2024-09-12T17:10:41.985 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:10:42.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:10:42.099 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7902722' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFL0IVSJAK1eV412x6lgJcr0ZGXjVXJ8oTr0DXoacMWYyx0XvuZimVHTbQQHms6zWT16peb9GHDiQ1piW8mjnNU= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOggYi/usk5mCuulBTM5YuZnEG5C2x7QUBj3lqCRPuvuO5XK/Q7o2L8wSXgHd2WiuI0Jsh7qMpJo9yQ1Nh3Ppro= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:10:42.099 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:10:42.100 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:10:42.100 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:10:42.101 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:10:42.123 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:10:42.123 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:10:42.123 INFO:teuthology.packaging:ref: None 2024-09-12T17:10:42.123 INFO:teuthology.packaging:tag: None 2024-09-12T17:10:42.123 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:10:42.123 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:10:42.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:10:42.274 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-12T17:10:42.275 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:10:42.282 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:10:42.283 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:10:42.295 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:10:42.312 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:10:42.319 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:10:42.344 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:05:46.623277', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFL0IVSJAK1eV412x6lgJcr0ZGXjVXJ8oTr0DXoacMWYyx0XvuZimVHTbQQHms6zWT16peb9GHDiQ1piW8mjnNU='} 2024-09-12T17:10:42.369 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:05:46.621341', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOggYi/usk5mCuulBTM5YuZnEG5C2x7QUBj3lqCRPuvuO5XK/Q7o2L8wSXgHd2WiuI0Jsh7qMpJo9yQ1Nh3Ppro='} 2024-09-12T17:10:42.370 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:10:42.377 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:10:42.378 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:10:42.378 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:10:42.439 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f329fcc3ac0>, signals=[15]) 2024-09-12T17:10:42.439 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:10:42.445 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:10:42.445 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T17:10:42.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:10:42.527 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T17:10:42.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:10:42.617 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:10:42.624 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-12T17:10:42.642 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-12T17:10:42.642 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:10:42.700 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-09-12T17:10:42.701 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:10:42.701 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:10:42.701 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:10:42.701 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:10:42.701 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:10:42.701 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:10:42.702 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-12T17:10:42.720 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-09-12T17:10:42.739 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-09-12T17:10:42.739 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-09-12T17:10:42.797 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:10:42.798 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:10:42.799 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:10:42.799 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:10:42.799 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-09-12T17:10:42.820 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:10:42.829 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:10:42.834 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:10:42.835 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:10:42.837 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:10:42.855 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:10:42.863 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:10:42.863 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:10:42.895 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:10:42.987 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:10:43.043 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:10:43.058 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:10:43.058 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:10:43.058 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:10:43.059 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:10:43.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:43.076 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-12T17:10:43.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:43.078 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-09-12T17:10:43.133 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:10:43.134 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.14.0-503.el9.x86_64 2024-09-12T17:10:43.134 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-09-12T17:10:43.137 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:10:43.137 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-503.el9.x86_64 2024-09-12T17:10:43.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-09-12T17:10:45.757 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 8.2 MB 00:00 2024-09-12T17:10:47.956 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-12T17:10:49.649 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.2 MB 00:04 2024-09-12T17:10:51.799 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-12T17:10:52.456 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T17:10:53.957 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-12T17:10:54.836 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T17:10:56.200 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T17:10:57.875 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-12T17:10:59.004 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-12T17:11:00.450 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-12T17:11:02.448 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:11:02.449 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:11:02.557 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:11:02.561 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:11:02.562 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:11:02.562 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:11:02.562 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-12T17:11:02.562 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-12T17:11:02.562 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-09-12T17:11:02.562 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:11:02.563 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 79 M 2024-09-12T17:11:02.563 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 126 M 2024-09-12T17:11:02.563 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-12T17:11:02.977 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 167 kB/s | 23 kB 00:00 2024-09-12T17:11:03.627 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-12T17:11:04.459 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T17:11:04.527 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-09-12T17:11:04.786 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-12T17:11:04.786 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:11:04.786 INFO:teuthology.orchestra.run.smithi063.stdout:Total 35 MB/s | 79 MB 00:02 2024-09-12T17:11:05.497 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-12T17:11:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-12T17:11:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-12T17:11:06.457 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:11:06.458 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:11:06.538 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:11:06.549 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:11:06.550 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:11:06.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:11:06.550 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-12T17:11:06.550 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-12T17:11:06.550 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-09-12T17:11:06.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:11:06.550 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 79 M 2024-09-12T17:11:06.551 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 126 M 2024-09-12T17:11:06.551 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-12T17:11:06.844 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-12T17:11:06.844 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-12T17:11:07.361 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 41 kB/s | 23 kB 00:00 2024-09-12T17:11:08.186 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T17:11:08.827 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-12T17:11:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-12T17:11:09.636 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-12T17:11:09.636 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:11:09.636 INFO:teuthology.orchestra.run.smithi082.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-12T17:11:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:11:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:11:10.316 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-12T17:11:10.660 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-12T17:11:10.661 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-12T17:11:11.598 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-12T17:11:11.598 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-12T17:11:12.968 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:11:13.107 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:11:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-12T17:11:14.679 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:11:14.763 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:11:17.672 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:11:18.235 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:11:18.274 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:11:22.528 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:11:23.422 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:11:27.419 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:02.306 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:02.346 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:02.678 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:02.678 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:12:02.678 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:12:02.678 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:12:03.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:03.531 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:12:03.531 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-12T17:12:03.531 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:12:03.531 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:12:03.531 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:12:03.531 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:12:03.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:12:03.532 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-12T17:12:03.871 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:12:03.991 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:12:03.991 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:12:03.991 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:12:03.992 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:12:03.992 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:12:03.992 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:12:03.992 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:12:03.992 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:12:04.050 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:12:04.051 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:12:04.051 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-09-12T17:12:04.087 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 82.el9 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8274670 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:12:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:12:04.089 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:12:04.090 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:12:04.090 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:12:04.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:12:04.706 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-12T17:12:05.726 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:05.769 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:06.053 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:12:06.070 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:06.070 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:12:06.070 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:12:06.070 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:12:06.095 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-12T17:12:06.097 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-12T17:12:06.112 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.ba4FgWiev8 2024-09-12T17:12:06.112 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ba4FgWiev8 2024-09-12T17:12:06.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.ba4FgWiev8 2024-09-12T17:12:06.315 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.ba4FgWiev8 is 6KB 2024-09-12T17:12:06.364 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.ba4FgWiev8 2024-09-12T17:12:06.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:12:06.441 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:12:06.441 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:12:06.441 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:12:06.441 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:12:06.442 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:12:06.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-12T17:12:06.889 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:12:06.890 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-12T17:12:07.247 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:12:07.335 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:12:07.335 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:12:07.335 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:12:07.336 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:12:07.336 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:12:07.336 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:12:07.336 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:12:07.336 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:12:07.394 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:12:07.394 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:12:07.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-09-12T17:12:07.426 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-09-12T17:12:07.426 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-09-12T17:12:07.426 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 82.el9 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8274670 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:12:07.427 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-09-12T17:12:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:12:07.429 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:12:07.430 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:12:07.430 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:12:07.430 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:12:08.036 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-09-12T17:12:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:12:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-09-12T17:12:09.384 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-09-12T17:12:09.400 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.GKzUTQGdh7 2024-09-12T17:12:09.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GKzUTQGdh7 2024-09-12T17:12:09.467 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.GKzUTQGdh7 2024-09-12T17:12:09.605 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.GKzUTQGdh7 is 6KB 2024-09-12T17:12:09.655 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.GKzUTQGdh7 2024-09-12T17:12:09.670 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:12:09.733 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:12:09.733 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:12:09.733 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:12:09.734 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:12:09.735 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:12:09.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-09-12T17:12:36.621 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:12:36.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T17:12:36.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:12:39.897 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:12:39.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-12T17:12:39.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:12:55.101 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-12T17:12:58.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-09-12T17:13:04.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T17:13:04.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:13:07.169 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-12T17:13:07.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-12T17:13:07.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:13:10.493 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-09-12T17:13:19.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T17:13:19.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:13:22.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-12T17:13:22.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:13:37.597 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-12T17:13:52.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T17:13:52.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:13:52.979 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-12T17:13:53.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T17:13:53.681 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:13:53.681 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-12T17:13:53.728 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:13:53.728 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:13:53.728 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:13:53.728 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:13:54.568 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-09-12T17:13:54.729 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:13:54.730 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:13:54.907 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-09-12T17:13:54.948 DEBUG:teuthology.parallel:result is None 2024-09-12T17:13:55.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-12T17:13:55.216 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:13:55.216 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-09-12T17:13:55.231 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:13:55.231 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:13:55.232 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:13:55.232 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:13:56.232 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:13:56.233 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:13:56.298 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-09-12T17:13:56.330 DEBUG:teuthology.parallel:result is None 2024-09-12T17:13:56.330 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:13:56.343 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:13:56.343 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:13:56.347 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:13:56.366 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:13:56.374 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:13:56.382 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:13:56.382 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:13:56.407 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:13:56.441 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:13:56.447 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:13:56.448 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:13:56.470 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:13:56.508 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:13:56.510 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:13:56.520 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:13:56.521 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:13:56.523 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:13:56.529 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:13:56.530 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:13:56.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:13:56.591 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:13:56.601 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:13:56.601 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:13:56.634 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:13:56.650 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:13:56.732 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:13:56.784 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:13:56.896 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:13:56.923 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:13:56.924 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:13:56.990 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:13:57.035 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:13:57.085 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:13:57.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:13:57.213 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:13:57.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:13:57.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-12T17:13:57.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-09-12T17:13:57.330 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:13:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:13:57.723 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:13:57.730 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:13:57.731 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:13:57.748 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:13:57.757 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-09-12T17:13:57.825 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-09-12T17:13:57.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-09-12T17:13:57.885 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-09-12T17:13:57.887 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:13:57.888 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-09-12T17:13:57.914 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-09-12T17:13:57.914 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-09-12T17:13:57.938 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-09-12T17:13:57.938 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive'} 2024-09-12T17:13:57.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:13:57.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:13:57.984 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:13:58.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:13:58.012 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:13:58.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:13:58.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:13:58.098 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:13:58.107 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:13:58.134 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:13:58.136 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:17:50.314 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2024-09-12T17:17:50.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T17:17:50.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:17:50.397 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-12T17:17:50.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T17:17:50.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-12T17:17:50.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:17:50.565 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-09-12T17:17:50.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-12T17:17:50.641 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:17:50.656 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:17:50.656 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:17:50.657 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:17:50.659 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:17:50.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:17:50.689 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:17:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:17:50.710 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:17:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:17:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-09-12T17:17:50.743 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-09-12T17:17:50.750 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-09-12T17:17:50.758 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:17:50.761 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-09-12T17:17:50.772 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:17:50.775 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:17:50.789 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:17:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:17:50.833 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:17:50.833 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-12T17:17:50.833 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.833 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.834 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.834 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.856 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:17:50.861 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:17:50.861 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-09-12T17:17:50.861 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.861 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.861 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.861 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:17:50.861 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:17:50.872 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:17:50.872 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:17:50.872 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:17:50.872 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:17:50.878 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:17:50.878 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:17:50.878 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:17:50.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:17:50.881 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:17:50.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:17:51.028 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:17:51.028 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:17:51.035 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:17:51.035 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:17:51.137 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:17:51.137 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:17:51.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:17:51.144 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:17:51.144 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:17:51.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:17:51.164 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:17:51.165 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:17:51.170 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:17:51.170 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:17:51.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:17:51.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:17:51.308 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:17:51.310 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:17:51.373 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-09-12T17:17:51.374 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-09-12T17:17:51.375 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-09-12T17:17:51.376 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-09-12T17:17:51.603 INFO:teuthology.orchestra.run.smithi082.stdout:45 files removed 2024-09-12T17:17:51.619 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-09-12T17:17:51.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:17:51.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:17:52.185 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-12T17:17:52.205 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 326 kB/s | 84 kB 00:00 2024-09-12T17:17:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-12T17:17:52.498 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-12T17:17:52.761 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T17:17:52.782 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T17:17:53.286 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T17:17:54.390 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-12T17:17:55.212 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T17:17:57.583 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-12T17:17:59.571 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T17:18:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-12T17:18:01.834 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T17:18:02.317 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.5 MB 00:00 2024-09-12T17:18:04.118 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T17:18:05.038 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T17:18:07.273 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T17:18:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:18:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:18:09.672 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-12T17:18:09.700 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================================== 2024-09-12T17:18:09.700 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-12T17:18:09.700 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================================== 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:18:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:18:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:18:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:18:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:18:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:18:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:18:09.703 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:18:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:18:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:18:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:18:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:18:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:18:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:18:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:18:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:18:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:18:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:18:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:18:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:18:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:18:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:18:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:18:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:18:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:18:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:18:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-12T17:18:09.723 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================================== 2024-09-12T17:18:09.724 INFO:teuthology.orchestra.run.smithi082.stdout:Install 283 Packages 2024-09-12T17:18:09.724 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 2 Packages 2024-09-12T17:18:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:18:09.724 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 322 M 2024-09-12T17:18:09.724 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-12T17:18:10.682 INFO:teuthology.orchestra.run.smithi082.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-12T17:18:10.736 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-12T17:18:10.883 INFO:teuthology.orchestra.run.smithi082.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 4.4 MB/s | 900 kB 00:00 2024-09-12T17:18:10.949 INFO:teuthology.orchestra.run.smithi082.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.1 MB/s | 145 kB 00:00 2024-09-12T17:18:11.058 INFO:teuthology.orchestra.run.smithi082.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-12T17:18:11.133 INFO:teuthology.orchestra.run.smithi082.stdout:(5/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 13 MB/s | 2.4 MB 00:00 2024-09-12T17:18:11.184 INFO:teuthology.orchestra.run.smithi082.stdout:(6/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-12T17:18:11.542 INFO:teuthology.orchestra.run.smithi082.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-12T17:18:11.767 INFO:teuthology.orchestra.run.smithi082.stdout:(8/285): ceph-common-19.3.0-4762.gbad475c1.el9. 18 MB/s | 22 MB 00:01 2024-09-12T17:18:11.801 INFO:teuthology.orchestra.run.smithi082.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 763 kB/s | 25 kB 00:00 2024-09-12T17:18:12.168 INFO:teuthology.orchestra.run.smithi082.stdout:(10/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 17 MB/s | 17 MB 00:00 2024-09-12T17:18:12.293 INFO:teuthology.orchestra.run.smithi082.stdout:(11/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 15 MB/s | 11 MB 00:00 2024-09-12T17:18:12.310 INFO:teuthology.orchestra.run.smithi082.stdout:(12/285): libcephfs-devel-19.3.0-4762.gbad475c1 224 kB/s | 32 kB 00:00 2024-09-12T17:18:12.352 INFO:teuthology.orchestra.run.smithi082.stdout:(13/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 13 MB/s | 756 kB 00:00 2024-09-12T17:18:12.377 INFO:teuthology.orchestra.run.smithi082.stdout:(14/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.3 MB/s | 161 kB 00:00 2024-09-12T17:18:12.403 INFO:teuthology.orchestra.run.smithi082.stdout:(15/285): librados-devel-19.3.0-4762.gbad475c1. 2.4 MB/s | 126 kB 00:00 2024-09-12T17:18:12.436 INFO:teuthology.orchestra.run.smithi082.stdout:(16/285): libradosstriper1-19.3.0-4762.gbad475c 8.5 MB/s | 508 kB 00:00 2024-09-12T17:18:12.503 INFO:teuthology.orchestra.run.smithi082.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 678 kB/s | 45 kB 00:00 2024-09-12T17:18:12.595 INFO:teuthology.orchestra.run.smithi082.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 1.5 MB/s | 143 kB 00:00 2024-09-12T17:18:12.670 INFO:teuthology.orchestra.run.smithi082.stdout:(19/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-12T17:18:12.696 INFO:teuthology.orchestra.run.smithi082.stdout:(20/285): python3-cephfs-19.3.0-4762.gbad475c1. 1.6 MB/s | 161 kB 00:00 2024-09-12T17:18:12.721 INFO:teuthology.orchestra.run.smithi082.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 6.3 MB/s | 321 kB 00:00 2024-09-12T17:18:12.746 INFO:teuthology.orchestra.run.smithi082.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 5.9 MB/s | 305 kB 00:00 2024-09-12T17:18:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T17:18:12.797 INFO:teuthology.orchestra.run.smithi082.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:18:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-12T17:18:12.922 INFO:teuthology.orchestra.run.smithi082.stdout:(26/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 21 MB/s | 3.2 MB 00:00 2024-09-12T17:18:12.948 INFO:teuthology.orchestra.run.smithi082.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4762.g 410 kB/s | 34 kB 00:00 2024-09-12T17:18:12.973 INFO:teuthology.orchestra.run.smithi082.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 3.0 MB/s | 154 kB 00:00 2024-09-12T17:18:13.139 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:18:13.140 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:18:13.239 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-12T17:18:13.271 INFO:teuthology.orchestra.run.smithi063.stdout:====================================================================================================== 2024-09-12T17:18:13.271 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-12T17:18:13.271 INFO:teuthology.orchestra.run.smithi063.stdout:====================================================================================================== 2024-09-12T17:18:13.271 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-12T17:18:13.271 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:18:13.271 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:18:13.272 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:18:13.273 INFO:teuthology.orchestra.run.smithi063.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:18:13.274 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:18:13.275 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:18:13.276 INFO:teuthology.orchestra.run.smithi063.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:18:13.277 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:18:13.278 INFO:teuthology.orchestra.run.smithi063.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:18:13.279 INFO:teuthology.orchestra.run.smithi063.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:18:13.280 INFO:teuthology.orchestra.run.smithi063.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:18:13.281 INFO:teuthology.orchestra.run.smithi063.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:18:13.282 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:18:13.283 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:18:13.284 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:18:13.285 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:18:13.286 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:18:13.287 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:18:13.288 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:18:13.289 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:18:13.290 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:18:13.291 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:18:13.292 INFO:teuthology.orchestra.run.smithi063.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:18:13.293 INFO:teuthology.orchestra.run.smithi063.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:18:13.294 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout:====================================================================================================== 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout:Install 283 Packages 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 2 Packages 2024-09-12T17:18:13.295 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:18:13.296 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 322 M 2024-09-12T17:18:13.296 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-12T17:18:13.406 INFO:teuthology.orchestra.run.smithi082.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-12T17:18:13.482 INFO:teuthology.orchestra.run.smithi082.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 3.8 MB/s | 291 kB 00:00 2024-09-12T17:18:13.540 INFO:teuthology.orchestra.run.smithi082.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 848 kB/s | 49 kB 00:00 2024-09-12T17:18:13.599 INFO:teuthology.orchestra.run.smithi082.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4762.gb 282 kB/s | 16 kB 00:00 2024-09-12T17:18:13.645 INFO:teuthology.orchestra.run.smithi063.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-09-12T17:18:13.666 INFO:teuthology.orchestra.run.smithi082.stdout:(33/285): ceph-volume-19.3.0-4762.gbad475c1.el9 4.2 MB/s | 285 kB 00:00 2024-09-12T17:18:13.817 INFO:teuthology.orchestra.run.smithi082.stdout:(34/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 16 MB/s | 14 MB 00:00 2024-09-12T17:18:13.821 INFO:teuthology.orchestra.run.smithi063.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 5.0 MB/s | 900 kB 00:00 2024-09-12T17:18:13.858 INFO:teuthology.orchestra.run.smithi082.stdout:(35/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 4.0 MB/s | 783 kB 00:00 2024-09-12T17:18:13.871 INFO:teuthology.orchestra.run.smithi063.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.9 MB/s | 145 kB 00:00 2024-09-12T17:18:13.996 INFO:teuthology.orchestra.run.smithi063.stdout:(4/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 19 MB/s | 2.4 MB 00:00 2024-09-12T17:18:14.097 INFO:teuthology.orchestra.run.smithi063.stdout:(5/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 15 MB/s | 1.5 MB 00:00 2024-09-12T17:18:14.267 INFO:teuthology.orchestra.run.smithi082.stdout:(36/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 18 MB/s | 45 MB 00:02 2024-09-12T17:18:14.305 INFO:teuthology.orchestra.run.smithi063.stdout:(6/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 23 MB/s | 4.8 MB 00:00 2024-09-12T17:18:14.380 INFO:teuthology.orchestra.run.smithi063.stdout:(7/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 6.1 MB/s | 5.5 MB 00:00 2024-09-12T17:18:14.617 INFO:teuthology.orchestra.run.smithi082.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 112 kB/s | 85 kB 00:00 2024-09-12T17:18:14.634 INFO:teuthology.orchestra.run.smithi082.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-09-12T17:18:14.784 INFO:teuthology.orchestra.run.smithi082.stdout:(39/285): ModemManager-glib-1.20.2-1.el9.x86_64 353 kB/s | 335 kB 00:00 2024-09-12T17:18:14.981 INFO:teuthology.orchestra.run.smithi063.stdout:(8/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x86 25 MB/s | 17 MB 00:00 2024-09-12T17:18:15.039 INFO:teuthology.orchestra.run.smithi063.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 434 kB/s | 25 kB 00:00 2024-09-12T17:18:15.051 INFO:teuthology.orchestra.run.smithi082.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 191 kB/s | 80 kB 00:00 2024-09-12T17:18:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:(41/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 523 kB/s | 262 kB 00:00 2024-09-12T17:18:15.310 INFO:teuthology.orchestra.run.smithi082.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 104 kB/s | 27 kB 00:00 2024-09-12T17:18:15.323 INFO:teuthology.orchestra.run.smithi063.stdout:(10/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 12 MB/s | 11 MB 00:00 2024-09-12T17:18:15.360 INFO:teuthology.orchestra.run.smithi082.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-12T17:18:15.373 INFO:teuthology.orchestra.run.smithi063.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 637 kB/s | 32 kB 00:00 2024-09-12T17:18:15.482 INFO:teuthology.orchestra.run.smithi063.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 6.8 MB/s | 756 kB 00:00 2024-09-12T17:18:15.602 INFO:teuthology.orchestra.run.smithi082.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 395 kB/s | 191 kB 00:00 2024-09-12T17:18:15.727 INFO:teuthology.orchestra.run.smithi082.stdout:(45/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 225 kB/s | 94 kB 00:00 2024-09-12T17:18:15.732 INFO:teuthology.orchestra.run.smithi063.stdout:(13/285): ceph-common-19.3.0-4762.gbad475c1.el9 9.6 MB/s | 22 MB 00:02 2024-09-12T17:18:15.757 INFO:teuthology.orchestra.run.smithi063.stdout:(14/285): libcephsqlite-19.3.0-4762.gbad475c1.e 585 kB/s | 161 kB 00:00 2024-09-12T17:18:15.825 INFO:teuthology.orchestra.run.smithi063.stdout:(15/285): librados-devel-19.3.0-4762.gbad475c1. 1.3 MB/s | 126 kB 00:00 2024-09-12T17:18:15.861 INFO:teuthology.orchestra.run.smithi082.stdout:(46/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 506 kB/s | 253 kB 00:00 2024-09-12T17:18:15.925 INFO:teuthology.orchestra.run.smithi063.stdout:(16/285): libradosstriper1-19.3.0-4762.gbad475c 3.0 MB/s | 508 kB 00:00 2024-09-12T17:18:15.984 INFO:teuthology.orchestra.run.smithi063.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 777 kB/s | 45 kB 00:00 2024-09-12T17:18:16.067 INFO:teuthology.orchestra.run.smithi063.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 1.7 MB/s | 143 kB 00:00 2024-09-12T17:18:16.145 INFO:teuthology.orchestra.run.smithi082.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 255 kB/s | 106 kB 00:00 2024-09-12T17:18:16.192 INFO:teuthology.orchestra.run.smithi063.stdout:(19/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 15 MB/s | 5.5 MB 00:00 2024-09-12T17:18:16.217 INFO:teuthology.orchestra.run.smithi063.stdout:(20/285): python3-cephfs-19.3.0-4762.gbad475c1. 1.1 MB/s | 161 kB 00:00 2024-09-12T17:18:16.243 INFO:teuthology.orchestra.run.smithi063.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 6.3 MB/s | 321 kB 00:00 2024-09-12T17:18:16.268 INFO:teuthology.orchestra.run.smithi063.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 5.9 MB/s | 305 kB 00:00 2024-09-12T17:18:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:(48/285): python3-cryptography-36.0.1-4.el9.x86 1.8 MB/s | 1.2 MB 00:00 2024-09-12T17:18:16.293 INFO:teuthology.orchestra.run.smithi063.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T17:18:16.295 INFO:teuthology.orchestra.run.smithi082.stdout:(49/285): python3-pycparser-2.20-6.el9.noarch.r 312 kB/s | 135 kB 00:00 2024-09-12T17:18:16.318 INFO:teuthology.orchestra.run.smithi063.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:18:16.369 INFO:teuthology.orchestra.run.smithi063.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-12T17:18:16.469 INFO:teuthology.orchestra.run.smithi063.stdout:(26/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 18 MB/s | 3.2 MB 00:00 2024-09-12T17:18:16.494 INFO:teuthology.orchestra.run.smithi063.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4762.g 274 kB/s | 34 kB 00:00 2024-09-12T17:18:16.520 INFO:teuthology.orchestra.run.smithi063.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 3.0 MB/s | 154 kB 00:00 2024-09-12T17:18:16.562 INFO:teuthology.orchestra.run.smithi082.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 299 kB/s | 125 kB 00:00 2024-09-12T17:18:16.779 INFO:teuthology.orchestra.run.smithi082.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 422 kB/s | 215 kB 00:00 2024-09-12T17:18:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 757 kB/s | 650 kB 00:00 2024-09-12T17:18:17.228 INFO:teuthology.orchestra.run.smithi063.stdout:(29/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 21 MB/s | 45 MB 00:02 2024-09-12T17:18:17.329 INFO:teuthology.orchestra.run.smithi063.stdout:(30/285): ceph-mgr-diskprediction-local-19.3.0- 9.2 MB/s | 7.4 MB 00:00 2024-09-12T17:18:17.354 INFO:teuthology.orchestra.run.smithi063.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4762.gba 2.3 MB/s | 291 kB 00:00 2024-09-12T17:18:17.379 INFO:teuthology.orchestra.run.smithi063.stdout:(32/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 992 kB/s | 49 kB 00:00 2024-09-12T17:18:17.404 INFO:teuthology.orchestra.run.smithi063.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4762.gb 328 kB/s | 16 kB 00:00 2024-09-12T17:18:17.438 INFO:teuthology.orchestra.run.smithi063.stdout:(34/285): ceph-volume-19.3.0-4762.gbad475c1.el9 4.8 MB/s | 285 kB 00:00 2024-09-12T17:18:17.496 INFO:teuthology.orchestra.run.smithi063.stdout:(35/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 8.3 MB/s | 783 kB 00:00 2024-09-12T17:18:17.613 INFO:teuthology.orchestra.run.smithi063.stdout:(36/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.9 MB/s | 335 kB 00:00 2024-09-12T17:18:17.629 INFO:teuthology.orchestra.run.smithi082.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 621 kB/s | 523 kB 00:00 2024-09-12T17:18:17.756 INFO:teuthology.orchestra.run.smithi063.stdout:(37/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 11 MB/s | 14 MB 00:01 2024-09-12T17:18:17.781 INFO:teuthology.orchestra.run.smithi063.stdout:(38/285): bluez-libs-5.56-6.el9.x86_64.rpm 298 kB/s | 85 kB 00:00 2024-09-12T17:18:17.806 INFO:teuthology.orchestra.run.smithi063.stdout:(39/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 257 kB/s | 49 kB 00:00 2024-09-12T17:18:17.863 INFO:teuthology.orchestra.run.smithi082.stdout:(54/285): adwaita-icon-theme-40.1.1-3.el9.noarc 9.2 MB/s | 12 MB 00:01 2024-09-12T17:18:17.873 INFO:teuthology.orchestra.run.smithi063.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.2 MB/s | 262 kB 00:00 2024-09-12T17:18:17.888 INFO:teuthology.orchestra.run.smithi082.stdout:(55/285): apache-commons-cli-1.4-17.el9.noarch. 96 kB/s | 71 kB 00:00 2024-09-12T17:18:17.906 INFO:teuthology.orchestra.run.smithi063.stdout:(41/285): libgfortran-11.5.0-2.el9.x86_64.rpm 7.8 MB/s | 801 kB 00:00 2024-09-12T17:18:17.940 INFO:teuthology.orchestra.run.smithi063.stdout:(42/285): fuse-2.9.9-16.el9.x86_64.rpm 501 kB/s | 80 kB 00:00 2024-09-12T17:18:17.965 INFO:teuthology.orchestra.run.smithi063.stdout:(43/285): libpciaccess-0.16-7.el9.x86_64.rpm 291 kB/s | 27 kB 00:00 2024-09-12T17:18:18.032 INFO:teuthology.orchestra.run.smithi063.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-12T17:18:18.066 INFO:teuthology.orchestra.run.smithi063.stdout:(45/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 749 kB/s | 94 kB 00:00 2024-09-12T17:18:18.099 INFO:teuthology.orchestra.run.smithi063.stdout:(46/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-12T17:18:18.141 INFO:teuthology.orchestra.run.smithi063.stdout:(47/285): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-12T17:18:18.175 INFO:teuthology.orchestra.run.smithi063.stdout:(48/285): python3-ply-3.11-14.el9.noarch.rpm 978 kB/s | 106 kB 00:00 2024-09-12T17:18:18.200 INFO:teuthology.orchestra.run.smithi063.stdout:(49/285): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-12T17:18:18.226 INFO:teuthology.orchestra.run.smithi063.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-12T17:18:18.267 INFO:teuthology.orchestra.run.smithi063.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-12T17:18:18.401 INFO:teuthology.orchestra.run.smithi063.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 3.2 MB/s | 650 kB 00:00 2024-09-12T17:18:18.443 INFO:teuthology.orchestra.run.smithi063.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.7 MB/s | 71 kB 00:00 2024-09-12T17:18:18.477 INFO:teuthology.orchestra.run.smithi063.stdout:(54/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.5 MB/s | 523 kB 00:00 2024-09-12T17:18:18.502 INFO:teuthology.orchestra.run.smithi063.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 5.0 MB/s | 302 kB 00:00 2024-09-12T17:18:18.528 INFO:teuthology.orchestra.run.smithi063.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 283 kB 00:00 2024-09-12T17:18:18.563 INFO:teuthology.orchestra.run.smithi082.stdout:(56/285): apache-commons-codec-1.15-7.el9.noarc 323 kB/s | 302 kB 00:00 2024-09-12T17:18:18.569 INFO:teuthology.orchestra.run.smithi063.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 8.2 MB/s | 559 kB 00:00 2024-09-12T17:18:18.594 INFO:teuthology.orchestra.run.smithi063.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T17:18:18.620 INFO:teuthology.orchestra.run.smithi063.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-09-12T17:18:18.630 INFO:teuthology.orchestra.run.smithi082.stdout:(57/285): apache-commons-io-2.8.0-8.el9.noarch. 370 kB/s | 283 kB 00:00 2024-09-12T17:18:18.645 INFO:teuthology.orchestra.run.smithi063.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 462 kB/s | 23 kB 00:00 2024-09-12T17:18:18.670 INFO:teuthology.orchestra.run.smithi063.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T17:18:18.687 INFO:teuthology.orchestra.run.smithi063.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 358 kB/s | 15 kB 00:00 2024-09-12T17:18:18.712 INFO:teuthology.orchestra.run.smithi063.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-12T17:18:18.729 INFO:teuthology.orchestra.run.smithi063.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 1.2 MB/s | 53 kB 00:00 2024-09-12T17:18:18.739 INFO:teuthology.orchestra.run.smithi082.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 657 kB/s | 559 kB 00:00 2024-09-12T17:18:18.755 INFO:teuthology.orchestra.run.smithi063.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2024-09-12T17:18:18.771 INFO:teuthology.orchestra.run.smithi063.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-12T17:18:18.789 INFO:teuthology.orchestra.run.smithi063.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 843 kB/s | 28 kB 00:00 2024-09-12T17:18:18.814 INFO:teuthology.orchestra.run.smithi063.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 2.6 MB/s | 113 kB 00:00 2024-09-12T17:18:18.856 INFO:teuthology.orchestra.run.smithi063.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 7.7 MB/s | 525 kB 00:00 2024-09-12T17:18:18.906 INFO:teuthology.orchestra.run.smithi063.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 10 MB/s | 980 kB 00:00 2024-09-12T17:18:18.940 INFO:teuthology.orchestra.run.smithi063.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 9.2 MB/s | 781 kB 00:00 2024-09-12T17:18:18.973 INFO:teuthology.orchestra.run.smithi063.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.7 MB/s | 325 kB 00:00 2024-09-12T17:18:19.007 INFO:teuthology.orchestra.run.smithi063.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2024-09-12T17:18:19.133 INFO:teuthology.orchestra.run.smithi063.stdout:(74/285): adwaita-icon-theme-40.1.1-3.el9.noarc 13 MB/s | 12 MB 00:00 2024-09-12T17:18:19.174 INFO:teuthology.orchestra.run.smithi063.stdout:(75/285): flatpak-1.12.9-1.el9.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2024-09-12T17:18:19.197 INFO:teuthology.orchestra.run.smithi082.stdout:(59/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 137 kB/s | 87 kB 00:00 2024-09-12T17:18:19.199 INFO:teuthology.orchestra.run.smithi063.stdout:(76/285): flatpak-selinux-1.12.9-1.el9.noarch.r 112 kB/s | 22 kB 00:00 2024-09-12T17:18:19.225 INFO:teuthology.orchestra.run.smithi063.stdout:(77/285): flatpak-session-helper-1.12.9-1.el9.x 796 kB/s | 73 kB 00:00 2024-09-12T17:18:19.267 INFO:teuthology.orchestra.run.smithi063.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-12T17:18:19.281 INFO:teuthology.orchestra.run.smithi082.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 43 kB/s | 23 kB 00:00 2024-09-12T17:18:19.292 INFO:teuthology.orchestra.run.smithi063.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-12T17:18:19.317 INFO:teuthology.orchestra.run.smithi063.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-12T17:18:19.343 INFO:teuthology.orchestra.run.smithi063.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-12T17:18:19.368 INFO:teuthology.orchestra.run.smithi063.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-12T17:18:19.373 INFO:teuthology.orchestra.run.smithi082.stdout:(61/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 263 kB/s | 195 kB 00:00 2024-09-12T17:18:19.393 INFO:teuthology.orchestra.run.smithi063.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 9.2 MB/s | 473 kB 00:00 2024-09-12T17:18:19.418 INFO:teuthology.orchestra.run.smithi063.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-12T17:18:19.443 INFO:teuthology.orchestra.run.smithi063.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 682 kB/s | 34 kB 00:00 2024-09-12T17:18:19.494 INFO:teuthology.orchestra.run.smithi063.stdout:(86/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 19 MB/s | 1.4 MB 00:00 2024-09-12T17:18:19.553 INFO:teuthology.orchestra.run.smithi063.stdout:(87/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-09-12T17:18:19.578 INFO:teuthology.orchestra.run.smithi063.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 396 kB/s | 33 kB 00:00 2024-09-12T17:18:19.628 INFO:teuthology.orchestra.run.smithi063.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 12 MB/s | 2.2 MB 00:00 2024-09-12T17:18:19.687 INFO:teuthology.orchestra.run.smithi063.stdout:(90/285): guava-30.1-6.el9.noarch.rpm 21 MB/s | 2.3 MB 00:00 2024-09-12T17:18:19.712 INFO:teuthology.orchestra.run.smithi063.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 2.6 MB/s | 219 kB 00:00 2024-09-12T17:18:19.779 INFO:teuthology.orchestra.run.smithi063.stdout:(92/285): gtk3-3.24.31-5.el9.x86_64.rpm 22 MB/s | 4.9 MB 00:00 2024-09-12T17:18:19.781 INFO:teuthology.orchestra.run.smithi082.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 30 kB/s | 15 kB 00:00 2024-09-12T17:18:19.804 INFO:teuthology.orchestra.run.smithi063.stdout:(93/285): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-09-12T17:18:19.838 INFO:teuthology.orchestra.run.smithi063.stdout:(94/285): httpcomponents-core-4.4.13-7.el9.noar 4.9 MB/s | 632 kB 00:00 2024-09-12T17:18:19.863 INFO:teuthology.orchestra.run.smithi063.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 771 kB/s | 45 kB 00:00 2024-09-12T17:18:19.888 INFO:teuthology.orchestra.run.smithi063.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-12T17:18:19.922 INFO:teuthology.orchestra.run.smithi063.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.9 MB/s | 413 kB 00:00 2024-09-12T17:18:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 16 MB/s | 3.5 MB 00:00 2024-09-12T17:18:20.007 INFO:teuthology.orchestra.run.smithi082.stdout:(63/285): atk-2.36.0-5.el9.x86_64.rpm 361 kB/s | 292 kB 00:00 2024-09-12T17:18:20.032 INFO:teuthology.orchestra.run.smithi082.stdout:(64/285): boost-program-options-1.75.0-8.el9.x8 162 kB/s | 107 kB 00:00 2024-09-12T17:18:20.056 INFO:teuthology.orchestra.run.smithi063.stdout:(99/285): java-11-openjdk-devel-11.0.20.1.1-2.e 20 MB/s | 3.3 MB 00:00 2024-09-12T17:18:20.073 INFO:teuthology.orchestra.run.smithi063.stdout:(100/285): javapackages-filesystem-6.0.0-4.el9. 173 kB/s | 13 kB 00:00 2024-09-12T17:18:20.089 INFO:teuthology.orchestra.run.smithi063.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.6 MB/s | 53 kB 00:00 2024-09-12T17:18:20.106 INFO:teuthology.orchestra.run.smithi063.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 719 kB/s | 24 kB 00:00 2024-09-12T17:18:20.140 INFO:teuthology.orchestra.run.smithi063.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 7.3 MB/s | 377 kB 00:00 2024-09-12T17:18:20.157 INFO:teuthology.orchestra.run.smithi063.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 706 kB/s | 35 kB 00:00 2024-09-12T17:18:20.182 INFO:teuthology.orchestra.run.smithi063.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 3.9 MB/s | 168 kB 00:00 2024-09-12T17:18:20.199 INFO:teuthology.orchestra.run.smithi063.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 265 kB/s | 11 kB 00:00 2024-09-12T17:18:20.225 INFO:teuthology.orchestra.run.smithi063.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 576 kB/s | 24 kB 00:00 2024-09-12T17:18:20.250 INFO:teuthology.orchestra.run.smithi063.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 615 kB/s | 31 kB 00:00 2024-09-12T17:18:20.275 INFO:teuthology.orchestra.run.smithi063.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 457 kB/s | 23 kB 00:00 2024-09-12T17:18:20.300 INFO:teuthology.orchestra.run.smithi063.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-12T17:18:20.326 INFO:teuthology.orchestra.run.smithi063.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-12T17:18:20.351 INFO:teuthology.orchestra.run.smithi063.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 301 kB/s | 15 kB 00:00 2024-09-12T17:18:20.376 INFO:teuthology.orchestra.run.smithi063.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 567 kB/s | 28 kB 00:00 2024-09-12T17:18:20.399 INFO:teuthology.orchestra.run.smithi082.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 86 kB/s | 53 kB 00:00 2024-09-12T17:18:20.401 INFO:teuthology.orchestra.run.smithi063.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-09-12T17:18:20.427 INFO:teuthology.orchestra.run.smithi063.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-09-12T17:18:20.452 INFO:teuthology.orchestra.run.smithi063.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-09-12T17:18:20.477 INFO:teuthology.orchestra.run.smithi063.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 607 kB/s | 30 kB 00:00 2024-09-12T17:18:20.503 INFO:teuthology.orchestra.run.smithi063.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-12T17:18:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 635 kB/s | 32 kB 00:00 2024-09-12T17:18:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-12T17:18:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-12T17:18:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 7.3 MB/s | 435 kB 00:00 2024-09-12T17:18:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 528 kB/s | 31 kB 00:00 2024-09-12T17:18:20.657 INFO:teuthology.orchestra.run.smithi082.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 98 kB/s | 61 kB 00:00 2024-09-12T17:18:20.663 INFO:teuthology.orchestra.run.smithi063.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-12T17:18:20.688 INFO:teuthology.orchestra.run.smithi063.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-12T17:18:20.713 INFO:teuthology.orchestra.run.smithi063.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 733 kB/s | 37 kB 00:00 2024-09-12T17:18:20.738 INFO:teuthology.orchestra.run.smithi063.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-12T17:18:20.764 INFO:teuthology.orchestra.run.smithi063.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-12T17:18:20.789 INFO:teuthology.orchestra.run.smithi063.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-12T17:18:20.791 INFO:teuthology.orchestra.run.smithi082.stdout:(67/285): colord-libs-1.4.5-4.el9.x86_64.rpm 295 kB/s | 229 kB 00:00 2024-09-12T17:18:20.814 INFO:teuthology.orchestra.run.smithi063.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T17:18:20.839 INFO:teuthology.orchestra.run.smithi063.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 824 kB/s | 41 kB 00:00 2024-09-12T17:18:20.865 INFO:teuthology.orchestra.run.smithi063.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 871 kB/s | 44 kB 00:00 2024-09-12T17:18:20.890 INFO:teuthology.orchestra.run.smithi063.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 670 kB/s | 34 kB 00:00 2024-09-12T17:18:20.932 INFO:teuthology.orchestra.run.smithi063.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 4.7 MB/s | 319 kB 00:00 2024-09-12T17:18:20.957 INFO:teuthology.orchestra.run.smithi063.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-12T17:18:20.983 INFO:teuthology.orchestra.run.smithi063.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-12T17:18:21.016 INFO:teuthology.orchestra.run.smithi063.stdout:(137/285): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T17:18:21.024 INFO:teuthology.orchestra.run.smithi082.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 45 kB/s | 28 kB 00:00 2024-09-12T17:18:21.042 INFO:teuthology.orchestra.run.smithi063.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-12T17:18:21.067 INFO:teuthology.orchestra.run.smithi063.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T17:18:21.092 INFO:teuthology.orchestra.run.smithi063.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-12T17:18:21.117 INFO:teuthology.orchestra.run.smithi063.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-09-12T17:18:21.143 INFO:teuthology.orchestra.run.smithi063.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 709 kB/s | 36 kB 00:00 2024-09-12T17:18:21.168 INFO:teuthology.orchestra.run.smithi063.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-12T17:18:21.193 INFO:teuthology.orchestra.run.smithi063.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-12T17:18:21.219 INFO:teuthology.orchestra.run.smithi063.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.7 MB/s | 193 kB 00:00 2024-09-12T17:18:21.235 INFO:teuthology.orchestra.run.smithi063.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 799 kB/s | 33 kB 00:00 2024-09-12T17:18:21.252 INFO:teuthology.orchestra.run.smithi063.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 580 kB/s | 19 kB 00:00 2024-09-12T17:18:21.270 INFO:teuthology.orchestra.run.smithi063.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 382 kB/s | 13 kB 00:00 2024-09-12T17:18:21.286 INFO:teuthology.orchestra.run.smithi063.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 1.2 MB/s | 42 kB 00:00 2024-09-12T17:18:21.320 INFO:teuthology.orchestra.run.smithi063.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-12T17:18:21.341 INFO:teuthology.orchestra.run.smithi082.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 166 kB/s | 113 kB 00:00 2024-09-12T17:18:21.345 INFO:teuthology.orchestra.run.smithi063.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-12T17:18:21.362 INFO:teuthology.orchestra.run.smithi063.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 302 kB/s | 13 kB 00:00 2024-09-12T17:18:21.387 INFO:teuthology.orchestra.run.smithi063.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 860 kB/s | 36 kB 00:00 2024-09-12T17:18:21.474 INFO:teuthology.orchestra.run.smithi063.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-12T17:18:21.505 INFO:teuthology.orchestra.run.smithi063.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T17:18:21.530 INFO:teuthology.orchestra.run.smithi063.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.6 MB/s | 151 kB 00:00 2024-09-12T17:18:21.555 INFO:teuthology.orchestra.run.smithi063.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 353 kB/s | 18 kB 00:00 2024-09-12T17:18:21.597 INFO:teuthology.orchestra.run.smithi063.stdout:(158/285): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-12T17:18:21.623 INFO:teuthology.orchestra.run.smithi063.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-09-12T17:18:21.648 INFO:teuthology.orchestra.run.smithi063.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 10 MB/s | 517 kB 00:00 2024-09-12T17:18:21.658 INFO:teuthology.orchestra.run.smithi082.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 605 kB/s | 525 kB 00:00 2024-09-12T17:18:21.681 INFO:teuthology.orchestra.run.smithi063.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-12T17:18:21.707 INFO:teuthology.orchestra.run.smithi063.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.9 MB/s | 112 kB 00:00 2024-09-12T17:18:21.749 INFO:teuthology.orchestra.run.smithi063.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 271 kB/s | 11 kB 00:00 2024-09-12T17:18:21.799 INFO:teuthology.orchestra.run.smithi063.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.7 MB/s | 139 kB 00:00 2024-09-12T17:18:21.908 INFO:teuthology.orchestra.run.smithi063.stdout:(165/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 39 MB/s | 8.8 MB 00:00 2024-09-12T17:18:21.933 INFO:teuthology.orchestra.run.smithi063.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-12T17:18:21.958 INFO:teuthology.orchestra.run.smithi063.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 725 kB/s | 36 kB 00:00 2024-09-12T17:18:21.991 INFO:teuthology.orchestra.run.smithi063.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 805 kB/s | 46 kB 00:00 2024-09-12T17:18:22.016 INFO:teuthology.orchestra.run.smithi063.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 566 kB/s | 32 kB 00:00 2024-09-12T17:18:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-12T17:18:22.075 INFO:teuthology.orchestra.run.smithi082.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 941 kB/s | 980 kB 00:01 2024-09-12T17:18:22.083 INFO:teuthology.orchestra.run.smithi063.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.8 MB/s | 163 kB 00:00 2024-09-12T17:18:22.167 INFO:teuthology.orchestra.run.smithi063.stdout:(172/285): openblas-openmp-0.3.26-2.el9.x86_64. 33 MB/s | 4.9 MB 00:00 2024-09-12T17:18:22.192 INFO:teuthology.orchestra.run.smithi063.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-09-12T17:18:22.217 INFO:teuthology.orchestra.run.smithi063.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-12T17:18:22.225 INFO:teuthology.orchestra.run.smithi082.stdout:(72/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 884 kB/s | 781 kB 00:00 2024-09-12T17:18:22.251 INFO:teuthology.orchestra.run.smithi063.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-12T17:18:22.276 INFO:teuthology.orchestra.run.smithi063.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-12T17:18:22.310 INFO:teuthology.orchestra.run.smithi063.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-12T17:18:22.343 INFO:teuthology.orchestra.run.smithi063.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 3.6 MB/s | 246 kB 00:00 2024-09-12T17:18:22.369 INFO:teuthology.orchestra.run.smithi063.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-12T17:18:22.394 INFO:teuthology.orchestra.run.smithi063.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-12T17:18:22.419 INFO:teuthology.orchestra.run.smithi063.stdout:(181/285): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-12T17:18:22.442 INFO:teuthology.orchestra.run.smithi082.stdout:(73/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 415 kB/s | 325 kB 00:00 2024-09-12T17:18:22.445 INFO:teuthology.orchestra.run.smithi063.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-12T17:18:22.503 INFO:teuthology.orchestra.run.smithi063.stdout:(183/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 23 MB/s | 1.9 MB 00:00 2024-09-12T17:18:22.529 INFO:teuthology.orchestra.run.smithi063.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.2 MB/s | 192 kB 00:00 2024-09-12T17:18:22.554 INFO:teuthology.orchestra.run.smithi063.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-12T17:18:22.579 INFO:teuthology.orchestra.run.smithi063.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-12T17:18:22.604 INFO:teuthology.orchestra.run.smithi063.stdout:(187/285): plexus-containers-component-annotati 366 kB/s | 18 kB 00:00 2024-09-12T17:18:22.630 INFO:teuthology.orchestra.run.smithi063.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 80 kB 00:00 2024-09-12T17:18:22.655 INFO:teuthology.orchestra.run.smithi063.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 669 kB/s | 34 kB 00:00 2024-09-12T17:18:22.681 INFO:teuthology.orchestra.run.smithi063.stdout:(190/285): plexus-utils-3.3.0-10.el9.noarch.rpm 4.9 MB/s | 254 kB 00:00 2024-09-12T17:18:22.722 INFO:teuthology.orchestra.run.smithi063.stdout:(191/285): poppler-21.01.0-21.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-09-12T17:18:22.773 INFO:teuthology.orchestra.run.smithi063.stdout:(192/285): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-12T17:18:22.798 INFO:teuthology.orchestra.run.smithi063.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-12T17:18:22.826 INFO:teuthology.orchestra.run.smithi082.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 291 kB/s | 218 kB 00:00 2024-09-12T17:18:22.840 INFO:teuthology.orchestra.run.smithi063.stdout:(194/285): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-12T17:18:22.865 INFO:teuthology.orchestra.run.smithi063.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-12T17:18:22.899 INFO:teuthology.orchestra.run.smithi063.stdout:(196/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 11 MB/s | 679 kB 00:00 2024-09-12T17:18:22.941 INFO:teuthology.orchestra.run.smithi063.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 5.8 MB/s | 245 kB 00:00 2024-09-12T17:18:23.026 INFO:teuthology.orchestra.run.smithi082.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 37 kB/s | 22 kB 00:00 2024-09-12T17:18:23.201 INFO:teuthology.orchestra.run.smithi082.stdout:(76/285): flatpak-1.12.9-1.el9.x86_64.rpm 1.8 MB/s | 1.7 MB 00:00 2024-09-12T17:18:23.299 INFO:teuthology.orchestra.run.smithi063.stdout:(198/285): java-11-openjdk-headless-11.0.20.1.1 12 MB/s | 39 MB 00:03 2024-09-12T17:18:23.333 INFO:teuthology.orchestra.run.smithi063.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 634 kB/s | 248 kB 00:00 2024-09-12T17:18:23.350 INFO:teuthology.orchestra.run.smithi063.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 514 kB/s | 26 kB 00:00 2024-09-12T17:18:23.366 INFO:teuthology.orchestra.run.smithi063.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 573 kB/s | 19 kB 00:00 2024-09-12T17:18:23.442 INFO:teuthology.orchestra.run.smithi063.stdout:(202/285): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-09-12T17:18:23.460 INFO:teuthology.orchestra.run.smithi082.stdout:(77/285): flatpak-session-helper-1.12.9-1.el9.x 115 kB/s | 73 kB 00:00 2024-09-12T17:18:23.498 INFO:teuthology.orchestra.run.smithi063.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 266 kB/s | 35 kB 00:00 2024-09-12T17:18:23.526 INFO:teuthology.orchestra.run.smithi063.stdout:(204/285): python3-mako-1.1.4-6.el9.noarch.rpm 978 kB/s | 172 kB 00:00 2024-09-12T17:18:23.551 INFO:teuthology.orchestra.run.smithi063.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.6 MB/s | 250 kB 00:00 2024-09-12T17:18:23.585 INFO:teuthology.orchestra.run.smithi063.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-12T17:18:23.610 INFO:teuthology.orchestra.run.smithi063.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-12T17:18:23.610 INFO:teuthology.orchestra.run.smithi082.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 56 kB/s | 33 kB 00:00 2024-09-12T17:18:23.635 INFO:teuthology.orchestra.run.smithi063.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 841 kB/s | 42 kB 00:00 2024-09-12T17:18:23.661 INFO:teuthology.orchestra.run.smithi063.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-09-12T17:18:23.686 INFO:teuthology.orchestra.run.smithi063.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-12T17:18:23.711 INFO:teuthology.orchestra.run.smithi063.stdout:(211/285): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-12T17:18:23.736 INFO:teuthology.orchestra.run.smithi063.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T17:18:23.762 INFO:teuthology.orchestra.run.smithi063.stdout:(213/285): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-12T17:18:23.804 INFO:teuthology.orchestra.run.smithi063.stdout:(214/285): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-12T17:18:23.879 INFO:teuthology.orchestra.run.smithi063.stdout:(215/285): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-12T17:18:23.904 INFO:teuthology.orchestra.run.smithi063.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-09-12T17:18:23.929 INFO:teuthology.orchestra.run.smithi063.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 718 kB/s | 36 kB 00:00 2024-09-12T17:18:23.955 INFO:teuthology.orchestra.run.smithi063.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-12T17:18:23.980 INFO:teuthology.orchestra.run.smithi063.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-12T17:18:23.985 INFO:teuthology.orchestra.run.smithi082.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-09-12T17:18:24.005 INFO:teuthology.orchestra.run.smithi063.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 9.9 MB/s | 510 kB 00:00 2024-09-12T17:18:24.031 INFO:teuthology.orchestra.run.smithi063.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-12T17:18:24.056 INFO:teuthology.orchestra.run.smithi063.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T17:18:24.081 INFO:teuthology.orchestra.run.smithi063.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 7.4 MB/s | 383 kB 00:00 2024-09-12T17:18:24.106 INFO:teuthology.orchestra.run.smithi063.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-12T17:18:24.140 INFO:teuthology.orchestra.run.smithi063.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 9.3 MB/s | 555 kB 00:00 2024-09-12T17:18:24.174 INFO:teuthology.orchestra.run.smithi063.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 14 MB/s | 944 kB 00:00 2024-09-12T17:18:24.199 INFO:teuthology.orchestra.run.smithi063.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 908 kB/s | 53 kB 00:00 2024-09-12T17:18:24.233 INFO:teuthology.orchestra.run.smithi063.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-12T17:18:24.266 INFO:teuthology.orchestra.run.smithi063.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.5 MB/s | 173 kB 00:00 2024-09-12T17:18:24.269 INFO:teuthology.orchestra.run.smithi082.stdout:(80/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-12T17:18:24.286 INFO:teuthology.orchestra.run.smithi082.stdout:(81/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 132 kB/s | 89 kB 00:00 2024-09-12T17:18:24.292 INFO:teuthology.orchestra.run.smithi063.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-12T17:18:24.317 INFO:teuthology.orchestra.run.smithi063.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T17:18:24.351 INFO:teuthology.orchestra.run.smithi063.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 5.9 MB/s | 358 kB 00:00 2024-09-12T17:18:24.376 INFO:teuthology.orchestra.run.smithi063.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 721 kB/s | 42 kB 00:00 2024-09-12T17:18:24.410 INFO:teuthology.orchestra.run.smithi063.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 6.4 MB/s | 385 kB 00:00 2024-09-12T17:18:24.435 INFO:teuthology.orchestra.run.smithi063.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-12T17:18:24.477 INFO:teuthology.orchestra.run.smithi063.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-09-12T17:18:24.502 INFO:teuthology.orchestra.run.smithi063.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 64 kB 00:00 2024-09-12T17:18:24.537 INFO:teuthology.orchestra.run.smithi063.stdout:(238/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 8.5 MB/s | 505 kB 00:00 2024-09-12T17:18:24.569 INFO:teuthology.orchestra.run.smithi063.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 333 kB/s | 22 kB 00:00 2024-09-12T17:18:24.678 INFO:teuthology.orchestra.run.smithi082.stdout:(82/285): geoclue2-2.6.0-7.el9.x86_64.rpm 180 kB/s | 124 kB 00:00 2024-09-12T17:18:24.745 INFO:teuthology.orchestra.run.smithi063.stdout:(240/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-12T17:18:24.787 INFO:teuthology.orchestra.run.smithi063.stdout:(241/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-09-12T17:18:24.829 INFO:teuthology.orchestra.run.smithi063.stdout:(242/285): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-09-12T17:18:24.854 INFO:teuthology.orchestra.run.smithi063.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 300 kB/s | 19 kB 00:00 2024-09-12T17:18:24.879 INFO:teuthology.orchestra.run.smithi063.stdout:(244/285): gperftools-libs-2.9.1-3.el9.x86_64.r 2.3 MB/s | 308 kB 00:00 2024-09-12T17:18:24.904 INFO:teuthology.orchestra.run.smithi063.stdout:(245/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-12T17:18:24.911 INFO:teuthology.orchestra.run.smithi082.stdout:(83/285): giflib-5.2.1-9.el9.x86_64.rpm 76 kB/s | 49 kB 00:00 2024-09-12T17:18:24.929 INFO:teuthology.orchestra.run.smithi063.stdout:(246/285): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-09-12T17:18:25.071 INFO:teuthology.orchestra.run.smithi063.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 404 kB/s | 67 kB 00:00 2024-09-12T17:18:25.105 INFO:teuthology.orchestra.run.smithi063.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 864 kB/s | 151 kB 00:00 2024-09-12T17:18:25.147 INFO:teuthology.orchestra.run.smithi063.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T17:18:25.172 INFO:teuthology.orchestra.run.smithi063.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T17:18:25.195 INFO:teuthology.orchestra.run.smithi082.stdout:(84/285): google-guice-4.2.3-9.el9.noarch.rpm 521 kB/s | 473 kB 00:00 2024-09-12T17:18:25.197 INFO:teuthology.orchestra.run.smithi063.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T17:18:25.223 INFO:teuthology.orchestra.run.smithi063.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-12T17:18:25.256 INFO:teuthology.orchestra.run.smithi063.stdout:(253/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-12T17:18:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T17:18:25.315 INFO:teuthology.orchestra.run.smithi063.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T17:18:25.341 INFO:teuthology.orchestra.run.smithi063.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T17:18:25.370 INFO:teuthology.orchestra.run.smithi082.stdout:(85/285): graphene-1.10.6-2.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-09-12T17:18:25.375 INFO:teuthology.orchestra.run.smithi063.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T17:18:25.399 INFO:teuthology.orchestra.run.smithi063.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-12T17:18:25.425 INFO:teuthology.orchestra.run.smithi063.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-12T17:18:25.450 INFO:teuthology.orchestra.run.smithi063.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 937 kB/s | 23 kB 00:00 2024-09-12T17:18:25.462 INFO:teuthology.orchestra.run.smithi082.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 63 kB/s | 34 kB 00:00 2024-09-12T17:18:25.475 INFO:teuthology.orchestra.run.smithi063.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-12T17:18:25.501 INFO:teuthology.orchestra.run.smithi063.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 782 kB/s | 20 kB 00:00 2024-09-12T17:18:25.559 INFO:teuthology.orchestra.run.smithi063.stdout:(263/285): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-12T17:18:25.585 INFO:teuthology.orchestra.run.smithi063.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:18:25.610 INFO:teuthology.orchestra.run.smithi063.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:18:25.635 INFO:teuthology.orchestra.run.smithi063.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T17:18:25.677 INFO:teuthology.orchestra.run.smithi063.stdout:(267/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-12T17:18:25.703 INFO:teuthology.orchestra.run.smithi063.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-12T17:18:25.728 INFO:teuthology.orchestra.run.smithi063.stdout:(269/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-12T17:18:25.753 INFO:teuthology.orchestra.run.smithi063.stdout:(270/285): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-12T17:18:25.778 INFO:teuthology.orchestra.run.smithi063.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-12T17:18:25.804 INFO:teuthology.orchestra.run.smithi063.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T17:18:25.829 INFO:teuthology.orchestra.run.smithi063.stdout:(273/285): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T17:18:25.854 INFO:teuthology.orchestra.run.smithi063.stdout:(274/285): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-12T17:18:25.879 INFO:teuthology.orchestra.run.smithi063.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T17:18:25.905 INFO:teuthology.orchestra.run.smithi063.stdout:(276/285): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T17:18:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:(277/285): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T17:18:25.997 INFO:teuthology.orchestra.run.smithi063.stdout:(278/285): libarrow-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-12T17:18:26.014 INFO:teuthology.orchestra.run.smithi063.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-09-12T17:18:26.039 INFO:teuthology.orchestra.run.smithi063.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T17:18:26.045 INFO:teuthology.orchestra.run.smithi082.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 57 kB/s | 33 kB 00:00 2024-09-12T17:18:26.064 INFO:teuthology.orchestra.run.smithi063.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T17:18:26.090 INFO:teuthology.orchestra.run.smithi063.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-09-12T17:18:26.137 INFO:teuthology.orchestra.run.smithi082.stdout:(88/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.5 MB/s | 1.4 MB 00:00 2024-09-12T17:18:26.148 INFO:teuthology.orchestra.run.smithi063.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T17:18:26.365 INFO:teuthology.orchestra.run.smithi063.stdout:(284/285): librados2-19.3.0-4762.gbad475c1.el9. 12 MB/s | 3.5 MB 00:00 2024-09-12T17:18:26.371 INFO:teuthology.orchestra.run.smithi082.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 2.2 MB/s | 2.2 MB 00:01 2024-09-12T17:18:26.415 INFO:teuthology.orchestra.run.smithi063.stdout:(285/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-12T17:18:26.422 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:18:26.423 INFO:teuthology.orchestra.run.smithi063.stdout:Total 25 MB/s | 322 MB 00:13 2024-09-12T17:18:27.213 INFO:teuthology.orchestra.run.smithi082.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 263 kB/s | 219 kB 00:00 2024-09-12T17:18:27.280 INFO:teuthology.orchestra.run.smithi082.stdout:(91/285): gtk3-3.24.31-5.el9.x86_64.rpm 4.0 MB/s | 4.9 MB 00:01 2024-09-12T17:18:27.331 INFO:teuthology.orchestra.run.smithi082.stdout:(92/285): guava-30.1-6.el9.noarch.rpm 1.9 MB/s | 2.3 MB 00:01 2024-09-12T17:18:28.072 INFO:teuthology.orchestra.run.smithi082.stdout:(93/285): httpcomponents-client-4.5.13-3.el9.no 765 kB/s | 657 kB 00:00 2024-09-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi082.stdout:(94/285): httpcomponents-core-4.4.13-7.el9.noar 736 kB/s | 632 kB 00:00 2024-09-12T17:18:28.406 INFO:teuthology.orchestra.run.smithi082.stdout:(95/285): iso-codes-4.6.0-3.el9.noarch.rpm 3.3 MB/s | 3.5 MB 00:01 2024-09-12T17:18:28.690 INFO:teuthology.orchestra.run.smithi082.stdout:(96/285): jakarta-annotations-1.3.5-13.el9.noar 73 kB/s | 45 kB 00:00 2024-09-12T17:18:28.806 INFO:teuthology.orchestra.run.smithi082.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 164 kB/s | 110 kB 00:00 2024-09-12T17:18:29.257 INFO:teuthology.orchestra.run.smithi082.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 486 kB/s | 413 kB 00:00 2024-09-12T17:18:29.612 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-12T17:18:29.740 INFO:teuthology.orchestra.run.smithi082.stdout:(99/285): java-11-openjdk-devel-11.0.20.1.1-2.e 3.2 MB/s | 3.3 MB 00:01 2024-09-12T17:18:29.765 INFO:teuthology.orchestra.run.smithi082.stdout:(100/285): javapackages-filesystem-6.0.0-4.el9. 26 kB/s | 13 kB 00:00 2024-09-12T17:18:29.815 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-12T17:18:29.815 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-12T17:18:30.307 INFO:teuthology.orchestra.run.smithi082.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 44 kB/s | 24 kB 00:00 2024-09-12T17:18:30.358 INFO:teuthology.orchestra.run.smithi082.stdout:(102/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 86 kB/s | 53 kB 00:00 2024-09-12T17:18:30.941 INFO:teuthology.orchestra.run.smithi082.stdout:(103/285): java-11-openjdk-headless-11.0.20.1.1 18 MB/s | 39 MB 00:02 2024-09-12T17:18:31.233 INFO:teuthology.orchestra.run.smithi082.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 41 kB/s | 35 kB 00:00 2024-09-12T17:18:31.383 INFO:teuthology.orchestra.run.smithi082.stdout:(105/285): jsoup-1.13.1-10.el9.noarch.rpm 350 kB/s | 377 kB 00:01 2024-09-12T17:18:31.667 INFO:teuthology.orchestra.run.smithi082.stdout:(106/285): lcms2-2.12-3.el9.x86_64.rpm 232 kB/s | 168 kB 00:00 2024-09-12T17:18:31.709 INFO:teuthology.orchestra.run.smithi082.stdout:(107/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 23 kB/s | 11 kB 00:00 2024-09-12T17:18:31.917 INFO:teuthology.orchestra.run.smithi082.stdout:(108/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 45 kB/s | 24 kB 00:00 2024-09-12T17:18:32.301 INFO:teuthology.orchestra.run.smithi082.stdout:(109/285): libXcursor-1.2.0-7.el9.x86_64.rpm 48 kB/s | 31 kB 00:00 2024-09-12T17:18:32.418 INFO:teuthology.orchestra.run.smithi082.stdout:(110/285): libXdamage-1.1.5-7.el9.x86_64.rpm 32 kB/s | 23 kB 00:00 2024-09-12T17:18:32.543 INFO:teuthology.orchestra.run.smithi082.stdout:(111/285): libXfixes-5.0.3-16.el9.x86_64.rpm 32 kB/s | 20 kB 00:00 2024-09-12T17:18:32.902 INFO:teuthology.orchestra.run.smithi082.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 31 kB/s | 15 kB 00:00 2024-09-12T17:18:32.927 INFO:teuthology.orchestra.run.smithi082.stdout:(113/285): libXi-1.7.10-8.el9.x86_64.rpm 63 kB/s | 40 kB 00:00 2024-09-12T17:18:33.111 INFO:teuthology.orchestra.run.smithi082.stdout:(114/285): libXrandr-1.5.2-8.el9.x86_64.rpm 50 kB/s | 28 kB 00:00 2024-09-12T17:18:33.238 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-12T17:18:33.238 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-12T17:18:33.411 INFO:teuthology.orchestra.run.smithi082.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 39 kB/s | 19 kB 00:00 2024-09-12T17:18:33.436 INFO:teuthology.orchestra.run.smithi082.stdout:(116/285): libXtst-1.2.3-16.el9.x86_64.rpm 40 kB/s | 21 kB 00:00 2024-09-12T17:18:33.653 INFO:teuthology.orchestra.run.smithi082.stdout:(117/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 35 kB/s | 19 kB 00:00 2024-09-12T17:18:33.986 INFO:teuthology.orchestra.run.smithi082.stdout:(118/285): libasyncns-0.8-22.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2024-09-12T17:18:34.137 INFO:teuthology.orchestra.run.smithi082.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 123 kB/s | 86 kB 00:00 2024-09-12T17:18:34.212 INFO:teuthology.orchestra.run.smithi082.stdout:(120/285): libcanberra-gtk3-0.30-27.el9.x86_64. 58 kB/s | 32 kB 00:00 2024-09-12T17:18:34.779 INFO:teuthology.orchestra.run.smithi082.stdout:(121/285): libdrm-2.4.121-1.el9.x86_64.rpm 203 kB/s | 161 kB 00:00 2024-09-12T17:18:34.971 INFO:teuthology.orchestra.run.smithi082.stdout:(122/285): libepoxy-1.5.5-4.el9.x86_64.rpm 290 kB/s | 241 kB 00:00 2024-09-12T17:18:35.355 INFO:teuthology.orchestra.run.smithi082.stdout:(123/285): libexif-0.6.22-6.el9.x86_64.rpm 384 kB/s | 435 kB 00:01 2024-09-12T17:18:35.379 INFO:teuthology.orchestra.run.smithi082.stdout:(124/285): libfontenc-1.1.3-17.el9.x86_64.rpm 52 kB/s | 31 kB 00:00 2024-09-12T17:18:35.630 INFO:teuthology.orchestra.run.smithi082.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 126 kB/s | 83 kB 00:00 2024-09-12T17:18:35.955 INFO:teuthology.orchestra.run.smithi082.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 64 kB/s | 37 kB 00:00 2024-09-12T17:18:36.063 INFO:teuthology.orchestra.run.smithi082.stdout:(127/285): libglvnd-1.3.4-1.el9.x86_64.rpm 191 kB/s | 135 kB 00:00 2024-09-12T17:18:36.380 INFO:teuthology.orchestra.run.smithi082.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 190 kB/s | 142 kB 00:00 2024-09-12T17:18:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:(129/285): libgsf-1.14.47-5.el9.x86_64.rpm 330 kB/s | 256 kB 00:00 2024-09-12T17:18:36.756 INFO:teuthology.orchestra.run.smithi082.stdout:(130/285): libgxps-0.3.2-3.el9.x86_64.rpm 114 kB/s | 79 kB 00:00 2024-09-12T17:18:37.048 INFO:teuthology.orchestra.run.smithi082.stdout:(131/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 92 kB/s | 61 kB 00:00 2024-09-12T17:18:37.323 INFO:teuthology.orchestra.run.smithi082.stdout:(132/285): libldac-2.0.2.3-10.el9.x86_64.rpm 70 kB/s | 41 kB 00:00 2024-09-12T17:18:37.348 INFO:teuthology.orchestra.run.smithi082.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 74 kB/s | 44 kB 00:00 2024-09-12T17:18:37.615 INFO:teuthology.orchestra.run.smithi082.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 59 kB/s | 34 kB 00:00 2024-09-12T17:18:38.190 INFO:teuthology.orchestra.run.smithi082.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 190 kB/s | 160 kB 00:00 2024-09-12T17:18:38.216 INFO:teuthology.orchestra.run.smithi082.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-09-12T17:18:38.291 INFO:teuthology.orchestra.run.smithi082.stdout:(137/285): libosinfo-1.10.0-1.el9.x86_64.rpm 330 kB/s | 319 kB 00:00 2024-09-12T17:18:38.808 INFO:teuthology.orchestra.run.smithi082.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-12T17:18:39.100 INFO:teuthology.orchestra.run.smithi082.stdout:(139/285): librdkafka-1.6.1-102.el9.x86_64.rpm 729 kB/s | 662 kB 00:00 2024-09-12T17:18:39.125 INFO:teuthology.orchestra.run.smithi082.stdout:(140/285): libsndfile-1.0.31-8.el9.x86_64.rpm 248 kB/s | 206 kB 00:00 2024-09-12T17:18:39.559 INFO:teuthology.orchestra.run.smithi082.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 218 kB/s | 164 kB 00:00 2024-09-12T17:18:39.709 INFO:teuthology.orchestra.run.smithi082.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 61 kB/s | 36 kB 00:00 2024-09-12T17:18:39.901 INFO:teuthology.orchestra.run.smithi082.stdout:(143/285): libtiff-4.4.0-13.el9.x86_64.rpm 247 kB/s | 198 kB 00:00 2024-09-12T17:18:40.484 INFO:teuthology.orchestra.run.smithi082.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 186 kB/s | 144 kB 00:00 2024-09-12T17:18:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:(145/285): libtracker-sparql-3.1.2-3.el9.x86_64 316 kB/s | 324 kB 00:01 2024-09-12T17:18:40.751 INFO:teuthology.orchestra.run.smithi082.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 227 kB/s | 193 kB 00:00 2024-09-12T17:18:41.043 INFO:teuthology.orchestra.run.smithi082.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 60 kB/s | 33 kB 00:00 2024-09-12T17:18:41.143 INFO:teuthology.orchestra.run.smithi082.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 35 kB/s | 19 kB 00:00 2024-09-12T17:18:41.463 INFO:teuthology.orchestra.run.smithi082.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 18 kB/s | 13 kB 00:00 2024-09-12T17:18:41.827 INFO:teuthology.orchestra.run.smithi082.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 53 kB/s | 42 kB 00:00 2024-09-12T17:18:42.302 INFO:teuthology.orchestra.run.smithi082.stdout:(151/285): libxshmfence-1.3-10.el9.x86_64.rpm 27 kB/s | 13 kB 00:00 2024-09-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi082.stdout:(152/285): libwebp-1.2.0-8.el9.x86_64.rpm 231 kB/s | 277 kB 00:01 2024-09-12T17:18:42.378 INFO:teuthology.orchestra.run.smithi082.stdout:(153/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 147 kB/s | 133 kB 00:00 2024-09-12T17:18:42.862 INFO:teuthology.orchestra.run.smithi082.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 64 kB/s | 36 kB 00:00 2024-09-12T17:18:43.128 INFO:teuthology.orchestra.run.smithi082.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 251 kB/s | 188 kB 00:00 2024-09-12T17:18:43.253 INFO:teuthology.orchestra.run.smithi082.stdout:(156/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 325 kB/s | 292 kB 00:00 2024-09-12T17:18:43.612 INFO:teuthology.orchestra.run.smithi082.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 37 kB/s | 18 kB 00:00 2024-09-12T17:18:43.646 INFO:teuthology.orchestra.run.smithi082.stdout:(158/285): lua-posix-35.0-8.el9.x86_64.rpm 193 kB/s | 151 kB 00:00 2024-09-12T17:18:43.756 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:18:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:18:44.071 INFO:teuthology.orchestra.run.smithi082.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 20 kB/s | 9.0 kB 00:00 2024-09-12T17:18:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-12T17:18:44.177 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:18:44.211 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:18:44.313 INFO:teuthology.orchestra.run.smithi082.stdout:(160/285): maven-lib-3.6.3-15.el9.noarch.rpm 1.4 MB/s | 1.5 MB 00:01 2024-09-12T17:18:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:18:44.431 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:18:44.498 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:18:44.522 INFO:teuthology.orchestra.run.smithi082.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 590 kB/s | 517 kB 00:00 2024-09-12T17:18:44.547 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:18:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:18:44.646 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:18:44.813 INFO:teuthology.orchestra.run.smithi082.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 204 kB/s | 151 kB 00:00 2024-09-12T17:18:44.989 INFO:teuthology.orchestra.run.smithi082.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 168 kB/s | 112 kB 00:00 2024-09-12T17:18:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:18:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:18:45.198 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:18:45.232 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:18:45.280 INFO:teuthology.orchestra.run.smithi082.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 24 kB/s | 11 kB 00:00 2024-09-12T17:18:45.309 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:18:45.336 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:18:45.381 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:18:45.420 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:18:45.446 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:18:45.472 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:18:45.504 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:18:45.529 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:18:45.557 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:18:45.714 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:18:45.756 INFO:teuthology.orchestra.run.smithi082.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 181 kB/s | 139 kB 00:00 2024-09-12T17:18:45.851 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:18:45.888 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:18:45.925 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:18:45.952 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:18:46.064 INFO:teuthology.orchestra.run.smithi082.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 218 kB/s | 171 kB 00:00 2024-09-12T17:18:46.087 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:18:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:18:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:18:46.196 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:18:46.217 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:18:46.240 INFO:teuthology.orchestra.run.smithi082.stdout:(167/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 5.1 MB/s | 8.8 MB 00:01 2024-09-12T17:18:46.331 INFO:teuthology.orchestra.run.smithi082.stdout:(168/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 63 kB/s | 36 kB 00:00 2024-09-12T17:18:46.418 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:18:46.455 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:18:46.587 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:18:46.615 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:18:46.651 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi082.stdout:(169/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 71 kB/s | 46 kB 00:00 2024-09-12T17:18:46.754 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:18:46.802 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:18:46.815 INFO:teuthology.orchestra.run.smithi082.stdout:(170/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 56 kB/s | 32 kB 00:00 2024-09-12T17:18:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:18:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:18:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:18:46.945 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:18:46.949 INFO:teuthology.orchestra.run.smithi082.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 63 kB/s | 38 kB 00:00 2024-09-12T17:18:46.970 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:18:46.995 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:18:47.024 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:18:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:18:47.106 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:18:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:18:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:18:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:18:47.315 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:18:47.343 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:18:47.394 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:18:47.431 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:18:47.464 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:18:47.541 INFO:teuthology.orchestra.run.smithi082.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 225 kB/s | 163 kB 00:00 2024-09-12T17:18:47.544 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:18:47.591 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:18:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:18:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:18:47.756 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:18:47.858 INFO:teuthology.orchestra.run.smithi082.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 222 kB/s | 200 kB 00:00 2024-09-12T17:18:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:18:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:18:48.100 INFO:teuthology.orchestra.run.smithi082.stdout:(174/285): openblas-openmp-0.3.26-2.el9.x86_64. 3.6 MB/s | 4.9 MB 00:01 2024-09-12T17:18:48.325 INFO:teuthology.orchestra.run.smithi082.stdout:(175/285): orc-0.4.31-8.el9.x86_64.rpm 234 kB/s | 183 kB 00:00 2024-09-12T17:18:48.538 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:18:48.627 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:18:48.660 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:18:48.733 INFO:teuthology.orchestra.run.smithi082.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 118 kB/s | 74 kB 00:00 2024-09-12T17:18:48.749 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:18:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:18:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:18:48.842 INFO:teuthology.orchestra.run.smithi082.stdout:(177/285): osinfo-db-20240701-2.el9.noarch.rpm 539 kB/s | 531 kB 00:00 2024-09-12T17:18:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:18:48.932 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:18:48.969 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:18:49.002 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:18:49.045 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:18:49.092 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:18:49.133 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:18:49.165 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:18:49.167 INFO:teuthology.orchestra.run.smithi082.stdout:(178/285): ostree-libs-2024.7-2.el9.x86_64.rpm 561 kB/s | 468 kB 00:00 2024-09-12T17:18:49.207 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:18:49.275 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:18:49.309 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:18:49.345 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:18:49.452 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:18:49.501 INFO:teuthology.orchestra.run.smithi082.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 162 kB/s | 107 kB 00:00 2024-09-12T17:18:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:18:49.529 INFO:teuthology.orchestra.run.smithi082.stdout:(180/285): p11-kit-server-0.25.3-2.el9.x86_64.r 311 kB/s | 246 kB 00:00 2024-09-12T17:18:49.594 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:18:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:18:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:18:49.723 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:18:49.768 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:18:49.768 INFO:teuthology.orchestra.run.smithi082.stdout:(181/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 95 kB/s | 57 kB 00:00 2024-09-12T17:18:49.810 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:18:49.955 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:18:49.985 INFO:teuthology.orchestra.run.smithi082.stdout:(182/285): pipewire-jack-audio-connection-kit-1 19 kB/s | 9.1 kB 00:00 2024-09-12T17:18:50.002 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:18:50.045 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:18:50.161 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:18:50.210 INFO:teuthology.orchestra.run.smithi082.stdout:(183/285): pipewire-jack-audio-connection-kit-l 197 kB/s | 135 kB 00:00 2024-09-12T17:18:50.221 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:18:50.261 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:18:50.292 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:18:50.317 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:18:50.403 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:18:50.534 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:18:50.569 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:18:50.727 INFO:teuthology.orchestra.run.smithi082.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 261 kB/s | 192 kB 00:00 2024-09-12T17:18:50.769 INFO:teuthology.orchestra.run.smithi082.stdout:(185/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 1.9 MB/s | 1.9 MB 00:01 2024-09-12T17:18:50.789 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:18:50.797 INFO:teuthology.orchestra.run.smithi082.stdout:(186/285): plexus-cipher-1.7-27.el9.noarch.rpm 45 kB/s | 26 kB 00:00 2024-09-12T17:18:50.829 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:18:50.860 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:18:50.890 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:18:50.931 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:18:50.959 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:18:50.974 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:18:50.974 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:18:50.974 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:18:51.172 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:18:51.249 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:18:51.264 INFO:teuthology.orchestra.run.smithi082.stdout:(187/285): plexus-containers-component-annotati 37 kB/s | 18 kB 00:00 2024-09-12T17:18:51.300 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:18:51.324 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:18:51.339 INFO:teuthology.orchestra.run.smithi082.stdout:(188/285): plexus-classworlds-2.6.0-11.el9.noar 98 kB/s | 60 kB 00:00 2024-09-12T17:18:51.350 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:18:51.375 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:18:51.422 INFO:teuthology.orchestra.run.smithi082.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 127 kB/s | 80 kB 00:00 2024-09-12T17:18:51.827 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:18:51.839 INFO:teuthology.orchestra.run.smithi082.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 58 kB/s | 34 kB 00:00 2024-09-12T17:18:51.863 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:18:51.878 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:18:51.878 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:18:51.878 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:18:51.919 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:18:51.954 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:18:51.987 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:18:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:18:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:18:52.106 INFO:teuthology.orchestra.run.smithi082.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 331 kB/s | 254 kB 00:00 2024-09-12T17:18:52.172 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:18:52.219 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:18:52.249 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:18:52.359 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:18:52.365 INFO:teuthology.orchestra.run.smithi082.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 1.1 MB/s | 1.1 MB 00:00 2024-09-12T17:18:52.419 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:18:52.807 INFO:teuthology.orchestra.run.smithi082.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 217 kB/s | 152 kB 00:00 2024-09-12T17:18:52.907 INFO:teuthology.orchestra.run.smithi082.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 1.8 MB/s | 1.9 MB 00:01 2024-09-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:18:53.256 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:18:53.289 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:18:53.299 INFO:teuthology.orchestra.run.smithi082.stdout:(195/285): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-12T17:18:53.394 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:18:53.436 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:18:53.524 INFO:teuthology.orchestra.run.smithi082.stdout:(196/285): publicsuffix-list-20210518-3.el9.noa 115 kB/s | 83 kB 00:00 2024-09-12T17:18:53.633 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:18:53.678 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:18:53.731 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:18:53.799 INFO:teuthology.orchestra.run.smithi082.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 761 kB/s | 679 kB 00:00 2024-09-12T17:18:54.279 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:18:54.299 INFO:teuthology.orchestra.run.smithi082.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 319 kB/s | 245 kB 00:00 2024-09-12T17:18:54.338 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:18:54.374 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:18:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:18:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:18:54.458 INFO:teuthology.orchestra.run.smithi082.stdout:(199/285): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-12T17:18:54.633 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:18:54.642 INFO:teuthology.orchestra.run.smithi082.stdout:(200/285): python3-jinja2-2.11.3-6.el9.noarch.r 295 kB/s | 248 kB 00:00 2024-09-12T17:18:54.663 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:18:54.761 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:18:54.900 INFO:teuthology.orchestra.run.smithi082.stdout:(201/285): python3-jsonpatch-1.21-16.el9.noarch 43 kB/s | 26 kB 00:00 2024-09-12T17:18:54.934 INFO:teuthology.orchestra.run.smithi082.stdout:(202/285): python3-jsonpointer-2.0-4.el9.noarch 40 kB/s | 19 kB 00:00 2024-09-12T17:18:55.484 INFO:teuthology.orchestra.run.smithi082.stdout:(203/285): python3-mako-1.1.4-6.el9.noarch.rpm 205 kB/s | 172 kB 00:00 2024-09-12T17:18:55.487 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:18:55.509 INFO:teuthology.orchestra.run.smithi082.stdout:(204/285): python3-markupsafe-1.1.1-12.el9.x86_ 57 kB/s | 35 kB 00:00 2024-09-12T17:18:55.608 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:18:56.355 INFO:teuthology.orchestra.run.smithi082.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 288 kB/s | 250 kB 00:00 2024-09-12T17:18:56.385 INFO:teuthology.orchestra.run.smithi082.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 254 kB/s | 222 kB 00:00 2024-09-12T17:18:56.952 INFO:teuthology.orchestra.run.smithi082.stdout:(207/285): python3-prettytable-0.7.2-27.el9.noa 75 kB/s | 42 kB 00:00 2024-09-12T17:18:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:18:56.985 INFO:teuthology.orchestra.run.smithi082.stdout:(208/285): python3-packaging-20.9-5.el9.noarch. 123 kB/s | 77 kB 00:00 2024-09-12T17:18:57.048 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:18:57.061 INFO:teuthology.orchestra.run.smithi082.stdout:(209/285): python3-numpy-1.20.1-5.el9.x86_64.rp 2.4 MB/s | 5.1 MB 00:02 2024-09-12T17:18:57.092 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:18:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:18:57.161 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:18:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:18:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:18:57.278 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:18:57.306 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:18:57.643 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:18:57.693 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:18:57.727 INFO:teuthology.orchestra.run.smithi082.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 214 kB/s | 159 kB 00:00 2024-09-12T17:18:57.794 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:18:57.825 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:18:57.852 INFO:teuthology.orchestra.run.smithi082.stdout:(211/285): python3-pyasn1-modules-0.4.8-6.el9.n 352 kB/s | 279 kB 00:00 2024-09-12T17:18:57.866 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:18:57.894 INFO:teuthology.orchestra.run.smithi082.stdout:(212/285): python3-protobuf-3.14.0-13.el9.noarc 286 kB/s | 269 kB 00:00 2024-09-12T17:18:57.896 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:18:57.955 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:18:57.986 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:18:58.011 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:18:58.056 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:18:58.084 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:18:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:18:58.353 INFO:teuthology.orchestra.run.smithi082.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 82 kB/s | 51 kB 00:00 2024-09-12T17:18:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:18:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:18:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:18:58.453 INFO:teuthology.orchestra.run.smithi082.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 89 kB/s | 54 kB 00:00 2024-09-12T17:18:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:18:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:18:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:18:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:18:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:18:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:18:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:18:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:18:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:18:58.920 INFO:teuthology.orchestra.run.smithi082.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-12T17:18:59.196 INFO:teuthology.orchestra.run.smithi082.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 298 kB/s | 221 kB 00:00 2024-09-12T17:18:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:18:59.429 INFO:teuthology.orchestra.run.smithi082.stdout:(217/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T17:18:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:18:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:18:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:18:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:18:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:18:59.629 INFO:teuthology.orchestra.run.smithi082.stdout:(218/285): qatlib-service-24.02.0-1.el9.x86_64. 51 kB/s | 36 kB 00:00 2024-09-12T17:18:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:18:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:18:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:18:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:18:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:18:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:18:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:18:59.871 INFO:teuthology.orchestra.run.smithi082.stdout:(219/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 70 kB/s | 47 kB 00:00 2024-09-12T17:19:00.046 INFO:teuthology.orchestra.run.smithi082.stdout:(220/285): rtkit-0.11-29.el9.x86_64.rpm 91 kB/s | 56 kB 00:00 2024-09-12T17:19:00.455 INFO:teuthology.orchestra.run.smithi082.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 618 kB/s | 510 kB 00:00 2024-09-12T17:19:00.488 INFO:teuthology.orchestra.run.smithi082.stdout:(222/285): slf4j-1.7.30-13.el9.noarch.rpm 112 kB/s | 69 kB 00:00 2024-09-12T17:19:00.831 INFO:teuthology.orchestra.run.smithi082.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-09-12T17:19:01.189 INFO:teuthology.orchestra.run.smithi082.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 218 kB/s | 152 kB 00:00 2024-09-12T17:19:01.265 INFO:teuthology.orchestra.run.smithi082.stdout:(225/285): sound-theme-freedesktop-0.8-17.el9.n 473 kB/s | 383 kB 00:00 2024-09-12T17:19:01.673 INFO:teuthology.orchestra.run.smithi082.stdout:(226/285): tracker-3.1.2-3.el9.x86_64.rpm 659 kB/s | 555 kB 00:00 2024-09-12T17:19:01.873 INFO:teuthology.orchestra.run.smithi082.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 87 kB/s | 53 kB 00:00 2024-09-12T17:19:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:(228/285): tracker-miners-3.1.2-4.el9.x86_64.rp 952 kB/s | 944 kB 00:00 2024-09-12T17:19:02.424 INFO:teuthology.orchestra.run.smithi082.stdout:(229/285): tzdata-java-2024a-2.el9.noarch.rpm 306 kB/s | 230 kB 00:00 2024-09-12T17:19:02.615 INFO:teuthology.orchestra.run.smithi082.stdout:(230/285): upower-0.99.11-11.el9.x86_64.rpm 233 kB/s | 173 kB 00:00 2024-09-12T17:19:02.991 INFO:teuthology.orchestra.run.smithi082.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 379 kB/s | 306 kB 00:00 2024-09-12T17:19:03.099 INFO:teuthology.orchestra.run.smithi082.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 145 kB/s | 96 kB 00:00 2024-09-12T17:19:03.483 INFO:teuthology.orchestra.run.smithi082.stdout:(233/285): wireplumber-libs-0.4.14-1.el9.x86_64 413 kB/s | 358 kB 00:00 2024-09-12T17:19:03.558 INFO:teuthology.orchestra.run.smithi082.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 75 kB/s | 42 kB 00:00 2024-09-12T17:19:03.925 INFO:teuthology.orchestra.run.smithi082.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 467 kB/s | 385 kB 00:00 2024-09-12T17:19:04.250 INFO:teuthology.orchestra.run.smithi082.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 175 kB/s | 134 kB 00:00 2024-09-12T17:19:04.459 INFO:teuthology.orchestra.run.smithi082.stdout:(237/285): xkeyboard-config-2.33-2.el9.noarch.r 954 kB/s | 859 kB 00:00 2024-09-12T17:19:04.551 INFO:teuthology.orchestra.run.smithi082.stdout:(238/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-12T17:19:04.576 INFO:teuthology.orchestra.run.smithi082.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-12T17:19:04.635 INFO:teuthology.orchestra.run.smithi082.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T17:19:04.661 INFO:teuthology.orchestra.run.smithi082.stdout:(241/285): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-12T17:19:04.685 INFO:teuthology.orchestra.run.smithi082.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-12T17:19:04.744 INFO:teuthology.orchestra.run.smithi082.stdout:(243/285): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-09-12T17:19:04.786 INFO:teuthology.orchestra.run.smithi082.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-09-12T17:19:04.811 INFO:teuthology.orchestra.run.smithi082.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T17:19:04.887 INFO:teuthology.orchestra.run.smithi082.stdout:(246/285): libarrow-9.0.0-11.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-12T17:19:04.912 INFO:teuthology.orchestra.run.smithi082.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-09-12T17:19:04.937 INFO:teuthology.orchestra.run.smithi082.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-12T17:19:04.970 INFO:teuthology.orchestra.run.smithi082.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T17:19:05.004 INFO:teuthology.orchestra.run.smithi082.stdout:(250/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-12T17:19:05.021 INFO:teuthology.orchestra.run.smithi082.stdout:(251/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-12T17:19:05.038 INFO:teuthology.orchestra.run.smithi082.stdout:(252/285): python3-cachetools-4.2.4-1.el9.noarc 955 kB/s | 32 kB 00:00 2024-09-12T17:19:05.055 INFO:teuthology.orchestra.run.smithi082.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 419 kB/s | 14 kB 00:00 2024-09-12T17:19:05.080 INFO:teuthology.orchestra.run.smithi082.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T17:19:05.105 INFO:teuthology.orchestra.run.smithi082.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T17:19:05.131 INFO:teuthology.orchestra.run.smithi082.stdout:(256/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 574 kB/s | 505 kB 00:00 2024-09-12T17:19:05.156 INFO:teuthology.orchestra.run.smithi082.stdout:(257/285): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-12T17:19:05.190 INFO:teuthology.orchestra.run.smithi082.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 414 kB/s | 11 kB 00:00 2024-09-12T17:19:05.215 INFO:teuthology.orchestra.run.smithi082.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 767 kB/s | 18 kB 00:00 2024-09-12T17:19:05.240 INFO:teuthology.orchestra.run.smithi082.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-12T17:19:05.265 INFO:teuthology.orchestra.run.smithi082.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-12T17:19:05.291 INFO:teuthology.orchestra.run.smithi082.stdout:(262/285): python3-grpcio-tools-1.46.7-10.el9.x 906 kB/s | 144 kB 00:00 2024-09-12T17:19:05.324 INFO:teuthology.orchestra.run.smithi082.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-09-12T17:19:05.350 INFO:teuthology.orchestra.run.smithi082.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:19:05.375 INFO:teuthology.orchestra.run.smithi082.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:19:05.400 INFO:teuthology.orchestra.run.smithi082.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T17:19:05.434 INFO:teuthology.orchestra.run.smithi082.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T17:19:05.459 INFO:teuthology.orchestra.run.smithi082.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-12T17:19:05.493 INFO:teuthology.orchestra.run.smithi082.stdout:(269/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-12T17:19:05.526 INFO:teuthology.orchestra.run.smithi082.stdout:(270/285): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-12T17:19:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-09-12T17:19:05.577 INFO:teuthology.orchestra.run.smithi082.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T17:19:05.611 INFO:teuthology.orchestra.run.smithi082.stdout:(273/285): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-12T17:19:05.636 INFO:teuthology.orchestra.run.smithi082.stdout:(274/285): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-12T17:19:05.653 INFO:teuthology.orchestra.run.smithi082.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-12T17:19:05.678 INFO:teuthology.orchestra.run.smithi082.stdout:(276/285): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T17:19:05.704 INFO:teuthology.orchestra.run.smithi082.stdout:(277/285): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-12T17:19:05.729 INFO:teuthology.orchestra.run.smithi082.stdout:(278/285): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-09-12T17:19:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:(279/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-12T17:19:05.796 INFO:teuthology.orchestra.run.smithi082.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T17:19:05.821 INFO:teuthology.orchestra.run.smithi082.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T17:19:05.847 INFO:teuthology.orchestra.run.smithi082.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-12T17:19:05.897 INFO:teuthology.orchestra.run.smithi082.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T17:19:06.072 INFO:teuthology.orchestra.run.smithi082.stdout:(284/285): librados2-19.3.0-4762.gbad475c1.el9. 14 MB/s | 3.5 MB 00:00 2024-09-12T17:19:06.156 INFO:teuthology.orchestra.run.smithi082.stdout:(285/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-12T17:19:06.163 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:19:06.163 INFO:teuthology.orchestra.run.smithi082.stdout:Total 5.7 MB/s | 322 MB 00:56 2024-09-12T17:19:09.173 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-12T17:19:09.359 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-12T17:19:09.360 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-12T17:19:11.407 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:19:11.446 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:19:11.515 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:19:11.548 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:19:11.584 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:19:12.110 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:19:12.138 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:19:12.219 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:19:12.249 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:19:12.546 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-12T17:19:12.546 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-12T17:19:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:19:14.689 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:19:15.285 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:19:15.342 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:19:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:19:15.435 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:19:15.435 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:19:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:15.468 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:19:22.426 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:19:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:19:22.743 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-12T17:19:22.815 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:19:22.841 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:19:22.914 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:19:22.961 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:19:23.010 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:19:23.052 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:19:23.077 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:19:23.132 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:19:23.464 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:19:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:19:23.717 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:19:23.746 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:19:23.838 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:19:23.867 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:19:23.910 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:19:23.942 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:19:23.968 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:19:23.994 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:19:24.026 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:19:24.060 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:19:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:19:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:19:24.363 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:19:24.403 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:19:24.439 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:19:24.467 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:19:24.570 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:19:24.593 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:19:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:19:24.672 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:19:24.695 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:19:24.865 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:19:24.894 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:19:25.016 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:19:25.051 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:19:25.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:19:25.179 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:19:25.230 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:19:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-09-12T17:19:25.282 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:25.313 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:19:25.346 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:19:25.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:19:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:19:25.428 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:19:25.456 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:19:25.457 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:19:25.474 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:19:25.474 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:25.474 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:19:25.475 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:25.488 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:19:25.521 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:19:25.571 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:19:25.603 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:19:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:19:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:19:25.751 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:19:25.794 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:19:25.830 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:19:25.863 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:19:25.941 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:19:25.982 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:19:26.016 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:19:26.058 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:19:26.135 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:19:26.281 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:19:26.337 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:19:26.874 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:19:26.957 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:19:26.985 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:19:27.017 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:19:27.045 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:19:27.066 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:27.066 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:19:27.066 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:19:27.067 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:19:27.067 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:27.067 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:19:27.102 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:19:27.138 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:19:27.167 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:19:27.239 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:19:27.275 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:19:27.278 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:19:27.301 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:19:27.301 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:27.301 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:19:27.301 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:19:27.301 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:19:27.301 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:27.311 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:19:27.347 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:19:27.385 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:19:27.418 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:19:27.459 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:19:27.501 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:19:27.575 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:19:27.610 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:19:27.647 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:19:27.739 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:19:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:19:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:19:27.793 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:27.793 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:19:27.793 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:19:27.793 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:19:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:27.804 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:19:27.878 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:19:27.898 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:19:27.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:19:27.960 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:19:28.017 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:19:28.063 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:19:28.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:19:28.245 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:19:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:19:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:19:28.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:19:28.465 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:19:28.514 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:19:28.547 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:19:28.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:19:28.662 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:19:28.792 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:19:28.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:19:29.037 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:19:29.084 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:19:29.115 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:19:29.145 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:19:29.186 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:19:29.215 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:19:29.228 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:19:29.228 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:19:29.228 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:19:29.411 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:19:29.491 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:19:29.547 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:19:29.571 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:19:29.596 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:19:29.623 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:19:30.048 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:19:30.094 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:19:30.108 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:19:30.108 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:19:30.108 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:19:30.150 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:19:30.185 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:19:30.218 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:19:30.259 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:19:30.302 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:19:30.392 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:19:30.450 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:19:30.480 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:19:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:19:30.640 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:19:30.955 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:19:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:19:31.118 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:19:31.184 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:19:31.382 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:19:31.387 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:19:31.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:19:31.438 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:19:31.462 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:19:31.520 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:19:31.564 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:19:31.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:19:31.626 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:19:31.768 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:19:31.796 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:19:31.813 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:19:31.843 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:19:31.857 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:19:31.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:19:32.393 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:19:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:19:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:19:32.525 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:19:32.556 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:19:32.739 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:19:32.763 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:19:32.775 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:19:32.827 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:19:32.840 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:19:33.317 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:19:33.359 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:19:33.390 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:19:33.418 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:19:33.462 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:19:33.499 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:19:33.515 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:19:33.534 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:19:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:19:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:19:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:19:33.630 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:19:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:19:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:19:33.689 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:19:33.719 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:19:33.747 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:19:33.782 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:19:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:19:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:19:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:19:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:19:33.962 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:19:34.001 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:19:34.043 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:19:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:19:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:19:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:19:34.208 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:19:34.238 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:19:34.279 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:19:34.314 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:19:34.339 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:19:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:19:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:19:34.617 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:19:34.644 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:19:34.677 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:19:34.818 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:19:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:19:34.904 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:19:34.947 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:19:34.981 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:19:34.991 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:19:35.051 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:19:35.085 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:19:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:19:35.112 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:19:35.141 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:19:35.141 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:19:35.152 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:19:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:19:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:19:35.157 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:19:35.190 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:19:35.213 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:19:35.230 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:19:35.262 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:19:35.290 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:19:35.608 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:19:35.609 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:19:35.634 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:19:35.652 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:19:35.652 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:19:35.652 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:35.661 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:19:35.762 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:19:35.794 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:19:35.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:19:35.863 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:19:35.905 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:19:35.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:19:35.954 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:19:35.974 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:19:35.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:19:36.010 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:19:36.023 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:19:36.047 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:19:36.053 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:19:36.071 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:19:36.316 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:19:36.363 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:19:36.391 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:19:36.416 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:19:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:19:36.468 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:19:36.492 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:19:36.521 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:19:36.522 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:19:36.556 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:19:36.559 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:19:36.577 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:19:36.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:19:36.641 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:19:36.688 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:19:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:19:37.039 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:19:37.124 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:19:37.192 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:19:37.222 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:19:37.434 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:19:37.517 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:19:37.542 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:19:37.565 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:19:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:19:37.609 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:19:37.666 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:19:37.704 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:19:37.715 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:19:37.746 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:19:37.767 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:19:37.797 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:19:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:19:37.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:19:37.881 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:19:37.910 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:19:37.979 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:19:38.017 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:19:38.041 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:19:38.061 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:19:38.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:19:38.114 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:19:38.151 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:19:38.177 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:19:38.245 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:19:38.270 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:19:38.304 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:19:38.365 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:19:38.394 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:19:41.780 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:19:41.834 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:19:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:19:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:19:43.008 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:19:43.171 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:19:43.195 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:19:43.220 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:19:43.220 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:43.220 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:19:43.220 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:19:43.220 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:19:43.220 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:43.270 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:19:43.282 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:19:43.296 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:19:43.326 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:19:43.375 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:19:43.406 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:19:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:19:43.422 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:19:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:44.440 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:19:44.465 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:19:44.465 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:44.465 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:19:44.465 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:19:44.465 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:19:44.466 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:44.524 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:19:44.548 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:19:44.548 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:44.548 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:19:44.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:19:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:19:44.908 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:19:44.909 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:19:44.909 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:19:44.909 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:19:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:49.462 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:19:49.508 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:19:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:19:49.543 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:19:49.553 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:19:49.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:19:49.624 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:19:49.652 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:19:49.655 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:19:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:19:49.713 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:19:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:19:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:19:49.835 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:19:49.835 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:19:49.918 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:19:49.935 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:19:49.941 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:19:49.951 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:19:49.961 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:19:49.961 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:19:49.961 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:19:49.961 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:19:50.047 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:19:50.121 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:19:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:19:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:19:50.284 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:19:50.314 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:19:52.706 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:19:52.748 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:19:53.315 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:19:53.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:19:53.451 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:19:53.451 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:19:53.451 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:19:53.451 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:19:53.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:19:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:19:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:19:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:19:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:19:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:19:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:19:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:19:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:19:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:19:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:19:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:19:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:19:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:19:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:19:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:19:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:19:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:19:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:19:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:19:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:19:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:19:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:19:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:19:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:19:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:19:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:19:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:19:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:19:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:20:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:20:02.652 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-09-12T17:20:02.652 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-09-12T17:20:02.652 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-09-12T17:20:02.652 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-09-12T17:20:02.652 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-09-12T17:20:02.653 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-09-12T17:20:02.653 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-09-12T17:20:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:20:02.843 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:20:02.843 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:02.843 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:20:02.843 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:20:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:20:02.995 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:20:02.997 INFO:teuthology.orchestra.run.smithi063.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:20:02.998 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:20:02.999 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:20:03.000 INFO:teuthology.orchestra.run.smithi063.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:20:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:20:03.003 INFO:teuthology.orchestra.run.smithi063.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:20:03.004 INFO:teuthology.orchestra.run.smithi063.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:20:03.004 INFO:teuthology.orchestra.run.smithi063.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:20:03.004 INFO:teuthology.orchestra.run.smithi063.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:20:03.004 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:20:03.004 INFO:teuthology.orchestra.run.smithi063.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:20:03.004 INFO:teuthology.orchestra.run.smithi063.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:20:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:20:03.006 INFO:teuthology.orchestra.run.smithi063.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:20:03.007 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:20:03.008 INFO:teuthology.orchestra.run.smithi063.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:20:03.009 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:20:03.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:20:03.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:20:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:20:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.014 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:20:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:20:03.016 INFO:teuthology.orchestra.run.smithi063.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:20:03.017 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:20:03.018 INFO:teuthology.orchestra.run.smithi063.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:20:03.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:03.018 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-12T17:20:03.446 DEBUG:teuthology.parallel:result is None 2024-09-12T17:20:04.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:20:04.330 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:20:04.330 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:04.330 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:20:04.330 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:20:04.330 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:20:04.330 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:04.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:20:04.584 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:20:04.585 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:04.585 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:20:04.585 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:20:04.585 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:20:04.585 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:05.029 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:20:05.052 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:20:05.052 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:05.052 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:20:05.052 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:20:05.053 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:20:05.053 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:05.156 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:20:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:20:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:20:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:20:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:20:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:20:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:20:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:20:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:20:08.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:20:08.817 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:20:08.865 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:20:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:20:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:20:10.141 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:20:10.180 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:20:10.203 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:20:10.231 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:20:10.267 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:20:10.304 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:20:10.332 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:20:10.358 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:20:10.392 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:20:10.416 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:20:10.442 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:20:10.468 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:20:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:20:10.553 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:20:10.613 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:20:10.649 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:20:10.679 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:20:10.714 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:20:10.748 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:20:10.776 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:20:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:20:10.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:20:10.901 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:20:10.933 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:20:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:20:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:20:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:20:11.072 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:20:11.101 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:20:11.126 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:20:11.294 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:20:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:20:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:20:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:20:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:20:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:20:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:20:11.679 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:20:11.717 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:20:11.823 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:20:11.864 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:20:11.879 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:20:11.910 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:20:11.932 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:20:12.494 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:20:12.510 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:20:12.511 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:20:12.511 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:12.737 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:20:12.806 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:20:12.845 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:20:12.881 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:20:12.906 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:20:13.346 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:20:13.377 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:20:13.392 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:20:13.939 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:20:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:20:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:20:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:20:14.288 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:20:14.341 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:20:14.367 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:20:14.388 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:20:14.417 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:20:14.485 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:20:14.512 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:20:14.523 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:20:14.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:20:14.566 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:20:14.588 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:20:15.027 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:20:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:20:15.085 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:20:15.161 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:20:15.193 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:20:18.402 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:20:18.449 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:20:19.415 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:20:19.449 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:20:19.564 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:20:19.728 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:20:19.759 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:20:19.782 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:20:19.782 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:19.782 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:20:19.782 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:20:19.782 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:20:19.783 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:20:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:20:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:20:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:20:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:20:19.962 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:20:19.977 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:20:19.978 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:20:19.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:20.929 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:20:20.953 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:20:20.953 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:20.953 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:20:20.953 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:20:20.953 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:20:20.953 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:21.005 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:20:21.028 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:20:21.028 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:21.028 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:20:21.028 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:21.347 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:20:21.370 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:20:21.370 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:20:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:20:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:20:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:20:21.371 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:20:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:20:25.740 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:20:25.844 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:20:25.908 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:20:25.939 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:20:25.939 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:20:26.032 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:20:26.032 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:20:26.122 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:20:26.139 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:20:26.145 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:20:26.154 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:20:26.164 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:20:26.164 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:20:26.164 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:20:26.164 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:26.235 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:20:26.303 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:20:36.400 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:20:36.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:20:36.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:20:36.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:20:36.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:20:36.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:20:36.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:20:36.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:20:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:20:36.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:20:36.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:20:36.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:20:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:20:36.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:20:36.431 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:20:36.432 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:20:36.433 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:20:36.434 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:20:36.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:20:36.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:20:36.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:20:36.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:20:36.439 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:20:36.440 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:20:36.441 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:20:36.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:20:36.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:20:36.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:20:36.445 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:20:36.445 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:20:36.445 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:20:36.445 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:20:36.445 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:20:36.445 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:20:39.872 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:20:39.873 INFO:teuthology.orchestra.run.smithi082.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:20:39.875 INFO:teuthology.orchestra.run.smithi082.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:20:39.876 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:20:39.877 INFO:teuthology.orchestra.run.smithi082.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:20:39.878 INFO:teuthology.orchestra.run.smithi082.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:20:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:20:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:20:39.881 INFO:teuthology.orchestra.run.smithi082.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:20:39.882 INFO:teuthology.orchestra.run.smithi082.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:20:39.883 INFO:teuthology.orchestra.run.smithi082.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:20:39.884 INFO:teuthology.orchestra.run.smithi082.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:20:39.886 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:20:39.887 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:20:39.888 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:20:39.889 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:20:39.890 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:20:39.891 INFO:teuthology.orchestra.run.smithi082.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:20:39.892 INFO:teuthology.orchestra.run.smithi082.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:20:39.893 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:39.893 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-12T17:20:40.297 DEBUG:teuthology.parallel:result is None 2024-09-12T17:20:40.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:20:40.458 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:20:40.526 INFO:teuthology.orchestra.run.smithi063.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:20:40.527 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:20:40.527 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:20:40.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:20:40.679 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:20:40.751 INFO:teuthology.orchestra.run.smithi082.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:20:40.751 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:20:40.751 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:20:40.752 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:20:40.753 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:40.753 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:20:40.802 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:20:40.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:20:40.844 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:20:40.844 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:40.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:20:40.889 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:20:40.970 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:20:40.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:20:41.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:20:41.086 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:20:41.086 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:41.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:20:41.128 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:20:41.208 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:20:41.208 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:20:41.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:20:41.324 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:20:41.324 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:41.324 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:20:41.364 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:20:41.445 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:20:41.445 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:20:41.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:20:41.561 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:20:41.637 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:20:41.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-09-12T17:20:41.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-09-12T17:20:41.678 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:20:41.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:20:41.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:20:41.759 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:20:41.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:20:41.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:20:41.849 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:20:41.849 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:20:41.849 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7902722', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFL0IVSJAK1eV412x6lgJcr0ZGXjVXJ8oTr0DXoacMWYyx0XvuZimVHTbQQHms6zWT16peb9GHDiQ1piW8mjnNU=', 'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOggYi/usk5mCuulBTM5YuZnEG5C2x7QUBj3lqCRPuvuO5XK/Q7o2L8wSXgHd2WiuI0Jsh7qMpJo9yQ1Nh3Ppro='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:20:41.850 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:20:41.881 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:20:41.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:20:41.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:20:41.988 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:41.988 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:20:42.058 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:20:42.058 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 17:19:51.092272132 +0000 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 17:17:30.716859793 +0000 2024-09-12T17:20:42.129 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 17:17:30.716859793 +0000 2024-09-12T17:20:42.129 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 17:17:30.716859793 +0000 2024-09-12T17:20:42.129 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:20:42.207 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T17:20:42.207 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T17:20:42.207 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000259735 s, 2.0 MB/s 2024-09-12T17:20:42.208 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:20:42.280 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-12T17:20:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 17:19:51.093272122 +0000 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 17:17:31.064856490 +0000 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 17:17:31.064856490 +0000 2024-09-12T17:20:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 17:17:31.064856490 +0000 2024-09-12T17:20:42.351 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:20:42.430 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T17:20:42.430 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T17:20:42.430 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000294089 s, 1.7 MB/s 2024-09-12T17:20:42.431 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:20:42.501 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-12T17:20:42.570 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:20:42.570 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:42.571 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T17:20:42.571 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:42.571 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:42.571 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 17:19:51.093272122 +0000 2024-09-12T17:20:42.571 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 17:17:31.397853329 +0000 2024-09-12T17:20:42.571 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 17:17:31.397853329 +0000 2024-09-12T17:20:42.571 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 17:17:31.397853329 +0000 2024-09-12T17:20:42.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:20:42.648 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T17:20:42.649 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T17:20:42.649 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000176599 s, 2.9 MB/s 2024-09-12T17:20:42.650 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:20:42.720 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-12T17:20:42.789 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:20:42.789 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:42.789 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T17:20:42.789 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:42.789 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:42.790 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 17:19:51.094272112 +0000 2024-09-12T17:20:42.790 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 17:17:31.726850207 +0000 2024-09-12T17:20:42.790 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 17:17:31.726850207 +0000 2024-09-12T17:20:42.790 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 17:17:31.726850207 +0000 2024-09-12T17:20:42.790 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:20:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T17:20:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T17:20:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.0001841 s, 2.8 MB/s 2024-09-12T17:20:42.868 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:20:42.938 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:20:42.938 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:20:42.938 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:20:42.970 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:20:42.970 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-09-12T17:20:43.041 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:20:43.041 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:43.041 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T17:20:43.041 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:43.042 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:43.042 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-12 17:20:27.344800085 +0000 2024-09-12T17:20:43.042 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-12 17:17:21.802910872 +0000 2024-09-12T17:20:43.042 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-12 17:17:21.802910872 +0000 2024-09-12T17:20:43.042 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-12 17:17:21.802910872 +0000 2024-09-12T17:20:43.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:20:43.121 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-12T17:20:43.121 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-12T17:20:43.121 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000190325 s, 2.7 MB/s 2024-09-12T17:20:43.122 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:20:43.192 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-09-12T17:20:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:20:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:43.260 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T17:20:43.260 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:43.260 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:43.260 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-12 17:20:27.344800085 +0000 2024-09-12T17:20:43.260 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-12 17:17:22.130904263 +0000 2024-09-12T17:20:43.261 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-12 17:17:22.130904263 +0000 2024-09-12T17:20:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-12 17:17:22.130904263 +0000 2024-09-12T17:20:43.261 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:20:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-12T17:20:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-12T17:20:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000222226 s, 2.3 MB/s 2024-09-12T17:20:43.339 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:20:43.408 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-09-12T17:20:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:20:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:43.477 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T17:20:43.477 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:43.477 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:43.477 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-12 17:20:27.344800085 +0000 2024-09-12T17:20:43.477 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-12 17:17:22.466897493 +0000 2024-09-12T17:20:43.478 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-12 17:17:22.466897493 +0000 2024-09-12T17:20:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-12 17:17:22.466897493 +0000 2024-09-12T17:20:43.478 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:20:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-12T17:20:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-12T17:20:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000205583 s, 2.5 MB/s 2024-09-12T17:20:43.555 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:20:43.624 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-12 17:20:27.344800085 +0000 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-12 17:17:22.794890884 +0000 2024-09-12T17:20:43.692 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-12 17:17:22.794890884 +0000 2024-09-12T17:20:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-12 17:17:22.794890884 +0000 2024-09-12T17:20:43.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:20:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-12T17:20:43.768 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-12T17:20:43.768 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000189199 s, 2.7 MB/s 2024-09-12T17:20:43.769 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:20:43.838 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:20:43.838 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:20:43.838 INFO:tasks.ceph:Generating config... 2024-09-12T17:20:43.839 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:20:43.839 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:20:43.839 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:20:43.839 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:20:43.839 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:20:43.840 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:20:43.841 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:20:43.841 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:20:43.841 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:20:43.841 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:20:43.841 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:20:43.841 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:20:43.841 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:20:43.841 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:20:43.841 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:20:43.841 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T17:20:43.841 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:20:43.841 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:20:43.841 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:20:43.842 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:20:43.843 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:20:43.843 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:20:43.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:20:43.933 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:20:43.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:20:43.997 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:20:44.036 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.c', '[v2:172.21.15.63:3301,v1:172.21.15.63:6790]'), ('mon.b', '172.21.15.82')] 2024-09-12T17:20:44.037 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],172.21.15.82', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:20:44.038 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:44.038 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:20:44.107 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --addv c '[v2:172.21.15.63:3301,v1:172.21.15.63:6790]' --add b 172.21.15.82 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:44.208 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:44.208 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-09-12T17:20:44.209 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-09-12T17:20:44.210 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:20:44.210 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:20:44.210 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:20:44.210 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:20:44.211 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:20:44.240 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 40c8ab5f-c624-4f6c-a988-0ddc1f0db948... 2024-09-12T17:20:44.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:20:44.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-12T17:20:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-12T17:20:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],172.21.15.82" 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: mon client directed command retry = 5 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject socket failures = 5000 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.343 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-09-12T17:20:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 1/20 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 1/20 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: debug objclass = 20 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 4/10 2024-09-12T17:20:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: lockdep = True 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: osd shutdown pgref assert = True 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-12T17:20:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-12T17:20:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: lockdep = True 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = True 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: debug rgw = 20 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: debug rgw notification = 20 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw bucket counters cache = True 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw crypt require ssl = False 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:20:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: rgw s3 auth use sts = True 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: rgw torrent flag = True 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: rgw user counters cache = True 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: setgroup = ceph 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: setuser = ceph 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-09-12T17:20:44.351 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-09-12T17:20:44.353 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-09-12T17:20:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-09-12T17:20:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:20:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-09-12T17:20:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:20:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-09-12T17:20:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],172.21.15.82" 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: mon client directed command retry = 5 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: ms inject socket failures = 5000 2024-09-12T17:20:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-09-12T17:20:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-09-12T17:20:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: bdev async discard = True 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: bdev enable discard = True 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore allocator = bitmap 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2024-09-12T17:20:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: debug objclass = 20 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: lockdep = True 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: osd shutdown pgref assert = True 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-09-12T17:20:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-09-12T17:20:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:20:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: lockdep = True 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = True 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: debug rgw = 20 2024-09-12T17:20:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: debug rgw notification = 20 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw bucket counters cache = True 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw crypt require ssl = False 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw s3 auth use sts = True 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw torrent flag = True 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: rgw user counters cache = True 2024-09-12T17:20:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: setgroup = ceph 2024-09-12T17:20:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: setuser = ceph 2024-09-12T17:20:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-09-12T17:20:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-09-12T17:20:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-09-12T17:20:44.365 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:20:44.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:20:44.436 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:20:44.436 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:44.436 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:20:44.465 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:44.465 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:20:44.534 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T17:20:44.534 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:44.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:20:44.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:20:44.625 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:20:44.625 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:44.694 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T17:20:44.694 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:20:44.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:20:44.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:20:44.746 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:20:44.746 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:44.816 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:20:44.816 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:20:44.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:20:44.884 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:20:44.886 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:20:44.958 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:20:44.961 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:20:44.961 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:20:44.961 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:20:45.017 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:20:45.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:20:45.085 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:20:45.097 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:20:45.098 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:20:45.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:20:45.137 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:20:45.137 INFO:tasks.ceph:role: osd.0 2024-09-12T17:20:45.137 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T17:20:45.138 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:20:45.224 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:20:45.224 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:20:45.224 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:20:45.225 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:20:45.225 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:20:45.225 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:20:45.225 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:20:45.225 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:20:45.225 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:20:45.225 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:20:45.738 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T17:20:45.740 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T17:20:45.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:20:45.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:20:45.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:20:45.947 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:20:45.947 INFO:tasks.ceph:role: osd.1 2024-09-12T17:20:45.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T17:20:45.947 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:20:46.033 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:20:46.034 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:20:46.493 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T17:20:46.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T17:20:46.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:20:46.557 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:20:46.601 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:20:46.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:20:46.682 INFO:tasks.ceph:role: osd.2 2024-09-12T17:20:46.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T17:20:46.682 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:20:46.769 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:20:46.769 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:20:46.769 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:20:46.769 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:20:46.769 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:20:46.769 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:20:46.770 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:20:46.770 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:20:46.770 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:20:46.770 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:20:47.265 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T17:20:47.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T17:20:47.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:20:47.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:20:47.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:20:47.470 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:20:47.470 INFO:tasks.ceph:role: osd.3 2024-09-12T17:20:47.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T17:20:47.470 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:20:47.557 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:20:48.076 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T17:20:48.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T17:20:48.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:20:48.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:20:48.246 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:48.329+0000 7fd576424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:20:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:48.329+0000 7fd576424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:20:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:48.329+0000 7fd576424640 -1 bdev(0x560ac29e9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:20:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:48.329+0000 7fd576424640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:20:51.482 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:20:51.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:51.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:51.592+0000 7f809ca0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:20:51.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:51.593+0000 7f809ca0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:20:51.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:51.593+0000 7f809ca0f640 -1 bdev(0x560b62e03800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:20:51.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:51.593+0000 7f809ca0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:20:54.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:20:54.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:54.608+0000 7f83a8a0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:20:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:54.609+0000 7f83a8a0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:20:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:54.609+0000 7f83a8a0b640 -1 bdev(0x55c00ed8b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:20:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:54.609+0000 7f83a8a0b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:20:57.778 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:20:57.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:20:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:57.887+0000 7facfd81f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:20:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:57.888+0000 7facfd81f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:20:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:57.888+0000 7facfd81f640 -1 bdev(0x55891125b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:20:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:20:57.888+0000 7facfd81f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:21:01.318 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:21:01.365 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:21:01.411 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:21:01.411 INFO:tasks.ceph:role: osd.4 2024-09-12T17:21:01.411 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T17:21:01.411 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:21:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:21:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:21:01.972 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-09-12T17:21:01.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-09-12T17:21:01.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:21:02.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:21:02.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:21:02.185 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:21:02.185 INFO:tasks.ceph:role: osd.5 2024-09-12T17:21:02.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T17:21:02.185 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:21:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:21:02.271 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:21:02.271 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:21:02.272 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:21:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:21:02.272 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:21:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:21:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:21:02.272 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:21:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:21:02.737 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-09-12T17:21:02.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-09-12T17:21:02.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:21:02.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:21:02.859 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:21:02.898 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:21:02.898 INFO:tasks.ceph:role: osd.6 2024-09-12T17:21:02.898 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T17:21:02.898 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:21:02.984 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:21:02.985 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:21:03.482 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-09-12T17:21:03.484 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-09-12T17:21:03.484 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:21:03.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:21:03.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:21:03.666 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:21:03.666 INFO:tasks.ceph:role: osd.7 2024-09-12T17:21:03.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T17:21:03.666 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:21:03.751 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:21:03.752 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:21:04.268 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-09-12T17:21:04.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-09-12T17:21:04.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:21:04.376 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:21:04.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:21:04.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:04.550+0000 7f12e4214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:21:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:04.551+0000 7f12e4214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:21:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:04.551+0000 7f12e4214640 -1 bdev(0x5579c814f800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:21:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:04.551+0000 7f12e4214640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:21:07.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:21:07.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:21:07.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:07.616+0000 7f356f8da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:21:07.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:07.616+0000 7f356f8da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:21:07.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:07.616+0000 7f356f8da640 -1 bdev(0x55a7c2f71800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:21:07.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:07.616+0000 7f356f8da640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:21:10.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:21:10.574 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:21:10.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:10.676+0000 7fed10e2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:21:10.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:10.676+0000 7fed10e2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:21:10.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:10.676+0000 7fed10e2c640 -1 bdev(0x55dd0bc31800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:21:10.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:10.676+0000 7fed10e2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:21:13.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:21:13.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:21:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:13.735+0000 7ff9a840b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:21:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:13.736+0000 7ff9a840b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:21:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:13.736+0000 7ff9a840b640 -1 bdev(0x564efe1cd800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:21:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-12T17:21:13.736+0000 7ff9a840b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:21:17.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:21:17.193 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:21:17.194 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:17.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:21:17.242 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:17.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:21:17.326 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:17.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:21:17.409 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:17.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:21:17.490 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:17.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:21:17.572 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:17.572 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:21:17.618 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:17.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:21:17.700 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:17.701 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:21:17.782 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:17.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:21:17.861 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:17.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:21:17.942 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:17.942 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:21:17.973 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:17.973 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:21:18.010 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:21:18.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:21:18.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:21:18.053 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-09-12T17:21:18.053 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDsIuNm1AexNBAAd4LxfLTMGb/ArnIeeEMLXg== 2024-09-12T17:21:18.053 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-09-12T17:21:18.053 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDwIuNm0SexExAAdMt7zctBle+stnoNFFdBPA== 2024-09-12T17:21:18.053 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-09-12T17:21:18.053 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDzIuNmNk5lIxAAJIcGvnBHn0YFr7INn/SgEA== 2024-09-12T17:21:18.053 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD2IuNm9RdZJBAAvzEoRd7WD252XpLFA4q2nw== 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD5IuNmKbf5NBAAriAAhR9aMSpFXlAeuw/jTg== 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDsIuNmbdUkORAAUUSm1kjrYx5P/X3/orPpBA== 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAAI+NmQefZIBAATJMNXjILz/5kyYoioFFBhA== 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQADI+NmUfLWJBAAtaC9etQjpKv63i59cE8+Rg== 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAGI+NmwdZnKBAAVZiHgudFd/GkwXHjRUbU0w== 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-09-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAJI+NmNLb3KxAAkRBgM0/+g5xMfFaEJCXUXg== 2024-09-12T17:21:18.055 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-12T17:21:18.055 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDtIuNmUP4GARAA9yoJ6ALmSpzKPk3DxHGgdQ== 2024-09-12T17:21:18.055 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2024-09-12T17:21:18.055 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDtIuNmTvgRBRAA1MRklRWlwxpx68W9yEAGLQ== 2024-09-12T17:21:18.086 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2024-09-12T17:21:18.086 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDsIuNm1AexNBAAd4LxfLTMGb/ArnIeeEMLXg== 2024-09-12T17:21:18.086 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2024-09-12T17:21:18.086 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDwIuNm0SexExAAdMt7zctBle+stnoNFFdBPA== 2024-09-12T17:21:18.086 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2024-09-12T17:21:18.086 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDzIuNmNk5lIxAAJIcGvnBHn0YFr7INn/SgEA== 2024-09-12T17:21:18.086 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQD2IuNm9RdZJBAAvzEoRd7WD252XpLFA4q2nw== 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQD5IuNmKbf5NBAAriAAhR9aMSpFXlAeuw/jTg== 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDsIuNmbdUkORAAUUSm1kjrYx5P/X3/orPpBA== 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAAI+NmQefZIBAATJMNXjILz/5kyYoioFFBhA== 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQADI+NmUfLWJBAAtaC9etQjpKv63i59cE8+Rg== 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAGI+NmwdZnKBAAVZiHgudFd/GkwXHjRUbU0w== 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2024-09-12T17:21:18.087 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAJI+NmNLb3KxAAkRBgM0/+g5xMfFaEJCXUXg== 2024-09-12T17:21:18.088 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-09-12T17:21:18.088 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDtIuNmUP4GARAA9yoJ6ALmSpzKPk3DxHGgdQ== 2024-09-12T17:21:18.088 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2024-09-12T17:21:18.088 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDtIuNmTvgRBRAA1MRklRWlwxpx68W9yEAGLQ== 2024-09-12T17:21:18.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:21:18.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:21:18.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.261 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:21:18.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:21:18.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.660 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:21:18.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:21:18.796 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:21:18.863 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:21:18.865 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:21:18.933 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:21:18.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:21:18.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:21:19.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:21:19.125 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:21:19.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:21:19.320 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:21:19.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:21:19.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:21:19.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:21:19.548 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:21:19.551 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:21:19.618 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:21:19.618 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:21:19.618 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:21:19.622 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:21:19.622 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:21:19.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:21:19.624 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:21:19.625 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:21:19.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:21:19.660 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:21:19.660 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:21:19.661 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:21:19.661 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:21:19.663 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:21:19.663 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:21:19.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:21:19.665 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:21:19.665 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:21:19.665 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:21:19.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:21:20.049 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-12T17:21:20.061 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:21:20.061 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:21:20.062 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:20.062 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:21:20.101 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:20.101 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:21:20.182 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:20.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:21:20.261 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:21:20.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:21:20.343 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:20.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:21:20.381 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:20.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:21:20.462 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:20.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:21:20.540 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-12T17:21:20.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:21:20.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new cf700c49-6315-49f1-a9fc-b0ace076f8ac 0 2024-09-12T17:21:20.852 INFO:teuthology.orchestra.run.smithi082.stdout:0 2024-09-12T17:21:20.863 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 67ee34cb-38d4-4fff-b754-9c1d5d652c98 1 2024-09-12T17:21:21.064 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-09-12T17:21:21.075 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 7b375013-f20c-4bf8-813a-2f71d7167197 2 2024-09-12T17:21:21.265 INFO:teuthology.orchestra.run.smithi082.stdout:2 2024-09-12T17:21:21.277 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 180f047c-136f-46ea-bd8a-cf03aaa497d4 3 2024-09-12T17:21:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:3 2024-09-12T17:21:21.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189 4 2024-09-12T17:21:21.684 INFO:teuthology.orchestra.run.smithi082.stdout:4 2024-09-12T17:21:21.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 08d6d21d-bda6-4f15-a8d1-961c7edef2f9 5 2024-09-12T17:21:21.891 INFO:teuthology.orchestra.run.smithi082.stdout:5 2024-09-12T17:21:21.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 195868a1-ad74-421f-a581-6f1589108a49 6 2024-09-12T17:21:22.094 INFO:teuthology.orchestra.run.smithi082.stdout:6 2024-09-12T17:21:22.106 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 489ffcc8-e25e-4999-aa3a-47b0234e22f8 7 2024-09-12T17:21:22.302 INFO:teuthology.orchestra.run.smithi082.stdout:7 2024-09-12T17:21:22.313 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:21:22.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:21:22.315 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:21:22.316 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:21:22.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:21:22.318 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:21:22.318 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:21:22.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:21:22.321 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:21:22.321 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:21:22.321 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:21:22.323 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:21:22.324 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:21:22.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:21:22.326 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:21:22.326 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:21:22.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:21:22.329 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:21:22.329 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:21:22.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:21:22.331 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:21:22.331 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:21:22.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:21:22.333 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:21:22.334 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:21:22.559 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:22.560 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"fsid":"40c8ab5f-c624-4f6c-a988-0ddc1f0db948","created":"2024-09-12T17:21:19.931623+0000","modified":"2024-09-12T17:21:22.297484+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:21:22.297484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf700c49-6315-49f1-a9fc-b0ace076f8ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67ee34cb-38d4-4fff-b754-9c1d5d652c98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b375013-f20c-4bf8-813a-2f71d7167197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"180f047c-136f-46ea-bd8a-cf03aaa497d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08d6d21d-bda6-4f15-a8d1-961c7edef2f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"195868a1-ad74-421f-a581-6f1589108a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"489ffcc8-e25e-4999-aa3a-47b0234e22f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:21:22.571 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:21:22.571 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:21:23.316 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T17:21:23.315+0000 7f91ad82c640 -1 Falling back to public interface 2024-09-12T17:21:23.319 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-09-12T17:21:23.318+0000 7f7f9d40d640 -1 Falling back to public interface 2024-09-12T17:21:23.378 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:21:23.553 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T17:21:23.552+0000 7fa2103db640 -1 Falling back to public interface 2024-09-12T17:21:23.558 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-12T17:21:23.558 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"40c8ab5f-c624-4f6c-a988-0ddc1f0db948","created":"2024-09-12T17:21:19.931623+0000","modified":"2024-09-12T17:21:22.297484+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:21:22.297484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf700c49-6315-49f1-a9fc-b0ace076f8ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67ee34cb-38d4-4fff-b754-9c1d5d652c98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b375013-f20c-4bf8-813a-2f71d7167197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"180f047c-136f-46ea-bd8a-cf03aaa497d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08d6d21d-bda6-4f15-a8d1-961c7edef2f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"195868a1-ad74-421f-a581-6f1589108a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"489ffcc8-e25e-4999-aa3a-47b0234e22f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:21:23.567 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:21:23.589 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-09-12T17:21:23.588+0000 7f32f5a0f640 -1 Falling back to public interface 2024-09-12T17:21:23.810 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T17:21:23.809+0000 7f5f56920640 -1 Falling back to public interface 2024-09-12T17:21:24.057 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-09-12T17:21:24.056+0000 7f4b3c00d640 -1 Falling back to public interface 2024-09-12T17:21:24.066 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-09-12T17:21:24.065+0000 7f921540f640 -1 Falling back to public interface 2024-09-12T17:21:24.079 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T17:21:24.078+0000 7fc06900c640 -1 Falling back to public interface 2024-09-12T17:21:25.229 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-09-12T17:21:25.227+0000 7f45f88e7640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:21:25.229 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-09-12T17:21:25.227+0000 7f45f88e7640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:21:26.909 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-09-12T17:21:26.908+0000 7f7f9d40d640 -1 osd.7 0 log_to_monitors true 2024-09-12T17:21:27.158 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T17:21:27.157+0000 7f91ad82c640 -1 osd.1 0 log_to_monitors true 2024-09-12T17:21:27.376 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T17:21:27.375+0000 7fa2103db640 -1 osd.0 0 log_to_monitors true 2024-09-12T17:21:27.406 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T17:21:27.405+0000 7f5f56920640 -1 osd.3 0 log_to_monitors true 2024-09-12T17:21:27.845 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-09-12T17:21:27.844+0000 7f921540f640 -1 osd.4 0 log_to_monitors true 2024-09-12T17:21:27.885 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-09-12T17:21:27.884+0000 7f32f5a0f640 -1 osd.6 0 log_to_monitors true 2024-09-12T17:21:28.137 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T17:21:28.136+0000 7fc06900c640 -1 osd.2 0 log_to_monitors true 2024-09-12T17:21:28.342 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-09-12T17:21:28.341+0000 7f4b3c00d640 -1 osd.5 0 log_to_monitors true 2024-09-12T17:21:28.852 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-09-12T17:21:28.851+0000 7f7f98e50640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:21:28.865 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-09-12T17:21:28.864+0000 7f7f90c6f640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:30.375 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:21:30.752 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-09-12T17:21:30.751+0000 7f9211612640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:21:30.771 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-09-12T17:21:30.770+0000 7f9208c1d640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:30.797 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-09-12T17:21:30.796+0000 7f32f128b640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:21:30.826 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-09-12T17:21:30.825+0000 7f32e90aa640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:30.865 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T17:21:30.864+0000 7f5f528b4640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:21:30.881 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T17:21:30.880+0000 7f5f4a6d3640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:30.894 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T17:21:30.893+0000 7f91a97c0640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:21:30.909 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T17:21:30.908+0000 7f91a15df640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:30.910 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T17:21:30.909+0000 7fa20c36f640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:21:30.911 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-12T17:21:30.911 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":14,"fsid":"40c8ab5f-c624-4f6c-a988-0ddc1f0db948","created":"2024-09-12T17:21:19.931623+0000","modified":"2024-09-12T17:21:29.953762+0000","last_up_change":"2024-09-12T17:21:28.952165+0000","last_in_change":"2024-09-12T17:21:22.297484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf700c49-6315-49f1-a9fc-b0ace076f8ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67ee34cb-38d4-4fff-b754-9c1d5d652c98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b375013-f20c-4bf8-813a-2f71d7167197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"180f047c-136f-46ea-bd8a-cf03aaa497d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08d6d21d-bda6-4f15-a8d1-961c7edef2f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"195868a1-ad74-421f-a581-6f1589108a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"489ffcc8-e25e-4999-aa3a-47b0234e22f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6801","nonce":1774933818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6803","nonce":1774933818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6807","nonce":1774933818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6805","nonce":1774933818}]},"public_addr":"172.21.15.82:6801/1774933818","cluster_addr":"172.21.15.82:6803/1774933818","heartbeat_back_addr":"172.21.15.82:6807/1774933818","heartbeat_front_addr":"172.21.15.82:6805/1774933818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:27.905922+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:21:30.925 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T17:21:30.926 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T17:21:30.925+0000 7fa20418e640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:31.171 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T17:21:31.170+0000 7fc0648ce640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:21:31.188 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T17:21:31.187+0000 7fc05c6ed640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:32.031 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-09-12T17:21:32.030+0000 7f4b37a3f640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:21:32.042 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-09-12T17:21:32.041+0000 7f4b2f85e640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:21:37.731 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:21:38.055 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-12T17:21:38.056 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":18,"fsid":"40c8ab5f-c624-4f6c-a988-0ddc1f0db948","created":"2024-09-12T17:21:19.931623+0000","modified":"2024-09-12T17:21:34.792695+0000","last_up_change":"2024-09-12T17:21:32.756341+0000","last_in_change":"2024-09-12T17:21:22.297484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:21:32.238457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf700c49-6315-49f1-a9fc-b0ace076f8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6809","nonce":4011131089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6811","nonce":4011131089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6815","nonce":4011131089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6813","nonce":4011131089}]},"public_addr":"172.21.15.63:6809/4011131089","cluster_addr":"172.21.15.63:6811/4011131089","heartbeat_back_addr":"172.21.15.63:6815/4011131089","heartbeat_front_addr":"172.21.15.63:6813/4011131089","state":["exists","up"]},{"osd":1,"uuid":"67ee34cb-38d4-4fff-b754-9c1d5d652c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6801","nonce":101797795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6803","nonce":101797795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6807","nonce":101797795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6805","nonce":101797795}]},"public_addr":"172.21.15.63:6801/101797795","cluster_addr":"172.21.15.63:6803/101797795","heartbeat_back_addr":"172.21.15.63:6807/101797795","heartbeat_front_addr":"172.21.15.63:6805/101797795","state":["exists","up"]},{"osd":2,"uuid":"7b375013-f20c-4bf8-813a-2f71d7167197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6825","nonce":1777922010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6827","nonce":1777922010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6831","nonce":1777922010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6829","nonce":1777922010}]},"public_addr":"172.21.15.63:6825/1777922010","cluster_addr":"172.21.15.63:6827/1777922010","heartbeat_back_addr":"172.21.15.63:6831/1777922010","heartbeat_front_addr":"172.21.15.63:6829/1777922010","state":["exists","up"]},{"osd":3,"uuid":"180f047c-136f-46ea-bd8a-cf03aaa497d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6817","nonce":1632744678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6819","nonce":1632744678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6823","nonce":1632744678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6821","nonce":1632744678}]},"public_addr":"172.21.15.63:6817/1632744678","cluster_addr":"172.21.15.63:6819/1632744678","heartbeat_back_addr":"172.21.15.63:6823/1632744678","heartbeat_front_addr":"172.21.15.63:6821/1632744678","state":["exists","up"]},{"osd":4,"uuid":"edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6825","nonce":3370836524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6827","nonce":3370836524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6831","nonce":3370836524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6829","nonce":3370836524}]},"public_addr":"172.21.15.82:6825/3370836524","cluster_addr":"172.21.15.82:6827/3370836524","heartbeat_back_addr":"172.21.15.82:6831/3370836524","heartbeat_front_addr":"172.21.15.82:6829/3370836524","state":["exists","up"]},{"osd":5,"uuid":"08d6d21d-bda6-4f15-a8d1-961c7edef2f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6817","nonce":4151406223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6819","nonce":4151406223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6823","nonce":4151406223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6821","nonce":4151406223}]},"public_addr":"172.21.15.82:6817/4151406223","cluster_addr":"172.21.15.82:6819/4151406223","heartbeat_back_addr":"172.21.15.82:6823/4151406223","heartbeat_front_addr":"172.21.15.82:6821/4151406223","state":["exists","up"]},{"osd":6,"uuid":"195868a1-ad74-421f-a581-6f1589108a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6809","nonce":3312995022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6811","nonce":3312995022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6815","nonce":3312995022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6813","nonce":3312995022}]},"public_addr":"172.21.15.82:6809/3312995022","cluster_addr":"172.21.15.82:6811/3312995022","heartbeat_back_addr":"172.21.15.82:6815/3312995022","heartbeat_front_addr":"172.21.15.82:6813/3312995022","state":["exists","up"]},{"osd":7,"uuid":"489ffcc8-e25e-4999-aa3a-47b0234e22f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6801","nonce":1774933818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6803","nonce":1774933818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6807","nonce":1774933818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6805","nonce":1774933818}]},"public_addr":"172.21.15.82:6801/1774933818","cluster_addr":"172.21.15.82:6803/1774933818","heartbeat_back_addr":"172.21.15.82:6807/1774933818","heartbeat_front_addr":"172.21.15.82:6805/1774933818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.400650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.190579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.097688+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.360689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.842046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.381685+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.859696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:27.905922+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:21:38.067 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:21:38.067 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:21:38.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:21:38.847 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'rbd' created 2024-09-12T17:21:38.861 DEBUG:teuthology.orchestra.run.smithi063:> rbd --cluster ceph pool init rbd 2024-09-12T17:21:38.920 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:38.921 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:41.873 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:21:41.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:21:41.875 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:21:42.206 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:42.219 INFO:teuthology.orchestra.run.smithi063.stdout:[{"version":9,"timestamp":"2024-09-12T17:21:32.031648+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"7620.229369"}]}] 2024-09-12T17:21:42.219 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:21:42.219 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:21:42.219 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:21:42.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:21:42.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:42.596 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2727355490},{"type":"v1","addr":"172.21.15.82:6833","nonce":2727355490}]},"active_addr":"172.21.15.82:6833/2727355490","active_change":"2024-09-12T17:21:24.214463+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":731435352}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1093711498}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":519344101}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1556640483}]}]} 2024-09-12T17:21:42.600 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:21:42.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:21:42.600 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:21:42.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:42.917 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"40c8ab5f-c624-4f6c-a988-0ddc1f0db948","created":"2024-09-12T17:21:19.931623+0000","modified":"2024-09-12T17:21:41.858481+0000","last_up_change":"2024-09-12T17:21:32.756341+0000","last_in_change":"2024-09-12T17:21:22.297484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:21:32.238457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:21:38.380085+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf700c49-6315-49f1-a9fc-b0ace076f8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6809","nonce":4011131089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6811","nonce":4011131089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6815","nonce":4011131089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6813","nonce":4011131089}]},"public_addr":"172.21.15.63:6809/4011131089","cluster_addr":"172.21.15.63:6811/4011131089","heartbeat_back_addr":"172.21.15.63:6815/4011131089","heartbeat_front_addr":"172.21.15.63:6813/4011131089","state":["exists","up"]},{"osd":1,"uuid":"67ee34cb-38d4-4fff-b754-9c1d5d652c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6801","nonce":101797795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6803","nonce":101797795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6807","nonce":101797795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6805","nonce":101797795}]},"public_addr":"172.21.15.63:6801/101797795","cluster_addr":"172.21.15.63:6803/101797795","heartbeat_back_addr":"172.21.15.63:6807/101797795","heartbeat_front_addr":"172.21.15.63:6805/101797795","state":["exists","up"]},{"osd":2,"uuid":"7b375013-f20c-4bf8-813a-2f71d7167197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6825","nonce":1777922010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6827","nonce":1777922010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6831","nonce":1777922010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6829","nonce":1777922010}]},"public_addr":"172.21.15.63:6825/1777922010","cluster_addr":"172.21.15.63:6827/1777922010","heartbeat_back_addr":"172.21.15.63:6831/1777922010","heartbeat_front_addr":"172.21.15.63:6829/1777922010","state":["exists","up"]},{"osd":3,"uuid":"180f047c-136f-46ea-bd8a-cf03aaa497d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6817","nonce":1632744678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6819","nonce":1632744678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6823","nonce":1632744678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6821","nonce":1632744678}]},"public_addr":"172.21.15.63:6817/1632744678","cluster_addr":"172.21.15.63:6819/1632744678","heartbeat_back_addr":"172.21.15.63:6823/1632744678","heartbeat_front_addr":"172.21.15.63:6821/1632744678","state":["exists","up"]},{"osd":4,"uuid":"edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6825","nonce":3370836524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6827","nonce":3370836524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6831","nonce":3370836524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6829","nonce":3370836524}]},"public_addr":"172.21.15.82:6825/3370836524","cluster_addr":"172.21.15.82:6827/3370836524","heartbeat_back_addr":"172.21.15.82:6831/3370836524","heartbeat_front_addr":"172.21.15.82:6829/3370836524","state":["exists","up"]},{"osd":5,"uuid":"08d6d21d-bda6-4f15-a8d1-961c7edef2f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6817","nonce":4151406223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6819","nonce":4151406223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6823","nonce":4151406223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6821","nonce":4151406223}]},"public_addr":"172.21.15.82:6817/4151406223","cluster_addr":"172.21.15.82:6819/4151406223","heartbeat_back_addr":"172.21.15.82:6823/4151406223","heartbeat_front_addr":"172.21.15.82:6821/4151406223","state":["exists","up"]},{"osd":6,"uuid":"195868a1-ad74-421f-a581-6f1589108a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6809","nonce":3312995022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6811","nonce":3312995022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6815","nonce":3312995022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6813","nonce":3312995022}]},"public_addr":"172.21.15.82:6809/3312995022","cluster_addr":"172.21.15.82:6811/3312995022","heartbeat_back_addr":"172.21.15.82:6815/3312995022","heartbeat_front_addr":"172.21.15.82:6813/3312995022","state":["exists","up"]},{"osd":7,"uuid":"489ffcc8-e25e-4999-aa3a-47b0234e22f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6801","nonce":1774933818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6803","nonce":1774933818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6807","nonce":1774933818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6805","nonce":1774933818}]},"public_addr":"172.21.15.82:6801/1774933818","cluster_addr":"172.21.15.82:6803/1774933818","heartbeat_back_addr":"172.21.15.82:6807/1774933818","heartbeat_front_addr":"172.21.15.82:6805/1774933818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.400650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.190579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.097688+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.360689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.842046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.381685+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.859696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:27.905922+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:21:42.929 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:21:42.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:21:43.243 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:43.243 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"40c8ab5f-c624-4f6c-a988-0ddc1f0db948","created":"2024-09-12T17:21:19.931623+0000","modified":"2024-09-12T17:21:41.858481+0000","last_up_change":"2024-09-12T17:21:32.756341+0000","last_in_change":"2024-09-12T17:21:22.297484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:21:32.238457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:21:38.380085+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf700c49-6315-49f1-a9fc-b0ace076f8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6809","nonce":4011131089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6811","nonce":4011131089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6815","nonce":4011131089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6813","nonce":4011131089}]},"public_addr":"172.21.15.63:6809/4011131089","cluster_addr":"172.21.15.63:6811/4011131089","heartbeat_back_addr":"172.21.15.63:6815/4011131089","heartbeat_front_addr":"172.21.15.63:6813/4011131089","state":["exists","up"]},{"osd":1,"uuid":"67ee34cb-38d4-4fff-b754-9c1d5d652c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6801","nonce":101797795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6803","nonce":101797795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6807","nonce":101797795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6805","nonce":101797795}]},"public_addr":"172.21.15.63:6801/101797795","cluster_addr":"172.21.15.63:6803/101797795","heartbeat_back_addr":"172.21.15.63:6807/101797795","heartbeat_front_addr":"172.21.15.63:6805/101797795","state":["exists","up"]},{"osd":2,"uuid":"7b375013-f20c-4bf8-813a-2f71d7167197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6825","nonce":1777922010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6827","nonce":1777922010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6831","nonce":1777922010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6829","nonce":1777922010}]},"public_addr":"172.21.15.63:6825/1777922010","cluster_addr":"172.21.15.63:6827/1777922010","heartbeat_back_addr":"172.21.15.63:6831/1777922010","heartbeat_front_addr":"172.21.15.63:6829/1777922010","state":["exists","up"]},{"osd":3,"uuid":"180f047c-136f-46ea-bd8a-cf03aaa497d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6817","nonce":1632744678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6819","nonce":1632744678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6823","nonce":1632744678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6821","nonce":1632744678}]},"public_addr":"172.21.15.63:6817/1632744678","cluster_addr":"172.21.15.63:6819/1632744678","heartbeat_back_addr":"172.21.15.63:6823/1632744678","heartbeat_front_addr":"172.21.15.63:6821/1632744678","state":["exists","up"]},{"osd":4,"uuid":"edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6825","nonce":3370836524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6827","nonce":3370836524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6831","nonce":3370836524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6829","nonce":3370836524}]},"public_addr":"172.21.15.82:6825/3370836524","cluster_addr":"172.21.15.82:6827/3370836524","heartbeat_back_addr":"172.21.15.82:6831/3370836524","heartbeat_front_addr":"172.21.15.82:6829/3370836524","state":["exists","up"]},{"osd":5,"uuid":"08d6d21d-bda6-4f15-a8d1-961c7edef2f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6817","nonce":4151406223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6819","nonce":4151406223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6823","nonce":4151406223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6821","nonce":4151406223}]},"public_addr":"172.21.15.82:6817/4151406223","cluster_addr":"172.21.15.82:6819/4151406223","heartbeat_back_addr":"172.21.15.82:6823/4151406223","heartbeat_front_addr":"172.21.15.82:6821/4151406223","state":["exists","up"]},{"osd":6,"uuid":"195868a1-ad74-421f-a581-6f1589108a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6809","nonce":3312995022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6811","nonce":3312995022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6815","nonce":3312995022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6813","nonce":3312995022}]},"public_addr":"172.21.15.82:6809/3312995022","cluster_addr":"172.21.15.82:6811/3312995022","heartbeat_back_addr":"172.21.15.82:6815/3312995022","heartbeat_front_addr":"172.21.15.82:6813/3312995022","state":["exists","up"]},{"osd":7,"uuid":"489ffcc8-e25e-4999-aa3a-47b0234e22f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6801","nonce":1774933818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6803","nonce":1774933818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6807","nonce":1774933818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6805","nonce":1774933818}]},"public_addr":"172.21.15.82:6801/1774933818","cluster_addr":"172.21.15.82:6803/1774933818","heartbeat_back_addr":"172.21.15.82:6807/1774933818","heartbeat_front_addr":"172.21.15.82:6805/1774933818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.400650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.190579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.097688+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.360689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.842046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.381685+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.859696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:27.905922+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:21:43.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:21:43.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:21:43.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:21:43.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:21:43.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:21:43.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:21:43.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:21:43.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:21:43.531 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:43.532 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:21:43.536 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:43.537 INFO:teuthology.orchestra.run.smithi063.stdout:68719476743 2024-09-12T17:21:43.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:21:43.538 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:43.538 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:21:43.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:21:43.539 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:43.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:21:43.540 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:43.541 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:21:43.541 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:43.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:21:43.543 INFO:teuthology.orchestra.run.smithi063.stdout:55834574854 2024-09-12T17:21:43.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:21:44.147 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:44.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-12T17:21:44.192 INFO:teuthology.orchestra.run.smithi063.stdout:55834574853 2024-09-12T17:21:44.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-09-12T17:21:44.225 INFO:teuthology.orchestra.run.smithi063.stdout:64424509445 2024-09-12T17:21:44.230 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:44.237 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:44.239 INFO:teuthology.orchestra.run.smithi063.stdout:64424509445 2024-09-12T17:21:44.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-09-12T17:21:44.247 INFO:teuthology.orchestra.run.smithi063.stdout:68719476741 2024-09-12T17:21:44.249 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:44.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-12T17:21:44.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-12T17:21:44.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-12T17:21:44.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-09-12T17:21:44.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476741 for osd.5 2024-09-12T17:21:45.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:21:45.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:21:45.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:21:45.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:21:45.254 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:21:45.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:21:45.265 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:21:45.265 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:21:45.727 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:45.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-12T17:21:45.748 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.825 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:45.838 INFO:teuthology.orchestra.run.smithi063.stdout:55834574854 2024-09-12T17:21:45.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-12T17:21:45.839 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-12T17:21:45.854 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.873 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:45.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-12T17:21:45.888 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.894 INFO:teuthology.orchestra.run.smithi063.stdout:64424509446 2024-09-12T17:21:45.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T17:21:45.907 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:68719476743 2024-09-12T17:21:45.912 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:45.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.5 2024-09-12T17:21:45.924 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.926 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-12T17:21:45.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-12T17:21:45.931 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-12T17:21:45.941 DEBUG:teuthology.parallel:result is None 2024-09-12T17:21:45.941 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:21:45.941 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:21:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:46.294 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T17:21:46.306 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T17:21:46.223841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223308,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751412,"statfs":{"total":773094113280,"available":772865445888,"internally_reserved":0,"allocated":2965504,"data_stored":1781062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.367621"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866850+0000","last_change":"2024-09-12T17:21:41.866850+0000","last_active":"2024-09-12T17:21:41.866850+0000","last_peered":"2024-09-12T17:21:41.866850+0000","last_clean":"2024-09-12T17:21:41.866850+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T17:21:41.866850+0000","last_undegraded":"2024-09-12T17:21:41.866850+0000","last_fullsized":"2024-09-12T17:21:41.866850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.746085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.865878+0000","last_change":"2024-09-12T17:21:41.865878+0000","last_active":"2024-09-12T17:21:41.865878+0000","last_peered":"2024-09-12T17:21:41.865878+0000","last_clean":"2024-09-12T17:21:41.865878+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T17:21:41.865878+0000","last_undegraded":"2024-09-12T17:21:41.865878+0000","last_fullsized":"2024-09-12T17:21:41.865878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.625705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866466+0000","last_change":"2024-09-12T17:21:41.866466+0000","last_active":"2024-09-12T17:21:41.866466+0000","last_peered":"2024-09-12T17:21:41.866466+0000","last_clean":"2024-09-12T17:21:41.866466+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T17:21:41.866466+0000","last_undegraded":"2024-09-12T17:21:41.866466+0000","last_fullsized":"2024-09-12T17:21:41.866466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:41.352304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:42.043334+0000","last_change":"2024-09-12T17:21:42.043334+0000","last_active":"2024-09-12T17:21:42.043334+0000","last_peered":"2024-09-12T17:21:42.043334+0000","last_clean":"2024-09-12T17:21:42.043334+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T17:21:42.043334+0000","last_undegraded":"2024-09-12T17:21:42.043334+0000","last_fullsized":"2024-09-12T17:21:42.043334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:38.050118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.868150+0000","last_change":"2024-09-12T17:21:41.867476+0000","last_active":"2024-09-12T17:21:41.868150+0000","last_peered":"2024-09-12T17:21:41.868150+0000","last_clean":"2024-09-12T17:21:41.868150+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T17:21:41.868150+0000","last_undegraded":"2024-09-12T17:21:41.868150+0000","last_fullsized":"2024-09-12T17:21:41.868150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:11.414546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:42.042805+0000","last_change":"2024-09-12T17:21:42.043085+0000","last_active":"2024-09-12T17:21:42.042805+0000","last_peered":"2024-09-12T17:21:42.042805+0000","last_clean":"2024-09-12T17:21:42.042805+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T17:21:42.042805+0000","last_undegraded":"2024-09-12T17:21:42.042805+0000","last_fullsized":"2024-09-12T17:21:42.042805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:25.499579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866473+0000","last_change":"2024-09-12T17:21:41.866473+0000","last_active":"2024-09-12T17:21:41.866473+0000","last_peered":"2024-09-12T17:21:41.866473+0000","last_clean":"2024-09-12T17:21:41.866473+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T17:21:41.866473+0000","last_undegraded":"2024-09-12T17:21:41.866473+0000","last_fullsized":"2024-09-12T17:21:41.866473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:12.213846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866930+0000","last_change":"2024-09-12T17:21:41.866930+0000","last_active":"2024-09-12T17:21:41.866930+0000","last_peered":"2024-09-12T17:21:41.866930+0000","last_clean":"2024-09-12T17:21:41.866930+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T17:21:41.866930+0000","last_undegraded":"2024-09-12T17:21:41.866930+0000","last_fullsized":"2024-09-12T17:21:41.866930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:40.562409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:42.042304+0000","last_change":"2024-09-12T17:21:34.165528+0000","last_active":"2024-09-12T17:21:42.042304+0000","last_peered":"2024-09-12T17:21:42.042304+0000","last_clean":"2024-09-12T17:21:42.042304+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T17:21:42.042304+0000","last_undegraded":"2024-09-12T17:21:42.042304+0000","last_fullsized":"2024-09-12T17:21:42.042304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_clean_scrub_stamp":"2024-09-12T17:21:32.756341+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:27.504316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":225280,"data_stored":75055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:21:46.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:21:46.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:46.619 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T17:21:46.631 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T17:21:46.223841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223308,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751412,"statfs":{"total":773094113280,"available":772865445888,"internally_reserved":0,"allocated":2965504,"data_stored":1781062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.367621"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866850+0000","last_change":"2024-09-12T17:21:41.866850+0000","last_active":"2024-09-12T17:21:41.866850+0000","last_peered":"2024-09-12T17:21:41.866850+0000","last_clean":"2024-09-12T17:21:41.866850+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T17:21:41.866850+0000","last_undegraded":"2024-09-12T17:21:41.866850+0000","last_fullsized":"2024-09-12T17:21:41.866850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.746085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.865878+0000","last_change":"2024-09-12T17:21:41.865878+0000","last_active":"2024-09-12T17:21:41.865878+0000","last_peered":"2024-09-12T17:21:41.865878+0000","last_clean":"2024-09-12T17:21:41.865878+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T17:21:41.865878+0000","last_undegraded":"2024-09-12T17:21:41.865878+0000","last_fullsized":"2024-09-12T17:21:41.865878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.625705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866466+0000","last_change":"2024-09-12T17:21:41.866466+0000","last_active":"2024-09-12T17:21:41.866466+0000","last_peered":"2024-09-12T17:21:41.866466+0000","last_clean":"2024-09-12T17:21:41.866466+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T17:21:41.866466+0000","last_undegraded":"2024-09-12T17:21:41.866466+0000","last_fullsized":"2024-09-12T17:21:41.866466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:41.352304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:42.043334+0000","last_change":"2024-09-12T17:21:42.043334+0000","last_active":"2024-09-12T17:21:42.043334+0000","last_peered":"2024-09-12T17:21:42.043334+0000","last_clean":"2024-09-12T17:21:42.043334+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T17:21:42.043334+0000","last_undegraded":"2024-09-12T17:21:42.043334+0000","last_fullsized":"2024-09-12T17:21:42.043334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:38.050118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.868150+0000","last_change":"2024-09-12T17:21:41.867476+0000","last_active":"2024-09-12T17:21:41.868150+0000","last_peered":"2024-09-12T17:21:41.868150+0000","last_clean":"2024-09-12T17:21:41.868150+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T17:21:41.868150+0000","last_undegraded":"2024-09-12T17:21:41.868150+0000","last_fullsized":"2024-09-12T17:21:41.868150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:11.414546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:42.042805+0000","last_change":"2024-09-12T17:21:42.043085+0000","last_active":"2024-09-12T17:21:42.042805+0000","last_peered":"2024-09-12T17:21:42.042805+0000","last_clean":"2024-09-12T17:21:42.042805+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T17:21:42.042805+0000","last_undegraded":"2024-09-12T17:21:42.042805+0000","last_fullsized":"2024-09-12T17:21:42.042805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:25.499579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866473+0000","last_change":"2024-09-12T17:21:41.866473+0000","last_active":"2024-09-12T17:21:41.866473+0000","last_peered":"2024-09-12T17:21:41.866473+0000","last_clean":"2024-09-12T17:21:41.866473+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T17:21:41.866473+0000","last_undegraded":"2024-09-12T17:21:41.866473+0000","last_fullsized":"2024-09-12T17:21:41.866473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:12.213846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:41.866930+0000","last_change":"2024-09-12T17:21:41.866930+0000","last_active":"2024-09-12T17:21:41.866930+0000","last_peered":"2024-09-12T17:21:41.866930+0000","last_clean":"2024-09-12T17:21:41.866930+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T17:21:41.866930+0000","last_undegraded":"2024-09-12T17:21:41.866930+0000","last_fullsized":"2024-09-12T17:21:41.866930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:40.562409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:21:42.042304+0000","last_change":"2024-09-12T17:21:34.165528+0000","last_active":"2024-09-12T17:21:42.042304+0000","last_peered":"2024-09-12T17:21:42.042304+0000","last_clean":"2024-09-12T17:21:42.042304+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T17:21:42.042304+0000","last_undegraded":"2024-09-12T17:21:42.042304+0000","last_fullsized":"2024-09-12T17:21:42.042304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_clean_scrub_stamp":"2024-09-12T17:21:32.756341+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:27.504316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":225280,"data_stored":75055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:21:46.632 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:21:46.632 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:21:46.632 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:21:46.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:21:46.984 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:21:46.985 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:21:46.997 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:21:47.000 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:21:47.017 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:21:47.031 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T17:21:47.031 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:21:47.032 INFO:tasks.rgw:Creating data pools 2024-09-12T17:21:47.032 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:21:47.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T17:21:47.901 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T17:21:49.742 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:21:49.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:21:50.756 INFO:teuthology.orchestra.run.smithi063.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:21:50.792 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:21:51.729 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:21:51.755 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:21:52.736 INFO:teuthology.orchestra.run.smithi063.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:21:52.766 DEBUG:tasks.rgw:Pools created 2024-09-12T17:21:52.766 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:21:52.766 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:21:52.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:21:52.766 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:21:52.872 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:52.872 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:54.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.790+0000 7f7a9301b640 0 -- 172.21.15.63:0/218632309 >> [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] conn(0x7f7968076380 msgr2=0x7f7968078840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:54.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.794+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.796+0000 7f7a9301b640 0 -- 172.21.15.63:0/1101742752 >> [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] conn(0x7f7958076470 msgr2=0x7f7958078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.796+0000 7f7a96b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.796+0000 7f7a96b2f800 20 realm 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.796+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.796+0000 7f7a96b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.796+0000 7f7a96b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.796+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.797+0000 7f7a96b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.797+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.798+0000 7f7a96b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:54.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.798+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.798+0000 7f7a96b2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:21:54.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.798+0000 7f7a96b2f800 20 searching for the correct realm 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.809+0000 7f7a96b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.809+0000 7f7a96b2f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.809+0000 7f7a96b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.809+0000 7f7a96b2f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.809+0000 7f7a96b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.809+0000 7f7a96b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.809+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.810+0000 7f7a96b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.810+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.810+0000 7f7a96b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.810+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.810+0000 7f7a96b2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 20 zone default found 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 4 Realm: () 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 20 zonegroup default 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:54.811+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:56.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:56.764+0000 7f7a96b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:56.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:56.765+0000 7f7a96b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:21:56.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:56.766+0000 7f7a96b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:56.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:56.767+0000 7f7a96b2f800 20 started sync module instance, tier type = 2024-09-12T17:21:56.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:56.768+0000 7f7a96b2f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:21:58.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.812+0000 7f7a96b2f800 20 add_watcher() i=0 2024-09-12T17:21:58.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.812+0000 7f7a96b2f800 20 add_watcher() i=1 2024-09-12T17:21:58.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.812+0000 7f7a96b2f800 20 add_watcher() i=2 2024-09-12T17:21:58.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.812+0000 7f7a96b2f800 20 add_watcher() i=3 2024-09-12T17:21:58.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.812+0000 7f7a96b2f800 20 add_watcher() i=4 2024-09-12T17:21:58.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.812+0000 7f7a96b2f800 20 add_watcher() i=5 2024-09-12T17:21:58.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.812+0000 7f7a96b2f800 20 add_watcher() i=6 2024-09-12T17:21:58.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.815+0000 7f7a96b2f800 20 add_watcher() i=7 2024-09-12T17:21:58.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.815+0000 7f7a96b2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:58.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:21:58.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:21:58.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:21:58.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:21:58.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:21:58.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:21:58.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.816+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:21:58.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:21:58.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:21:58.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:21:58.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.817+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:21:58.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.818+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:21:58.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.819+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:21:58.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.820+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:21:58.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:21:58.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.821+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:21:58.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.822+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.823+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.824+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.824+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.824+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.824+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.824+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.824+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:21:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.825+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.826+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.827+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.827+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.827+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.827+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.827+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.827+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:21:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.828+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:21:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.829+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:21:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.830+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:21:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.831+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:21:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.832+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:21:58.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:21:58.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:21:58.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:21:58.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:21:58.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:21:58.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.833+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.834+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.835+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.836+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.837+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:21:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.838+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:21:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.839+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:21:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.840+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.841+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:21:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.842+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.843+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.844+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:21:58.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.845+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.846+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:21:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:21:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:21:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:21:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:21:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:21:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.847+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:21:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.848+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.849+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.850+0000 7f7a96b2f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:21:58.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.850+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:21:58.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.851+0000 7f7a96b2f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:21:58.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.857+0000 7f79457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:58.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.857+0000 7f7a96b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:58.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:21:58.857+0000 7f7a96b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.786+0000 7f7a96b2f800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:22:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.786+0000 7f7a96b2f800 5 note: GC not initialized 2024-09-12T17:22:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.787+0000 7f78affff640 20 reqs_thread_entry: start 2024-09-12T17:22:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.787+0000 7f7a96b2f800 20 init_complete bucket index max shards: 11 2024-09-12T17:22:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.787+0000 7f7a96b2f800 20 Filter name: none 2024-09-12T17:22:01.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.787+0000 7f78adffb640 20 reqs_thread_entry: start 2024-09-12T17:22:01.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.816+0000 7f79457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:01.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.819+0000 7f7a96b2f800 20 remove_watcher() i=0 2024-09-12T17:22:01.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.819+0000 7f7a96b2f800 2 removed watcher, disabling cache 2024-09-12T17:22:01.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.820+0000 7f7a96b2f800 20 remove_watcher() i=1 2024-09-12T17:22:01.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.821+0000 7f7a96b2f800 20 remove_watcher() i=2 2024-09-12T17:22:01.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.822+0000 7f7a96b2f800 20 remove_watcher() i=3 2024-09-12T17:22:01.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.824+0000 7f7a96b2f800 20 remove_watcher() i=4 2024-09-12T17:22:01.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.825+0000 7f7a96b2f800 20 remove_watcher() i=5 2024-09-12T17:22:01.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.826+0000 7f7a96b2f800 20 remove_watcher() i=6 2024-09-12T17:22:01.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.828+0000 7f7a96b2f800 20 remove_watcher() i=7 2024-09-12T17:22:01.852 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-12T17:22:01.853 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:22:01.853 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:22:01.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:22:01.853 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:22:01.921 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:01.921 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:01.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.947+0000 7f616bc20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:01.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.947+0000 7f616bc20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:01.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:01.951+0000 7f6027fff640 20 reqs_thread_entry: start 2024-09-12T17:22:01.971 INFO:teuthology.orchestra.run.smithi063.stdout:{"id":"44b5948e-036f-4ba3-a922-c18ae061c84d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:22:01.971 DEBUG:tasks.util.rgw: json result: {'id': '44b5948e-036f-4ba3-a922-c18ae061c84d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:22:01.971 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:22:01.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:22:01.972 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:22:02.029 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:02.029 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:02.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.063+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 20 realm 2024-09-12T17:22:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:02.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.065+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.066+0000 7fc0c1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:02.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.066+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.066+0000 7fc0c1519800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:22:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.066+0000 7fc0c1519800 20 searching for the correct realm 2024-09-12T17:22:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.069+0000 7fc0bf003640 0 -- 172.21.15.63:0/1839640551 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fc0b0084060 msgr2=0x7fc0b00aab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:02.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.073+0000 7fc0bf003640 0 -- 172.21.15.63:0/1839640551 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fc0b8036040 msgr2=0x7fc0b8025450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:02.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:02.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:22:02.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.281+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 zone default found 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 4 Realm: () 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 zonegroup default 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.282+0000 7fc0c1519800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.283+0000 7fc0c1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.283+0000 7fc0c1519800 20 started sync module instance, tier type = 2024-09-12T17:22:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.283+0000 7fc0c1519800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:22:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.293+0000 7fc0c1519800 20 add_watcher() i=0 2024-09-12T17:22:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.293+0000 7fc0c1519800 20 add_watcher() i=1 2024-09-12T17:22:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.293+0000 7fc0c1519800 20 add_watcher() i=2 2024-09-12T17:22:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.293+0000 7fc0c1519800 20 add_watcher() i=3 2024-09-12T17:22:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.293+0000 7fc0c1519800 20 add_watcher() i=4 2024-09-12T17:22:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.293+0000 7fc0c1519800 20 add_watcher() i=5 2024-09-12T17:22:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.293+0000 7fc0c1519800 20 add_watcher() i=6 2024-09-12T17:22:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.294+0000 7fc0c1519800 20 add_watcher() i=7 2024-09-12T17:22:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.294+0000 7fc0c1519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fbf757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fc0c1519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fc0c1519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fc0c1519800 5 note: GC not initialized 2024-09-12T17:22:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fbeeffff640 20 reqs_thread_entry: start 2024-09-12T17:22:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fc0c1519800 20 init_complete bucket index max shards: 11 2024-09-12T17:22:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fc0c1519800 20 Filter name: none 2024-09-12T17:22:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.297+0000 7fbeedffb640 20 reqs_thread_entry: start 2024-09-12T17:22:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.307+0000 7fbf757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.309+0000 7fc0c1519800 20 remove_watcher() i=0 2024-09-12T17:22:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.309+0000 7fc0c1519800 2 removed watcher, disabling cache 2024-09-12T17:22:02.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.310+0000 7fc0c1519800 20 remove_watcher() i=1 2024-09-12T17:22:02.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.311+0000 7fc0c1519800 20 remove_watcher() i=2 2024-09-12T17:22:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.312+0000 7fc0c1519800 20 remove_watcher() i=3 2024-09-12T17:22:02.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.313+0000 7fc0c1519800 20 remove_watcher() i=4 2024-09-12T17:22:02.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.315+0000 7fc0c1519800 20 remove_watcher() i=5 2024-09-12T17:22:02.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.316+0000 7fc0c1519800 20 remove_watcher() i=6 2024-09-12T17:22:02.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.317+0000 7fc0c1519800 20 remove_watcher() i=7 2024-09-12T17:22:02.330 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-12T17:22:02.330 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:22:02.330 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:22:02.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:22:02.331 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:22:02.395 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:02.395 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.419+0000 7f949712c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.419+0000 7f949712c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:02.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.423+0000 7f93557e2640 20 reqs_thread_entry: start 2024-09-12T17:22:02.441 INFO:teuthology.orchestra.run.smithi063.stdout:{"id":"44b5948e-036f-4ba3-a922-c18ae061c84d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:22:02.442 DEBUG:tasks.util.rgw: json result: {'id': '44b5948e-036f-4ba3-a922-c18ae061c84d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:22:02.442 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T17:22:02.442 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p /tmp/rgw_datacache 2024-09-12T17:22:02.472 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T17:22:02.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:22:02.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:22:02.552 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:22:02.648 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:02.648 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:02.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.681+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 20 realm 2024-09-12T17:22:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.683+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.684+0000 7f3c4fd28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.684+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.684+0000 7f3c4fd28800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:22:02.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.684+0000 7f3c4fd28800 20 searching for the correct realm 2024-09-12T17:22:02.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.688+0000 7f3c4b26e640 0 -- 172.21.15.63:0/1270500330 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f3c4006d930 msgr2=0x7f3c40084410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.894+0000 7f3c4b26e640 0 -- 172.21.15.63:0/1270500330 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5603b7c9d0c0 msgr2=0x5603b7c9f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:02.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:02.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:02.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.899+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 20 zone default found 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 4 Realm: () 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 20 zonegroup default 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.900+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.901+0000 7f3c4fd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.901+0000 7f3c4fd28800 20 rados->read ofs=0 len=0 2024-09-12T17:22:02.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.901+0000 7f3c4fd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:02.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.901+0000 7f3c4fd28800 20 started sync module instance, tier type = 2024-09-12T17:22:02.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.901+0000 7f3c4fd28800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:22:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.920+0000 7f3c4fd28800 20 add_watcher() i=0 2024-09-12T17:22:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.920+0000 7f3c4fd28800 20 add_watcher() i=1 2024-09-12T17:22:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.920+0000 7f3c4fd28800 20 add_watcher() i=2 2024-09-12T17:22:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.920+0000 7f3c4fd28800 20 add_watcher() i=3 2024-09-12T17:22:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.920+0000 7f3c4fd28800 20 add_watcher() i=4 2024-09-12T17:22:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.920+0000 7f3c4fd28800 20 add_watcher() i=5 2024-09-12T17:22:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.920+0000 7f3c4fd28800 20 add_watcher() i=6 2024-09-12T17:22:02.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.921+0000 7f3c4fd28800 20 add_watcher() i=7 2024-09-12T17:22:02.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.921+0000 7f3c4fd28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:02.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3b01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:02.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3c4fd28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:02.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3c4fd28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:02.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3c4fd28800 5 note: GC not initialized 2024-09-12T17:22:02.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3b00fe1640 20 reqs_thread_entry: start 2024-09-12T17:22:02.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3c4fd28800 20 init_complete bucket index max shards: 11 2024-09-12T17:22:02.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3c4fd28800 20 Filter name: none 2024-09-12T17:22:02.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.923+0000 7f3a7a7fc640 20 reqs_thread_entry: start 2024-09-12T17:22:02.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.933+0000 7f3b01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.935+0000 7f3c4fd28800 20 remove_watcher() i=0 2024-09-12T17:22:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.935+0000 7f3c4fd28800 2 removed watcher, disabling cache 2024-09-12T17:22:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.936+0000 7f3c4fd28800 20 remove_watcher() i=1 2024-09-12T17:22:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.938+0000 7f3c4fd28800 20 remove_watcher() i=2 2024-09-12T17:22:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.939+0000 7f3c4fd28800 20 remove_watcher() i=3 2024-09-12T17:22:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.940+0000 7f3c4fd28800 20 remove_watcher() i=4 2024-09-12T17:22:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.941+0000 7f3c4fd28800 20 remove_watcher() i=5 2024-09-12T17:22:02.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.946+0000 7f3c4fd28800 20 remove_watcher() i=6 2024-09-12T17:22:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:02.948+0000 7f3c4fd28800 20 remove_watcher() i=7 2024-09-12T17:22:02.960 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-12T17:22:02.961 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:22:02.961 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:22:02.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:22:02.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:22:02.961 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:22:03.025 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:03.025 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.050+0000 7fa927613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.050+0000 7fa927613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.053+0000 7fa7e57e2640 20 reqs_thread_entry: start 2024-09-12T17:22:03.070 INFO:teuthology.orchestra.run.smithi063.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:22:03.070 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:22:03.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:22:03.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:22:03.071 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:22:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:03.138 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.163+0000 7ff9a5a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.163+0000 7ff9a5a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.167+0000 7ff819ffb640 20 reqs_thread_entry: start 2024-09-12T17:22:03.186 INFO:teuthology.orchestra.run.smithi063.stdout:{"id":"44b5948e-036f-4ba3-a922-c18ae061c84d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:22:03.186 DEBUG:tasks.util.rgw: json result: {'id': '44b5948e-036f-4ba3-a922-c18ae061c84d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:22:03.186 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:22:03.186 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:22:03.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:22:03.187 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:22:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:03.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.275+0000 7f558b92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:03.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.275+0000 7f558b92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:03.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.279+0000 7f54467fc640 20 reqs_thread_entry: start 2024-09-12T17:22:03.299 INFO:teuthology.orchestra.run.smithi063.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:22:03.299 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:22:03.300 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:22:03.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:22:03.300 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:22:03.366 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:03.366 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.391+0000 7f50ff32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.391+0000 7f50ff32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:03.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:22:03.395+0000 7f4f81ffb640 20 reqs_thread_entry: start 2024-09-12T17:22:03.413 INFO:teuthology.orchestra.run.smithi063.stdout:{"id":"44b5948e-036f-4ba3-a922-c18ae061c84d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:22:03.413 DEBUG:tasks.util.rgw: json result: {'id': '44b5948e-036f-4ba3-a922-c18ae061c84d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:22:03.413 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:22:03.413 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T17:22:03.413 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:22:03.414 DEBUG:teuthology.orchestra.run.smithi063:> sudo echo -n http://smithi063.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:22:03.454 INFO:teuthology.orchestra.run.smithi063.stdout:http://smithi063.front.sepia.ceph.com:80 2024-09-12T17:22:03.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:22:03.533 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:22:03.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:22:03.575 INFO:tasks.rgw.client.0:Started 2024-09-12T17:22:03.576 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi063.front.sepia.ceph.com:80/ 2024-09-12T17:22:03.576 DEBUG:teuthology.orchestra.run.smithi063:> curl http://smithi063.front.sepia.ceph.com:80/ 2024-09-12T17:22:03.619 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:22:03.619 INFO:teuthology.orchestra.run.smithi063.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:22:03.620 INFO:teuthology.orchestra.run.smithi063.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:22:03.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:22:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:curl: (7) Failed to connect to smithi063.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:22:04.621 DEBUG:teuthology.orchestra.run.smithi063:> curl http://smithi063.front.sepia.ceph.com:80/ 2024-09-12T17:22:04.654 INFO:teuthology.orchestra.run.smithi063.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:22:04.654 INFO:teuthology.orchestra.run.smithi063.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:22:04.656 INFO:teuthology.orchestra.run.smithi063.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-09-12T17:22:04.657 INFO:teuthology.orchestra.run.smithi063.stdout:anonymous 2024-09-12T17:22:04.657 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:22:04.668 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:22:04.668 DEBUG:teuthology.orchestra.run.smithi063:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:22:07.057 DEBUG:teuthology.orchestra.run.smithi063:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:22:07.601 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting tox==3.15.0 2024-09-12T17:22:07.667 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:22:07.864 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:22:07.878 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:22:08.156 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:22:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:22:08.411 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:22:08.425 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:22:08.535 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:22:08.549 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:22:08.654 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting packaging>=14 2024-09-12T17:22:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:22:08.765 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:22:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:22:08.861 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting toml>=0.9.4 2024-09-12T17:22:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:22:08.999 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:22:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:22:09.129 INFO:teuthology.orchestra.run.smithi063.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:22:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:22:09.264 INFO:teuthology.orchestra.run.smithi063.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T17:22:10.089 INFO:teuthology.orchestra.run.smithi063.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:22:10.295 INFO:teuthology.orchestra.run.smithi063.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T17:22:10.296 INFO:teuthology.orchestra.run.smithi063.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T17:22:10.358 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:22:10.371 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:22:10.372 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:22:10.372 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:22:10.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:22:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:22:10.402 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:22:10.472 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:22:10.472 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:22:10.541 INFO:tasks.workunit:timeout=3h 2024-09-12T17:22:10.541 INFO:tasks.workunit:cleanup=True 2024-09-12T17:22:10.541 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:22:10.611 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:23:10.126 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 92% (11770/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:23:10.528 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:23:10.529 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:23:10.533 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:23:10.609 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:23:10.611 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:23:10.611 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:23:11.212 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:23:11.276 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:23:11.316 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:23:11.318 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:23:11.318 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:23:11.357 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:23:11.361 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:23:11.361 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:23:11.431 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T17:23:11.432 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T17:23:11.433 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:23:11.505 INFO:tasks.workunit.client.0.smithi063.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:23:11.505 INFO:tasks.workunit.client.0.smithi063.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:23:11.506 INFO:tasks.workunit.client.0.smithi063.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:23:13.861 INFO:tasks.workunit.client.0.smithi063.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ deactivate nondestructive 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ export VIRTUAL_ENV 2024-09-12T17:23:13.862 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:23:13.863 INFO:tasks.workunit.client.0.smithi063.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:23:13.863 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PATH 2024-09-12T17:23:13.863 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:23:13.864 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -z '' ']' 2024-09-12T17:23:13.864 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:23:13.864 INFO:tasks.workunit.client.0.smithi063.stderr:++ PS1='(rgw) ' 2024-09-12T17:23:13.864 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PS1 2024-09-12T17:23:13.864 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:23:13.864 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T17:23:13.864 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install pip --upgrade 2024-09-12T17:23:14.101 INFO:tasks.workunit.client.0.smithi063.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:23:14.283 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting pip 2024-09-12T17:23:14.347 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:23:14.512 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: pip 2024-09-12T17:23:14.512 INFO:tasks.workunit.client.0.smithi063.stdout: Attempting uninstall: pip 2024-09-12T17:23:14.512 INFO:tasks.workunit.client.0.smithi063.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:23:14.675 INFO:tasks.workunit.client.0.smithi063.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:23:14.681 INFO:tasks.workunit.client.0.smithi063.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:23:15.439 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed pip-24.2 2024-09-12T17:23:15.676 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install configobj 2024-09-12T17:23:16.052 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting configobj 2024-09-12T17:23:16.096 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T17:23:16.217 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting six (from configobj) 2024-09-12T17:23:16.232 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:23:16.302 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T17:23:16.392 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:23:16.457 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: six, configobj 2024-09-12T17:23:16.582 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T17:23:16.632 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T17:23:16.665 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T17:23:16.665 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T17:23:16.667 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:16.667 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T17:23:16.667 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:23:16.667 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T17:23:16.718 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:16.718 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 45891/radosgw \ntcp6 0 0 :::80 :::* LISTEN 45891/radosgw \n' 2024-09-12T17:23:16.718 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:radosgw port: 80 2024-09-12T17:23:16.718 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T17:23:16.718 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T17:23:16.740 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:16.740 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b'' 2024-09-12T17:23:16.740 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T17:23:17.085 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:17.085 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T17:23:17.055482Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T17:23:17.055470Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T17:23:17.085 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:Creating s3cmd config... 2024-09-12T17:23:17.085 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:proto for s3cmd config is http 2024-09-12T17:23:17.085 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:s3cmd config written 2024-09-12T17:23:17.085 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T17:23:17.233 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:17.233 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T17:23:17.233 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T17:23:17.462 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:17.462 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 79.46 MB/s) [1 of 1]\n" 2024-09-12T17:23:17.462 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T17:23:17.623 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:17.623 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 202.70 MB/s)\n" 2024-09-12T17:23:17.623 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T17:23:17.961 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:17.961 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "e5891ecbf2ac0def1d71aa542b18dc02",\n "tag": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13414085985310493687",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".6lhsXGsAxhW4CZpNBRa7GwNbTNAh-Et_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4190208,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1",\n "bucket_id": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1",\n "bucket_id": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".6lhsXGsAxhW4CZpNBRa7GwNbTNAh-Et_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4190208,\n "ofs": 7340376,\n "stripe_size": 3150168,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1",\n "bucket_id": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".6lhsXGsAxhW4CZpNBRa7GwNbTNAh-Et_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T17:23:17.436634Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13414085985310493687",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726161796/ctime:1726161796/gid:1333/gname:ubuntu/md5:e5891ecbf2ac0def1d71aa542b18dc02/mode:33188/mtime:1726161796/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T17:23:17.962 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:Cached object name is: .6lhsXGsAxhW4CZpNBRa7GwNbTNAh-Et_ 2024-09-12T17:23:17.962 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T17:23:17.970 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:command succeeded 2024-09-12T17:23:17.970 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:b'0\n' 2024-09-12T17:23:17.970 INFO:tasks.workunit.client.0.smithi063.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T17:23:17.970 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T17:23:17.971 INFO:tasks.workunit.client.0.smithi063.stderr:INFO:root:Completed Datacache tests 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ deactivate 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ export PATH 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:23:17.978 INFO:tasks.workunit.client.0.smithi063.stderr:+ hash -r 2024-09-12T17:23:17.979 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T17:23:17.979 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:23:17.979 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:23:17.979 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset -f deactivate 2024-09-12T17:23:17.979 INFO:tasks.workunit.client.0.smithi063.stderr:+ echo OK. 2024-09-12T17:23:17.980 INFO:tasks.workunit.client.0.smithi063.stdout:OK. 2024-09-12T17:23:17.980 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:23:17.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:23:18.063 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T17:23:18.063 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:23:18.395 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:18.396 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:23:18.439 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:23:18.439 DEBUG:teuthology.orchestra.run.smithi063:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:23:18.514 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:23:18.515 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:23:18.529 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:23:18.529 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:23:18.529 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:23:18.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:23:18.584 INFO:teuthology.orchestra.run.smithi063.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:23:18.585 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:23:18.654 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:23:18.654 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:23:18.724 INFO:tasks.workunit:timeout=3h 2024-09-12T17:23:18.724 INFO:tasks.workunit:cleanup=True 2024-09-12T17:23:18.724 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:23:18.797 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:24:18.643 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 92% (11770/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:24:19.450 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:19.451 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-12T17:24:19.452 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:19.452 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:24:19.452 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:19.452 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:24:19.456 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:24:19.526 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:24:19.529 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:24:19.529 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:24:19.579 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:24:19.630 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:24:19.671 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:24:19.672 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:24:19.673 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:24:19.712 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:24:19.715 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:24:19.715 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:24:19.787 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:24:19.788 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:24:19.788 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:24:19.861 INFO:tasks.workunit.client.0.smithi063.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:24:19.862 INFO:tasks.workunit.client.0.smithi063.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:24:19.862 INFO:tasks.workunit.client.0.smithi063.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:24:22.222 INFO:tasks.workunit.client.0.smithi063.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ deactivate nondestructive 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ export VIRTUAL_ENV 2024-09-12T17:24:22.223 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:24:22.224 INFO:tasks.workunit.client.0.smithi063.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PATH 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -z '' ']' 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ PS1='(rgw) ' 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PS1 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T17:24:22.225 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install pip --upgrade 2024-09-12T17:24:22.463 INFO:tasks.workunit.client.0.smithi063.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:24:22.646 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting pip 2024-09-12T17:24:22.651 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:24:22.698 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: pip 2024-09-12T17:24:22.698 INFO:tasks.workunit.client.0.smithi063.stdout: Attempting uninstall: pip 2024-09-12T17:24:22.698 INFO:tasks.workunit.client.0.smithi063.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:24:22.872 INFO:tasks.workunit.client.0.smithi063.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:24:22.878 INFO:tasks.workunit.client.0.smithi063.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:24:23.649 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed pip-24.2 2024-09-12T17:24:23.698 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install boto3 2024-09-12T17:24:24.572 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting boto3 2024-09-12T17:24:24.616 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:24:25.301 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:24:25.315 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:24:25.411 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:24:25.425 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:24:25.532 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:24:25.546 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:24:25.677 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:24:25.691 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:24:25.848 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:24:25.862 INFO:tasks.workunit.client.0.smithi063.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:24:26.175 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:24:26.176 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:24:26.194 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:24:26.274 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:24:26.489 INFO:tasks.workunit.client.0.smithi063.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 61.4 MB/s eta 0:00:00 2024-09-12T17:24:26.503 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:24:26.567 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:24:26.651 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:24:26.710 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:24:26.764 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:24:26.842 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:24:27.890 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:24:28.010 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:24:28.149 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:24:28.184 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:28.185 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:28.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.223+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 20 realm 2024-09-12T17:24:28.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:28.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.225+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.226+0000 7fb75313a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.226+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.226+0000 7fb75313a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:28.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.226+0000 7fb75313a800 20 searching for the correct realm 2024-09-12T17:24:28.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.230+0000 7fb74e680640 0 -- 172.21.15.63:0/3017716315 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb74406d070 msgr2=0x7fb744086450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:28.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.436+0000 7fb74e680640 0 -- 172.21.15.63:0/3017716315 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559657e3e860 msgr2=0x559657e40c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:28.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:28.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:28.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:28.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:28.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:28.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:28.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.441+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 zone default found 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 4 Realm: () 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 zonegroup default 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.442+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.443+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.443+0000 7fb75313a800 20 started sync module instance, tier type = 2024-09-12T17:24:28.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.443+0000 7fb75313a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:28.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.460+0000 7fb75313a800 20 add_watcher() i=0 2024-09-12T17:24:28.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.460+0000 7fb75313a800 20 add_watcher() i=1 2024-09-12T17:24:28.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.460+0000 7fb75313a800 20 add_watcher() i=2 2024-09-12T17:24:28.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.460+0000 7fb75313a800 20 add_watcher() i=3 2024-09-12T17:24:28.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.460+0000 7fb75313a800 20 add_watcher() i=4 2024-09-12T17:24:28.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.460+0000 7fb75313a800 20 add_watcher() i=5 2024-09-12T17:24:28.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.460+0000 7fb75313a800 20 add_watcher() i=6 2024-09-12T17:24:28.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.463+0000 7fb75313a800 20 add_watcher() i=7 2024-09-12T17:24:28.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.463+0000 7fb75313a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:28.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb6057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb75313a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb75313a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb75313a800 5 note: GC not initialized 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb57ffff640 20 reqs_thread_entry: start 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb75313a800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb75313a800 20 Filter name: none 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.465+0000 7fb57dffb640 20 reqs_thread_entry: start 2024-09-12T17:24:28.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:24:28.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.466+0000 7fb75313a800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:24:28.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.467+0000 7fb75313a800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:24:28.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.467+0000 7fb75313a800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:24:28.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.467+0000 7fb75313a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:24:28.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.468+0000 7fb6327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724546 cookie 94104208017200 notifier 4740 bl.length()=593 2024-09-12T17:24:28.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.468+0000 7fb6327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:24:28.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.468+0000 7fb6327fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.469+0000 7fb75313a800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.469+0000 7fb75313a800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.469+0000 7fb75313a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.470+0000 7fb631ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94104208013936 notifier 4740 bl.length()=186 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.470+0000 7fb631ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.470+0000 7fb631ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:24:28.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.471+0000 7fb6057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:28.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.473+0000 7fb75313a800 20 remove_watcher() i=0 2024-09-12T17:24:28.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.473+0000 7fb75313a800 2 removed watcher, disabling cache 2024-09-12T17:24:28.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.474+0000 7fb75313a800 20 remove_watcher() i=1 2024-09-12T17:24:28.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.475+0000 7fb75313a800 20 remove_watcher() i=2 2024-09-12T17:24:28.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.476+0000 7fb75313a800 20 remove_watcher() i=3 2024-09-12T17:24:28.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.478+0000 7fb75313a800 20 remove_watcher() i=4 2024-09-12T17:24:28.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.481+0000 7fb75313a800 20 remove_watcher() i=5 2024-09-12T17:24:28.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.483+0000 7fb75313a800 20 remove_watcher() i=6 2024-09-12T17:24:28.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.485+0000 7fb75313a800 20 remove_watcher() i=7 2024-09-12T17:24:28.845 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:24:28.845 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:28.846 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:24:28.877 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:28.877 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:28.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.915+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.916+0000 7fad1452a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.916+0000 7fad1452a800 20 realm 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.916+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.917+0000 7fad1452a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.917+0000 7fad1452a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.917+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.917+0000 7fad1452a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.917+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.917+0000 7fad1452a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.917+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.918+0000 7fad1452a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:28.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.918+0000 7fad1452a800 20 searching for the correct realm 2024-09-12T17:24:28.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:28.921+0000 7fad07ad9640 0 -- 172.21.15.63:0/1003649106 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7facf8026980 msgr2=0x7facf8071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:29.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.126+0000 7fad10adb640 0 -- 172.21.15.63:0/1003649106 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x562fd83ae0a0 msgr2=0x562fd83b04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:29.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:29.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:29.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:29.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:29.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:29.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:29.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.130+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 zone default found 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 4 Realm: () 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 zonegroup default 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.131+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.132+0000 7fad1452a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.132+0000 7fad1452a800 20 started sync module instance, tier type = 2024-09-12T17:24:29.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.132+0000 7fad1452a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:29.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.148+0000 7fad1452a800 20 add_watcher() i=0 2024-09-12T17:24:29.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.148+0000 7fad1452a800 20 add_watcher() i=1 2024-09-12T17:24:29.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.148+0000 7fad1452a800 20 add_watcher() i=2 2024-09-12T17:24:29.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.148+0000 7fad1452a800 20 add_watcher() i=3 2024-09-12T17:24:29.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.148+0000 7fad1452a800 20 add_watcher() i=4 2024-09-12T17:24:29.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.148+0000 7fad1452a800 20 add_watcher() i=5 2024-09-12T17:24:29.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.148+0000 7fad1452a800 20 add_watcher() i=6 2024-09-12T17:24:29.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.149+0000 7fad1452a800 20 add_watcher() i=7 2024-09-12T17:24:29.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.149+0000 7fad1452a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:29.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.151+0000 7fabc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:29.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.151+0000 7fad1452a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.151+0000 7fad1452a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.151+0000 7fad1452a800 5 note: GC not initialized 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.151+0000 7fabc5fdb640 20 reqs_thread_entry: start 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.151+0000 7fad1452a800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.151+0000 7fad1452a800 20 Filter name: none 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fab377fe640 20 reqs_thread_entry: start 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fad1452a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:29.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fad1452a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:29.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fad1452a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:29.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fad1452a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:29.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fad1452a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:29.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.152+0000 7fad1452a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.153+0000 7fad1452a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:29.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.153+0000 7fad1452a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:29.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.153+0000 7fad1452a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:29.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.153+0000 7fad1452a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:29.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.153+0000 7fad1452a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:29.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.153+0000 7fad1452a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:29.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.153+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:29.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.154+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:29.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.154+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:29.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.155+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:29.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.155+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:29.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.156+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:29.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.157+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:29.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.157+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:29.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.158+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:29.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.159+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:29.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.159+0000 7fad1452a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:29.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.168+0000 7fabc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:29.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.171+0000 7fad1452a800 20 remove_watcher() i=0 2024-09-12T17:24:29.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.171+0000 7fad1452a800 2 removed watcher, disabling cache 2024-09-12T17:24:29.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.172+0000 7fad1452a800 20 remove_watcher() i=1 2024-09-12T17:24:29.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.173+0000 7fad1452a800 20 remove_watcher() i=2 2024-09-12T17:24:29.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.174+0000 7fad1452a800 20 remove_watcher() i=3 2024-09-12T17:24:29.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.175+0000 7fad1452a800 20 remove_watcher() i=4 2024-09-12T17:24:29.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.176+0000 7fad1452a800 20 remove_watcher() i=5 2024-09-12T17:24:29.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.177+0000 7fad1452a800 20 remove_watcher() i=6 2024-09-12T17:24:29.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.178+0000 7fad1452a800 20 remove_watcher() i=7 2024-09-12T17:24:29.192 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:24:29.221 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:29.221 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:29.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.258+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 20 realm 2024-09-12T17:24:29.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:29.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.260+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.261+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:29.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.261+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.261+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:29.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.261+0000 7f4be3c0e800 20 searching for the correct realm 2024-09-12T17:24:29.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.265+0000 7f4bdeb6a640 0 -- 172.21.15.63:0/789921241 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f4bd4056950 msgr2=0x7f4bd403a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:29.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.471+0000 7f4bdfb6c640 0 -- 172.21.15.63:0/789921241 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55db0dcd5090 msgr2=0x55db0dcd7480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:29.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:29.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:29.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:29.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:29.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:29.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:29.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:29.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.475+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 zone default found 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 4 Realm: () 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 zonegroup default 2024-09-12T17:24:29.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 started sync module instance, tier type = 2024-09-12T17:24:29.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.476+0000 7f4be3c0e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:29.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.489+0000 7f4be3c0e800 20 add_watcher() i=0 2024-09-12T17:24:29.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.489+0000 7f4be3c0e800 20 add_watcher() i=1 2024-09-12T17:24:29.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.489+0000 7f4be3c0e800 20 add_watcher() i=2 2024-09-12T17:24:29.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.489+0000 7f4be3c0e800 20 add_watcher() i=3 2024-09-12T17:24:29.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.489+0000 7f4be3c0e800 20 add_watcher() i=4 2024-09-12T17:24:29.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.489+0000 7f4be3c0e800 20 add_watcher() i=5 2024-09-12T17:24:29.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.489+0000 7f4be3c0e800 20 add_watcher() i=6 2024-09-12T17:24:29.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.490+0000 7f4be3c0e800 20 add_watcher() i=7 2024-09-12T17:24:29.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.490+0000 7f4be3c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:29.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.492+0000 7f4a95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.492+0000 7f4be3c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.492+0000 7f4be3c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.492+0000 7f4be3c0e800 5 note: GC not initialized 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.493+0000 7f4a94fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.493+0000 7f4be3c0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.493+0000 7f4be3c0e800 20 Filter name: none 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.493+0000 7f4a0e7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:29.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.493+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.493+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.493+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.494+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.494+0000 7f4be3c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.494+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.494+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.494+0000 7f4be3c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.494+0000 7f4be3c0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:29.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.494+0000 7f4be3c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:29.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.496+0000 7f4a95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:29.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.498+0000 7f4be3c0e800 20 remove_watcher() i=0 2024-09-12T17:24:29.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.498+0000 7f4be3c0e800 2 removed watcher, disabling cache 2024-09-12T17:24:29.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.500+0000 7f4be3c0e800 20 remove_watcher() i=1 2024-09-12T17:24:29.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.502+0000 7f4be3c0e800 20 remove_watcher() i=2 2024-09-12T17:24:29.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.503+0000 7f4be3c0e800 20 remove_watcher() i=3 2024-09-12T17:24:29.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.504+0000 7f4be3c0e800 20 remove_watcher() i=4 2024-09-12T17:24:29.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.505+0000 7f4be3c0e800 20 remove_watcher() i=5 2024-09-12T17:24:29.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.507+0000 7f4be3c0e800 20 remove_watcher() i=6 2024-09-12T17:24:29.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.509+0000 7f4be3c0e800 20 remove_watcher() i=7 2024-09-12T17:24:29.522 INFO:tasks.workunit.client.0.smithi063.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 98, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:24:29.522 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:24:29.522 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:29.523 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:24:29.557 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:29.558 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:29.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.596+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.597+0000 7f1dd4b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.597+0000 7f1dd4b35800 20 realm 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.597+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.597+0000 7f1dd4b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.598+0000 7f1dd4b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.598+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.598+0000 7f1dd4b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.598+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.598+0000 7f1dd4b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:29.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.598+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.599+0000 7f1dd4b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:29.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.599+0000 7f1dd4b35800 20 searching for the correct realm 2024-09-12T17:24:29.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.602+0000 7f1dcbfff640 0 -- 172.21.15.63:0/1153115464 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1dbc06cf80 msgr2=0x7f1dbc072670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:29.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.605+0000 7f1dd08e4640 0 -- 172.21.15.63:0/1153115464 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f1dcc020040 msgr2=0x7f1dcc03a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:29.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.609+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 zone default found 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 4 Realm: () 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 zonegroup default 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:29.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 started sync module instance, tier type = 2024-09-12T17:24:29.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.610+0000 7f1dd4b35800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:29.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.628+0000 7f1dd4b35800 20 add_watcher() i=0 2024-09-12T17:24:29.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.628+0000 7f1dd4b35800 20 add_watcher() i=1 2024-09-12T17:24:29.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.628+0000 7f1dd4b35800 20 add_watcher() i=2 2024-09-12T17:24:29.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.628+0000 7f1dd4b35800 20 add_watcher() i=3 2024-09-12T17:24:29.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.628+0000 7f1dd4b35800 20 add_watcher() i=4 2024-09-12T17:24:29.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.628+0000 7f1dd4b35800 20 add_watcher() i=5 2024-09-12T17:24:29.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.628+0000 7f1dd4b35800 20 add_watcher() i=6 2024-09-12T17:24:29.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.631+0000 7f1dd4b35800 20 add_watcher() i=7 2024-09-12T17:24:29.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.631+0000 7f1dd4b35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:29.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.633+0000 7f1c86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.633+0000 7f1dd4b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.633+0000 7f1dd4b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.633+0000 7f1dd4b35800 5 note: GC not initialized 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.633+0000 7f1c85fe3640 20 reqs_thread_entry: start 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 20 Filter name: none 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1bf77fe640 20 reqs_thread_entry: start 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:29.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.634+0000 7f1dd4b35800 20 rados->read ofs=0 len=0 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:29.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.635+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.636+0000 7f1dd4b35800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:24:29.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.636+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:29.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.636+0000 7f1dd4b35800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:24:29.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.636+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:29.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.637+0000 7f1dd4b35800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:24:29.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.637+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:29.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.637+0000 7f1dd4b35800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:24:29.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.637+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:29.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.637+0000 7f1dd4b35800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:24:29.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.637+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:29.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.638+0000 7f1dd4b35800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:24:29.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.638+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:29.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.638+0000 7f1dd4b35800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:24:29.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.638+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:29.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.639+0000 7f1dd4b35800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:24:29.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.639+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:29.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.640+0000 7f1dd4b35800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:24:29.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.640+0000 7f1dd4b35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:29.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.640+0000 7f1dd4b35800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:24:29.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.640+0000 7f1dd4b35800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:24:29.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.641+0000 7f1c86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:29.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.643+0000 7f1dd4b35800 20 remove_watcher() i=0 2024-09-12T17:24:29.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.643+0000 7f1dd4b35800 2 removed watcher, disabling cache 2024-09-12T17:24:29.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.645+0000 7f1dd4b35800 20 remove_watcher() i=1 2024-09-12T17:24:29.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.646+0000 7f1dd4b35800 20 remove_watcher() i=2 2024-09-12T17:24:29.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.647+0000 7f1dd4b35800 20 remove_watcher() i=3 2024-09-12T17:24:29.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.648+0000 7f1dd4b35800 20 remove_watcher() i=4 2024-09-12T17:24:29.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.650+0000 7f1dd4b35800 20 remove_watcher() i=5 2024-09-12T17:24:29.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.652+0000 7f1dd4b35800 20 remove_watcher() i=6 2024-09-12T17:24:29.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:29.654+0000 7f1dd4b35800 20 remove_watcher() i=7 2024-09-12T17:24:29.668 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:24:30.074 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:24:31.541 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:31.543 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:24:31.578 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:31.578 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:31.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.621+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.623+0000 7fdce5722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:31.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.623+0000 7fdce5722800 20 realm 2024-09-12T17:24:31.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.623+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.623+0000 7fdce5722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:31.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.623+0000 7fdce5722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:31.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.623+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.624+0000 7fdce5722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:31.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.624+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.625+0000 7fdce5722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:31.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.625+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.625+0000 7fdce5722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:31.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.625+0000 7fdce5722800 20 searching for the correct realm 2024-09-12T17:24:31.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.629+0000 7fdce0c67640 0 -- 172.21.15.63:0/4082673221 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fdcd8083420 msgr2=0x7fdcd80838a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:31.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.835+0000 7fdce1c69640 0 -- 172.21.15.63:0/4082673221 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e03cb685b0 msgr2=0x55e03cb6a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:31.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:31.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:31.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:31.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:31.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:31.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:31.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:31.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:31.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.841+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 20 zone default found 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 4 Realm: () 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 20 zonegroup default 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:31.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.842+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.843+0000 7fdce5722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:31.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.843+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.844+0000 7fdce5722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:31.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.844+0000 7fdce5722800 20 started sync module instance, tier type = 2024-09-12T17:24:31.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.844+0000 7fdce5722800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:31.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.861+0000 7fdce5722800 20 add_watcher() i=0 2024-09-12T17:24:31.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.861+0000 7fdce5722800 20 add_watcher() i=1 2024-09-12T17:24:31.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.861+0000 7fdce5722800 20 add_watcher() i=2 2024-09-12T17:24:31.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.861+0000 7fdce5722800 20 add_watcher() i=3 2024-09-12T17:24:31.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.861+0000 7fdce5722800 20 add_watcher() i=4 2024-09-12T17:24:31.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.861+0000 7fdce5722800 20 add_watcher() i=5 2024-09-12T17:24:31.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.861+0000 7fdce5722800 20 add_watcher() i=6 2024-09-12T17:24:31.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.863+0000 7fdce5722800 20 add_watcher() i=7 2024-09-12T17:24:31.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.863+0000 7fdce5722800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:31.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.865+0000 7fdb977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:31.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.865+0000 7fdce5722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:31.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.865+0000 7fdce5722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:31.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.865+0000 7fdce5722800 5 note: GC not initialized 2024-09-12T17:24:31.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.865+0000 7fdb967e4640 20 reqs_thread_entry: start 2024-09-12T17:24:31.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.865+0000 7fdce5722800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:31.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.866+0000 7fdce5722800 20 Filter name: none 2024-09-12T17:24:31.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.866+0000 7fdb07fff640 20 reqs_thread_entry: start 2024-09-12T17:24:31.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.866+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.867+0000 7fdce5722800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:31.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.867+0000 7fdce5722800 20 rados->read ofs=0 len=0 2024-09-12T17:24:31.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.867+0000 7fdce5722800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:31.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.867+0000 7fdce5722800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:31.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.867+0000 7fdce5722800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:31.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.867+0000 7fdce5722800 20 INFO: main: starting shard=0 2024-09-12T17:24:31.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.867+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.868+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.868+0000 7fdce5722800 20 INFO: main: starting shard=1 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.868+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.868+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.868+0000 7fdce5722800 20 INFO: main: starting shard=2 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.868+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.869+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.869+0000 7fdce5722800 20 INFO: main: starting shard=3 2024-09-12T17:24:31.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.869+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:31.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.869+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.869+0000 7fdce5722800 20 INFO: main: starting shard=4 2024-09-12T17:24:31.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.869+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:31.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.870+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.870+0000 7fdce5722800 20 INFO: main: starting shard=5 2024-09-12T17:24:31.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.870+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.870+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.870+0000 7fdce5722800 20 INFO: main: starting shard=6 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.870+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.871+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.871+0000 7fdce5722800 20 INFO: main: starting shard=7 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.871+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.871+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.872+0000 7fdce5722800 20 INFO: main: starting shard=8 2024-09-12T17:24:31.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.872+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:31.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.872+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:24:31.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.872+0000 7fdce5722800 20 INFO: main: starting shard=9 2024-09-12T17:24:31.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.872+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:31.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.873+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.873+0000 7fdce5722800 20 INFO: main: starting shard=10 2024-09-12T17:24:31.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.873+0000 7fdce5722800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:31.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.874+0000 7fdce5722800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:31.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.874+0000 7fdce5722800 20 INFO: main: done 2024-09-12T17:24:31.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.875+0000 7fdb977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:31.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.877+0000 7fdce5722800 20 remove_watcher() i=0 2024-09-12T17:24:31.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.877+0000 7fdce5722800 2 removed watcher, disabling cache 2024-09-12T17:24:31.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.879+0000 7fdce5722800 20 remove_watcher() i=1 2024-09-12T17:24:31.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.880+0000 7fdce5722800 20 remove_watcher() i=2 2024-09-12T17:24:31.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.882+0000 7fdce5722800 20 remove_watcher() i=3 2024-09-12T17:24:31.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.884+0000 7fdce5722800 20 remove_watcher() i=4 2024-09-12T17:24:31.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.886+0000 7fdce5722800 20 remove_watcher() i=5 2024-09-12T17:24:31.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.887+0000 7fdce5722800 20 remove_watcher() i=6 2024-09-12T17:24:31.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:31.889+0000 7fdce5722800 20 remove_watcher() i=7 2024-09-12T17:24:31.966 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:31.968 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:24:32.000 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:32.000 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:32.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.040+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.041+0000 7f3447536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.041+0000 7f3447536800 20 realm 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.041+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.041+0000 7f3447536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.041+0000 7f3447536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.041+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.042+0000 7f3447536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.042+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.042+0000 7f3447536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.042+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.043+0000 7f3447536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:32.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.043+0000 7f3447536800 20 searching for the correct realm 2024-09-12T17:24:32.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.046+0000 7f343aab6640 0 -- 172.21.15.63:0/3261744885 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f342c03e040 msgr2=0x7f342c03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.050+0000 7f3443ab8640 0 -- 172.21.15.63:0/3261744885 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55a3e98e8ad0 msgr2=0x55a3e98eaec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:32.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:32.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:32.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:32.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:32.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:32.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:32.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 zone default found 2024-09-12T17:24:32.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 4 Realm: () 2024-09-12T17:24:32.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:32.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:32.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:32.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 zonegroup default 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.054+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.055+0000 7f3447536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.055+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.055+0000 7f3447536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.055+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.056+0000 7f3447536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.056+0000 7f3447536800 20 started sync module instance, tier type = 2024-09-12T17:24:32.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.056+0000 7f3447536800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:32.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.071+0000 7f3447536800 20 add_watcher() i=0 2024-09-12T17:24:32.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.071+0000 7f3447536800 20 add_watcher() i=1 2024-09-12T17:24:32.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.071+0000 7f3447536800 20 add_watcher() i=2 2024-09-12T17:24:32.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.071+0000 7f3447536800 20 add_watcher() i=3 2024-09-12T17:24:32.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.071+0000 7f3447536800 20 add_watcher() i=4 2024-09-12T17:24:32.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.071+0000 7f3447536800 20 add_watcher() i=5 2024-09-12T17:24:32.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.071+0000 7f3447536800 20 add_watcher() i=6 2024-09-12T17:24:32.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.072+0000 7f3447536800 20 add_watcher() i=7 2024-09-12T17:24:32.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.072+0000 7f3447536800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:32.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f32f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f3447536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f3447536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f3447536800 5 note: GC not initialized 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f32f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f3447536800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f3447536800 20 Filter name: none 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.074+0000 7f32727fc640 20 reqs_thread_entry: start 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:32.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:32.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:32.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:32.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 INFO: main: starting shard=0 2024-09-12T17:24:32.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.075+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:32.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.076+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.076+0000 7f3447536800 20 INFO: main: starting shard=1 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.076+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.076+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.076+0000 7f3447536800 20 INFO: main: starting shard=2 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.076+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.077+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.077+0000 7f3447536800 20 INFO: main: starting shard=3 2024-09-12T17:24:32.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.077+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.077+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.077+0000 7f3447536800 20 INFO: main: starting shard=4 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.077+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.078+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.078+0000 7f3447536800 20 INFO: main: starting shard=5 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.078+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.078+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:24:32.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.078+0000 7f3447536800 20 INFO: main: starting shard=6 2024-09-12T17:24:32.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.078+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:32.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.079+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.079+0000 7f3447536800 20 INFO: main: starting shard=7 2024-09-12T17:24:32.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.079+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:32.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.079+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.079+0000 7f3447536800 20 INFO: main: starting shard=8 2024-09-12T17:24:32.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.079+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:32.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.080+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.080+0000 7f3447536800 20 INFO: main: starting shard=9 2024-09-12T17:24:32.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.080+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:32.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.080+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.080+0000 7f3447536800 20 INFO: main: starting shard=10 2024-09-12T17:24:32.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.080+0000 7f3447536800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:32.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.081+0000 7f3447536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.081+0000 7f3447536800 20 INFO: main: done 2024-09-12T17:24:32.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.082+0000 7f32f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.084+0000 7f3447536800 20 remove_watcher() i=0 2024-09-12T17:24:32.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.084+0000 7f3447536800 2 removed watcher, disabling cache 2024-09-12T17:24:32.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.085+0000 7f3447536800 20 remove_watcher() i=1 2024-09-12T17:24:32.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.087+0000 7f3447536800 20 remove_watcher() i=2 2024-09-12T17:24:32.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.088+0000 7f3447536800 20 remove_watcher() i=3 2024-09-12T17:24:32.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.090+0000 7f3447536800 20 remove_watcher() i=4 2024-09-12T17:24:32.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.092+0000 7f3447536800 20 remove_watcher() i=5 2024-09-12T17:24:32.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.093+0000 7f3447536800 20 remove_watcher() i=6 2024-09-12T17:24:32.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.094+0000 7f3447536800 20 remove_watcher() i=7 2024-09-12T17:24:32.173 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:32.175 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:24:32.206 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:32.206 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:32.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.244+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 20 realm 2024-09-12T17:24:32.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:32.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.246+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.247+0000 7fe43852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.247+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.247+0000 7fe43852c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:32.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.247+0000 7fe43852c800 20 searching for the correct realm 2024-09-12T17:24:32.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.250+0000 7fe433a4e640 0 -- 172.21.15.63:0/4257069819 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fe428054370 msgr2=0x7fe4280547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.455+0000 7fe434a50640 0 -- 172.21.15.63:0/4257069819 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e4629c3390 msgr2=0x55e4629c5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:32.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:32.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:32.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:32.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:32.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:32.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.459+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 zone default found 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 4 Realm: () 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 zonegroup default 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.460+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.461+0000 7fe43852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.461+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.461+0000 7fe43852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.461+0000 7fe43852c800 20 started sync module instance, tier type = 2024-09-12T17:24:32.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.461+0000 7fe43852c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:32.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.481+0000 7fe43852c800 20 add_watcher() i=0 2024-09-12T17:24:32.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.481+0000 7fe43852c800 20 add_watcher() i=1 2024-09-12T17:24:32.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.481+0000 7fe43852c800 20 add_watcher() i=2 2024-09-12T17:24:32.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.481+0000 7fe43852c800 20 add_watcher() i=3 2024-09-12T17:24:32.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.481+0000 7fe43852c800 20 add_watcher() i=4 2024-09-12T17:24:32.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.481+0000 7fe43852c800 20 add_watcher() i=5 2024-09-12T17:24:32.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.481+0000 7fe43852c800 20 add_watcher() i=6 2024-09-12T17:24:32.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.483+0000 7fe43852c800 20 add_watcher() i=7 2024-09-12T17:24:32.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.483+0000 7fe43852c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:32.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.485+0000 7fe2eb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.485+0000 7fe43852c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.485+0000 7fe43852c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.485+0000 7fe43852c800 5 note: GC not initialized 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.485+0000 7fe2ea7dc640 20 reqs_thread_entry: start 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.485+0000 7fe43852c800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.485+0000 7fe43852c800 20 Filter name: none 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.486+0000 7fe2e37fe640 20 reqs_thread_entry: start 2024-09-12T17:24:32.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.486+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.486+0000 7fe43852c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:32.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.486+0000 7fe43852c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.486+0000 7fe43852c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:32.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.486+0000 7fe43852c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 INFO: main: starting shard=0 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 INFO: main: starting shard=1 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 INFO: main: starting shard=2 2024-09-12T17:24:32.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.487+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.488+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.488+0000 7fe43852c800 20 INFO: main: starting shard=3 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.488+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.488+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.488+0000 7fe43852c800 20 INFO: main: starting shard=4 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.488+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.489+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.489+0000 7fe43852c800 20 INFO: main: starting shard=5 2024-09-12T17:24:32.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.489+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:32.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.490+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.490+0000 7fe43852c800 20 INFO: main: starting shard=6 2024-09-12T17:24:32.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.490+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:32.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.490+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.490+0000 7fe43852c800 20 INFO: main: starting shard=7 2024-09-12T17:24:32.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.490+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:32.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.491+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.491+0000 7fe43852c800 20 INFO: main: starting shard=8 2024-09-12T17:24:32.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.491+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:32.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.492+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.492+0000 7fe43852c800 20 INFO: main: starting shard=9 2024-09-12T17:24:32.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.492+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:32.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.492+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.492+0000 7fe43852c800 20 INFO: main: starting shard=10 2024-09-12T17:24:32.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.492+0000 7fe43852c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:32.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.493+0000 7fe43852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.493+0000 7fe43852c800 20 INFO: main: done 2024-09-12T17:24:32.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.493+0000 7fe2eb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.496+0000 7fe43852c800 20 remove_watcher() i=0 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.496+0000 7fe43852c800 2 removed watcher, disabling cache 2024-09-12T17:24:32.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.497+0000 7fe43852c800 20 remove_watcher() i=1 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.498+0000 7fe43852c800 20 remove_watcher() i=2 2024-09-12T17:24:32.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.499+0000 7fe43852c800 20 remove_watcher() i=3 2024-09-12T17:24:32.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.500+0000 7fe43852c800 20 remove_watcher() i=4 2024-09-12T17:24:32.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.501+0000 7fe43852c800 20 remove_watcher() i=5 2024-09-12T17:24:32.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.504+0000 7fe43852c800 20 remove_watcher() i=6 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.506+0000 7fe43852c800 20 remove_watcher() i=7 2024-09-12T17:24:32.577 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:32.578 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:24:32.609 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:32.610 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:32.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.647+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 20 realm 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.649+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.650+0000 7fd50d13a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.650+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.650+0000 7fd50d13a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:32.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.650+0000 7fd50d13a800 20 searching for the correct realm 2024-09-12T17:24:32.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.653+0000 7fd508e81640 0 -- 172.21.15.63:0/4225793388 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fd4f8094070 msgr2=0x7fd4f8096480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.656+0000 7fd508e81640 0 -- 172.21.15.63:0/4225793388 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fd500020420 msgr2=0x7fd500020880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.862+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:32.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 zone default found 2024-09-12T17:24:32.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 4 Realm: () 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 zonegroup default 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.863+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.864+0000 7fd50d13a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.864+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.864+0000 7fd50d13a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.864+0000 7fd50d13a800 20 started sync module instance, tier type = 2024-09-12T17:24:32.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.864+0000 7fd50d13a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:32.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.878+0000 7fd50d13a800 20 add_watcher() i=0 2024-09-12T17:24:32.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.878+0000 7fd50d13a800 20 add_watcher() i=1 2024-09-12T17:24:32.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.878+0000 7fd50d13a800 20 add_watcher() i=2 2024-09-12T17:24:32.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.878+0000 7fd50d13a800 20 add_watcher() i=3 2024-09-12T17:24:32.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.878+0000 7fd50d13a800 20 add_watcher() i=4 2024-09-12T17:24:32.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.878+0000 7fd50d13a800 20 add_watcher() i=5 2024-09-12T17:24:32.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.878+0000 7fd50d13a800 20 add_watcher() i=6 2024-09-12T17:24:32.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.880+0000 7fd50d13a800 20 add_watcher() i=7 2024-09-12T17:24:32.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.880+0000 7fd50d13a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:32.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd3befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd50d13a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd50d13a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd50d13a800 5 note: GC not initialized 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd3bdfe3640 20 reqs_thread_entry: start 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd50d13a800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd50d13a800 20 Filter name: none 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.883+0000 7fd32f7fe640 20 reqs_thread_entry: start 2024-09-12T17:24:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:32.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:32.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:32.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 INFO: main: starting shard=0 2024-09-12T17:24:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.884+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.885+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.885+0000 7fd50d13a800 20 INFO: main: starting shard=1 2024-09-12T17:24:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.885+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 INFO: main: starting shard=2 2024-09-12T17:24:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 INFO: main: starting shard=3 2024-09-12T17:24:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 INFO: main: starting shard=4 2024-09-12T17:24:32.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.886+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:32.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.887+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.887+0000 7fd50d13a800 20 INFO: main: starting shard=5 2024-09-12T17:24:32.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.887+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.888+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.888+0000 7fd50d13a800 20 INFO: main: starting shard=6 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.888+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.888+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.888+0000 7fd50d13a800 20 INFO: main: starting shard=7 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.888+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.889+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.889+0000 7fd50d13a800 20 INFO: main: starting shard=8 2024-09-12T17:24:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.889+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:32.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.889+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.889+0000 7fd50d13a800 20 INFO: main: starting shard=9 2024-09-12T17:24:32.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.890+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:32.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.890+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:32.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.890+0000 7fd50d13a800 20 INFO: main: starting shard=10 2024-09-12T17:24:32.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.890+0000 7fd50d13a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:32.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.890+0000 7fd50d13a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:32.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.891+0000 7fd50d13a800 20 INFO: main: done 2024-09-12T17:24:32.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.891+0000 7fd3befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.893+0000 7fd50d13a800 20 remove_watcher() i=0 2024-09-12T17:24:32.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.893+0000 7fd50d13a800 2 removed watcher, disabling cache 2024-09-12T17:24:32.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.894+0000 7fd50d13a800 20 remove_watcher() i=1 2024-09-12T17:24:32.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.895+0000 7fd50d13a800 20 remove_watcher() i=2 2024-09-12T17:24:32.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.896+0000 7fd50d13a800 20 remove_watcher() i=3 2024-09-12T17:24:32.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.897+0000 7fd50d13a800 20 remove_watcher() i=4 2024-09-12T17:24:32.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.899+0000 7fd50d13a800 20 remove_watcher() i=5 2024-09-12T17:24:32.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.900+0000 7fd50d13a800 20 remove_watcher() i=6 2024-09-12T17:24:32.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:32.901+0000 7fd50d13a800 20 remove_watcher() i=7 2024-09-12T17:24:32.919 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:24:33.338 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:24:33.750 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:24:33.750 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:33.752 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:24:33.785 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:33.785 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:33.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.824+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.825+0000 7f2ef792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.825+0000 7f2ef792c800 20 realm 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.826+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.826+0000 7f2ef792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.826+0000 7f2ef792c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.826+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.826+0000 7f2ef792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.826+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.827+0000 7f2ef792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:33.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.827+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.827+0000 7f2ef792c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:33.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.827+0000 7f2ef792c800 20 searching for the correct realm 2024-09-12T17:24:33.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.829+0000 7f2ef36ad640 0 -- 172.21.15.63:0/3006538033 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x5628d99b8ef0 msgr2=0x5628d99bb2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:33.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:33.833+0000 7f2ef3eae640 0 -- 172.21.15.63:0/3006538033 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x5628d99b8ef0 msgr2=0x7f2ee4041940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:34.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.041+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 zone default found 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 4 Realm: () 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 zonegroup default 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.042+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.043+0000 7f2ef792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.043+0000 7f2ef792c800 20 started sync module instance, tier type = 2024-09-12T17:24:34.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.043+0000 7f2ef792c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:34.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.054+0000 7f2ef792c800 20 add_watcher() i=0 2024-09-12T17:24:34.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.054+0000 7f2ef792c800 20 add_watcher() i=1 2024-09-12T17:24:34.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.054+0000 7f2ef792c800 20 add_watcher() i=2 2024-09-12T17:24:34.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.054+0000 7f2ef792c800 20 add_watcher() i=3 2024-09-12T17:24:34.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.054+0000 7f2ef792c800 20 add_watcher() i=4 2024-09-12T17:24:34.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.056+0000 7f2ef792c800 20 add_watcher() i=5 2024-09-12T17:24:34.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.056+0000 7f2ef792c800 20 add_watcher() i=6 2024-09-12T17:24:34.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.056+0000 7f2ef792c800 20 add_watcher() i=7 2024-09-12T17:24:34.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.056+0000 7f2ef792c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:34.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.058+0000 7f2da9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:34.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.058+0000 7f2ef792c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:34.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.058+0000 7f2ef792c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:34.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.058+0000 7f2ef792c800 5 note: GC not initialized 2024-09-12T17:24:34.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.059+0000 7f2da8fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:34.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.059+0000 7f2ef792c800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:34.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.059+0000 7f2ef792c800 20 Filter name: none 2024-09-12T17:24:34.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.059+0000 7f2d227fc640 20 reqs_thread_entry: start 2024-09-12T17:24:34.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.059+0000 7f2ef792c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:34.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.059+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:34.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:34.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.060+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:34.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.061+0000 7f2ef792c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:24:34.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.061+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.061+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.062+0000 7f2ef792c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:24:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.062+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.062+0000 7f2ef792c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:24:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.062+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.063+0000 7f2ef792c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:24:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.063+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.063+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:34.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.064+0000 7f2ef792c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:24:34.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.064+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:34.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.065+0000 7f2ef792c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:24:34.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.065+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.066+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:34.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.066+0000 7f2ef792c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:24:34.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.066+0000 7f2ef792c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.067+0000 7f2ef792c800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T17:24:34.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.067+0000 7f2ef792c800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:24:34.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.067+0000 7f2ef792c800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:24:34.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.067+0000 7f2ef792c800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T17:24:34.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.067+0000 7f2ef792c800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:24:34.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.068+0000 7f2da9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:34.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.070+0000 7f2ef792c800 20 remove_watcher() i=0 2024-09-12T17:24:34.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.070+0000 7f2ef792c800 2 removed watcher, disabling cache 2024-09-12T17:24:34.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.071+0000 7f2ef792c800 20 remove_watcher() i=1 2024-09-12T17:24:34.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.073+0000 7f2ef792c800 20 remove_watcher() i=2 2024-09-12T17:24:34.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.074+0000 7f2ef792c800 20 remove_watcher() i=3 2024-09-12T17:24:34.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.075+0000 7f2ef792c800 20 remove_watcher() i=4 2024-09-12T17:24:34.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.076+0000 7f2ef792c800 20 remove_watcher() i=5 2024-09-12T17:24:34.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.077+0000 7f2ef792c800 20 remove_watcher() i=6 2024-09-12T17:24:34.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.078+0000 7f2ef792c800 20 remove_watcher() i=7 2024-09-12T17:24:34.090 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: unlinked entries are not listable 2024-09-12T17:24:34.090 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:34.098 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:24:34.098 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:34.187 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:24:34.187 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:34.189 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:24:34.224 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:34.224 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:34.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.262+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 20 realm 2024-09-12T17:24:34.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:34.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.264+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.265+0000 7f478ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:34.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.265+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.265+0000 7f478ab42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:34.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.265+0000 7f478ab42800 20 searching for the correct realm 2024-09-12T17:24:34.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.269+0000 7f47860ec640 0 -- 172.21.15.63:0/2152078839 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f477c065930 msgr2=0x7f477c07a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:34.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.475+0000 7f47870ee640 0 -- 172.21.15.63:0/2152078839 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5627b5fb79f0 msgr2=0x5627b5fb9eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.480+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 zone default found 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 4 Realm: () 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 zonegroup default 2024-09-12T17:24:34.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.481+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.482+0000 7f478ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.482+0000 7f478ab42800 20 started sync module instance, tier type = 2024-09-12T17:24:34.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.482+0000 7f478ab42800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:34.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.495+0000 7f478ab42800 20 add_watcher() i=0 2024-09-12T17:24:34.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.495+0000 7f478ab42800 20 add_watcher() i=1 2024-09-12T17:24:34.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.495+0000 7f478ab42800 20 add_watcher() i=2 2024-09-12T17:24:34.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.495+0000 7f478ab42800 20 add_watcher() i=3 2024-09-12T17:24:34.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.495+0000 7f478ab42800 20 add_watcher() i=4 2024-09-12T17:24:34.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.495+0000 7f478ab42800 20 add_watcher() i=5 2024-09-12T17:24:34.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.496+0000 7f478ab42800 20 add_watcher() i=6 2024-09-12T17:24:34.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.497+0000 7f478ab42800 20 add_watcher() i=7 2024-09-12T17:24:34.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.497+0000 7f478ab42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:34.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f463d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f478ab42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f478ab42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f478ab42800 5 note: GC not initialized 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f45b7fff640 20 reqs_thread_entry: start 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f478ab42800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f478ab42800 20 Filter name: none 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f45b5ffb640 20 reqs_thread_entry: start 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f478ab42800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:34.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.500+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:34.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:34.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:34.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:34.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:34.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:34.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:34.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:34.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:34.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:34.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.501+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:34.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.502+0000 7f478ab42800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:24:34.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.502+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.502+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:34.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.503+0000 7f478ab42800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:24:34.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.503+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:34.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.503+0000 7f478ab42800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:24:34.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.503+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:34.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.504+0000 7f478ab42800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:24:34.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.504+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.504+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:34.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.505+0000 7f478ab42800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:24:34.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.505+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:34.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.505+0000 7f478ab42800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:24:34.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.505+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.506+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:34.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.507+0000 7f478ab42800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:24:34.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.507+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.507+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.508+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5d42c60 obj=check-bucket:e state=0x5627b5ff12e8 s->prefetch_data=0 2024-09-12T17:24:34.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.508+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.508+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5d55780 obj=check-bucket:d state=0x5627b5fee8e8 s->prefetch_data=0 2024-09-12T17:24:34.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.508+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.508+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5ff1ea0 obj=check-bucket:c state=0x5627b5ff2cf8 s->prefetch_data=0 2024-09-12T17:24:34.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.508+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5ff0040 obj=check-bucket:f state=0x5627b608d7d8 s->prefetch_data=0 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to ximo50gstwvvhttmzw927f27q3kqehdk 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state_impl: setting s->olh_tag to iurpoguw8dturo8frtu2kizsb0wgor7g 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iurpoguw8dturo8frtu2kizsb0wgor7g 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to ks90ux8ypq0yha5npollhi1tu2usy25a 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state_impl: setting s->olh_tag to nu0l5tnj40me821wpl2jbslfxow9qex4 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nu0l5tnj40me821wpl2jbslfxow9qex4 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to 0484wxuzmjmlkmlielj1i8ui94oz6ynr 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state_impl: setting s->olh_tag to uibuqauqbi7mr0j1ltgjx01gm5rpxvsc 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uibuqauqbi7mr0j1ltgjx01gm5rpxvsc 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to 9utuoofzax5hu0l97nf2soj21nnp70w7 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 get_obj_state_impl: setting s->olh_tag to 1m69nhqhqkcb9x9l9ymdhkkw8biju0hd 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.509+0000 7f478ab42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1m69nhqhqkcb9x9l9ymdhkkw8biju0hd 2024-09-12T17:24:34.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.513+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.513+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.513+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.514+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.519+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.519+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.519+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.519+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.519+0000 7f478ab42800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.519+0000 7f478ab42800 20 olh_log_entry: epoch=2 op=3 key=e[XeqWNCttAgrt1cIeLcsrIi8.99eMDhs] 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.519+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5d42c60 obj=check-bucket:_:XeqWNCttAgrt1cIeLcsrIi8.99eMDhs_e state=0x5627b6098e08 s->prefetch_data=0 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 olh_log_entry: epoch=3 op=3 key=d[IiCDm98tKmB6Z9khA0DbkDlT-L2BVVx] 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5d55780 obj=check-bucket:_:IiCDm98tKmB6Z9khA0DbkDlT-L2BVVx_d state=0x5627b60a2bb8 s->prefetch_data=0 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 olh_log_entry: epoch=3 op=3 key=c[an.lnJmz.KHX2hrp0WecpHfDVnzYLtw] 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5ff1ea0 obj=check-bucket:_:an.lnJmz.KHX2hrp0WecpHfDVnzYLtw_c state=0x5627b60abf78 s->prefetch_data=0 2024-09-12T17:24:34.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 olh_log_entry: epoch=2 op=3 key=f[FYhfi7A-N3X.kIEB4G8M4hWkn---Os8] 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5ff0040 obj=check-bucket:_:FYhfi7A-N3X.kIEB4G8M4hWkn---Os8_f state=0x5627b60b5578 s->prefetch_data=0 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 10 manifest: total_size = 11 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17976449070183117288 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5d42c60 obj=check-bucket:_:XeqWNCttAgrt1cIeLcsrIi8.99eMDhs_e state=0x5627b6098e08 s->prefetch_data=0 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 prepare_atomic_modification: state is not atomic. state=0x5627b6098e08 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 10 manifest: total_size = 22 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9023154103485587892 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5d55780 obj=check-bucket:_:IiCDm98tKmB6Z9khA0DbkDlT-L2BVVx_d state=0x5627b60a2bb8 s->prefetch_data=0 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 prepare_atomic_modification: state is not atomic. state=0x5627b60a2bb8 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 10 manifest: total_size = 11 2024-09-12T17:24:34.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8214262712103637877 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5ff1ea0 obj=check-bucket:_:an.lnJmz.KHX2hrp0WecpHfDVnzYLtw_c state=0x5627b60abf78 s->prefetch_data=0 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 prepare_atomic_modification: state is not atomic. state=0x5627b60abf78 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 10 manifest: total_size = 22 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1614337307266899722 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5ff0040 obj=check-bucket:_:FYhfi7A-N3X.kIEB4G8M4hWkn---Os8_f state=0x5627b60b5578 s->prefetch_data=0 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 prepare_atomic_modification: state is not atomic. state=0x5627b60b5578 2024-09-12T17:24:34.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.520+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.525+0000 7f478ab42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:34.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.525+0000 7f478ab42800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:24:34.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.525+0000 7f478ab42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:34.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.525+0000 7f478ab42800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:an.lnJmz.KHX2hrp0WecpHfDVnzYLtw_.WQu_HRAQKGzZWtPdJypRr-m3p2HPHVm_0 2024-09-12T17:24:34.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.526+0000 7f478ab42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:34.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.526+0000 7f478ab42800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:24:34.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.526+0000 7f478ab42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:34.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.526+0000 7f478ab42800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:XeqWNCttAgrt1cIeLcsrIi8.99eMDhs_.O1I9hCJv2uCQW0C_eKP24dvIGfhjJry_0 2024-09-12T17:24:34.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.529+0000 7f478ab42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:34.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:34.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:24:34.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:34.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:FYhfi7A-N3X.kIEB4G8M4hWkn---Os8_.r62hvrIefVsCiBt1lVlUCkFF4uaPBG9_0 2024-09-12T17:24:34.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:34.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:24:34.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:34.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f478ab42800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:IiCDm98tKmB6Z9khA0DbkDlT-L2BVVx_.qcBwbJy6SipT5nldNdDbk3jplSdYyIt_0 2024-09-12T17:24:34.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f466a7fc640 20 handle_completion(): completion ok for obj=c[an.lnJmz.KHX2hrp0WecpHfDVnzYLtw] 2024-09-12T17:24:34.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.530+0000 7f4669ffb640 20 handle_completion(): completion ok for obj=e[XeqWNCttAgrt1cIeLcsrIi8.99eMDhs] 2024-09-12T17:24:34.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.531+0000 7f478ab42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.535+0000 7f478ab42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.535+0000 7f466a7fc640 20 handle_completion(): completion ok for obj=d[IiCDm98tKmB6Z9khA0DbkDlT-L2BVVx] 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.535+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.535+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.536+0000 7f466a7fc640 20 handle_completion(): completion ok for obj=f[FYhfi7A-N3X.kIEB4G8M4hWkn---Os8] 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.536+0000 7f478ab42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.536+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5d42c60 obj=check-bucket:e state=0x5627b5ff12e8 s->prefetch_data=0 2024-09-12T17:24:34.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.536+0000 7f478ab42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iurpoguw8dturo8frtu2kizsb0wgor7g 2024-09-12T17:24:34.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.541+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.541+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.541+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.541+0000 7f478ab42800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:24:34.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.542+0000 7f478ab42800 20 get_obj_state: octx=0x5627b5ff0040 obj=check-bucket:f state=0x5627b608d7d8 s->prefetch_data=0 2024-09-12T17:24:34.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.542+0000 7f478ab42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1m69nhqhqkcb9x9l9ymdhkkw8biju0hd 2024-09-12T17:24:34.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.548+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.548+0000 7f478ab42800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:24:34.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.548+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.551+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.551+0000 7f478ab42800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:24:34.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.552+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.554+0000 7f478ab42800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.554+0000 7f478ab42800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:24:34.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.554+0000 7f478ab42800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:24:34.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.555+0000 7f463d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:34.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.558+0000 7f478ab42800 20 remove_watcher() i=0 2024-09-12T17:24:34.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.558+0000 7f478ab42800 2 removed watcher, disabling cache 2024-09-12T17:24:34.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.559+0000 7f478ab42800 20 remove_watcher() i=1 2024-09-12T17:24:34.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.560+0000 7f478ab42800 20 remove_watcher() i=2 2024-09-12T17:24:34.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.561+0000 7f478ab42800 20 remove_watcher() i=3 2024-09-12T17:24:34.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.562+0000 7f478ab42800 20 remove_watcher() i=4 2024-09-12T17:24:34.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.563+0000 7f478ab42800 20 remove_watcher() i=5 2024-09-12T17:24:34.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.564+0000 7f478ab42800 20 remove_watcher() i=6 2024-09-12T17:24:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.565+0000 7f478ab42800 20 remove_watcher() i=7 2024-09-12T17:24:34.589 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:24:34.589 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:34.644 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:24:34.644 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:34.646 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:24:34.679 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:34.679 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.718+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.719+0000 7f484d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.719+0000 7f484d9af800 20 realm 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.719+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.719+0000 7f484d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.719+0000 7f484d9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.719+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.719+0000 7f484d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.720+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.720+0000 7f484d9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:34.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.720+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.720+0000 7f484d9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:34.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.720+0000 7f484d9af800 20 searching for the correct realm 2024-09-12T17:24:34.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.724+0000 7f484ac98640 0 -- 172.21.15.63:0/3131646476 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f4834001490 msgr2=0x7f4834001930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:34.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.929+0000 7f484bc9a640 0 -- 172.21.15.63:0/3131646476 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56375920c360 msgr2=0x56375920e7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:34.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.934+0000 7f484d9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:34.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.934+0000 7f484d9af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:34.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.934+0000 7f484d9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:34.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.934+0000 7f484d9af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:34.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.934+0000 7f484d9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:34.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.934+0000 7f484d9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:34.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.934+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.935+0000 7f484d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.935+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.935+0000 7f484d9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:34.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.935+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.935+0000 7f484d9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 zone default found 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 4 Realm: () 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 zonegroup default 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 started sync module instance, tier type = 2024-09-12T17:24:34.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.936+0000 7f484d9af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.946+0000 7f484d9af800 20 add_watcher() i=0 2024-09-12T17:24:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.946+0000 7f484d9af800 20 add_watcher() i=1 2024-09-12T17:24:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.946+0000 7f484d9af800 20 add_watcher() i=2 2024-09-12T17:24:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.946+0000 7f484d9af800 20 add_watcher() i=3 2024-09-12T17:24:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.946+0000 7f484d9af800 20 add_watcher() i=4 2024-09-12T17:24:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.946+0000 7f484d9af800 20 add_watcher() i=5 2024-09-12T17:24:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.946+0000 7f484d9af800 20 add_watcher() i=6 2024-09-12T17:24:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.947+0000 7f484d9af800 20 add_watcher() i=7 2024-09-12T17:24:34.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.947+0000 7f484d9af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:34.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.949+0000 7f4701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:34.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f484d9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:34.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f484d9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:34.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f484d9af800 5 note: GC not initialized 2024-09-12T17:24:34.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f4700fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:34.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f484d9af800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:34.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f484d9af800 20 Filter name: none 2024-09-12T17:24:34.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f467a7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:34.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f484d9af800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:34.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.950+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:34.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:34.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:34.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:34.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.951+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:34.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.952+0000 7f484d9af800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:24:34.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.952+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:34.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.952+0000 7f484d9af800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:24:34.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.952+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:34.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.953+0000 7f484d9af800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:24:34.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.953+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:34.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.953+0000 7f484d9af800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:24:34.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.953+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:34.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.954+0000 7f484d9af800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:24:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.954+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.954+0000 7f484d9af800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:24:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.954+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.955+0000 7f484d9af800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:24:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.955+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:34.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.955+0000 7f484d9af800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:24:34.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.955+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:34.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.956+0000 7f484d9af800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:24:34.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.956+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:34.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.956+0000 7f484d9af800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:24:34.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.956+0000 7f484d9af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:34.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.957+0000 7f484d9af800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:24:34.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.957+0000 7f484d9af800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:24:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.958+0000 7f4701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:34.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.961+0000 7f484d9af800 20 remove_watcher() i=0 2024-09-12T17:24:34.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.961+0000 7f484d9af800 2 removed watcher, disabling cache 2024-09-12T17:24:34.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.963+0000 7f484d9af800 20 remove_watcher() i=1 2024-09-12T17:24:34.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.964+0000 7f484d9af800 20 remove_watcher() i=2 2024-09-12T17:24:34.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.965+0000 7f484d9af800 20 remove_watcher() i=3 2024-09-12T17:24:34.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.966+0000 7f484d9af800 20 remove_watcher() i=4 2024-09-12T17:24:34.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.967+0000 7f484d9af800 20 remove_watcher() i=5 2024-09-12T17:24:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.968+0000 7f484d9af800 20 remove_watcher() i=6 2024-09-12T17:24:34.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:34.969+0000 7f484d9af800 20 remove_watcher() i=7 2024-09-12T17:24:35.015 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:24:35.046 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:35.046 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:35.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.085+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 20 realm 2024-09-12T17:24:35.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:35.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.087+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.088+0000 7f34d293d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.088+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.088+0000 7f34d293d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:35.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.088+0000 7f34d293d800 20 searching for the correct realm 2024-09-12T17:24:35.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.090+0000 7f34ce62a640 0 -- 172.21.15.63:0/330030124 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f34c00b17c0 msgr2=0x7f34c00a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.296+0000 7f34ce62a640 0 -- 172.21.15.63:0/330030124 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f34c8018040 msgr2=0x7f34c801a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:35.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.503+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 zone default found 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 4 Realm: () 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 zonegroup default 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.504+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.505+0000 7f34d293d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.505+0000 7f34d293d800 20 started sync module instance, tier type = 2024-09-12T17:24:35.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.505+0000 7f34d293d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:35.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.527+0000 7f34d293d800 20 add_watcher() i=0 2024-09-12T17:24:35.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.527+0000 7f34d293d800 20 add_watcher() i=1 2024-09-12T17:24:35.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.527+0000 7f34d293d800 20 add_watcher() i=2 2024-09-12T17:24:35.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.527+0000 7f34d293d800 20 add_watcher() i=3 2024-09-12T17:24:35.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.527+0000 7f34d293d800 20 add_watcher() i=4 2024-09-12T17:24:35.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.527+0000 7f34d293d800 20 add_watcher() i=5 2024-09-12T17:24:35.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.527+0000 7f34d293d800 20 add_watcher() i=6 2024-09-12T17:24:35.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.529+0000 7f34d293d800 20 add_watcher() i=7 2024-09-12T17:24:35.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.529+0000 7f34d293d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:35.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f3380fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f34d293d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:35.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f34d293d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:35.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f34d293d800 5 note: GC not initialized 2024-09-12T17:24:35.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f32fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:24:35.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f34d293d800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:35.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f34d293d800 20 Filter name: none 2024-09-12T17:24:35.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f32f97fa640 20 reqs_thread_entry: start 2024-09-12T17:24:35.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.531+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.532+0000 7f34d293d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.532+0000 7f34d293d800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.533+0000 7f34d293d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.533+0000 7f34d293d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.533+0000 7f34d293d800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.533+0000 7f34d293d800 20 INFO: main: starting shard=0 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.533+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 INFO: main: starting shard=1 2024-09-12T17:24:35.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:35.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 INFO: main: starting shard=2 2024-09-12T17:24:35.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:35.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 INFO: main: starting shard=3 2024-09-12T17:24:35.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.534+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:35.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.535+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.535+0000 7f34d293d800 20 INFO: main: starting shard=4 2024-09-12T17:24:35.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.535+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:35.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.535+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.535+0000 7f34d293d800 20 INFO: main: starting shard=5 2024-09-12T17:24:35.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.535+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:35.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.536+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.536+0000 7f34d293d800 20 INFO: main: starting shard=6 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.536+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.537+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.537+0000 7f34d293d800 20 INFO: main: starting shard=7 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.537+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.537+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.537+0000 7f34d293d800 20 INFO: main: starting shard=8 2024-09-12T17:24:35.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.537+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:35.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.538+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:24:35.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.538+0000 7f34d293d800 20 INFO: main: starting shard=9 2024-09-12T17:24:35.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.538+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:35.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.538+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.538+0000 7f34d293d800 20 INFO: main: starting shard=10 2024-09-12T17:24:35.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.538+0000 7f34d293d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:35.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.539+0000 7f34d293d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.539+0000 7f34d293d800 20 INFO: main: done 2024-09-12T17:24:35.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.540+0000 7f3380fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.544 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.543+0000 7f34d293d800 20 remove_watcher() i=0 2024-09-12T17:24:35.544 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.543+0000 7f34d293d800 2 removed watcher, disabling cache 2024-09-12T17:24:35.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.544+0000 7f34d293d800 20 remove_watcher() i=1 2024-09-12T17:24:35.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.545+0000 7f34d293d800 20 remove_watcher() i=2 2024-09-12T17:24:35.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.547+0000 7f34d293d800 20 remove_watcher() i=3 2024-09-12T17:24:35.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.549+0000 7f34d293d800 20 remove_watcher() i=4 2024-09-12T17:24:35.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.550+0000 7f34d293d800 20 remove_watcher() i=5 2024-09-12T17:24:35.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.551+0000 7f34d293d800 20 remove_watcher() i=6 2024-09-12T17:24:35.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.554+0000 7f34d293d800 20 remove_watcher() i=7 2024-09-12T17:24:35.569 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:35.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.640+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 20 realm 2024-09-12T17:24:35.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:35.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.642+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.643+0000 7f35a7d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.643+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.643+0000 7f35a7d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:35.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.643+0000 7f35a7d75800 20 searching for the correct realm 2024-09-12T17:24:35.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.646+0000 7f35a505e640 0 -- 172.21.15.63:0/3723113398 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x55deba149890 msgr2=0x55deba14bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.649+0000 7f35a585f640 0 -- 172.21.15.63:0/3723113398 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f35a0017410 msgr2=0x7f35a0017890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.856+0000 7f35a7d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.856+0000 7f35a7d75800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.856+0000 7f35a7d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.856+0000 7f35a7d75800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.856+0000 7f35a7d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.856+0000 7f35a7d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.856+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.857+0000 7f35a7d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.857+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.857+0000 7f35a7d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.857+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:35.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 zone default found 2024-09-12T17:24:35.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 4 Realm: () 2024-09-12T17:24:35.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 zonegroup default 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 started sync module instance, tier type = 2024-09-12T17:24:35.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.858+0000 7f35a7d75800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:35.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.876+0000 7f35a7d75800 20 add_watcher() i=0 2024-09-12T17:24:35.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.876+0000 7f35a7d75800 20 add_watcher() i=1 2024-09-12T17:24:35.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.876+0000 7f35a7d75800 20 add_watcher() i=2 2024-09-12T17:24:35.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.876+0000 7f35a7d75800 20 add_watcher() i=3 2024-09-12T17:24:35.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.876+0000 7f35a7d75800 20 add_watcher() i=4 2024-09-12T17:24:35.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.876+0000 7f35a7d75800 20 add_watcher() i=5 2024-09-12T17:24:35.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.876+0000 7f35a7d75800 20 add_watcher() i=6 2024-09-12T17:24:35.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.877+0000 7f35a7d75800 20 add_watcher() i=7 2024-09-12T17:24:35.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.877+0000 7f35a7d75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:35.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.881+0000 7f34577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.881+0000 7f35a7d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:35.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.881+0000 7f35a7d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:35.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.881+0000 7f35a7d75800 5 note: GC not initialized 2024-09-12T17:24:35.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.882+0000 7f34567fc640 20 reqs_thread_entry: start 2024-09-12T17:24:35.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.882+0000 7f35a7d75800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:35.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.882+0000 7f35a7d75800 20 Filter name: none 2024-09-12T17:24:35.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.882+0000 7f33c7fff640 20 reqs_thread_entry: start 2024-09-12T17:24:35.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.882+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.883+0000 7f35a7d75800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:35.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.883+0000 7f35a7d75800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.883+0000 7f35a7d75800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:35.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.883+0000 7f35a7d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:35.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.883+0000 7f35a7d75800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:35.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.883+0000 7f35a7d75800 20 INFO: main: starting shard=0 2024-09-12T17:24:35.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.883+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:35.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.884+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.884+0000 7f35a7d75800 20 INFO: main: starting shard=1 2024-09-12T17:24:35.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.884+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:35.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.884+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.884+0000 7f35a7d75800 20 INFO: main: starting shard=2 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.884+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.885+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.885+0000 7f35a7d75800 20 INFO: main: starting shard=3 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.885+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.885+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.885+0000 7f35a7d75800 20 INFO: main: starting shard=4 2024-09-12T17:24:35.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.885+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:35.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.886+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.886+0000 7f35a7d75800 20 INFO: main: starting shard=5 2024-09-12T17:24:35.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.886+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:35.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.886+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:24:35.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.886+0000 7f35a7d75800 20 INFO: main: starting shard=6 2024-09-12T17:24:35.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.886+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:35.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.887+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.887+0000 7f35a7d75800 20 INFO: main: starting shard=7 2024-09-12T17:24:35.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.887+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:35.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.887+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.887+0000 7f35a7d75800 20 INFO: main: starting shard=8 2024-09-12T17:24:35.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.887+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:35.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.888+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.888+0000 7f35a7d75800 20 INFO: main: starting shard=9 2024-09-12T17:24:35.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.888+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:35.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.888+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.888+0000 7f35a7d75800 20 INFO: main: starting shard=10 2024-09-12T17:24:35.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.888+0000 7f35a7d75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:35.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.889+0000 7f35a7d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:35.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.889+0000 7f35a7d75800 20 INFO: main: done 2024-09-12T17:24:35.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.890+0000 7f34577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.892+0000 7f35a7d75800 20 remove_watcher() i=0 2024-09-12T17:24:35.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.892+0000 7f35a7d75800 2 removed watcher, disabling cache 2024-09-12T17:24:35.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.894+0000 7f35a7d75800 20 remove_watcher() i=1 2024-09-12T17:24:35.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.895+0000 7f35a7d75800 20 remove_watcher() i=2 2024-09-12T17:24:35.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.896+0000 7f35a7d75800 20 remove_watcher() i=3 2024-09-12T17:24:35.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.899+0000 7f35a7d75800 20 remove_watcher() i=4 2024-09-12T17:24:35.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.901+0000 7f35a7d75800 20 remove_watcher() i=5 2024-09-12T17:24:35.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.902+0000 7f35a7d75800 20 remove_watcher() i=6 2024-09-12T17:24:35.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.903+0000 7f35a7d75800 20 remove_watcher() i=7 2024-09-12T17:24:35.915 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:24:35.915 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:35.916 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:24:35.947 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:35.948 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:35.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.987+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 20 realm 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.989+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.990+0000 7fdb4a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.990+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.990+0000 7fdb4a60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:35.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.990+0000 7fdb4a60e800 20 searching for the correct realm 2024-09-12T17:24:35.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:35.993+0000 7fdb45458640 0 -- 172.21.15.63:0/1344391731 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fdb3c02d420 msgr2=0x7fdb3c02d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:36.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.199+0000 7fdb45458640 0 -- 172.21.15.63:0/1344391731 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55596a8bfe80 msgr2=0x55596a8c2320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:36.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:36.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:36.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:36.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:36.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:36.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:36.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.203+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 zone default found 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 4 Realm: () 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:36.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 zonegroup default 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.204+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.205+0000 7fdb4a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.205+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.205+0000 7fdb4a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.205+0000 7fdb4a60e800 20 started sync module instance, tier type = 2024-09-12T17:24:36.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.205+0000 7fdb4a60e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:36.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.220+0000 7fdb4a60e800 20 add_watcher() i=0 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.220+0000 7fdb4a60e800 20 add_watcher() i=1 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.220+0000 7fdb4a60e800 20 add_watcher() i=2 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.220+0000 7fdb4a60e800 20 add_watcher() i=3 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.220+0000 7fdb4a60e800 20 add_watcher() i=4 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.220+0000 7fdb4a60e800 20 add_watcher() i=5 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.220+0000 7fdb4a60e800 20 add_watcher() i=6 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.221+0000 7fdb4a60e800 20 add_watcher() i=7 2024-09-12T17:24:36.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.221+0000 7fdb4a60e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:36.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.223+0000 7fd9fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:36.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.223+0000 7fdb4a60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:36.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.223+0000 7fdb4a60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:36.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.224+0000 7fdb4a60e800 5 note: GC not initialized 2024-09-12T17:24:36.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.224+0000 7fd9fafe5640 20 reqs_thread_entry: start 2024-09-12T17:24:36.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.224+0000 7fdb4a60e800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:36.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.224+0000 7fdb4a60e800 20 Filter name: none 2024-09-12T17:24:36.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.224+0000 7fd9f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:36.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.224+0000 7fdb4a60e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:36.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.224+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:36.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.225+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.226+0000 7fdb4a60e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.226+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.226+0000 7fdb4a60e800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:24:36.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.226+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.227+0000 7fdb4a60e800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.227+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.227+0000 7fdb4a60e800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.227+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.227+0000 7fdb4a60e800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.227+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.228+0000 7fdb4a60e800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:24:36.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.228+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:36.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.228+0000 7fdb4a60e800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:24:36.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.228+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:36.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.229+0000 7fdb4a60e800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:24:36.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.229+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:36.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.229+0000 7fdb4a60e800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:24:36.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.229+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:36.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.230+0000 7fdb4a60e800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:24:36.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.230+0000 7fdb4a60e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:36.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.230+0000 7fdb4a60e800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:24:36.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.230+0000 7fdb4a60e800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:24:36.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.231+0000 7fd9fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:36.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.233+0000 7fdb4a60e800 20 remove_watcher() i=0 2024-09-12T17:24:36.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.233+0000 7fdb4a60e800 2 removed watcher, disabling cache 2024-09-12T17:24:36.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.235+0000 7fdb4a60e800 20 remove_watcher() i=1 2024-09-12T17:24:36.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.236+0000 7fdb4a60e800 20 remove_watcher() i=2 2024-09-12T17:24:36.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.238+0000 7fdb4a60e800 20 remove_watcher() i=3 2024-09-12T17:24:36.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.240+0000 7fdb4a60e800 20 remove_watcher() i=4 2024-09-12T17:24:36.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.241+0000 7fdb4a60e800 20 remove_watcher() i=5 2024-09-12T17:24:36.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.242+0000 7fdb4a60e800 20 remove_watcher() i=6 2024-09-12T17:24:36.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.243+0000 7fdb4a60e800 20 remove_watcher() i=7 2024-09-12T17:24:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:24:36.255 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:36.257 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:24:36.291 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:36.291 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:36.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.329+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 20 realm 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.331+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.332+0000 7f97aa53a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:36.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.332+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.332+0000 7f97aa53a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:36.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.332+0000 7f97aa53a800 20 searching for the correct realm 2024-09-12T17:24:36.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.335+0000 7f97a5a80640 0 -- 172.21.15.63:0/3810318929 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f979c06ab60 msgr2=0x7f979c0919b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:36.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.541+0000 7f97a6a82640 0 -- 172.21.15.63:0/3810318929 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x558f0bf135f0 msgr2=0x558f0bf15a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:36.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.546+0000 7f97aa53a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:36.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.546+0000 7f97aa53a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:36.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.546+0000 7f97aa53a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:36.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.546+0000 7f97aa53a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:36.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.546+0000 7f97aa53a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:36.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.546+0000 7f97aa53a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:36.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.546+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:36.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 zone default found 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 4 Realm: () 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 zonegroup default 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.547+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.548+0000 7f97aa53a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.548+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.548+0000 7f97aa53a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.548+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.548+0000 7f97aa53a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.548+0000 7f97aa53a800 20 started sync module instance, tier type = 2024-09-12T17:24:36.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.548+0000 7f97aa53a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:36.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.559+0000 7f97aa53a800 20 add_watcher() i=0 2024-09-12T17:24:36.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.559+0000 7f97aa53a800 20 add_watcher() i=1 2024-09-12T17:24:36.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.559+0000 7f97aa53a800 20 add_watcher() i=2 2024-09-12T17:24:36.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.559+0000 7f97aa53a800 20 add_watcher() i=3 2024-09-12T17:24:36.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.559+0000 7f97aa53a800 20 add_watcher() i=4 2024-09-12T17:24:36.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.559+0000 7f97aa53a800 20 add_watcher() i=5 2024-09-12T17:24:36.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.559+0000 7f97aa53a800 20 add_watcher() i=6 2024-09-12T17:24:36.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.560+0000 7f97aa53a800 20 add_watcher() i=7 2024-09-12T17:24:36.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.560+0000 7f97aa53a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:36.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.562+0000 7f965cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.562+0000 7f97aa53a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.562+0000 7f97aa53a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.562+0000 7f97aa53a800 5 note: GC not initialized 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f95d77fe640 20 reqs_thread_entry: start 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 20 Filter name: none 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f95d57fa640 20 reqs_thread_entry: start 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:36.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.563+0000 7f97aa53a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.564+0000 7f97aa53a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:36.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.564+0000 7f97aa53a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:36.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.564+0000 7f97aa53a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:36.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.564+0000 7f97aa53a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:36.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.564+0000 7f97aa53a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:36.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.564+0000 7f97aa53a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:36.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.564+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:36.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.565+0000 7f97aa53a800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:24:36.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.565+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.566+0000 7f97aa53a800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.566+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.566+0000 7f97aa53a800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.566+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.566+0000 7f97aa53a800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.566+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.567+0000 7f97aa53a800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:24:36.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.567+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:36.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.567+0000 7f97aa53a800 20 get_obj_state: octx=0x558f0bc9ec50 obj=check-bucket:d state=0x558f0bf50e18 s->prefetch_data=0 2024-09-12T17:24:36.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.567+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:36.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.568+0000 7f97aa53a800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:24:36.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.568+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:36.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.568+0000 7f97aa53a800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:24:36.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.568+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:36.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.569+0000 7f97aa53a800 20 get_obj_state: octx=0x558f0bcb1770 obj=check-bucket:c state=0x558f0bf4eee8 s->prefetch_data=0 2024-09-12T17:24:36.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.569+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:36.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.569+0000 7f97aa53a800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:24:36.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.569+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:36.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 get_obj_state: setting s->obj_tag to ks90ux8ypq0yha5npollhi1tu2usy25a 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 get_obj_state_impl: setting s->olh_tag to nu0l5tnj40me821wpl2jbslfxow9qex4 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 get_obj_state: setting s->obj_tag to 0484wxuzmjmlkmlielj1i8ui94oz6ynr 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 get_obj_state_impl: setting s->olh_tag to uibuqauqbi7mr0j1ltgjx01gm5rpxvsc 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 olh_log_entry: epoch=4 op=3 key=d[3Fwax45GaltNzxUvUlODoSFmjsy5td.] 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 get_obj_state: octx=0x558f0bf88ab0 obj=check-bucket:_:3Fwax45GaltNzxUvUlODoSFmjsy5td._d state=0x558f0bf4b328 s->prefetch_data=0 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 olh_log_entry: epoch=4 op=3 key=c[mgs6TBKjG4KGKM6zW9.cYz1QjdupUk3] 2024-09-12T17:24:36.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.570+0000 7f97aa53a800 20 get_obj_state: octx=0x558f0bfa8ab0 obj=check-bucket:_:mgs6TBKjG4KGKM6zW9.cYz1QjdupUk3_c state=0x558f0bfb5558 s->prefetch_data=0 2024-09-12T17:24:36.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.572+0000 7f97aa53a800 20 get_obj_state: octx=0x558f0bfa8ab0 obj=check-bucket:c state=0x558f0bfa9498 s->prefetch_data=0 2024-09-12T17:24:36.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.572+0000 7f97aa53a800 20 get_obj_state: octx=0x558f0bf88ab0 obj=check-bucket:d state=0x558f0bf4cc58 s->prefetch_data=0 2024-09-12T17:24:36.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.573+0000 7f97aa53a800 20 get_obj_state: setting s->obj_tag to 0484wxuzmjmlkmlielj1i8ui94oz6ynr 2024-09-12T17:24:36.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.573+0000 7f97aa53a800 20 get_obj_state_impl: setting s->olh_tag to uibuqauqbi7mr0j1ltgjx01gm5rpxvsc 2024-09-12T17:24:36.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.573+0000 7f97aa53a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uibuqauqbi7mr0j1ltgjx01gm5rpxvsc 2024-09-12T17:24:36.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.573+0000 7f97aa53a800 20 get_obj_state: setting s->obj_tag to ks90ux8ypq0yha5npollhi1tu2usy25a 2024-09-12T17:24:36.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.573+0000 7f97aa53a800 20 get_obj_state_impl: setting s->olh_tag to nu0l5tnj40me821wpl2jbslfxow9qex4 2024-09-12T17:24:36.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.573+0000 7f97aa53a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nu0l5tnj40me821wpl2jbslfxow9qex4 2024-09-12T17:24:36.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.586+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:36.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.587+0000 7f97aa53a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:36.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.589+0000 7f97aa53a800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:24:36.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.589+0000 7f97aa53a800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:24:36.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.589+0000 7f97aa53a800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:24:36.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.590+0000 7f965cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:36.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.593+0000 7f97aa53a800 20 remove_watcher() i=0 2024-09-12T17:24:36.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.593+0000 7f97aa53a800 2 removed watcher, disabling cache 2024-09-12T17:24:36.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.594+0000 7f97aa53a800 20 remove_watcher() i=1 2024-09-12T17:24:36.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.595+0000 7f97aa53a800 20 remove_watcher() i=2 2024-09-12T17:24:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.597+0000 7f97aa53a800 20 remove_watcher() i=3 2024-09-12T17:24:36.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.598+0000 7f97aa53a800 20 remove_watcher() i=4 2024-09-12T17:24:36.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.599+0000 7f97aa53a800 20 remove_watcher() i=5 2024-09-12T17:24:36.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.601+0000 7f97aa53a800 20 remove_watcher() i=6 2024-09-12T17:24:36.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.602+0000 7f97aa53a800 20 remove_watcher() i=7 2024-09-12T17:24:36.615 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:24:36.647 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:36.647 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:36.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.684+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 20 realm 2024-09-12T17:24:36.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:36.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.686+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.687+0000 7fc3e520e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:36.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.687+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.687+0000 7fc3e520e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:36.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.687+0000 7fc3e520e800 20 searching for the correct realm 2024-09-12T17:24:36.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.691+0000 7fc3e0179640 0 -- 172.21.15.63:0/424916166 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fc3c80453f0 msgr2=0x7fc3c8045850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:36.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.896+0000 7fc3e117b640 0 -- 172.21.15.63:0/424916166 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55a00e358220 msgr2=0x55a00e35a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.900+0000 7fc3e520e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.900+0000 7fc3e520e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.900+0000 7fc3e520e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.900+0000 7fc3e520e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.900+0000 7fc3e520e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.900+0000 7fc3e520e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.900+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:36.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 zone default found 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 4 Realm: () 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 zonegroup default 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.901+0000 7fc3e520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.902+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.902+0000 7fc3e520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.902+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.902+0000 7fc3e520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.902+0000 7fc3e520e800 20 started sync module instance, tier type = 2024-09-12T17:24:36.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.902+0000 7fc3e520e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:36.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.911+0000 7fc3e520e800 20 add_watcher() i=0 2024-09-12T17:24:36.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.911+0000 7fc3e520e800 20 add_watcher() i=1 2024-09-12T17:24:36.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.911+0000 7fc3e520e800 20 add_watcher() i=2 2024-09-12T17:24:36.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.911+0000 7fc3e520e800 20 add_watcher() i=3 2024-09-12T17:24:36.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.911+0000 7fc3e520e800 20 add_watcher() i=4 2024-09-12T17:24:36.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.911+0000 7fc3e520e800 20 add_watcher() i=5 2024-09-12T17:24:36.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.911+0000 7fc3e520e800 20 add_watcher() i=6 2024-09-12T17:24:36.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.913+0000 7fc3e520e800 20 add_watcher() i=7 2024-09-12T17:24:36.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.913+0000 7fc3e520e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:36.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc296fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc3e520e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc3e520e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc3e520e800 5 note: GC not initialized 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc295fe3640 20 reqs_thread_entry: start 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc3e520e800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc3e520e800 20 Filter name: none 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc2077fe640 20 reqs_thread_entry: start 2024-09-12T17:24:36.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.915+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.916+0000 7fc3e520e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:36.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.916+0000 7fc3e520e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.916+0000 7fc3e520e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:36.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.916+0000 7fc3e520e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:36.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.916+0000 7fc3e520e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.916+0000 7fc3e520e800 20 INFO: main: starting shard=0 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.916+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.917+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.917+0000 7fc3e520e800 20 INFO: main: starting shard=1 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.917+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.917+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.917+0000 7fc3e520e800 20 INFO: main: starting shard=2 2024-09-12T17:24:36.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.917+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.918+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.918+0000 7fc3e520e800 20 INFO: main: starting shard=3 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.918+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.918+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.918+0000 7fc3e520e800 20 INFO: main: starting shard=4 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.918+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.919+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.919+0000 7fc3e520e800 20 INFO: main: starting shard=5 2024-09-12T17:24:36.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.919+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:36.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.920+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.920+0000 7fc3e520e800 20 INFO: main: starting shard=6 2024-09-12T17:24:36.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.920+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:36.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.920+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.920+0000 7fc3e520e800 20 INFO: main: starting shard=7 2024-09-12T17:24:36.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.920+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:36.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.921+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.921+0000 7fc3e520e800 20 INFO: main: starting shard=8 2024-09-12T17:24:36.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.921+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:36.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.921+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.921+0000 7fc3e520e800 20 INFO: main: starting shard=9 2024-09-12T17:24:36.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.921+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:36.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.922+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.922+0000 7fc3e520e800 20 INFO: main: starting shard=10 2024-09-12T17:24:36.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.922+0000 7fc3e520e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:36.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.923+0000 7fc3e520e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:36.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.923+0000 7fc3e520e800 20 INFO: main: done 2024-09-12T17:24:36.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.924+0000 7fc296fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:36.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.926+0000 7fc3e520e800 20 remove_watcher() i=0 2024-09-12T17:24:36.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.926+0000 7fc3e520e800 2 removed watcher, disabling cache 2024-09-12T17:24:36.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.927+0000 7fc3e520e800 20 remove_watcher() i=1 2024-09-12T17:24:36.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.928+0000 7fc3e520e800 20 remove_watcher() i=2 2024-09-12T17:24:36.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.929+0000 7fc3e520e800 20 remove_watcher() i=3 2024-09-12T17:24:36.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.930+0000 7fc3e520e800 20 remove_watcher() i=4 2024-09-12T17:24:36.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.931+0000 7fc3e520e800 20 remove_watcher() i=5 2024-09-12T17:24:36.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.932+0000 7fc3e520e800 20 remove_watcher() i=6 2024-09-12T17:24:36.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:36.934+0000 7fc3e520e800 20 remove_watcher() i=7 2024-09-12T17:24:36.947 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:24:36.978 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:36.978 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:37.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.017+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.018+0000 7f0b4733a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.018+0000 7f0b4733a800 20 realm 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.018+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.018+0000 7f0b4733a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.018+0000 7f0b4733a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.018+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.019+0000 7f0b4733a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.019+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.019+0000 7f0b4733a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.019+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.020+0000 7f0b4733a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.020+0000 7f0b4733a800 20 searching for the correct realm 2024-09-12T17:24:37.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.023+0000 7f0b42880640 0 -- 172.21.15.63:0/1555992060 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f0b38083ad0 msgr2=0x7f0b3807b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.228+0000 7f0b42880640 0 -- 172.21.15.63:0/1555992060 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e17756edd0 msgr2=0x55e1775711c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:37.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.232+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 zone default found 2024-09-12T17:24:37.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 4 Realm: () 2024-09-12T17:24:37.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:37.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 zonegroup default 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.233+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.234+0000 7f0b4733a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.234+0000 7f0b4733a800 20 started sync module instance, tier type = 2024-09-12T17:24:37.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.234+0000 7f0b4733a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:37.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.246+0000 7f0b4733a800 20 add_watcher() i=0 2024-09-12T17:24:37.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.246+0000 7f0b4733a800 20 add_watcher() i=1 2024-09-12T17:24:37.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.246+0000 7f0b4733a800 20 add_watcher() i=2 2024-09-12T17:24:37.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.246+0000 7f0b4733a800 20 add_watcher() i=3 2024-09-12T17:24:37.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.246+0000 7f0b4733a800 20 add_watcher() i=4 2024-09-12T17:24:37.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.246+0000 7f0b4733a800 20 add_watcher() i=5 2024-09-12T17:24:37.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.246+0000 7f0b4733a800 20 add_watcher() i=6 2024-09-12T17:24:37.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.247+0000 7f0b4733a800 20 add_watcher() i=7 2024-09-12T17:24:37.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.247+0000 7f0b4733a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.249+0000 7f09f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f0b4733a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f0b4733a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f0b4733a800 5 note: GC not initialized 2024-09-12T17:24:37.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f09f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:37.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f0b4733a800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:37.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f0b4733a800 20 Filter name: none 2024-09-12T17:24:37.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f09727fc640 20 reqs_thread_entry: start 2024-09-12T17:24:37.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.250+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.251+0000 7f0b4733a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:37.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.251+0000 7f0b4733a800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.251+0000 7f0b4733a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:37.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.251+0000 7f0b4733a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:37.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.251+0000 7f0b4733a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:37.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.251+0000 7f0b4733a800 20 INFO: main: starting shard=0 2024-09-12T17:24:37.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.251+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.252+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.252+0000 7f0b4733a800 20 INFO: main: starting shard=1 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.252+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.253+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.253+0000 7f0b4733a800 20 INFO: main: starting shard=2 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.253+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.253+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.253+0000 7f0b4733a800 20 INFO: main: starting shard=3 2024-09-12T17:24:37.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.253+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:37.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.254+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.254+0000 7f0b4733a800 20 INFO: main: starting shard=4 2024-09-12T17:24:37.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.254+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:37.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.254+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.254+0000 7f0b4733a800 20 INFO: main: starting shard=5 2024-09-12T17:24:37.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.254+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:37.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.255+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.255+0000 7f0b4733a800 20 INFO: main: starting shard=6 2024-09-12T17:24:37.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.255+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:37.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.255+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.255+0000 7f0b4733a800 20 INFO: main: starting shard=7 2024-09-12T17:24:37.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.255+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:37.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.256+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.256+0000 7f0b4733a800 20 INFO: main: starting shard=8 2024-09-12T17:24:37.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.256+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:37.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.257+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.257+0000 7f0b4733a800 20 INFO: main: starting shard=9 2024-09-12T17:24:37.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.257+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:37.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.257+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.257+0000 7f0b4733a800 20 INFO: main: starting shard=10 2024-09-12T17:24:37.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.257+0000 7f0b4733a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:37.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.258+0000 7f0b4733a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.258+0000 7f0b4733a800 20 INFO: main: done 2024-09-12T17:24:37.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.259+0000 7f09f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.261+0000 7f0b4733a800 20 remove_watcher() i=0 2024-09-12T17:24:37.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.261+0000 7f0b4733a800 2 removed watcher, disabling cache 2024-09-12T17:24:37.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.262+0000 7f0b4733a800 20 remove_watcher() i=1 2024-09-12T17:24:37.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.263+0000 7f0b4733a800 20 remove_watcher() i=2 2024-09-12T17:24:37.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.264+0000 7f0b4733a800 20 remove_watcher() i=3 2024-09-12T17:24:37.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.265+0000 7f0b4733a800 20 remove_watcher() i=4 2024-09-12T17:24:37.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.266+0000 7f0b4733a800 20 remove_watcher() i=5 2024-09-12T17:24:37.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.268+0000 7f0b4733a800 20 remove_watcher() i=6 2024-09-12T17:24:37.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.270+0000 7f0b4733a800 20 remove_watcher() i=7 2024-09-12T17:24:37.282 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:24:37.282 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:37.284 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:24:37.315 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:37.315 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:37.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.354+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 20 realm 2024-09-12T17:24:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.356+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.357+0000 7faa1a32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.357+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.357+0000 7faa1a32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.357+0000 7faa1a32c800 20 searching for the correct realm 2024-09-12T17:24:37.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.360+0000 7faa1584e640 0 -- 172.21.15.63:0/1054535640 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7faa0c02c3f0 msgr2=0x7faa0c02c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.565+0000 7faa16850640 0 -- 172.21.15.63:0/1054535640 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55949daaabe0 msgr2=0x55949daad0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.569+0000 7faa1a32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.569+0000 7faa1a32c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.569+0000 7faa1a32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.569+0000 7faa1a32c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.569+0000 7faa1a32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.569+0000 7faa1a32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.569+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 zone default found 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 4 Realm: () 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 zonegroup default 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.570+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.571+0000 7faa1a32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.571+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.571+0000 7faa1a32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.571+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.571+0000 7faa1a32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.571+0000 7faa1a32c800 20 started sync module instance, tier type = 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.571+0000 7faa1a32c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.589+0000 7faa1a32c800 20 add_watcher() i=0 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.589+0000 7faa1a32c800 20 add_watcher() i=1 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.589+0000 7faa1a32c800 20 add_watcher() i=2 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.589+0000 7faa1a32c800 20 add_watcher() i=3 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.589+0000 7faa1a32c800 20 add_watcher() i=4 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.589+0000 7faa1a32c800 20 add_watcher() i=5 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.589+0000 7faa1a32c800 20 add_watcher() i=6 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.594+0000 7faa1a32c800 20 add_watcher() i=7 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.594+0000 7faa1a32c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.596+0000 7fa8ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7faa1a32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7faa1a32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7faa1a32c800 5 note: GC not initialized 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7fa8477fe640 20 reqs_thread_entry: start 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7faa1a32c800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7faa1a32c800 20 Filter name: none 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7fa8457fa640 20 reqs_thread_entry: start 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7faa1a32c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.597+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.598+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.599+0000 7faa1a32c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.599+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.599+0000 7faa1a32c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.599+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.600+0000 7faa1a32c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.600+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.600+0000 7faa1a32c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.600+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.601+0000 7faa1a32c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.601+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.601+0000 7faa1a32c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.601+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.602+0000 7faa1a32c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.602+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.602+0000 7faa1a32c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.602+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.602+0000 7faa1a32c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.602+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.603+0000 7faa1a32c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.603+0000 7faa1a32c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.604+0000 7faa1a32c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.604+0000 7faa1a32c800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.605+0000 7fa8ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.607+0000 7faa1a32c800 20 remove_watcher() i=0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.607+0000 7faa1a32c800 2 removed watcher, disabling cache 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.609+0000 7faa1a32c800 20 remove_watcher() i=1 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.610+0000 7faa1a32c800 20 remove_watcher() i=2 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.612+0000 7faa1a32c800 20 remove_watcher() i=3 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.617+0000 7faa1a32c800 20 remove_watcher() i=4 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.619+0000 7faa1a32c800 20 remove_watcher() i=5 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.620+0000 7faa1a32c800 20 remove_watcher() i=6 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:37.623+0000 7faa1a32c800 20 remove_watcher() i=7 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:37.688 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:24:37.688 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:24:37.939 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:24:38.357 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:24:39.827 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:39.829 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:24:39.864 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:39.864 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:40.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.103+0000 7f707176b640 0 --2- 172.21.15.63:0/4168939098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dcb9ab6bb0 0x55dcb9ab0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:24:40.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.108+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 20 realm 2024-09-12T17:24:40.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:40.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.110+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.111+0000 7f7075b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.111+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.111+0000 7f7075b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:40.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.112+0000 7f7075b2e800 20 searching for the correct realm 2024-09-12T17:24:40.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.114+0000 7f7071f6c640 0 -- 172.21.15.63:0/2338492101 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55dcb9ad0750 msgr2=0x55dcb9ad2b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:40.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.117+0000 7f7071f6c640 0 -- 172.21.15.63:0/2338492101 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x7f706c049150 msgr2=0x7f706c07b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.326+0000 7f7075b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.326+0000 7f7075b2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.326+0000 7f7075b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.326+0000 7f7075b2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.326+0000 7f7075b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.326+0000 7f7075b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.326+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 zone default found 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 4 Realm: () 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 zonegroup default 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.327+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.328+0000 7f7075b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.328+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.328+0000 7f7075b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.328+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.329+0000 7f7075b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.329+0000 7f7075b2e800 20 started sync module instance, tier type = 2024-09-12T17:24:40.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.329+0000 7f7075b2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:40.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.348+0000 7f7075b2e800 20 add_watcher() i=0 2024-09-12T17:24:40.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.348+0000 7f7075b2e800 20 add_watcher() i=1 2024-09-12T17:24:40.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.348+0000 7f7075b2e800 20 add_watcher() i=2 2024-09-12T17:24:40.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.348+0000 7f7075b2e800 20 add_watcher() i=3 2024-09-12T17:24:40.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.348+0000 7f7075b2e800 20 add_watcher() i=4 2024-09-12T17:24:40.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.348+0000 7f7075b2e800 20 add_watcher() i=5 2024-09-12T17:24:40.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.348+0000 7f7075b2e800 20 add_watcher() i=6 2024-09-12T17:24:40.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.351+0000 7f7075b2e800 20 add_watcher() i=7 2024-09-12T17:24:40.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.351+0000 7f7075b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:40.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.353+0000 7f6f27fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.353+0000 7f7075b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:40.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.353+0000 7f7075b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:40.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.353+0000 7f7075b2e800 5 note: GC not initialized 2024-09-12T17:24:40.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.354+0000 7f6f26fe5640 20 reqs_thread_entry: start 2024-09-12T17:24:40.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.354+0000 7f7075b2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:40.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.354+0000 7f7075b2e800 20 Filter name: none 2024-09-12T17:24:40.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.354+0000 7f6f24fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:40.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.354+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.355+0000 7f7075b2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:40.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.355+0000 7f7075b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.355+0000 7f7075b2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:40.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.355+0000 7f7075b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:40.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.355+0000 7f7075b2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:40.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.355+0000 7f7075b2e800 20 INFO: main: starting shard=0 2024-09-12T17:24:40.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.355+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.356+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.356+0000 7f7075b2e800 20 INFO: main: starting shard=1 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.356+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.356+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.356+0000 7f7075b2e800 20 INFO: main: starting shard=2 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.356+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.357+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.357+0000 7f7075b2e800 20 INFO: main: starting shard=3 2024-09-12T17:24:40.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.357+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:40.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.357+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.357+0000 7f7075b2e800 20 INFO: main: starting shard=4 2024-09-12T17:24:40.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.357+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:40.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.358+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.358+0000 7f7075b2e800 20 INFO: main: starting shard=5 2024-09-12T17:24:40.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.358+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:40.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.358+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.358+0000 7f7075b2e800 20 INFO: main: starting shard=6 2024-09-12T17:24:40.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.358+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:40.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.359+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.359+0000 7f7075b2e800 20 INFO: main: starting shard=7 2024-09-12T17:24:40.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.359+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:40.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.360+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.360+0000 7f7075b2e800 20 INFO: main: starting shard=8 2024-09-12T17:24:40.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.360+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:40.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.360+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:24:40.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.361+0000 7f7075b2e800 20 INFO: main: starting shard=9 2024-09-12T17:24:40.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.361+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:40.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.361+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.361+0000 7f7075b2e800 20 INFO: main: starting shard=10 2024-09-12T17:24:40.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.361+0000 7f7075b2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:40.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.362+0000 7f7075b2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.362+0000 7f7075b2e800 20 INFO: main: done 2024-09-12T17:24:40.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.363+0000 7f6f27fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.366+0000 7f7075b2e800 20 remove_watcher() i=0 2024-09-12T17:24:40.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.366+0000 7f7075b2e800 2 removed watcher, disabling cache 2024-09-12T17:24:40.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.367+0000 7f7075b2e800 20 remove_watcher() i=1 2024-09-12T17:24:40.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.368+0000 7f7075b2e800 20 remove_watcher() i=2 2024-09-12T17:24:40.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.369+0000 7f7075b2e800 20 remove_watcher() i=3 2024-09-12T17:24:40.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.371+0000 7f7075b2e800 20 remove_watcher() i=4 2024-09-12T17:24:40.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.372+0000 7f7075b2e800 20 remove_watcher() i=5 2024-09-12T17:24:40.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.376+0000 7f7075b2e800 20 remove_watcher() i=6 2024-09-12T17:24:40.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.377+0000 7f7075b2e800 20 remove_watcher() i=7 2024-09-12T17:24:40.457 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:40.459 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:24:40.492 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:40.493 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:40.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.533+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 20 realm 2024-09-12T17:24:40.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:40.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.535+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.536+0000 7fa9deb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.536+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.536+0000 7fa9deb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:40.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.536+0000 7fa9deb2e800 20 searching for the correct realm 2024-09-12T17:24:40.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.540+0000 7fa9da0dc640 0 -- 172.21.15.63:0/537175931 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa9d001ebd0 msgr2=0x7fa9d0040400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:40.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.746+0000 7fa9db0de640 0 -- 172.21.15.63:0/537175931 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x564d0fc8b210 msgr2=0x564d0fc8d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:40.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.750+0000 7fa9deb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:40.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.750+0000 7fa9deb2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:40.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.750+0000 7fa9deb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:40.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.750+0000 7fa9deb2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:40.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.750+0000 7fa9deb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:40.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.750+0000 7fa9deb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:40.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.750+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.751+0000 7fa9deb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.751+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.751+0000 7fa9deb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.751+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 zone default found 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 4 Realm: () 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 zonegroup default 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.752+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.753+0000 7fa9deb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.753+0000 7fa9deb2e800 20 started sync module instance, tier type = 2024-09-12T17:24:40.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.753+0000 7fa9deb2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:40.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.763+0000 7fa9deb2e800 20 add_watcher() i=0 2024-09-12T17:24:40.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.763+0000 7fa9deb2e800 20 add_watcher() i=1 2024-09-12T17:24:40.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.763+0000 7fa9deb2e800 20 add_watcher() i=2 2024-09-12T17:24:40.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.763+0000 7fa9deb2e800 20 add_watcher() i=3 2024-09-12T17:24:40.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.763+0000 7fa9deb2e800 20 add_watcher() i=4 2024-09-12T17:24:40.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.763+0000 7fa9deb2e800 20 add_watcher() i=5 2024-09-12T17:24:40.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.763+0000 7fa9deb2e800 20 add_watcher() i=6 2024-09-12T17:24:40.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.764+0000 7fa9deb2e800 20 add_watcher() i=7 2024-09-12T17:24:40.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.764+0000 7fa9deb2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:40.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.766+0000 7fa8917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.766+0000 7fa9deb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:40.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.766+0000 7fa9deb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:40.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.766+0000 7fa9deb2e800 5 note: GC not initialized 2024-09-12T17:24:40.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.767+0000 7fa80bfff640 20 reqs_thread_entry: start 2024-09-12T17:24:40.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.767+0000 7fa9deb2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:40.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.767+0000 7fa9deb2e800 20 Filter name: none 2024-09-12T17:24:40.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.767+0000 7fa809ffb640 20 reqs_thread_entry: start 2024-09-12T17:24:40.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.767+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.767+0000 7fa9deb2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:40.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.767+0000 7fa9deb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.768+0000 7fa9deb2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.768+0000 7fa9deb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.768+0000 7fa9deb2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.768+0000 7fa9deb2e800 20 INFO: main: starting shard=0 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.768+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.769+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.769+0000 7fa9deb2e800 20 INFO: main: starting shard=1 2024-09-12T17:24:40.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.769+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:40.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.769+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.769+0000 7fa9deb2e800 20 INFO: main: starting shard=2 2024-09-12T17:24:40.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.769+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:40.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.770+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.770+0000 7fa9deb2e800 20 INFO: main: starting shard=3 2024-09-12T17:24:40.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.770+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:40.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.770+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.770+0000 7fa9deb2e800 20 INFO: main: starting shard=4 2024-09-12T17:24:40.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.770+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:40.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.771+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.771+0000 7fa9deb2e800 20 INFO: main: starting shard=5 2024-09-12T17:24:40.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.771+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:40.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.771+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:24:40.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.771+0000 7fa9deb2e800 20 INFO: main: starting shard=6 2024-09-12T17:24:40.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.771+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:40.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.772+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.772+0000 7fa9deb2e800 20 INFO: main: starting shard=7 2024-09-12T17:24:40.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.772+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:40.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.772+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.772+0000 7fa9deb2e800 20 INFO: main: starting shard=8 2024-09-12T17:24:40.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.772+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:40.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.773+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.773+0000 7fa9deb2e800 20 INFO: main: starting shard=9 2024-09-12T17:24:40.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.773+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:40.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.774+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.774+0000 7fa9deb2e800 20 INFO: main: starting shard=10 2024-09-12T17:24:40.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.774+0000 7fa9deb2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:40.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.775+0000 7fa9deb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.775+0000 7fa9deb2e800 20 INFO: main: done 2024-09-12T17:24:40.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.776+0000 7fa8917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.778+0000 7fa9deb2e800 20 remove_watcher() i=0 2024-09-12T17:24:40.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.778+0000 7fa9deb2e800 2 removed watcher, disabling cache 2024-09-12T17:24:40.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.779+0000 7fa9deb2e800 20 remove_watcher() i=1 2024-09-12T17:24:40.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.780+0000 7fa9deb2e800 20 remove_watcher() i=2 2024-09-12T17:24:40.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.781+0000 7fa9deb2e800 20 remove_watcher() i=3 2024-09-12T17:24:40.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.783+0000 7fa9deb2e800 20 remove_watcher() i=4 2024-09-12T17:24:40.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.784+0000 7fa9deb2e800 20 remove_watcher() i=5 2024-09-12T17:24:40.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.785+0000 7fa9deb2e800 20 remove_watcher() i=6 2024-09-12T17:24:40.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.786+0000 7fa9deb2e800 20 remove_watcher() i=7 2024-09-12T17:24:40.863 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:40.864 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:24:40.896 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:40.896 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:40.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.934+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 20 realm 2024-09-12T17:24:40.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:40.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.936+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.937+0000 7f07c7335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.937+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.937+0000 7f07c7335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:40.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.937+0000 7f07c7335800 20 searching for the correct realm 2024-09-12T17:24:40.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.938+0000 7f07c387e640 0 -- 172.21.15.63:0/3666240916 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7f07ac0b3070 msgr2=0x7f07ac0c1b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:40.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.942+0000 7f07c387e640 0 -- 172.21.15.63:0/3666240916 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5558d8926bd0 msgr2=0x5558d8928fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:40.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:40.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:40.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:40.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:40.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:40.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:40.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.948+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:40.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 20 zone default found 2024-09-12T17:24:40.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 4 Realm: () 2024-09-12T17:24:40.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 20 zonegroup default 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.949+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.950+0000 7f07c7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.950+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.950+0000 7f07c7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.950+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.950+0000 7f07c7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.950+0000 7f07c7335800 20 started sync module instance, tier type = 2024-09-12T17:24:40.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.950+0000 7f07c7335800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:40.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.963+0000 7f07c7335800 20 add_watcher() i=0 2024-09-12T17:24:40.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.963+0000 7f07c7335800 20 add_watcher() i=1 2024-09-12T17:24:40.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.963+0000 7f07c7335800 20 add_watcher() i=2 2024-09-12T17:24:40.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.963+0000 7f07c7335800 20 add_watcher() i=3 2024-09-12T17:24:40.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.963+0000 7f07c7335800 20 add_watcher() i=4 2024-09-12T17:24:40.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.963+0000 7f07c7335800 20 add_watcher() i=5 2024-09-12T17:24:40.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.963+0000 7f07c7335800 20 add_watcher() i=6 2024-09-12T17:24:40.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.965+0000 7f07c7335800 20 add_watcher() i=7 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.965+0000 7f07c7335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.967+0000 7f0679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.967+0000 7f07c7335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.967+0000 7f07c7335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.967+0000 7f07c7335800 5 note: GC not initialized 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.967+0000 7f0678fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.967+0000 7f07c7335800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.967+0000 7f07c7335800 20 Filter name: none 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.968+0000 7f05f27fc640 20 reqs_thread_entry: start 2024-09-12T17:24:40.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.968+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.968+0000 7f07c7335800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:40.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.968+0000 7f07c7335800 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:40.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:40.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:40.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 INFO: main: starting shard=0 2024-09-12T17:24:40.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:40.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 INFO: main: starting shard=1 2024-09-12T17:24:40.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.969+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:40.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.970+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:40.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.970+0000 7f07c7335800 20 INFO: main: starting shard=2 2024-09-12T17:24:40.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.970+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:40.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.970+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.970+0000 7f07c7335800 20 INFO: main: starting shard=3 2024-09-12T17:24:40.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.970+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:40.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.971+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.971+0000 7f07c7335800 20 INFO: main: starting shard=4 2024-09-12T17:24:40.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.971+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.971+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.971+0000 7f07c7335800 20 INFO: main: starting shard=5 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.971+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.972+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.972+0000 7f07c7335800 20 INFO: main: starting shard=6 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.972+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.972+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.972+0000 7f07c7335800 20 INFO: main: starting shard=7 2024-09-12T17:24:40.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.972+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:40.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.973+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.973+0000 7f07c7335800 20 INFO: main: starting shard=8 2024-09-12T17:24:40.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.973+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:40.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.974+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.974+0000 7f07c7335800 20 INFO: main: starting shard=9 2024-09-12T17:24:40.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.974+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:40.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.974+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.974+0000 7f07c7335800 20 INFO: main: starting shard=10 2024-09-12T17:24:40.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.974+0000 7f07c7335800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:40.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.975+0000 7f07c7335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:40.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.975+0000 7f07c7335800 20 INFO: main: done 2024-09-12T17:24:40.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.976+0000 7f0679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.978+0000 7f07c7335800 20 remove_watcher() i=0 2024-09-12T17:24:40.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.978+0000 7f07c7335800 2 removed watcher, disabling cache 2024-09-12T17:24:40.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.979+0000 7f07c7335800 20 remove_watcher() i=1 2024-09-12T17:24:40.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.980+0000 7f07c7335800 20 remove_watcher() i=2 2024-09-12T17:24:40.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.981+0000 7f07c7335800 20 remove_watcher() i=3 2024-09-12T17:24:40.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.982+0000 7f07c7335800 20 remove_watcher() i=4 2024-09-12T17:24:40.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.983+0000 7f07c7335800 20 remove_watcher() i=5 2024-09-12T17:24:40.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.984+0000 7f07c7335800 20 remove_watcher() i=6 2024-09-12T17:24:40.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:40.985+0000 7f07c7335800 20 remove_watcher() i=7 2024-09-12T17:24:41.057 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:41.058 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:24:41.090 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:41.090 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:41.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.128+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:41.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 20 realm 2024-09-12T17:24:41.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:41.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:41.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:41.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.130+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.131+0000 7f88be6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:41.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.131+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.131+0000 7f88be6bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:41.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.131+0000 7f88be6bb800 20 searching for the correct realm 2024-09-12T17:24:41.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.134+0000 7f88bb9a4640 0 -- 172.21.15.63:0/728773888 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f88b00757c0 msgr2=0x7f88b00393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:41.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.340+0000 7f88bc9a6640 0 -- 172.21.15.63:0/728773888 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561f2188c970 msgr2=0x561f2188ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:41.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:41.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:41.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:41.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:41.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:41.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:41.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:41.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.344+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:41.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:41.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 zone default found 2024-09-12T17:24:41.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 4 Realm: () 2024-09-12T17:24:41.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:41.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 zonegroup default 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.345+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.346+0000 7f88be6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.346+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.346+0000 7f88be6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.346+0000 7f88be6bb800 20 started sync module instance, tier type = 2024-09-12T17:24:41.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.346+0000 7f88be6bb800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:41.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.355+0000 7f88be6bb800 20 add_watcher() i=0 2024-09-12T17:24:41.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.355+0000 7f88be6bb800 20 add_watcher() i=1 2024-09-12T17:24:41.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.355+0000 7f88be6bb800 20 add_watcher() i=2 2024-09-12T17:24:41.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.355+0000 7f88be6bb800 20 add_watcher() i=3 2024-09-12T17:24:41.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.355+0000 7f88be6bb800 20 add_watcher() i=4 2024-09-12T17:24:41.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.355+0000 7f88be6bb800 20 add_watcher() i=5 2024-09-12T17:24:41.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.355+0000 7f88be6bb800 20 add_watcher() i=6 2024-09-12T17:24:41.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.356+0000 7f88be6bb800 20 add_watcher() i=7 2024-09-12T17:24:41.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.356+0000 7f88be6bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:41.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.357+0000 7f87727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f88be6bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f88be6bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f88be6bb800 5 note: GC not initialized 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f87717e2640 20 reqs_thread_entry: start 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f88be6bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f88be6bb800 20 Filter name: none 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f86e2ffd640 20 reqs_thread_entry: start 2024-09-12T17:24:41.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.358+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.359+0000 7f88be6bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.359+0000 7f88be6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.359+0000 7f88be6bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.359+0000 7f88be6bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.359+0000 7f88be6bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.359+0000 7f88be6bb800 20 INFO: main: starting shard=0 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.359+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.360+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.360+0000 7f88be6bb800 20 INFO: main: starting shard=1 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.360+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.360+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.360+0000 7f88be6bb800 20 INFO: main: starting shard=2 2024-09-12T17:24:41.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.360+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:41.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.361+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.361+0000 7f88be6bb800 20 INFO: main: starting shard=3 2024-09-12T17:24:41.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.361+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:41.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.361+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.361+0000 7f88be6bb800 20 INFO: main: starting shard=4 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.361+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.362+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.362+0000 7f88be6bb800 20 INFO: main: starting shard=5 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.362+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 INFO: main: starting shard=6 2024-09-12T17:24:41.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:41.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 INFO: main: starting shard=7 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 INFO: main: starting shard=8 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.363+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.364+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.364+0000 7f88be6bb800 20 INFO: main: starting shard=9 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.364+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.364+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.364+0000 7f88be6bb800 20 INFO: main: starting shard=10 2024-09-12T17:24:41.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.364+0000 7f88be6bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:41.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.365+0000 7f88be6bb800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:41.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.365+0000 7f88be6bb800 20 INFO: main: done 2024-09-12T17:24:41.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.366+0000 7f87727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:41.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.368+0000 7f88be6bb800 20 remove_watcher() i=0 2024-09-12T17:24:41.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.368+0000 7f88be6bb800 2 removed watcher, disabling cache 2024-09-12T17:24:41.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.369+0000 7f88be6bb800 20 remove_watcher() i=1 2024-09-12T17:24:41.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.370+0000 7f88be6bb800 20 remove_watcher() i=2 2024-09-12T17:24:41.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.371+0000 7f88be6bb800 20 remove_watcher() i=3 2024-09-12T17:24:41.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.372+0000 7f88be6bb800 20 remove_watcher() i=4 2024-09-12T17:24:41.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.373+0000 7f88be6bb800 20 remove_watcher() i=5 2024-09-12T17:24:41.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.374+0000 7f88be6bb800 20 remove_watcher() i=6 2024-09-12T17:24:41.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:41.375+0000 7f88be6bb800 20 remove_watcher() i=7 2024-09-12T17:24:41.393 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:24:41.802 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:24:42.210 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:24:42.240 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:42.240 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:42.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.279+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.280+0000 7fb820613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.280+0000 7fb820613800 20 realm 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.280+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.281+0000 7fb820613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.281+0000 7fb820613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.281+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.281+0000 7fb820613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.281+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.282+0000 7fb820613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:42.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.282+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.282+0000 7fb820613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:42.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.282+0000 7fb820613800 20 searching for the correct realm 2024-09-12T17:24:42.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.285+0000 7fb81b547640 0 -- 172.21.15.63:0/3651078675 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb810030920 msgr2=0x7fb810032420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:42.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.491+0000 7fb81c549640 0 -- 172.21.15.63:0/3651078675 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x556b5fc5f570 msgr2=0x556b5fc619e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:42.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:42.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:42.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:42.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:42.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:42.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:42.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:42.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.496+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:42.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 zone default found 2024-09-12T17:24:42.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 4 Realm: () 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 zonegroup default 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.497+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.498+0000 7fb820613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.498+0000 7fb820613800 20 started sync module instance, tier type = 2024-09-12T17:24:42.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.498+0000 7fb820613800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:42.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.509+0000 7fb820613800 20 add_watcher() i=0 2024-09-12T17:24:42.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.509+0000 7fb820613800 20 add_watcher() i=1 2024-09-12T17:24:42.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.509+0000 7fb820613800 20 add_watcher() i=2 2024-09-12T17:24:42.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.509+0000 7fb820613800 20 add_watcher() i=3 2024-09-12T17:24:42.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.509+0000 7fb820613800 20 add_watcher() i=4 2024-09-12T17:24:42.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.509+0000 7fb820613800 20 add_watcher() i=5 2024-09-12T17:24:42.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.509+0000 7fb820613800 20 add_watcher() i=6 2024-09-12T17:24:42.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.510+0000 7fb820613800 20 add_watcher() i=7 2024-09-12T17:24:42.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.510+0000 7fb820613800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:42.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.512+0000 7fb6d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:42.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.512+0000 7fb820613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.512+0000 7fb820613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.512+0000 7fb820613800 5 note: GC not initialized 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.512+0000 7fb6d17e2640 20 reqs_thread_entry: start 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.512+0000 7fb820613800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.512+0000 7fb820613800 20 Filter name: none 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb6ca7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:42.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:42.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.513+0000 7fb820613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.514+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:42.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.514+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.515+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:42.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.515+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:42.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.516+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:42.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.516+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.517+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:42.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.517+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:42.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.518+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.518+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:42.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.519+0000 7fb820613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.527+0000 7fb6d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:42.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.529+0000 7fb820613800 20 remove_watcher() i=0 2024-09-12T17:24:42.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.529+0000 7fb820613800 2 removed watcher, disabling cache 2024-09-12T17:24:42.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.531+0000 7fb820613800 20 remove_watcher() i=1 2024-09-12T17:24:42.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.532+0000 7fb820613800 20 remove_watcher() i=2 2024-09-12T17:24:42.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.533+0000 7fb820613800 20 remove_watcher() i=3 2024-09-12T17:24:42.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.534+0000 7fb820613800 20 remove_watcher() i=4 2024-09-12T17:24:42.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.536+0000 7fb820613800 20 remove_watcher() i=5 2024-09-12T17:24:42.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.537+0000 7fb820613800 20 remove_watcher() i=6 2024-09-12T17:24:42.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.538+0000 7fb820613800 20 remove_watcher() i=7 2024-09-12T17:24:42.551 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:24:42.587 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:42.587 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:42.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.625+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 20 realm 2024-09-12T17:24:42.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:42.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.627+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.628+0000 7f30afb37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:42.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.628+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.628+0000 7f30afb37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:42.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.628+0000 7f30afb37800 20 searching for the correct realm 2024-09-12T17:24:42.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.632+0000 7f30ab020640 0 -- 172.21.15.63:0/282089942 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f30a0071e10 msgr2=0x7f30a0067490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:42.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.836+0000 7f30ac022640 0 -- 172.21.15.63:0/282089942 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x555ab3421b70 msgr2=0x555ab3423fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:42.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:42.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:42.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:42.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:42.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:42.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:42.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:42.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.841+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:42.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 zone default found 2024-09-12T17:24:42.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 4 Realm: () 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 zonegroup default 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.842+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.843+0000 7f30afb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:42.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.843+0000 7f30afb37800 20 started sync module instance, tier type = 2024-09-12T17:24:42.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.843+0000 7f30afb37800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:42.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.854+0000 7f30afb37800 20 add_watcher() i=0 2024-09-12T17:24:42.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.854+0000 7f30afb37800 20 add_watcher() i=1 2024-09-12T17:24:42.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.854+0000 7f30afb37800 20 add_watcher() i=2 2024-09-12T17:24:42.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.854+0000 7f30afb37800 20 add_watcher() i=3 2024-09-12T17:24:42.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.854+0000 7f30afb37800 20 add_watcher() i=4 2024-09-12T17:24:42.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.854+0000 7f30afb37800 20 add_watcher() i=5 2024-09-12T17:24:42.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.854+0000 7f30afb37800 20 add_watcher() i=6 2024-09-12T17:24:42.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.855+0000 7f30afb37800 20 add_watcher() i=7 2024-09-12T17:24:42.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.855+0000 7f30afb37800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:42.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.857+0000 7f2f61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:42.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f30afb37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f30afb37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f30afb37800 5 note: GC not initialized 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f2f60fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f30afb37800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f30afb37800 20 Filter name: none 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f2eda7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f30afb37800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:24:42.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.858+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:42.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:24:42.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 : miss 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 20 rados->read ofs=0 len=0 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 info.flags=0x17 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 to cache LRU end 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.859+0000 7f30afb37800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.860+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.0 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.860+0000 7f30afb37800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:24:42.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.860+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.861+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.2 2024-09-12T17:24:42.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.861+0000 7f30afb37800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:24:42.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.861+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.3 2024-09-12T17:24:42.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.862+0000 7f30afb37800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:24:42.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.862+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.4 2024-09-12T17:24:42.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.862+0000 7f30afb37800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:24:42.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.862+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.863+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.6 2024-09-12T17:24:42.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.863+0000 7f30afb37800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:24:42.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.863+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.7 2024-09-12T17:24:42.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.864+0000 7f30afb37800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:24:42.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.864+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.865+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.9 2024-09-12T17:24:42.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.865+0000 7f30afb37800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:24:42.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.865+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.866+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.866+0000 7f30afb37800 20 get_obj_state: octx=0x555ab31acc60 obj=check-bucket:e state=0x555ab345f698 s->prefetch_data=0 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.866+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.866+0000 7f30afb37800 20 get_obj_state: octx=0x555ab31bf780 obj=check-bucket:d state=0x555ab34587f8 s->prefetch_data=0 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.866+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state: octx=0x555ab3459170 obj=check-bucket:c state=0x555ab345d458 s->prefetch_data=0 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state: octx=0x555ab345bed0 obj=check-bucket:f state=0x555ab345dfb8 s->prefetch_data=0 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to 3em852i2244ev0du8damo9bfg20z19xj 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state_impl: setting s->olh_tag to g75lk72f1gm9ejxohdiffr97unrvjaiz 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g75lk72f1gm9ejxohdiffr97unrvjaiz 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to hl22pb0kfueg55bbkfs5zp98z3jmgw61 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state_impl: setting s->olh_tag to x1djs2d0gbufjfrkos6ngzn3q8tyrfmn 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x1djs2d0gbufjfrkos6ngzn3q8tyrfmn 2024-09-12T17:24:42.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to izkci8lio1ry1cp5a0v9i8mzlmzgmvvk 2024-09-12T17:24:42.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state_impl: setting s->olh_tag to ej94c13bjg0k320zq2pogsn3f2jac9oq 2024-09-12T17:24:42.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ej94c13bjg0k320zq2pogsn3f2jac9oq 2024-09-12T17:24:42.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to 0lyp7x7b9iy086pvo3ulgh3ndfvtrner 2024-09-12T17:24:42.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 get_obj_state_impl: setting s->olh_tag to w42r6woe35g3npmi8ko74i5rjfd8fvt3 2024-09-12T17:24:42.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.867+0000 7f30afb37800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=w42r6woe35g3npmi8ko74i5rjfd8fvt3 2024-09-12T17:24:42.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.869+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.872+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.872+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.872+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.874+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:24:42.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 20 olh_log_entry: epoch=2 op=3 key=e[84ubgk-FHzy1S2EKrgPO9aVfENCkYey] 2024-09-12T17:24:42.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 20 get_obj_state: octx=0x555ab31acc60 obj=check-bucket:_:84ubgk-FHzy1S2EKrgPO9aVfENCkYey_e state=0x555ab3513ea8 s->prefetch_data=0 2024-09-12T17:24:42.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 10 manifest: total_size = 22 2024-09-12T17:24:42.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7534664418055565995 2024-09-12T17:24:42.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 20 get_obj_state: octx=0x555ab31acc60 obj=check-bucket:_:84ubgk-FHzy1S2EKrgPO9aVfENCkYey_e state=0x555ab3513ea8 s->prefetch_data=0 2024-09-12T17:24:42.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 20 prepare_atomic_modification: state is not atomic. state=0x555ab3513ea8 2024-09-12T17:24:42.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.875+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.877+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.878+0000 7f30afb37800 20 olh_log_entry: epoch=3 op=3 key=d[s9zjC0WrPbp5.4Gar6iMDygDm.HetaU] 2024-09-12T17:24:42.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.878+0000 7f30afb37800 20 get_obj_state: octx=0x555ab31bf780 obj=check-bucket:_:s9zjC0WrPbp5.4Gar6iMDygDm.HetaU_d state=0x555ab351cb88 s->prefetch_data=0 2024-09-12T17:24:42.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.878+0000 7f30afb37800 10 manifest: total_size = 22 2024-09-12T17:24:42.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.878+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14298878864637996695 2024-09-12T17:24:42.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.878+0000 7f30afb37800 20 get_obj_state: octx=0x555ab31bf780 obj=check-bucket:_:s9zjC0WrPbp5.4Gar6iMDygDm.HetaU_d state=0x555ab351cb88 s->prefetch_data=0 2024-09-12T17:24:42.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.878+0000 7f30afb37800 20 prepare_atomic_modification: state is not atomic. state=0x555ab351cb88 2024-09-12T17:24:42.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.878+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.880+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.880+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 olh_log_entry: epoch=3 op=3 key=c[038Ywmgwy0D.enBpoML6Tsj.-sHHBIM] 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 get_obj_state: octx=0x555ab3459170 obj=check-bucket:_:038Ywmgwy0D.enBpoML6Tsj.-sHHBIM_c state=0x555ab3517e08 s->prefetch_data=0 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 olh_log_entry: epoch=2 op=3 key=f[AwTsBwhTolvBeCOO6xYhyi2.LwT-cDB] 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 get_obj_state: octx=0x555ab345bed0 obj=check-bucket:_:AwTsBwhTolvBeCOO6xYhyi2.LwT-cDB_f state=0x555ab3525d98 s->prefetch_data=0 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 10 manifest: total_size = 12 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2478225921110985218 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 get_obj_state: octx=0x555ab3459170 obj=check-bucket:_:038Ywmgwy0D.enBpoML6Tsj.-sHHBIM_c state=0x555ab3517e08 s->prefetch_data=0 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 prepare_atomic_modification: state is not atomic. state=0x555ab3517e08 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 10 manifest: total_size = 22 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14821106085637609454 2024-09-12T17:24:42.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 get_obj_state: octx=0x555ab345bed0 obj=check-bucket:_:AwTsBwhTolvBeCOO6xYhyi2.LwT-cDB_f state=0x555ab3525d98 s->prefetch_data=0 2024-09-12T17:24:42.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 prepare_atomic_modification: state is not atomic. state=0x555ab3525d98 2024-09-12T17:24:42.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.881+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.885+0000 7f30afb37800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:42.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.885+0000 7f30afb37800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:24:42.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.885+0000 7f30afb37800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:42.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.885+0000 7f30afb37800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:s9zjC0WrPbp5.4Gar6iMDygDm.HetaU_.yEcV_Wd26G22iR_UNJh5fi3xKgN_ekW_0 2024-09-12T17:24:42.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.887+0000 7f30afb37800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:42.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.887+0000 7f30afb37800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:24:42.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.887+0000 7f30afb37800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:42.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.887+0000 7f30afb37800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:84ubgk-FHzy1S2EKrgPO9aVfENCkYey_.n6G62OTXSDeN4sqJp-nrFzB6ENYaIOK_0 2024-09-12T17:24:42.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.890+0000 7f2f8a7fc640 20 handle_completion(): completion ok for obj=d[s9zjC0WrPbp5.4Gar6iMDygDm.HetaU] 2024-09-12T17:24:42.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.890+0000 7f30afb37800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:42.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.892+0000 7f2f8a7fc640 20 handle_completion(): completion ok for obj=e[84ubgk-FHzy1S2EKrgPO9aVfENCkYey] 2024-09-12T17:24:42.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.892+0000 7f30afb37800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:42.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.892+0000 7f30afb37800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:24:42.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.892+0000 7f30afb37800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:42.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.892+0000 7f30afb37800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:AwTsBwhTolvBeCOO6xYhyi2.LwT-cDB_.KLQviqWkJ0x_6MeLDQJnIkDvqH--BSY_0 2024-09-12T17:24:42.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.892+0000 7f30afb37800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:42.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.895+0000 7f30afb37800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:42.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.895+0000 7f30afb37800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:24:42.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.895+0000 7f30afb37800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:42.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.895+0000 7f30afb37800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2__shadow:038Ywmgwy0D.enBpoML6Tsj.-sHHBIM_.Fu92m-ZoqXEFQ0xxx8B_nEB39ySFmtR_0 2024-09-12T17:24:42.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.895+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.895+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.896+0000 7f2f8affd640 20 handle_completion(): completion ok for obj=f[AwTsBwhTolvBeCOO6xYhyi2.LwT-cDB] 2024-09-12T17:24:42.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.897+0000 7f30afb37800 20 get_obj_state: octx=0x555ab31acc60 obj=check-bucket:e state=0x555ab345f698 s->prefetch_data=0 2024-09-12T17:24:42.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.897+0000 7f30afb37800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g75lk72f1gm9ejxohdiffr97unrvjaiz 2024-09-12T17:24:42.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.899+0000 7f30afb37800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:42.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.899+0000 7f30afb37800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:42.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.899+0000 7f2f8affd640 20 handle_completion(): completion ok for obj=c[038Ywmgwy0D.enBpoML6Tsj.-sHHBIM] 2024-09-12T17:24:42.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.899+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.5 2024-09-12T17:24:42.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.899+0000 7f30afb37800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:24:42.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.904+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.904+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.904+0000 7f30afb37800 20 get_obj_state: octx=0x555ab345bed0 obj=check-bucket:f state=0x555ab345dfb8 s->prefetch_data=0 2024-09-12T17:24:42.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.904+0000 7f30afb37800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=w42r6woe35g3npmi8ko74i5rjfd8fvt3 2024-09-12T17:24:42.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.911+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.911+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.8 2024-09-12T17:24:42.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.911+0000 7f30afb37800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:24:42.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.914+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.1 2024-09-12T17:24:42.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.914+0000 7f30afb37800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:24:42.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.914+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.919+0000 7f30afb37800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2.10 2024-09-12T17:24:42.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.919+0000 7f30afb37800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:24:42.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.919+0000 7f30afb37800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:24:42.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.920+0000 7f2f61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:42.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.922+0000 7f30afb37800 20 remove_watcher() i=0 2024-09-12T17:24:42.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.922+0000 7f30afb37800 2 removed watcher, disabling cache 2024-09-12T17:24:42.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.923+0000 7f30afb37800 20 remove_watcher() i=1 2024-09-12T17:24:42.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.924+0000 7f30afb37800 20 remove_watcher() i=2 2024-09-12T17:24:42.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.925+0000 7f30afb37800 20 remove_watcher() i=3 2024-09-12T17:24:42.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.926+0000 7f30afb37800 20 remove_watcher() i=4 2024-09-12T17:24:42.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.927+0000 7f30afb37800 20 remove_watcher() i=5 2024-09-12T17:24:42.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.928+0000 7f30afb37800 20 remove_watcher() i=6 2024-09-12T17:24:42.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:42.929+0000 7f30afb37800 20 remove_watcher() i=7 2024-09-12T17:24:42.993 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:24:43.022 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:43.022 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:43.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.059+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 20 realm 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:43.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.061+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.062+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:43.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.062+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.062+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:43.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.062+0000 7f907f521800 20 searching for the correct realm 2024-09-12T17:24:43.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.065+0000 7f907aa0b640 0 -- 172.21.15.63:0/4069011391 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f9070026920 msgr2=0x7f9070038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:43.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.069+0000 7f907aa0b640 0 -- 172.21.15.63:0/4069011391 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55d856472700 msgr2=0x55d856474bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.073+0000 7f907f521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.073+0000 7f907f521800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.073+0000 7f907f521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.073+0000 7f907f521800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.073+0000 7f907f521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.073+0000 7f907f521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.073+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:43.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 zone default found 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 4 Realm: () 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 zonegroup default 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.074+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.075+0000 7f907f521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:43.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.075+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.075+0000 7f907f521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:43.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.075+0000 7f907f521800 20 started sync module instance, tier type = 2024-09-12T17:24:43.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.075+0000 7f907f521800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:24:43.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.084+0000 7f907f521800 20 add_watcher() i=0 2024-09-12T17:24:43.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.084+0000 7f907f521800 20 add_watcher() i=1 2024-09-12T17:24:43.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.084+0000 7f907f521800 20 add_watcher() i=2 2024-09-12T17:24:43.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.084+0000 7f907f521800 20 add_watcher() i=3 2024-09-12T17:24:43.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.084+0000 7f907f521800 20 add_watcher() i=4 2024-09-12T17:24:43.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.084+0000 7f907f521800 20 add_watcher() i=5 2024-09-12T17:24:43.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.084+0000 7f907f521800 20 add_watcher() i=6 2024-09-12T17:24:43.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.085+0000 7f907f521800 20 add_watcher() i=7 2024-09-12T17:24:43.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.085+0000 7f907f521800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:43.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.086+0000 7f8f31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:43.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.086+0000 7f907f521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:43.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.086+0000 7f907f521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.086+0000 7f907f521800 5 note: GC not initialized 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.087+0000 7f8f30fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.087+0000 7f907f521800 20 init_complete bucket index max shards: 11 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.087+0000 7f907f521800 20 Filter name: none 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.087+0000 7f8eaa7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.087+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.087+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:43.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.087+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.088+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:43.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.088+0000 7f907f521800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:43.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.088+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.088+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:24:43.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.088+0000 7f907f521800 20 rados->read ofs=0 len=0 2024-09-12T17:24:43.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.089+0000 7f907f521800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:24:43.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.089+0000 7f907f521800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:43.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.090+0000 7f8f31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:43.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.093+0000 7f907f521800 20 remove_watcher() i=0 2024-09-12T17:24:43.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.093+0000 7f907f521800 2 removed watcher, disabling cache 2024-09-12T17:24:43.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.094+0000 7f907f521800 20 remove_watcher() i=1 2024-09-12T17:24:43.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.094+0000 7f907f521800 20 remove_watcher() i=2 2024-09-12T17:24:43.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.096+0000 7f907f521800 20 remove_watcher() i=3 2024-09-12T17:24:43.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.097+0000 7f907f521800 20 remove_watcher() i=4 2024-09-12T17:24:43.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.098+0000 7f907f521800 20 remove_watcher() i=5 2024-09-12T17:24:43.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.099+0000 7f907f521800 20 remove_watcher() i=6 2024-09-12T17:24:43.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:24:43.100+0000 7f907f521800 20 remove_watcher() i=7 2024-09-12T17:24:43.112 INFO:tasks.workunit.client.0.smithi063.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:24:43.112 INFO:tasks.workunit.client.0.smithi063.stderr:Deleting bucket check-bucket 2024-09-12T17:24:43.149 INFO:tasks.workunit.client.0.smithi063.stderr:Completed bucket check tests 2024-09-12T17:24:43.149 INFO:tasks.workunit.client.0.smithi063.stdout:connected to http://localhost:80 2024-09-12T17:24:43.209 INFO:tasks.workunit.client.0.smithi063.stderr:+ deactivate 2024-09-12T17:24:43.209 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:24:43.209 INFO:tasks.workunit.client.0.smithi063.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:24:43.209 INFO:tasks.workunit.client.0.smithi063.stderr:+ export PATH 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ hash -r 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset -f deactivate 2024-09-12T17:24:43.210 INFO:tasks.workunit.client.0.smithi063.stderr:+ echo OK. 2024-09-12T17:24:43.211 INFO:tasks.workunit.client.0.smithi063.stdout:OK. 2024-09-12T17:24:43.211 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:24:43.211 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:24:43.291 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:24:43.291 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:24:43.667 DEBUG:teuthology.parallel:result is None 2024-09-12T17:24:43.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:24:43.707 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:24:43.707 DEBUG:teuthology.orchestra.run.smithi063:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:24:43.777 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:24:43.777 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:24:43.787 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:24:43.787 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:24:43.787 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:24:43.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:24:43.848 INFO:teuthology.orchestra.run.smithi063.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:24:43.848 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:24:43.918 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:24:43.918 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:24:43.988 INFO:tasks.workunit:timeout=3h 2024-09-12T17:24:43.988 INFO:tasks.workunit:cleanup=True 2024-09-12T17:24:43.988 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:24:44.058 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:25:43.503 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 92% (11697/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:25:44.240 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:25:44.241 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:25:44.246 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:25:44.316 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:25:44.318 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:25:44.318 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:25:44.370 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:25:44.421 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:25:44.464 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:25:44.465 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:25:44.465 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:25:44.506 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:25:44.509 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:25:44.510 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:25:44.580 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:25:44.581 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:25:44.581 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:25:44.665 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:25:44.665 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:25:44.665 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:25:44.665 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:25:44.665 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:25:46.490 INFO:tasks.workunit.client.0.smithi063.stdout:lock: mylock 2024-09-12T17:25:46.490 INFO:tasks.workunit.client.0.smithi063.stdout: lock_type: exclusive 2024-09-12T17:25:46.490 INFO:tasks.workunit.client.0.smithi063.stdout: tag: 2024-09-12T17:25:46.490 INFO:tasks.workunit.client.0.smithi063.stdout: lockers: 2024-09-12T17:25:46.490 INFO:tasks.workunit.client.0.smithi063.stdout: client.5247 expiration=2024-09-12T17:27:46.483588+0000 addr=v1:172.21.15.63:0/1963820723 cookie= 2024-09-12T17:25:46.493 INFO:tasks.workunit.client.0.smithi063.stdout:lock: mylock 2024-09-12T17:25:46.493 INFO:tasks.workunit.client.0.smithi063.stdout: lock_type: shared 2024-09-12T17:25:46.494 INFO:tasks.workunit.client.0.smithi063.stdout: tag: 2024-09-12T17:25:46.494 INFO:tasks.workunit.client.0.smithi063.stdout: lockers: 2024-09-12T17:25:46.494 INFO:tasks.workunit.client.0.smithi063.stdout: client.5045 expiration=0.000000 addr=v1:172.21.15.63:0/56573570 cookie= 2024-09-12T17:25:46.494 INFO:tasks.workunit.client.0.smithi063.stdout: client.5247 expiration=2024-09-12T17:27:46.492468+0000 addr=v1:172.21.15.63:0/1963820723 cookie= 2024-09-12T17:25:46.495 INFO:tasks.workunit.client.0.smithi063.stdout:lock: mylock 2024-09-12T17:25:46.495 INFO:tasks.workunit.client.0.smithi063.stdout: lock_type: shared 2024-09-12T17:25:46.495 INFO:tasks.workunit.client.0.smithi063.stdout: tag: 2024-09-12T17:25:46.495 INFO:tasks.workunit.client.0.smithi063.stdout: lockers: 2024-09-12T17:25:46.495 INFO:tasks.workunit.client.0.smithi063.stdout: client.5045 expiration=0.000000 addr=v1:172.21.15.63:0/56573570 cookie= 2024-09-12T17:25:47.453 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestMultiLocking (2787 ms) 2024-09-12T17:25:47.453 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:25:49.912 INFO:tasks.workunit.client.0.smithi063.stdout:lock: mylock 2024-09-12T17:25:49.913 INFO:tasks.workunit.client.0.smithi063.stdout: lock_type: shared 2024-09-12T17:25:49.913 INFO:tasks.workunit.client.0.smithi063.stdout: tag: 2024-09-12T17:25:49.913 INFO:tasks.workunit.client.0.smithi063.stdout: lockers: 2024-09-12T17:25:49.913 INFO:tasks.workunit.client.0.smithi063.stdout: client.5089 expiration=0.000000 addr=v1:172.21.15.63:0/428119367 cookie= 2024-09-12T17:25:49.915 INFO:tasks.workunit.client.0.smithi063.stdout:lock: mylock 2024-09-12T17:25:49.915 INFO:tasks.workunit.client.0.smithi063.stdout: lock_type: exclusive 2024-09-12T17:25:49.915 INFO:tasks.workunit.client.0.smithi063.stdout: tag: new_tag 2024-09-12T17:25:49.915 INFO:tasks.workunit.client.0.smithi063.stdout: lockers: 2024-09-12T17:25:49.915 INFO:tasks.workunit.client.0.smithi063.stdout: client.5051 expiration=0.000000 addr=v1:172.21.15.63:0/1212845227 cookie= 2024-09-12T17:25:50.479 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestMeta (3027 ms) 2024-09-12T17:25:50.479 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:25:52.520 INFO:tasks.workunit.client.0.smithi063.stdout:lock: mylock 2024-09-12T17:25:52.520 INFO:tasks.workunit.client.0.smithi063.stdout: lock_type: exclusive 2024-09-12T17:25:52.520 INFO:tasks.workunit.client.0.smithi063.stdout: tag: 2024-09-12T17:25:52.521 INFO:tasks.workunit.client.0.smithi063.stdout: lockers: 2024-09-12T17:25:52.526 INFO:tasks.workunit.client.0.smithi063.stdout:lock: mylock 2024-09-12T17:25:52.527 INFO:tasks.workunit.client.0.smithi063.stdout: lock_type: shared 2024-09-12T17:25:52.527 INFO:tasks.workunit.client.0.smithi063.stdout: tag: 2024-09-12T17:25:52.527 INFO:tasks.workunit.client.0.smithi063.stdout: lockers: 2024-09-12T17:25:52.527 INFO:tasks.workunit.client.0.smithi063.stdout: client.5265 expiration=0.000000 addr=v1:172.21.15.63:0/733208083 cookie= 2024-09-12T17:25:52.527 INFO:tasks.workunit.client.0.smithi063.stdout: client.5265 expiration=0.000000 addr=v1:172.21.15.63:0/733208083 cookie=new cookie 2024-09-12T17:25:53.500 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestCookie (3021 ms) 2024-09-12T17:25:53.501 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:25:56.531 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestMultipleLocks (3029 ms) 2024-09-12T17:25:56.531 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:26:04.561 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestLockDuration (8032 ms) 2024-09-12T17:26:04.562 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:26:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestAssertLocked (3005 ms) 2024-09-12T17:26:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:26:10.599 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestSetCookie (3033 ms) 2024-09-12T17:26:10.599 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:26:30.665 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestRenew (20065 ms) 2024-09-12T17:26:30.666 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:26:37.694 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7030 ms) 2024-09-12T17:26:37.695 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:26:45.737 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8042 ms) 2024-09-12T17:26:45.737 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:26:53.773 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8036 ms) 2024-09-12T17:26:53.773 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 11 tests from ClsLock (69107 ms total) 2024-09-12T17:26:53.773 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:26:53.773 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:26:53.774 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 11 tests from 1 test suite ran. (69108 ms total) 2024-09-12T17:26:53.774 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 11 tests. 2024-09-12T17:26:53.778 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:26:53.778 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:26:53.825 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:26:53.826 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:26:53.826 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:26:53.875 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:26:53.875 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:26:53.875 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:26:53.875 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 4 tests from cls_log 2024-09-12T17:26:53.875 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:26:56.798 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_log.test_log_add_same_time (2924 ms) 2024-09-12T17:26:56.798 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:26:59.816 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_log.test_log_add_different_time (3017 ms) 2024-09-12T17:26:59.817 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:27:02.828 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_log.trim_by_time (3011 ms) 2024-09-12T17:27:02.828 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:27:05.866 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_log.trim_by_marker (3037 ms) 2024-09-12T17:27:05.867 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 4 tests from cls_log (11990 ms total) 2024-09-12T17:27:05.867 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:27:05.867 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:27:05.867 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 4 tests from 1 test suite ran. (11990 ms total) 2024-09-12T17:27:05.867 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 4 tests. 2024-09-12T17:27:05.868 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:27:05.868 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:27:05.913 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:27:05.914 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:27:05.915 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:27:06.001 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:27:06.002 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:27:06.002 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:27:06.002 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:27:06.002 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:27:08.890 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_implicit (2888 ms) 2024-09-12T17:27:08.890 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:27:11.913 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3024 ms) 2024-09-12T17:27:11.913 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:27:20.972 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_put_snap (9058 ms) 2024-09-12T17:27:20.972 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:27:23.981 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_explicit (3009 ms) 2024-09-12T17:27:23.981 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:27:27.013 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.set (3033 ms) 2024-09-12T17:27:27.014 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:27:34.059 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_implicit_ec (7045 ms) 2024-09-12T17:27:34.059 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:27:41.105 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7046 ms) 2024-09-12T17:27:41.105 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:27:53.229 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_put_snap_ec (12124 ms) 2024-09-12T17:27:53.229 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:28:00.283 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.test_explicit_ec (7054 ms) 2024-09-12T17:28:00.283 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:28:07.316 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_refcount.set_ec (7033 ms) 2024-09-12T17:28:07.316 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 10 tests from cls_refcount (61314 ms total) 2024-09-12T17:28:07.316 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:28:07.316 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:28:07.316 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 10 tests from 1 test suite ran. (61314 ms total) 2024-09-12T17:28:07.317 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 10 tests. 2024-09-12T17:28:07.319 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:28:07.320 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:28:07.364 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:28:07.365 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:28:07.366 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:28:07.453 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:28:07.453 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:28:07.453 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:28:07.453 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:28:09.348 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:28:09.400 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_basic (53 ms) 2024-09-12T17:28:09.400 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:28:09.431 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (31 ms) 2024-09-12T17:28:09.431 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:28:09.469 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_remove_object (38 ms) 2024-09-12T17:28:09.469 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:28:10.941 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_suggest (1471 ms) 2024-09-12T17:28:10.941 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:28:10.948 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_suggest_complete (8 ms) 2024-09-12T17:28:10.948 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:28:10.970 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_list (22 ms) 2024-09-12T17:28:10.970 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:28:34.298 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_list_delimited (23328 ms) 2024-09-12T17:28:34.299 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:28:34.593 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.bi_list (294 ms) 2024-09-12T17:28:34.593 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:28:34.606 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.gc_set (14 ms) 2024-09-12T17:28:34.606 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:28:34.620 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.gc_list (14 ms) 2024-09-12T17:28:34.620 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:28:42.439 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.gc_defer (7818 ms) 2024-09-12T17:28:42.439 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:28:42.514 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.usage_basic (76 ms) 2024-09-12T17:28:42.514 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:28:42.519 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.usage_clear_no_obj (5 ms) 2024-09-12T17:28:42.520 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:28:42.613 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.usage_clear (93 ms) 2024-09-12T17:28:42.613 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:28:42.664 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.bi_log_trim (52 ms) 2024-09-12T17:28:42.664 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:28:42.677 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2024-09-12T17:28:42.678 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:28:42.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.reshardlog_list (27 ms) 2024-09-12T17:28:42.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:28:42.715 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-12T17:28:43.445 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 18 tests from cls_rgw (33368 ms total) 2024-09-12T17:28:43.445 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:28:43.445 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:28:43.445 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 18 tests from 1 test suite ran. (35991 ms total) 2024-09-12T17:28:43.445 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 18 tests. 2024-09-12T17:28:43.448 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:28:43.448 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:28:43.495 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:28:43.496 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:28:43.496 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:28:43.543 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:28:43.544 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:28:43.544 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:28:43.544 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:28:43.544 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:28:45.471 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.init (1928 ms) 2024-09-12T17:28:45.471 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:28:45.485 INFO:tasks.workunit.client.0.smithi063.stderr:[ ] list info tag = chain-0 2024-09-12T17:28:45.485 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (13 ms) 2024-09-12T17:28:45.485 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:28:45.491 INFO:tasks.workunit.client.0.smithi063.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:28:45.491 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-12T17:28:45.492 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:28:45.500 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2024-09-12T17:28:45.500 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:28:45.508 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-09-12T17:28:45.509 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:28:45.518 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (10 ms) 2024-09-12T17:28:45.518 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:28:45.526 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-12T17:28:45.526 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:28:45.539 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (12 ms) 2024-09-12T17:28:45.539 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:28:46.476 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_gc.finalize (936 ms) 2024-09-12T17:28:46.477 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 9 tests from cls_rgw_gc (2931 ms total) 2024-09-12T17:28:46.477 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:28:46.477 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:28:46.477 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 9 tests from 1 test suite ran. (2932 ms total) 2024-09-12T17:28:46.477 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 9 tests. 2024-09-12T17:28:46.478 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:28:46.479 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:28:46.524 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:28:46.526 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:28:46.526 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:28:46.620 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:46.621 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:46.621 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:28:46.622 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:28:48.490 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:28:48.491 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:28:48.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.498+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~LVY0TFDFAS2M.0 size=1048576 2024-09-12T17:28:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.499+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~LVY0TFDFAS2M.1 size=1048576 2024-09-12T17:28:48.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.501+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~LVY0TFDFAS2M.2 size=175272 2024-09-12T17:28:48.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.501+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=LVY0TFDFAS2M tag=QKGKOYELX0AA type=write size=3321000 2024-09-12T17:28:48.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.502+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=88O51T83P427 type=del size=1143621 2024-09-12T17:28:48.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.504+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=YMLJ5XU26ZJN type=write size=140887 2024-09-12T17:28:48.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.506+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=176M88A176K4 type=del size=683239 2024-09-12T17:28:48.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.507+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=8FQ8E94QCI4I type=del size=2453633 2024-09-12T17:28:48.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.509+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~O6SJ2066SH8Z.0 size=1048576 2024-09-12T17:28:48.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.510+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~O6SJ2066SH8Z.1 size=424632 2024-09-12T17:28:48.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.510+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=O6SJ2066SH8Z tag=1DGWRV8CZEV5 type=write size=2521784 2024-09-12T17:28:48.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.512+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=JF22POXD6GYT type=del size=2409207 2024-09-12T17:28:48.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.514+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~ECT0D5OJOW5Q.0 size=701264 2024-09-12T17:28:48.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.514+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=ECT0D5OJOW5Q tag=FVNTKMX0VVEK type=write size=1749840 2024-09-12T17:28:48.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.515+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=3EFUMU9GQI1U type=del size=3349545 2024-09-12T17:28:48.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.516+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=K2H3WKO8YQQJ type=del size=3314253 2024-09-12T17:28:48.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.518+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=I5HKZR1L7XM1 type=del size=254899 2024-09-12T17:28:48.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.521+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~VHVEMYOHUXX3.0 size=1048576 2024-09-12T17:28:48.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.522+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~VHVEMYOHUXX3.1 size=806974 2024-09-12T17:28:48.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.522+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=VHVEMYOHUXX3 tag=K5EIL60OX2BW type=write size=2904126 2024-09-12T17:28:48.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.524+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=77QFHFEVA7KZ type=del size=2978371 2024-09-12T17:28:48.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.525+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=MM2K1R350A73 type=del size=3450987 2024-09-12T17:28:48.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.528+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=QARFM3UM13UL type=del size=1925648 2024-09-12T17:28:48.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.529+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=9OZVX9J89EDU type=write size=731652 2024-09-12T17:28:48.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.529+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LJZNPSVLS9AF.2~LVY0TFDFAS2M.0 size=1048576 2024-09-12T17:28:48.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.530+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~LVY0TFDFAS2M.1 size=1048576 2024-09-12T17:28:48.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.531+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~LVY0TFDFAS2M.2 size=175272 2024-09-12T17:28:48.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.534+0000 7f9d7bc0c780 1 < canceled multipart upload key=LJZNPSVLS9AF upload=LVY0TFDFAS2M tag=QKGKOYELX0AA type=write size=3321000 2024-09-12T17:28:48.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.535+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=68P6IIFY3CG0 type=del size=869505 2024-09-12T17:28:48.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.536+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=88O51T83P427 type=del 2024-09-12T17:28:48.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.539+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~9HWBGFETLJ8T.0 size=862781 2024-09-12T17:28:48.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.539+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=9HWBGFETLJ8T tag=HNG8K3KDRGJ5 type=write size=1911357 2024-09-12T17:28:48.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.541+0000 7f9d7bc0c780 1 < canceled operation key=9B83KWC5E4ZV tag=YMLJ5XU26ZJN type=write size=140887 2024-09-12T17:28:48.544 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.543+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~H9M6HEYWXATJ.0 size=479964 2024-09-12T17:28:48.544 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.543+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=H9M6HEYWXATJ tag=CY9FX5995F3X type=write size=1528540 2024-09-12T17:28:48.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.544+0000 7f9d7bc0c780 1 < canceled operation key=5B96YH46VAK3 tag=176M88A176K4 type=del size=683239 2024-09-12T17:28:48.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.546+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=N0PNWIK692XY type=del size=1974447 2024-09-12T17:28:48.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.547+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=8FQ8E94QCI4I type=del 2024-09-12T17:28:48.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.548+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=QRVTNJD4VLVO type=del size=2706722 2024-09-12T17:28:48.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.550+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~O6SJ2066SH8Z.0 size=1048576 2024-09-12T17:28:48.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.551+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~O6SJ2066SH8Z.1 size=424632 2024-09-12T17:28:48.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.554+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=O6SJ2066SH8Z tag=1DGWRV8CZEV5 type=write size=2521784 2024-09-12T17:28:48.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.557+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~810NJT8312ZB.0 size=65649 2024-09-12T17:28:48.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.557+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=810NJT8312ZB tag=8UEFJNY0AL71 type=write size=1114225 2024-09-12T17:28:48.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.558+0000 7f9d7bc0c780 1 < canceled operation key=9TE5N5TIB7AD tag=JF22POXD6GYT type=del size=2409207 2024-09-12T17:28:48.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.559+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=C1Q9SR2UCR4O type=del size=3474356 2024-09-12T17:28:48.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.561+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~ECT0D5OJOW5Q.0 size=701264 2024-09-12T17:28:48.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.563+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=ECT0D5OJOW5Q tag=FVNTKMX0VVEK type=write size=1749840 2024-09-12T17:28:48.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.564+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=94GT722UGM8P type=write size=778141 2024-09-12T17:28:48.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.566+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=3EFUMU9GQI1U type=del 2024-09-12T17:28:48.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.569+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~VSP7HY1QPRVA.0 size=1048576 2024-09-12T17:28:48.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.570+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~VSP7HY1QPRVA.1 size=811041 2024-09-12T17:28:48.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.570+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=VSP7HY1QPRVA tag=ATRNQ9ZJ1O5A type=write size=2908193 2024-09-12T17:28:48.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.571+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=K2H3WKO8YQQJ type=del 2024-09-12T17:28:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.572+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=TNLTBQ838MA3 type=del size=4156325 2024-09-12T17:28:48.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.576+0000 7f9d7bc0c780 1 < suggested remove operation key=X7J78IOJR0HA tag=I5HKZR1L7XM1 type=del 2024-09-12T17:28:48.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.577+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=KI2SBPLCO03P type=del size=4046014 2024-09-12T17:28:48.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.578+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~VHVEMYOHUXX3.0 size=1048576 2024-09-12T17:28:48.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.578+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~VHVEMYOHUXX3.1 size=806974 2024-09-12T17:28:48.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.580+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=VHVEMYOHUXX3 tag=K5EIL60OX2BW type=write size=2904126 2024-09-12T17:28:48.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.583+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~VENDQTZETMVW.0 size=1048576 2024-09-12T17:28:48.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.584+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~VENDQTZETMVW.1 size=482163 2024-09-12T17:28:48.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.584+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=VENDQTZETMVW tag=NN2XIBQ6149F type=write size=2579315 2024-09-12T17:28:48.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.585+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=77QFHFEVA7KZ type=del 2024-09-12T17:28:48.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.588+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~DW0VXF3DJRCQ.0 size=1048576 2024-09-12T17:28:48.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.589+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~DW0VXF3DJRCQ.1 size=1048576 2024-09-12T17:28:48.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.591+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~DW0VXF3DJRCQ.2 size=688405 2024-09-12T17:28:48.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.591+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=DW0VXF3DJRCQ tag=3VNG2BW0O815 type=write size=3834133 2024-09-12T17:28:48.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.592+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=MM2K1R350A73 type=del 2024-09-12T17:28:48.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.595+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~E29I2FFLTOZ1.0 size=1048576 2024-09-12T17:28:48.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.596+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~E29I2FFLTOZ1.1 size=60104 2024-09-12T17:28:48.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.596+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=E29I2FFLTOZ1 tag=02XG5X1W5L35 type=write size=2157256 2024-09-12T17:28:48.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.597+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=QARFM3UM13UL type=del 2024-09-12T17:28:48.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.599+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=6SCWPJR1SQJ0 type=del size=3399578 2024-09-12T17:28:48.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.600+0000 7f9d7bc0c780 1 < completed write operation key=QB8C0OJA1L4X tag=9OZVX9J89EDU type=write size=731652 2024-09-12T17:28:48.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.601+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=F9WMPIB438G9 type=write size=541762 2024-09-12T17:28:48.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.603+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=68P6IIFY3CG0 type=del 2024-09-12T17:28:48.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.604+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=6KXFGGPLHBC2 type=del size=3175064 2024-09-12T17:28:48.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.605+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~9HWBGFETLJ8T.0 size=862781 2024-09-12T17:28:48.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.608+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=9HWBGFETLJ8T tag=HNG8K3KDRGJ5 type=write size=1911357 2024-09-12T17:28:48.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.609+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=9B11INV3DEBB type=del size=576356 2024-09-12T17:28:48.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.610+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~H9M6HEYWXATJ.0 size=479964 2024-09-12T17:28:48.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.612+0000 7f9d7bc0c780 1 < canceled multipart upload key=FU7ARIH2X839 upload=H9M6HEYWXATJ tag=CY9FX5995F3X type=write size=1528540 2024-09-12T17:28:48.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.614+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~Y2DQA2DM3T8Z.0 size=1048576 2024-09-12T17:28:48.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.616+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~Y2DQA2DM3T8Z.1 size=254421 2024-09-12T17:28:48.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.616+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=Y2DQA2DM3T8Z tag=I3C1DWEOQ2J4 type=write size=2351573 2024-09-12T17:28:48.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.617+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=N0PNWIK692XY type=del 2024-09-12T17:28:48.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.619+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~HJ2DZJHHP9AP.0 size=1048576 2024-09-12T17:28:48.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.621+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~HJ2DZJHHP9AP.1 size=1048576 2024-09-12T17:28:48.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.622+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~HJ2DZJHHP9AP.2 size=297590 2024-09-12T17:28:48.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.622+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=HJ2DZJHHP9AP tag=ML6AFTTQ9VU0 type=write size=3443318 2024-09-12T17:28:48.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.623+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=QRVTNJD4VLVO type=del 2024-09-12T17:28:48.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.625+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=D4ML2U8LPLWT type=write size=862326 2024-09-12T17:28:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.626+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~810NJT8312ZB.0 size=65649 2024-09-12T17:28:48.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.628+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=810NJT8312ZB tag=8UEFJNY0AL71 type=write size=1114225 2024-09-12T17:28:48.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.630+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=UHJ12NZY0IJS type=del size=1903685 2024-09-12T17:28:48.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.631+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=C1Q9SR2UCR4O type=del 2024-09-12T17:28:48.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.633+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=KV4RVPP116QK type=del size=645653 2024-09-12T17:28:48.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.636+0000 7f9d7bc0c780 1 < suggested update operation key=M3Q7I7MD7M4I tag=94GT722UGM8P type=write size=778141 2024-09-12T17:28:48.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.637+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=0ADBRKTG77P2 type=del size=3750782 2024-09-12T17:28:48.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.639+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~VSP7HY1QPRVA.0 size=1048576 2024-09-12T17:28:48.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.639+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~VSP7HY1QPRVA.1 size=811041 2024-09-12T17:28:48.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.641+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=VSP7HY1QPRVA tag=ATRNQ9ZJ1O5A type=write size=2908193 2024-09-12T17:28:48.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.643+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=Y61RNFOSQC5I type=del size=1064766 2024-09-12T17:28:48.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.647+0000 7f9d7bc0c780 1 < suggested remove operation key=ZM8NMC18RN3I tag=TNLTBQ838MA3 type=del 2024-09-12T17:28:48.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.650+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~SPKR9B2G91QW.0 size=892410 2024-09-12T17:28:48.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.650+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=SPKR9B2G91QW tag=59V37VAXZRWO type=write size=1940986 2024-09-12T17:28:48.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.651+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=KI2SBPLCO03P type=del 2024-09-12T17:28:48.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.653+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~PA39MRPJ00XP.0 size=450508 2024-09-12T17:28:48.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.653+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=PA39MRPJ00XP tag=DESLSAUKH0JT type=write size=1499084 2024-09-12T17:28:48.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.655+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~VENDQTZETMVW.0 size=1048576 2024-09-12T17:28:48.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.656+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~VENDQTZETMVW.1 size=482163 2024-09-12T17:28:48.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.659+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=VENDQTZETMVW tag=NN2XIBQ6149F type=write size=2579315 2024-09-12T17:28:48.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.660+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=IR20FAOYV88W type=write size=250747 2024-09-12T17:28:48.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.661+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~DW0VXF3DJRCQ.0 size=1048576 2024-09-12T17:28:48.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.662+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~DW0VXF3DJRCQ.1 size=1048576 2024-09-12T17:28:48.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.663+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~DW0VXF3DJRCQ.2 size=688405 2024-09-12T17:28:48.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.666+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=DW0VXF3DJRCQ tag=3VNG2BW0O815 type=write size=3834133 2024-09-12T17:28:48.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.668+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~LXSDRUQI6DGH.0 size=1048576 2024-09-12T17:28:48.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.669+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~LXSDRUQI6DGH.1 size=687217 2024-09-12T17:28:48.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.669+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=LXSDRUQI6DGH tag=LS5HDHIEB37V type=write size=2784369 2024-09-12T17:28:48.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.671+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~E29I2FFLTOZ1.0 size=1048576 2024-09-12T17:28:48.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.674+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~E29I2FFLTOZ1.1 size=60104 2024-09-12T17:28:48.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.677+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=E29I2FFLTOZ1 tag=02XG5X1W5L35 type=write size=2157256 2024-09-12T17:28:48.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.680+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1HM0WQM5JUMU.0 size=1048576 2024-09-12T17:28:48.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.682+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1HM0WQM5JUMU.1 size=1048576 2024-09-12T17:28:48.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.683+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1HM0WQM5JUMU.2 size=505470 2024-09-12T17:28:48.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.683+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=1HM0WQM5JUMU tag=IQSR899PDS3C type=write size=3651198 2024-09-12T17:28:48.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.685+0000 7f9d7bc0c780 1 < suggested update operation key=J3YYRIVKQ5AU tag=6SCWPJR1SQJ0 type=del size=3399578 2024-09-12T17:28:48.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.688+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~37XIRA4LY5CU.0 size=881073 2024-09-12T17:28:48.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.688+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=37XIRA4LY5CU tag=7UCTH4HOTGPE type=write size=1929649 2024-09-12T17:28:48.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.691+0000 7f9d7bc0c780 1 < suggested update operation key=LTG0UQEYPUGO tag=F9WMPIB438G9 type=write size=541762 2024-09-12T17:28:48.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.692+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=3KUB5VUEK67L type=del size=3718829 2024-09-12T17:28:48.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.693+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=6KXFGGPLHBC2 type=del 2024-09-12T17:28:48.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.695+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=JR6W475HS7CC type=del size=1399846 2024-09-12T17:28:48.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.696+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=9B11INV3DEBB type=del 2024-09-12T17:28:48.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.698+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=H4KPMTMA8PK4 type=del size=3805108 2024-09-12T17:28:48.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.699+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~Y2DQA2DM3T8Z.0 size=1048576 2024-09-12T17:28:48.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.700+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~Y2DQA2DM3T8Z.1 size=254421 2024-09-12T17:28:48.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.702+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=Y2DQA2DM3T8Z tag=I3C1DWEOQ2J4 type=write size=2351573 2024-09-12T17:28:48.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.704+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=64SB5G24P6JB type=del size=665817 2024-09-12T17:28:48.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.705+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~HJ2DZJHHP9AP.0 size=1048576 2024-09-12T17:28:48.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.706+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~HJ2DZJHHP9AP.1 size=1048576 2024-09-12T17:28:48.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.706+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~HJ2DZJHHP9AP.2 size=297590 2024-09-12T17:28:48.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.709+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=HJ2DZJHHP9AP tag=ML6AFTTQ9VU0 type=write size=3443318 2024-09-12T17:28:48.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.710+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=K1QKHE2P2JUX type=del size=1836860 2024-09-12T17:28:48.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.713+0000 7f9d7bc0c780 1 < suggested update operation key=J7MREXK6R3C4 tag=D4ML2U8LPLWT type=write size=862326 2024-09-12T17:28:48.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.714+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=85IJ1G1223SB type=del size=2778425 2024-09-12T17:28:48.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.716+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=UHJ12NZY0IJS type=del 2024-09-12T17:28:48.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.717+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=ZGNF7B23WFSB type=del size=1886813 2024-09-12T17:28:48.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.718+0000 7f9d7bc0c780 -1 < failed to complete operation key=M3Q7I7MD7M4I tag=KV4RVPP116QK type=del size=645653: (22) Invalid argument 2024-09-12T17:28:48.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.720+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=QTDKUCRCSFTE type=del size=1847212 2024-09-12T17:28:48.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.722+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=0ADBRKTG77P2 type=del 2024-09-12T17:28:48.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.723+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=3IGCUBHST61G type=del size=1520787 2024-09-12T17:28:48.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.724+0000 7f9d7bc0c780 1 < canceled operation key=80JXIGQWQGR9 tag=Y61RNFOSQC5I type=del size=1064766 2024-09-12T17:28:48.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.726+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=BT7L59OPVFOI type=del size=1553114 2024-09-12T17:28:48.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.727+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~SPKR9B2G91QW.0 size=892410 2024-09-12T17:28:48.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.731+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=SPKR9B2G91QW tag=59V37VAXZRWO type=write size=1940986 2024-09-12T17:28:48.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.733+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=3CL99OEGF31P type=write size=487619 2024-09-12T17:28:48.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.734+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~PA39MRPJ00XP.0 size=450508 2024-09-12T17:28:48.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.737+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=PA39MRPJ00XP tag=DESLSAUKH0JT type=write size=1499084 2024-09-12T17:28:48.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.740+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~POJWEZKZPO2B.0 size=1048576 2024-09-12T17:28:48.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.741+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~POJWEZKZPO2B.1 size=1048576 2024-09-12T17:28:48.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.742+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~POJWEZKZPO2B.2 size=387617 2024-09-12T17:28:48.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.742+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=POJWEZKZPO2B tag=1S7NAHJW72X0 type=write size=3533345 2024-09-12T17:28:48.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.744+0000 7f9d7bc0c780 1 < completed write operation key=R94VERREGANN tag=IR20FAOYV88W type=write size=250747 2024-09-12T17:28:48.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.745+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=0BHJFILL3N1I type=del size=3480154 2024-09-12T17:28:48.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.745+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~LXSDRUQI6DGH.0 size=1048576 2024-09-12T17:28:48.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.745+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~LXSDRUQI6DGH.1 size=687217 2024-09-12T17:28:48.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.748+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=LXSDRUQI6DGH tag=LS5HDHIEB37V type=write size=2784369 2024-09-12T17:28:48.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.749+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=WW0ZVEN9J3R5 type=del size=188177 2024-09-12T17:28:48.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.750+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~1HM0WQM5JUMU.0 size=1048576 2024-09-12T17:28:48.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.751+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~1HM0WQM5JUMU.1 size=1048576 2024-09-12T17:28:48.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.751+0000 7f9d7bc0c780 1 < canceled part key=_multipart_X7J78IOJR0HA.2~1HM0WQM5JUMU.2 size=505470 2024-09-12T17:28:48.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.754+0000 7f9d7bc0c780 1 < canceled multipart upload key=X7J78IOJR0HA upload=1HM0WQM5JUMU tag=IQSR899PDS3C type=write size=3651198 2024-09-12T17:28:48.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.755+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=V1KY1SPVQCEP type=del size=3994440 2024-09-12T17:28:48.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.756+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~37XIRA4LY5CU.0 size=881073 2024-09-12T17:28:48.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.759+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=37XIRA4LY5CU tag=7UCTH4HOTGPE type=write size=1929649 2024-09-12T17:28:48.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.761+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~SV33TC2UZVP3.0 size=502838 2024-09-12T17:28:48.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.761+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=SV33TC2UZVP3 tag=R20Q4O7PA5D3 type=write size=1551414 2024-09-12T17:28:48.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.763+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=3KUB5VUEK67L type=del 2024-09-12T17:28:48.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.764+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=D6K5PXKBNA9Z type=del size=1019642 2024-09-12T17:28:48.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.766+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=JR6W475HS7CC type=del 2024-09-12T17:28:48.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.768+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~8DIVPCDKJBWP.0 size=1048576 2024-09-12T17:28:48.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.769+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~8DIVPCDKJBWP.1 size=1048576 2024-09-12T17:28:48.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.770+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~8DIVPCDKJBWP.2 size=698938 2024-09-12T17:28:48.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.770+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=8DIVPCDKJBWP tag=6BGLJY3VLO1Q type=write size=3844666 2024-09-12T17:28:48.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.772+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=H4KPMTMA8PK4 type=del 2024-09-12T17:28:48.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.775+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KO7AITJ3KK36.0 size=1048576 2024-09-12T17:28:48.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.776+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KO7AITJ3KK36.1 size=393681 2024-09-12T17:28:48.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.776+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=KO7AITJ3KK36 tag=SHFHON586I3H type=write size=2490833 2024-09-12T17:28:48.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.777+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=64SB5G24P6JB type=del 2024-09-12T17:28:48.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.781+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~XQ11MUQLNAZI.0 size=1048576 2024-09-12T17:28:48.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.782+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~XQ11MUQLNAZI.1 size=1048576 2024-09-12T17:28:48.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.783+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~XQ11MUQLNAZI.2 size=753860 2024-09-12T17:28:48.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.783+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=XQ11MUQLNAZI tag=L69M94TK9AOT type=write size=3899588 2024-09-12T17:28:48.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.785+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=K1QKHE2P2JUX type=del 2024-09-12T17:28:48.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.787+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~K5DWUW712F7A.0 size=641149 2024-09-12T17:28:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.787+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=K5DWUW712F7A tag=D57HUOB46FTE type=write size=1689725 2024-09-12T17:28:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.789+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=85IJ1G1223SB type=del 2024-09-12T17:28:48.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.791+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=87AKRM54W54S type=del size=2149748 2024-09-12T17:28:48.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.792+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=ZGNF7B23WFSB type=del 2024-09-12T17:28:48.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.795+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~7GTL3HSXCDXY.0 size=117322 2024-09-12T17:28:48.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.795+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=7GTL3HSXCDXY tag=ELRQRZSZYG7D type=write size=1165898 2024-09-12T17:28:48.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.796+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=QTDKUCRCSFTE type=del 2024-09-12T17:28:48.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.797+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=MK3XO71M01CS type=del size=1027847 2024-09-12T17:28:48.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.799+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=3IGCUBHST61G type=del 2024-09-12T17:28:48.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.800+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=BFUR2CF33UAS type=del size=3628364 2024-09-12T17:28:48.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.802+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=BT7L59OPVFOI type=del 2024-09-12T17:28:48.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.803+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=F9O0AWTOCNHD type=del size=1824879 2024-09-12T17:28:48.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.806+0000 7f9d7bc0c780 1 < suggested update operation key=G5ZKTTY1XQ9T tag=3CL99OEGF31P type=write size=487619 2024-09-12T17:28:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.808+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~3IQVDD5I9N78.0 size=73143 2024-09-12T17:28:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.808+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=3IQVDD5I9N78 tag=SX3FSUIDZDXU type=write size=1121719 2024-09-12T17:28:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.809+0000 7f9d7bc0c780 1 < canceled part key=_multipart_SDX69F30A2RK.2~POJWEZKZPO2B.0 size=1048576 2024-09-12T17:28:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.810+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~POJWEZKZPO2B.1 size=1048576 2024-09-12T17:28:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.811+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~POJWEZKZPO2B.2 size=387617 2024-09-12T17:28:48.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.813+0000 7f9d7bc0c780 1 < canceled multipart upload key=SDX69F30A2RK upload=POJWEZKZPO2B tag=1S7NAHJW72X0 type=write size=3533345 2024-09-12T17:28:48.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.814+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=XRJSFVK6SX7X type=write size=202112 2024-09-12T17:28:48.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.816+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=0BHJFILL3N1I type=del 2024-09-12T17:28:48.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.818+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~LNPT2H46503Y.0 size=1027171 2024-09-12T17:28:48.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.818+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=LNPT2H46503Y tag=HY88J0PUCPQ4 type=write size=2075747 2024-09-12T17:28:48.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.820+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=WW0ZVEN9J3R5 type=del 2024-09-12T17:28:48.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.821+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=ZX6DDIRSAQ73 type=del size=3468443 2024-09-12T17:28:48.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.824+0000 7f9d7bc0c780 1 < suggested remove operation key=ZA6JC3WXS8Y5 tag=V1KY1SPVQCEP type=del 2024-09-12T17:28:48.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.826+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~Z62SL1NHXY2Q.0 size=1048576 2024-09-12T17:28:48.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.827+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~Z62SL1NHXY2Q.1 size=658808 2024-09-12T17:28:48.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.827+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=Z62SL1NHXY2Q tag=OJ5QHGFC1HLO type=write size=2755960 2024-09-12T17:28:48.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.829+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~SV33TC2UZVP3.0 size=502838 2024-09-12T17:28:48.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.831+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=SV33TC2UZVP3 tag=R20Q4O7PA5D3 type=write size=1551414 2024-09-12T17:28:48.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.832+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=5K9N5I6VAOIE type=write size=207915 2024-09-12T17:28:48.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.834+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=D6K5PXKBNA9Z type=del 2024-09-12T17:28:48.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.835+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=BBT4F5XS8RWQ type=del size=1929852 2024-09-12T17:28:48.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.836+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~8DIVPCDKJBWP.0 size=1048576 2024-09-12T17:28:48.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.837+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~8DIVPCDKJBWP.1 size=1048576 2024-09-12T17:28:48.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.837+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~8DIVPCDKJBWP.2 size=698938 2024-09-12T17:28:48.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.839+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=8DIVPCDKJBWP tag=6BGLJY3VLO1Q type=write size=3844666 2024-09-12T17:28:48.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.841+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~WT33E1M5CXHF.0 size=1048576 2024-09-12T17:28:48.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.842+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~WT33E1M5CXHF.1 size=1048576 2024-09-12T17:28:48.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.843+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~WT33E1M5CXHF.2 size=367777 2024-09-12T17:28:48.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.843+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=WT33E1M5CXHF tag=I0B74YKQ0ODK type=write size=3513505 2024-09-12T17:28:48.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.845+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~KO7AITJ3KK36.0 size=1048576 2024-09-12T17:28:48.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.846+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~KO7AITJ3KK36.1 size=393681 2024-09-12T17:28:48.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.848+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=KO7AITJ3KK36 tag=SHFHON586I3H type=write size=2490833 2024-09-12T17:28:48.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.852+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~JV595A3YEXY1.0 size=1048576 2024-09-12T17:28:48.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.853+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~JV595A3YEXY1.1 size=724378 2024-09-12T17:28:48.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.853+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=JV595A3YEXY1 tag=Q4C4WY19PE5D type=write size=2821530 2024-09-12T17:28:48.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.853+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~XQ11MUQLNAZI.0 size=1048576 2024-09-12T17:28:48.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.854+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~XQ11MUQLNAZI.1 size=1048576 2024-09-12T17:28:48.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.855+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~XQ11MUQLNAZI.2 size=753860 2024-09-12T17:28:48.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.857+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=XQ11MUQLNAZI tag=L69M94TK9AOT type=write size=3899588 2024-09-12T17:28:48.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.859+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~6L05Q8DUMJW5.0 size=1048576 2024-09-12T17:28:48.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.860+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~6L05Q8DUMJW5.1 size=471305 2024-09-12T17:28:48.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.860+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=6L05Q8DUMJW5 tag=4QZWOD9TWXDI type=write size=2568457 2024-09-12T17:28:48.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.862+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~K5DWUW712F7A.0 size=641149 2024-09-12T17:28:48.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.864+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=K5DWUW712F7A tag=D57HUOB46FTE type=write size=1689725 2024-09-12T17:28:48.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.866+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~DEOEBI9UBA2T.0 size=1048576 2024-09-12T17:28:48.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.867+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~DEOEBI9UBA2T.1 size=1048576 2024-09-12T17:28:48.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.868+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~DEOEBI9UBA2T.2 size=587190 2024-09-12T17:28:48.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.868+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=DEOEBI9UBA2T tag=2IAKIIF3BBHQ type=write size=3732918 2024-09-12T17:28:48.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.870+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=87AKRM54W54S type=del 2024-09-12T17:28:48.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.872+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~QIOW5SU1TD18.0 size=1048576 2024-09-12T17:28:48.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.873+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~QIOW5SU1TD18.1 size=1048576 2024-09-12T17:28:48.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.874+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~QIOW5SU1TD18.2 size=943681 2024-09-12T17:28:48.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.874+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=QIOW5SU1TD18 tag=VIWRPSUK7BMS type=write size=4089409 2024-09-12T17:28:48.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.875+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~7GTL3HSXCDXY.0 size=117322 2024-09-12T17:28:48.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.878+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=7GTL3HSXCDXY tag=ELRQRZSZYG7D type=write size=1165898 2024-09-12T17:28:48.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.879+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=VNPXR2O494DJ type=del size=84203 2024-09-12T17:28:48.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.880+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=MK3XO71M01CS type=del 2024-09-12T17:28:48.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.882+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=PEABO62GRVZP type=del size=10016 2024-09-12T17:28:48.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.883+0000 7f9d7bc0c780 1 < canceled operation key=64T291B0U226 tag=BFUR2CF33UAS type=del size=3628364 2024-09-12T17:28:48.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.885+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~3DU98M0EV2R9.0 size=1048576 2024-09-12T17:28:48.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.886+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~3DU98M0EV2R9.1 size=1048576 2024-09-12T17:28:48.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.888+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~3DU98M0EV2R9.2 size=1019647 2024-09-12T17:28:48.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.888+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=3DU98M0EV2R9 tag=GLO26QO0T3K0 type=write size=4165375 2024-09-12T17:28:48.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.889+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=F9O0AWTOCNHD type=del 2024-09-12T17:28:48.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.891+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=R1K1SILXQILI type=del size=10832 2024-09-12T17:28:48.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.892+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~3IQVDD5I9N78.0 size=73143 2024-09-12T17:28:48.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.894+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=3IQVDD5I9N78 tag=SX3FSUIDZDXU type=write size=1121719 2024-09-12T17:28:48.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.897+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~YFFHW110OH40.0 size=1048576 2024-09-12T17:28:48.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.898+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~YFFHW110OH40.1 size=1048576 2024-09-12T17:28:48.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.899+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~YFFHW110OH40.2 size=576119 2024-09-12T17:28:48.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.899+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=YFFHW110OH40 tag=25IV48R5AGZP type=write size=3721847 2024-09-12T17:28:48.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.900+0000 7f9d7bc0c780 1 < completed write operation key=80JXIGQWQGR9 tag=XRJSFVK6SX7X type=write size=202112 2024-09-12T17:28:48.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.903+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~R2WMXBEIMFYE.0 size=1048576 2024-09-12T17:28:48.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.904+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~R2WMXBEIMFYE.1 size=1048576 2024-09-12T17:28:48.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.905+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~R2WMXBEIMFYE.2 size=373702 2024-09-12T17:28:48.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.905+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=R2WMXBEIMFYE tag=0062QA381VGS type=write size=3519430 2024-09-12T17:28:48.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.907+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~LNPT2H46503Y.0 size=1027171 2024-09-12T17:28:48.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.909+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=LNPT2H46503Y tag=HY88J0PUCPQ4 type=write size=2075747 2024-09-12T17:28:48.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.911+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=QUYUBD2CB3WD type=del size=3685024 2024-09-12T17:28:48.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.912+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=ZX6DDIRSAQ73 type=del 2024-09-12T17:28:48.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.913+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=A5YXH6Q2XF1H type=write size=463024 2024-09-12T17:28:48.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.914+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~Z62SL1NHXY2Q.0 size=1048576 2024-09-12T17:28:48.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.916+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~Z62SL1NHXY2Q.1 size=658808 2024-09-12T17:28:48.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.918+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=Z62SL1NHXY2Q tag=OJ5QHGFC1HLO type=write size=2755960 2024-09-12T17:28:48.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.919+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=K40NS2JBTNFP type=del size=623932 2024-09-12T17:28:48.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.921+0000 7f9d7bc0c780 1 < suggested remove operation key=64T291B0U226 tag=5K9N5I6VAOIE type=write 2024-09-12T17:28:48.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.923+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=APK5O7S2M91D type=del size=1803274 2024-09-12T17:28:48.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.924+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=BBT4F5XS8RWQ type=del 2024-09-12T17:28:48.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.926+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~PMVPSLVM8BBP.0 size=1048576 2024-09-12T17:28:48.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.927+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~PMVPSLVM8BBP.1 size=1048576 2024-09-12T17:28:48.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.928+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~PMVPSLVM8BBP.2 size=923471 2024-09-12T17:28:48.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.928+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=PMVPSLVM8BBP tag=M430MDGRY31K type=write size=4069199 2024-09-12T17:28:48.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.930+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~WT33E1M5CXHF.0 size=1048576 2024-09-12T17:28:48.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.931+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~WT33E1M5CXHF.1 size=1048576 2024-09-12T17:28:48.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.932+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~WT33E1M5CXHF.2 size=367777 2024-09-12T17:28:48.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.934+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=WT33E1M5CXHF tag=I0B74YKQ0ODK type=write size=3513505 2024-09-12T17:28:48.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.937+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~1IAUQXB2912L.0 size=235314 2024-09-12T17:28:48.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.937+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=1IAUQXB2912L tag=IZQUX7Z1V75H type=write size=1283890 2024-09-12T17:28:48.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.938+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~JV595A3YEXY1.0 size=1048576 2024-09-12T17:28:48.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.939+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~JV595A3YEXY1.1 size=724378 2024-09-12T17:28:48.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.942+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=JV595A3YEXY1 tag=Q4C4WY19PE5D type=write size=2821530 2024-09-12T17:28:48.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.944+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~CY9CZS0WGC7X.0 size=1048576 2024-09-12T17:28:48.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.945+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~CY9CZS0WGC7X.1 size=133997 2024-09-12T17:28:48.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.945+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=CY9CZS0WGC7X tag=CMXTI7KNB76X type=write size=2231149 2024-09-12T17:28:48.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.947+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~6L05Q8DUMJW5.0 size=1048576 2024-09-12T17:28:48.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.948+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~6L05Q8DUMJW5.1 size=471305 2024-09-12T17:28:48.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.951+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=6L05Q8DUMJW5 tag=4QZWOD9TWXDI type=write size=2568457 2024-09-12T17:28:48.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.952+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=NUJZL4UFWNQK type=del size=2133443 2024-09-12T17:28:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.954+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~DEOEBI9UBA2T.0 size=1048576 2024-09-12T17:28:48.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.955+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~DEOEBI9UBA2T.1 size=1048576 2024-09-12T17:28:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.956+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~DEOEBI9UBA2T.2 size=587190 2024-09-12T17:28:48.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.959+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=DEOEBI9UBA2T tag=2IAKIIF3BBHQ type=write size=3732918 2024-09-12T17:28:48.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.962+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~RZFRA2IPAQQU.0 size=1048576 2024-09-12T17:28:48.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.963+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~RZFRA2IPAQQU.1 size=386183 2024-09-12T17:28:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.963+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=RZFRA2IPAQQU tag=MIALHS37ROPA type=write size=2483335 2024-09-12T17:28:48.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.964+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~QIOW5SU1TD18.0 size=1048576 2024-09-12T17:28:48.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.965+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~QIOW5SU1TD18.1 size=1048576 2024-09-12T17:28:48.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.967+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~QIOW5SU1TD18.2 size=943681 2024-09-12T17:28:48.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.969+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=QIOW5SU1TD18 tag=VIWRPSUK7BMS type=write size=4089409 2024-09-12T17:28:48.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.970+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=3GD6QVF8VGJ0 type=del size=1960765 2024-09-12T17:28:48.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.972+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=VNPXR2O494DJ type=del 2024-09-12T17:28:48.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.975+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~QITGHI442SP7.0 size=1048576 2024-09-12T17:28:48.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.976+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~QITGHI442SP7.1 size=1048576 2024-09-12T17:28:48.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.977+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~QITGHI442SP7.2 size=170116 2024-09-12T17:28:48.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.977+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=QITGHI442SP7 tag=83STOC8PNQ6G type=write size=3315844 2024-09-12T17:28:48.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.978+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=PEABO62GRVZP type=del 2024-09-12T17:28:48.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.981+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~VK3AAG0H5N95.0 size=299533 2024-09-12T17:28:48.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.981+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=VK3AAG0H5N95 tag=O6IIGXIBMNKV type=write size=1348109 2024-09-12T17:28:48.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.983+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~3DU98M0EV2R9.0 size=1048576 2024-09-12T17:28:48.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.984+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~3DU98M0EV2R9.1 size=1048576 2024-09-12T17:28:48.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.986+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~3DU98M0EV2R9.2 size=1019647 2024-09-12T17:28:48.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.988+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=3DU98M0EV2R9 tag=GLO26QO0T3K0 type=write size=4165375 2024-09-12T17:28:48.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.990+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=SN56CLJ9408Y type=del size=637025 2024-09-12T17:28:48.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.991+0000 7f9d7bc0c780 -1 < failed to complete operation key=64T291B0U226 tag=R1K1SILXQILI type=del size=10832: (22) Invalid argument 2024-09-12T17:28:48.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.993+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=S2KO7Q73A6FC type=del size=1497292 2024-09-12T17:28:48.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.993+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~YFFHW110OH40.0 size=1048576 2024-09-12T17:28:48.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.994+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~YFFHW110OH40.1 size=1048576 2024-09-12T17:28:48.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.995+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~YFFHW110OH40.2 size=576119 2024-09-12T17:28:48.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.998+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=YFFHW110OH40 tag=25IV48R5AGZP type=write size=3721847 2024-09-12T17:28:49.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:48.999+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=F10N9VFW7RRR type=del size=2149245 2024-09-12T17:28:49.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.001+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~R2WMXBEIMFYE.0 size=1048576 2024-09-12T17:28:49.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.001+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J7MREXK6R3C4.2~R2WMXBEIMFYE.1 size=1048576 2024-09-12T17:28:49.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.002+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~R2WMXBEIMFYE.2 size=373702 2024-09-12T17:28:49.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.004+0000 7f9d7bc0c780 1 < canceled multipart upload key=J7MREXK6R3C4 upload=R2WMXBEIMFYE tag=0062QA381VGS type=write size=3519430 2024-09-12T17:28:49.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.005+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=K6ICFSPIGQ4A type=del size=3098129 2024-09-12T17:28:49.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.006+0000 7f9d7bc0c780 -1 < no bi entry to suggest for operation key=64T291B0U226 tag=QUYUBD2CB3WD type=del size=3685024: (2) No such file or directory 2024-09-12T17:28:49.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.007+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=ODSMH0GUSFSI type=del size=2977835 2024-09-12T17:28:49.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.010+0000 7f9d7bc0c780 1 < suggested update operation key=L72DVWQ63XUW tag=A5YXH6Q2XF1H type=write size=463024 2024-09-12T17:28:49.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.013+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~99PSCJEZF21F.0 size=1048576 2024-09-12T17:28:49.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.014+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~99PSCJEZF21F.1 size=1048576 2024-09-12T17:28:49.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.015+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~99PSCJEZF21F.2 size=902671 2024-09-12T17:28:49.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.015+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=99PSCJEZF21F tag=SWN148C215S7 type=write size=4048399 2024-09-12T17:28:49.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.017+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=K40NS2JBTNFP type=del 2024-09-12T17:28:49.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.018+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=Q915VEUE7N80 type=del size=529053 2024-09-12T17:28:49.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.020+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=APK5O7S2M91D type=del 2024-09-12T17:28:49.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.023+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~U1R23HZ7BFGH.0 size=1048576 2024-09-12T17:28:49.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.024+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~U1R23HZ7BFGH.1 size=53504 2024-09-12T17:28:49.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.024+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=U1R23HZ7BFGH tag=3E82ZHOUBSDH type=write size=2150656 2024-09-12T17:28:49.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.025+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9TE5N5TIB7AD.2~PMVPSLVM8BBP.0 size=1048576 2024-09-12T17:28:49.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.026+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~PMVPSLVM8BBP.1 size=1048576 2024-09-12T17:28:49.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.027+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~PMVPSLVM8BBP.2 size=923471 2024-09-12T17:28:49.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.029+0000 7f9d7bc0c780 1 < canceled multipart upload key=9TE5N5TIB7AD upload=PMVPSLVM8BBP tag=M430MDGRY31K type=write size=4069199 2024-09-12T17:28:49.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.032+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~DPQGZI8JPS4X.0 size=1048576 2024-09-12T17:28:49.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.033+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~DPQGZI8JPS4X.1 size=498372 2024-09-12T17:28:49.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.033+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=DPQGZI8JPS4X tag=9W0KEVMP5IT1 type=write size=2595524 2024-09-12T17:28:49.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.035+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~1IAUQXB2912L.0 size=235314 2024-09-12T17:28:49.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.038+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=1IAUQXB2912L tag=IZQUX7Z1V75H type=write size=1283890 2024-09-12T17:28:49.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.040+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=X2AULKB3LVZX type=del size=4137552 2024-09-12T17:28:49.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.041+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~CY9CZS0WGC7X.0 size=1048576 2024-09-12T17:28:49.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.042+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~CY9CZS0WGC7X.1 size=133997 2024-09-12T17:28:49.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.044+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=CY9CZS0WGC7X tag=CMXTI7KNB76X type=write size=2231149 2024-09-12T17:28:49.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.046+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=TXLIUKRFKITE type=del size=441909 2024-09-12T17:28:49.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.047+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=NUJZL4UFWNQK type=del 2024-09-12T17:28:49.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.050+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~THBBI2BX8MEV.0 size=1048576 2024-09-12T17:28:49.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.051+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~THBBI2BX8MEV.1 size=179334 2024-09-12T17:28:49.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.051+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=THBBI2BX8MEV tag=A8FK7Y1G4HA8 type=write size=2276486 2024-09-12T17:28:49.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.053+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~RZFRA2IPAQQU.0 size=1048576 2024-09-12T17:28:49.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.053+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LJZNPSVLS9AF.2~RZFRA2IPAQQU.1 size=386183 2024-09-12T17:28:49.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.055+0000 7f9d7bc0c780 1 < canceled multipart upload key=LJZNPSVLS9AF upload=RZFRA2IPAQQU tag=MIALHS37ROPA type=write size=2483335 2024-09-12T17:28:49.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.057+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=CBLWO986HDR0 type=del size=3880014 2024-09-12T17:28:49.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.059+0000 7f9d7bc0c780 1 < suggested remove operation key=EUHRVHNVI83I tag=3GD6QVF8VGJ0 type=del 2024-09-12T17:28:49.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.061+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=YLX32IS2FTJH type=write size=788127 2024-09-12T17:28:49.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.063+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~QITGHI442SP7.0 size=1048576 2024-09-12T17:28:49.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.064+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~QITGHI442SP7.1 size=1048576 2024-09-12T17:28:49.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.065+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~QITGHI442SP7.2 size=170116 2024-09-12T17:28:49.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.067+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=QITGHI442SP7 tag=83STOC8PNQ6G type=write size=3315844 2024-09-12T17:28:49.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.073+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=YVBFHBAKKQEP type=del size=664255 2024-09-12T17:28:49.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.075+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~VK3AAG0H5N95.0 size=299533 2024-09-12T17:28:49.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.077+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=VK3AAG0H5N95 tag=O6IIGXIBMNKV type=write size=1348109 2024-09-12T17:28:49.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.080+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~XXZ6O6F5C79D.0 size=1048576 2024-09-12T17:28:49.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.081+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~XXZ6O6F5C79D.1 size=459637 2024-09-12T17:28:49.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.081+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=XXZ6O6F5C79D tag=X17Z7ROXU4KA type=write size=2556789 2024-09-12T17:28:49.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.083+0000 7f9d7bc0c780 -1 < failed to complete operation key=L72DVWQ63XUW tag=SN56CLJ9408Y type=del size=637025: (22) Invalid argument 2024-09-12T17:28:49.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.085+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~ZDWIRY4ZO6WB.0 size=1048576 2024-09-12T17:28:49.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.087+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~ZDWIRY4ZO6WB.1 size=5826 2024-09-12T17:28:49.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.087+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=ZDWIRY4ZO6WB tag=QZN4STGWC48Y type=write size=2102978 2024-09-12T17:28:49.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.088+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=S2KO7Q73A6FC type=del 2024-09-12T17:28:49.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.090+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=H1LITLENOGS1 type=del size=2332536 2024-09-12T17:28:49.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.091+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=F10N9VFW7RRR type=del 2024-09-12T17:28:49.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.094+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~MLHCZ2URWMM4.0 size=902713 2024-09-12T17:28:49.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.094+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=MLHCZ2URWMM4 tag=FQ5OS3WG2TF5 type=write size=1951289 2024-09-12T17:28:49.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.095+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=K6ICFSPIGQ4A type=del 2024-09-12T17:28:49.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.096+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=RKQ3JE361KC6 type=del size=2682412 2024-09-12T17:28:49.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.098+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=ODSMH0GUSFSI type=del 2024-09-12T17:28:49.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.099+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=KX9X8QXY71SO type=del size=3120933 2024-09-12T17:28:49.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.101+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~99PSCJEZF21F.0 size=1048576 2024-09-12T17:28:49.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.102+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~99PSCJEZF21F.1 size=1048576 2024-09-12T17:28:49.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.103+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~99PSCJEZF21F.2 size=902671 2024-09-12T17:28:49.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.106+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=99PSCJEZF21F tag=SWN148C215S7 type=write size=4048399 2024-09-12T17:28:49.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.108+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~VSPLXAJIJ6Z3.0 size=1048576 2024-09-12T17:28:49.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.110+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~VSPLXAJIJ6Z3.1 size=1048576 2024-09-12T17:28:49.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.111+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~VSPLXAJIJ6Z3.2 size=872425 2024-09-12T17:28:49.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.111+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=VSPLXAJIJ6Z3 tag=XQAZ4DQHM7CH type=write size=4018153 2024-09-12T17:28:49.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.113+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=Q915VEUE7N80 type=del 2024-09-12T17:28:49.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.115+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~5GGXNHK21G7Z.0 size=1048576 2024-09-12T17:28:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.117+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~5GGXNHK21G7Z.1 size=479774 2024-09-12T17:28:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.117+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=5GGXNHK21G7Z tag=IS83NCH7NP59 type=write size=2576926 2024-09-12T17:28:49.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.118+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~U1R23HZ7BFGH.0 size=1048576 2024-09-12T17:28:49.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.119+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~U1R23HZ7BFGH.1 size=53504 2024-09-12T17:28:49.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.122+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=U1R23HZ7BFGH tag=3E82ZHOUBSDH type=write size=2150656 2024-09-12T17:28:49.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.123+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=MED49UUAAOC3 type=del size=2155453 2024-09-12T17:28:49.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.125+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~DPQGZI8JPS4X.0 size=1048576 2024-09-12T17:28:49.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.126+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~DPQGZI8JPS4X.1 size=498372 2024-09-12T17:28:49.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.128+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=DPQGZI8JPS4X tag=9W0KEVMP5IT1 type=write size=2595524 2024-09-12T17:28:49.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.130+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=YYZFZ92IHAVN type=del size=3237813 2024-09-12T17:28:49.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.132+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=X2AULKB3LVZX type=del 2024-09-12T17:28:49.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.133+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=4BHSDV8S1J1Z type=write size=379034 2024-09-12T17:28:49.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.135+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=TXLIUKRFKITE type=del 2024-09-12T17:28:49.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.136+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=KANTIAB54JCR type=del size=1648657 2024-09-12T17:28:49.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.137+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~THBBI2BX8MEV.0 size=1048576 2024-09-12T17:28:49.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.139+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~THBBI2BX8MEV.1 size=179334 2024-09-12T17:28:49.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.141+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=THBBI2BX8MEV tag=A8FK7Y1G4HA8 type=write size=2276486 2024-09-12T17:28:49.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.144+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~MW00C31VGQWG.0 size=108065 2024-09-12T17:28:49.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.144+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=MW00C31VGQWG tag=MVMSLK4VHHW3 type=write size=1156641 2024-09-12T17:28:49.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.145+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=CBLWO986HDR0 type=del 2024-09-12T17:28:49.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.146+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=RH7A2JPIWMI9 type=del size=155268 2024-09-12T17:28:49.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.148+0000 7f9d7bc0c780 1 < completed write operation key=9B83KWC5E4ZV tag=YLX32IS2FTJH type=write size=788127 2024-09-12T17:28:49.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.150+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BCHQ5SQIKZ2C.0 size=1048576 2024-09-12T17:28:49.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.151+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BCHQ5SQIKZ2C.1 size=139876 2024-09-12T17:28:49.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.151+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=BCHQ5SQIKZ2C tag=MRY713S1I2JF type=write size=2237028 2024-09-12T17:28:49.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.153+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=YVBFHBAKKQEP type=del 2024-09-12T17:28:49.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.156+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~AETYR3J3CQUE.0 size=1048576 2024-09-12T17:28:49.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.157+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~AETYR3J3CQUE.1 size=1048576 2024-09-12T17:28:49.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.158+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~AETYR3J3CQUE.2 size=503866 2024-09-12T17:28:49.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.158+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=AETYR3J3CQUE tag=HCPSTL3MOQ1E type=write size=3649594 2024-09-12T17:28:49.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.160+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~XXZ6O6F5C79D.0 size=1048576 2024-09-12T17:28:49.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.161+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~XXZ6O6F5C79D.1 size=459637 2024-09-12T17:28:49.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.163+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=XXZ6O6F5C79D tag=X17Z7ROXU4KA type=write size=2556789 2024-09-12T17:28:49.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.165+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=79RB0GN1FS2G type=del size=1217938 2024-09-12T17:28:49.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.166+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~ZDWIRY4ZO6WB.0 size=1048576 2024-09-12T17:28:49.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.168+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~ZDWIRY4ZO6WB.1 size=5826 2024-09-12T17:28:49.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.170+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=ZDWIRY4ZO6WB tag=QZN4STGWC48Y type=write size=2102978 2024-09-12T17:28:49.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.171+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=9JTSCLK4Q1JI type=del size=3406691 2024-09-12T17:28:49.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.174+0000 7f9d7bc0c780 1 < suggested remove operation key=0JN5WWDYEM6Q tag=H1LITLENOGS1 type=del 2024-09-12T17:28:49.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.176+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=LEAJDBWAU4Q7 type=del size=1121020 2024-09-12T17:28:49.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.178+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~MLHCZ2URWMM4.0 size=902713 2024-09-12T17:28:49.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.180+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=MLHCZ2URWMM4 tag=FQ5OS3WG2TF5 type=write size=1951289 2024-09-12T17:28:49.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.182+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=S5E6NOS8ESZF type=del size=837503 2024-09-12T17:28:49.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.183+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=RKQ3JE361KC6 type=del 2024-09-12T17:28:49.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.186+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~AR04ATXVS4EM.0 size=1048576 2024-09-12T17:28:49.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.187+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~AR04ATXVS4EM.1 size=1048576 2024-09-12T17:28:49.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.188+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~AR04ATXVS4EM.2 size=953066 2024-09-12T17:28:49.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.188+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=AR04ATXVS4EM tag=W6NLSTHU5WLG type=write size=4098794 2024-09-12T17:28:49.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.191+0000 7f9d7bc0c780 1 < suggested update operation key=J7MREXK6R3C4 tag=KX9X8QXY71SO type=del size=3120933 2024-09-12T17:28:49.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.193+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=YI1A8129E41D type=del size=3187838 2024-09-12T17:28:49.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.193+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~VSPLXAJIJ6Z3.0 size=1048576 2024-09-12T17:28:49.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.193+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~VSPLXAJIJ6Z3.1 size=1048576 2024-09-12T17:28:49.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.194+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~VSPLXAJIJ6Z3.2 size=872425 2024-09-12T17:28:49.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.196+0000 7f9d7bc0c780 1 < canceled multipart upload key=AOT2ZKFTD0HY upload=VSPLXAJIJ6Z3 tag=XQAZ4DQHM7CH type=write size=4018153 2024-09-12T17:28:49.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.198+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=M34VUDWQG0RQ type=del size=759932 2024-09-12T17:28:49.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.199+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~5GGXNHK21G7Z.0 size=1048576 2024-09-12T17:28:49.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.200+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~5GGXNHK21G7Z.1 size=479774 2024-09-12T17:28:49.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.203+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=5GGXNHK21G7Z tag=IS83NCH7NP59 type=write size=2576926 2024-09-12T17:28:49.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.205+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=F66BQMJTXLQN type=del size=1396149 2024-09-12T17:28:49.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.206+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=MED49UUAAOC3 type=del 2024-09-12T17:28:49.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.209+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~VJDACB52UO9C.0 size=1048576 2024-09-12T17:28:49.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.210+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~VJDACB52UO9C.1 size=1048576 2024-09-12T17:28:49.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.211+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~VJDACB52UO9C.2 size=332439 2024-09-12T17:28:49.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.211+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=VJDACB52UO9C tag=VNSEGEFC587M type=write size=3478167 2024-09-12T17:28:49.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.214+0000 7f9d7bc0c780 1 < suggested update operation key=4V2IYJRP2PZI tag=YYZFZ92IHAVN type=del size=3237813 2024-09-12T17:28:49.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.217+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~1LFWR6EMLLZU.0 size=887805 2024-09-12T17:28:49.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.217+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=1LFWR6EMLLZU tag=I1RMXCA8IH7J type=write size=1936381 2024-09-12T17:28:49.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.220+0000 7f9d7bc0c780 1 < suggested update operation key=QB8C0OJA1L4X tag=4BHSDV8S1J1Z type=write size=379034 2024-09-12T17:28:49.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.222+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=BUHBPL8DU697 type=del size=2721746 2024-09-12T17:28:49.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.224+0000 7f9d7bc0c780 1 < canceled operation key=OZKAXB0ET9R7 tag=KANTIAB54JCR type=del size=1648657 2024-09-12T17:28:49.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.225+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=UNKVOCSZR20D type=del size=958012 2024-09-12T17:28:49.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.227+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~MW00C31VGQWG.0 size=108065 2024-09-12T17:28:49.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.229+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=MW00C31VGQWG tag=MVMSLK4VHHW3 type=write size=1156641 2024-09-12T17:28:49.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.232+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~A9RY2OH3VSMD.0 size=1048576 2024-09-12T17:28:49.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.233+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~A9RY2OH3VSMD.1 size=1048576 2024-09-12T17:28:49.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.234+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~A9RY2OH3VSMD.2 size=370915 2024-09-12T17:28:49.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.234+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=A9RY2OH3VSMD tag=B88GO89EFL3C type=write size=3516643 2024-09-12T17:28:49.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.236+0000 7f9d7bc0c780 -1 < failed to complete operation key=0JN5WWDYEM6Q tag=RH7A2JPIWMI9 type=del size=155268: (22) Invalid argument 2024-09-12T17:28:49.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.237+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=PHPSTTR0L4MA type=del size=374037 2024-09-12T17:28:49.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.239+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~BCHQ5SQIKZ2C.0 size=1048576 2024-09-12T17:28:49.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.240+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~BCHQ5SQIKZ2C.1 size=139876 2024-09-12T17:28:49.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.242+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=BCHQ5SQIKZ2C tag=MRY713S1I2JF type=write size=2237028 2024-09-12T17:28:49.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.244+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=W1YIGKYD9JYQ type=del size=2845139 2024-09-12T17:28:49.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.245+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~AETYR3J3CQUE.0 size=1048576 2024-09-12T17:28:49.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.247+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~AETYR3J3CQUE.1 size=1048576 2024-09-12T17:28:49.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.248+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~AETYR3J3CQUE.2 size=503866 2024-09-12T17:28:49.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.250+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=AETYR3J3CQUE tag=HCPSTL3MOQ1E type=write size=3649594 2024-09-12T17:28:49.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.251+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=FW461SFMLPTU type=del size=4163891 2024-09-12T17:28:49.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.253+0000 7f9d7bc0c780 -1 < failed to complete operation key=J7MREXK6R3C4 tag=79RB0GN1FS2G type=del size=1217938: (22) Invalid argument 2024-09-12T17:28:49.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.254+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=W0JPFGSBHTFL type=del size=1788301 2024-09-12T17:28:49.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.256+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=9JTSCLK4Q1JI type=del 2024-09-12T17:28:49.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.257+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=2676MO6SGWW8 type=write size=141850 2024-09-12T17:28:49.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.260+0000 7f9d7bc0c780 1 < suggested remove operation key=L72DVWQ63XUW tag=LEAJDBWAU4Q7 type=del 2024-09-12T17:28:49.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.261+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=PHLXSJWGWQ8K type=del size=1265236 2024-09-12T17:28:49.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.263+0000 7f9d7bc0c780 1 < canceled operation key=X7J78IOJR0HA tag=S5E6NOS8ESZF type=del size=837503 2024-09-12T17:28:49.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.265+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6A5DRHT6D8WH.0 size=1048576 2024-09-12T17:28:49.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.267+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6A5DRHT6D8WH.1 size=269158 2024-09-12T17:28:49.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.267+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=6A5DRHT6D8WH tag=UJ93H1XLAHW3 type=write size=2366310 2024-09-12T17:28:49.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.268+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~AR04ATXVS4EM.0 size=1048576 2024-09-12T17:28:49.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.269+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~AR04ATXVS4EM.1 size=1048576 2024-09-12T17:28:49.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.270+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~AR04ATXVS4EM.2 size=953066 2024-09-12T17:28:49.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.273+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=AR04ATXVS4EM tag=W6NLSTHU5WLG type=write size=4098794 2024-09-12T17:28:49.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.275+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=XJL1UN3S0VQJ type=write size=785816 2024-09-12T17:28:49.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.276+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=YI1A8129E41D type=del 2024-09-12T17:28:49.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.277+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=K1N38Y4PQD4W type=del size=3153483 2024-09-12T17:28:49.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.279+0000 7f9d7bc0c780 -1 < failed to complete operation key=QB8C0OJA1L4X tag=M34VUDWQG0RQ type=del size=759932: (22) Invalid argument 2024-09-12T17:28:49.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.280+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=CZKEELT6WZ9G type=del size=1393692 2024-09-12T17:28:49.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.282+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=F66BQMJTXLQN type=del 2024-09-12T17:28:49.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.283+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=2SSEH8O2OLJG type=del size=1991561 2024-09-12T17:28:49.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.285+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~VJDACB52UO9C.0 size=1048576 2024-09-12T17:28:49.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.286+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~VJDACB52UO9C.1 size=1048576 2024-09-12T17:28:49.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.287+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~VJDACB52UO9C.2 size=332439 2024-09-12T17:28:49.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.289+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=VJDACB52UO9C tag=VNSEGEFC587M type=write size=3478167 2024-09-12T17:28:49.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.291+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=W0EOWAVVMHQ5 type=del size=1964556 2024-09-12T17:28:49.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.292+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~1LFWR6EMLLZU.0 size=887805 2024-09-12T17:28:49.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.295+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=1LFWR6EMLLZU tag=I1RMXCA8IH7J type=write size=1936381 2024-09-12T17:28:49.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.296+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=J7J1RS0SVQTA type=del size=271504 2024-09-12T17:28:49.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.298+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=BUHBPL8DU697 type=del 2024-09-12T17:28:49.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.300+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~D19EHP3TVL7R.0 size=612908 2024-09-12T17:28:49.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.300+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=D19EHP3TVL7R tag=D1ILMHJUIZ1L type=write size=1661484 2024-09-12T17:28:49.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.302+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=UNKVOCSZR20D type=del 2024-09-12T17:28:49.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.304+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~H5D9QGX0LDLZ.0 size=1048576 2024-09-12T17:28:49.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.305+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~H5D9QGX0LDLZ.1 size=331898 2024-09-12T17:28:49.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.305+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=H5D9QGX0LDLZ tag=XMGGXBVBR7WU type=write size=2429050 2024-09-12T17:28:49.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.307+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~A9RY2OH3VSMD.0 size=1048576 2024-09-12T17:28:49.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.308+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~A9RY2OH3VSMD.1 size=1048576 2024-09-12T17:28:49.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.309+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~A9RY2OH3VSMD.2 size=370915 2024-09-12T17:28:49.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.312+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=A9RY2OH3VSMD tag=B88GO89EFL3C type=write size=3516643 2024-09-12T17:28:49.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.314+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=I9W8R1P10YQ2 type=write size=116867 2024-09-12T17:28:49.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.316+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=PHPSTTR0L4MA type=del 2024-09-12T17:28:49.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.318+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~S3BU8ZJ6NFU5.0 size=728020 2024-09-12T17:28:49.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.318+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=S3BU8ZJ6NFU5 tag=YG0P55HOMU4Q type=write size=1776596 2024-09-12T17:28:49.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.320+0000 7f9d7bc0c780 1 < canceled operation key=ZM8NMC18RN3I tag=W1YIGKYD9JYQ type=del size=2845139 2024-09-12T17:28:49.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.321+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=97RL2QFHS138 type=del size=2585348 2024-09-12T17:28:49.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.323+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=FW461SFMLPTU type=del 2024-09-12T17:28:49.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.324+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=VNFJKYMWOD8I type=del size=3625507 2024-09-12T17:28:49.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.326+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=W0JPFGSBHTFL type=del 2024-09-12T17:28:49.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.327+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=M6G6MECHQLFG type=del size=957430 2024-09-12T17:28:49.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.329+0000 7f9d7bc0c780 1 < canceled operation key=J3YYRIVKQ5AU tag=2676MO6SGWW8 type=write size=141850 2024-09-12T17:28:49.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.330+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=LGBX9KA5N5YX type=del size=259733 2024-09-12T17:28:49.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.332+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=PHLXSJWGWQ8K type=del 2024-09-12T17:28:49.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.335+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~TGBLSYW3LGNR.0 size=567908 2024-09-12T17:28:49.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.335+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=TGBLSYW3LGNR tag=UZ56OK5JIHWA type=write size=1616484 2024-09-12T17:28:49.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.336+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6A5DRHT6D8WH.0 size=1048576 2024-09-12T17:28:49.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.337+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6A5DRHT6D8WH.1 size=269158 2024-09-12T17:28:49.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.339+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=6A5DRHT6D8WH tag=UJ93H1XLAHW3 type=write size=2366310 2024-09-12T17:28:49.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.341+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=RU4SK5T7WVW1 type=del size=3698132 2024-09-12T17:28:49.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.342+0000 7f9d7bc0c780 1 < completed write operation key=4V2IYJRP2PZI tag=XJL1UN3S0VQJ type=write size=785816 2024-09-12T17:28:49.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.344+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=ALJ9N5NO48X1 type=del size=3175257 2024-09-12T17:28:49.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.345+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=K1N38Y4PQD4W type=del 2024-09-12T17:28:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.347+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=73YQN3HKL8YA type=del size=1746715 2024-09-12T17:28:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.348+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=CZKEELT6WZ9G type=del 2024-09-12T17:28:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.350+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=IGW6UCZT3AS2 type=del size=1547506 2024-09-12T17:28:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.351+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=2SSEH8O2OLJG type=del 2024-09-12T17:28:49.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.353+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=Y9LKAN50Y4V4 type=del size=3149804 2024-09-12T17:28:49.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.355+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=W0EOWAVVMHQ5 type=del 2024-09-12T17:28:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.357+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~ZY77JYO17PVQ.0 size=1048576 2024-09-12T17:28:49.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.358+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~ZY77JYO17PVQ.1 size=1048576 2024-09-12T17:28:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.359+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~ZY77JYO17PVQ.2 size=145808 2024-09-12T17:28:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.359+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=ZY77JYO17PVQ tag=I9WPQPU6O98R type=write size=3291536 2024-09-12T17:28:49.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.361+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=J7J1RS0SVQTA type=del 2024-09-12T17:28:49.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.362+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=ARIINIPU3XBT type=del size=1715111 2024-09-12T17:28:49.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.363+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~D19EHP3TVL7R.0 size=612908 2024-09-12T17:28:49.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.366+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=D19EHP3TVL7R tag=D1ILMHJUIZ1L type=write size=1661484 2024-09-12T17:28:49.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.367+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=3RZ4ML7UR2FL type=write size=988729 2024-09-12T17:28:49.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.369+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~H5D9QGX0LDLZ.0 size=1048576 2024-09-12T17:28:49.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.370+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~H5D9QGX0LDLZ.1 size=331898 2024-09-12T17:28:49.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.372+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=H5D9QGX0LDLZ tag=XMGGXBVBR7WU type=write size=2429050 2024-09-12T17:28:49.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.375+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~1E71F6WMGD4O.0 size=1048576 2024-09-12T17:28:49.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.376+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~1E71F6WMGD4O.1 size=1048576 2024-09-12T17:28:49.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.377+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~1E71F6WMGD4O.2 size=479749 2024-09-12T17:28:49.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.377+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=1E71F6WMGD4O tag=CSNO0QK0XD4L type=write size=3625477 2024-09-12T17:28:49.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.380+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=I9W8R1P10YQ2 type=write 2024-09-12T17:28:49.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.381+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=VYV3MHC3GWG6 type=write size=506316 2024-09-12T17:28:49.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.382+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~S3BU8ZJ6NFU5.0 size=728020 2024-09-12T17:28:49.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.385+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=S3BU8ZJ6NFU5 tag=YG0P55HOMU4Q type=write size=1776596 2024-09-12T17:28:49.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.388+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~2O667S9AQ69I.0 size=114387 2024-09-12T17:28:49.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.388+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=2O667S9AQ69I tag=GVO5H59ZUWTP type=write size=1162963 2024-09-12T17:28:49.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.390+0000 7f9d7bc0c780 1 < canceled operation key=0BYGD7FTPQF3 tag=97RL2QFHS138 type=del size=2585348 2024-09-12T17:28:49.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.392+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~1E9IQD48029G.0 size=1048576 2024-09-12T17:28:49.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.394+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~1E9IQD48029G.1 size=1048576 2024-09-12T17:28:49.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.395+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~1E9IQD48029G.2 size=937422 2024-09-12T17:28:49.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.395+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=1E9IQD48029G tag=YHHSDIKEA1Q9 type=write size=4083150 2024-09-12T17:28:49.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.396+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=VNFJKYMWOD8I type=del 2024-09-12T17:28:49.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.399+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~WQ2O1L4PN87T.0 size=794477 2024-09-12T17:28:49.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.399+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=WQ2O1L4PN87T tag=49T7WR6NLUDS type=write size=1843053 2024-09-12T17:28:49.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.400+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=M6G6MECHQLFG type=del 2024-09-12T17:28:49.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.403+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~PGHVQ527B7GU.0 size=552409 2024-09-12T17:28:49.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.403+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=PGHVQ527B7GU tag=JQ6QGLYS40H7 type=write size=1600985 2024-09-12T17:28:49.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.404+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=LGBX9KA5N5YX type=del 2024-09-12T17:28:49.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.407+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~SCGYQI4NPNH9.0 size=1048576 2024-09-12T17:28:49.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.408+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~SCGYQI4NPNH9.1 size=1048576 2024-09-12T17:28:49.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.409+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~SCGYQI4NPNH9.2 size=2452 2024-09-12T17:28:49.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.409+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=SCGYQI4NPNH9 tag=5O5PT2QCZJKX type=write size=3148180 2024-09-12T17:28:49.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.411+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~TGBLSYW3LGNR.0 size=567908 2024-09-12T17:28:49.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.413+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=TGBLSYW3LGNR tag=UZ56OK5JIHWA type=write size=1616484 2024-09-12T17:28:49.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.416+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~1RJ9ZQ359ZA6.0 size=440542 2024-09-12T17:28:49.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.416+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=1RJ9ZQ359ZA6 tag=C9J7V9KMHGR7 type=write size=1489118 2024-09-12T17:28:49.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.417+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=RU4SK5T7WVW1 type=del 2024-09-12T17:28:49.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.419+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=V3MDFJ64KIW0 type=del size=2366698 2024-09-12T17:28:49.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.420+0000 7f9d7bc0c780 1 < canceled operation key=QB8C0OJA1L4X tag=ALJ9N5NO48X1 type=del size=3175257 2024-09-12T17:28:49.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.422+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=05S215GG72BA type=del size=2104512 2024-09-12T17:28:49.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.423+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=73YQN3HKL8YA type=del 2024-09-12T17:28:49.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.424+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=18EO95DW5SZX type=del size=1845186 2024-09-12T17:28:49.427 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.426+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=IGW6UCZT3AS2 type=del 2024-09-12T17:28:49.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.429+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~KLE4F12MIE5E.0 size=96135 2024-09-12T17:28:49.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.429+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=KLE4F12MIE5E tag=Q6JOO81UU4IS type=write size=1144711 2024-09-12T17:28:49.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.430+0000 7f9d7bc0c780 1 < canceled operation key=X7J78IOJR0HA tag=Y9LKAN50Y4V4 type=del size=3149804 2024-09-12T17:28:49.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.433+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~Y636QGDC7EDW.0 size=1048576 2024-09-12T17:28:49.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.434+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~Y636QGDC7EDW.1 size=1048576 2024-09-12T17:28:49.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.435+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~Y636QGDC7EDW.2 size=755503 2024-09-12T17:28:49.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.435+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=Y636QGDC7EDW tag=XJ9BBMF5FOST type=write size=3901231 2024-09-12T17:28:49.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.435+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~ZY77JYO17PVQ.0 size=1048576 2024-09-12T17:28:49.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.436+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~ZY77JYO17PVQ.1 size=1048576 2024-09-12T17:28:49.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.438+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~ZY77JYO17PVQ.2 size=145808 2024-09-12T17:28:49.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.440+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=ZY77JYO17PVQ tag=I9WPQPU6O98R type=write size=3291536 2024-09-12T17:28:49.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.442+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~YB38B5MHX3NU.0 size=1048576 2024-09-12T17:28:49.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.444+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~YB38B5MHX3NU.1 size=552929 2024-09-12T17:28:49.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.444+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=YB38B5MHX3NU tag=5G7KYGP48L2H type=write size=2650081 2024-09-12T17:28:49.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.446+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=ARIINIPU3XBT type=del 2024-09-12T17:28:49.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.448+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=9TQHF6AE874W type=del size=4121072 2024-09-12T17:28:49.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.452+0000 7f9d7bc0c780 1 < suggested remove operation key=4V2IYJRP2PZI tag=3RZ4ML7UR2FL type=write 2024-09-12T17:28:49.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.454+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~3X6MZ7ZY5T96.0 size=1048576 2024-09-12T17:28:49.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.456+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~3X6MZ7ZY5T96.1 size=1048576 2024-09-12T17:28:49.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.457+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~3X6MZ7ZY5T96.2 size=887342 2024-09-12T17:28:49.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.457+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=3X6MZ7ZY5T96 tag=5LZKUNNB085M type=write size=4033070 2024-09-12T17:28:49.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.458+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~1E71F6WMGD4O.0 size=1048576 2024-09-12T17:28:49.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.459+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~1E71F6WMGD4O.1 size=1048576 2024-09-12T17:28:49.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.461+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~1E71F6WMGD4O.2 size=479749 2024-09-12T17:28:49.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.463+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=1E71F6WMGD4O tag=CSNO0QK0XD4L type=write size=3625477 2024-09-12T17:28:49.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.465+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=4SKQX4ESA59T type=write size=195657 2024-09-12T17:28:49.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.466+0000 7f9d7bc0c780 1 < completed write operation key=OZKAXB0ET9R7 tag=VYV3MHC3GWG6 type=write size=506316 2024-09-12T17:28:49.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.469+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~TE1R2WJT230U.0 size=1048576 2024-09-12T17:28:49.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.470+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~TE1R2WJT230U.1 size=1048576 2024-09-12T17:28:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.471+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~TE1R2WJT230U.2 size=409761 2024-09-12T17:28:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.471+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=TE1R2WJT230U tag=V0CJG9DP38NH type=write size=3555489 2024-09-12T17:28:49.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.472+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~2O667S9AQ69I.0 size=114387 2024-09-12T17:28:49.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.475+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=2O667S9AQ69I tag=GVO5H59ZUWTP type=write size=1162963 2024-09-12T17:28:49.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.477+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~GEOM5E959V0C.0 size=1048576 2024-09-12T17:28:49.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.479+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~GEOM5E959V0C.1 size=772923 2024-09-12T17:28:49.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.479+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=GEOM5E959V0C tag=U67PT34ZFEHO type=write size=2870075 2024-09-12T17:28:49.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.480+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~1E9IQD48029G.0 size=1048576 2024-09-12T17:28:49.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.484+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~1E9IQD48029G.1 size=1048576 2024-09-12T17:28:49.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.487+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~1E9IQD48029G.2 size=937422 2024-09-12T17:28:49.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.489+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=1E9IQD48029G tag=YHHSDIKEA1Q9 type=write size=4083150 2024-09-12T17:28:49.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.490+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=BLFQP98R43V3 type=del size=916588 2024-09-12T17:28:49.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.492+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~WQ2O1L4PN87T.0 size=794477 2024-09-12T17:28:49.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.494+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=WQ2O1L4PN87T tag=49T7WR6NLUDS type=write size=1843053 2024-09-12T17:28:49.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.495+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=PUWBK93WJ5I0 type=del size=1969957 2024-09-12T17:28:49.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.496+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~PGHVQ527B7GU.0 size=552409 2024-09-12T17:28:49.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.499+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=PGHVQ527B7GU tag=JQ6QGLYS40H7 type=write size=1600985 2024-09-12T17:28:49.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.500+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=KN3IHV0TIO2V type=del size=61978 2024-09-12T17:28:49.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.502+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~SCGYQI4NPNH9.0 size=1048576 2024-09-12T17:28:49.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.503+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~SCGYQI4NPNH9.1 size=1048576 2024-09-12T17:28:49.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.504+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~SCGYQI4NPNH9.2 size=2452 2024-09-12T17:28:49.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.506+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=SCGYQI4NPNH9 tag=5O5PT2QCZJKX type=write size=3148180 2024-09-12T17:28:49.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.509+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~2Y0WQE0P2KRZ.0 size=1048576 2024-09-12T17:28:49.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.510+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~2Y0WQE0P2KRZ.1 size=214192 2024-09-12T17:28:49.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.510+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=2Y0WQE0P2KRZ tag=3FIR5FVEVENW type=write size=2311344 2024-09-12T17:28:49.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.512+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~1RJ9ZQ359ZA6.0 size=440542 2024-09-12T17:28:49.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.514+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=1RJ9ZQ359ZA6 tag=C9J7V9KMHGR7 type=write size=1489118 2024-09-12T17:28:49.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.516+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=1FSS40R4JHK6 type=del size=1603376 2024-09-12T17:28:49.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.517+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=V3MDFJ64KIW0 type=del 2024-09-12T17:28:49.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.519+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=14T12HSLQHM2 type=del size=314662 2024-09-12T17:28:49.521 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.520+0000 7f9d7bc0c780 -1 < failed to complete operation key=4V2IYJRP2PZI tag=05S215GG72BA type=del size=2104512: (22) Invalid argument 2024-09-12T17:28:49.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.523+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~D1BQRQMYJLZ2.0 size=1048576 2024-09-12T17:28:49.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.524+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~D1BQRQMYJLZ2.1 size=574878 2024-09-12T17:28:49.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.524+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=D1BQRQMYJLZ2 tag=CWV3DE211E0L type=write size=2672030 2024-09-12T17:28:49.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.527+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=18EO95DW5SZX type=del size=1845186 2024-09-12T17:28:49.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.528+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=89QVIYPAUQWH type=del size=962751 2024-09-12T17:28:49.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.529+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~KLE4F12MIE5E.0 size=96135 2024-09-12T17:28:49.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.531+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=KLE4F12MIE5E tag=Q6JOO81UU4IS type=write size=1144711 2024-09-12T17:28:49.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.533+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=M0CXEBTRSEHE type=del size=2760731 2024-09-12T17:28:49.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.535+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~Y636QGDC7EDW.0 size=1048576 2024-09-12T17:28:49.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.535+0000 7f9d7bc0c780 1 < canceled part key=_multipart_80JXIGQWQGR9.2~Y636QGDC7EDW.1 size=1048576 2024-09-12T17:28:49.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.536+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~Y636QGDC7EDW.2 size=755503 2024-09-12T17:28:49.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.538+0000 7f9d7bc0c780 1 < canceled multipart upload key=80JXIGQWQGR9 upload=Y636QGDC7EDW tag=XJ9BBMF5FOST type=write size=3901231 2024-09-12T17:28:49.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.540+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~ICZR36T33MG2.0 size=1048576 2024-09-12T17:28:49.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.541+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~ICZR36T33MG2.1 size=887933 2024-09-12T17:28:49.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.541+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=ICZR36T33MG2 tag=1IY687MRD5BW type=write size=2985085 2024-09-12T17:28:49.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.543+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~YB38B5MHX3NU.0 size=1048576 2024-09-12T17:28:49.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.544+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~YB38B5MHX3NU.1 size=552929 2024-09-12T17:28:49.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.546+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=YB38B5MHX3NU tag=5G7KYGP48L2H type=write size=2650081 2024-09-12T17:28:49.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.547+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=48DBAHTG8WRJ type=del size=1081777 2024-09-12T17:28:49.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.549+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=9TQHF6AE874W type=del 2024-09-12T17:28:49.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.550+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=ZC2V3W10JD3V type=write size=871872 2024-09-12T17:28:49.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.552+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~3X6MZ7ZY5T96.0 size=1048576 2024-09-12T17:28:49.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.552+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LU8MLGM7H0CE.2~3X6MZ7ZY5T96.1 size=1048576 2024-09-12T17:28:49.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.553+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~3X6MZ7ZY5T96.2 size=887342 2024-09-12T17:28:49.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.555+0000 7f9d7bc0c780 1 < canceled multipart upload key=LU8MLGM7H0CE upload=3X6MZ7ZY5T96 tag=5LZKUNNB085M type=write size=4033070 2024-09-12T17:28:49.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.557+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=YKK7ZASY7GQM type=del size=267457 2024-09-12T17:28:49.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.558+0000 7f9d7bc0c780 1 < completed write operation key=LU8MLGM7H0CE tag=4SKQX4ESA59T type=write size=195657 2024-09-12T17:28:49.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.561+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~8RN01TKDYC98.0 size=1048576 2024-09-12T17:28:49.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.562+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~8RN01TKDYC98.1 size=293778 2024-09-12T17:28:49.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.562+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=8RN01TKDYC98 tag=GIGS0CKTIFKM type=write size=2390930 2024-09-12T17:28:49.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.564+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~TE1R2WJT230U.0 size=1048576 2024-09-12T17:28:49.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.565+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~TE1R2WJT230U.1 size=1048576 2024-09-12T17:28:49.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.566+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~TE1R2WJT230U.2 size=409761 2024-09-12T17:28:49.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.568+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=TE1R2WJT230U tag=V0CJG9DP38NH type=write size=3555489 2024-09-12T17:28:49.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.570+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=RZ3W61A5L3OS type=del size=3696911 2024-09-12T17:28:49.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.571+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~GEOM5E959V0C.0 size=1048576 2024-09-12T17:28:49.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.571+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9TE5N5TIB7AD.2~GEOM5E959V0C.1 size=772923 2024-09-12T17:28:49.575 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.574+0000 7f9d7bc0c780 1 < canceled multipart upload key=9TE5N5TIB7AD upload=GEOM5E959V0C tag=U67PT34ZFEHO type=write size=2870075 2024-09-12T17:28:49.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.575+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=KVLK1GCUE182 type=del size=1251199 2024-09-12T17:28:49.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.577+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=BLFQP98R43V3 type=del 2024-09-12T17:28:49.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.580+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~FWUVUO0RYS9R.0 size=1048576 2024-09-12T17:28:49.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.581+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~FWUVUO0RYS9R.1 size=1048576 2024-09-12T17:28:49.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.582+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~FWUVUO0RYS9R.2 size=1002625 2024-09-12T17:28:49.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.582+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=FWUVUO0RYS9R tag=63NFS3N7N3VI type=write size=4148353 2024-09-12T17:28:49.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.583+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=PUWBK93WJ5I0 type=del 2024-09-12T17:28:49.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.585+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=A06BVPOFH68U type=del size=522066 2024-09-12T17:28:49.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.587+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=KN3IHV0TIO2V type=del 2024-09-12T17:28:49.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.590+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=GQB6TJYV5ZTS type=write size=497088 2024-09-12T17:28:49.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.591+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~2Y0WQE0P2KRZ.0 size=1048576 2024-09-12T17:28:49.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.593+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~2Y0WQE0P2KRZ.1 size=214192 2024-09-12T17:28:49.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.595+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=2Y0WQE0P2KRZ tag=3FIR5FVEVENW type=write size=2311344 2024-09-12T17:28:49.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.598+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~GUEAGVFJXAMH.0 size=179635 2024-09-12T17:28:49.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.598+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=GUEAGVFJXAMH tag=P6Y99WCMY4YA type=write size=1228211 2024-09-12T17:28:49.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.599+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=1FSS40R4JHK6 type=del 2024-09-12T17:28:49.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.602+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~081FKWEMIY1I.0 size=563535 2024-09-12T17:28:49.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.602+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=081FKWEMIY1I tag=9ZSCC08QQYK9 type=write size=1612111 2024-09-12T17:28:49.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.605+0000 7f9d7bc0c780 1 < suggested remove operation key=ZA6JC3WXS8Y5 tag=14T12HSLQHM2 type=del 2024-09-12T17:28:49.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.606+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=TWTO8WPBS02G type=write size=625327 2024-09-12T17:28:49.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.608+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~D1BQRQMYJLZ2.0 size=1048576 2024-09-12T17:28:49.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.609+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~D1BQRQMYJLZ2.1 size=574878 2024-09-12T17:28:49.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.612+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=D1BQRQMYJLZ2 tag=CWV3DE211E0L type=write size=2672030 2024-09-12T17:28:49.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.613+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=ONVMQGQQLXQR type=del size=410745 2024-09-12T17:28:49.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.615+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=89QVIYPAUQWH type=del 2024-09-12T17:28:49.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.617+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=FJOS3S6HE303 type=del size=1780640 2024-09-12T17:28:49.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.620+0000 7f9d7bc0c780 1 < suggested remove operation key=4V2IYJRP2PZI tag=M0CXEBTRSEHE type=del 2024-09-12T17:28:49.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.621+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=2V1WBRQ5UYAA type=del size=2655227 2024-09-12T17:28:49.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.623+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~ICZR36T33MG2.0 size=1048576 2024-09-12T17:28:49.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.624+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~ICZR36T33MG2.1 size=887933 2024-09-12T17:28:49.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.626+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=ICZR36T33MG2 tag=1IY687MRD5BW type=write size=2985085 2024-09-12T17:28:49.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.628+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=X15HPSB5QMEJ type=del size=750438 2024-09-12T17:28:49.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.628+0000 7f9d7bc0c780 -1 < no bi entry to suggest for operation key=4V2IYJRP2PZI tag=48DBAHTG8WRJ type=del size=1081777: (2) No such file or directory 2024-09-12T17:28:49.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.631+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~4HOT2W3TSQ17.0 size=1048576 2024-09-12T17:28:49.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.632+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~4HOT2W3TSQ17.1 size=1048576 2024-09-12T17:28:49.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.633+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~4HOT2W3TSQ17.2 size=92350 2024-09-12T17:28:49.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.633+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=4HOT2W3TSQ17 tag=2VQVNVWA5L1Q type=write size=3238078 2024-09-12T17:28:49.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.635+0000 7f9d7bc0c780 1 < completed write operation key=0NGHC5GMSGRX tag=ZC2V3W10JD3V type=write size=871872 2024-09-12T17:28:49.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.637+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=Y6HKTBWSUQTE type=write size=889295 2024-09-12T17:28:49.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.638+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=YKK7ZASY7GQM type=del 2024-09-12T17:28:49.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.640+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=3107HLDLND3F type=del size=2422419 2024-09-12T17:28:49.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.642+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~8RN01TKDYC98.0 size=1048576 2024-09-12T17:28:49.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.643+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~8RN01TKDYC98.1 size=293778 2024-09-12T17:28:49.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.645+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=8RN01TKDYC98 tag=GIGS0CKTIFKM type=write size=2390930 2024-09-12T17:28:49.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.646+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=1YNAOAM9ZYBJ type=del size=3272637 2024-09-12T17:28:49.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.649+0000 7f9d7bc0c780 1 < suggested update operation key=AOT2ZKFTD0HY tag=RZ3W61A5L3OS type=del size=3696911 2024-09-12T17:28:49.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.651+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=14BH5TZKT7PH type=write size=661296 2024-09-12T17:28:49.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.652+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=KVLK1GCUE182 type=del 2024-09-12T17:28:49.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.655+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~VUWRWPGVW6U9.0 size=1048576 2024-09-12T17:28:49.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.656+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~VUWRWPGVW6U9.1 size=1048576 2024-09-12T17:28:49.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.657+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~VUWRWPGVW6U9.2 size=459866 2024-09-12T17:28:49.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.657+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=VUWRWPGVW6U9 tag=K1BSKK7JFXMW type=write size=3605594 2024-09-12T17:28:49.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.659+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~FWUVUO0RYS9R.0 size=1048576 2024-09-12T17:28:49.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.660+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~FWUVUO0RYS9R.1 size=1048576 2024-09-12T17:28:49.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.661+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~FWUVUO0RYS9R.2 size=1002625 2024-09-12T17:28:49.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.663+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=FWUVUO0RYS9R tag=63NFS3N7N3VI type=write size=4148353 2024-09-12T17:28:49.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.665+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=WDCSYD94L9LL type=del size=472943 2024-09-12T17:28:49.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.666+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=A06BVPOFH68U type=del 2024-09-12T17:28:49.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.668+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=8JKTH692N8KW type=del size=1851839 2024-09-12T17:28:49.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.669+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=GQB6TJYV5ZTS type=write size=497088 2024-09-12T17:28:49.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.672+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~YFI29XVI8LJW.0 size=1048576 2024-09-12T17:28:49.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.673+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~YFI29XVI8LJW.1 size=1048576 2024-09-12T17:28:49.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.674+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~YFI29XVI8LJW.2 size=948744 2024-09-12T17:28:49.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.674+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=YFI29XVI8LJW tag=HA8G5AI2YNQ3 type=write size=4094472 2024-09-12T17:28:49.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.676+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~GUEAGVFJXAMH.0 size=179635 2024-09-12T17:28:49.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.678+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=GUEAGVFJXAMH tag=P6Y99WCMY4YA type=write size=1228211 2024-09-12T17:28:49.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.681+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~T9QSF7GMXI8M.0 size=1048576 2024-09-12T17:28:49.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.682+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~T9QSF7GMXI8M.1 size=1013505 2024-09-12T17:28:49.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.682+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=T9QSF7GMXI8M tag=BHK2BXFFD3F9 type=write size=3110657 2024-09-12T17:28:49.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.684+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~081FKWEMIY1I.0 size=563535 2024-09-12T17:28:49.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.686+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=081FKWEMIY1I tag=9ZSCC08QQYK9 type=write size=1612111 2024-09-12T17:28:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.688+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~R8SG2YA9VLSY.0 size=1048576 2024-09-12T17:28:49.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.690+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~R8SG2YA9VLSY.1 size=439722 2024-09-12T17:28:49.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.690+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=R8SG2YA9VLSY tag=M1ITSE5KJ409 type=write size=2536874 2024-09-12T17:28:49.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.691+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=TWTO8WPBS02G type=write size=625327 2024-09-12T17:28:49.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.693+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=PFN3SVEON3LI type=write size=365137 2024-09-12T17:28:49.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.696+0000 7f9d7bc0c780 1 < suggested remove operation key=NQ0768B94GVV tag=ONVMQGQQLXQR type=del 2024-09-12T17:28:49.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.698+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~YLZ1BM9QWLD4.0 size=1048576 2024-09-12T17:28:49.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.700+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~YLZ1BM9QWLD4.1 size=463163 2024-09-12T17:28:49.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.700+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=YLZ1BM9QWLD4 tag=33S3GJXYFSOP type=write size=2560315 2024-09-12T17:28:49.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.701+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=FJOS3S6HE303 type=del 2024-09-12T17:28:49.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.703+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=CVJCADY3Q5EW type=del size=4107159 2024-09-12T17:28:49.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.705+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=2V1WBRQ5UYAA type=del 2024-09-12T17:28:49.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.707+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~HJZDJ13XKEHL.0 size=770291 2024-09-12T17:28:49.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.707+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=HJZDJ13XKEHL tag=MXCO7L3MR4AM type=write size=1818867 2024-09-12T17:28:49.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.710+0000 7f9d7bc0c780 1 < suggested update operation key=W1SE9R6KU04G tag=X15HPSB5QMEJ type=del size=750438 2024-09-12T17:28:49.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.712+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=X0LZF4EGNRA0 type=write size=163217 2024-09-12T17:28:49.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.713+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~4HOT2W3TSQ17.0 size=1048576 2024-09-12T17:28:49.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.715+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~4HOT2W3TSQ17.1 size=1048576 2024-09-12T17:28:49.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.716+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~4HOT2W3TSQ17.2 size=92350 2024-09-12T17:28:49.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.718+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=4HOT2W3TSQ17 tag=2VQVNVWA5L1Q type=write size=3238078 2024-09-12T17:28:49.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.719+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=QO0LKTUK8W4F type=write size=730709 2024-09-12T17:28:49.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.721+0000 7f9d7bc0c780 1 < completed write operation key=QB8C0OJA1L4X tag=Y6HKTBWSUQTE type=write size=889295 2024-09-12T17:28:49.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.724+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~KSHGWQ4JWS68.0 size=973663 2024-09-12T17:28:49.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.724+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=KSHGWQ4JWS68 tag=4NHDAOWM3E53 type=write size=2022239 2024-09-12T17:28:49.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.726+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=3107HLDLND3F type=del 2024-09-12T17:28:49.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.728+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=R2XNZUJZKQNU type=del size=1861781 2024-09-12T17:28:49.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.730+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=1YNAOAM9ZYBJ type=del 2024-09-12T17:28:49.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.733+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~VZGPMDY32A46.0 size=782803 2024-09-12T17:28:49.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.733+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=VZGPMDY32A46 tag=DKCPAO1KZPF3 type=write size=1831379 2024-09-12T17:28:49.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.735+0000 7f9d7bc0c780 1 < suggested update operation key=J7MREXK6R3C4 tag=14BH5TZKT7PH type=write size=661296 2024-09-12T17:28:49.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.737+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=0FK8HXKES1PZ type=del size=3806876 2024-09-12T17:28:49.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.738+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~VUWRWPGVW6U9.0 size=1048576 2024-09-12T17:28:49.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.740+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~VUWRWPGVW6U9.1 size=1048576 2024-09-12T17:28:49.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.740+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~VUWRWPGVW6U9.2 size=459866 2024-09-12T17:28:49.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.742+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=VUWRWPGVW6U9 tag=K1BSKK7JFXMW type=write size=3605594 2024-09-12T17:28:49.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.744+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=0O7K65MW38HQ type=del size=3824580 2024-09-12T17:28:49.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.745+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=WDCSYD94L9LL type=del 2024-09-12T17:28:49.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.747+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=R625EIXMWBBO type=del size=2775814 2024-09-12T17:28:49.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.750+0000 7f9d7bc0c780 1 < suggested remove operation key=R94VERREGANN tag=8JKTH692N8KW type=del 2024-09-12T17:28:49.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.753+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~Q2DNZAKTRVE2.0 size=1048576 2024-09-12T17:28:49.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.754+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~Q2DNZAKTRVE2.1 size=1048576 2024-09-12T17:28:49.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.755+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~Q2DNZAKTRVE2.2 size=107969 2024-09-12T17:28:49.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.755+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=Q2DNZAKTRVE2 tag=7H2JKHS5UU00 type=write size=3253697 2024-09-12T17:28:49.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.756+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~YFI29XVI8LJW.0 size=1048576 2024-09-12T17:28:49.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.757+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~YFI29XVI8LJW.1 size=1048576 2024-09-12T17:28:49.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.758+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~YFI29XVI8LJW.2 size=948744 2024-09-12T17:28:49.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.761+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=YFI29XVI8LJW tag=HA8G5AI2YNQ3 type=write size=4094472 2024-09-12T17:28:49.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.762+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=5W8GJV9SCPYW type=write size=288873 2024-09-12T17:28:49.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.764+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~T9QSF7GMXI8M.0 size=1048576 2024-09-12T17:28:49.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.765+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~T9QSF7GMXI8M.1 size=1013505 2024-09-12T17:28:49.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.768+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=T9QSF7GMXI8M tag=BHK2BXFFD3F9 type=write size=3110657 2024-09-12T17:28:49.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.770+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~2UBVRLS0C480.0 size=1048576 2024-09-12T17:28:49.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.772+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~2UBVRLS0C480.1 size=1025311 2024-09-12T17:28:49.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.772+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=2UBVRLS0C480 tag=V6B0WMO19PTP type=write size=3122463 2024-09-12T17:28:49.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.773+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~R8SG2YA9VLSY.0 size=1048576 2024-09-12T17:28:49.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.774+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~R8SG2YA9VLSY.1 size=439722 2024-09-12T17:28:49.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.777+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=R8SG2YA9VLSY tag=M1ITSE5KJ409 type=write size=2536874 2024-09-12T17:28:49.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.779+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~JKVL70MHQL1O.0 size=1048576 2024-09-12T17:28:49.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.781+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~JKVL70MHQL1O.1 size=247903 2024-09-12T17:28:49.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.781+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=JKVL70MHQL1O tag=XVFL4G4VOV1I type=write size=2345055 2024-09-12T17:28:49.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.782+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=PFN3SVEON3LI type=write size=365137 2024-09-12T17:28:49.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.785+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~YGANUAL63PCL.0 size=1048576 2024-09-12T17:28:49.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.786+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~YGANUAL63PCL.1 size=1048576 2024-09-12T17:28:49.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.787+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~YGANUAL63PCL.2 size=107292 2024-09-12T17:28:49.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.787+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=YGANUAL63PCL tag=87420RBR3Q5G type=write size=3253020 2024-09-12T17:28:49.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.788+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~YLZ1BM9QWLD4.0 size=1048576 2024-09-12T17:28:49.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.790+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~YLZ1BM9QWLD4.1 size=463163 2024-09-12T17:28:49.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.792+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=YLZ1BM9QWLD4 tag=33S3GJXYFSOP type=write size=2560315 2024-09-12T17:28:49.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.793+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=1STSLUNWWKHN type=del size=3140620 2024-09-12T17:28:49.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.796+0000 7f9d7bc0c780 1 < suggested update operation key=G5ZKTTY1XQ9T tag=CVJCADY3Q5EW type=del size=4107159 2024-09-12T17:28:49.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.797+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=KZT6EBB3VDJN type=write size=282639 2024-09-12T17:28:49.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.800+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~HJZDJ13XKEHL.0 size=770291 2024-09-12T17:28:49.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.803+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=HJZDJ13XKEHL tag=MXCO7L3MR4AM type=write size=1818867 2024-09-12T17:28:49.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.804+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=6YPV57ONQX3C type=del size=1891917 2024-09-12T17:28:49.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.807+0000 7f9d7bc0c780 1 < suggested remove operation key=X7J78IOJR0HA tag=X0LZF4EGNRA0 type=write 2024-09-12T17:28:49.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.808+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=FT9WCRKUX8SV type=del size=1518898 2024-09-12T17:28:49.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.810+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=QO0LKTUK8W4F type=write size=730709 2024-09-12T17:28:49.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.812+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~JG9IBTAVLYHQ.0 size=1048576 2024-09-12T17:28:49.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.814+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~JG9IBTAVLYHQ.1 size=996283 2024-09-12T17:28:49.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.814+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=JG9IBTAVLYHQ tag=Y7EWA71CI447 type=write size=3093435 2024-09-12T17:28:49.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.815+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~KSHGWQ4JWS68.0 size=973663 2024-09-12T17:28:49.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.818+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=KSHGWQ4JWS68 tag=4NHDAOWM3E53 type=write size=2022239 2024-09-12T17:28:49.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.819+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=VEBBDQYBXQVI type=write size=654248 2024-09-12T17:28:49.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.820+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=R2XNZUJZKQNU type=del 2024-09-12T17:28:49.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.822+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=ZZ1X7K3D0OSU type=del size=2562910 2024-09-12T17:28:49.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.823+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~VZGPMDY32A46.0 size=782803 2024-09-12T17:28:49.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.827+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=VZGPMDY32A46 tag=DKCPAO1KZPF3 type=write size=1831379 2024-09-12T17:28:49.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.829+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=5RWNRJMS9W52 type=write size=659018 2024-09-12T17:28:49.831 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.831+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=0FK8HXKES1PZ type=del 2024-09-12T17:28:49.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.833+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~JB1WSKPFQXK0.0 size=1048576 2024-09-12T17:28:49.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.834+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~JB1WSKPFQXK0.1 size=1048576 2024-09-12T17:28:49.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.836+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~JB1WSKPFQXK0.2 size=1014287 2024-09-12T17:28:49.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.836+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=JB1WSKPFQXK0 tag=TW0DDLSYEK61 type=write size=4160015 2024-09-12T17:28:49.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.837+0000 7f9d7bc0c780 1 < canceled operation key=5B96YH46VAK3 tag=0O7K65MW38HQ type=del size=3824580 2024-09-12T17:28:49.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.839+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=S80WG8494YPN type=del size=1439743 2024-09-12T17:28:49.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.840+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=R625EIXMWBBO type=del 2024-09-12T17:28:49.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.842+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=T95W7YQJGL0B type=del size=1342136 2024-09-12T17:28:49.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.843+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~Q2DNZAKTRVE2.0 size=1048576 2024-09-12T17:28:49.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.844+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~Q2DNZAKTRVE2.1 size=1048576 2024-09-12T17:28:49.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.846+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~Q2DNZAKTRVE2.2 size=107969 2024-09-12T17:28:49.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.848+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=Q2DNZAKTRVE2 tag=7H2JKHS5UU00 type=write size=3253697 2024-09-12T17:28:49.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.849+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=6PUHLU2YXHRM type=del size=2060643 2024-09-12T17:28:49.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.851+0000 7f9d7bc0c780 1 < canceled operation key=80JXIGQWQGR9 tag=5W8GJV9SCPYW type=write size=288873 2024-09-12T17:28:49.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.853+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=Z8DONFS5R7K2 type=del size=3042850 2024-09-12T17:28:49.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.854+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~2UBVRLS0C480.0 size=1048576 2024-09-12T17:28:49.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.855+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~2UBVRLS0C480.1 size=1025311 2024-09-12T17:28:49.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.857+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=2UBVRLS0C480 tag=V6B0WMO19PTP type=write size=3122463 2024-09-12T17:28:49.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.859+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=CKP5TWM1ZSXE type=del size=774237 2024-09-12T17:28:49.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.860+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~JKVL70MHQL1O.0 size=1048576 2024-09-12T17:28:49.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.860+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~JKVL70MHQL1O.1 size=247903 2024-09-12T17:28:49.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.863+0000 7f9d7bc0c780 1 < canceled multipart upload key=AOT2ZKFTD0HY upload=JKVL70MHQL1O tag=XVFL4G4VOV1I type=write size=2345055 2024-09-12T17:28:49.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.867+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~WC5YJ2I831HH.0 size=1048576 2024-09-12T17:28:49.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.870+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~WC5YJ2I831HH.1 size=219210 2024-09-12T17:28:49.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.870+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=WC5YJ2I831HH tag=AFKCB2Y719AS type=write size=2316362 2024-09-12T17:28:49.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.872+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~YGANUAL63PCL.0 size=1048576 2024-09-12T17:28:49.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.873+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~YGANUAL63PCL.1 size=1048576 2024-09-12T17:28:49.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.874+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~YGANUAL63PCL.2 size=107292 2024-09-12T17:28:49.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.877+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=YGANUAL63PCL tag=87420RBR3Q5G type=write size=3253020 2024-09-12T17:28:49.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.878+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=5GUF6TYBYKWF type=del size=1098089 2024-09-12T17:28:49.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.880+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=1STSLUNWWKHN type=del 2024-09-12T17:28:49.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.882+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~Y25LADPU9J76.0 size=1048576 2024-09-12T17:28:49.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.883+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~Y25LADPU9J76.1 size=14024 2024-09-12T17:28:49.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.883+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=Y25LADPU9J76 tag=TSHSRL344765 type=write size=2111176 2024-09-12T17:28:49.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.886+0000 7f9d7bc0c780 1 < suggested update operation key=AOT2ZKFTD0HY tag=KZT6EBB3VDJN type=write size=282639 2024-09-12T17:28:49.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.889+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~6WNRVI31MA9M.0 size=1048576 2024-09-12T17:28:49.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.890+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~6WNRVI31MA9M.1 size=1048576 2024-09-12T17:28:49.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.891+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~6WNRVI31MA9M.2 size=371545 2024-09-12T17:28:49.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.891+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=6WNRVI31MA9M tag=FS89OVKQ9YML type=write size=3517273 2024-09-12T17:28:49.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.892+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=6YPV57ONQX3C type=del 2024-09-12T17:28:49.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.895+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~2PB7KFHOZIS7.0 size=1048576 2024-09-12T17:28:49.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.896+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~2PB7KFHOZIS7.1 size=664906 2024-09-12T17:28:49.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.896+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=2PB7KFHOZIS7 tag=0R57IZ27NBGQ type=write size=2762058 2024-09-12T17:28:49.899 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.899+0000 7f9d7bc0c780 1 < suggested remove operation key=0JN5WWDYEM6Q tag=FT9WCRKUX8SV type=del 2024-09-12T17:28:49.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.900+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=9GYKR3PX8HVP type=del size=2226274 2024-09-12T17:28:49.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.902+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~JG9IBTAVLYHQ.0 size=1048576 2024-09-12T17:28:49.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.902+0000 7f9d7bc0c780 1 < canceled part key=_multipart_QB8C0OJA1L4X.2~JG9IBTAVLYHQ.1 size=996283 2024-09-12T17:28:49.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.904+0000 7f9d7bc0c780 1 < canceled multipart upload key=QB8C0OJA1L4X upload=JG9IBTAVLYHQ tag=Y7EWA71CI447 type=write size=3093435 2024-09-12T17:28:49.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.906+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=04DMQ2OOFRA4 type=write size=168708 2024-09-12T17:28:49.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.907+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=VEBBDQYBXQVI type=write size=654248 2024-09-12T17:28:49.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.910+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~GNK4WGCMW3TF.0 size=1048576 2024-09-12T17:28:49.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.911+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~GNK4WGCMW3TF.1 size=933100 2024-09-12T17:28:49.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.911+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=GNK4WGCMW3TF tag=W6195ZH3XPAT type=write size=3030252 2024-09-12T17:28:49.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.913+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=ZZ1X7K3D0OSU type=del 2024-09-12T17:28:49.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.914+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=P130C5088HL3 type=del size=1622816 2024-09-12T17:28:49.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.915+0000 7f9d7bc0c780 1 < canceled operation key=SDX69F30A2RK tag=5RWNRJMS9W52 type=write size=659018 2024-09-12T17:28:49.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.917+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=2LH06IMH2X8N type=write size=487995 2024-09-12T17:28:49.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.918+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~JB1WSKPFQXK0.0 size=1048576 2024-09-12T17:28:49.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.918+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~JB1WSKPFQXK0.1 size=1048576 2024-09-12T17:28:49.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.919+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~JB1WSKPFQXK0.2 size=1014287 2024-09-12T17:28:49.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.922+0000 7f9d7bc0c780 1 < canceled multipart upload key=FU7ARIH2X839 upload=JB1WSKPFQXK0 tag=TW0DDLSYEK61 type=write size=4160015 2024-09-12T17:28:49.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.924+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~VY80CQ7EPVQY.0 size=1048576 2024-09-12T17:28:49.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.925+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~VY80CQ7EPVQY.1 size=1048576 2024-09-12T17:28:49.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.926+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~VY80CQ7EPVQY.2 size=796790 2024-09-12T17:28:49.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.926+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=VY80CQ7EPVQY tag=P1S33F6C79QB type=write size=3942518 2024-09-12T17:28:49.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.929+0000 7f9d7bc0c780 1 < suggested remove operation key=QB8C0OJA1L4X tag=S80WG8494YPN type=del 2024-09-12T17:28:49.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.932+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~KZ8ENWFSA0B0.0 size=1048576 2024-09-12T17:28:49.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.933+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~KZ8ENWFSA0B0.1 size=1048576 2024-09-12T17:28:49.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.934+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~KZ8ENWFSA0B0.2 size=559612 2024-09-12T17:28:49.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.934+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=KZ8ENWFSA0B0 tag=5JZLVKV0JJMM type=write size=3705340 2024-09-12T17:28:49.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.935+0000 7f9d7bc0c780 -1 < failed to complete operation key=0JN5WWDYEM6Q tag=T95W7YQJGL0B type=del size=1342136: (22) Invalid argument 2024-09-12T17:28:49.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.938+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~RURI0WJF5XGG.0 size=1048576 2024-09-12T17:28:49.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.939+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~RURI0WJF5XGG.1 size=1048576 2024-09-12T17:28:49.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.940+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~RURI0WJF5XGG.2 size=1014299 2024-09-12T17:28:49.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.940+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=RURI0WJF5XGG tag=7YUVO0KXJ0WS type=write size=4160027 2024-09-12T17:28:49.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.941+0000 7f9d7bc0c780 1 < canceled operation key=31PU0U6IEAV2 tag=6PUHLU2YXHRM type=del size=2060643 2024-09-12T17:28:49.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.943+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=YVASJQJUFGYT type=del size=2418900 2024-09-12T17:28:49.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.944+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=Z8DONFS5R7K2 type=del 2024-09-12T17:28:49.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.946+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=WPL8KCMB0SP7 type=del size=3966207 2024-09-12T17:28:49.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.947+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=CKP5TWM1ZSXE type=del 2024-09-12T17:28:49.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.950+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~98BRNGVC2UGY.0 size=1048576 2024-09-12T17:28:49.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.951+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~98BRNGVC2UGY.1 size=1048576 2024-09-12T17:28:49.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.952+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~98BRNGVC2UGY.2 size=707298 2024-09-12T17:28:49.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.952+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=98BRNGVC2UGY tag=8GRGNCMBUJQ3 type=write size=3853026 2024-09-12T17:28:49.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.953+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~WC5YJ2I831HH.0 size=1048576 2024-09-12T17:28:49.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.955+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~WC5YJ2I831HH.1 size=219210 2024-09-12T17:28:49.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.958+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=WC5YJ2I831HH tag=AFKCB2Y719AS type=write size=2316362 2024-09-12T17:28:49.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.959+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=0N7ALYN4XXER type=del size=1150940 2024-09-12T17:28:49.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.961+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=5GUF6TYBYKWF type=del 2024-09-12T17:28:49.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.963+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~BG1MXTE8RV6B.0 size=1048576 2024-09-12T17:28:49.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.964+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~BG1MXTE8RV6B.1 size=1048576 2024-09-12T17:28:49.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.966+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~BG1MXTE8RV6B.2 size=480404 2024-09-12T17:28:49.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.966+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=BG1MXTE8RV6B tag=TRBSHE8UI9ZO type=write size=3626132 2024-09-12T17:28:49.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.967+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~Y25LADPU9J76.0 size=1048576 2024-09-12T17:28:49.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.968+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~Y25LADPU9J76.1 size=14024 2024-09-12T17:28:49.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.971+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=Y25LADPU9J76 tag=TSHSRL344765 type=write size=2111176 2024-09-12T17:28:49.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.972+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=12U9UF2YCFPH type=del size=629564 2024-09-12T17:28:49.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.974+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~6WNRVI31MA9M.0 size=1048576 2024-09-12T17:28:49.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.975+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~6WNRVI31MA9M.1 size=1048576 2024-09-12T17:28:49.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.976+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~6WNRVI31MA9M.2 size=371545 2024-09-12T17:28:49.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.978+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=6WNRVI31MA9M tag=FS89OVKQ9YML type=write size=3517273 2024-09-12T17:28:49.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.981+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~3UB4VHCPC3QO.0 size=1048576 2024-09-12T17:28:49.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.982+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~3UB4VHCPC3QO.1 size=377053 2024-09-12T17:28:49.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.982+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=3UB4VHCPC3QO tag=1RQK62U9H10V type=write size=2474205 2024-09-12T17:28:49.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.982+0000 7f9d7bc0c780 1 < canceled part key=_multipart_EUHRVHNVI83I.2~2PB7KFHOZIS7.0 size=1048576 2024-09-12T17:28:49.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.983+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~2PB7KFHOZIS7.1 size=664906 2024-09-12T17:28:49.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.986+0000 7f9d7bc0c780 1 < canceled multipart upload key=EUHRVHNVI83I upload=2PB7KFHOZIS7 tag=0R57IZ27NBGQ type=write size=2762058 2024-09-12T17:28:49.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.987+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=BHCPZCBYWM8R type=del size=1535959 2024-09-12T17:28:49.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.989+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=9GYKR3PX8HVP type=del 2024-09-12T17:28:49.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.990+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=IOTBHZOWMN9V type=del size=917496 2024-09-12T17:28:49.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.992+0000 7f9d7bc0c780 1 < completed write operation key=LTG0UQEYPUGO tag=04DMQ2OOFRA4 type=write size=168708 2024-09-12T17:28:49.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.994+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~B5DPVK2P5OW9.0 size=222703 2024-09-12T17:28:49.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.994+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=B5DPVK2P5OW9 tag=XKZNBLEIB4E6 type=write size=1271279 2024-09-12T17:28:49.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.996+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~GNK4WGCMW3TF.0 size=1048576 2024-09-12T17:28:49.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.996+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0NGHC5GMSGRX.2~GNK4WGCMW3TF.1 size=933100 2024-09-12T17:28:50.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:49.999+0000 7f9d7bc0c780 1 < canceled multipart upload key=0NGHC5GMSGRX upload=GNK4WGCMW3TF tag=W6195ZH3XPAT type=write size=3030252 2024-09-12T17:28:50.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.001+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=FHCEPNZUZLC8 type=del size=2668772 2024-09-12T17:28:50.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.004+0000 7f9d7bc0c780 1 < suggested update operation key=W1SE9R6KU04G tag=P130C5088HL3 type=del size=1622816 2024-09-12T17:28:50.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.006+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~F24GXFDV0J2M.0 size=117662 2024-09-12T17:28:50.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.006+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=F24GXFDV0J2M tag=7IPLV33QC80L type=write size=1166238 2024-09-12T17:28:50.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.009+0000 7f9d7bc0c780 1 < suggested update operation key=NQ0768B94GVV tag=2LH06IMH2X8N type=write size=487995 2024-09-12T17:28:50.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.011+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=9SIG1JJ00FJ2 type=del size=240412 2024-09-12T17:28:50.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.012+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~VY80CQ7EPVQY.0 size=1048576 2024-09-12T17:28:50.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.013+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~VY80CQ7EPVQY.1 size=1048576 2024-09-12T17:28:50.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.014+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~VY80CQ7EPVQY.2 size=796790 2024-09-12T17:28:50.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.017+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=VY80CQ7EPVQY tag=P1S33F6C79QB type=write size=3942518 2024-09-12T17:28:50.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.018+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=3O863NR9Y549 type=write size=102653 2024-09-12T17:28:50.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.020+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~KZ8ENWFSA0B0.0 size=1048576 2024-09-12T17:28:50.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.020+0000 7f9d7bc0c780 1 < canceled part key=_multipart_QB8C0OJA1L4X.2~KZ8ENWFSA0B0.1 size=1048576 2024-09-12T17:28:50.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.020+0000 7f9d7bc0c780 1 < canceled part key=_multipart_QB8C0OJA1L4X.2~KZ8ENWFSA0B0.2 size=559612 2024-09-12T17:28:50.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.022+0000 7f9d7bc0c780 1 < canceled multipart upload key=QB8C0OJA1L4X upload=KZ8ENWFSA0B0 tag=5JZLVKV0JJMM type=write size=3705340 2024-09-12T17:28:50.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.023+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=21H43T8GFW6I type=write size=949530 2024-09-12T17:28:50.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.025+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~RURI0WJF5XGG.0 size=1048576 2024-09-12T17:28:50.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.026+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~RURI0WJF5XGG.1 size=1048576 2024-09-12T17:28:50.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.027+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~RURI0WJF5XGG.2 size=1014299 2024-09-12T17:28:50.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.030+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=RURI0WJF5XGG tag=7YUVO0KXJ0WS type=write size=4160027 2024-09-12T17:28:50.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.031+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=6HA6UDIS0UU3 type=del size=3101484 2024-09-12T17:28:50.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.033+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=YVASJQJUFGYT type=del 2024-09-12T17:28:50.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.035+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~JFKMIYNDO5FV.0 size=1048576 2024-09-12T17:28:50.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.037+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~JFKMIYNDO5FV.1 size=1048576 2024-09-12T17:28:50.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.038+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~JFKMIYNDO5FV.2 size=417561 2024-09-12T17:28:50.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.038+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=JFKMIYNDO5FV tag=860QORZHPJQJ type=write size=3563289 2024-09-12T17:28:50.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.039+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=WPL8KCMB0SP7 type=del 2024-09-12T17:28:50.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.042+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~235OW5GXYXIU.0 size=1048576 2024-09-12T17:28:50.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.043+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~235OW5GXYXIU.1 size=1048576 2024-09-12T17:28:50.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.044+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~235OW5GXYXIU.2 size=183762 2024-09-12T17:28:50.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.044+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=235OW5GXYXIU tag=GK10SOU0AUWS type=write size=3329490 2024-09-12T17:28:50.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.045+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~98BRNGVC2UGY.0 size=1048576 2024-09-12T17:28:50.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.047+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~98BRNGVC2UGY.1 size=1048576 2024-09-12T17:28:50.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.048+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~98BRNGVC2UGY.2 size=707298 2024-09-12T17:28:50.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.050+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=98BRNGVC2UGY tag=8GRGNCMBUJQ3 type=write size=3853026 2024-09-12T17:28:50.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.053+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~H260IEUIENZL.0 size=1048576 2024-09-12T17:28:50.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.054+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~H260IEUIENZL.1 size=1048576 2024-09-12T17:28:50.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.055+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~H260IEUIENZL.2 size=282752 2024-09-12T17:28:50.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.055+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=H260IEUIENZL tag=MTL9DBB396Y2 type=write size=3428480 2024-09-12T17:28:50.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.056+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=0N7ALYN4XXER type=del 2024-09-12T17:28:50.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.059+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~TXUY20O5M3SY.0 size=1048576 2024-09-12T17:28:50.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.060+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~TXUY20O5M3SY.1 size=597399 2024-09-12T17:28:50.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.060+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=TXUY20O5M3SY tag=XYJDJJETHYDI type=write size=2694551 2024-09-12T17:28:50.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.062+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~BG1MXTE8RV6B.0 size=1048576 2024-09-12T17:28:50.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.063+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~BG1MXTE8RV6B.1 size=1048576 2024-09-12T17:28:50.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.064+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~BG1MXTE8RV6B.2 size=480404 2024-09-12T17:28:50.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.066+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=BG1MXTE8RV6B tag=TRBSHE8UI9ZO type=write size=3626132 2024-09-12T17:28:50.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.069+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~K7HGZGUJ40KN.0 size=580217 2024-09-12T17:28:50.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.069+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=K7HGZGUJ40KN tag=IKE3USV2EAXD type=write size=1628793 2024-09-12T17:28:50.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.071+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=12U9UF2YCFPH type=del 2024-09-12T17:28:50.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.072+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=YW52GGLZI0PH type=write size=110578 2024-09-12T17:28:50.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.074+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~3UB4VHCPC3QO.0 size=1048576 2024-09-12T17:28:50.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.075+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~3UB4VHCPC3QO.1 size=377053 2024-09-12T17:28:50.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.078+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=3UB4VHCPC3QO tag=1RQK62U9H10V type=write size=2474205 2024-09-12T17:28:50.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.080+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~XGIV32ZM7O0P.0 size=700543 2024-09-12T17:28:50.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.080+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=XGIV32ZM7O0P tag=L9G0OETYMM3T type=write size=1749119 2024-09-12T17:28:50.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.083+0000 7f9d7bc0c780 1 < suggested remove operation key=L72DVWQ63XUW tag=BHCPZCBYWM8R type=del 2024-09-12T17:28:50.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.086+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~6OT7KJNGFQ4X.0 size=1048576 2024-09-12T17:28:50.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.087+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~6OT7KJNGFQ4X.1 size=1048576 2024-09-12T17:28:50.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.088+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~6OT7KJNGFQ4X.2 size=779916 2024-09-12T17:28:50.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.088+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=6OT7KJNGFQ4X tag=3H2N871LF3PJ type=write size=3925644 2024-09-12T17:28:50.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.089+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=IOTBHZOWMN9V type=del 2024-09-12T17:28:50.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.092+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~8HQUTZIDVC1C.0 size=1048576 2024-09-12T17:28:50.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.093+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~8HQUTZIDVC1C.1 size=672866 2024-09-12T17:28:50.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.093+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=8HQUTZIDVC1C tag=BH14BABGV06A type=write size=2770018 2024-09-12T17:28:50.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.093+0000 7f9d7bc0c780 1 < canceled part key=_multipart_R94VERREGANN.2~B5DPVK2P5OW9.0 size=222703 2024-09-12T17:28:50.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.096+0000 7f9d7bc0c780 1 < canceled multipart upload key=R94VERREGANN upload=B5DPVK2P5OW9 tag=XKZNBLEIB4E6 type=write size=1271279 2024-09-12T17:28:50.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.099+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~P749A3966DYT.0 size=728274 2024-09-12T17:28:50.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.099+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=P749A3966DYT tag=SDKK9HSMXX0A type=write size=1776850 2024-09-12T17:28:50.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.102+0000 7f9d7bc0c780 1 < suggested update operation key=R94VERREGANN tag=FHCEPNZUZLC8 type=del size=2668772 2024-09-12T17:28:50.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.104+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=V32UVPIB3CV3 type=del size=592048 2024-09-12T17:28:50.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.105+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~F24GXFDV0J2M.0 size=117662 2024-09-12T17:28:50.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.107+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=F24GXFDV0J2M tag=7IPLV33QC80L type=write size=1166238 2024-09-12T17:28:50.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.109+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=A2M9VTKX5M4O type=write size=616344 2024-09-12T17:28:50.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.110+0000 7f9d7bc0c780 -1 < failed to complete operation key=L72DVWQ63XUW tag=9SIG1JJ00FJ2 type=del size=240412: (22) Invalid argument 2024-09-12T17:28:50.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.113+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~KOHWTOQYLSL9.0 size=1048576 2024-09-12T17:28:50.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.114+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~KOHWTOQYLSL9.1 size=1048576 2024-09-12T17:28:50.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.116+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~KOHWTOQYLSL9.2 size=1001900 2024-09-12T17:28:50.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.116+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=KOHWTOQYLSL9 tag=SJKEINSBVSQW type=write size=4147628 2024-09-12T17:28:50.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.117+0000 7f9d7bc0c780 1 < completed write operation key=QB8C0OJA1L4X tag=3O863NR9Y549 type=write size=102653 2024-09-12T17:28:50.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.120+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~OE6BDFEBTYWK.0 size=1048576 2024-09-12T17:28:50.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.121+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~OE6BDFEBTYWK.1 size=844580 2024-09-12T17:28:50.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.121+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=OE6BDFEBTYWK tag=1CX1HTUXC0G4 type=write size=2941732 2024-09-12T17:28:50.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.123+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=21H43T8GFW6I type=write size=949530 2024-09-12T17:28:50.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.124+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=RD961UIT6SNW type=del size=1091701 2024-09-12T17:28:50.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.126+0000 7f9d7bc0c780 1 < canceled operation key=0BYGD7FTPQF3 tag=6HA6UDIS0UU3 type=del size=3101484 2024-09-12T17:28:50.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.128+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=4ISMZRF9JL4K type=del size=1375491 2024-09-12T17:28:50.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.129+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~JFKMIYNDO5FV.0 size=1048576 2024-09-12T17:28:50.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.131+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~JFKMIYNDO5FV.1 size=1048576 2024-09-12T17:28:50.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.132+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~JFKMIYNDO5FV.2 size=417561 2024-09-12T17:28:50.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.135+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=JFKMIYNDO5FV tag=860QORZHPJQJ type=write size=3563289 2024-09-12T17:28:50.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.138+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~F2NR8TRIYHIB.0 size=1048576 2024-09-12T17:28:50.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.140+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~F2NR8TRIYHIB.1 size=1048576 2024-09-12T17:28:50.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.141+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~F2NR8TRIYHIB.2 size=405614 2024-09-12T17:28:50.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.141+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=F2NR8TRIYHIB tag=XTPC9BBHGA73 type=write size=3551342 2024-09-12T17:28:50.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.143+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~235OW5GXYXIU.0 size=1048576 2024-09-12T17:28:50.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.144+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~235OW5GXYXIU.1 size=1048576 2024-09-12T17:28:50.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.145+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~235OW5GXYXIU.2 size=183762 2024-09-12T17:28:50.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.149+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=235OW5GXYXIU tag=GK10SOU0AUWS type=write size=3329490 2024-09-12T17:28:50.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.152+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~5H0ZXONEXX6P.0 size=1048576 2024-09-12T17:28:50.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.153+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~5H0ZXONEXX6P.1 size=236984 2024-09-12T17:28:50.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.153+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=5H0ZXONEXX6P tag=JEIYICO5EWQ3 type=write size=2334136 2024-09-12T17:28:50.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.155+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~H260IEUIENZL.0 size=1048576 2024-09-12T17:28:50.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.157+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~H260IEUIENZL.1 size=1048576 2024-09-12T17:28:50.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.158+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~H260IEUIENZL.2 size=282752 2024-09-12T17:28:50.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.160+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=H260IEUIENZL tag=MTL9DBB396Y2 type=write size=3428480 2024-09-12T17:28:50.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.163+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~RZWP7C3NE8N9.0 size=657794 2024-09-12T17:28:50.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.163+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=RZWP7C3NE8N9 tag=OV2Q1076Y42K type=write size=1706370 2024-09-12T17:28:50.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.165+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~TXUY20O5M3SY.0 size=1048576 2024-09-12T17:28:50.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.166+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~TXUY20O5M3SY.1 size=597399 2024-09-12T17:28:50.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.169+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=TXUY20O5M3SY tag=XYJDJJETHYDI type=write size=2694551 2024-09-12T17:28:50.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.170+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=GMRKU618PE15 type=del size=56786 2024-09-12T17:28:50.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.172+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~K7HGZGUJ40KN.0 size=580217 2024-09-12T17:28:50.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.175+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=K7HGZGUJ40KN tag=IKE3USV2EAXD type=write size=1628793 2024-09-12T17:28:50.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.177+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~NQCBIBCAK807.0 size=1048576 2024-09-12T17:28:50.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.178+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~NQCBIBCAK807.1 size=464077 2024-09-12T17:28:50.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.178+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=NQCBIBCAK807 tag=4APS4XRZDHW5 type=write size=2561229 2024-09-12T17:28:50.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.180+0000 7f9d7bc0c780 1 < canceled operation key=31PU0U6IEAV2 tag=YW52GGLZI0PH type=write size=110578 2024-09-12T17:28:50.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.181+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=2ENN5RENWJYI type=del size=543526 2024-09-12T17:28:50.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.183+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~XGIV32ZM7O0P.0 size=700543 2024-09-12T17:28:50.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.185+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=XGIV32ZM7O0P tag=L9G0OETYMM3T type=write size=1749119 2024-09-12T17:28:50.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.187+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=KVN3QL0KHHP2 type=del size=825310 2024-09-12T17:28:50.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.188+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~6OT7KJNGFQ4X.0 size=1048576 2024-09-12T17:28:50.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.190+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~6OT7KJNGFQ4X.1 size=1048576 2024-09-12T17:28:50.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.191+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~6OT7KJNGFQ4X.2 size=779916 2024-09-12T17:28:50.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.193+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=6OT7KJNGFQ4X tag=3H2N871LF3PJ type=write size=3925644 2024-09-12T17:28:50.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.195+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=7ZM933702TRJ type=del size=2538022 2024-09-12T17:28:50.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.196+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~8HQUTZIDVC1C.0 size=1048576 2024-09-12T17:28:50.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.197+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~8HQUTZIDVC1C.1 size=672866 2024-09-12T17:28:50.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.200+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=8HQUTZIDVC1C tag=BH14BABGV06A type=write size=2770018 2024-09-12T17:28:50.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.201+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=NGCCI0O8Z2O5 type=write size=415955 2024-09-12T17:28:50.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.203+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~P749A3966DYT.0 size=728274 2024-09-12T17:28:50.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.205+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=P749A3966DYT tag=SDKK9HSMXX0A type=write size=1776850 2024-09-12T17:28:50.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.207+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=O3OD2EBVZV1J type=write size=951803 2024-09-12T17:28:50.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.208+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=V32UVPIB3CV3 type=del 2024-09-12T17:28:50.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.210+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=VZ1HJEQOA7IM type=del size=311739 2024-09-12T17:28:50.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.211+0000 7f9d7bc0c780 1 < completed write operation key=9TE5N5TIB7AD tag=A2M9VTKX5M4O type=write size=616344 2024-09-12T17:28:50.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.213+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=S6ZD7X7Y0REM type=del size=638435 2024-09-12T17:28:50.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.214+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~KOHWTOQYLSL9.0 size=1048576 2024-09-12T17:28:50.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.216+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~KOHWTOQYLSL9.1 size=1048576 2024-09-12T17:28:50.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.217+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~KOHWTOQYLSL9.2 size=1001900 2024-09-12T17:28:50.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.219+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=KOHWTOQYLSL9 tag=SJKEINSBVSQW type=write size=4147628 2024-09-12T17:28:50.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.221+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=GR085UPUH0LT type=write size=851836 2024-09-12T17:28:50.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.222+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~OE6BDFEBTYWK.0 size=1048576 2024-09-12T17:28:50.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.223+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~OE6BDFEBTYWK.1 size=844580 2024-09-12T17:28:50.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.226+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=OE6BDFEBTYWK tag=1CX1HTUXC0G4 type=write size=2941732 2024-09-12T17:28:50.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.227+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=T03C5YE7Q4QF type=del size=4052658 2024-09-12T17:28:50.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.229+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=RD961UIT6SNW type=del 2024-09-12T17:28:50.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.230+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=1HM2R1C9B3DA type=write size=420273 2024-09-12T17:28:50.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.231+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=4ISMZRF9JL4K type=del 2024-09-12T17:28:50.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.233+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=8VBHDW38ACTA type=write size=438123 2024-09-12T17:28:50.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.234+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~F2NR8TRIYHIB.0 size=1048576 2024-09-12T17:28:50.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.235+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~F2NR8TRIYHIB.1 size=1048576 2024-09-12T17:28:50.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.237+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~F2NR8TRIYHIB.2 size=405614 2024-09-12T17:28:50.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.239+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=F2NR8TRIYHIB tag=XTPC9BBHGA73 type=write size=3551342 2024-09-12T17:28:50.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.241+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~SJOGR51YUI7Q.0 size=1048576 2024-09-12T17:28:50.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.242+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~SJOGR51YUI7Q.1 size=708119 2024-09-12T17:28:50.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.242+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=SJOGR51YUI7Q tag=7DF023DRUUAX type=write size=2805271 2024-09-12T17:28:50.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.243+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZA6JC3WXS8Y5.2~5H0ZXONEXX6P.0 size=1048576 2024-09-12T17:28:50.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.244+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~5H0ZXONEXX6P.1 size=236984 2024-09-12T17:28:50.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.246+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZA6JC3WXS8Y5 upload=5H0ZXONEXX6P tag=JEIYICO5EWQ3 type=write size=2334136 2024-09-12T17:28:50.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.248+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~R1BKUMRLZ0S7.0 size=465096 2024-09-12T17:28:50.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.248+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=R1BKUMRLZ0S7 tag=95MYUD5XHXLS type=write size=1513672 2024-09-12T17:28:50.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.250+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~RZWP7C3NE8N9.0 size=657794 2024-09-12T17:28:50.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.252+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=RZWP7C3NE8N9 tag=OV2Q1076Y42K type=write size=1706370 2024-09-12T17:28:50.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.253+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=4PI84N5DZMX9 type=del size=382993 2024-09-12T17:28:50.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.255+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=GMRKU618PE15 type=del 2024-09-12T17:28:50.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.256+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=KQ7MYBAM2W01 type=del size=380930 2024-09-12T17:28:50.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.258+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~NQCBIBCAK807.0 size=1048576 2024-09-12T17:28:50.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.259+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~NQCBIBCAK807.1 size=464077 2024-09-12T17:28:50.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.262+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=NQCBIBCAK807 tag=4APS4XRZDHW5 type=write size=2561229 2024-09-12T17:28:50.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.263+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=MTA584FJVJ4F type=del size=2071298 2024-09-12T17:28:50.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.265+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=2ENN5RENWJYI type=del 2024-09-12T17:28:50.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.268+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~UGEPIPXM9D9X.0 size=1048576 2024-09-12T17:28:50.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.269+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~UGEPIPXM9D9X.1 size=393265 2024-09-12T17:28:50.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.269+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=UGEPIPXM9D9X tag=VIH1H06UNBW1 type=write size=2490417 2024-09-12T17:28:50.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.271+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=KVN3QL0KHHP2 type=del 2024-09-12T17:28:50.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.274+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~PW7ABI9ZZZ2U.0 size=1048576 2024-09-12T17:28:50.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.275+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~PW7ABI9ZZZ2U.1 size=971525 2024-09-12T17:28:50.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.275+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=PW7ABI9ZZZ2U tag=P03KNZQQCC91 type=write size=3068677 2024-09-12T17:28:50.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.277+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=7ZM933702TRJ type=del 2024-09-12T17:28:50.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.280+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~66DUSC48AJ34.0 size=931799 2024-09-12T17:28:50.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.280+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=66DUSC48AJ34 tag=Y0Y5SOPODWAH type=write size=1980375 2024-09-12T17:28:50.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.281+0000 7f9d7bc0c780 1 < canceled operation key=SDX69F30A2RK tag=NGCCI0O8Z2O5 type=write size=415955 2024-09-12T17:28:50.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.284+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~CUON9BJHSQ1V.0 size=1048576 2024-09-12T17:28:50.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.285+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~CUON9BJHSQ1V.1 size=1048576 2024-09-12T17:28:50.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.286+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~CUON9BJHSQ1V.2 size=641877 2024-09-12T17:28:50.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.286+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=CUON9BJHSQ1V tag=1HU2FWUMDZND type=write size=3787605 2024-09-12T17:28:50.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.288+0000 7f9d7bc0c780 1 < completed write operation key=80JXIGQWQGR9 tag=O3OD2EBVZV1J type=write size=951803 2024-09-12T17:28:50.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.291+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~6DXH4BB93ZW2.0 size=1048576 2024-09-12T17:28:50.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.292+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~6DXH4BB93ZW2.1 size=465409 2024-09-12T17:28:50.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.292+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=6DXH4BB93ZW2 tag=RZARJ7CQR8Z9 type=write size=2562561 2024-09-12T17:28:50.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.293+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=VZ1HJEQOA7IM type=del 2024-09-12T17:28:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.295+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=FCOIDT03JAFL type=del size=1781274 2024-09-12T17:28:50.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.297+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=S6ZD7X7Y0REM type=del 2024-09-12T17:28:50.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.299+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~W1CM59HVT5AL.0 size=1048576 2024-09-12T17:28:50.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.300+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~W1CM59HVT5AL.1 size=514720 2024-09-12T17:28:50.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.300+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=W1CM59HVT5AL tag=G6W44KX53RAP type=write size=2611872 2024-09-12T17:28:50.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.302+0000 7f9d7bc0c780 1 < completed write operation key=R94VERREGANN tag=GR085UPUH0LT type=write size=851836 2024-09-12T17:28:50.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.305+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~QYUK9YZRTBOD.0 size=770524 2024-09-12T17:28:50.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.305+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=QYUK9YZRTBOD tag=BKXGUN02CM6S type=write size=1819100 2024-09-12T17:28:50.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.307+0000 7f9d7bc0c780 1 < canceled operation key=ZA6JC3WXS8Y5 tag=T03C5YE7Q4QF type=del size=4052658 2024-09-12T17:28:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.309+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=7ID2O8NKJZO1 type=write size=721336 2024-09-12T17:28:50.311 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.310+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=1HM2R1C9B3DA type=write size=420273 2024-09-12T17:28:50.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.312+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=HUHY0C1YSS4I type=write size=1026433 2024-09-12T17:28:50.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.313+0000 7f9d7bc0c780 1 < completed write operation key=SDX69F30A2RK tag=8VBHDW38ACTA type=write size=438123 2024-09-12T17:28:50.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.314+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=DVWYIY4UYP1C type=del size=914862 2024-09-12T17:28:50.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.316+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~SJOGR51YUI7Q.0 size=1048576 2024-09-12T17:28:50.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.317+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~SJOGR51YUI7Q.1 size=708119 2024-09-12T17:28:50.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.318+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=SJOGR51YUI7Q tag=7DF023DRUUAX type=write size=2805271 2024-09-12T17:28:50.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.320+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=4UBJULESSUFO type=del size=2222389 2024-09-12T17:28:50.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.321+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~R1BKUMRLZ0S7.0 size=465096 2024-09-12T17:28:50.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.324+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=R1BKUMRLZ0S7 tag=95MYUD5XHXLS type=write size=1513672 2024-09-12T17:28:50.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.326+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~BNDTK4X0WUK7.0 size=942904 2024-09-12T17:28:50.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.326+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=BNDTK4X0WUK7 tag=CMXA4SV9YO52 type=write size=1991480 2024-09-12T17:28:50.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.327+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=4PI84N5DZMX9 type=del 2024-09-12T17:28:50.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.330+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~WSNF2XVHDRWO.0 size=442416 2024-09-12T17:28:50.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.330+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=WSNF2XVHDRWO tag=EXKRHJ1NM3BU type=write size=1490992 2024-09-12T17:28:50.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.331+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=KQ7MYBAM2W01 type=del 2024-09-12T17:28:50.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.332+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=13LO1F3TZR70 type=del size=1725066 2024-09-12T17:28:50.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.334+0000 7f9d7bc0c780 1 < canceled operation key=J3YYRIVKQ5AU tag=MTA584FJVJ4F type=del size=2071298 2024-09-12T17:28:50.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.335+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=PD7B9JUADEWW type=del size=2612975 2024-09-12T17:28:50.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.336+0000 7f9d7bc0c780 1 < canceled part key=_multipart_5B96YH46VAK3.2~UGEPIPXM9D9X.0 size=1048576 2024-09-12T17:28:50.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.336+0000 7f9d7bc0c780 1 < canceled part key=_multipart_5B96YH46VAK3.2~UGEPIPXM9D9X.1 size=393265 2024-09-12T17:28:50.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.338+0000 7f9d7bc0c780 1 < canceled multipart upload key=5B96YH46VAK3 upload=UGEPIPXM9D9X tag=VIH1H06UNBW1 type=write size=2490417 2024-09-12T17:28:50.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.341+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~SYIQMP061C4S.0 size=1048576 2024-09-12T17:28:50.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.342+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~SYIQMP061C4S.1 size=1048576 2024-09-12T17:28:50.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.343+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~SYIQMP061C4S.2 size=897080 2024-09-12T17:28:50.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.343+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=SYIQMP061C4S tag=E2WQ9OXG47M4 type=write size=4042808 2024-09-12T17:28:50.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.345+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~PW7ABI9ZZZ2U.0 size=1048576 2024-09-12T17:28:50.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.346+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~PW7ABI9ZZZ2U.1 size=971525 2024-09-12T17:28:50.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.348+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=PW7ABI9ZZZ2U tag=P03KNZQQCC91 type=write size=3068677 2024-09-12T17:28:50.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.351+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~647MMOLJEKM6.0 size=247664 2024-09-12T17:28:50.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.351+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=647MMOLJEKM6 tag=KKFVWWM1SN1V type=write size=1296240 2024-09-12T17:28:50.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.351+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~66DUSC48AJ34.0 size=931799 2024-09-12T17:28:50.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.353+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=66DUSC48AJ34 tag=Y0Y5SOPODWAH type=write size=1980375 2024-09-12T17:28:50.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.354+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=C7WN4AKNZRZ4 type=del size=3862923 2024-09-12T17:28:50.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.356+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~CUON9BJHSQ1V.0 size=1048576 2024-09-12T17:28:50.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.357+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~CUON9BJHSQ1V.1 size=1048576 2024-09-12T17:28:50.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.358+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~CUON9BJHSQ1V.2 size=641877 2024-09-12T17:28:50.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.360+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=CUON9BJHSQ1V tag=1HU2FWUMDZND type=write size=3787605 2024-09-12T17:28:50.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.363+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~QRVKFK505FQL.0 size=1048576 2024-09-12T17:28:50.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.364+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~QRVKFK505FQL.1 size=881297 2024-09-12T17:28:50.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.364+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=QRVKFK505FQL tag=C89530OVRNTH type=write size=2978449 2024-09-12T17:28:50.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.365+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~6DXH4BB93ZW2.0 size=1048576 2024-09-12T17:28:50.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.365+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~6DXH4BB93ZW2.1 size=465409 2024-09-12T17:28:50.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.368+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=6DXH4BB93ZW2 tag=RZARJ7CQR8Z9 type=write size=2562561 2024-09-12T17:28:50.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.370+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~SPD7OQSIJWIJ.0 size=811294 2024-09-12T17:28:50.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.370+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=SPD7OQSIJWIJ tag=1ADQ5S77I4QH type=write size=1859870 2024-09-12T17:28:50.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.373+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=FCOIDT03JAFL type=del size=1781274 2024-09-12T17:28:50.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.376+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~YGR2DR0M7EB3.0 size=767889 2024-09-12T17:28:50.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.376+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=YGR2DR0M7EB3 tag=0MW51SAZQR4V type=write size=1816465 2024-09-12T17:28:50.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.377+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~W1CM59HVT5AL.0 size=1048576 2024-09-12T17:28:50.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.377+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9B83KWC5E4ZV.2~W1CM59HVT5AL.1 size=514720 2024-09-12T17:28:50.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.380+0000 7f9d7bc0c780 1 < canceled multipart upload key=9B83KWC5E4ZV upload=W1CM59HVT5AL tag=G6W44KX53RAP type=write size=2611872 2024-09-12T17:28:50.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.382+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~HBWPI29NJ6CY.0 size=929685 2024-09-12T17:28:50.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.382+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=HBWPI29NJ6CY tag=A1BTEVPNMC00 type=write size=1978261 2024-09-12T17:28:50.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.384+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~QYUK9YZRTBOD.0 size=770524 2024-09-12T17:28:50.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.386+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=QYUK9YZRTBOD tag=BKXGUN02CM6S type=write size=1819100 2024-09-12T17:28:50.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.389+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~JZXUAPWD9BMK.0 size=1048576 2024-09-12T17:28:50.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.390+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~JZXUAPWD9BMK.1 size=1048576 2024-09-12T17:28:50.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.391+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~JZXUAPWD9BMK.2 size=800148 2024-09-12T17:28:50.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.391+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=JZXUAPWD9BMK tag=RZDHE13NPUP9 type=write size=3945876 2024-09-12T17:28:50.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.392+0000 7f9d7bc0c780 1 < completed write operation key=ZA6JC3WXS8Y5 tag=7ID2O8NKJZO1 type=write size=721336 2024-09-12T17:28:50.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.393+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=PMXBSRB47AJ6 type=del size=1246428 2024-09-12T17:28:50.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.395+0000 7f9d7bc0c780 1 < completed write operation key=AOT2ZKFTD0HY tag=HUHY0C1YSS4I type=write size=1026433 2024-09-12T17:28:50.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.397+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~S0X742BE2ESG.0 size=1048576 2024-09-12T17:28:50.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.399+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~S0X742BE2ESG.1 size=62809 2024-09-12T17:28:50.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.399+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=S0X742BE2ESG tag=09CBD4W2RX0R type=write size=2159961 2024-09-12T17:28:50.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.401+0000 7f9d7bc0c780 1 < suggested remove operation key=LJZNPSVLS9AF tag=DVWYIY4UYP1C type=del 2024-09-12T17:28:50.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.403+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=IWP9HI3Y402O type=del size=1132087 2024-09-12T17:28:50.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.405+0000 7f9d7bc0c780 -1 < failed to complete operation key=9TE5N5TIB7AD tag=4UBJULESSUFO type=del size=2222389: (22) Invalid argument 2024-09-12T17:28:50.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.407+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~BZM8OY8YHJJ2.0 size=1048576 2024-09-12T17:28:50.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.408+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~BZM8OY8YHJJ2.1 size=1048576 2024-09-12T17:28:50.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.409+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~BZM8OY8YHJJ2.2 size=499451 2024-09-12T17:28:50.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.409+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=BZM8OY8YHJJ2 tag=MGMJD1XIJ3QM type=write size=3645179 2024-09-12T17:28:50.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.410+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~BNDTK4X0WUK7.0 size=942904 2024-09-12T17:28:50.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.412+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=BNDTK4X0WUK7 tag=CMXA4SV9YO52 type=write size=1991480 2024-09-12T17:28:50.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.414+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=Q8P7KE2NH589 type=del size=3986040 2024-09-12T17:28:50.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.416+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~WSNF2XVHDRWO.0 size=442416 2024-09-12T17:28:50.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.418+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=WSNF2XVHDRWO tag=EXKRHJ1NM3BU type=write size=1490992 2024-09-12T17:28:50.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.420+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=G5SAZO5YTO1R type=del size=2379346 2024-09-12T17:28:50.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.421+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=13LO1F3TZR70 type=del 2024-09-12T17:28:50.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.424+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~03XIVS58BU3S.0 size=1048576 2024-09-12T17:28:50.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.425+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~03XIVS58BU3S.1 size=777 2024-09-12T17:28:50.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.425+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=03XIVS58BU3S tag=93V0JR21K8GI type=write size=2097929 2024-09-12T17:28:50.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.428+0000 7f9d7bc0c780 1 < suggested update operation key=QB8C0OJA1L4X tag=PD7B9JUADEWW type=del size=2612975 2024-09-12T17:28:50.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.430+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~6H6YMUY1P1ME.0 size=1048576 2024-09-12T17:28:50.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.431+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~6H6YMUY1P1ME.1 size=255168 2024-09-12T17:28:50.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.431+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=6H6YMUY1P1ME tag=R2QJK69B3SOD type=write size=2352320 2024-09-12T17:28:50.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.433+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~SYIQMP061C4S.0 size=1048576 2024-09-12T17:28:50.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.434+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~SYIQMP061C4S.1 size=1048576 2024-09-12T17:28:50.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.435+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~SYIQMP061C4S.2 size=897080 2024-09-12T17:28:50.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.437+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=SYIQMP061C4S tag=E2WQ9OXG47M4 type=write size=4042808 2024-09-12T17:28:50.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.440+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~0OD9JPLWPQUP.0 size=1048576 2024-09-12T17:28:50.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.441+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~0OD9JPLWPQUP.1 size=921061 2024-09-12T17:28:50.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.441+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=0OD9JPLWPQUP tag=1NSXE2TPI2RX type=write size=3018213 2024-09-12T17:28:50.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.443+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~647MMOLJEKM6.0 size=247664 2024-09-12T17:28:50.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.445+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=647MMOLJEKM6 tag=KKFVWWM1SN1V type=write size=1296240 2024-09-12T17:28:50.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.448+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~W3R318HA2U87.0 size=1048576 2024-09-12T17:28:50.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.449+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~W3R318HA2U87.1 size=684557 2024-09-12T17:28:50.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.449+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=W3R318HA2U87 tag=FU2DDJQAAA62 type=write size=2781709 2024-09-12T17:28:50.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.450+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=C7WN4AKNZRZ4 type=del 2024-09-12T17:28:50.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.453+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~T7I235V5XDI2.0 size=1048576 2024-09-12T17:28:50.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.455+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~T7I235V5XDI2.1 size=1048576 2024-09-12T17:28:50.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.456+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~T7I235V5XDI2.2 size=441830 2024-09-12T17:28:50.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.456+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=T7I235V5XDI2 tag=37ZG9J19YILK type=write size=3587558 2024-09-12T17:28:50.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.457+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~QRVKFK505FQL.0 size=1048576 2024-09-12T17:28:50.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.458+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~QRVKFK505FQL.1 size=881297 2024-09-12T17:28:50.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.461+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=QRVKFK505FQL tag=C89530OVRNTH type=write size=2978449 2024-09-12T17:28:50.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.464+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~ZCA1ADFGE1JM.0 size=1048576 2024-09-12T17:28:50.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.465+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~ZCA1ADFGE1JM.1 size=1048576 2024-09-12T17:28:50.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.466+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~ZCA1ADFGE1JM.2 size=417834 2024-09-12T17:28:50.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.466+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=ZCA1ADFGE1JM tag=ZX2NDGMZ99P0 type=write size=3563562 2024-09-12T17:28:50.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.468+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~SPD7OQSIJWIJ.0 size=811294 2024-09-12T17:28:50.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.470+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=SPD7OQSIJWIJ tag=1ADQ5S77I4QH type=write size=1859870 2024-09-12T17:28:50.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.473+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~TSSF8Z24I7VW.0 size=1048576 2024-09-12T17:28:50.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.474+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~TSSF8Z24I7VW.1 size=545063 2024-09-12T17:28:50.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.474+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=TSSF8Z24I7VW tag=1HX3ADTHVVSN type=write size=2642215 2024-09-12T17:28:50.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.475+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~YGR2DR0M7EB3.0 size=767889 2024-09-12T17:28:50.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.478+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=YGR2DR0M7EB3 tag=0MW51SAZQR4V type=write size=1816465 2024-09-12T17:28:50.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.479+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=O0G79RFXYOK7 type=del size=158541 2024-09-12T17:28:50.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.480+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~HBWPI29NJ6CY.0 size=929685 2024-09-12T17:28:50.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.482+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=HBWPI29NJ6CY tag=A1BTEVPNMC00 type=write size=1978261 2024-09-12T17:28:50.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.484+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=ZJVHEFBOZRU8 type=del size=691447 2024-09-12T17:28:50.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.485+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~JZXUAPWD9BMK.0 size=1048576 2024-09-12T17:28:50.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.486+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~JZXUAPWD9BMK.1 size=1048576 2024-09-12T17:28:50.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.487+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~JZXUAPWD9BMK.2 size=800148 2024-09-12T17:28:50.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.489+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=JZXUAPWD9BMK tag=RZDHE13NPUP9 type=write size=3945876 2024-09-12T17:28:50.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.491+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=E2S9X5PYEVT2 type=del size=2959154 2024-09-12T17:28:50.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.492+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=PMXBSRB47AJ6 type=del 2024-09-12T17:28:50.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.495+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~TL1L863CUD34.0 size=53195 2024-09-12T17:28:50.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.495+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=TL1L863CUD34 tag=KQ2GFZD25DD4 type=write size=1101771 2024-09-12T17:28:50.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.496+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~S0X742BE2ESG.0 size=1048576 2024-09-12T17:28:50.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.497+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~S0X742BE2ESG.1 size=62809 2024-09-12T17:28:50.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.499+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=S0X742BE2ESG tag=09CBD4W2RX0R type=write size=2159961 2024-09-12T17:28:50.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.501+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=M9H132I2LPNG type=del size=2811763 2024-09-12T17:28:50.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.502+0000 7f9d7bc0c780 1 < canceled operation key=ZM8NMC18RN3I tag=IWP9HI3Y402O type=del size=1132087 2024-09-12T17:28:50.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.504+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=E5N5CE05Z3PE type=write size=752755 2024-09-12T17:28:50.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.505+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~BZM8OY8YHJJ2.0 size=1048576 2024-09-12T17:28:50.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.505+0000 7f9d7bc0c780 1 < canceled part key=_multipart_5B96YH46VAK3.2~BZM8OY8YHJJ2.1 size=1048576 2024-09-12T17:28:50.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.506+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~BZM8OY8YHJJ2.2 size=499451 2024-09-12T17:28:50.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.509+0000 7f9d7bc0c780 1 < canceled multipart upload key=5B96YH46VAK3 upload=BZM8OY8YHJJ2 tag=MGMJD1XIJ3QM type=write size=3645179 2024-09-12T17:28:50.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.510+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=UBYT05Y230L3 type=del size=3360970 2024-09-12T17:28:50.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.512+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=Q8P7KE2NH589 type=del 2024-09-12T17:28:50.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.514+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~AF86D5MO4QK5.0 size=752471 2024-09-12T17:28:50.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.514+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=AF86D5MO4QK5 tag=DTX9YW7BXZPJ type=write size=1801047 2024-09-12T17:28:50.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.516+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=G5SAZO5YTO1R type=del 2024-09-12T17:28:50.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.517+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=XP2FZG51F9OJ type=del size=498487 2024-09-12T17:28:50.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.519+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~03XIVS58BU3S.0 size=1048576 2024-09-12T17:28:50.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.520+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~03XIVS58BU3S.1 size=777 2024-09-12T17:28:50.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.522+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=03XIVS58BU3S tag=93V0JR21K8GI type=write size=2097929 2024-09-12T17:28:50.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.523+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=OTN3BT306Q7W type=del size=812674 2024-09-12T17:28:50.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.525+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~6H6YMUY1P1ME.0 size=1048576 2024-09-12T17:28:50.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.526+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~6H6YMUY1P1ME.1 size=255168 2024-09-12T17:28:50.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.528+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=6H6YMUY1P1ME tag=R2QJK69B3SOD type=write size=2352320 2024-09-12T17:28:50.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.530+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=IEJJO6EVSZW8 type=del size=4042809 2024-09-12T17:28:50.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.531+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~0OD9JPLWPQUP.0 size=1048576 2024-09-12T17:28:50.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.533+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~0OD9JPLWPQUP.1 size=921061 2024-09-12T17:28:50.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.536+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=0OD9JPLWPQUP tag=1NSXE2TPI2RX type=write size=3018213 2024-09-12T17:28:50.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.539+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~CVY3B9U9X27K.0 size=1048576 2024-09-12T17:28:50.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.541+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~CVY3B9U9X27K.1 size=928380 2024-09-12T17:28:50.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.541+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=CVY3B9U9X27K tag=T62EWWAYUW06 type=write size=3025532 2024-09-12T17:28:50.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.542+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~W3R318HA2U87.0 size=1048576 2024-09-12T17:28:50.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.544+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~W3R318HA2U87.1 size=684557 2024-09-12T17:28:50.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.547+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=W3R318HA2U87 tag=FU2DDJQAAA62 type=write size=2781709 2024-09-12T17:28:50.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.549+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=WGZQG7SR65HR type=write size=590575 2024-09-12T17:28:50.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.550+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~T7I235V5XDI2.0 size=1048576 2024-09-12T17:28:50.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.552+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~T7I235V5XDI2.1 size=1048576 2024-09-12T17:28:50.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.553+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~T7I235V5XDI2.2 size=441830 2024-09-12T17:28:50.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.556+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=T7I235V5XDI2 tag=37ZG9J19YILK type=write size=3587558 2024-09-12T17:28:50.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.558+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=2ZGNA2ZSFCZQ type=del size=105398 2024-09-12T17:28:50.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.559+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~ZCA1ADFGE1JM.0 size=1048576 2024-09-12T17:28:50.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.560+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~ZCA1ADFGE1JM.1 size=1048576 2024-09-12T17:28:50.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.560+0000 7f9d7bc0c780 1 < canceled part key=_multipart_64T291B0U226.2~ZCA1ADFGE1JM.2 size=417834 2024-09-12T17:28:50.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.563+0000 7f9d7bc0c780 1 < canceled multipart upload key=64T291B0U226 upload=ZCA1ADFGE1JM tag=ZX2NDGMZ99P0 type=write size=3563562 2024-09-12T17:28:50.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.565+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~H99RCAKDVLIH.0 size=1048576 2024-09-12T17:28:50.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.567+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~H99RCAKDVLIH.1 size=1048576 2024-09-12T17:28:50.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.568+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~H99RCAKDVLIH.2 size=614809 2024-09-12T17:28:50.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.568+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=H99RCAKDVLIH tag=K1QOHGCUD62W type=write size=3760537 2024-09-12T17:28:50.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.570+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~TSSF8Z24I7VW.0 size=1048576 2024-09-12T17:28:50.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.571+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~TSSF8Z24I7VW.1 size=545063 2024-09-12T17:28:50.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.573+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=TSSF8Z24I7VW tag=1HX3ADTHVVSN type=write size=2642215 2024-09-12T17:28:50.575 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.574+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=CLG6SKWITMR2 type=del size=259011 2024-09-12T17:28:50.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.576+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=O0G79RFXYOK7 type=del 2024-09-12T17:28:50.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.578+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~DFHCEY1DY4CW.0 size=334496 2024-09-12T17:28:50.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.578+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=DFHCEY1DY4CW tag=640VGUMZW3PT type=write size=1383072 2024-09-12T17:28:50.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.581+0000 7f9d7bc0c780 1 < suggested remove operation key=0JN5WWDYEM6Q tag=ZJVHEFBOZRU8 type=del 2024-09-12T17:28:50.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.584+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~L41YVXJTU9VA.0 size=52929 2024-09-12T17:28:50.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.584+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=L41YVXJTU9VA tag=J4MVYYWO08BS type=write size=1101505 2024-09-12T17:28:50.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.587+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=E2S9X5PYEVT2 type=del 2024-09-12T17:28:50.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.588+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=21MI54F7VN9N type=del size=3380075 2024-09-12T17:28:50.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.590+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~TL1L863CUD34.0 size=53195 2024-09-12T17:28:50.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.592+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=TL1L863CUD34 tag=KQ2GFZD25DD4 type=write size=1101771 2024-09-12T17:28:50.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.595+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~916L16ZCWR41.0 size=392338 2024-09-12T17:28:50.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.595+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=916L16ZCWR41 tag=KRI2749YYJ9D type=write size=1440914 2024-09-12T17:28:50.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.596+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=M9H132I2LPNG type=del 2024-09-12T17:28:50.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.598+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=19ARFFOV9GXH type=del size=3295044 2024-09-12T17:28:50.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.600+0000 7f9d7bc0c780 1 < completed write operation key=R94VERREGANN tag=E5N5CE05Z3PE type=write size=752755 2024-09-12T17:28:50.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.602+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~2TIKDLQWO4LG.0 size=258146 2024-09-12T17:28:50.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.602+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=2TIKDLQWO4LG tag=40TJ0CABZCVZ type=write size=1306722 2024-09-12T17:28:50.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.603+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=UBYT05Y230L3 type=del 2024-09-12T17:28:50.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.605+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=0YQIXEDG3RTT type=del size=2359259 2024-09-12T17:28:50.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.607+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~AF86D5MO4QK5.0 size=752471 2024-09-12T17:28:50.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.610+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=AF86D5MO4QK5 tag=DTX9YW7BXZPJ type=write size=1801047 2024-09-12T17:28:50.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.611+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=BJHDWED15FPF type=del size=2606577 2024-09-12T17:28:50.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.613+0000 7f9d7bc0c780 -1 < failed to complete operation key=58C4SS3TN12K tag=XP2FZG51F9OJ type=del size=498487: (22) Invalid argument 2024-09-12T17:28:50.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.616+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6F56B9OE7ULQ.0 size=864921 2024-09-12T17:28:50.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.616+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=6F56B9OE7ULQ tag=AHR1M27STHVN type=write size=1913497 2024-09-12T17:28:50.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.617+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=OTN3BT306Q7W type=del 2024-09-12T17:28:50.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.620+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~DGDBUUU188NP.0 size=1048576 2024-09-12T17:28:50.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.621+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~DGDBUUU188NP.1 size=1048576 2024-09-12T17:28:50.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.622+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~DGDBUUU188NP.2 size=735870 2024-09-12T17:28:50.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.622+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=DGDBUUU188NP tag=PUG6IKBB5DNF type=write size=3881598 2024-09-12T17:28:50.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.624+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=IEJJO6EVSZW8 type=del 2024-09-12T17:28:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.626+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~L07ZEHPZCDM1.0 size=857915 2024-09-12T17:28:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.626+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=L07ZEHPZCDM1 tag=MW6Z3D4KSQXV type=write size=1906491 2024-09-12T17:28:50.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.628+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~CVY3B9U9X27K.0 size=1048576 2024-09-12T17:28:50.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.629+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~CVY3B9U9X27K.1 size=928380 2024-09-12T17:28:50.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.631+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=CVY3B9U9X27K tag=T62EWWAYUW06 type=write size=3025532 2024-09-12T17:28:50.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.634+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~NRY3F5TZ0N4Y.0 size=963259 2024-09-12T17:28:50.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.634+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=NRY3F5TZ0N4Y tag=1YSM1EQMAQS2 type=write size=2011835 2024-09-12T17:28:50.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.635+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=WGZQG7SR65HR type=write size=590575 2024-09-12T17:28:50.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.637+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=JRCDE45HOF9I type=write size=449451 2024-09-12T17:28:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.639+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=2ZGNA2ZSFCZQ type=del 2024-09-12T17:28:50.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.640+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=G3ASYVBM1CD6 type=write size=435277 2024-09-12T17:28:50.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.642+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~H99RCAKDVLIH.0 size=1048576 2024-09-12T17:28:50.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.643+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~H99RCAKDVLIH.1 size=1048576 2024-09-12T17:28:50.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.644+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~H99RCAKDVLIH.2 size=614809 2024-09-12T17:28:50.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.647+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=H99RCAKDVLIH tag=K1QOHGCUD62W type=write size=3760537 2024-09-12T17:28:50.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.648+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=XKM80B8JHTNA type=del size=1833187 2024-09-12T17:28:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.650+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=CLG6SKWITMR2 type=del 2024-09-12T17:28:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.652+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=4HMQ9HVX3ZTU type=del size=2825931 2024-09-12T17:28:50.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.653+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~DFHCEY1DY4CW.0 size=334496 2024-09-12T17:28:50.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.656+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=DFHCEY1DY4CW tag=640VGUMZW3PT type=write size=1383072 2024-09-12T17:28:50.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.658+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=2GAA0QU8M2JA type=del size=2707460 2024-09-12T17:28:50.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.659+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~L41YVXJTU9VA.0 size=52929 2024-09-12T17:28:50.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.662+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=L41YVXJTU9VA tag=J4MVYYWO08BS type=write size=1101505 2024-09-12T17:28:50.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.663+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=4RA7HCOJRHON type=del size=2187925 2024-09-12T17:28:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.667+0000 7f9d7bc0c780 1 < suggested update operation key=J3YYRIVKQ5AU tag=21MI54F7VN9N type=del size=3380075 2024-09-12T17:28:50.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.670+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~NRWJXONKNKQ5.0 size=1048576 2024-09-12T17:28:50.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.671+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~NRWJXONKNKQ5.1 size=521944 2024-09-12T17:28:50.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.671+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=NRWJXONKNKQ5 tag=LICPZUM0DJUQ type=write size=2619096 2024-09-12T17:28:50.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.673+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~916L16ZCWR41.0 size=392338 2024-09-12T17:28:50.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.675+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=916L16ZCWR41 tag=KRI2749YYJ9D type=write size=1440914 2024-09-12T17:28:50.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.677+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=4J83DUF72MVY type=del size=3876404 2024-09-12T17:28:50.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.679+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=19ARFFOV9GXH type=del 2024-09-12T17:28:50.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.681+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=OG9X62VHNQ47 type=del size=3683982 2024-09-12T17:28:50.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.682+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~2TIKDLQWO4LG.0 size=258146 2024-09-12T17:28:50.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.685+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=2TIKDLQWO4LG tag=40TJ0CABZCVZ type=write size=1306722 2024-09-12T17:28:50.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.687+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~LUQN9FJNGOPB.0 size=1048576 2024-09-12T17:28:50.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.689+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~LUQN9FJNGOPB.1 size=329638 2024-09-12T17:28:50.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.689+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=LUQN9FJNGOPB tag=TQ3VU7Q68RW8 type=write size=2426790 2024-09-12T17:28:50.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.690+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=0YQIXEDG3RTT type=del 2024-09-12T17:28:50.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.693+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~8J4T6YDZ79FD.0 size=1048576 2024-09-12T17:28:50.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.694+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~8J4T6YDZ79FD.1 size=1048576 2024-09-12T17:28:50.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.695+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~8J4T6YDZ79FD.2 size=537600 2024-09-12T17:28:50.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.695+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=8J4T6YDZ79FD tag=LTKJ8NMVGJLQ type=write size=3683328 2024-09-12T17:28:50.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.697+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=BJHDWED15FPF type=del 2024-09-12T17:28:50.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.700+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~Z6RLLWFT4I1R.0 size=7897 2024-09-12T17:28:50.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.700+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=Z6RLLWFT4I1R tag=WYL23SVUT5G7 type=write size=1056473 2024-09-12T17:28:50.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.701+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6F56B9OE7ULQ.0 size=864921 2024-09-12T17:28:50.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.704+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=6F56B9OE7ULQ tag=AHR1M27STHVN type=write size=1913497 2024-09-12T17:28:50.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.706+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~YTVZ7DHN8QJU.0 size=312849 2024-09-12T17:28:50.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.706+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=YTVZ7DHN8QJU tag=6T7EAP54D7D3 type=write size=1361425 2024-09-12T17:28:50.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.708+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~DGDBUUU188NP.0 size=1048576 2024-09-12T17:28:50.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.709+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~DGDBUUU188NP.1 size=1048576 2024-09-12T17:28:50.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.710+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~DGDBUUU188NP.2 size=735870 2024-09-12T17:28:50.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.713+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=DGDBUUU188NP tag=PUG6IKBB5DNF type=write size=3881598 2024-09-12T17:28:50.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.714+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=WG2OZ0UN7EQP type=del size=1599662 2024-09-12T17:28:50.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.716+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~L07ZEHPZCDM1.0 size=857915 2024-09-12T17:28:50.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.718+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=L07ZEHPZCDM1 tag=MW6Z3D4KSQXV type=write size=1906491 2024-09-12T17:28:50.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.721+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~VBZ7XZKZA2W1.0 size=1048576 2024-09-12T17:28:50.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.722+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~VBZ7XZKZA2W1.1 size=1048576 2024-09-12T17:28:50.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.723+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~VBZ7XZKZA2W1.2 size=541219 2024-09-12T17:28:50.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.723+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=VBZ7XZKZA2W1 tag=HMZ1G5OL0UMR type=write size=3686947 2024-09-12T17:28:50.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.725+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~NRY3F5TZ0N4Y.0 size=963259 2024-09-12T17:28:50.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.727+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=NRY3F5TZ0N4Y tag=1YSM1EQMAQS2 type=write size=2011835 2024-09-12T17:28:50.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.728+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=8W1LTICTO4KT type=write size=228635 2024-09-12T17:28:50.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.730+0000 7f9d7bc0c780 1 < completed write operation key=R94VERREGANN tag=JRCDE45HOF9I type=write size=449451 2024-09-12T17:28:50.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.731+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=QHC8QL0HDX8K type=del size=992455 2024-09-12T17:28:50.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.733+0000 7f9d7bc0c780 1 < canceled operation key=G5ZKTTY1XQ9T tag=G3ASYVBM1CD6 type=write size=435277 2024-09-12T17:28:50.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.736+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~4VQG6IPKSMP9.0 size=1048576 2024-09-12T17:28:50.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.737+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~4VQG6IPKSMP9.1 size=1048576 2024-09-12T17:28:50.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.738+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~4VQG6IPKSMP9.2 size=83594 2024-09-12T17:28:50.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.738+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=4VQG6IPKSMP9 tag=BJ5ARYYGPA17 type=write size=3229322 2024-09-12T17:28:50.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.739+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=XKM80B8JHTNA type=del 2024-09-12T17:28:50.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.741+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=E2NJ6N2CESBA type=write size=259714 2024-09-12T17:28:50.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.743+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=4HMQ9HVX3ZTU type=del 2024-09-12T17:28:50.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.744+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=F73UEITNPCN1 type=del size=2421796 2024-09-12T17:28:50.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.745+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=2GAA0QU8M2JA type=del 2024-09-12T17:28:50.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.747+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=36WN26ZFVCFF type=del size=4187498 2024-09-12T17:28:50.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.748+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=4RA7HCOJRHON type=del 2024-09-12T17:28:50.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.749+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=XCYWTEW7NM60 type=del size=1225127 2024-09-12T17:28:50.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.751+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~NRWJXONKNKQ5.0 size=1048576 2024-09-12T17:28:50.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.752+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~NRWJXONKNKQ5.1 size=521944 2024-09-12T17:28:50.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.754+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=NRWJXONKNKQ5 tag=LICPZUM0DJUQ type=write size=2619096 2024-09-12T17:28:50.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.756+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=WU3LPILNN77D type=write size=586175 2024-09-12T17:28:50.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.759+0000 7f9d7bc0c780 1 < suggested remove operation key=J3YYRIVKQ5AU tag=4J83DUF72MVY type=del 2024-09-12T17:28:50.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.760+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=ZAATG1HXMSSN type=del size=4028680 2024-09-12T17:28:50.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.761+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=OG9X62VHNQ47 type=del 2024-09-12T17:28:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.765+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~1S38PH3Y2P7I.0 size=1048576 2024-09-12T17:28:50.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.766+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~1S38PH3Y2P7I.1 size=1048576 2024-09-12T17:28:50.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.767+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~1S38PH3Y2P7I.2 size=444663 2024-09-12T17:28:50.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.767+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=1S38PH3Y2P7I tag=DZO3FD5MY7HA type=write size=3590391 2024-09-12T17:28:50.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.768+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~LUQN9FJNGOPB.0 size=1048576 2024-09-12T17:28:50.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.769+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~LUQN9FJNGOPB.1 size=329638 2024-09-12T17:28:50.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.772+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=LUQN9FJNGOPB tag=TQ3VU7Q68RW8 type=write size=2426790 2024-09-12T17:28:50.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.773+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=L6YHRJHL1HFG type=del size=1940625 2024-09-12T17:28:50.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.773+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~8J4T6YDZ79FD.0 size=1048576 2024-09-12T17:28:50.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.775+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~8J4T6YDZ79FD.1 size=1048576 2024-09-12T17:28:50.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.776+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~8J4T6YDZ79FD.2 size=537600 2024-09-12T17:28:50.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.778+0000 7f9d7bc0c780 1 < canceled multipart upload key=FU7ARIH2X839 upload=8J4T6YDZ79FD tag=LTKJ8NMVGJLQ type=write size=3683328 2024-09-12T17:28:50.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.779+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=JRHXABRKGBSA type=del size=2566401 2024-09-12T17:28:50.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.781+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~Z6RLLWFT4I1R.0 size=7897 2024-09-12T17:28:50.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.783+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=Z6RLLWFT4I1R tag=WYL23SVUT5G7 type=write size=1056473 2024-09-12T17:28:50.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.785+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~NXUZ1ZJ4UUJG.0 size=1048576 2024-09-12T17:28:50.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.786+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~NXUZ1ZJ4UUJG.1 size=21077 2024-09-12T17:28:50.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.786+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=NXUZ1ZJ4UUJG tag=CFUE8SHN31PW type=write size=2118229 2024-09-12T17:28:50.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.788+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~YTVZ7DHN8QJU.0 size=312849 2024-09-12T17:28:50.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.790+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=YTVZ7DHN8QJU tag=6T7EAP54D7D3 type=write size=1361425 2024-09-12T17:28:50.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.791+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=7JZN3DB94LFI type=del size=1567192 2024-09-12T17:28:50.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.793+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=WG2OZ0UN7EQP type=del 2024-09-12T17:28:50.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.795+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~LIL7LDY4IWX3.0 size=1048576 2024-09-12T17:28:50.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.797+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~LIL7LDY4IWX3.1 size=1048576 2024-09-12T17:28:50.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.798+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~LIL7LDY4IWX3.2 size=769867 2024-09-12T17:28:50.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.798+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=LIL7LDY4IWX3 tag=JRB19VIQ640U type=write size=3915595 2024-09-12T17:28:50.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.799+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~VBZ7XZKZA2W1.0 size=1048576 2024-09-12T17:28:50.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.800+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~VBZ7XZKZA2W1.1 size=1048576 2024-09-12T17:28:50.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.802+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~VBZ7XZKZA2W1.2 size=541219 2024-09-12T17:28:50.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.804+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=VBZ7XZKZA2W1 tag=HMZ1G5OL0UMR type=write size=3686947 2024-09-12T17:28:50.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.806+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~OVVGG8UXEHF0.0 size=317829 2024-09-12T17:28:50.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.806+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=OVVGG8UXEHF0 tag=F3R8NXAJX3O5 type=write size=1366405 2024-09-12T17:28:50.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.808+0000 7f9d7bc0c780 1 < completed write operation key=SDX69F30A2RK tag=8W1LTICTO4KT type=write size=228635 2024-09-12T17:28:50.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.810+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=BG57IC3STVBP type=write size=310043 2024-09-12T17:28:50.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.811+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=QHC8QL0HDX8K type=del 2024-09-12T17:28:50.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.813+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=3QZOERGQJZ7W type=del size=3001569 2024-09-12T17:28:50.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.814+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~4VQG6IPKSMP9.0 size=1048576 2024-09-12T17:28:50.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.815+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~4VQG6IPKSMP9.1 size=1048576 2024-09-12T17:28:50.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.816+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~4VQG6IPKSMP9.2 size=83594 2024-09-12T17:28:50.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.818+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=4VQG6IPKSMP9 tag=BJ5ARYYGPA17 type=write size=3229322 2024-09-12T17:28:50.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.821+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~BQ4RPOWW29JR.0 size=1045686 2024-09-12T17:28:50.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.821+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=BQ4RPOWW29JR tag=4F5KUGC0TC0W type=write size=2094262 2024-09-12T17:28:50.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.822+0000 7f9d7bc0c780 1 < completed write operation key=4V2IYJRP2PZI tag=E2NJ6N2CESBA type=write size=259714 2024-09-12T17:28:50.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.824+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=Q4L6X25NTKCQ type=del size=3707395 2024-09-12T17:28:50.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.825+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=F73UEITNPCN1 type=del 2024-09-12T17:28:50.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.828+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~PF1AQBLFNW9M.0 size=262114 2024-09-12T17:28:50.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.828+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=PF1AQBLFNW9M tag=YTDRNYGEGCYX type=write size=1310690 2024-09-12T17:28:50.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.829+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=36WN26ZFVCFF type=del 2024-09-12T17:28:50.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.831+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=ZDRCA0QCCD8L type=del size=4062591 2024-09-12T17:28:50.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.832+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=XCYWTEW7NM60 type=del 2024-09-12T17:28:50.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.834+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=NOW06WLCT1VN type=write size=239559 2024-09-12T17:28:50.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.835+0000 7f9d7bc0c780 1 < canceled operation key=80JXIGQWQGR9 tag=WU3LPILNN77D type=write size=586175 2024-09-12T17:28:50.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.837+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=GF3PQ4KQ14KE type=del size=3709978 2024-09-12T17:28:50.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.839+0000 7f9d7bc0c780 1 < suggested remove operation key=AOT2ZKFTD0HY tag=ZAATG1HXMSSN type=del 2024-09-12T17:28:50.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.841+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=QLM0EB1L6TNG type=del size=3626377 2024-09-12T17:28:50.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.842+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~1S38PH3Y2P7I.0 size=1048576 2024-09-12T17:28:50.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.842+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9B83KWC5E4ZV.2~1S38PH3Y2P7I.1 size=1048576 2024-09-12T17:28:50.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.844+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~1S38PH3Y2P7I.2 size=444663 2024-09-12T17:28:50.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.846+0000 7f9d7bc0c780 1 < canceled multipart upload key=9B83KWC5E4ZV upload=1S38PH3Y2P7I tag=DZO3FD5MY7HA type=write size=3590391 2024-09-12T17:28:50.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.849+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~F5U0HNP9ST8O.0 size=869812 2024-09-12T17:28:50.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.849+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=F5U0HNP9ST8O tag=O4CMPGESMF3P type=write size=1918388 2024-09-12T17:28:50.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.852+0000 7f9d7bc0c780 1 < suggested update operation key=M3Q7I7MD7M4I tag=L6YHRJHL1HFG type=del size=1940625 2024-09-12T17:28:50.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.853+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=B2EL14DEK4IA type=del size=100644 2024-09-12T17:28:50.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.855+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=JRHXABRKGBSA type=del 2024-09-12T17:28:50.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.856+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=ZD38TV9H1523 type=del size=2505571 2024-09-12T17:28:50.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.858+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~NXUZ1ZJ4UUJG.0 size=1048576 2024-09-12T17:28:50.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.859+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~NXUZ1ZJ4UUJG.1 size=21077 2024-09-12T17:28:50.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.862+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=NXUZ1ZJ4UUJG tag=CFUE8SHN31PW type=write size=2118229 2024-09-12T17:28:50.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.863+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=CVM53XV6T6HL type=del size=4176375 2024-09-12T17:28:50.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.865+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=7JZN3DB94LFI type=del 2024-09-12T17:28:50.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.867+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~DPODHI3H072W.0 size=1048576 2024-09-12T17:28:50.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.868+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~DPODHI3H072W.1 size=218350 2024-09-12T17:28:50.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.868+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=DPODHI3H072W tag=VAE0CUBXXJC5 type=write size=2315502 2024-09-12T17:28:50.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.870+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~LIL7LDY4IWX3.0 size=1048576 2024-09-12T17:28:50.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.871+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~LIL7LDY4IWX3.1 size=1048576 2024-09-12T17:28:50.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.872+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~LIL7LDY4IWX3.2 size=769867 2024-09-12T17:28:50.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.875+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=LIL7LDY4IWX3 tag=JRB19VIQ640U type=write size=3915595 2024-09-12T17:28:50.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.878+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~QB31JYDUVJ32.0 size=1046435 2024-09-12T17:28:50.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.878+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=QB31JYDUVJ32 tag=05NW4F51Y3RN type=write size=2095011 2024-09-12T17:28:50.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.879+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~OVVGG8UXEHF0.0 size=317829 2024-09-12T17:28:50.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.882+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=OVVGG8UXEHF0 tag=F3R8NXAJX3O5 type=write size=1366405 2024-09-12T17:28:50.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.885+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KXIUMSHGOQI2.0 size=1048576 2024-09-12T17:28:50.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.886+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KXIUMSHGOQI2.1 size=1048576 2024-09-12T17:28:50.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.887+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KXIUMSHGOQI2.2 size=24619 2024-09-12T17:28:50.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.887+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=KXIUMSHGOQI2 tag=JB1N4CZCYKKL type=write size=3170347 2024-09-12T17:28:50.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.889+0000 7f9d7bc0c780 1 < canceled operation key=SDX69F30A2RK tag=BG57IC3STVBP type=write size=310043 2024-09-12T17:28:50.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.890+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=MM5YOSR5I0I0 type=del size=418794 2024-09-12T17:28:50.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.892+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=3QZOERGQJZ7W type=del 2024-09-12T17:28:50.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.894+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=Y8HQT6E1JN0U type=del size=2858055 2024-09-12T17:28:50.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.895+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~BQ4RPOWW29JR.0 size=1045686 2024-09-12T17:28:50.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.897+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=BQ4RPOWW29JR tag=4F5KUGC0TC0W type=write size=2094262 2024-09-12T17:28:50.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.899+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=0FFWTH8RBKJ4 type=write size=57254 2024-09-12T17:28:50.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.901+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=Q4L6X25NTKCQ type=del 2024-09-12T17:28:50.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.902+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=XGM19YRJ7HDW type=del size=4068755 2024-09-12T17:28:50.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.903+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9B83KWC5E4ZV.2~PF1AQBLFNW9M.0 size=262114 2024-09-12T17:28:50.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.905+0000 7f9d7bc0c780 1 < canceled multipart upload key=9B83KWC5E4ZV upload=PF1AQBLFNW9M tag=YTDRNYGEGCYX type=write size=1310690 2024-09-12T17:28:50.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.908+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~A1QNTF5S7BCW.0 size=1048576 2024-09-12T17:28:50.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.909+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~A1QNTF5S7BCW.1 size=1048576 2024-09-12T17:28:50.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.910+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~A1QNTF5S7BCW.2 size=713882 2024-09-12T17:28:50.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.910+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=A1QNTF5S7BCW tag=YWSJGAT49I78 type=write size=3859610 2024-09-12T17:28:50.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.911+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=ZDRCA0QCCD8L type=del 2024-09-12T17:28:50.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.914+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=TRQFWCCJPU3D type=del size=477608 2024-09-12T17:28:50.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.915+0000 7f9d7bc0c780 1 < canceled operation key=LTG0UQEYPUGO tag=NOW06WLCT1VN type=write size=239559 2024-09-12T17:28:50.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.917+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=TZY4HR8VKO4O type=del size=34526 2024-09-12T17:28:50.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.919+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=GF3PQ4KQ14KE type=del size=3709978 2024-09-12T17:28:50.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.921+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~273IURC6KIIV.0 size=1048576 2024-09-12T17:28:50.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.922+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~273IURC6KIIV.1 size=956823 2024-09-12T17:28:50.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.922+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=273IURC6KIIV tag=AQPGYDOK47J3 type=write size=3053975 2024-09-12T17:28:50.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.924+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=QLM0EB1L6TNG type=del 2024-09-12T17:28:50.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.927+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~CXO9Y5EUMEJS.0 size=757622 2024-09-12T17:28:50.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.927+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=CXO9Y5EUMEJS tag=L1OZXHRK3CGO type=write size=1806198 2024-09-12T17:28:50.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.929+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~F5U0HNP9ST8O.0 size=869812 2024-09-12T17:28:50.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.932+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=F5U0HNP9ST8O tag=O4CMPGESMF3P type=write size=1918388 2024-09-12T17:28:50.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.935+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~GF48HLKF0AM8.0 size=1048576 2024-09-12T17:28:50.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.936+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~GF48HLKF0AM8.1 size=1048576 2024-09-12T17:28:50.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.937+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~GF48HLKF0AM8.2 size=116718 2024-09-12T17:28:50.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.937+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=GF48HLKF0AM8 tag=OLWYRFOE6V5D type=write size=3262446 2024-09-12T17:28:50.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.938+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=B2EL14DEK4IA type=del 2024-09-12T17:28:50.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.940+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=8TBHCQG3CBQ0 type=del size=2216426 2024-09-12T17:28:50.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.941+0000 7f9d7bc0c780 1 < canceled operation key=9B83KWC5E4ZV tag=ZD38TV9H1523 type=del size=2505571 2024-09-12T17:28:50.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.943+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=P8494TTLO2UK type=del size=2097466 2024-09-12T17:28:50.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.945+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=CVM53XV6T6HL type=del 2024-09-12T17:28:50.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.948+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~70SBRWZ72DAX.0 size=1048576 2024-09-12T17:28:50.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.949+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~70SBRWZ72DAX.1 size=778327 2024-09-12T17:28:50.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.949+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=70SBRWZ72DAX tag=1AVFHTYFH7KV type=write size=2875479 2024-09-12T17:28:50.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.951+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~DPODHI3H072W.0 size=1048576 2024-09-12T17:28:50.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.953+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~DPODHI3H072W.1 size=218350 2024-09-12T17:28:50.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.955+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=DPODHI3H072W tag=VAE0CUBXXJC5 type=write size=2315502 2024-09-12T17:28:50.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.958+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~LOWO9YS2DAWQ.0 size=1048576 2024-09-12T17:28:50.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.959+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~LOWO9YS2DAWQ.1 size=1048576 2024-09-12T17:28:50.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.960+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~LOWO9YS2DAWQ.2 size=103986 2024-09-12T17:28:50.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.960+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=LOWO9YS2DAWQ tag=AQY99KBECC1L type=write size=3249714 2024-09-12T17:28:50.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.961+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~QB31JYDUVJ32.0 size=1046435 2024-09-12T17:28:50.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.963+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=QB31JYDUVJ32 tag=05NW4F51Y3RN type=write size=2095011 2024-09-12T17:28:50.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.965+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=ACRPNRIZ917D type=del size=2125654 2024-09-12T17:28:50.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.965+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~KXIUMSHGOQI2.0 size=1048576 2024-09-12T17:28:50.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.967+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~KXIUMSHGOQI2.1 size=1048576 2024-09-12T17:28:50.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.968+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~KXIUMSHGOQI2.2 size=24619 2024-09-12T17:28:50.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.970+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=KXIUMSHGOQI2 tag=JB1N4CZCYKKL type=write size=3170347 2024-09-12T17:28:50.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.972+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~H9T2787S31HY.0 size=1048576 2024-09-12T17:28:50.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.973+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~H9T2787S31HY.1 size=286632 2024-09-12T17:28:50.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.973+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=H9T2787S31HY tag=OMM4AZBRTBFW type=write size=2383784 2024-09-12T17:28:50.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.975+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=MM5YOSR5I0I0 type=del 2024-09-12T17:28:50.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.978+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~WQ0FI0ATP5LH.0 size=524681 2024-09-12T17:28:50.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.978+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=WQ0FI0ATP5LH tag=LPX2JYO5IB11 type=write size=1573257 2024-09-12T17:28:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.979+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=Y8HQT6E1JN0U type=del 2024-09-12T17:28:50.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.981+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=PMPIA7LI8S6M type=del size=3253555 2024-09-12T17:28:50.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.982+0000 7f9d7bc0c780 1 < completed write operation key=X7J78IOJR0HA tag=0FFWTH8RBKJ4 type=write size=57254 2024-09-12T17:28:50.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.985+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~LVKEGZZCN45G.0 size=1048576 2024-09-12T17:28:50.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.986+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~LVKEGZZCN45G.1 size=1048576 2024-09-12T17:28:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.987+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~LVKEGZZCN45G.2 size=894852 2024-09-12T17:28:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.987+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=LVKEGZZCN45G tag=VMOPJRQYR49B type=write size=4040580 2024-09-12T17:28:50.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.988+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=XGM19YRJ7HDW type=del 2024-09-12T17:28:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.990+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=WGDTNJHTKX9E type=del size=2680518 2024-09-12T17:28:50.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.991+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~A1QNTF5S7BCW.0 size=1048576 2024-09-12T17:28:50.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.992+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~A1QNTF5S7BCW.1 size=1048576 2024-09-12T17:28:50.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.993+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~A1QNTF5S7BCW.2 size=713882 2024-09-12T17:28:50.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.996+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=A1QNTF5S7BCW tag=YWSJGAT49I78 type=write size=3859610 2024-09-12T17:28:50.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.997+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=IC0W7ZNOFX0O type=del size=1788680 2024-09-12T17:28:50.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:50.999+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=TRQFWCCJPU3D type=del 2024-09-12T17:28:51.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.000+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=Q1TAT358EBHK type=write size=823524 2024-09-12T17:28:51.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.001+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=TZY4HR8VKO4O type=del 2024-09-12T17:28:51.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.004+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~UYKZWLQO4G8C.0 size=1048576 2024-09-12T17:28:51.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.005+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~UYKZWLQO4G8C.1 size=646597 2024-09-12T17:28:51.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.005+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=UYKZWLQO4G8C tag=NX2QLXY1LT9N type=write size=2743749 2024-09-12T17:28:51.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.005+0000 7f9d7bc0c780 1 < canceled part key=_multipart_QB8C0OJA1L4X.2~273IURC6KIIV.0 size=1048576 2024-09-12T17:28:51.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.006+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~273IURC6KIIV.1 size=956823 2024-09-12T17:28:51.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.009+0000 7f9d7bc0c780 1 < canceled multipart upload key=QB8C0OJA1L4X upload=273IURC6KIIV tag=AQPGYDOK47J3 type=write size=3053975 2024-09-12T17:28:51.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.011+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~FTWHI05I4W41.0 size=1048576 2024-09-12T17:28:51.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.012+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~FTWHI05I4W41.1 size=1048576 2024-09-12T17:28:51.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.013+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~FTWHI05I4W41.2 size=889568 2024-09-12T17:28:51.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.013+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=FTWHI05I4W41 tag=ALW0LBAHFN98 type=write size=4035296 2024-09-12T17:28:51.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.015+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~CXO9Y5EUMEJS.0 size=757622 2024-09-12T17:28:51.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.017+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=CXO9Y5EUMEJS tag=L1OZXHRK3CGO type=write size=1806198 2024-09-12T17:28:51.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.019+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~MRCH6TDAQL0P.0 size=1048576 2024-09-12T17:28:51.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.020+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~MRCH6TDAQL0P.1 size=1048576 2024-09-12T17:28:51.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.022+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~MRCH6TDAQL0P.2 size=754352 2024-09-12T17:28:51.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.022+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=MRCH6TDAQL0P tag=75OD5IT3QFP0 type=write size=3900080 2024-09-12T17:28:51.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.023+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~GF48HLKF0AM8.0 size=1048576 2024-09-12T17:28:51.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.024+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~GF48HLKF0AM8.1 size=1048576 2024-09-12T17:28:51.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.025+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~GF48HLKF0AM8.2 size=116718 2024-09-12T17:28:51.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.028+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=GF48HLKF0AM8 tag=OLWYRFOE6V5D type=write size=3262446 2024-09-12T17:28:51.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.030+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~2SSA70AT16U0.0 size=1048576 2024-09-12T17:28:51.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.032+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~2SSA70AT16U0.1 size=1048576 2024-09-12T17:28:51.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.033+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~2SSA70AT16U0.2 size=158439 2024-09-12T17:28:51.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.033+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=2SSA70AT16U0 tag=J22PWZ83J863 type=write size=3304167 2024-09-12T17:28:51.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.036+0000 7f9d7bc0c780 1 < suggested remove operation key=CYKLX4CJWVJE tag=8TBHCQG3CBQ0 type=del 2024-09-12T17:28:51.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.037+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=5ZS4LZXXTR0X type=del size=1197383 2024-09-12T17:28:51.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.039+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=P8494TTLO2UK type=del 2024-09-12T17:28:51.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.040+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=DV63MKWTJJSS type=del size=241346 2024-09-12T17:28:51.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.041+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~70SBRWZ72DAX.0 size=1048576 2024-09-12T17:28:51.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.041+0000 7f9d7bc0c780 1 < canceled part key=_multipart_58C4SS3TN12K.2~70SBRWZ72DAX.1 size=778327 2024-09-12T17:28:51.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.043+0000 7f9d7bc0c780 1 < canceled multipart upload key=58C4SS3TN12K upload=70SBRWZ72DAX tag=1AVFHTYFH7KV type=write size=2875479 2024-09-12T17:28:51.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.046+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~BOVL49963URQ.0 size=338219 2024-09-12T17:28:51.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.046+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=BOVL49963URQ tag=8T2EIRZF2ZEU type=write size=1386795 2024-09-12T17:28:51.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.047+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~LOWO9YS2DAWQ.0 size=1048576 2024-09-12T17:28:51.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.048+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~LOWO9YS2DAWQ.1 size=1048576 2024-09-12T17:28:51.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.049+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~LOWO9YS2DAWQ.2 size=103986 2024-09-12T17:28:51.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.052+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=LOWO9YS2DAWQ tag=AQY99KBECC1L type=write size=3249714 2024-09-12T17:28:51.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.054+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~JM53BEP1WUTV.0 size=915708 2024-09-12T17:28:51.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.054+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=JM53BEP1WUTV tag=PKDJ2IQ661IM type=write size=1964284 2024-09-12T17:28:51.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.056+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=ACRPNRIZ917D type=del 2024-09-12T17:28:51.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.057+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=8Y5SC0G1CIW3 type=del size=3808952 2024-09-12T17:28:51.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.058+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~H9T2787S31HY.0 size=1048576 2024-09-12T17:28:51.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.059+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~H9T2787S31HY.1 size=286632 2024-09-12T17:28:51.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.061+0000 7f9d7bc0c780 1 < canceled multipart upload key=FU7ARIH2X839 upload=H9T2787S31HY tag=OMM4AZBRTBFW type=write size=2383784 2024-09-12T17:28:51.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.063+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=UKL54YESCD0O type=del size=3940225 2024-09-12T17:28:51.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.063+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~WQ0FI0ATP5LH.0 size=524681 2024-09-12T17:28:51.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.065+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=WQ0FI0ATP5LH tag=LPX2JYO5IB11 type=write size=1573257 2024-09-12T17:28:51.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.068+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~YYVLN9KUVPDC.0 size=1048576 2024-09-12T17:28:51.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.069+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~YYVLN9KUVPDC.1 size=220951 2024-09-12T17:28:51.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.069+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=YYVLN9KUVPDC tag=GOXDG2LPWJOP type=write size=2318103 2024-09-12T17:28:51.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.071+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=PMPIA7LI8S6M type=del 2024-09-12T17:28:51.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.073+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~ZTQDZRO6W23D.0 size=1048576 2024-09-12T17:28:51.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.074+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~ZTQDZRO6W23D.1 size=1048576 2024-09-12T17:28:51.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.075+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~ZTQDZRO6W23D.2 size=191630 2024-09-12T17:28:51.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.075+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=ZTQDZRO6W23D tag=PJ6ANVRZBVT6 type=write size=3337358 2024-09-12T17:28:51.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.076+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0NGHC5GMSGRX.2~LVKEGZZCN45G.0 size=1048576 2024-09-12T17:28:51.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.077+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~LVKEGZZCN45G.1 size=1048576 2024-09-12T17:28:51.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.078+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~LVKEGZZCN45G.2 size=894852 2024-09-12T17:28:51.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.081+0000 7f9d7bc0c780 1 < canceled multipart upload key=0NGHC5GMSGRX upload=LVKEGZZCN45G tag=VMOPJRQYR49B type=write size=4040580 2024-09-12T17:28:51.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.083+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=6GJ7KMTZEZKZ type=write size=533977 2024-09-12T17:28:51.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.084+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=WGDTNJHTKX9E type=del 2024-09-12T17:28:51.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.087+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~Z978JYY1UJCP.0 size=1048576 2024-09-12T17:28:51.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.088+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~Z978JYY1UJCP.1 size=1048576 2024-09-12T17:28:51.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.089+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~Z978JYY1UJCP.2 size=253132 2024-09-12T17:28:51.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.089+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=Z978JYY1UJCP tag=CFSULRJ4KU2Z type=write size=3398860 2024-09-12T17:28:51.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.091+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=IC0W7ZNOFX0O type=del 2024-09-12T17:28:51.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.092+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=48KO671XQ7SF type=write size=429751 2024-09-12T17:28:51.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.094+0000 7f9d7bc0c780 1 < completed write operation key=0NGHC5GMSGRX tag=Q1TAT358EBHK type=write size=823524 2024-09-12T17:28:51.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.095+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=F7D5C7C2UDWL type=del size=3767860 2024-09-12T17:28:51.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.096+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~UYKZWLQO4G8C.0 size=1048576 2024-09-12T17:28:51.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.096+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~UYKZWLQO4G8C.1 size=646597 2024-09-12T17:28:51.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.098+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=UYKZWLQO4G8C tag=NX2QLXY1LT9N type=write size=2743749 2024-09-12T17:28:51.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.100+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=TF6C6JNWE3Z6 type=del size=2783452 2024-09-12T17:28:51.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.101+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~FTWHI05I4W41.0 size=1048576 2024-09-12T17:28:51.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.101+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~FTWHI05I4W41.1 size=1048576 2024-09-12T17:28:51.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.102+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~FTWHI05I4W41.2 size=889568 2024-09-12T17:28:51.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.105+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=FTWHI05I4W41 tag=ALW0LBAHFN98 type=write size=4035296 2024-09-12T17:28:51.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.106+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=AYF1M4GYNUIL type=del size=1093716 2024-09-12T17:28:51.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.107+0000 7f9d7bc0c780 1 < canceled part key=_multipart_NQ0768B94GVV.2~MRCH6TDAQL0P.0 size=1048576 2024-09-12T17:28:51.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.107+0000 7f9d7bc0c780 1 < canceled part key=_multipart_NQ0768B94GVV.2~MRCH6TDAQL0P.1 size=1048576 2024-09-12T17:28:51.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.108+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~MRCH6TDAQL0P.2 size=754352 2024-09-12T17:28:51.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.110+0000 7f9d7bc0c780 1 < canceled multipart upload key=NQ0768B94GVV upload=MRCH6TDAQL0P tag=75OD5IT3QFP0 type=write size=3900080 2024-09-12T17:28:51.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.113+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~6KC1J62IBH8T.0 size=1048576 2024-09-12T17:28:51.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.114+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~6KC1J62IBH8T.1 size=1048576 2024-09-12T17:28:51.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.115+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~6KC1J62IBH8T.2 size=270763 2024-09-12T17:28:51.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.115+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=6KC1J62IBH8T tag=FS4A0FZBMQ3Z type=write size=3416491 2024-09-12T17:28:51.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.116+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~2SSA70AT16U0.0 size=1048576 2024-09-12T17:28:51.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.118+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~2SSA70AT16U0.1 size=1048576 2024-09-12T17:28:51.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.119+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~2SSA70AT16U0.2 size=158439 2024-09-12T17:28:51.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.122+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=2SSA70AT16U0 tag=J22PWZ83J863 type=write size=3304167 2024-09-12T17:28:51.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.125+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~WNQT6RFRJTOB.0 size=1048576 2024-09-12T17:28:51.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.126+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~WNQT6RFRJTOB.1 size=380518 2024-09-12T17:28:51.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.126+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=WNQT6RFRJTOB tag=RLO8I7TARP9F type=write size=2477670 2024-09-12T17:28:51.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.128+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=5ZS4LZXXTR0X type=del 2024-09-12T17:28:51.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.129+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=PNQ0LKGM289O type=del size=2424469 2024-09-12T17:28:51.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.132+0000 7f9d7bc0c780 1 < suggested update operation key=0BYGD7FTPQF3 tag=DV63MKWTJJSS type=del size=241346 2024-09-12T17:28:51.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.135+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~NI3PV70T9Y4C.0 size=657775 2024-09-12T17:28:51.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.135+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=NI3PV70T9Y4C tag=9LKSHPZA5K2O type=write size=1706351 2024-09-12T17:28:51.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.137+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~BOVL49963URQ.0 size=338219 2024-09-12T17:28:51.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.139+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=BOVL49963URQ tag=8T2EIRZF2ZEU type=write size=1386795 2024-09-12T17:28:51.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.141+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=RDP2DZN1S7ND type=del size=827159 2024-09-12T17:28:51.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.141+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~JM53BEP1WUTV.0 size=915708 2024-09-12T17:28:51.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.144+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=JM53BEP1WUTV tag=PKDJ2IQ661IM type=write size=1964284 2024-09-12T17:28:51.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.145+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=5W8O2H59XDKF type=del size=2599122 2024-09-12T17:28:51.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.147+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=8Y5SC0G1CIW3 type=del 2024-09-12T17:28:51.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.149+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=DV55IIDKOGWP type=del size=2098096 2024-09-12T17:28:51.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.150+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=UKL54YESCD0O type=del 2024-09-12T17:28:51.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.153+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~PMG3H1X36G6M.0 size=1048576 2024-09-12T17:28:51.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.154+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~PMG3H1X36G6M.1 size=789567 2024-09-12T17:28:51.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.154+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=PMG3H1X36G6M tag=HPJPL97E8UXZ type=write size=2886719 2024-09-12T17:28:51.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.156+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~YYVLN9KUVPDC.0 size=1048576 2024-09-12T17:28:51.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.157+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~YYVLN9KUVPDC.1 size=220951 2024-09-12T17:28:51.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.159+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=YYVLN9KUVPDC tag=GOXDG2LPWJOP type=write size=2318103 2024-09-12T17:28:51.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.162+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~21WPULU4CX7Q.0 size=245587 2024-09-12T17:28:51.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.162+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=21WPULU4CX7Q tag=VEBK4EBZVKW1 type=write size=1294163 2024-09-12T17:28:51.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.163+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~ZTQDZRO6W23D.0 size=1048576 2024-09-12T17:28:51.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.164+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~ZTQDZRO6W23D.1 size=1048576 2024-09-12T17:28:51.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.166+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~ZTQDZRO6W23D.2 size=191630 2024-09-12T17:28:51.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.168+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=ZTQDZRO6W23D tag=PJ6ANVRZBVT6 type=write size=3337358 2024-09-12T17:28:51.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.169+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=MCZI8I77B8Z6 type=del size=2623206 2024-09-12T17:28:51.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.171+0000 7f9d7bc0c780 1 < completed write operation key=LJZNPSVLS9AF tag=6GJ7KMTZEZKZ type=write size=533977 2024-09-12T17:28:51.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.173+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~2X16LU12ZTCF.0 size=167111 2024-09-12T17:28:51.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.173+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=2X16LU12ZTCF tag=R0BNMHK6EWCG type=write size=1215687 2024-09-12T17:28:51.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.175+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~Z978JYY1UJCP.0 size=1048576 2024-09-12T17:28:51.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.176+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~Z978JYY1UJCP.1 size=1048576 2024-09-12T17:28:51.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.177+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~Z978JYY1UJCP.2 size=253132 2024-09-12T17:28:51.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.179+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=Z978JYY1UJCP tag=CFSULRJ4KU2Z type=write size=3398860 2024-09-12T17:28:51.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.181+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=NUKBXV02UCWY type=write size=844924 2024-09-12T17:28:51.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.182+0000 7f9d7bc0c780 1 < canceled operation key=J7MREXK6R3C4 tag=48KO671XQ7SF type=write size=429751 2024-09-12T17:28:51.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.185+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~MD5RD21QDQTM.0 size=1048576 2024-09-12T17:28:51.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.186+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~MD5RD21QDQTM.1 size=1024314 2024-09-12T17:28:51.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.186+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=MD5RD21QDQTM tag=8Z43GLQ06CCH type=write size=3121466 2024-09-12T17:28:51.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.188+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=F7D5C7C2UDWL type=del 2024-09-12T17:28:51.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.189+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=985KEXCLWX0R type=del size=1321912 2024-09-12T17:28:51.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.191+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=TF6C6JNWE3Z6 type=del 2024-09-12T17:28:51.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.192+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=52QR58ZH938Z type=write size=1030420 2024-09-12T17:28:51.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.193+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=AYF1M4GYNUIL type=del 2024-09-12T17:28:51.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.196+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~RUPILPBZQT94.0 size=740213 2024-09-12T17:28:51.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.196+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=RUPILPBZQT94 tag=9S8VBDJD85P4 type=write size=1788789 2024-09-12T17:28:51.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.197+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~6KC1J62IBH8T.0 size=1048576 2024-09-12T17:28:51.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.198+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~6KC1J62IBH8T.1 size=1048576 2024-09-12T17:28:51.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.198+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0NGHC5GMSGRX.2~6KC1J62IBH8T.2 size=270763 2024-09-12T17:28:51.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.200+0000 7f9d7bc0c780 1 < canceled multipart upload key=0NGHC5GMSGRX upload=6KC1J62IBH8T tag=FS4A0FZBMQ3Z type=write size=3416491 2024-09-12T17:28:51.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.202+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=MNMIH7DNUB6V type=write size=342725 2024-09-12T17:28:51.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.203+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~WNQT6RFRJTOB.0 size=1048576 2024-09-12T17:28:51.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.203+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LJZNPSVLS9AF.2~WNQT6RFRJTOB.1 size=380518 2024-09-12T17:28:51.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.205+0000 7f9d7bc0c780 1 < canceled multipart upload key=LJZNPSVLS9AF upload=WNQT6RFRJTOB tag=RLO8I7TARP9F type=write size=2477670 2024-09-12T17:28:51.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.207+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=RG6UW8R4FJQH type=del size=371096 2024-09-12T17:28:51.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.211+0000 7f9d7bc0c780 1 < suggested update operation key=G5ZKTTY1XQ9T tag=PNQ0LKGM289O type=del size=2424469 2024-09-12T17:28:51.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.212+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=WC3P85922LJX type=write size=589301 2024-09-12T17:28:51.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.214+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~NI3PV70T9Y4C.0 size=657775 2024-09-12T17:28:51.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.217+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=NI3PV70T9Y4C tag=9LKSHPZA5K2O type=write size=1706351 2024-09-12T17:28:51.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.220+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~CJ2YIE1KE1O6.0 size=1048576 2024-09-12T17:28:51.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.221+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~CJ2YIE1KE1O6.1 size=1048576 2024-09-12T17:28:51.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.222+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~CJ2YIE1KE1O6.2 size=779998 2024-09-12T17:28:51.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.222+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=CJ2YIE1KE1O6 tag=JMBM66TPPZ1I type=write size=3925726 2024-09-12T17:28:51.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.223+0000 7f9d7bc0c780 1 < canceled operation key=5B96YH46VAK3 tag=RDP2DZN1S7ND type=del size=827159 2024-09-12T17:28:51.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.225+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=OJ35ZDS68QJI type=del size=4179901 2024-09-12T17:28:51.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.226+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=5W8O2H59XDKF type=del 2024-09-12T17:28:51.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.228+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=THKYIN13LFQP type=del size=2617832 2024-09-12T17:28:51.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.229+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=DV55IIDKOGWP type=del 2024-09-12T17:28:51.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.230+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=JGF6ZKZI90A5 type=del size=1723453 2024-09-12T17:28:51.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.232+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~PMG3H1X36G6M.0 size=1048576 2024-09-12T17:28:51.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.232+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LTG0UQEYPUGO.2~PMG3H1X36G6M.1 size=789567 2024-09-12T17:28:51.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.234+0000 7f9d7bc0c780 1 < canceled multipart upload key=LTG0UQEYPUGO upload=PMG3H1X36G6M tag=HPJPL97E8UXZ type=write size=2886719 2024-09-12T17:28:51.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.235+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=H49YHBOMPA38 type=del size=1548389 2024-09-12T17:28:51.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.237+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~21WPULU4CX7Q.0 size=245587 2024-09-12T17:28:51.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.239+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=21WPULU4CX7Q tag=VEBK4EBZVKW1 type=write size=1294163 2024-09-12T17:28:51.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.241+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=41RTQ40NWYZ5 type=del size=1948870 2024-09-12T17:28:51.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.242+0000 7f9d7bc0c780 1 < canceled operation key=M3Q7I7MD7M4I tag=MCZI8I77B8Z6 type=del size=2623206 2024-09-12T17:28:51.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.243+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=H9BKQFBGQKXB type=del size=2079947 2024-09-12T17:28:51.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.245+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~2X16LU12ZTCF.0 size=167111 2024-09-12T17:28:51.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.247+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=2X16LU12ZTCF tag=R0BNMHK6EWCG type=write size=1215687 2024-09-12T17:28:51.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.248+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=D4WGY80W33CI type=del size=2478095 2024-09-12T17:28:51.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.249+0000 7f9d7bc0c780 1 < completed write operation key=0BYGD7FTPQF3 tag=NUKBXV02UCWY type=write size=844924 2024-09-12T17:28:51.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.252+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~OYPFWBGVX3WZ.0 size=124424 2024-09-12T17:28:51.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.252+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=OYPFWBGVX3WZ tag=OF9FZHSFFP9R type=write size=1173000 2024-09-12T17:28:51.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.253+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~MD5RD21QDQTM.0 size=1048576 2024-09-12T17:28:51.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.254+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~MD5RD21QDQTM.1 size=1024314 2024-09-12T17:28:51.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.256+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=MD5RD21QDQTM tag=8Z43GLQ06CCH type=write size=3121466 2024-09-12T17:28:51.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.257+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=Y037IABICBWK type=del size=412998 2024-09-12T17:28:51.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.259+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=985KEXCLWX0R type=del 2024-09-12T17:28:51.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.260+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=6N0J9J2U1VS3 type=del size=2108254 2024-09-12T17:28:51.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.262+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=52QR58ZH938Z type=write size=1030420 2024-09-12T17:28:51.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.263+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=EMNAATN3D00A type=del size=3107355 2024-09-12T17:28:51.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.265+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~RUPILPBZQT94.0 size=740213 2024-09-12T17:28:51.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.267+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=RUPILPBZQT94 tag=9S8VBDJD85P4 type=write size=1788789 2024-09-12T17:28:51.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.269+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~L8R8Y2PK6PE8.0 size=1048576 2024-09-12T17:28:51.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.271+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~L8R8Y2PK6PE8.1 size=163174 2024-09-12T17:28:51.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.271+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=L8R8Y2PK6PE8 tag=7OW8V3GKUXO1 type=write size=2260326 2024-09-12T17:28:51.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.272+0000 7f9d7bc0c780 1 < completed write operation key=58C4SS3TN12K tag=MNMIH7DNUB6V type=write size=342725 2024-09-12T17:28:51.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.274+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=DLMYZEEYX4RA type=del size=3846160 2024-09-12T17:28:51.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.275+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=RG6UW8R4FJQH type=del 2024-09-12T17:28:51.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.277+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=CN64XAO64W8T type=del size=2489879 2024-09-12T17:28:51.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.278+0000 7f9d7bc0c780 1 < completed write operation key=AOT2ZKFTD0HY tag=WC3P85922LJX type=write size=589301 2024-09-12T17:28:51.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.280+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=T1MKRJVVAUUF type=del size=431401 2024-09-12T17:28:51.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.282+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~CJ2YIE1KE1O6.0 size=1048576 2024-09-12T17:28:51.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.283+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~CJ2YIE1KE1O6.1 size=1048576 2024-09-12T17:28:51.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.284+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~CJ2YIE1KE1O6.2 size=779998 2024-09-12T17:28:51.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.287+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=CJ2YIE1KE1O6 tag=JMBM66TPPZ1I type=write size=3925726 2024-09-12T17:28:51.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.289+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~6IMX0S9Q2GEW.0 size=1048576 2024-09-12T17:28:51.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.290+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~6IMX0S9Q2GEW.1 size=511989 2024-09-12T17:28:51.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.290+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=6IMX0S9Q2GEW tag=H2A7CDYHPWRM type=write size=2609141 2024-09-12T17:28:51.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.292+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=OJ35ZDS68QJI type=del 2024-09-12T17:28:51.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.294+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=MDDO14BNUZ5E type=del size=1904612 2024-09-12T17:28:51.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.296+0000 7f9d7bc0c780 1 < canceled operation key=X7J78IOJR0HA tag=THKYIN13LFQP type=del size=2617832 2024-09-12T17:28:51.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.297+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=Z0O53E986DJT type=write size=567732 2024-09-12T17:28:51.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.299+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=JGF6ZKZI90A5 type=del 2024-09-12T17:28:51.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.300+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=UDPBI8US4MC7 type=del size=2560381 2024-09-12T17:28:51.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.302+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=H49YHBOMPA38 type=del 2024-09-12T17:28:51.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.304+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=LD4A9XF5S51L type=write size=719318 2024-09-12T17:28:51.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.305+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=41RTQ40NWYZ5 type=del 2024-09-12T17:28:51.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.306+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=4HD4UJHRAA4P type=write size=799265 2024-09-12T17:28:51.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.308+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=H9BKQFBGQKXB type=del 2024-09-12T17:28:51.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.309+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=EQ6KIPKYLR6D type=del size=1924303 2024-09-12T17:28:51.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.311+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=D4WGY80W33CI type=del 2024-09-12T17:28:51.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.312+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=5QRQ3IELHWJL type=del size=1025273 2024-09-12T17:28:51.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.314+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~OYPFWBGVX3WZ.0 size=124424 2024-09-12T17:28:51.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.316+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=OYPFWBGVX3WZ tag=OF9FZHSFFP9R type=write size=1173000 2024-09-12T17:28:51.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.317+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=GDVKWE1COIGO type=del size=3981895 2024-09-12T17:28:51.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.318+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=Y037IABICBWK type=del 2024-09-12T17:28:51.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.320+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=IAQPBCF166SU type=del size=2623656 2024-09-12T17:28:51.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.321+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=6N0J9J2U1VS3 type=del 2024-09-12T17:28:51.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.323+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=RS85S1INH8RR type=write size=855799 2024-09-12T17:28:51.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.324+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=EMNAATN3D00A type=del 2024-09-12T17:28:51.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.325+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=DD037LY1UBCP type=del size=3913751 2024-09-12T17:28:51.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.327+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~L8R8Y2PK6PE8.0 size=1048576 2024-09-12T17:28:51.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.328+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~L8R8Y2PK6PE8.1 size=163174 2024-09-12T17:28:51.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.330+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=L8R8Y2PK6PE8 tag=7OW8V3GKUXO1 type=write size=2260326 2024-09-12T17:28:51.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.333+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~3Q5C844CDCIF.0 size=508672 2024-09-12T17:28:51.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.333+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=3Q5C844CDCIF tag=YHUBV9HILQAZ type=write size=1557248 2024-09-12T17:28:51.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.335+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=DLMYZEEYX4RA type=del 2024-09-12T17:28:51.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.337+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~AVJ2JFULMJ17.0 size=1048576 2024-09-12T17:28:51.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.339+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~AVJ2JFULMJ17.1 size=372579 2024-09-12T17:28:51.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.339+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=AVJ2JFULMJ17 tag=BOT5Y8PG2CTD type=write size=2469731 2024-09-12T17:28:51.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.341+0000 7f9d7bc0c780 1 < suggested update operation key=LU8MLGM7H0CE tag=CN64XAO64W8T type=del size=2489879 2024-09-12T17:28:51.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.343+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=E3N1VM5Y6266 type=del size=3786150 2024-09-12T17:28:51.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.344+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=T1MKRJVVAUUF type=del 2024-09-12T17:28:51.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.346+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=2MYVY34W9UZ0 type=del size=107858 2024-09-12T17:28:51.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.347+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~6IMX0S9Q2GEW.0 size=1048576 2024-09-12T17:28:51.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.348+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~6IMX0S9Q2GEW.1 size=511989 2024-09-12T17:28:51.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.352+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=6IMX0S9Q2GEW tag=H2A7CDYHPWRM type=write size=2609141 2024-09-12T17:28:51.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.356+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~YMWYTK2KNI5H.0 size=1048576 2024-09-12T17:28:51.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.357+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~YMWYTK2KNI5H.1 size=1048576 2024-09-12T17:28:51.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.358+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~YMWYTK2KNI5H.2 size=317307 2024-09-12T17:28:51.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.358+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=YMWYTK2KNI5H tag=FYJ66THKG1JR type=write size=3463035 2024-09-12T17:28:51.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.360+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=MDDO14BNUZ5E type=del 2024-09-12T17:28:51.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.361+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=67CEFWNCE86Y type=del size=2185390 2024-09-12T17:28:51.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.362+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=Z0O53E986DJT type=write size=567732 2024-09-12T17:28:51.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.365+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~1WHYV8YPTU70.0 size=1048576 2024-09-12T17:28:51.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.366+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~1WHYV8YPTU70.1 size=217528 2024-09-12T17:28:51.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.366+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=1WHYV8YPTU70 tag=57L9PC7DEDTI type=write size=2314680 2024-09-12T17:28:51.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.367+0000 7f9d7bc0c780 1 < canceled operation key=ZM8NMC18RN3I tag=UDPBI8US4MC7 type=del size=2560381 2024-09-12T17:28:51.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.368+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=03HLS620T217 type=del size=2302979 2024-09-12T17:28:51.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.371+0000 7f9d7bc0c780 1 < suggested remove operation key=4V2IYJRP2PZI tag=LD4A9XF5S51L type=write 2024-09-12T17:28:51.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.374+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~FLL0T6C3DSBY.0 size=789204 2024-09-12T17:28:51.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.374+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=FLL0T6C3DSBY tag=99470VFSWTST type=write size=1837780 2024-09-12T17:28:51.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.375+0000 7f9d7bc0c780 1 < completed write operation key=W1SE9R6KU04G tag=4HD4UJHRAA4P type=write size=799265 2024-09-12T17:28:51.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.377+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=8X442R9MU7DG type=del size=88780 2024-09-12T17:28:51.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.378+0000 7f9d7bc0c780 1 < canceled operation key=LJZNPSVLS9AF tag=EQ6KIPKYLR6D type=del size=1924303 2024-09-12T17:28:51.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.380+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=XYAWVOQSSJ53 type=del size=4137859 2024-09-12T17:28:51.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.381+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=5QRQ3IELHWJL type=del 2024-09-12T17:28:51.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.382+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=5OQQGT0RGG9S type=write size=543194 2024-09-12T17:28:51.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.384+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=GDVKWE1COIGO type=del 2024-09-12T17:28:51.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.385+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=QD3RZ2JJZBFJ type=del size=1504071 2024-09-12T17:28:51.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.388+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=IAQPBCF166SU type=del size=2623656 2024-09-12T17:28:51.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.390+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=2WQZJHYECX6K type=write size=578076 2024-09-12T17:28:51.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.391+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=RS85S1INH8RR type=write size=855799 2024-09-12T17:28:51.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.394+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~3ZB8MHC6GEIM.0 size=1048576 2024-09-12T17:28:51.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.395+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~3ZB8MHC6GEIM.1 size=349048 2024-09-12T17:28:51.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.395+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=3ZB8MHC6GEIM tag=C84Q6OTWLUMM type=write size=2446200 2024-09-12T17:28:51.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.397+0000 7f9d7bc0c780 1 < canceled operation key=G5ZKTTY1XQ9T tag=DD037LY1UBCP type=del size=3913751 2024-09-12T17:28:51.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.398+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=JEYJMYG8LHJD type=del size=3412929 2024-09-12T17:28:51.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.399+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~3Q5C844CDCIF.0 size=508672 2024-09-12T17:28:51.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.402+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=3Q5C844CDCIF tag=YHUBV9HILQAZ type=write size=1557248 2024-09-12T17:28:51.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.404+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~ZBA17OI8FK4Q.0 size=1048576 2024-09-12T17:28:51.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.405+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~ZBA17OI8FK4Q.1 size=461380 2024-09-12T17:28:51.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.405+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=ZBA17OI8FK4Q tag=J18MNVNCHVWY type=write size=2558532 2024-09-12T17:28:51.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.406+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~AVJ2JFULMJ17.0 size=1048576 2024-09-12T17:28:51.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.408+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~AVJ2JFULMJ17.1 size=372579 2024-09-12T17:28:51.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.410+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=AVJ2JFULMJ17 tag=BOT5Y8PG2CTD type=write size=2469731 2024-09-12T17:28:51.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.411+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=VVHKDJ4XRMYC type=del size=875800 2024-09-12T17:28:51.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.413+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=E3N1VM5Y6266 type=del 2024-09-12T17:28:51.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.414+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=DIINMT0N28QO type=del size=3933041 2024-09-12T17:28:51.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.415+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=2MYVY34W9UZ0 type=del 2024-09-12T17:28:51.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.418+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~3OING0AS1RX0.0 size=1048576 2024-09-12T17:28:51.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.419+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~3OING0AS1RX0.1 size=1048576 2024-09-12T17:28:51.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.420+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~3OING0AS1RX0.2 size=521487 2024-09-12T17:28:51.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.420+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=3OING0AS1RX0 tag=L22P7L3LTG4C type=write size=3667215 2024-09-12T17:28:51.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.422+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~YMWYTK2KNI5H.0 size=1048576 2024-09-12T17:28:51.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.423+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~YMWYTK2KNI5H.1 size=1048576 2024-09-12T17:28:51.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.424+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~YMWYTK2KNI5H.2 size=317307 2024-09-12T17:28:51.427 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.426+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=YMWYTK2KNI5H tag=FYJ66THKG1JR type=write size=3463035 2024-09-12T17:28:51.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.428+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=ZT0XPBNF272M type=del size=2968028 2024-09-12T17:28:51.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.429+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=67CEFWNCE86Y type=del 2024-09-12T17:28:51.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.431+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=4KGYO6SFSS1D type=write size=534192 2024-09-12T17:28:51.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.432+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~1WHYV8YPTU70.0 size=1048576 2024-09-12T17:28:51.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.433+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~1WHYV8YPTU70.1 size=217528 2024-09-12T17:28:51.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.436+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=1WHYV8YPTU70 tag=57L9PC7DEDTI type=write size=2314680 2024-09-12T17:28:51.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.437+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=D02Q4F0ZQAZ0 type=del size=3762134 2024-09-12T17:28:51.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.439+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=03HLS620T217 type=del 2024-09-12T17:28:51.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.441+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~B54UIXFWP1Z9.0 size=168914 2024-09-12T17:28:51.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.441+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=B54UIXFWP1Z9 tag=JL74ABM32FAJ type=write size=1217490 2024-09-12T17:28:51.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.441+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~FLL0T6C3DSBY.0 size=789204 2024-09-12T17:28:51.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.444+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=FLL0T6C3DSBY tag=99470VFSWTST type=write size=1837780 2024-09-12T17:28:51.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.445+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=159UB776VTSA type=del size=3403201 2024-09-12T17:28:51.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.446+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=8X442R9MU7DG type=del 2024-09-12T17:28:51.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.448+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=N93UB1I941H2 type=del size=4003919 2024-09-12T17:28:51.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.450+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=XYAWVOQSSJ53 type=del 2024-09-12T17:28:51.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.453+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~WDB7PQ773L9N.0 size=1048576 2024-09-12T17:28:51.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.454+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~WDB7PQ773L9N.1 size=934174 2024-09-12T17:28:51.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.454+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=WDB7PQ773L9N tag=997QSYBLCZ2G type=write size=3031326 2024-09-12T17:28:51.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.457+0000 7f9d7bc0c780 1 < suggested update operation key=4V2IYJRP2PZI tag=5OQQGT0RGG9S type=write size=543194 2024-09-12T17:28:51.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.460+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~GMTWG87F40QL.0 size=1048576 2024-09-12T17:28:51.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.461+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~GMTWG87F40QL.1 size=1031284 2024-09-12T17:28:51.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.461+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=GMTWG87F40QL tag=8T24TZ9EI0W1 type=write size=3128436 2024-09-12T17:28:51.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.462+0000 7f9d7bc0c780 -1 < failed to complete operation key=SDX69F30A2RK tag=QD3RZ2JJZBFJ type=del size=1504071: (22) Invalid argument 2024-09-12T17:28:51.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.465+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~LBMO2JD1VP5F.0 size=1048576 2024-09-12T17:28:51.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.466+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~LBMO2JD1VP5F.1 size=618871 2024-09-12T17:28:51.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.466+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=LBMO2JD1VP5F tag=CVDU5XGXNP56 type=write size=2716023 2024-09-12T17:28:51.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.469+0000 7f9d7bc0c780 1 < suggested update operation key=W1SE9R6KU04G tag=2WQZJHYECX6K type=write size=578076 2024-09-12T17:28:51.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.470+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=ADDVIQC1LV8Q type=write size=508649 2024-09-12T17:28:51.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.471+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~3ZB8MHC6GEIM.0 size=1048576 2024-09-12T17:28:51.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.473+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~3ZB8MHC6GEIM.1 size=349048 2024-09-12T17:28:51.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.475+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=3ZB8MHC6GEIM tag=C84Q6OTWLUMM type=write size=2446200 2024-09-12T17:28:51.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.478+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~S1PZFMBJ13PC.0 size=1048576 2024-09-12T17:28:51.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.479+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~S1PZFMBJ13PC.1 size=1048576 2024-09-12T17:28:51.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.480+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~S1PZFMBJ13PC.2 size=321311 2024-09-12T17:28:51.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.480+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=S1PZFMBJ13PC tag=J1UO0X3TK1YF type=write size=3467039 2024-09-12T17:28:51.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.481+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=JEYJMYG8LHJD type=del 2024-09-12T17:28:51.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.484+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~F9QGYWXDFPXK.0 size=1048576 2024-09-12T17:28:51.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.486+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~F9QGYWXDFPXK.1 size=546690 2024-09-12T17:28:51.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.486+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=F9QGYWXDFPXK tag=EKZ42EOZ0VE0 type=write size=2643842 2024-09-12T17:28:51.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.487+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~ZBA17OI8FK4Q.0 size=1048576 2024-09-12T17:28:51.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.488+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~ZBA17OI8FK4Q.1 size=461380 2024-09-12T17:28:51.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.491+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=ZBA17OI8FK4Q tag=J18MNVNCHVWY type=write size=2558532 2024-09-12T17:28:51.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.492+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=14OLXYKK03QL type=write size=262808 2024-09-12T17:28:51.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.493+0000 7f9d7bc0c780 1 < canceled operation key=J3YYRIVKQ5AU tag=VVHKDJ4XRMYC type=del size=875800 2024-09-12T17:28:51.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.495+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=HJCT73WBMVC0 type=del size=3343470 2024-09-12T17:28:51.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.498+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=DIINMT0N28QO type=del 2024-09-12T17:28:51.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.501+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~FVNND34P82C2.0 size=1048576 2024-09-12T17:28:51.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.502+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~FVNND34P82C2.1 size=276779 2024-09-12T17:28:51.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.502+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=FVNND34P82C2 tag=MJIVUCO8MH0H type=write size=2373931 2024-09-12T17:28:51.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.503+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~3OING0AS1RX0.0 size=1048576 2024-09-12T17:28:51.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.504+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~3OING0AS1RX0.1 size=1048576 2024-09-12T17:28:51.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.505+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~3OING0AS1RX0.2 size=521487 2024-09-12T17:28:51.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.507+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=3OING0AS1RX0 tag=L22P7L3LTG4C type=write size=3667215 2024-09-12T17:28:51.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.509+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~4K6C5AZ05TC2.0 size=1048576 2024-09-12T17:28:51.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.510+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~4K6C5AZ05TC2.1 size=1048576 2024-09-12T17:28:51.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.511+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~4K6C5AZ05TC2.2 size=696822 2024-09-12T17:28:51.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.511+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=4K6C5AZ05TC2 tag=JAU0KTJU3QU6 type=write size=3842550 2024-09-12T17:28:51.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.513+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=ZT0XPBNF272M type=del 2024-09-12T17:28:51.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.515+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~G2T7MPPNAUPJ.0 size=1048576 2024-09-12T17:28:51.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.516+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~G2T7MPPNAUPJ.1 size=1048576 2024-09-12T17:28:51.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.517+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~G2T7MPPNAUPJ.2 size=49045 2024-09-12T17:28:51.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.517+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=G2T7MPPNAUPJ tag=R3Z4JCG5WQT1 type=write size=3194773 2024-09-12T17:28:51.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.519+0000 7f9d7bc0c780 1 < completed write operation key=80JXIGQWQGR9 tag=4KGYO6SFSS1D type=write size=534192 2024-09-12T17:28:51.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.521+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~1YU5Q03AYQHK.0 size=1048576 2024-09-12T17:28:51.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.523+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~1YU5Q03AYQHK.1 size=210818 2024-09-12T17:28:51.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.523+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=1YU5Q03AYQHK tag=3ACAXWCP0Y65 type=write size=2307970 2024-09-12T17:28:51.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.525+0000 7f9d7bc0c780 1 < suggested remove operation key=X7J78IOJR0HA tag=D02Q4F0ZQAZ0 type=del 2024-09-12T17:28:51.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.527+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=RP8DGTNUSTT0 type=del size=2708077 2024-09-12T17:28:51.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.528+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~B54UIXFWP1Z9.0 size=168914 2024-09-12T17:28:51.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.530+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=B54UIXFWP1Z9 tag=JL74ABM32FAJ type=write size=1217490 2024-09-12T17:28:51.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.532+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=TEE469ZSJ1YT type=del size=1000271 2024-09-12T17:28:51.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.533+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=159UB776VTSA type=del 2024-09-12T17:28:51.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.535+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=MVBFTRJVCB5U type=write size=998233 2024-09-12T17:28:51.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.538+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=N93UB1I941H2 type=del 2024-09-12T17:28:51.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.539+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=XMWXDWINOJ3P type=del size=3148454 2024-09-12T17:28:51.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.541+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~WDB7PQ773L9N.0 size=1048576 2024-09-12T17:28:51.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.542+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~WDB7PQ773L9N.1 size=934174 2024-09-12T17:28:51.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.545+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=WDB7PQ773L9N tag=997QSYBLCZ2G type=write size=3031326 2024-09-12T17:28:51.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.547+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~Q5VVHU9SYGMJ.0 size=151404 2024-09-12T17:28:51.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.547+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=Q5VVHU9SYGMJ tag=K4CYK0R9LU7I type=write size=1199980 2024-09-12T17:28:51.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.547+0000 7f9d7bc0c780 1 < canceled part key=_multipart_OZKAXB0ET9R7.2~GMTWG87F40QL.0 size=1048576 2024-09-12T17:28:51.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.549+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~GMTWG87F40QL.1 size=1031284 2024-09-12T17:28:51.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.551+0000 7f9d7bc0c780 1 < canceled multipart upload key=OZKAXB0ET9R7 upload=GMTWG87F40QL tag=8T24TZ9EI0W1 type=write size=3128436 2024-09-12T17:28:51.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.552+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=90RROQEBXGG7 type=write size=379000 2024-09-12T17:28:51.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.554+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~LBMO2JD1VP5F.0 size=1048576 2024-09-12T17:28:51.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.554+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~LBMO2JD1VP5F.1 size=618871 2024-09-12T17:28:51.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.556+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=LBMO2JD1VP5F tag=CVDU5XGXNP56 type=write size=2716023 2024-09-12T17:28:51.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.558+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=LCAY2YS4JYVS type=write size=725799 2024-09-12T17:28:51.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.559+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=ADDVIQC1LV8Q type=write size=508649 2024-09-12T17:28:51.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.561+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=XB0KDHPL66RO type=del size=975995 2024-09-12T17:28:51.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.563+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~S1PZFMBJ13PC.0 size=1048576 2024-09-12T17:28:51.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.563+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~S1PZFMBJ13PC.1 size=1048576 2024-09-12T17:28:51.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.564+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~S1PZFMBJ13PC.2 size=321311 2024-09-12T17:28:51.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.567+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=S1PZFMBJ13PC tag=J1UO0X3TK1YF type=write size=3467039 2024-09-12T17:28:51.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.568+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=LI0DLXURS7UB type=del size=1931990 2024-09-12T17:28:51.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.569+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~F9QGYWXDFPXK.0 size=1048576 2024-09-12T17:28:51.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.571+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~F9QGYWXDFPXK.1 size=546690 2024-09-12T17:28:51.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.573+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=F9QGYWXDFPXK tag=EKZ42EOZ0VE0 type=write size=2643842 2024-09-12T17:28:51.575 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.574+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=7VYY3U5K52GU type=del size=513383 2024-09-12T17:28:51.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.577+0000 7f9d7bc0c780 1 < suggested update operation key=0BYGD7FTPQF3 tag=14OLXYKK03QL type=write size=262808 2024-09-12T17:28:51.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.578+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=1Q3WVVXMAS7Y type=del size=1394440 2024-09-12T17:28:51.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.580+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=HJCT73WBMVC0 type=del 2024-09-12T17:28:51.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.582+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~HWLHJEL8X61A.0 size=48566 2024-09-12T17:28:51.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.582+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=HWLHJEL8X61A tag=D083VAH5ZPWB type=write size=1097142 2024-09-12T17:28:51.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.584+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~FVNND34P82C2.0 size=1048576 2024-09-12T17:28:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.585+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~FVNND34P82C2.1 size=276779 2024-09-12T17:28:51.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.588+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=FVNND34P82C2 tag=MJIVUCO8MH0H type=write size=2373931 2024-09-12T17:28:51.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.589+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=U51BCMYV82PF type=del size=1329346 2024-09-12T17:28:51.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.591+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~4K6C5AZ05TC2.0 size=1048576 2024-09-12T17:28:51.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.592+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~4K6C5AZ05TC2.1 size=1048576 2024-09-12T17:28:51.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.593+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~4K6C5AZ05TC2.2 size=696822 2024-09-12T17:28:51.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.597+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=4K6C5AZ05TC2 tag=JAU0KTJU3QU6 type=write size=3842550 2024-09-12T17:28:51.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.600+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~EXXKB7FCY790.0 size=1048576 2024-09-12T17:28:51.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.601+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~EXXKB7FCY790.1 size=373699 2024-09-12T17:28:51.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.601+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=EXXKB7FCY790 tag=JCGXZ77I6O4S type=write size=2470851 2024-09-12T17:28:51.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.602+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~G2T7MPPNAUPJ.0 size=1048576 2024-09-12T17:28:51.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.604+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~G2T7MPPNAUPJ.1 size=1048576 2024-09-12T17:28:51.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.605+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~G2T7MPPNAUPJ.2 size=49045 2024-09-12T17:28:51.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.607+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=G2T7MPPNAUPJ tag=R3Z4JCG5WQT1 type=write size=3194773 2024-09-12T17:28:51.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.609+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=E82L44FVXNQ6 type=del size=783561 2024-09-12T17:28:51.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.610+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~1YU5Q03AYQHK.0 size=1048576 2024-09-12T17:28:51.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.611+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~1YU5Q03AYQHK.1 size=210818 2024-09-12T17:28:51.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.614+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=1YU5Q03AYQHK tag=3ACAXWCP0Y65 type=write size=2307970 2024-09-12T17:28:51.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.615+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=3PGHSXB67BRT type=del size=3822105 2024-09-12T17:28:51.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.617+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=RP8DGTNUSTT0 type=del 2024-09-12T17:28:51.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.619+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~J1KYK0JMEAR0.0 size=326758 2024-09-12T17:28:51.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.619+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=J1KYK0JMEAR0 tag=9M3RTGN2YHRP type=write size=1375334 2024-09-12T17:28:51.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.622+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=TEE469ZSJ1YT type=del 2024-09-12T17:28:51.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.623+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=STEO6HREOJ20 type=write size=536550 2024-09-12T17:28:51.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.625+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=MVBFTRJVCB5U type=write size=998233 2024-09-12T17:28:51.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.626+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=AQ1DTBK70S2Y type=del size=1713152 2024-09-12T17:28:51.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.628+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=XMWXDWINOJ3P type=del 2024-09-12T17:28:51.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.629+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=RC39F7AGUFDW type=write size=258838 2024-09-12T17:28:51.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.631+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~Q5VVHU9SYGMJ.0 size=151404 2024-09-12T17:28:51.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.633+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=Q5VVHU9SYGMJ tag=K4CYK0R9LU7I type=write size=1199980 2024-09-12T17:28:51.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.636+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~G2BZCMPP1N84.0 size=1048576 2024-09-12T17:28:51.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.637+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~G2BZCMPP1N84.1 size=1048576 2024-09-12T17:28:51.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.638+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~G2BZCMPP1N84.2 size=216425 2024-09-12T17:28:51.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.638+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=G2BZCMPP1N84 tag=GUY43AYX09NA type=write size=3362153 2024-09-12T17:28:51.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.641+0000 7f9d7bc0c780 1 < suggested update operation key=LTG0UQEYPUGO tag=90RROQEBXGG7 type=write size=379000 2024-09-12T17:28:51.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.642+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=35HPUDMF8M9C type=write size=115219 2024-09-12T17:28:51.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.644+0000 7f9d7bc0c780 1 < completed write operation key=9TE5N5TIB7AD tag=LCAY2YS4JYVS type=write size=725799 2024-09-12T17:28:51.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.645+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=A2SAI23197DU type=del size=3872042 2024-09-12T17:28:51.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.647+0000 7f9d7bc0c780 -1 < failed to complete operation key=LTG0UQEYPUGO tag=XB0KDHPL66RO type=del size=975995: (22) Invalid argument 2024-09-12T17:28:51.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.649+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~B3PJ4IXYGTWK.0 size=1048576 2024-09-12T17:28:51.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.650+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~B3PJ4IXYGTWK.1 size=376296 2024-09-12T17:28:51.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.650+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=B3PJ4IXYGTWK tag=T021V31OVHKX type=write size=2473448 2024-09-12T17:28:51.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.651+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=LI0DLXURS7UB type=del 2024-09-12T17:28:51.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.653+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=QRVNZF1X3V81 type=del size=3573222 2024-09-12T17:28:51.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.656+0000 7f9d7bc0c780 1 < suggested remove operation key=SDX69F30A2RK tag=7VYY3U5K52GU type=del 2024-09-12T17:28:51.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.657+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=IS1S6AYG0ZDL type=write size=48879 2024-09-12T17:28:51.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.658+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=1Q3WVVXMAS7Y type=del 2024-09-12T17:28:51.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.661+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~3SVMTAW8WO47.0 size=747091 2024-09-12T17:28:51.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.661+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=3SVMTAW8WO47 tag=DRMUC2MSAHXN type=write size=1795667 2024-09-12T17:28:51.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.662+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~HWLHJEL8X61A.0 size=48566 2024-09-12T17:28:51.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.665+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=HWLHJEL8X61A tag=D083VAH5ZPWB type=write size=1097142 2024-09-12T17:28:51.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.667+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~LX1EHZJ8YWOB.0 size=575625 2024-09-12T17:28:51.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.667+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=LX1EHZJ8YWOB tag=HCMSWE5D0ZI3 type=write size=1624201 2024-09-12T17:28:51.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.669+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=U51BCMYV82PF type=del 2024-09-12T17:28:51.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.671+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=WFAHYY4X0664 type=del size=2538028 2024-09-12T17:28:51.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.672+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~EXXKB7FCY790.0 size=1048576 2024-09-12T17:28:51.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.673+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~EXXKB7FCY790.1 size=373699 2024-09-12T17:28:51.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.675+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=EXXKB7FCY790 tag=JCGXZ77I6O4S type=write size=2470851 2024-09-12T17:28:51.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.678+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~OBQ1FFFJ8G1B.0 size=1048576 2024-09-12T17:28:51.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.679+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~OBQ1FFFJ8G1B.1 size=260165 2024-09-12T17:28:51.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.679+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=OBQ1FFFJ8G1B tag=RNGZE3XUWNSY type=write size=2357317 2024-09-12T17:28:51.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.681+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=E82L44FVXNQ6 type=del 2024-09-12T17:28:51.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.682+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=3ZBNJHCLMBPQ type=del size=3460459 2024-09-12T17:28:51.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.684+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=3PGHSXB67BRT type=del 2024-09-12T17:28:51.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.686+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=RK35YA9XUPVS type=del size=805632 2024-09-12T17:28:51.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.687+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~J1KYK0JMEAR0.0 size=326758 2024-09-12T17:28:51.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.690+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=J1KYK0JMEAR0 tag=9M3RTGN2YHRP type=write size=1375334 2024-09-12T17:28:51.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.691+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=YYA72A3MRTRB type=del size=3261796 2024-09-12T17:28:51.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.693+0000 7f9d7bc0c780 1 < completed write operation key=ZM8NMC18RN3I tag=STEO6HREOJ20 type=write size=536550 2024-09-12T17:28:51.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.694+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=MWBKREWA10SD type=del size=4167194 2024-09-12T17:28:51.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.696+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=AQ1DTBK70S2Y type=del 2024-09-12T17:28:51.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.698+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=EDQJPIJZKQEB type=del size=436728 2024-09-12T17:28:51.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.699+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=RC39F7AGUFDW type=write size=258838 2024-09-12T17:28:51.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.701+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=WYU1O4476LJK type=del size=3762896 2024-09-12T17:28:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.702+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~G2BZCMPP1N84.0 size=1048576 2024-09-12T17:28:51.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.704+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~G2BZCMPP1N84.1 size=1048576 2024-09-12T17:28:51.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.705+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~G2BZCMPP1N84.2 size=216425 2024-09-12T17:28:51.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.708+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=G2BZCMPP1N84 tag=GUY43AYX09NA type=write size=3362153 2024-09-12T17:28:51.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.709+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=ZLT4B2NPN0NC type=write size=350193 2024-09-12T17:28:51.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.711+0000 7f9d7bc0c780 1 < completed write operation key=ZM8NMC18RN3I tag=35HPUDMF8M9C type=write size=115219 2024-09-12T17:28:51.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.713+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=F3C9Z0Y7AM1W type=del size=2480400 2024-09-12T17:28:51.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.714+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=A2SAI23197DU type=del 2024-09-12T17:28:51.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.718+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~CE9LSBIYXAUE.0 size=1048576 2024-09-12T17:28:51.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.719+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~CE9LSBIYXAUE.1 size=1048576 2024-09-12T17:28:51.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.720+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~CE9LSBIYXAUE.2 size=583415 2024-09-12T17:28:51.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.720+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=CE9LSBIYXAUE tag=LRN3UV83FNP9 type=write size=3729143 2024-09-12T17:28:51.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.722+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~B3PJ4IXYGTWK.0 size=1048576 2024-09-12T17:28:51.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.723+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~B3PJ4IXYGTWK.1 size=376296 2024-09-12T17:28:51.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.725+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=B3PJ4IXYGTWK tag=T021V31OVHKX type=write size=2473448 2024-09-12T17:28:51.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.727+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=3BTI9X2J7IIZ type=write size=138565 2024-09-12T17:28:51.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.729+0000 7f9d7bc0c780 1 < suggested update operation key=LJZNPSVLS9AF tag=QRVNZF1X3V81 type=del size=3573222 2024-09-12T17:28:51.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.731+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=BM1OZABC5F3G type=del size=2949994 2024-09-12T17:28:51.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.732+0000 7f9d7bc0c780 1 < completed write operation key=0JN5WWDYEM6Q tag=IS1S6AYG0ZDL type=write size=48879 2024-09-12T17:28:51.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.735+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~HN00Y4HQINW2.0 size=71308 2024-09-12T17:28:51.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.735+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=HN00Y4HQINW2 tag=AEAT6429JZ64 type=write size=1119884 2024-09-12T17:28:51.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.736+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~3SVMTAW8WO47.0 size=747091 2024-09-12T17:28:51.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.739+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=3SVMTAW8WO47 tag=DRMUC2MSAHXN type=write size=1795667 2024-09-12T17:28:51.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.740+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=E981PTLZJK7G type=del size=2403616 2024-09-12T17:28:51.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.742+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~LX1EHZJ8YWOB.0 size=575625 2024-09-12T17:28:51.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.744+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=LX1EHZJ8YWOB tag=HCMSWE5D0ZI3 type=write size=1624201 2024-09-12T17:28:51.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.747+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~YFQV7H4C6R9D.0 size=1048576 2024-09-12T17:28:51.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.748+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~YFQV7H4C6R9D.1 size=716927 2024-09-12T17:28:51.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.748+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=YFQV7H4C6R9D tag=CRZZ7KTKBK33 type=write size=2814079 2024-09-12T17:28:51.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.751+0000 7f9d7bc0c780 1 < suggested remove operation key=OZKAXB0ET9R7 tag=WFAHYY4X0664 type=del 2024-09-12T17:28:51.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.752+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=IY2ZURJS43TN type=del size=4146491 2024-09-12T17:28:51.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.754+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~OBQ1FFFJ8G1B.0 size=1048576 2024-09-12T17:28:51.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.754+0000 7f9d7bc0c780 1 < canceled part key=_multipart_R94VERREGANN.2~OBQ1FFFJ8G1B.1 size=260165 2024-09-12T17:28:51.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.757+0000 7f9d7bc0c780 1 < canceled multipart upload key=R94VERREGANN upload=OBQ1FFFJ8G1B tag=RNGZE3XUWNSY type=write size=2357317 2024-09-12T17:28:51.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.759+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~D8ZPLFZMWJ8N.0 size=617717 2024-09-12T17:28:51.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.759+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=D8ZPLFZMWJ8N tag=WNR09KS7G8KU type=write size=1666293 2024-09-12T17:28:51.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.762+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=3ZBNJHCLMBPQ type=del 2024-09-12T17:28:51.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.763+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=10XQVAV805B7 type=del size=2171700 2024-09-12T17:28:51.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.766+0000 7f9d7bc0c780 1 < suggested remove operation key=LJZNPSVLS9AF tag=RK35YA9XUPVS type=del 2024-09-12T17:28:51.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.768+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~298H36PJ5PWE.0 size=897520 2024-09-12T17:28:51.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.768+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=298H36PJ5PWE tag=VK73OUG8HC39 type=write size=1946096 2024-09-12T17:28:51.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.770+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=YYA72A3MRTRB type=del 2024-09-12T17:28:51.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.772+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~ID227Y3VGJRI.0 size=1048576 2024-09-12T17:28:51.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.773+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~ID227Y3VGJRI.1 size=1048576 2024-09-12T17:28:51.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.774+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~ID227Y3VGJRI.2 size=111773 2024-09-12T17:28:51.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.774+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=ID227Y3VGJRI tag=6UMYFH2VYPU2 type=write size=3257501 2024-09-12T17:28:51.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.776+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=MWBKREWA10SD type=del 2024-09-12T17:28:51.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.778+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~A7AIF4NI0WDT.0 size=1048576 2024-09-12T17:28:51.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.779+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~A7AIF4NI0WDT.1 size=1048576 2024-09-12T17:28:51.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.780+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~A7AIF4NI0WDT.2 size=475665 2024-09-12T17:28:51.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.780+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=A7AIF4NI0WDT tag=U1HFVH9V2WH1 type=write size=3621393 2024-09-12T17:28:51.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.782+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=EDQJPIJZKQEB type=del 2024-09-12T17:28:51.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.783+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=S1EFF2HP9VFV type=del size=484848 2024-09-12T17:28:51.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.785+0000 7f9d7bc0c780 1 < canceled operation key=80JXIGQWQGR9 tag=WYU1O4476LJK type=del size=3762896 2024-09-12T17:28:51.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.787+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~DKMPP6BYB7PA.0 size=1048576 2024-09-12T17:28:51.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.788+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~DKMPP6BYB7PA.1 size=136663 2024-09-12T17:28:51.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.788+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=DKMPP6BYB7PA tag=WZ58TYDWG8WF type=write size=2233815 2024-09-12T17:28:51.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.790+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=ZLT4B2NPN0NC type=write size=350193 2024-09-12T17:28:51.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.791+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=PG1Q0FFJ2YEX type=del size=3819399 2024-09-12T17:28:51.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.793+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=F3C9Z0Y7AM1W type=del 2024-09-12T17:28:51.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.794+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=HR0K4F03QJOC type=del size=3539108 2024-09-12T17:28:51.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.796+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~CE9LSBIYXAUE.0 size=1048576 2024-09-12T17:28:51.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.797+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~CE9LSBIYXAUE.1 size=1048576 2024-09-12T17:28:51.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.798+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~CE9LSBIYXAUE.2 size=583415 2024-09-12T17:28:51.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.800+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=CE9LSBIYXAUE tag=LRN3UV83FNP9 type=write size=3729143 2024-09-12T17:28:51.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.803+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~IVMIBHLGCICX.0 size=1048576 2024-09-12T17:28:51.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.804+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~IVMIBHLGCICX.1 size=542554 2024-09-12T17:28:51.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.804+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=IVMIBHLGCICX tag=YZ9J9EXCR6EU type=write size=2639706 2024-09-12T17:28:51.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.805+0000 7f9d7bc0c780 1 < completed write operation key=AOT2ZKFTD0HY tag=3BTI9X2J7IIZ type=write size=138565 2024-09-12T17:28:51.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.807+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=KKX4CWBUIUFT type=write size=969372 2024-09-12T17:28:51.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.808+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=BM1OZABC5F3G type=del 2024-09-12T17:28:51.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.810+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=QEISE3X5IDE0 type=write size=103712 2024-09-12T17:28:51.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.811+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~HN00Y4HQINW2.0 size=71308 2024-09-12T17:28:51.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.813+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=HN00Y4HQINW2 tag=AEAT6429JZ64 type=write size=1119884 2024-09-12T17:28:51.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.816+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~2WJT0VXU3HC2.0 size=1048576 2024-09-12T17:28:51.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.817+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~2WJT0VXU3HC2.1 size=1048576 2024-09-12T17:28:51.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.818+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~2WJT0VXU3HC2.2 size=88960 2024-09-12T17:28:51.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.818+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=2WJT0VXU3HC2 tag=PU27DM3RENN8 type=write size=3234688 2024-09-12T17:28:51.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.819+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=E981PTLZJK7G type=del 2024-09-12T17:28:51.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.821+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=F3W62OPJBDC0 type=del size=70537 2024-09-12T17:28:51.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.821+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~YFQV7H4C6R9D.0 size=1048576 2024-09-12T17:28:51.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.821+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~YFQV7H4C6R9D.1 size=716927 2024-09-12T17:28:51.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.824+0000 7f9d7bc0c780 1 < canceled multipart upload key=AOT2ZKFTD0HY upload=YFQV7H4C6R9D tag=CRZZ7KTKBK33 type=write size=2814079 2024-09-12T17:28:51.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.826+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1VGZAC3YU265.0 size=1048576 2024-09-12T17:28:51.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.828+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1VGZAC3YU265.1 size=287447 2024-09-12T17:28:51.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.828+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=1VGZAC3YU265 tag=9OZOTKE5DRPD type=write size=2384599 2024-09-12T17:28:51.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.829+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=IY2ZURJS43TN type=del 2024-09-12T17:28:51.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.831+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=U6VCJHV3D5DA type=write size=362871 2024-09-12T17:28:51.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.832+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~D8ZPLFZMWJ8N.0 size=617717 2024-09-12T17:28:51.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.834+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=D8ZPLFZMWJ8N tag=WNR09KS7G8KU type=write size=1666293 2024-09-12T17:28:51.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.836+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=0JW7OCV4AMMS type=del size=2450052 2024-09-12T17:28:51.839 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.837+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=10XQVAV805B7 type=del 2024-09-12T17:28:51.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.840+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~SFRMYKBW2O6Q.0 size=1048576 2024-09-12T17:28:51.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.841+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~SFRMYKBW2O6Q.1 size=1048576 2024-09-12T17:28:51.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.843+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~SFRMYKBW2O6Q.2 size=85480 2024-09-12T17:28:51.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.843+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=SFRMYKBW2O6Q tag=2X65JKIQT2Z0 type=write size=3231208 2024-09-12T17:28:51.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.844+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~298H36PJ5PWE.0 size=897520 2024-09-12T17:28:51.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.848+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=298H36PJ5PWE tag=VK73OUG8HC39 type=write size=1946096 2024-09-12T17:28:51.851 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.850+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~Y10TL7WPEE9F.0 size=1048576 2024-09-12T17:28:51.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.852+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~Y10TL7WPEE9F.1 size=1048576 2024-09-12T17:28:51.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.853+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~Y10TL7WPEE9F.2 size=229919 2024-09-12T17:28:51.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.853+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=Y10TL7WPEE9F tag=HZK2CN6XVSJZ type=write size=3375647 2024-09-12T17:28:51.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.854+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~ID227Y3VGJRI.0 size=1048576 2024-09-12T17:28:51.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.855+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~ID227Y3VGJRI.1 size=1048576 2024-09-12T17:28:51.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.857+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~ID227Y3VGJRI.2 size=111773 2024-09-12T17:28:51.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.859+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=ID227Y3VGJRI tag=6UMYFH2VYPU2 type=write size=3257501 2024-09-12T17:28:51.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.861+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~J82BGZFMU0NO.0 size=36448 2024-09-12T17:28:51.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.861+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=J82BGZFMU0NO tag=51TJ5R4II6OV type=write size=1085024 2024-09-12T17:28:51.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.863+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~A7AIF4NI0WDT.0 size=1048576 2024-09-12T17:28:51.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.864+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~A7AIF4NI0WDT.1 size=1048576 2024-09-12T17:28:51.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.865+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~A7AIF4NI0WDT.2 size=475665 2024-09-12T17:28:51.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.868+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=A7AIF4NI0WDT tag=U1HFVH9V2WH1 type=write size=3621393 2024-09-12T17:28:51.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.870+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BGNUO12K8ZNW.0 size=1048576 2024-09-12T17:28:51.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.871+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BGNUO12K8ZNW.1 size=1048576 2024-09-12T17:28:51.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.873+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BGNUO12K8ZNW.2 size=229963 2024-09-12T17:28:51.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.873+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=BGNUO12K8ZNW tag=NFY3Q1VZ0BDO type=write size=3375691 2024-09-12T17:28:51.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.874+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=S1EFF2HP9VFV type=del 2024-09-12T17:28:51.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.877+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~KD0T06NJRMD3.0 size=1048576 2024-09-12T17:28:51.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.878+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~KD0T06NJRMD3.1 size=432959 2024-09-12T17:28:51.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.878+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=KD0T06NJRMD3 tag=8Z86YTLKXFN7 type=write size=2530111 2024-09-12T17:28:51.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.879+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~DKMPP6BYB7PA.0 size=1048576 2024-09-12T17:28:51.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.880+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~DKMPP6BYB7PA.1 size=136663 2024-09-12T17:28:51.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.882+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=DKMPP6BYB7PA tag=WZ58TYDWG8WF type=write size=2233815 2024-09-12T17:28:51.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.884+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=71RMW9WQF12Q type=del size=1583104 2024-09-12T17:28:51.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.887+0000 7f9d7bc0c780 1 < suggested remove operation key=ZA6JC3WXS8Y5 tag=PG1Q0FFJ2YEX type=del 2024-09-12T17:28:51.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.889+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=UR5NI6Z2VQO6 type=del size=2296625 2024-09-12T17:28:51.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.891+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=HR0K4F03QJOC type=del 2024-09-12T17:28:51.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.893+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=9ONSQZ07LPKD type=write size=826127 2024-09-12T17:28:51.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.895+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~IVMIBHLGCICX.0 size=1048576 2024-09-12T17:28:51.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.896+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~IVMIBHLGCICX.1 size=542554 2024-09-12T17:28:51.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.899+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=IVMIBHLGCICX tag=YZ9J9EXCR6EU type=write size=2639706 2024-09-12T17:28:51.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.902+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~AXUP6R5AVLX3.0 size=1048576 2024-09-12T17:28:51.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.904+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~AXUP6R5AVLX3.1 size=1048576 2024-09-12T17:28:51.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.905+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~AXUP6R5AVLX3.2 size=166839 2024-09-12T17:28:51.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.905+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=AXUP6R5AVLX3 tag=OUJJYP9WLVVN type=write size=3312567 2024-09-12T17:28:51.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.906+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=KKX4CWBUIUFT type=write size=969372 2024-09-12T17:28:51.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.908+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=0025SHLUMQ78 type=write size=375345 2024-09-12T17:28:51.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.910+0000 7f9d7bc0c780 1 < suggested update operation key=ZM8NMC18RN3I tag=QEISE3X5IDE0 type=write size=103712 2024-09-12T17:28:51.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.913+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~HMO1Z47MPU6Y.0 size=1048576 2024-09-12T17:28:51.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.914+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~HMO1Z47MPU6Y.1 size=709578 2024-09-12T17:28:51.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.914+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=HMO1Z47MPU6Y tag=4PTR358PEKTY type=write size=2806730 2024-09-12T17:28:51.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.915+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~2WJT0VXU3HC2.0 size=1048576 2024-09-12T17:28:51.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.916+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~2WJT0VXU3HC2.1 size=1048576 2024-09-12T17:28:51.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.917+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~2WJT0VXU3HC2.2 size=88960 2024-09-12T17:28:51.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.920+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=2WJT0VXU3HC2 tag=PU27DM3RENN8 type=write size=3234688 2024-09-12T17:28:51.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.921+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=F8FAEO0LTSI8 type=write size=872723 2024-09-12T17:28:51.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.924+0000 7f9d7bc0c780 1 < suggested remove operation key=9TE5N5TIB7AD tag=F3W62OPJBDC0 type=del 2024-09-12T17:28:51.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.925+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=I6JGFBIQ0GJT type=del size=2631775 2024-09-12T17:28:51.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.926+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1VGZAC3YU265.0 size=1048576 2024-09-12T17:28:51.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.927+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1VGZAC3YU265.1 size=287447 2024-09-12T17:28:51.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.930+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=1VGZAC3YU265 tag=9OZOTKE5DRPD type=write size=2384599 2024-09-12T17:28:51.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.931+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=C6H7VDW4S1QB type=del size=2141678 2024-09-12T17:28:51.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.934+0000 7f9d7bc0c780 1 < suggested update operation key=J7MREXK6R3C4 tag=U6VCJHV3D5DA type=write size=362871 2024-09-12T17:28:51.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.936+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~1G88QZIWAYYX.0 size=1048576 2024-09-12T17:28:51.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.937+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~1G88QZIWAYYX.1 size=428694 2024-09-12T17:28:51.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.937+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=1G88QZIWAYYX tag=3INS0GR0MY0H type=write size=2525846 2024-09-12T17:28:51.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.939+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=0JW7OCV4AMMS type=del 2024-09-12T17:28:51.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.940+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=4H08UAKJLH30 type=del size=4164076 2024-09-12T17:28:51.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.941+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~SFRMYKBW2O6Q.0 size=1048576 2024-09-12T17:28:51.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.942+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~SFRMYKBW2O6Q.1 size=1048576 2024-09-12T17:28:51.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.944+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~SFRMYKBW2O6Q.2 size=85480 2024-09-12T17:28:51.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.946+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=SFRMYKBW2O6Q tag=2X65JKIQT2Z0 type=write size=3231208 2024-09-12T17:28:51.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.949+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~KZ4ZY8172QF0.0 size=1048576 2024-09-12T17:28:51.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.950+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~KZ4ZY8172QF0.1 size=132855 2024-09-12T17:28:51.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.950+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=KZ4ZY8172QF0 tag=2L77ALI7HZZ2 type=write size=2230007 2024-09-12T17:28:51.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.952+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~Y10TL7WPEE9F.0 size=1048576 2024-09-12T17:28:51.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.953+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~Y10TL7WPEE9F.1 size=1048576 2024-09-12T17:28:51.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.954+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~Y10TL7WPEE9F.2 size=229919 2024-09-12T17:28:51.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.956+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=Y10TL7WPEE9F tag=HZK2CN6XVSJZ type=write size=3375647 2024-09-12T17:28:51.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.958+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=0UR03KKAF3L0 type=del size=926647 2024-09-12T17:28:51.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.959+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~J82BGZFMU0NO.0 size=36448 2024-09-12T17:28:51.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.961+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=J82BGZFMU0NO tag=51TJ5R4II6OV type=write size=1085024 2024-09-12T17:28:51.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.962+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=8B2JPTNUAPUE type=del size=1569789 2024-09-12T17:28:51.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.963+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9TE5N5TIB7AD.2~BGNUO12K8ZNW.0 size=1048576 2024-09-12T17:28:51.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.964+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~BGNUO12K8ZNW.1 size=1048576 2024-09-12T17:28:51.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.964+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9TE5N5TIB7AD.2~BGNUO12K8ZNW.2 size=229963 2024-09-12T17:28:51.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.966+0000 7f9d7bc0c780 1 < canceled multipart upload key=9TE5N5TIB7AD upload=BGNUO12K8ZNW tag=NFY3Q1VZ0BDO type=write size=3375691 2024-09-12T17:28:51.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.969+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~P0SM481F4CWG.0 size=1048576 2024-09-12T17:28:51.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.970+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~P0SM481F4CWG.1 size=1048576 2024-09-12T17:28:51.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.971+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~P0SM481F4CWG.2 size=162710 2024-09-12T17:28:51.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.971+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=P0SM481F4CWG tag=SOCVC1YZFFFV type=write size=3308438 2024-09-12T17:28:51.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.972+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~KD0T06NJRMD3.0 size=1048576 2024-09-12T17:28:51.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.973+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~KD0T06NJRMD3.1 size=432959 2024-09-12T17:28:51.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.976+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=KD0T06NJRMD3 tag=8Z86YTLKXFN7 type=write size=2530111 2024-09-12T17:28:51.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.979+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~01PSKFOU6KHW.0 size=1048576 2024-09-12T17:28:51.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.980+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~01PSKFOU6KHW.1 size=688580 2024-09-12T17:28:51.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.980+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=01PSKFOU6KHW tag=DMVLB8TZ16E4 type=write size=2785732 2024-09-12T17:28:51.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.981+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=71RMW9WQF12Q type=del 2024-09-12T17:28:51.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.983+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=85K8ODLPX1DY type=del size=3618232 2024-09-12T17:28:51.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.984+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=UR5NI6Z2VQO6 type=del 2024-09-12T17:28:51.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.986+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~HE8ZCB821H5J.0 size=726095 2024-09-12T17:28:51.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.986+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=HE8ZCB821H5J tag=9FFPGC0A9GHQ type=write size=1774671 2024-09-12T17:28:51.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.988+0000 7f9d7bc0c780 1 < completed write operation key=G5ZKTTY1XQ9T tag=9ONSQZ07LPKD type=write size=826127 2024-09-12T17:28:51.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.990+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=0R15GI2LE10K type=del size=1012205 2024-09-12T17:28:51.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.990+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0NGHC5GMSGRX.2~AXUP6R5AVLX3.0 size=1048576 2024-09-12T17:28:51.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.991+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~AXUP6R5AVLX3.1 size=1048576 2024-09-12T17:28:51.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.992+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~AXUP6R5AVLX3.2 size=166839 2024-09-12T17:28:51.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.995+0000 7f9d7bc0c780 1 < canceled multipart upload key=0NGHC5GMSGRX upload=AXUP6R5AVLX3 tag=OUJJYP9WLVVN type=write size=3312567 2024-09-12T17:28:51.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.996+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=B8AGWU029BYE type=del size=2195022 2024-09-12T17:28:51.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:51.997+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=0025SHLUMQ78 type=write size=375345 2024-09-12T17:28:52.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.000+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~OUV9HORTV3BQ.0 size=74416 2024-09-12T17:28:52.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.000+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=OUV9HORTV3BQ tag=RD4IEF0ARN0X type=write size=1122992 2024-09-12T17:28:52.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.001+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~HMO1Z47MPU6Y.0 size=1048576 2024-09-12T17:28:52.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.003+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~HMO1Z47MPU6Y.1 size=709578 2024-09-12T17:28:52.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.005+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=HMO1Z47MPU6Y tag=4PTR358PEKTY type=write size=2806730 2024-09-12T17:28:52.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.008+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~RIPXE632CSHY.0 size=1048576 2024-09-12T17:28:52.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.009+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~RIPXE632CSHY.1 size=1048576 2024-09-12T17:28:52.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.010+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~RIPXE632CSHY.2 size=360524 2024-09-12T17:28:52.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.010+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=RIPXE632CSHY tag=ROJCGGPYL0AV type=write size=3506252 2024-09-12T17:28:52.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.012+0000 7f9d7bc0c780 1 < completed write operation key=ZA6JC3WXS8Y5 tag=F8FAEO0LTSI8 type=write size=872723 2024-09-12T17:28:52.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.014+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=YQ08HQ349594 type=del size=384267 2024-09-12T17:28:52.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.016+0000 7f9d7bc0c780 -1 < failed to complete operation key=J7MREXK6R3C4 tag=I6JGFBIQ0GJT type=del size=2631775: (22) Invalid argument 2024-09-12T17:28:52.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.018+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=WF4MYE3U3DQH type=del size=2378985 2024-09-12T17:28:52.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.021+0000 7f9d7bc0c780 1 < suggested remove operation key=4V2IYJRP2PZI tag=C6H7VDW4S1QB type=del 2024-09-12T17:28:52.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.023+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~DSHBCKYE4X96.0 size=1048576 2024-09-12T17:28:52.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.025+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~DSHBCKYE4X96.1 size=1048576 2024-09-12T17:28:52.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.027+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~DSHBCKYE4X96.2 size=814836 2024-09-12T17:28:52.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.027+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=DSHBCKYE4X96 tag=11ND5UZ89I9R type=write size=3960564 2024-09-12T17:28:52.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.028+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~1G88QZIWAYYX.0 size=1048576 2024-09-12T17:28:52.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.028+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~1G88QZIWAYYX.1 size=428694 2024-09-12T17:28:52.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.031+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=1G88QZIWAYYX tag=3INS0GR0MY0H type=write size=2525846 2024-09-12T17:28:52.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.032+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=IYXHLBRNC8XY type=del size=282319 2024-09-12T17:28:52.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.034+0000 7f9d7bc0c780 1 < canceled operation key=LTG0UQEYPUGO tag=4H08UAKJLH30 type=del size=4164076 2024-09-12T17:28:52.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.036+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~50NF26BKW7PQ.0 size=292098 2024-09-12T17:28:52.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.036+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=50NF26BKW7PQ tag=ZTX5Z3G6N7LB type=write size=1340674 2024-09-12T17:28:52.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.037+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~KZ4ZY8172QF0.0 size=1048576 2024-09-12T17:28:52.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.037+0000 7f9d7bc0c780 1 < canceled part key=_multipart_80JXIGQWQGR9.2~KZ4ZY8172QF0.1 size=132855 2024-09-12T17:28:52.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.040+0000 7f9d7bc0c780 1 < canceled multipart upload key=80JXIGQWQGR9 upload=KZ4ZY8172QF0 tag=2L77ALI7HZZ2 type=write size=2230007 2024-09-12T17:28:52.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.042+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~NRWUK9LP5IBN.0 size=1048576 2024-09-12T17:28:52.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.043+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~NRWUK9LP5IBN.1 size=1048576 2024-09-12T17:28:52.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.044+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~NRWUK9LP5IBN.2 size=261432 2024-09-12T17:28:52.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.044+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=NRWUK9LP5IBN tag=FONP37PUOQGC type=write size=3407160 2024-09-12T17:28:52.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.047+0000 7f9d7bc0c780 1 < suggested update operation key=LJZNPSVLS9AF tag=0UR03KKAF3L0 type=del size=926647 2024-09-12T17:28:52.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.050+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~M3E68U3YBDX2.0 size=363300 2024-09-12T17:28:52.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.050+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=M3E68U3YBDX2 tag=WF5BBERTP8TJ type=write size=1411876 2024-09-12T17:28:52.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.051+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=8B2JPTNUAPUE type=del 2024-09-12T17:28:52.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.053+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~3CESH16VJMT4.0 size=1048576 2024-09-12T17:28:52.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.054+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~3CESH16VJMT4.1 size=1048576 2024-09-12T17:28:52.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.055+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~3CESH16VJMT4.2 size=662140 2024-09-12T17:28:52.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.055+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=3CESH16VJMT4 tag=4R8X1JXQ790O type=write size=3807868 2024-09-12T17:28:52.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.057+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~P0SM481F4CWG.0 size=1048576 2024-09-12T17:28:52.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.058+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~P0SM481F4CWG.1 size=1048576 2024-09-12T17:28:52.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.059+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~P0SM481F4CWG.2 size=162710 2024-09-12T17:28:52.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.061+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=P0SM481F4CWG tag=SOCVC1YZFFFV type=write size=3308438 2024-09-12T17:28:52.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.064+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~U6U7TFGC9PPL.0 size=595240 2024-09-12T17:28:52.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.064+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=U6U7TFGC9PPL tag=C77BZU0NQO2V type=write size=1643816 2024-09-12T17:28:52.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.064+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~01PSKFOU6KHW.0 size=1048576 2024-09-12T17:28:52.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.065+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~01PSKFOU6KHW.1 size=688580 2024-09-12T17:28:52.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.068+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=01PSKFOU6KHW tag=DMVLB8TZ16E4 type=write size=2785732 2024-09-12T17:28:52.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.069+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=KIPUIPFUN4J5 type=del size=2621846 2024-09-12T17:28:52.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.071+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=85K8ODLPX1DY type=del 2024-09-12T17:28:52.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.072+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=UFGYCT115ER6 type=del size=3842400 2024-09-12T17:28:52.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.074+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~HE8ZCB821H5J.0 size=726095 2024-09-12T17:28:52.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.076+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=HE8ZCB821H5J tag=9FFPGC0A9GHQ type=write size=1774671 2024-09-12T17:28:52.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.077+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=92331AYL482F type=del size=2985700 2024-09-12T17:28:52.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.078+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=0R15GI2LE10K type=del 2024-09-12T17:28:52.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.080+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=55NGWZSLHME6 type=del size=4172198 2024-09-12T17:28:52.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.081+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=B8AGWU029BYE type=del 2024-09-12T17:28:52.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.083+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~DT84MDDLMF7W.0 size=1048576 2024-09-12T17:28:52.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.084+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~DT84MDDLMF7W.1 size=189029 2024-09-12T17:28:52.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.084+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=DT84MDDLMF7W tag=F301PET7OZQT type=write size=2286181 2024-09-12T17:28:52.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.085+0000 7f9d7bc0c780 1 < canceled part key=_multipart_64T291B0U226.2~OUV9HORTV3BQ.0 size=74416 2024-09-12T17:28:52.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.087+0000 7f9d7bc0c780 1 < canceled multipart upload key=64T291B0U226 upload=OUV9HORTV3BQ tag=RD4IEF0ARN0X type=write size=1122992 2024-09-12T17:28:52.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.090+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~12K2E4P5XKR2.0 size=1048576 2024-09-12T17:28:52.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.091+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~12K2E4P5XKR2.1 size=998795 2024-09-12T17:28:52.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.091+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=12K2E4P5XKR2 tag=1NCCJESFWFCZ type=write size=3095947 2024-09-12T17:28:52.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.092+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~RIPXE632CSHY.0 size=1048576 2024-09-12T17:28:52.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.093+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~RIPXE632CSHY.1 size=1048576 2024-09-12T17:28:52.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.095+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~RIPXE632CSHY.2 size=360524 2024-09-12T17:28:52.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.097+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=RIPXE632CSHY tag=ROJCGGPYL0AV type=write size=3506252 2024-09-12T17:28:52.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.098+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=E0TWBS8HIWEW type=del size=756334 2024-09-12T17:28:52.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.100+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=YQ08HQ349594 type=del 2024-09-12T17:28:52.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.101+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=V9GBDANK68IR type=write size=511853 2024-09-12T17:28:52.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.103+0000 7f9d7bc0c780 1 < canceled operation key=80JXIGQWQGR9 tag=WF4MYE3U3DQH type=del size=2378985 2024-09-12T17:28:52.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.105+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~DKQ2F99C35S5.0 size=1048576 2024-09-12T17:28:52.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.106+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~DKQ2F99C35S5.1 size=1048576 2024-09-12T17:28:52.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.108+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~DKQ2F99C35S5.2 size=5783 2024-09-12T17:28:52.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.108+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=DKQ2F99C35S5 tag=Y4I3D26EAE9Y type=write size=3151511 2024-09-12T17:28:52.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.109+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~DSHBCKYE4X96.0 size=1048576 2024-09-12T17:28:52.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.110+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~DSHBCKYE4X96.1 size=1048576 2024-09-12T17:28:52.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.111+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~DSHBCKYE4X96.2 size=814836 2024-09-12T17:28:52.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.114+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=DSHBCKYE4X96 tag=11ND5UZ89I9R type=write size=3960564 2024-09-12T17:28:52.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.116+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~VFRCNK8TGLZA.0 size=1048576 2024-09-12T17:28:52.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.117+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~VFRCNK8TGLZA.1 size=1048576 2024-09-12T17:28:52.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.118+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~VFRCNK8TGLZA.2 size=354444 2024-09-12T17:28:52.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.118+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=VFRCNK8TGLZA tag=0K0DOCOND310 type=write size=3500172 2024-09-12T17:28:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.121+0000 7f9d7bc0c780 1 < suggested update operation key=58C4SS3TN12K tag=IYXHLBRNC8XY type=del size=282319 2024-09-12T17:28:52.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.123+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=DPS558HBUQM1 type=del size=3780552 2024-09-12T17:28:52.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.124+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~50NF26BKW7PQ.0 size=292098 2024-09-12T17:28:52.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.127+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=50NF26BKW7PQ tag=ZTX5Z3G6N7LB type=write size=1340674 2024-09-12T17:28:52.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.128+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=V7YI0MV65JB1 type=write size=535762 2024-09-12T17:28:52.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.130+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~NRWUK9LP5IBN.0 size=1048576 2024-09-12T17:28:52.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.131+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~NRWUK9LP5IBN.1 size=1048576 2024-09-12T17:28:52.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.132+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~NRWUK9LP5IBN.2 size=261432 2024-09-12T17:28:52.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.134+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=NRWUK9LP5IBN tag=FONP37PUOQGC type=write size=3407160 2024-09-12T17:28:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.135+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=JHET4HBD2FOB type=del size=2553115 2024-09-12T17:28:52.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.137+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~M3E68U3YBDX2.0 size=363300 2024-09-12T17:28:52.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.139+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=M3E68U3YBDX2 tag=WF5BBERTP8TJ type=write size=1411876 2024-09-12T17:28:52.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.140+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=CY7PVNQBADN2 type=del size=1129972 2024-09-12T17:28:52.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.140+0000 7f9d7bc0c780 1 < canceled part key=_multipart_80JXIGQWQGR9.2~3CESH16VJMT4.0 size=1048576 2024-09-12T17:28:52.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.140+0000 7f9d7bc0c780 1 < canceled part key=_multipart_80JXIGQWQGR9.2~3CESH16VJMT4.1 size=1048576 2024-09-12T17:28:52.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.142+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~3CESH16VJMT4.2 size=662140 2024-09-12T17:28:52.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.145+0000 7f9d7bc0c780 1 < canceled multipart upload key=80JXIGQWQGR9 upload=3CESH16VJMT4 tag=4R8X1JXQ790O type=write size=3807868 2024-09-12T17:28:52.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.147+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=3ASTAX5DNB6X type=write size=1009561 2024-09-12T17:28:52.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.148+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~U6U7TFGC9PPL.0 size=595240 2024-09-12T17:28:52.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.151+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=U6U7TFGC9PPL tag=C77BZU0NQO2V type=write size=1643816 2024-09-12T17:28:52.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.153+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=5MNU1YYZQYNM type=del size=1075745 2024-09-12T17:28:52.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.157+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=KIPUIPFUN4J5 type=del size=2621846 2024-09-12T17:28:52.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.158+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=CDKTQ83YQYU6 type=del size=2388581 2024-09-12T17:28:52.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.160+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=UFGYCT115ER6 type=del 2024-09-12T17:28:52.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.161+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=82U18TEWY2LF type=del size=722144 2024-09-12T17:28:52.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.163+0000 7f9d7bc0c780 1 < canceled operation key=FU7ARIH2X839 tag=92331AYL482F type=del size=2985700 2024-09-12T17:28:52.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.164+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=1UAYHZF4XU1Z type=write size=208364 2024-09-12T17:28:52.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.166+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=55NGWZSLHME6 type=del 2024-09-12T17:28:52.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.167+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=23BOC1KHUB6K type=del size=138000 2024-09-12T17:28:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.169+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~DT84MDDLMF7W.0 size=1048576 2024-09-12T17:28:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.170+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~DT84MDDLMF7W.1 size=189029 2024-09-12T17:28:52.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.172+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=DT84MDDLMF7W tag=F301PET7OZQT type=write size=2286181 2024-09-12T17:28:52.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.174+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=WJTPX6XCB015 type=del size=1322797 2024-09-12T17:28:52.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.175+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~12K2E4P5XKR2.0 size=1048576 2024-09-12T17:28:52.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.176+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~12K2E4P5XKR2.1 size=998795 2024-09-12T17:28:52.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.179+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=12K2E4P5XKR2 tag=1NCCJESFWFCZ type=write size=3095947 2024-09-12T17:28:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.180+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=I2I3GCB8XJS2 type=del size=203536 2024-09-12T17:28:52.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.181+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=E0TWBS8HIWEW type=del 2024-09-12T17:28:52.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.184+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~5FNFD5WJUC8T.0 size=1048576 2024-09-12T17:28:52.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.185+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~5FNFD5WJUC8T.1 size=1048576 2024-09-12T17:28:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.186+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~5FNFD5WJUC8T.2 size=767473 2024-09-12T17:28:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.186+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=5FNFD5WJUC8T tag=FS7439LDZ058 type=write size=3913201 2024-09-12T17:28:52.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.188+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=V9GBDANK68IR type=write size=511853 2024-09-12T17:28:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.189+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=NG0Z2X0T74RX type=del size=3691763 2024-09-12T17:28:52.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.190+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~DKQ2F99C35S5.0 size=1048576 2024-09-12T17:28:52.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.192+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~DKQ2F99C35S5.1 size=1048576 2024-09-12T17:28:52.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.193+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~DKQ2F99C35S5.2 size=5783 2024-09-12T17:28:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.195+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=DKQ2F99C35S5 tag=Y4I3D26EAE9Y type=write size=3151511 2024-09-12T17:28:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.197+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=TXFGTM5MPZBR type=del size=639639 2024-09-12T17:28:52.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.198+0000 7f9d7bc0c780 1 < canceled part key=_multipart_31PU0U6IEAV2.2~VFRCNK8TGLZA.0 size=1048576 2024-09-12T17:28:52.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.199+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~VFRCNK8TGLZA.1 size=1048576 2024-09-12T17:28:52.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.200+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~VFRCNK8TGLZA.2 size=354444 2024-09-12T17:28:52.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.203+0000 7f9d7bc0c780 1 < canceled multipart upload key=31PU0U6IEAV2 upload=VFRCNK8TGLZA tag=0K0DOCOND310 type=write size=3500172 2024-09-12T17:28:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.205+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~G7VWEH7TJSRB.0 size=1048576 2024-09-12T17:28:52.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.206+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~G7VWEH7TJSRB.1 size=1048576 2024-09-12T17:28:52.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.207+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~G7VWEH7TJSRB.2 size=460299 2024-09-12T17:28:52.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.207+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=G7VWEH7TJSRB tag=PZYVR0UULH60 type=write size=3606027 2024-09-12T17:28:52.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.210+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=DPS558HBUQM1 type=del 2024-09-12T17:28:52.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.212+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~RYG1QU7JZTUT.0 size=531616 2024-09-12T17:28:52.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.212+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=RYG1QU7JZTUT tag=ESM9Y32XBONP type=write size=1580192 2024-09-12T17:28:52.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.214+0000 7f9d7bc0c780 1 < completed write operation key=L72DVWQ63XUW tag=V7YI0MV65JB1 type=write size=535762 2024-09-12T17:28:52.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.215+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=B2VS5WZOE5IL type=write size=569221 2024-09-12T17:28:52.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.217+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=JHET4HBD2FOB type=del 2024-09-12T17:28:52.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.218+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=42469KO8IT82 type=del size=846302 2024-09-12T17:28:52.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.220+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=CY7PVNQBADN2 type=del 2024-09-12T17:28:52.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.222+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~WP2GTZG7XVQ3.0 size=1048576 2024-09-12T17:28:52.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.223+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~WP2GTZG7XVQ3.1 size=1048576 2024-09-12T17:28:52.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.225+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~WP2GTZG7XVQ3.2 size=804235 2024-09-12T17:28:52.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.225+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=WP2GTZG7XVQ3 tag=4U5MG3QOH20K type=write size=3949963 2024-09-12T17:28:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.226+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=3ASTAX5DNB6X type=write size=1009561 2024-09-12T17:28:52.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.229+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~DLY8M376TAX5.0 size=1048576 2024-09-12T17:28:52.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.230+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~DLY8M376TAX5.1 size=48701 2024-09-12T17:28:52.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.230+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=DLY8M376TAX5 tag=A0191RYVOUEC type=write size=2145853 2024-09-12T17:28:52.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.231+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=5MNU1YYZQYNM type=del 2024-09-12T17:28:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.234+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~7GG74BGLYAG5.0 size=1048576 2024-09-12T17:28:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.235+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~7GG74BGLYAG5.1 size=787878 2024-09-12T17:28:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.235+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=7GG74BGLYAG5 tag=E4W0G7AVR9SB type=write size=2885030 2024-09-12T17:28:52.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.236+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=CDKTQ83YQYU6 type=del size=2388581 2024-09-12T17:28:52.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.238+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=E3I6YKIH82LC type=del size=707213 2024-09-12T17:28:52.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.239+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=82U18TEWY2LF type=del 2024-09-12T17:28:52.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.242+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~CB64T0P7DA8U.0 size=733960 2024-09-12T17:28:52.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.242+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=CB64T0P7DA8U tag=ELDBOJS6LGFM type=write size=1782536 2024-09-12T17:28:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.244+0000 7f9d7bc0c780 1 < completed write operation key=G5ZKTTY1XQ9T tag=1UAYHZF4XU1Z type=write size=208364 2024-09-12T17:28:52.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.245+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=9Q916N0OVLP9 type=del size=1231861 2024-09-12T17:28:52.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.247+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=23BOC1KHUB6K type=del 2024-09-12T17:28:52.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.249+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=4VY172WVE153 type=del size=3702608 2024-09-12T17:28:52.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.250+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=WJTPX6XCB015 type=del 2024-09-12T17:28:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.253+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~V6CBEMTB991L.0 size=1048576 2024-09-12T17:28:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.254+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~V6CBEMTB991L.1 size=898314 2024-09-12T17:28:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.254+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=V6CBEMTB991L tag=ISUBYDZS9FN2 type=write size=2995466 2024-09-12T17:28:52.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.256+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=I2I3GCB8XJS2 type=del 2024-09-12T17:28:52.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.259+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~MMZVWX5OAKEC.0 size=1048576 2024-09-12T17:28:52.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.260+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~MMZVWX5OAKEC.1 size=187519 2024-09-12T17:28:52.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.260+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=MMZVWX5OAKEC tag=9HACTX7S754L type=write size=2284671 2024-09-12T17:28:52.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.260+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~5FNFD5WJUC8T.0 size=1048576 2024-09-12T17:28:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.262+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~5FNFD5WJUC8T.1 size=1048576 2024-09-12T17:28:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.262+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~5FNFD5WJUC8T.2 size=767473 2024-09-12T17:28:52.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.264+0000 7f9d7bc0c780 1 < canceled multipart upload key=FU7ARIH2X839 upload=5FNFD5WJUC8T tag=FS7439LDZ058 type=write size=3913201 2024-09-12T17:28:52.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.266+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=2ZYIKXZVFKE0 type=del size=1907929 2024-09-12T17:28:52.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.268+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=NG0Z2X0T74RX type=del 2024-09-12T17:28:52.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.269+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=8X638VBI6BQB type=del size=458793 2024-09-12T17:28:52.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.271+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=TXFGTM5MPZBR type=del 2024-09-12T17:28:52.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.274+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~Z9OEHSM66VRH.0 size=1048576 2024-09-12T17:28:52.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.275+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~Z9OEHSM66VRH.1 size=396406 2024-09-12T17:28:52.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.275+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=Z9OEHSM66VRH tag=4OPPN3JH5WE9 type=write size=2493558 2024-09-12T17:28:52.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.277+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~G7VWEH7TJSRB.0 size=1048576 2024-09-12T17:28:52.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.278+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~G7VWEH7TJSRB.1 size=1048576 2024-09-12T17:28:52.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.279+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~G7VWEH7TJSRB.2 size=460299 2024-09-12T17:28:52.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.281+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=G7VWEH7TJSRB tag=PZYVR0UULH60 type=write size=3606027 2024-09-12T17:28:52.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.283+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=Q7ZPEQD9HKXX type=del size=2842477 2024-09-12T17:28:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.285+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~RYG1QU7JZTUT.0 size=531616 2024-09-12T17:28:52.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.287+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=RYG1QU7JZTUT tag=ESM9Y32XBONP type=write size=1580192 2024-09-12T17:28:52.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.288+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=TOFU5TL3RDX8 type=del size=2367488 2024-09-12T17:28:52.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.292+0000 7f9d7bc0c780 1 < suggested remove operation key=ZM8NMC18RN3I tag=B2VS5WZOE5IL type=write 2024-09-12T17:28:52.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.294+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=RXA0QUEJXFTI type=write size=168203 2024-09-12T17:28:52.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.295+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=42469KO8IT82 type=del 2024-09-12T17:28:52.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.297+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=UTXJOB5W3K8C type=del size=1653202 2024-09-12T17:28:52.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.300+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~WP2GTZG7XVQ3.0 size=1048576 2024-09-12T17:28:52.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.301+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~WP2GTZG7XVQ3.1 size=1048576 2024-09-12T17:28:52.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.303+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~WP2GTZG7XVQ3.2 size=804235 2024-09-12T17:28:52.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.306+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=WP2GTZG7XVQ3 tag=4U5MG3QOH20K type=write size=3949963 2024-09-12T17:28:52.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.307+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=CLZFKRDDKYJ2 type=del size=2832127 2024-09-12T17:28:52.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.309+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~DLY8M376TAX5.0 size=1048576 2024-09-12T17:28:52.311 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.310+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~DLY8M376TAX5.1 size=48701 2024-09-12T17:28:52.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.313+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=DLY8M376TAX5 tag=A0191RYVOUEC type=write size=2145853 2024-09-12T17:28:52.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.314+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=6LQFRQUC2VG0 type=del size=363367 2024-09-12T17:28:52.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.316+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~7GG74BGLYAG5.0 size=1048576 2024-09-12T17:28:52.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.317+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~7GG74BGLYAG5.1 size=787878 2024-09-12T17:28:52.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.319+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=7GG74BGLYAG5 tag=E4W0G7AVR9SB type=write size=2885030 2024-09-12T17:28:52.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.321+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=S5JGPRKMNW5F type=del size=2237010 2024-09-12T17:28:52.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.322+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=E3I6YKIH82LC type=del 2024-09-12T17:28:52.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.324+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=SDEVCLLFQTC0 type=write size=414121 2024-09-12T17:28:52.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.325+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~CB64T0P7DA8U.0 size=733960 2024-09-12T17:28:52.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.328+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=CB64T0P7DA8U tag=ELDBOJS6LGFM type=write size=1782536 2024-09-12T17:28:52.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.330+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~3GSXW2BBKAL7.0 size=1048576 2024-09-12T17:28:52.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.331+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~3GSXW2BBKAL7.1 size=22539 2024-09-12T17:28:52.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.331+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=3GSXW2BBKAL7 tag=VVE7HS2FD9CW type=write size=2119691 2024-09-12T17:28:52.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.334+0000 7f9d7bc0c780 1 < suggested remove operation key=9B83KWC5E4ZV tag=9Q916N0OVLP9 type=del 2024-09-12T17:28:52.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.337+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~WTO6587CDVTF.0 size=1048576 2024-09-12T17:28:52.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.338+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~WTO6587CDVTF.1 size=44416 2024-09-12T17:28:52.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.338+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=WTO6587CDVTF tag=CWPPLGYGCR9A type=write size=2141568 2024-09-12T17:28:52.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.339+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=4VY172WVE153 type=del 2024-09-12T17:28:52.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.341+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=HY1DIINLOSBQ type=del size=618151 2024-09-12T17:28:52.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.342+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~V6CBEMTB991L.0 size=1048576 2024-09-12T17:28:52.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.343+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~V6CBEMTB991L.1 size=898314 2024-09-12T17:28:52.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.346+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=V6CBEMTB991L tag=ISUBYDZS9FN2 type=write size=2995466 2024-09-12T17:28:52.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.348+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=NE3YXJDJCFHO type=write size=728345 2024-09-12T17:28:52.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.349+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~MMZVWX5OAKEC.0 size=1048576 2024-09-12T17:28:52.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.350+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~MMZVWX5OAKEC.1 size=187519 2024-09-12T17:28:52.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.353+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=MMZVWX5OAKEC tag=9HACTX7S754L type=write size=2284671 2024-09-12T17:28:52.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.356+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~CBZACHTYKTIA.0 size=287326 2024-09-12T17:28:52.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.356+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=CBZACHTYKTIA tag=HBTBG7TKJJIK type=write size=1335902 2024-09-12T17:28:52.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.358+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=2ZYIKXZVFKE0 type=del 2024-09-12T17:28:52.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.361+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~1DFLVCCU0YQ8.0 size=1048576 2024-09-12T17:28:52.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.362+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~1DFLVCCU0YQ8.1 size=1048576 2024-09-12T17:28:52.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.363+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~1DFLVCCU0YQ8.2 size=492711 2024-09-12T17:28:52.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.363+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=1DFLVCCU0YQ8 tag=B8IVX8EQYIT1 type=write size=3638439 2024-09-12T17:28:52.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.366+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=8X638VBI6BQB type=del size=458793 2024-09-12T17:28:52.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.367+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=6LO2X041VQRI type=del size=2611337 2024-09-12T17:28:52.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.369+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~Z9OEHSM66VRH.0 size=1048576 2024-09-12T17:28:52.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.370+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~Z9OEHSM66VRH.1 size=396406 2024-09-12T17:28:52.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.373+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=Z9OEHSM66VRH tag=4OPPN3JH5WE9 type=write size=2493558 2024-09-12T17:28:52.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.375+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=FF3VYTW2EMX2 type=write size=26735 2024-09-12T17:28:52.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.376+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=Q7ZPEQD9HKXX type=del 2024-09-12T17:28:52.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.379+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~4LGTUQGMFM1M.0 size=1048576 2024-09-12T17:28:52.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.380+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~4LGTUQGMFM1M.1 size=1048576 2024-09-12T17:28:52.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.382+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~4LGTUQGMFM1M.2 size=246613 2024-09-12T17:28:52.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.382+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=4LGTUQGMFM1M tag=VO87PD3OQRGB type=write size=3392341 2024-09-12T17:28:52.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.383+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=TOFU5TL3RDX8 type=del 2024-09-12T17:28:52.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.385+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=6CZZAR7Q3V81 type=write size=888840 2024-09-12T17:28:52.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.386+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=RXA0QUEJXFTI type=write size=168203 2024-09-12T17:28:52.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.389+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~WT484AGTQFLV.0 size=1048576 2024-09-12T17:28:52.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.390+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~WT484AGTQFLV.1 size=208349 2024-09-12T17:28:52.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.390+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=WT484AGTQFLV tag=KR18AQ6NA70O type=write size=2305501 2024-09-12T17:28:52.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.391+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=UTXJOB5W3K8C type=del 2024-09-12T17:28:52.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.394+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~ZJTMK11EMTQM.0 size=1048576 2024-09-12T17:28:52.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.395+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~ZJTMK11EMTQM.1 size=392169 2024-09-12T17:28:52.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.395+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=ZJTMK11EMTQM tag=Y0GRUMKJRHHS type=write size=2489321 2024-09-12T17:28:52.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.397+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=CLZFKRDDKYJ2 type=del 2024-09-12T17:28:52.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.399+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=WK26JEFCMTQF type=del size=3171624 2024-09-12T17:28:52.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.402+0000 7f9d7bc0c780 1 < suggested update operation key=G5ZKTTY1XQ9T tag=6LQFRQUC2VG0 type=del size=363367 2024-09-12T17:28:52.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.403+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=NVBJ6LF8YA48 type=del size=3137486 2024-09-12T17:28:52.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.405+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=S5JGPRKMNW5F type=del 2024-09-12T17:28:52.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.406+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=K04Q327VZ5F7 type=del size=2977246 2024-09-12T17:28:52.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.407+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=SDEVCLLFQTC0 type=write size=414121 2024-09-12T17:28:52.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.410+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~BVHG3U42L6LN.0 size=287132 2024-09-12T17:28:52.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.410+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=BVHG3U42L6LN tag=B0Q82II5PWZA type=write size=1335708 2024-09-12T17:28:52.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.412+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~3GSXW2BBKAL7.0 size=1048576 2024-09-12T17:28:52.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.413+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~3GSXW2BBKAL7.1 size=22539 2024-09-12T17:28:52.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.415+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=3GSXW2BBKAL7 tag=VVE7HS2FD9CW type=write size=2119691 2024-09-12T17:28:52.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.417+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=L6HTUZ8DO97Q type=del size=1628762 2024-09-12T17:28:52.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.418+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~WTO6587CDVTF.0 size=1048576 2024-09-12T17:28:52.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.420+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~WTO6587CDVTF.1 size=44416 2024-09-12T17:28:52.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.422+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=WTO6587CDVTF tag=CWPPLGYGCR9A type=write size=2141568 2024-09-12T17:28:52.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.423+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=L17KUKN91MIB type=del size=1600122 2024-09-12T17:28:52.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.425+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=HY1DIINLOSBQ type=del 2024-09-12T17:28:52.427 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.426+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=NAH59HDUHBNR type=del size=2103465 2024-09-12T17:28:52.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.428+0000 7f9d7bc0c780 1 < completed write operation key=0JN5WWDYEM6Q tag=NE3YXJDJCFHO type=write size=728345 2024-09-12T17:28:52.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.430+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~W3P9IZF5Z2U0.0 size=90643 2024-09-12T17:28:52.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.430+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=W3P9IZF5Z2U0 tag=PJFLQW7UICBC type=write size=1139219 2024-09-12T17:28:52.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.431+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~CBZACHTYKTIA.0 size=287326 2024-09-12T17:28:52.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.433+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=CBZACHTYKTIA tag=HBTBG7TKJJIK type=write size=1335902 2024-09-12T17:28:52.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.434+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=ZGD1MU8OQ6ZP type=del size=2636034 2024-09-12T17:28:52.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.436+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~1DFLVCCU0YQ8.0 size=1048576 2024-09-12T17:28:52.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.437+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~1DFLVCCU0YQ8.1 size=1048576 2024-09-12T17:28:52.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.439+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~1DFLVCCU0YQ8.2 size=492711 2024-09-12T17:28:52.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.441+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=1DFLVCCU0YQ8 tag=B8IVX8EQYIT1 type=write size=3638439 2024-09-12T17:28:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.442+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=Q0WI742F06TZ type=del size=1344431 2024-09-12T17:28:52.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.444+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=6LO2X041VQRI type=del 2024-09-12T17:28:52.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.445+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=NO1DMMHAQFLJ type=del size=3031977 2024-09-12T17:28:52.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.446+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=FF3VYTW2EMX2 type=write size=26735 2024-09-12T17:28:52.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.448+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=7HVTOX8GRN6E type=write size=362625 2024-09-12T17:28:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.450+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~4LGTUQGMFM1M.0 size=1048576 2024-09-12T17:28:52.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.451+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~4LGTUQGMFM1M.1 size=1048576 2024-09-12T17:28:52.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.452+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~4LGTUQGMFM1M.2 size=246613 2024-09-12T17:28:52.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.454+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=4LGTUQGMFM1M tag=VO87PD3OQRGB type=write size=3392341 2024-09-12T17:28:52.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.456+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=J07PZ066K0DV type=del size=724486 2024-09-12T17:28:52.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.457+0000 7f9d7bc0c780 -1 < failed to complete operation key=G5ZKTTY1XQ9T tag=6CZZAR7Q3V81 type=write size=888840: (22) Invalid argument 2024-09-12T17:28:52.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.459+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=GM61METMREP2 type=del size=2060853 2024-09-12T17:28:52.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.460+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~WT484AGTQFLV.0 size=1048576 2024-09-12T17:28:52.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.461+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~WT484AGTQFLV.1 size=208349 2024-09-12T17:28:52.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.464+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=WT484AGTQFLV tag=KR18AQ6NA70O type=write size=2305501 2024-09-12T17:28:52.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.465+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=Z4MRU0FTVH9E type=write size=58167 2024-09-12T17:28:52.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.467+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~ZJTMK11EMTQM.0 size=1048576 2024-09-12T17:28:52.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.467+0000 7f9d7bc0c780 1 < canceled part key=_multipart_X7J78IOJR0HA.2~ZJTMK11EMTQM.1 size=392169 2024-09-12T17:28:52.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.470+0000 7f9d7bc0c780 1 < canceled multipart upload key=X7J78IOJR0HA upload=ZJTMK11EMTQM tag=Y0GRUMKJRHHS type=write size=2489321 2024-09-12T17:28:52.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.471+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=1XVVM2V3GI0L type=del size=741843 2024-09-12T17:28:52.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.473+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=WK26JEFCMTQF type=del 2024-09-12T17:28:52.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.475+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~3GS0NXAXOQQZ.0 size=471156 2024-09-12T17:28:52.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.475+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=3GS0NXAXOQQZ tag=UBGKEU380ZPF type=write size=1519732 2024-09-12T17:28:52.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.477+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=NVBJ6LF8YA48 type=del 2024-09-12T17:28:52.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.480+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~PWEVF6RFG81H.0 size=1048576 2024-09-12T17:28:52.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.481+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~PWEVF6RFG81H.1 size=1048576 2024-09-12T17:28:52.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.482+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~PWEVF6RFG81H.2 size=141168 2024-09-12T17:28:52.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.482+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=PWEVF6RFG81H tag=YVTKJOP12H3H type=write size=3286896 2024-09-12T17:28:52.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.485+0000 7f9d7bc0c780 1 < suggested update operation key=80JXIGQWQGR9 tag=K04Q327VZ5F7 type=del size=2977246 2024-09-12T17:28:52.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.486+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=3D13A440XM36 type=del size=718976 2024-09-12T17:28:52.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.488+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~BVHG3U42L6LN.0 size=287132 2024-09-12T17:28:52.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.490+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=BVHG3U42L6LN tag=B0Q82II5PWZA type=write size=1335708 2024-09-12T17:28:52.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.493+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~332HM3J3P259.0 size=334620 2024-09-12T17:28:52.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.493+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=332HM3J3P259 tag=L50F8U5H60KK type=write size=1383196 2024-09-12T17:28:52.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.494+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=L6HTUZ8DO97Q type=del 2024-09-12T17:28:52.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.497+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~0390OU1YQVZC.0 size=1048576 2024-09-12T17:28:52.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.498+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~0390OU1YQVZC.1 size=602771 2024-09-12T17:28:52.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.498+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=0390OU1YQVZC tag=X1GBCKVKB5K5 type=write size=2699923 2024-09-12T17:28:52.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.499+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=L17KUKN91MIB type=del 2024-09-12T17:28:52.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.500+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=4LCMQ1J9I5AP type=del size=1527958 2024-09-12T17:28:52.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.502+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=NAH59HDUHBNR type=del 2024-09-12T17:28:52.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.503+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=ZRUUP66SDLV6 type=write size=45783 2024-09-12T17:28:52.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.503+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~W3P9IZF5Z2U0.0 size=90643 2024-09-12T17:28:52.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.505+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=W3P9IZF5Z2U0 tag=PJFLQW7UICBC type=write size=1139219 2024-09-12T17:28:52.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.507+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=4TI9F532CN2H type=del size=892192 2024-09-12T17:28:52.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.510+0000 7f9d7bc0c780 1 < suggested update operation key=G5ZKTTY1XQ9T tag=ZGD1MU8OQ6ZP type=del size=2636034 2024-09-12T17:28:52.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.512+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=25B51RXFSWBM type=del size=368680 2024-09-12T17:28:52.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.513+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=Q0WI742F06TZ type=del 2024-09-12T17:28:52.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.516+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~LTQQG7S16WDT.0 size=1048576 2024-09-12T17:28:52.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.517+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~LTQQG7S16WDT.1 size=351984 2024-09-12T17:28:52.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.517+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=LTQQG7S16WDT tag=IBKKN68BZFLB type=write size=2449136 2024-09-12T17:28:52.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.518+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=NO1DMMHAQFLJ type=del 2024-09-12T17:28:52.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.521+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~YE5T0DMCWWX7.0 size=1048576 2024-09-12T17:28:52.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.522+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~YE5T0DMCWWX7.1 size=475528 2024-09-12T17:28:52.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.522+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=YE5T0DMCWWX7 tag=T3LH3PGKAIGW type=write size=2572680 2024-09-12T17:28:52.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.523+0000 7f9d7bc0c780 1 < completed write operation key=QB8C0OJA1L4X tag=7HVTOX8GRN6E type=write size=362625 2024-09-12T17:28:52.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.526+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~5QV97D9Y4BH6.0 size=410845 2024-09-12T17:28:52.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.526+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=5QV97D9Y4BH6 tag=XGT46O12S6E5 type=write size=1459421 2024-09-12T17:28:52.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.527+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=J07PZ066K0DV type=del 2024-09-12T17:28:52.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.530+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~7QROPQIBUSS9.0 size=1048576 2024-09-12T17:28:52.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.531+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~7QROPQIBUSS9.1 size=363280 2024-09-12T17:28:52.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.531+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=7QROPQIBUSS9 tag=1F6DFL94AI91 type=write size=2460432 2024-09-12T17:28:52.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.532+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=GM61METMREP2 type=del 2024-09-12T17:28:52.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.534+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=V663GOX7CTJT type=del size=356115 2024-09-12T17:28:52.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.537+0000 7f9d7bc0c780 1 < suggested remove operation key=0BYGD7FTPQF3 tag=Z4MRU0FTVH9E type=write 2024-09-12T17:28:52.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.538+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=09ZV46AG9V6W type=del size=1786218 2024-09-12T17:28:52.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.539+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=1XVVM2V3GI0L type=del 2024-09-12T17:28:52.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.541+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=K81JL98QC14V type=del size=2962836 2024-09-12T17:28:52.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.542+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~3GS0NXAXOQQZ.0 size=471156 2024-09-12T17:28:52.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.544+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=3GS0NXAXOQQZ tag=UBGKEU380ZPF type=write size=1519732 2024-09-12T17:28:52.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.546+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=ZP6GQJ8L1UAV type=del size=1250845 2024-09-12T17:28:52.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.547+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~PWEVF6RFG81H.0 size=1048576 2024-09-12T17:28:52.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.549+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~PWEVF6RFG81H.1 size=1048576 2024-09-12T17:28:52.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.550+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~PWEVF6RFG81H.2 size=141168 2024-09-12T17:28:52.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.552+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=PWEVF6RFG81H tag=YVTKJOP12H3H type=write size=3286896 2024-09-12T17:28:52.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.555+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~BK83MD50J2TG.0 size=841048 2024-09-12T17:28:52.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.555+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=BK83MD50J2TG tag=7L7W94L8KL2U type=write size=1889624 2024-09-12T17:28:52.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.557+0000 7f9d7bc0c780 1 < suggested update operation key=5B96YH46VAK3 tag=3D13A440XM36 type=del size=718976 2024-09-12T17:28:52.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.559+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=JE5Q9SP07WJ9 type=write size=607018 2024-09-12T17:28:52.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.560+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~332HM3J3P259.0 size=334620 2024-09-12T17:28:52.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.562+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=332HM3J3P259 tag=L50F8U5H60KK type=write size=1383196 2024-09-12T17:28:52.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.564+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=9DN3IMCFE9Y9 type=del size=1486087 2024-09-12T17:28:52.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.565+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~0390OU1YQVZC.0 size=1048576 2024-09-12T17:28:52.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.567+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~0390OU1YQVZC.1 size=602771 2024-09-12T17:28:52.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.569+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=0390OU1YQVZC tag=X1GBCKVKB5K5 type=write size=2699923 2024-09-12T17:28:52.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.572+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=PX5CQZK4SRH4 type=del size=1116109 2024-09-12T17:28:52.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.573+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=4LCMQ1J9I5AP type=del 2024-09-12T17:28:52.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.575+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=AIZW0A2EBC2F type=del size=160934 2024-09-12T17:28:52.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.576+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=ZRUUP66SDLV6 type=write size=45783 2024-09-12T17:28:52.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.578+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~C7LJKGL6QM25.0 size=1048576 2024-09-12T17:28:52.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.580+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~C7LJKGL6QM25.1 size=192851 2024-09-12T17:28:52.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.580+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=C7LJKGL6QM25 tag=I51HVAKKVVSI type=write size=2290003 2024-09-12T17:28:52.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.581+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=4TI9F532CN2H type=del 2024-09-12T17:28:52.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.583+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=HXKA2SN9B87H type=del size=4138427 2024-09-12T17:28:52.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.584+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=25B51RXFSWBM type=del 2024-09-12T17:28:52.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.586+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=ENLU7N8VW922 type=del size=3634026 2024-09-12T17:28:52.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.587+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~LTQQG7S16WDT.0 size=1048576 2024-09-12T17:28:52.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.589+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~LTQQG7S16WDT.1 size=351984 2024-09-12T17:28:52.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.591+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=LTQQG7S16WDT tag=IBKKN68BZFLB type=write size=2449136 2024-09-12T17:28:52.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.593+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~DD8IEW1DDQMB.0 size=1048576 2024-09-12T17:28:52.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.595+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~DD8IEW1DDQMB.1 size=768674 2024-09-12T17:28:52.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.595+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=DD8IEW1DDQMB tag=Z0QUHK3VCD4Q type=write size=2865826 2024-09-12T17:28:52.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.596+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~YE5T0DMCWWX7.0 size=1048576 2024-09-12T17:28:52.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.598+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~YE5T0DMCWWX7.1 size=475528 2024-09-12T17:28:52.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.600+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=YE5T0DMCWWX7 tag=T3LH3PGKAIGW type=write size=2572680 2024-09-12T17:28:52.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.601+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=YOWFXGEP4FH8 type=del size=1059730 2024-09-12T17:28:52.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.603+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~5QV97D9Y4BH6.0 size=410845 2024-09-12T17:28:52.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.605+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=5QV97D9Y4BH6 tag=XGT46O12S6E5 type=write size=1459421 2024-09-12T17:28:52.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.606+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=HFU3TY3M76UN type=del size=325211 2024-09-12T17:28:52.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.608+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~7QROPQIBUSS9.0 size=1048576 2024-09-12T17:28:52.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.609+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~7QROPQIBUSS9.1 size=363280 2024-09-12T17:28:52.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.612+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=7QROPQIBUSS9 tag=1F6DFL94AI91 type=write size=2460432 2024-09-12T17:28:52.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.613+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=ITCYA8HEOY34 type=del size=3377872 2024-09-12T17:28:52.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.615+0000 7f9d7bc0c780 1 < canceled operation key=31PU0U6IEAV2 tag=V663GOX7CTJT type=del size=356115 2024-09-12T17:28:52.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.616+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=Y2R8527CTIIK type=del size=3927311 2024-09-12T17:28:52.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.618+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=09ZV46AG9V6W type=del 2024-09-12T17:28:52.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.619+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=UXOD9U79LLBS type=write size=1007756 2024-09-12T17:28:52.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.622+0000 7f9d7bc0c780 1 < suggested remove operation key=5B96YH46VAK3 tag=K81JL98QC14V type=del 2024-09-12T17:28:52.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.623+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=YU10UP0DCFTE type=write size=60859 2024-09-12T17:28:52.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.626+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=ZP6GQJ8L1UAV type=del 2024-09-12T17:28:52.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.627+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=B4K1IOQ1WK95 type=del size=3700133 2024-09-12T17:28:52.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.629+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~BK83MD50J2TG.0 size=841048 2024-09-12T17:28:52.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.631+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=BK83MD50J2TG tag=7L7W94L8KL2U type=write size=1889624 2024-09-12T17:28:52.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.632+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=0WHSCLYDBI41 type=del size=204799 2024-09-12T17:28:52.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.634+0000 7f9d7bc0c780 1 < canceled operation key=NQ0768B94GVV tag=JE5Q9SP07WJ9 type=write size=607018 2024-09-12T17:28:52.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.635+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=TKV3NPCI0N6O type=del size=1378460 2024-09-12T17:28:52.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.637+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=9DN3IMCFE9Y9 type=del 2024-09-12T17:28:52.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.639+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~UQAV8I1699TP.0 size=1048576 2024-09-12T17:28:52.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.640+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~UQAV8I1699TP.1 size=175929 2024-09-12T17:28:52.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.640+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=UQAV8I1699TP tag=T6U5XY83MYTA type=write size=2273081 2024-09-12T17:28:52.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.642+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=PX5CQZK4SRH4 type=del 2024-09-12T17:28:52.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.643+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=F14EUAZTL3IB type=del size=2120418 2024-09-12T17:28:52.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.646+0000 7f9d7bc0c780 1 < suggested update operation key=58C4SS3TN12K tag=AIZW0A2EBC2F type=del size=160934 2024-09-12T17:28:52.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.649+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~FVKB0Y54J9A9.0 size=674537 2024-09-12T17:28:52.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.649+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=FVKB0Y54J9A9 tag=K3YM69JMK2B3 type=write size=1723113 2024-09-12T17:28:52.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.650+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~C7LJKGL6QM25.0 size=1048576 2024-09-12T17:28:52.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.652+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~C7LJKGL6QM25.1 size=192851 2024-09-12T17:28:52.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.654+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=C7LJKGL6QM25 tag=I51HVAKKVVSI type=write size=2290003 2024-09-12T17:28:52.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.656+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=2DOASESYSY6O type=del size=633972 2024-09-12T17:28:52.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.657+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=HXKA2SN9B87H type=del 2024-09-12T17:28:52.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.660+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~0DQO626R1XYW.0 size=1048576 2024-09-12T17:28:52.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.661+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~0DQO626R1XYW.1 size=1048576 2024-09-12T17:28:52.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.662+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~0DQO626R1XYW.2 size=261163 2024-09-12T17:28:52.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.662+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=0DQO626R1XYW tag=YY6SG9MDAO3P type=write size=3406891 2024-09-12T17:28:52.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.664+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=ENLU7N8VW922 type=del size=3634026 2024-09-12T17:28:52.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.666+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~DBUXMD1IFKIF.0 size=1048576 2024-09-12T17:28:52.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.668+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~DBUXMD1IFKIF.1 size=345102 2024-09-12T17:28:52.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.668+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=DBUXMD1IFKIF tag=WBA55JPJ0UJC type=write size=2442254 2024-09-12T17:28:52.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.669+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~DD8IEW1DDQMB.0 size=1048576 2024-09-12T17:28:52.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.670+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~DD8IEW1DDQMB.1 size=768674 2024-09-12T17:28:52.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.673+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=DD8IEW1DDQMB tag=Z0QUHK3VCD4Q type=write size=2865826 2024-09-12T17:28:52.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.674+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=M3MBPTA9086P type=del size=1384761 2024-09-12T17:28:52.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.676+0000 7f9d7bc0c780 1 < canceled operation key=NQ0768B94GVV tag=YOWFXGEP4FH8 type=del size=1059730 2024-09-12T17:28:52.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.677+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=RY2C4OC141Z8 type=del size=2947806 2024-09-12T17:28:52.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.679+0000 7f9d7bc0c780 1 < canceled operation key=ZA6JC3WXS8Y5 tag=HFU3TY3M76UN type=del size=325211 2024-09-12T17:28:52.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.681+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~XYBS6DC4IPDZ.0 size=1048576 2024-09-12T17:28:52.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.683+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~XYBS6DC4IPDZ.1 size=1048576 2024-09-12T17:28:52.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.684+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~XYBS6DC4IPDZ.2 size=226968 2024-09-12T17:28:52.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.684+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=XYBS6DC4IPDZ tag=SWBEZ31BNCV0 type=write size=3372696 2024-09-12T17:28:52.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.685+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=ITCYA8HEOY34 type=del 2024-09-12T17:28:52.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.686+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=UA3GVNRI77YL type=del size=621283 2024-09-12T17:28:52.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.688+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=Y2R8527CTIIK type=del 2024-09-12T17:28:52.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.689+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=17WV58PD0L1S type=write size=798009 2024-09-12T17:28:52.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.691+0000 7f9d7bc0c780 1 < completed write operation key=OZKAXB0ET9R7 tag=UXOD9U79LLBS type=write size=1007756 2024-09-12T17:28:52.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.693+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~ATNJCBPN33KS.0 size=936800 2024-09-12T17:28:52.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.693+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=ATNJCBPN33KS tag=HYXE871K76D1 type=write size=1985376 2024-09-12T17:28:52.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.695+0000 7f9d7bc0c780 1 < canceled operation key=SDX69F30A2RK tag=YU10UP0DCFTE type=write size=60859 2024-09-12T17:28:52.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.698+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~KONUJO2KYLTX.0 size=210490 2024-09-12T17:28:52.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.698+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=KONUJO2KYLTX tag=6NBJDUOD2L0C type=write size=1259066 2024-09-12T17:28:52.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.699+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=B4K1IOQ1WK95 type=del 2024-09-12T17:28:52.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.702+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~B8SDKT3DQQGY.0 size=1048576 2024-09-12T17:28:52.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.703+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~B8SDKT3DQQGY.1 size=740558 2024-09-12T17:28:52.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.703+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=B8SDKT3DQQGY tag=PEFKO86PLP0W type=write size=2837710 2024-09-12T17:28:52.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.705+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=0WHSCLYDBI41 type=del 2024-09-12T17:28:52.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.706+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=SKQGD1KIUODE type=del size=1167566 2024-09-12T17:28:52.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.708+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=TKV3NPCI0N6O type=del 2024-09-12T17:28:52.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.712+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~E15QLNN3RQSN.0 size=591826 2024-09-12T17:28:52.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.712+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=E15QLNN3RQSN tag=UWSQL3FY57AF type=write size=1640402 2024-09-12T17:28:52.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.715+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~UQAV8I1699TP.0 size=1048576 2024-09-12T17:28:52.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.716+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~UQAV8I1699TP.1 size=175929 2024-09-12T17:28:52.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.718+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=UQAV8I1699TP tag=T6U5XY83MYTA type=write size=2273081 2024-09-12T17:28:52.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.720+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=F5AMRM0M2QCC type=write size=101130 2024-09-12T17:28:52.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.721+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=F14EUAZTL3IB type=del 2024-09-12T17:28:52.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.723+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~3H8QGCQFKZBF.0 size=259748 2024-09-12T17:28:52.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.723+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=3H8QGCQFKZBF tag=B5JA353ORANL type=write size=1308324 2024-09-12T17:28:52.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.725+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~FVKB0Y54J9A9.0 size=674537 2024-09-12T17:28:52.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.727+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=FVKB0Y54J9A9 tag=K3YM69JMK2B3 type=write size=1723113 2024-09-12T17:28:52.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.728+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=N0O1RRVHDQFE type=del size=1495968 2024-09-12T17:28:52.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.730+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=2DOASESYSY6O type=del 2024-09-12T17:28:52.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.731+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=K91OJ1PGNJ9J type=del size=2223817 2024-09-12T17:28:52.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.733+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~0DQO626R1XYW.0 size=1048576 2024-09-12T17:28:52.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.734+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~0DQO626R1XYW.1 size=1048576 2024-09-12T17:28:52.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.735+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~0DQO626R1XYW.2 size=261163 2024-09-12T17:28:52.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.737+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=0DQO626R1XYW tag=YY6SG9MDAO3P type=write size=3406891 2024-09-12T17:28:52.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.741+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~F87LZE2BP6YE.0 size=1048576 2024-09-12T17:28:52.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.742+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~F87LZE2BP6YE.1 size=1048576 2024-09-12T17:28:52.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.743+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~F87LZE2BP6YE.2 size=346045 2024-09-12T17:28:52.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.743+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=F87LZE2BP6YE tag=6NN181YWHYVU type=write size=3491773 2024-09-12T17:28:52.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.745+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~DBUXMD1IFKIF.0 size=1048576 2024-09-12T17:28:52.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.745+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~DBUXMD1IFKIF.1 size=345102 2024-09-12T17:28:52.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.747+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=DBUXMD1IFKIF tag=WBA55JPJ0UJC type=write size=2442254 2024-09-12T17:28:52.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.748+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=WXARCOOU3M0O type=del size=2626166 2024-09-12T17:28:52.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.749+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=M3MBPTA9086P type=del 2024-09-12T17:28:52.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.751+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=BW2O0JEGPYE0 type=del size=2389797 2024-09-12T17:28:52.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.752+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=RY2C4OC141Z8 type=del 2024-09-12T17:28:52.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.753+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=1T7OI00YLUJW type=del size=3550306 2024-09-12T17:28:52.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.755+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~XYBS6DC4IPDZ.0 size=1048576 2024-09-12T17:28:52.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.756+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~XYBS6DC4IPDZ.1 size=1048576 2024-09-12T17:28:52.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.757+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~XYBS6DC4IPDZ.2 size=226968 2024-09-12T17:28:52.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.759+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=XYBS6DC4IPDZ tag=SWBEZ31BNCV0 type=write size=3372696 2024-09-12T17:28:52.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.762+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~J44ME9ZUM7SR.0 size=1048576 2024-09-12T17:28:52.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.763+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~J44ME9ZUM7SR.1 size=759050 2024-09-12T17:28:52.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.763+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=J44ME9ZUM7SR tag=O2HU3O24PDKR type=write size=2856202 2024-09-12T17:28:52.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.764+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=UA3GVNRI77YL type=del 2024-09-12T17:28:52.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.766+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=XQ0JITXQYQW2 type=del size=3095222 2024-09-12T17:28:52.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.767+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=17WV58PD0L1S type=write size=798009 2024-09-12T17:28:52.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.770+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~HSLU2VVTTMJC.0 size=708649 2024-09-12T17:28:52.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.770+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=HSLU2VVTTMJC tag=A7EIQ7CZ0R9A type=write size=1757225 2024-09-12T17:28:52.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.771+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~ATNJCBPN33KS.0 size=936800 2024-09-12T17:28:52.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.774+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=ATNJCBPN33KS tag=HYXE871K76D1 type=write size=1985376 2024-09-12T17:28:52.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.776+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~X01VYZRQU2OV.0 size=655669 2024-09-12T17:28:52.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.776+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=X01VYZRQU2OV tag=A8MFCII3PHQQ type=write size=1704245 2024-09-12T17:28:52.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.778+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~KONUJO2KYLTX.0 size=210490 2024-09-12T17:28:52.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.780+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=KONUJO2KYLTX tag=6NBJDUOD2L0C type=write size=1259066 2024-09-12T17:28:52.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.781+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=2BXH9QOKRPHJ type=del size=3605011 2024-09-12T17:28:52.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.783+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~B8SDKT3DQQGY.0 size=1048576 2024-09-12T17:28:52.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.784+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~B8SDKT3DQQGY.1 size=740558 2024-09-12T17:28:52.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.786+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=B8SDKT3DQQGY tag=PEFKO86PLP0W type=write size=2837710 2024-09-12T17:28:52.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.787+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=CQAFRF20OVGR type=del size=498656 2024-09-12T17:28:52.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.790+0000 7f9d7bc0c780 1 < suggested remove operation key=64T291B0U226 tag=SKQGD1KIUODE type=del 2024-09-12T17:28:52.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.791+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=BM4U70PKSZDP type=del size=86818 2024-09-12T17:28:52.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.793+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~E15QLNN3RQSN.0 size=591826 2024-09-12T17:28:52.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.795+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=E15QLNN3RQSN tag=UWSQL3FY57AF type=write size=1640402 2024-09-12T17:28:52.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.797+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~RO6U0ZTOZDD9.0 size=1048576 2024-09-12T17:28:52.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.798+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~RO6U0ZTOZDD9.1 size=558227 2024-09-12T17:28:52.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.798+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=RO6U0ZTOZDD9 tag=FK2NPAND3Q8E type=write size=2655379 2024-09-12T17:28:52.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.800+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=F5AMRM0M2QCC type=write size=101130 2024-09-12T17:28:52.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.801+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=H00UCSVMM6QZ type=del size=1269880 2024-09-12T17:28:52.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.802+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~3H8QGCQFKZBF.0 size=259748 2024-09-12T17:28:52.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.805+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=3H8QGCQFKZBF tag=B5JA353ORANL type=write size=1308324 2024-09-12T17:28:52.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.807+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~D3RZMW1ME3B4.0 size=1048576 2024-09-12T17:28:52.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.808+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~D3RZMW1ME3B4.1 size=162164 2024-09-12T17:28:52.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.808+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=D3RZMW1ME3B4 tag=I5JPJSURUY1V type=write size=2259316 2024-09-12T17:28:52.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.810+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=N0O1RRVHDQFE type=del 2024-09-12T17:28:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.811+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=VSPD0QOZPM7P type=del size=1401759 2024-09-12T17:28:52.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.812+0000 7f9d7bc0c780 1 < canceled operation key=SDX69F30A2RK tag=K91OJ1PGNJ9J type=del size=2223817 2024-09-12T17:28:52.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.814+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=CNS3VJ39XHWH type=del size=1245117 2024-09-12T17:28:52.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.815+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~F87LZE2BP6YE.0 size=1048576 2024-09-12T17:28:52.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.817+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~F87LZE2BP6YE.1 size=1048576 2024-09-12T17:28:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.818+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~F87LZE2BP6YE.2 size=346045 2024-09-12T17:28:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.820+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=F87LZE2BP6YE tag=6NN181YWHYVU type=write size=3491773 2024-09-12T17:28:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.822+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=30BCZ6VH1ZL0 type=del size=962867 2024-09-12T17:28:52.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.823+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=WXARCOOU3M0O type=del 2024-09-12T17:28:52.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.824+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=WNZFC777J27B type=del size=2560505 2024-09-12T17:28:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.827+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=BW2O0JEGPYE0 type=del size=2389797 2024-09-12T17:28:52.831 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.830+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~AXYT0SQ3HW7I.0 size=1048576 2024-09-12T17:28:52.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.831+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~AXYT0SQ3HW7I.1 size=1048576 2024-09-12T17:28:52.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.832+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~AXYT0SQ3HW7I.2 size=368514 2024-09-12T17:28:52.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.832+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=AXYT0SQ3HW7I tag=AGF0FS9Z4YEM type=write size=3514242 2024-09-12T17:28:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.834+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=1T7OI00YLUJW type=del 2024-09-12T17:28:52.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.835+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=A016KTYA8S4L type=del size=1147397 2024-09-12T17:28:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.836+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~J44ME9ZUM7SR.0 size=1048576 2024-09-12T17:28:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.836+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~J44ME9ZUM7SR.1 size=759050 2024-09-12T17:28:52.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.839+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=J44ME9ZUM7SR tag=O2HU3O24PDKR type=write size=2856202 2024-09-12T17:28:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.843+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~2FXVEZZY46HS.0 size=949992 2024-09-12T17:28:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.843+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=2FXVEZZY46HS tag=5JB16YYYALJ7 type=write size=1998568 2024-09-12T17:28:52.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.844+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=XQ0JITXQYQW2 type=del 2024-09-12T17:28:52.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.845+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=D79AN5R41427 type=del size=1695803 2024-09-12T17:28:52.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.847+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~HSLU2VVTTMJC.0 size=708649 2024-09-12T17:28:52.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.849+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=HSLU2VVTTMJC tag=A7EIQ7CZ0R9A type=write size=1757225 2024-09-12T17:28:52.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.851+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=J65IN0PAIOI2 type=del size=924775 2024-09-12T17:28:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.852+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~X01VYZRQU2OV.0 size=655669 2024-09-12T17:28:52.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.854+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=X01VYZRQU2OV tag=A8MFCII3PHQQ type=write size=1704245 2024-09-12T17:28:52.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.856+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=PFOAFL5Q6EDV type=write size=12085 2024-09-12T17:28:52.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.857+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=2BXH9QOKRPHJ type=del 2024-09-12T17:28:52.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.859+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=AVE92LE8VO4T type=del size=1901427 2024-09-12T17:28:52.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.860+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=CQAFRF20OVGR type=del 2024-09-12T17:28:52.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.862+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=8NY0RTGQW3PG type=del size=1644835 2024-09-12T17:28:52.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.865+0000 7f9d7bc0c780 1 < suggested update operation key=J3YYRIVKQ5AU tag=BM4U70PKSZDP type=del size=86818 2024-09-12T17:28:52.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.867+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~6XCVOAPGXKRJ.0 size=788492 2024-09-12T17:28:52.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.867+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=6XCVOAPGXKRJ tag=HBUMOC2AVHN9 type=write size=1837068 2024-09-12T17:28:52.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.869+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~RO6U0ZTOZDD9.0 size=1048576 2024-09-12T17:28:52.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.870+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~RO6U0ZTOZDD9.1 size=558227 2024-09-12T17:28:52.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.872+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=RO6U0ZTOZDD9 tag=FK2NPAND3Q8E type=write size=2655379 2024-09-12T17:28:52.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.874+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=EA9Y0YFJIHR3 type=del size=3716580 2024-09-12T17:28:52.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.875+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=H00UCSVMM6QZ type=del 2024-09-12T17:28:52.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.878+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~CTNRJ5XDFX7W.0 size=1048576 2024-09-12T17:28:52.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.879+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~CTNRJ5XDFX7W.1 size=844038 2024-09-12T17:28:52.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.879+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=CTNRJ5XDFX7W tag=MNBEYNR113ZL type=write size=2941190 2024-09-12T17:28:52.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.881+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~D3RZMW1ME3B4.0 size=1048576 2024-09-12T17:28:52.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.881+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~D3RZMW1ME3B4.1 size=162164 2024-09-12T17:28:52.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.883+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=D3RZMW1ME3B4 tag=I5JPJSURUY1V type=write size=2259316 2024-09-12T17:28:52.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.886+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~866IYV3POPLK.0 size=1048576 2024-09-12T17:28:52.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.887+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~866IYV3POPLK.1 size=1048576 2024-09-12T17:28:52.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.888+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~866IYV3POPLK.2 size=356412 2024-09-12T17:28:52.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.888+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=866IYV3POPLK tag=4B5EA2HWH1CG type=write size=3502140 2024-09-12T17:28:52.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.889+0000 7f9d7bc0c780 1 < canceled operation key=G5ZKTTY1XQ9T tag=VSPD0QOZPM7P type=del size=1401759 2024-09-12T17:28:52.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.891+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=J5C8V6EW737Z type=del size=2208327 2024-09-12T17:28:52.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.892+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=CNS3VJ39XHWH type=del 2024-09-12T17:28:52.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.895+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~U40TV8EJ38DA.0 size=1048576 2024-09-12T17:28:52.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.896+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~U40TV8EJ38DA.1 size=155568 2024-09-12T17:28:52.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.896+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=U40TV8EJ38DA tag=AA2Q6GP7ORIP type=write size=2252720 2024-09-12T17:28:52.899 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.898+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=30BCZ6VH1ZL0 type=del 2024-09-12T17:28:52.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.900+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=UWPOW3FUDGCD type=del size=3586229 2024-09-12T17:28:52.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.902+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=WNZFC777J27B type=del 2024-09-12T17:28:52.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.903+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=KQ2CYT4SP3DZ type=del size=67331 2024-09-12T17:28:52.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.904+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~AXYT0SQ3HW7I.0 size=1048576 2024-09-12T17:28:52.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.905+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~AXYT0SQ3HW7I.1 size=1048576 2024-09-12T17:28:52.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.906+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~AXYT0SQ3HW7I.2 size=368514 2024-09-12T17:28:52.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.909+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=AXYT0SQ3HW7I tag=AGF0FS9Z4YEM type=write size=3514242 2024-09-12T17:28:52.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.911+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~TJ4FBLKB4T2O.0 size=1048576 2024-09-12T17:28:52.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.912+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~TJ4FBLKB4T2O.1 size=796611 2024-09-12T17:28:52.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.912+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=TJ4FBLKB4T2O tag=3P2KV686K1AI type=write size=2893763 2024-09-12T17:28:52.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.914+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=A016KTYA8S4L type=del 2024-09-12T17:28:52.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.916+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~R1SXUQMT0DX7.0 size=1048576 2024-09-12T17:28:52.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.917+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~R1SXUQMT0DX7.1 size=1048576 2024-09-12T17:28:52.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.918+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~R1SXUQMT0DX7.2 size=295153 2024-09-12T17:28:52.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.918+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=R1SXUQMT0DX7 tag=BHNHLYPRF0XP type=write size=3440881 2024-09-12T17:28:52.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.919+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~2FXVEZZY46HS.0 size=949992 2024-09-12T17:28:52.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.921+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=2FXVEZZY46HS tag=5JB16YYYALJ7 type=write size=1998568 2024-09-12T17:28:52.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.923+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~16U0ZC1HPDRU.0 size=1048576 2024-09-12T17:28:52.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.924+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~16U0ZC1HPDRU.1 size=431937 2024-09-12T17:28:52.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.925+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=16U0ZC1HPDRU tag=JXI7P0K37Y5N type=write size=2529089 2024-09-12T17:28:52.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.926+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=D79AN5R41427 type=del 2024-09-12T17:28:52.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.928+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=81QMHOQQDULB type=write size=586968 2024-09-12T17:28:52.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.929+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=J65IN0PAIOI2 type=del 2024-09-12T17:28:52.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.930+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=50R65KMV748W type=del size=1199154 2024-09-12T17:28:52.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.932+0000 7f9d7bc0c780 1 < completed write operation key=0NGHC5GMSGRX tag=PFOAFL5Q6EDV type=write size=12085 2024-09-12T17:28:52.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.933+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=KNFLFN30T3L9 type=write size=974742 2024-09-12T17:28:52.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.936+0000 7f9d7bc0c780 1 < suggested remove operation key=5B96YH46VAK3 tag=AVE92LE8VO4T type=del 2024-09-12T17:28:52.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.938+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~X46ULNJL4NRF.0 size=1048576 2024-09-12T17:28:52.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.939+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~X46ULNJL4NRF.1 size=1048576 2024-09-12T17:28:52.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.940+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~X46ULNJL4NRF.2 size=369604 2024-09-12T17:28:52.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.940+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=X46ULNJL4NRF tag=AZM9JPP4OPKY type=write size=3515332 2024-09-12T17:28:52.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.942+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=8NY0RTGQW3PG type=del 2024-09-12T17:28:52.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.944+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~T9FT74BQCGV3.0 size=1048576 2024-09-12T17:28:52.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.945+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~T9FT74BQCGV3.1 size=1048576 2024-09-12T17:28:52.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.946+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~T9FT74BQCGV3.2 size=442189 2024-09-12T17:28:52.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.946+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=T9FT74BQCGV3 tag=YZYV2NN21X6S type=write size=3587917 2024-09-12T17:28:52.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.947+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LTG0UQEYPUGO.2~6XCVOAPGXKRJ.0 size=788492 2024-09-12T17:28:52.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.949+0000 7f9d7bc0c780 1 < canceled multipart upload key=LTG0UQEYPUGO upload=6XCVOAPGXKRJ tag=HBUMOC2AVHN9 type=write size=1837068 2024-09-12T17:28:52.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.950+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=ZG0ABJ6YIEGO type=del size=2317224 2024-09-12T17:28:52.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.953+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=EA9Y0YFJIHR3 type=del 2024-09-12T17:28:52.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.954+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=Q0OTW9EDU926 type=del size=3778780 2024-09-12T17:28:52.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.956+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~CTNRJ5XDFX7W.0 size=1048576 2024-09-12T17:28:52.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.957+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~CTNRJ5XDFX7W.1 size=844038 2024-09-12T17:28:52.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.959+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=CTNRJ5XDFX7W tag=MNBEYNR113ZL type=write size=2941190 2024-09-12T17:28:52.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.960+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=NPQTTDIO50S9 type=del size=1300800 2024-09-12T17:28:52.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.962+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~866IYV3POPLK.0 size=1048576 2024-09-12T17:28:52.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.963+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~866IYV3POPLK.1 size=1048576 2024-09-12T17:28:52.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.964+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~866IYV3POPLK.2 size=356412 2024-09-12T17:28:52.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.966+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=866IYV3POPLK tag=4B5EA2HWH1CG type=write size=3502140 2024-09-12T17:28:52.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.967+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=QLHH2NPRYW8D type=write size=183444 2024-09-12T17:28:52.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.969+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=J5C8V6EW737Z type=del 2024-09-12T17:28:52.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.971+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=RT7QL68H2Y18 type=del size=2011665 2024-09-12T17:28:52.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.974+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~U40TV8EJ38DA.0 size=1048576 2024-09-12T17:28:52.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.975+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~U40TV8EJ38DA.1 size=155568 2024-09-12T17:28:52.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.978+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=U40TV8EJ38DA tag=AA2Q6GP7ORIP type=write size=2252720 2024-09-12T17:28:52.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.979+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=0BGMSZR8PAGS type=del size=1026011 2024-09-12T17:28:52.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.980+0000 7f9d7bc0c780 -1 < no bi entry to suggest for operation key=58C4SS3TN12K tag=UWPOW3FUDGCD type=del size=3586229: (2) No such file or directory 2024-09-12T17:28:52.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.982+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~DA7ZF5IK0UUK.0 size=1048576 2024-09-12T17:28:52.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.984+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~DA7ZF5IK0UUK.1 size=502243 2024-09-12T17:28:52.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.984+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=DA7ZF5IK0UUK tag=FJ0R083GAX0B type=write size=2599395 2024-09-12T17:28:52.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.985+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=KQ2CYT4SP3DZ type=del 2024-09-12T17:28:52.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.987+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~GCOJOF3CDOS2.0 size=1048576 2024-09-12T17:28:52.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.988+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~GCOJOF3CDOS2.1 size=1048576 2024-09-12T17:28:52.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.989+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~GCOJOF3CDOS2.2 size=324315 2024-09-12T17:28:52.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.989+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=GCOJOF3CDOS2 tag=SXQD0EXA3KHU type=write size=3470043 2024-09-12T17:28:52.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.991+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~TJ4FBLKB4T2O.0 size=1048576 2024-09-12T17:28:52.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.992+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~TJ4FBLKB4T2O.1 size=796611 2024-09-12T17:28:52.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.995+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=TJ4FBLKB4T2O tag=3P2KV686K1AI type=write size=2893763 2024-09-12T17:28:52.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.997+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~4M71YTC2H1CX.0 size=1048576 2024-09-12T17:28:52.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:52.998+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~4M71YTC2H1CX.1 size=1048576 2024-09-12T17:28:53.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.000+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~4M71YTC2H1CX.2 size=770032 2024-09-12T17:28:53.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.000+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=4M71YTC2H1CX tag=D590LEG3PY3M type=write size=3915760 2024-09-12T17:28:53.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.001+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~R1SXUQMT0DX7.0 size=1048576 2024-09-12T17:28:53.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.002+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~R1SXUQMT0DX7.1 size=1048576 2024-09-12T17:28:53.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.004+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~R1SXUQMT0DX7.2 size=295153 2024-09-12T17:28:53.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.006+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=R1SXUQMT0DX7 tag=BHNHLYPRF0XP type=write size=3440881 2024-09-12T17:28:53.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.007+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=VJ60T491RXJ3 type=write size=217830 2024-09-12T17:28:53.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.009+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~16U0ZC1HPDRU.0 size=1048576 2024-09-12T17:28:53.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.010+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~16U0ZC1HPDRU.1 size=431937 2024-09-12T17:28:53.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.013+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=16U0ZC1HPDRU tag=JXI7P0K37Y5N type=write size=2529089 2024-09-12T17:28:53.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.016+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~OG2OJBOER2PY.0 size=986131 2024-09-12T17:28:53.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.016+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=OG2OJBOER2PY tag=DJ6IAQEQEH11 type=write size=2034707 2024-09-12T17:28:53.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.017+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=81QMHOQQDULB type=write size=586968 2024-09-12T17:28:53.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.018+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=V1UV07M2YREJ type=del size=2269125 2024-09-12T17:28:53.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.020+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=50R65KMV748W type=del 2024-09-12T17:28:53.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.023+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~LLVPW1ZS6O9D.0 size=1048576 2024-09-12T17:28:53.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.024+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~LLVPW1ZS6O9D.1 size=615548 2024-09-12T17:28:53.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.024+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=LLVPW1ZS6O9D tag=G46Z3Q3JK6MD type=write size=2712700 2024-09-12T17:28:53.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.026+0000 7f9d7bc0c780 1 < completed write operation key=80JXIGQWQGR9 tag=KNFLFN30T3L9 type=write size=974742 2024-09-12T17:28:53.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.027+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=8AJV1CINSANG type=write size=572396 2024-09-12T17:28:53.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.030+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~X46ULNJL4NRF.0 size=1048576 2024-09-12T17:28:53.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.031+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~X46ULNJL4NRF.1 size=1048576 2024-09-12T17:28:53.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.031+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LU8MLGM7H0CE.2~X46ULNJL4NRF.2 size=369604 2024-09-12T17:28:53.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.033+0000 7f9d7bc0c780 1 < canceled multipart upload key=LU8MLGM7H0CE upload=X46ULNJL4NRF tag=AZM9JPP4OPKY type=write size=3515332 2024-09-12T17:28:53.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.036+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~7I5KKBS1N2JC.0 size=1048576 2024-09-12T17:28:53.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.037+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~7I5KKBS1N2JC.1 size=596707 2024-09-12T17:28:53.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.037+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=7I5KKBS1N2JC tag=N0UYUCHUX63A type=write size=2693859 2024-09-12T17:28:53.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.039+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~T9FT74BQCGV3.0 size=1048576 2024-09-12T17:28:53.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.040+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~T9FT74BQCGV3.1 size=1048576 2024-09-12T17:28:53.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.041+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~T9FT74BQCGV3.2 size=442189 2024-09-12T17:28:53.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.043+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=T9FT74BQCGV3 tag=YZYV2NN21X6S type=write size=3587917 2024-09-12T17:28:53.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.046+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~ITYOPZMF0UV0.0 size=1048576 2024-09-12T17:28:53.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.047+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~ITYOPZMF0UV0.1 size=1048576 2024-09-12T17:28:53.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.048+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~ITYOPZMF0UV0.2 size=227110 2024-09-12T17:28:53.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.048+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=ITYOPZMF0UV0 tag=PHNEYO8D67WD type=write size=3372838 2024-09-12T17:28:53.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.050+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=ZG0ABJ6YIEGO type=del 2024-09-12T17:28:53.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.051+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=YX09U07Z3T0A type=del size=1156804 2024-09-12T17:28:53.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.053+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=Q0OTW9EDU926 type=del 2024-09-12T17:28:53.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.055+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~UPBS3MDR6QV1.0 size=1048576 2024-09-12T17:28:53.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.056+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~UPBS3MDR6QV1.1 size=1048576 2024-09-12T17:28:53.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.057+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~UPBS3MDR6QV1.2 size=544563 2024-09-12T17:28:53.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.057+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=UPBS3MDR6QV1 tag=MY22HGWDYJM6 type=write size=3690291 2024-09-12T17:28:53.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.059+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=NPQTTDIO50S9 type=del 2024-09-12T17:28:53.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.060+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=L5BKUTU00L0Z type=del size=3260248 2024-09-12T17:28:53.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.061+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=QLHH2NPRYW8D type=write size=183444 2024-09-12T17:28:53.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.063+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=YMX00PWURR4N type=del size=1264689 2024-09-12T17:28:53.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.064+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=RT7QL68H2Y18 type=del 2024-09-12T17:28:53.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.066+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=FPA5WIAIMIY4 type=del size=97773 2024-09-12T17:28:53.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.067+0000 7f9d7bc0c780 1 < canceled operation key=LU8MLGM7H0CE tag=0BGMSZR8PAGS type=del size=1026011 2024-09-12T17:28:53.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.069+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=W6PS0DRUWJK1 type=del size=1434197 2024-09-12T17:28:53.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.070+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~DA7ZF5IK0UUK.0 size=1048576 2024-09-12T17:28:53.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.071+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~DA7ZF5IK0UUK.1 size=502243 2024-09-12T17:28:53.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.074+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=DA7ZF5IK0UUK tag=FJ0R083GAX0B type=write size=2599395 2024-09-12T17:28:53.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.075+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=VHCILC73YKGB type=del size=2991128 2024-09-12T17:28:53.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.076+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~GCOJOF3CDOS2.0 size=1048576 2024-09-12T17:28:53.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.078+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~GCOJOF3CDOS2.1 size=1048576 2024-09-12T17:28:53.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.079+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~GCOJOF3CDOS2.2 size=324315 2024-09-12T17:28:53.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.081+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=GCOJOF3CDOS2 tag=SXQD0EXA3KHU type=write size=3470043 2024-09-12T17:28:53.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.083+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=4RSPVX49YK8N type=del size=3192573 2024-09-12T17:28:53.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.084+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~4M71YTC2H1CX.0 size=1048576 2024-09-12T17:28:53.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.085+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~4M71YTC2H1CX.1 size=1048576 2024-09-12T17:28:53.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.086+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~4M71YTC2H1CX.2 size=770032 2024-09-12T17:28:53.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.089+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=4M71YTC2H1CX tag=D590LEG3PY3M type=write size=3915760 2024-09-12T17:28:53.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.090+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=LPG3YZC8EBGK type=del size=2531654 2024-09-12T17:28:53.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.092+0000 7f9d7bc0c780 1 < completed write operation key=80JXIGQWQGR9 tag=VJ60T491RXJ3 type=write size=217830 2024-09-12T17:28:53.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.094+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~VE1U9ZQ9BXGZ.0 size=1048576 2024-09-12T17:28:53.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.095+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~VE1U9ZQ9BXGZ.1 size=598163 2024-09-12T17:28:53.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.095+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=VE1U9ZQ9BXGZ tag=C6TXC919QAUS type=write size=2695315 2024-09-12T17:28:53.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.097+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~OG2OJBOER2PY.0 size=986131 2024-09-12T17:28:53.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.099+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=OG2OJBOER2PY tag=DJ6IAQEQEH11 type=write size=2034707 2024-09-12T17:28:53.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.102+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~TOMDCBOUKNMB.0 size=1048576 2024-09-12T17:28:53.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.103+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~TOMDCBOUKNMB.1 size=605798 2024-09-12T17:28:53.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.103+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=TOMDCBOUKNMB tag=FZ3626B2IOHC type=write size=2702950 2024-09-12T17:28:53.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.106+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=V1UV07M2YREJ type=del 2024-09-12T17:28:53.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.109+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~MVYVS6CRTE92.0 size=1048576 2024-09-12T17:28:53.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.110+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~MVYVS6CRTE92.1 size=510651 2024-09-12T17:28:53.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.110+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=MVYVS6CRTE92 tag=QQT279B54FNX type=write size=2607803 2024-09-12T17:28:53.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.111+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~LLVPW1ZS6O9D.0 size=1048576 2024-09-12T17:28:53.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.112+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~LLVPW1ZS6O9D.1 size=615548 2024-09-12T17:28:53.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.115+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=LLVPW1ZS6O9D tag=G46Z3Q3JK6MD type=write size=2712700 2024-09-12T17:28:53.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.116+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=4JGQ942JGV47 type=write size=405436 2024-09-12T17:28:53.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.118+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=8AJV1CINSANG type=write size=572396 2024-09-12T17:28:53.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.120+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~HM4FTTITYR22.0 size=812286 2024-09-12T17:28:53.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.120+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=HM4FTTITYR22 tag=B7SWPUIMIJR4 type=write size=1860862 2024-09-12T17:28:53.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.121+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LTG0UQEYPUGO.2~7I5KKBS1N2JC.0 size=1048576 2024-09-12T17:28:53.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.122+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~7I5KKBS1N2JC.1 size=596707 2024-09-12T17:28:53.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.125+0000 7f9d7bc0c780 1 < canceled multipart upload key=LTG0UQEYPUGO upload=7I5KKBS1N2JC tag=N0UYUCHUX63A type=write size=2693859 2024-09-12T17:28:53.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.126+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=K5KVDP2L1PAA type=write size=1022655 2024-09-12T17:28:53.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.128+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~ITYOPZMF0UV0.0 size=1048576 2024-09-12T17:28:53.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.129+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~ITYOPZMF0UV0.1 size=1048576 2024-09-12T17:28:53.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.130+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~ITYOPZMF0UV0.2 size=227110 2024-09-12T17:28:53.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.133+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=ITYOPZMF0UV0 tag=PHNEYO8D67WD type=write size=3372838 2024-09-12T17:28:53.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.136+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~25TV4ZVOK1CT.0 size=1048576 2024-09-12T17:28:53.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.137+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~25TV4ZVOK1CT.1 size=166536 2024-09-12T17:28:53.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.137+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=25TV4ZVOK1CT tag=A684M27GHDIA type=write size=2263688 2024-09-12T17:28:53.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.140+0000 7f9d7bc0c780 1 < suggested update operation key=64T291B0U226 tag=YX09U07Z3T0A type=del size=1156804 2024-09-12T17:28:53.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.141+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=10ZY9TBH83R3 type=del size=3725668 2024-09-12T17:28:53.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.143+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~UPBS3MDR6QV1.0 size=1048576 2024-09-12T17:28:53.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.144+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~UPBS3MDR6QV1.1 size=1048576 2024-09-12T17:28:53.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.145+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~UPBS3MDR6QV1.2 size=544563 2024-09-12T17:28:53.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.147+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=UPBS3MDR6QV1 tag=MY22HGWDYJM6 type=write size=3690291 2024-09-12T17:28:53.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.150+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~QEP1LCTCEQWN.0 size=1048576 2024-09-12T17:28:53.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.151+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~QEP1LCTCEQWN.1 size=1048576 2024-09-12T17:28:53.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.152+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~QEP1LCTCEQWN.2 size=548844 2024-09-12T17:28:53.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.152+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=QEP1LCTCEQWN tag=7KMI7ZLKN8TS type=write size=3694572 2024-09-12T17:28:53.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.154+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=L5BKUTU00L0Z type=del 2024-09-12T17:28:53.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.156+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~JEHVMIYWJSJP.0 size=1048576 2024-09-12T17:28:53.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.157+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~JEHVMIYWJSJP.1 size=1048576 2024-09-12T17:28:53.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.159+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~JEHVMIYWJSJP.2 size=863918 2024-09-12T17:28:53.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.159+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=JEHVMIYWJSJP tag=AULYSWFK8944 type=write size=4009646 2024-09-12T17:28:53.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.160+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=YMX00PWURR4N type=del 2024-09-12T17:28:53.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.162+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=3U0K9Y6YW5R1 type=del size=695872 2024-09-12T17:28:53.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.164+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=FPA5WIAIMIY4 type=del 2024-09-12T17:28:53.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.165+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=1LVL0QJZMD6G type=del size=784913 2024-09-12T17:28:53.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.167+0000 7f9d7bc0c780 1 < canceled operation key=J3YYRIVKQ5AU tag=W6PS0DRUWJK1 type=del size=1434197 2024-09-12T17:28:53.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.168+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=SX8XA3IHWOFR type=del size=2057868 2024-09-12T17:28:53.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.170+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=VHCILC73YKGB type=del 2024-09-12T17:28:53.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.171+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=3OW2E3Y29HK2 type=del size=2123334 2024-09-12T17:28:53.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.173+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=4RSPVX49YK8N type=del 2024-09-12T17:28:53.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.177+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~6LRYZA6QHZ2E.0 size=695646 2024-09-12T17:28:53.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.177+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=6LRYZA6QHZ2E tag=IH91MBN8AJ7Z type=write size=1744222 2024-09-12T17:28:53.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.178+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=LPG3YZC8EBGK type=del 2024-09-12T17:28:53.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.180+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=NJC42Z3OIPNM type=write size=516794 2024-09-12T17:28:53.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.181+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~VE1U9ZQ9BXGZ.0 size=1048576 2024-09-12T17:28:53.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.183+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~VE1U9ZQ9BXGZ.1 size=598163 2024-09-12T17:28:53.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.185+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=VE1U9ZQ9BXGZ tag=C6TXC919QAUS type=write size=2695315 2024-09-12T17:28:53.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.187+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=5W3BKGNGF5AA type=del size=914258 2024-09-12T17:28:53.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.189+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~TOMDCBOUKNMB.0 size=1048576 2024-09-12T17:28:53.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.190+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~TOMDCBOUKNMB.1 size=605798 2024-09-12T17:28:53.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.192+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=TOMDCBOUKNMB tag=FZ3626B2IOHC type=write size=2702950 2024-09-12T17:28:53.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.193+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=FJ0JM6PI6VZ5 type=del size=3977556 2024-09-12T17:28:53.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.195+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~MVYVS6CRTE92.0 size=1048576 2024-09-12T17:28:53.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.196+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~MVYVS6CRTE92.1 size=510651 2024-09-12T17:28:53.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.198+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=MVYVS6CRTE92 tag=QQT279B54FNX type=write size=2607803 2024-09-12T17:28:53.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.201+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~EHSB9YZLC7LZ.0 size=845777 2024-09-12T17:28:53.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.201+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=EHSB9YZLC7LZ tag=35ISJRRKDFQM type=write size=1894353 2024-09-12T17:28:53.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.202+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=4JGQ942JGV47 type=write size=405436 2024-09-12T17:28:53.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.204+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=DC649M736NBN type=del size=2718541 2024-09-12T17:28:53.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.205+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~HM4FTTITYR22.0 size=812286 2024-09-12T17:28:53.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.208+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=HM4FTTITYR22 tag=B7SWPUIMIJR4 type=write size=1860862 2024-09-12T17:28:53.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.209+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=Q8IODLM9X4B7 type=del size=2608902 2024-09-12T17:28:53.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.211+0000 7f9d7bc0c780 1 < completed write operation key=ZA6JC3WXS8Y5 tag=K5KVDP2L1PAA type=write size=1022655 2024-09-12T17:28:53.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.212+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=JCX615XBCR2E type=del size=2939247 2024-09-12T17:28:53.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.214+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~25TV4ZVOK1CT.0 size=1048576 2024-09-12T17:28:53.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.215+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~25TV4ZVOK1CT.1 size=166536 2024-09-12T17:28:53.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.217+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=25TV4ZVOK1CT tag=A684M27GHDIA type=write size=2263688 2024-09-12T17:28:53.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.219+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=JVGZ23SVH5HE type=del size=823972 2024-09-12T17:28:53.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.222+0000 7f9d7bc0c780 1 < suggested remove operation key=64T291B0U226 tag=10ZY9TBH83R3 type=del 2024-09-12T17:28:53.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.224+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~90C6MWY1SEBR.0 size=1048576 2024-09-12T17:28:53.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.226+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~90C6MWY1SEBR.1 size=1048576 2024-09-12T17:28:53.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.227+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~90C6MWY1SEBR.2 size=298971 2024-09-12T17:28:53.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.227+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=90C6MWY1SEBR tag=ZF4FD6HFRJ7O type=write size=3444699 2024-09-12T17:28:53.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.228+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~QEP1LCTCEQWN.0 size=1048576 2024-09-12T17:28:53.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.230+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~QEP1LCTCEQWN.1 size=1048576 2024-09-12T17:28:53.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.231+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~QEP1LCTCEQWN.2 size=548844 2024-09-12T17:28:53.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.233+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=QEP1LCTCEQWN tag=7KMI7ZLKN8TS type=write size=3694572 2024-09-12T17:28:53.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.235+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=NKR1IS43AG8D type=del size=3359765 2024-09-12T17:28:53.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.236+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~JEHVMIYWJSJP.0 size=1048576 2024-09-12T17:28:53.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.237+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~JEHVMIYWJSJP.1 size=1048576 2024-09-12T17:28:53.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.238+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~JEHVMIYWJSJP.2 size=863918 2024-09-12T17:28:53.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.241+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=JEHVMIYWJSJP tag=AULYSWFK8944 type=write size=4009646 2024-09-12T17:28:53.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.245+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~PD2NBA0S4LVD.0 size=506388 2024-09-12T17:28:53.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.245+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=PD2NBA0S4LVD tag=GSLXMSJZ9VDV type=write size=1554964 2024-09-12T17:28:53.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.247+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=3U0K9Y6YW5R1 type=del 2024-09-12T17:28:53.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.248+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=M0YUMW1ROP3W type=del size=2735130 2024-09-12T17:28:53.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.250+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=1LVL0QJZMD6G type=del 2024-09-12T17:28:53.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.252+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~9K6M2NE9TLIH.0 size=779663 2024-09-12T17:28:53.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.252+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=9K6M2NE9TLIH tag=0XCZW67LH0Q6 type=write size=1828239 2024-09-12T17:28:53.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.254+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=SX8XA3IHWOFR type=del 2024-09-12T17:28:53.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.255+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=BF3W0P34QTA2 type=del size=705795 2024-09-12T17:28:53.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.257+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=3OW2E3Y29HK2 type=del 2024-09-12T17:28:53.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.259+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~A281147Y9T6M.0 size=1048576 2024-09-12T17:28:53.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.260+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~A281147Y9T6M.1 size=1048576 2024-09-12T17:28:53.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.261+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~A281147Y9T6M.2 size=821426 2024-09-12T17:28:53.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.261+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=A281147Y9T6M tag=ZYRP81BCMLL0 type=write size=3967154 2024-09-12T17:28:53.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.263+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~6LRYZA6QHZ2E.0 size=695646 2024-09-12T17:28:53.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.265+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=6LRYZA6QHZ2E tag=IH91MBN8AJ7Z type=write size=1744222 2024-09-12T17:28:53.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.268+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~RR2CFIVCP7P2.0 size=1048576 2024-09-12T17:28:53.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.269+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~RR2CFIVCP7P2.1 size=209500 2024-09-12T17:28:53.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.269+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=RR2CFIVCP7P2 tag=O04CXK6C17NV type=write size=2306652 2024-09-12T17:28:53.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.270+0000 7f9d7bc0c780 1 < completed write operation key=ZM8NMC18RN3I tag=NJC42Z3OIPNM type=write size=516794 2024-09-12T17:28:53.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.272+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=C6FJ0ONUYW1W type=write size=148398 2024-09-12T17:28:53.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.273+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=5W3BKGNGF5AA type=del 2024-09-12T17:28:53.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.275+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=G2X402H01W48 type=del size=2070817 2024-09-12T17:28:53.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.276+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=FJ0JM6PI6VZ5 type=del 2024-09-12T17:28:53.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.279+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~ZYQC9MY1E5HZ.0 size=1034544 2024-09-12T17:28:53.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.279+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=ZYQC9MY1E5HZ tag=GZOOZ3CQWRUY type=write size=2083120 2024-09-12T17:28:53.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.280+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~EHSB9YZLC7LZ.0 size=845777 2024-09-12T17:28:53.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.283+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=EHSB9YZLC7LZ tag=35ISJRRKDFQM type=write size=1894353 2024-09-12T17:28:53.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.285+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~EAKI4BRWB73D.0 size=226149 2024-09-12T17:28:53.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.285+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=EAKI4BRWB73D tag=09G7XG73J7B8 type=write size=1274725 2024-09-12T17:28:53.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.286+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=DC649M736NBN type=del 2024-09-12T17:28:53.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.289+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~5WZVAQ5NMOSK.0 size=153879 2024-09-12T17:28:53.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.289+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=5WZVAQ5NMOSK tag=A4M44NN1B00B type=write size=1202455 2024-09-12T17:28:53.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.290+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=Q8IODLM9X4B7 type=del 2024-09-12T17:28:53.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.293+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~R2WO4H511HNN.0 size=1048576 2024-09-12T17:28:53.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.294+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~R2WO4H511HNN.1 size=730145 2024-09-12T17:28:53.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.294+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=R2WO4H511HNN tag=BCI4RXTV8HG7 type=write size=2827297 2024-09-12T17:28:53.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.297+0000 7f9d7bc0c780 1 < suggested update operation key=0JN5WWDYEM6Q tag=JCX615XBCR2E type=del size=2939247 2024-09-12T17:28:53.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.298+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=8G4J96P7RNNE type=del size=1961494 2024-09-12T17:28:53.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.300+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=JVGZ23SVH5HE type=del 2024-09-12T17:28:53.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.302+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~EFG9LPMR7R4M.0 size=60929 2024-09-12T17:28:53.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.302+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=EFG9LPMR7R4M tag=ZN4BSVT4JH8K type=write size=1109505 2024-09-12T17:28:53.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.303+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~90C6MWY1SEBR.0 size=1048576 2024-09-12T17:28:53.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.305+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~90C6MWY1SEBR.1 size=1048576 2024-09-12T17:28:53.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.306+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~90C6MWY1SEBR.2 size=298971 2024-09-12T17:28:53.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.309+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=90C6MWY1SEBR tag=ZF4FD6HFRJ7O type=write size=3444699 2024-09-12T17:28:53.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.311+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~MTDZSP633RIF.0 size=1048576 2024-09-12T17:28:53.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.313+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~MTDZSP633RIF.1 size=471331 2024-09-12T17:28:53.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.313+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=MTDZSP633RIF tag=B14F07HCKTMP type=write size=2568483 2024-09-12T17:28:53.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.314+0000 7f9d7bc0c780 1 < canceled operation key=LJZNPSVLS9AF tag=NKR1IS43AG8D type=del size=3359765 2024-09-12T17:28:53.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.315+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=UREHQSA0ZCS2 type=del size=1115114 2024-09-12T17:28:53.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.317+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~PD2NBA0S4LVD.0 size=506388 2024-09-12T17:28:53.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.319+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=PD2NBA0S4LVD tag=GSLXMSJZ9VDV type=write size=1554964 2024-09-12T17:28:53.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.321+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=YEHTGANC4MOD type=del size=646750 2024-09-12T17:28:53.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.322+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=M0YUMW1ROP3W type=del 2024-09-12T17:28:53.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.324+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=J6TEK9T7M2I6 type=write size=84371 2024-09-12T17:28:53.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.325+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~9K6M2NE9TLIH.0 size=779663 2024-09-12T17:28:53.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.328+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=9K6M2NE9TLIH tag=0XCZW67LH0Q6 type=write size=1828239 2024-09-12T17:28:53.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.330+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~AW2HLMN3KJDV.0 size=326601 2024-09-12T17:28:53.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.330+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=AW2HLMN3KJDV tag=17AGF6PUP200 type=write size=1375177 2024-09-12T17:28:53.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.332+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=BF3W0P34QTA2 type=del 2024-09-12T17:28:53.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.333+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=0IF3O3LRBZC1 type=del size=2387728 2024-09-12T17:28:53.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.334+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~A281147Y9T6M.0 size=1048576 2024-09-12T17:28:53.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.336+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~A281147Y9T6M.1 size=1048576 2024-09-12T17:28:53.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.337+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~A281147Y9T6M.2 size=821426 2024-09-12T17:28:53.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.339+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=A281147Y9T6M tag=ZYRP81BCMLL0 type=write size=3967154 2024-09-12T17:28:53.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.342+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~WK09O9S6PARD.0 size=1048576 2024-09-12T17:28:53.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.343+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~WK09O9S6PARD.1 size=198874 2024-09-12T17:28:53.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.343+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=WK09O9S6PARD tag=XDD765E2LYNT type=write size=2296026 2024-09-12T17:28:53.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.344+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~RR2CFIVCP7P2.0 size=1048576 2024-09-12T17:28:53.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.345+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~RR2CFIVCP7P2.1 size=209500 2024-09-12T17:28:53.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.348+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=RR2CFIVCP7P2 tag=O04CXK6C17NV type=write size=2306652 2024-09-12T17:28:53.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.349+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=7ONGZIFOP613 type=write size=25656 2024-09-12T17:28:53.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.351+0000 7f9d7bc0c780 1 < completed write operation key=9TE5N5TIB7AD tag=C6FJ0ONUYW1W type=write size=148398 2024-09-12T17:28:53.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.353+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=TP5ZSXTRIYAI type=del size=233571 2024-09-12T17:28:53.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.356+0000 7f9d7bc0c780 1 < suggested update operation key=X7J78IOJR0HA tag=G2X402H01W48 type=del size=2070817 2024-09-12T17:28:53.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.358+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~Z1LHB94XC7HC.0 size=140040 2024-09-12T17:28:53.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.358+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=Z1LHB94XC7HC tag=2QTDVNNMMDHY type=write size=1188616 2024-09-12T17:28:53.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.359+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~ZYQC9MY1E5HZ.0 size=1034544 2024-09-12T17:28:53.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.361+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=ZYQC9MY1E5HZ tag=GZOOZ3CQWRUY type=write size=2083120 2024-09-12T17:28:53.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.363+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=9MDLEMB9MUN6 type=del size=356073 2024-09-12T17:28:53.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.363+0000 7f9d7bc0c780 1 < canceled part key=_multipart_OZKAXB0ET9R7.2~EAKI4BRWB73D.0 size=226149 2024-09-12T17:28:53.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.366+0000 7f9d7bc0c780 1 < canceled multipart upload key=OZKAXB0ET9R7 upload=EAKI4BRWB73D tag=09G7XG73J7B8 type=write size=1274725 2024-09-12T17:28:53.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.367+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=2KM30VNZ3UA3 type=del size=169650 2024-09-12T17:28:53.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.369+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~5WZVAQ5NMOSK.0 size=153879 2024-09-12T17:28:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.371+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=5WZVAQ5NMOSK tag=A4M44NN1B00B type=write size=1202455 2024-09-12T17:28:53.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.372+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=CLLXPDQRCQU8 type=del size=2592902 2024-09-12T17:28:53.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.373+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~R2WO4H511HNN.0 size=1048576 2024-09-12T17:28:53.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.375+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~R2WO4H511HNN.1 size=730145 2024-09-12T17:28:53.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.378+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=R2WO4H511HNN tag=BCI4RXTV8HG7 type=write size=2827297 2024-09-12T17:28:53.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.381+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~R7G1Z6M6G84R.0 size=1048576 2024-09-12T17:28:53.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.382+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~R7G1Z6M6G84R.1 size=1048576 2024-09-12T17:28:53.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.383+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~R7G1Z6M6G84R.2 size=766125 2024-09-12T17:28:53.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.383+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=R7G1Z6M6G84R tag=T6M2CBC72ZK6 type=write size=3911853 2024-09-12T17:28:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.385+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=8G4J96P7RNNE type=del 2024-09-12T17:28:53.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.386+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=LTMG1R5U9TNG type=del size=2489990 2024-09-12T17:28:53.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.387+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~EFG9LPMR7R4M.0 size=60929 2024-09-12T17:28:53.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.390+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=EFG9LPMR7R4M tag=ZN4BSVT4JH8K type=write size=1109505 2024-09-12T17:28:53.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.392+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~CJBNE28CSSP8.0 size=1048576 2024-09-12T17:28:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.393+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~CJBNE28CSSP8.1 size=783171 2024-09-12T17:28:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.393+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=CJBNE28CSSP8 tag=HUPQOAVMHVNB type=write size=2880323 2024-09-12T17:28:53.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.395+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~MTDZSP633RIF.0 size=1048576 2024-09-12T17:28:53.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.396+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~MTDZSP633RIF.1 size=471331 2024-09-12T17:28:53.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.398+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=MTDZSP633RIF tag=B14F07HCKTMP type=write size=2568483 2024-09-12T17:28:53.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.401+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=A8YVF0C67L5M type=del size=577527 2024-09-12T17:28:53.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.402+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=UREHQSA0ZCS2 type=del 2024-09-12T17:28:53.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.404+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=Y42F49FDCWWS type=write size=1020729 2024-09-12T17:28:53.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.407+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=YEHTGANC4MOD type=del size=646750 2024-09-12T17:28:53.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.408+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=O3FV05JI6BFZ type=write size=576982 2024-09-12T17:28:53.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.409+0000 7f9d7bc0c780 1 < completed write operation key=0NGHC5GMSGRX tag=J6TEK9T7M2I6 type=write size=84371 2024-09-12T17:28:53.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.411+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=Z823SFA4UEL2 type=del size=3002375 2024-09-12T17:28:53.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.412+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~AW2HLMN3KJDV.0 size=326601 2024-09-12T17:28:53.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.414+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=AW2HLMN3KJDV tag=17AGF6PUP200 type=write size=1375177 2024-09-12T17:28:53.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.416+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=SCDL7ASV7UY5 type=del size=222823 2024-09-12T17:28:53.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.419+0000 7f9d7bc0c780 1 < suggested update operation key=9B83KWC5E4ZV tag=0IF3O3LRBZC1 type=del size=2387728 2024-09-12T17:28:53.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.420+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=8WGY3DR7C1UZ type=del size=785938 2024-09-12T17:28:53.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.422+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~WK09O9S6PARD.0 size=1048576 2024-09-12T17:28:53.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.422+0000 7f9d7bc0c780 1 < canceled part key=_multipart_X7J78IOJR0HA.2~WK09O9S6PARD.1 size=198874 2024-09-12T17:28:53.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.424+0000 7f9d7bc0c780 1 < canceled multipart upload key=X7J78IOJR0HA upload=WK09O9S6PARD tag=XDD765E2LYNT type=write size=2296026 2024-09-12T17:28:53.427 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.426+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=506OJKAMR1MN type=del size=4134654 2024-09-12T17:28:53.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.428+0000 7f9d7bc0c780 1 < completed write operation key=G5ZKTTY1XQ9T tag=7ONGZIFOP613 type=write size=25656 2024-09-12T17:28:53.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.430+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~V1JA7HBTTXVY.0 size=516284 2024-09-12T17:28:53.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.430+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=V1JA7HBTTXVY tag=XXU4DJJ5C4LW type=write size=1564860 2024-09-12T17:28:53.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.432+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=TP5ZSXTRIYAI type=del 2024-09-12T17:28:53.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.434+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~KCKSHOJ144IT.0 size=1048576 2024-09-12T17:28:53.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.435+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~KCKSHOJ144IT.1 size=1048576 2024-09-12T17:28:53.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.437+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~KCKSHOJ144IT.2 size=260314 2024-09-12T17:28:53.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.437+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=KCKSHOJ144IT tag=9NY8LX9SJOAU type=write size=3406042 2024-09-12T17:28:53.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.438+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~Z1LHB94XC7HC.0 size=140040 2024-09-12T17:28:53.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.440+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=Z1LHB94XC7HC tag=2QTDVNNMMDHY type=write size=1188616 2024-09-12T17:28:53.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.443+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~LR4JAFX7M6KX.0 size=1048576 2024-09-12T17:28:53.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.444+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~LR4JAFX7M6KX.1 size=1048576 2024-09-12T17:28:53.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.445+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~LR4JAFX7M6KX.2 size=315383 2024-09-12T17:28:53.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.445+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=LR4JAFX7M6KX tag=U4U0DNQIEUQJ type=write size=3461111 2024-09-12T17:28:53.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.446+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=9MDLEMB9MUN6 type=del 2024-09-12T17:28:53.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.448+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=NJG2EWKM0XCE type=del size=773973 2024-09-12T17:28:53.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.449+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=2KM30VNZ3UA3 type=del 2024-09-12T17:28:53.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.451+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=QD66JZVFD2O9 type=write size=107295 2024-09-12T17:28:53.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.453+0000 7f9d7bc0c780 1 < suggested update operation key=4V2IYJRP2PZI tag=CLLXPDQRCQU8 type=del size=2592902 2024-09-12T17:28:53.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.456+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~VQRXXCLXPTQK.0 size=1048576 2024-09-12T17:28:53.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.457+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~VQRXXCLXPTQK.1 size=1048576 2024-09-12T17:28:53.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.458+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~VQRXXCLXPTQK.2 size=310357 2024-09-12T17:28:53.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.458+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=VQRXXCLXPTQK tag=Q2ZVAV53H1Z7 type=write size=3456085 2024-09-12T17:28:53.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.460+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~R7G1Z6M6G84R.0 size=1048576 2024-09-12T17:28:53.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.461+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~R7G1Z6M6G84R.1 size=1048576 2024-09-12T17:28:53.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.462+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~R7G1Z6M6G84R.2 size=766125 2024-09-12T17:28:53.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.464+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=R7G1Z6M6G84R tag=T6M2CBC72ZK6 type=write size=3911853 2024-09-12T17:28:53.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.466+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=10B65AOTTNH1 type=del size=2149000 2024-09-12T17:28:53.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.467+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=LTMG1R5U9TNG type=del 2024-09-12T17:28:53.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.469+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=4QOG92GU1RT5 type=write size=196739 2024-09-12T17:28:53.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.471+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~CJBNE28CSSP8.0 size=1048576 2024-09-12T17:28:53.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.472+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~CJBNE28CSSP8.1 size=783171 2024-09-12T17:28:53.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.474+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=CJBNE28CSSP8 tag=HUPQOAVMHVNB type=write size=2880323 2024-09-12T17:28:53.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.477+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~GMT7LI2GGK9G.0 size=1048576 2024-09-12T17:28:53.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.478+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~GMT7LI2GGK9G.1 size=1048576 2024-09-12T17:28:53.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.479+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~GMT7LI2GGK9G.2 size=538452 2024-09-12T17:28:53.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.479+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=GMT7LI2GGK9G tag=Y6AVXPU8DH73 type=write size=3684180 2024-09-12T17:28:53.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.481+0000 7f9d7bc0c780 1 < canceled operation key=G5ZKTTY1XQ9T tag=A8YVF0C67L5M type=del size=577527 2024-09-12T17:28:53.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.482+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=AN9GQ5YJHKA7 type=del size=322707 2024-09-12T17:28:53.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.485+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=Y42F49FDCWWS type=write size=1020729 2024-09-12T17:28:53.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.486+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=VAGMXH4DX5GV type=del size=3342439 2024-09-12T17:28:53.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.488+0000 7f9d7bc0c780 1 < completed write operation key=CYKLX4CJWVJE tag=O3FV05JI6BFZ type=write size=576982 2024-09-12T17:28:53.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.489+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=WYMPZG1F3CIK type=del size=2646606 2024-09-12T17:28:53.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.491+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=Z823SFA4UEL2 type=del 2024-09-12T17:28:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.493+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=S52A4PPTU76O type=del size=2154459 2024-09-12T17:28:53.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.496+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=SCDL7ASV7UY5 type=del 2024-09-12T17:28:53.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.497+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=RM5Q0P8JNCNB type=write size=357543 2024-09-12T17:28:53.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.499+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=8WGY3DR7C1UZ type=del 2024-09-12T17:28:53.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.502+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~8H2QVKBJH5FC.0 size=1048576 2024-09-12T17:28:53.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.503+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~8H2QVKBJH5FC.1 size=1048576 2024-09-12T17:28:53.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.504+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~8H2QVKBJH5FC.2 size=443512 2024-09-12T17:28:53.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.504+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=8H2QVKBJH5FC tag=8DGOYQR78BSF type=write size=3589240 2024-09-12T17:28:53.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.506+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=506OJKAMR1MN type=del 2024-09-12T17:28:53.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.507+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=CTN46LJC3Z1I type=del size=2133863 2024-09-12T17:28:53.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.509+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~V1JA7HBTTXVY.0 size=516284 2024-09-12T17:28:53.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.512+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=V1JA7HBTTXVY tag=XXU4DJJ5C4LW type=write size=1564860 2024-09-12T17:28:53.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.514+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=J2Z34ZA86J8E type=del size=4191616 2024-09-12T17:28:53.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.517+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~KCKSHOJ144IT.0 size=1048576 2024-09-12T17:28:53.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.518+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~KCKSHOJ144IT.1 size=1048576 2024-09-12T17:28:53.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.518+0000 7f9d7bc0c780 1 < canceled part key=_multipart_OZKAXB0ET9R7.2~KCKSHOJ144IT.2 size=260314 2024-09-12T17:28:53.521 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.520+0000 7f9d7bc0c780 1 < canceled multipart upload key=OZKAXB0ET9R7 upload=KCKSHOJ144IT tag=9NY8LX9SJOAU type=write size=3406042 2024-09-12T17:28:53.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.522+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=KR81D9R68M8C type=del size=256074 2024-09-12T17:28:53.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.524+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~LR4JAFX7M6KX.0 size=1048576 2024-09-12T17:28:53.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.525+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~LR4JAFX7M6KX.1 size=1048576 2024-09-12T17:28:53.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.526+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~LR4JAFX7M6KX.2 size=315383 2024-09-12T17:28:53.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.528+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=LR4JAFX7M6KX tag=U4U0DNQIEUQJ type=write size=3461111 2024-09-12T17:28:53.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.530+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=O31BM7L0T4HQ type=del size=1875001 2024-09-12T17:28:53.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.531+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=NJG2EWKM0XCE type=del 2024-09-12T17:28:53.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.533+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=K9N0KT4UK5NW type=write size=111400 2024-09-12T17:28:53.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.534+0000 7f9d7bc0c780 1 < completed write operation key=R94VERREGANN tag=QD66JZVFD2O9 type=write size=107295 2024-09-12T17:28:53.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.536+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=1EA9OLJ2756P type=del size=3164804 2024-09-12T17:28:53.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.538+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~VQRXXCLXPTQK.0 size=1048576 2024-09-12T17:28:53.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.539+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~VQRXXCLXPTQK.1 size=1048576 2024-09-12T17:28:53.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.540+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~VQRXXCLXPTQK.2 size=310357 2024-09-12T17:28:53.544 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.543+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=VQRXXCLXPTQK tag=Q2ZVAV53H1Z7 type=write size=3456085 2024-09-12T17:28:53.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.545+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~8F41MOSFHHIL.0 size=200043 2024-09-12T17:28:53.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.545+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=8F41MOSFHHIL tag=YNWI3SHSCSU8 type=write size=1248619 2024-09-12T17:28:53.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.547+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=10B65AOTTNH1 type=del 2024-09-12T17:28:53.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.549+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~O3BZKKBTQ8PN.0 size=1048576 2024-09-12T17:28:53.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.551+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~O3BZKKBTQ8PN.1 size=1048576 2024-09-12T17:28:53.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.552+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~O3BZKKBTQ8PN.2 size=40728 2024-09-12T17:28:53.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.552+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=O3BZKKBTQ8PN tag=R3SYSZNR2MSB type=write size=3186456 2024-09-12T17:28:53.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.553+0000 7f9d7bc0c780 1 < completed write operation key=4V2IYJRP2PZI tag=4QOG92GU1RT5 type=write size=196739 2024-09-12T17:28:53.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.555+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=CA33HAFM1872 type=write size=475013 2024-09-12T17:28:53.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.556+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~GMT7LI2GGK9G.0 size=1048576 2024-09-12T17:28:53.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.557+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~GMT7LI2GGK9G.1 size=1048576 2024-09-12T17:28:53.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.559+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~GMT7LI2GGK9G.2 size=538452 2024-09-12T17:28:53.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.562+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=GMT7LI2GGK9G tag=Y6AVXPU8DH73 type=write size=3684180 2024-09-12T17:28:53.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.563+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=V5ND4EDTWL90 type=del size=2639233 2024-09-12T17:28:53.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.564+0000 7f9d7bc0c780 1 < canceled operation key=QB8C0OJA1L4X tag=AN9GQ5YJHKA7 type=del size=322707 2024-09-12T17:28:53.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.566+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=HFVMMUOPZUR0 type=del size=744901 2024-09-12T17:28:53.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.567+0000 7f9d7bc0c780 1 < canceled operation key=OZKAXB0ET9R7 tag=VAGMXH4DX5GV type=del size=3342439 2024-09-12T17:28:53.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.569+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=J4JMY4IKR0VT type=del size=3618451 2024-09-12T17:28:53.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.572+0000 7f9d7bc0c780 1 < suggested update operation key=9B83KWC5E4ZV tag=WYMPZG1F3CIK type=del size=2646606 2024-09-12T17:28:53.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.575+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~03ZL25OFXIZA.0 size=1048576 2024-09-12T17:28:53.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.576+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~03ZL25OFXIZA.1 size=1048576 2024-09-12T17:28:53.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.577+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~03ZL25OFXIZA.2 size=27742 2024-09-12T17:28:53.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.577+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=03ZL25OFXIZA tag=9FUUT2TS3C8I type=write size=3173470 2024-09-12T17:28:53.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.579+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=S52A4PPTU76O type=del 2024-09-12T17:28:53.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.580+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=XZ9QQBCZOZ3K type=write size=1021272 2024-09-12T17:28:53.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.582+0000 7f9d7bc0c780 1 < completed write operation key=LJZNPSVLS9AF tag=RM5Q0P8JNCNB type=write size=357543 2024-09-12T17:28:53.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.583+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=67SQT200DU32 type=write size=918551 2024-09-12T17:28:53.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.585+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~8H2QVKBJH5FC.0 size=1048576 2024-09-12T17:28:53.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.586+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~8H2QVKBJH5FC.1 size=1048576 2024-09-12T17:28:53.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.587+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~8H2QVKBJH5FC.2 size=443512 2024-09-12T17:28:53.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.589+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=8H2QVKBJH5FC tag=8DGOYQR78BSF type=write size=3589240 2024-09-12T17:28:53.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.591+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=FU7JQE202KA7 type=del size=3690850 2024-09-12T17:28:53.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.593+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=CTN46LJC3Z1I type=del 2024-09-12T17:28:53.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.596+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~5R4VNX697SE5.0 size=681711 2024-09-12T17:28:53.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.596+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=5R4VNX697SE5 tag=0DL445NVD3GH type=write size=1730287 2024-09-12T17:28:53.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.597+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=J2Z34ZA86J8E type=del 2024-09-12T17:28:53.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.598+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=ES843JPOO51G type=del size=1449317 2024-09-12T17:28:53.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.601+0000 7f9d7bc0c780 1 < suggested remove operation key=M3Q7I7MD7M4I tag=KR81D9R68M8C type=del 2024-09-12T17:28:53.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.604+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~7J23Y8965SMV.0 size=1048576 2024-09-12T17:28:53.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.605+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~7J23Y8965SMV.1 size=1048576 2024-09-12T17:28:53.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.606+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~7J23Y8965SMV.2 size=543435 2024-09-12T17:28:53.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.606+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=7J23Y8965SMV tag=W706WKUQSZ5T type=write size=3689163 2024-09-12T17:28:53.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.607+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=O31BM7L0T4HQ type=del 2024-09-12T17:28:53.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.609+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=MXN7PFG6K2SK type=del size=1407876 2024-09-12T17:28:53.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.610+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=K9N0KT4UK5NW type=write size=111400 2024-09-12T17:28:53.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.612+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~R0QWR1MNTP6X.0 size=1048576 2024-09-12T17:28:53.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.613+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~R0QWR1MNTP6X.1 size=1048576 2024-09-12T17:28:53.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.615+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~R0QWR1MNTP6X.2 size=862385 2024-09-12T17:28:53.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.615+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=R0QWR1MNTP6X tag=XZJXD1YVGYTW type=write size=4008113 2024-09-12T17:28:53.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.616+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=1EA9OLJ2756P type=del 2024-09-12T17:28:53.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.617+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=IR7OG9MI65R7 type=del size=120419 2024-09-12T17:28:53.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.619+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~8F41MOSFHHIL.0 size=200043 2024-09-12T17:28:53.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.621+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=8F41MOSFHHIL tag=YNWI3SHSCSU8 type=write size=1248619 2024-09-12T17:28:53.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.623+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=EBINQIABD9M8 type=del size=3753596 2024-09-12T17:28:53.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.624+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~O3BZKKBTQ8PN.0 size=1048576 2024-09-12T17:28:53.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.625+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~O3BZKKBTQ8PN.1 size=1048576 2024-09-12T17:28:53.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.627+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~O3BZKKBTQ8PN.2 size=40728 2024-09-12T17:28:53.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.629+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=O3BZKKBTQ8PN tag=R3SYSZNR2MSB type=write size=3186456 2024-09-12T17:28:53.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.630+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=VMWIOUQW5KU0 type=del size=2633001 2024-09-12T17:28:53.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.632+0000 7f9d7bc0c780 1 < canceled operation key=ZM8NMC18RN3I tag=CA33HAFM1872 type=write size=475013 2024-09-12T17:28:53.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.633+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=9DLD7K0GA8Z2 type=del size=2358586 2024-09-12T17:28:53.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.635+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=V5ND4EDTWL90 type=del 2024-09-12T17:28:53.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.636+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=Z53KQYDE4D1G type=del size=1534264 2024-09-12T17:28:53.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.638+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=HFVMMUOPZUR0 type=del 2024-09-12T17:28:53.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.639+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=2JDRC6JN85JS type=del size=154675 2024-09-12T17:28:53.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.640+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=J4JMY4IKR0VT type=del 2024-09-12T17:28:53.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.642+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=CHEX12RORJ6U type=del size=71973 2024-09-12T17:28:53.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.643+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~03ZL25OFXIZA.0 size=1048576 2024-09-12T17:28:53.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.644+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~03ZL25OFXIZA.1 size=1048576 2024-09-12T17:28:53.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.645+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~03ZL25OFXIZA.2 size=27742 2024-09-12T17:28:53.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.648+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=03ZL25OFXIZA tag=9FUUT2TS3C8I type=write size=3173470 2024-09-12T17:28:53.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.649+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=SNMNH13Q9UK6 type=del size=1879889 2024-09-12T17:28:53.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.653+0000 7f9d7bc0c780 1 < suggested update operation key=J3YYRIVKQ5AU tag=XZ9QQBCZOZ3K type=write size=1021272 2024-09-12T17:28:53.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.655+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=J274GZOK34FG type=del size=1717676 2024-09-12T17:28:53.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.657+0000 7f9d7bc0c780 1 < completed write operation key=G5ZKTTY1XQ9T tag=67SQT200DU32 type=write size=918551 2024-09-12T17:28:53.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.659+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=9H7LO8OFO2M9 type=del size=2879303 2024-09-12T17:28:53.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.662+0000 7f9d7bc0c780 1 < suggested update operation key=LTG0UQEYPUGO tag=FU7JQE202KA7 type=del size=3690850 2024-09-12T17:28:53.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.663+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=OF903V6BD87U type=del size=1968075 2024-09-12T17:28:53.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.665+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~5R4VNX697SE5.0 size=681711 2024-09-12T17:28:53.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.667+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=5R4VNX697SE5 tag=0DL445NVD3GH type=write size=1730287 2024-09-12T17:28:53.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.668+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=0QKH9LLKSMOQ type=del size=3203334 2024-09-12T17:28:53.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.670+0000 7f9d7bc0c780 1 < canceled operation key=EUHRVHNVI83I tag=ES843JPOO51G type=del size=1449317 2024-09-12T17:28:53.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.671+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=LBM9X2CD6NCC type=write size=421262 2024-09-12T17:28:53.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.673+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~7J23Y8965SMV.0 size=1048576 2024-09-12T17:28:53.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.674+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~7J23Y8965SMV.1 size=1048576 2024-09-12T17:28:53.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.675+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~7J23Y8965SMV.2 size=543435 2024-09-12T17:28:53.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.677+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=7J23Y8965SMV tag=W706WKUQSZ5T type=write size=3689163 2024-09-12T17:28:53.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.680+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~DOIXSURKD4EA.0 size=1039715 2024-09-12T17:28:53.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.680+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=DOIXSURKD4EA tag=PP21KFKYDOHM type=write size=2088291 2024-09-12T17:28:53.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.681+0000 7f9d7bc0c780 -1 < failed to complete operation key=LTG0UQEYPUGO tag=MXN7PFG6K2SK type=del size=1407876: (22) Invalid argument 2024-09-12T17:28:53.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.684+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~2T6HSPDMX4XL.0 size=1048576 2024-09-12T17:28:53.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.685+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~2T6HSPDMX4XL.1 size=614643 2024-09-12T17:28:53.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.685+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=2T6HSPDMX4XL tag=MD42C4T8S1U9 type=write size=2711795 2024-09-12T17:28:53.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.686+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~R0QWR1MNTP6X.0 size=1048576 2024-09-12T17:28:53.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.688+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~R0QWR1MNTP6X.1 size=1048576 2024-09-12T17:28:53.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.689+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~R0QWR1MNTP6X.2 size=862385 2024-09-12T17:28:53.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.691+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=R0QWR1MNTP6X tag=XZJXD1YVGYTW type=write size=4008113 2024-09-12T17:28:53.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.694+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~Q287AJ18WSTV.0 size=1048576 2024-09-12T17:28:53.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.695+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~Q287AJ18WSTV.1 size=653729 2024-09-12T17:28:53.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.695+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=Q287AJ18WSTV tag=OP24OY9KXBK3 type=write size=2750881 2024-09-12T17:28:53.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.696+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=IR7OG9MI65R7 type=del 2024-09-12T17:28:53.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.698+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=CCDSFQ6ZQY95 type=del size=4018432 2024-09-12T17:28:53.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.699+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=EBINQIABD9M8 type=del 2024-09-12T17:28:53.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.700+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=6P32KBSAHFGG type=del size=3954252 2024-09-12T17:28:53.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.703+0000 7f9d7bc0c780 1 < suggested update operation key=W1SE9R6KU04G tag=VMWIOUQW5KU0 type=del size=2633001 2024-09-12T17:28:53.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.706+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~PWL19VIP11WG.0 size=1048576 2024-09-12T17:28:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.707+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~PWL19VIP11WG.1 size=1048576 2024-09-12T17:28:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.708+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~PWL19VIP11WG.2 size=699206 2024-09-12T17:28:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.708+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=PWL19VIP11WG tag=OZ97F7Q9THE2 type=write size=3844934 2024-09-12T17:28:53.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.709+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=9DLD7K0GA8Z2 type=del 2024-09-12T17:28:53.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.712+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~H1DG4L9GRFBO.0 size=1048576 2024-09-12T17:28:53.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.713+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~H1DG4L9GRFBO.1 size=1048576 2024-09-12T17:28:53.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.714+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~H1DG4L9GRFBO.2 size=386253 2024-09-12T17:28:53.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.714+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=H1DG4L9GRFBO tag=HP1382BMBJ1A type=write size=3531981 2024-09-12T17:28:53.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.715+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=Z53KQYDE4D1G type=del 2024-09-12T17:28:53.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.718+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~KQJBPZQH5X6O.0 size=1048576 2024-09-12T17:28:53.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.719+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~KQJBPZQH5X6O.1 size=786453 2024-09-12T17:28:53.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.719+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=KQJBPZQH5X6O tag=7TFWQ893F8UV type=write size=2883605 2024-09-12T17:28:53.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.720+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=2JDRC6JN85JS type=del 2024-09-12T17:28:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.722+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=DLIIPDGMMGDS type=write size=565716 2024-09-12T17:28:53.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.723+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=CHEX12RORJ6U type=del 2024-09-12T17:28:53.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.726+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1NSF1U1B4W22.0 size=1048576 2024-09-12T17:28:53.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.727+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1NSF1U1B4W22.1 size=1048576 2024-09-12T17:28:53.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.728+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1NSF1U1B4W22.2 size=403641 2024-09-12T17:28:53.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.728+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=1NSF1U1B4W22 tag=F24W5CKG3KSC type=write size=3549369 2024-09-12T17:28:53.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.729+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=SNMNH13Q9UK6 type=del 2024-09-12T17:28:53.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.732+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~FC4Z4PJZ212B.0 size=1048576 2024-09-12T17:28:53.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.733+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~FC4Z4PJZ212B.1 size=1048576 2024-09-12T17:28:53.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.734+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~FC4Z4PJZ212B.2 size=321312 2024-09-12T17:28:53.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.734+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=FC4Z4PJZ212B tag=6WX8KVBRX78D type=write size=3467040 2024-09-12T17:28:53.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.736+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=J274GZOK34FG type=del 2024-09-12T17:28:53.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.737+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=HD2APRY3FC2D type=del size=2048536 2024-09-12T17:28:53.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.738+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=9H7LO8OFO2M9 type=del 2024-09-12T17:28:53.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.740+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=QUXXWG79JSAH type=del size=2484546 2024-09-12T17:28:53.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.741+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=OF903V6BD87U type=del 2024-09-12T17:28:53.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.744+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~WKCXC3P0Y1ZW.0 size=454694 2024-09-12T17:28:53.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.744+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=WKCXC3P0Y1ZW tag=8DQQZPSX77MR type=write size=1503270 2024-09-12T17:28:53.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.745+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=0QKH9LLKSMOQ type=del 2024-09-12T17:28:53.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.747+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=SPSTAXVFLJU1 type=del size=2050397 2024-09-12T17:28:53.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.748+0000 7f9d7bc0c780 1 < canceled operation key=OZKAXB0ET9R7 tag=LBM9X2CD6NCC type=write size=421262 2024-09-12T17:28:53.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.750+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=RX83JYBYNB0W type=del size=1115448 2024-09-12T17:28:53.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.751+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~DOIXSURKD4EA.0 size=1039715 2024-09-12T17:28:53.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.755+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=DOIXSURKD4EA tag=PP21KFKYDOHM type=write size=2088291 2024-09-12T17:28:53.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.758+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~QW1ZOCY4BND9.0 size=1048576 2024-09-12T17:28:53.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.759+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~QW1ZOCY4BND9.1 size=501273 2024-09-12T17:28:53.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.759+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=QW1ZOCY4BND9 tag=X6IE2X43MOJM type=write size=2598425 2024-09-12T17:28:53.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.760+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~2T6HSPDMX4XL.0 size=1048576 2024-09-12T17:28:53.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.762+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~2T6HSPDMX4XL.1 size=614643 2024-09-12T17:28:53.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.764+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=2T6HSPDMX4XL tag=MD42C4T8S1U9 type=write size=2711795 2024-09-12T17:28:53.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.767+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~61F6BTZ0K0QE.0 size=903605 2024-09-12T17:28:53.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.767+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=61F6BTZ0K0QE tag=UNONN267AAJD type=write size=1952181 2024-09-12T17:28:53.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.768+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~Q287AJ18WSTV.0 size=1048576 2024-09-12T17:28:53.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.770+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~Q287AJ18WSTV.1 size=653729 2024-09-12T17:28:53.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.772+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=Q287AJ18WSTV tag=OP24OY9KXBK3 type=write size=2750881 2024-09-12T17:28:53.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.775+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~DA388574PE9Y.0 size=1048576 2024-09-12T17:28:53.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.776+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~DA388574PE9Y.1 size=1048576 2024-09-12T17:28:53.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.777+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~DA388574PE9Y.2 size=483527 2024-09-12T17:28:53.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.777+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=DA388574PE9Y tag=JKLZN93EELMX type=write size=3629255 2024-09-12T17:28:53.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.779+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=CCDSFQ6ZQY95 type=del 2024-09-12T17:28:53.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.781+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1LGWZ4KGF23V.0 size=1048576 2024-09-12T17:28:53.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.782+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~1LGWZ4KGF23V.1 size=764911 2024-09-12T17:28:53.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.782+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=1LGWZ4KGF23V tag=149R6PFDUY2U type=write size=2862063 2024-09-12T17:28:53.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.785+0000 7f9d7bc0c780 1 < suggested update operation key=LJZNPSVLS9AF tag=6P32KBSAHFGG type=del size=3954252 2024-09-12T17:28:53.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.788+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=OMFUQLA0BSLH type=del size=385417 2024-09-12T17:28:53.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.790+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~PWL19VIP11WG.0 size=1048576 2024-09-12T17:28:53.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.791+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~PWL19VIP11WG.1 size=1048576 2024-09-12T17:28:53.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.792+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~PWL19VIP11WG.2 size=699206 2024-09-12T17:28:53.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.795+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=PWL19VIP11WG tag=OZ97F7Q9THE2 type=write size=3844934 2024-09-12T17:28:53.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.796+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=QB2R3RHOEH92 type=del size=420019 2024-09-12T17:28:53.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.798+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~H1DG4L9GRFBO.0 size=1048576 2024-09-12T17:28:53.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.799+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~H1DG4L9GRFBO.1 size=1048576 2024-09-12T17:28:53.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.800+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~H1DG4L9GRFBO.2 size=386253 2024-09-12T17:28:53.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.802+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=H1DG4L9GRFBO tag=HP1382BMBJ1A type=write size=3531981 2024-09-12T17:28:53.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.803+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=4E8EWDUAYM5Q type=write size=817966 2024-09-12T17:28:53.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.805+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~KQJBPZQH5X6O.0 size=1048576 2024-09-12T17:28:53.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.806+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~KQJBPZQH5X6O.1 size=786453 2024-09-12T17:28:53.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.808+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=KQJBPZQH5X6O tag=7TFWQ893F8UV type=write size=2883605 2024-09-12T17:28:53.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.809+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=OS1ZAT1ZNZTB type=del size=37507 2024-09-12T17:28:53.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.811+0000 7f9d7bc0c780 1 < canceled operation key=M3Q7I7MD7M4I tag=DLIIPDGMMGDS type=write size=565716 2024-09-12T17:28:53.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.812+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=XG4C1V9LDUZL type=del size=1011559 2024-09-12T17:28:53.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.814+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~1NSF1U1B4W22.0 size=1048576 2024-09-12T17:28:53.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.815+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~1NSF1U1B4W22.1 size=1048576 2024-09-12T17:28:53.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.816+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~1NSF1U1B4W22.2 size=403641 2024-09-12T17:28:53.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.818+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=1NSF1U1B4W22 tag=F24W5CKG3KSC type=write size=3549369 2024-09-12T17:28:53.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.821+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~OUMRGXNOZH27.0 size=1048576 2024-09-12T17:28:53.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.822+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~OUMRGXNOZH27.1 size=1048576 2024-09-12T17:28:53.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.823+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~OUMRGXNOZH27.2 size=210567 2024-09-12T17:28:53.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.823+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=OUMRGXNOZH27 tag=U0U2L8W005O5 type=write size=3356295 2024-09-12T17:28:53.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.824+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~FC4Z4PJZ212B.0 size=1048576 2024-09-12T17:28:53.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.826+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~FC4Z4PJZ212B.1 size=1048576 2024-09-12T17:28:53.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.827+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~FC4Z4PJZ212B.2 size=321312 2024-09-12T17:28:53.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.829+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=FC4Z4PJZ212B tag=6WX8KVBRX78D type=write size=3467040 2024-09-12T17:28:53.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.832+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~K7BW8JDR3FBZ.0 size=363361 2024-09-12T17:28:53.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.832+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=K7BW8JDR3FBZ tag=XHNEMSC3PHKB type=write size=1411937 2024-09-12T17:28:53.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.833+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=HD2APRY3FC2D type=del 2024-09-12T17:28:53.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.836+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~ORLK9P5YRXLN.0 size=1048576 2024-09-12T17:28:53.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.837+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~ORLK9P5YRXLN.1 size=714439 2024-09-12T17:28:53.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.837+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=ORLK9P5YRXLN tag=2PODSDCRLQZ3 type=write size=2811591 2024-09-12T17:28:53.839 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.838+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=QUXXWG79JSAH type=del 2024-09-12T17:28:53.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.840+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=YUM62YWSCG1N type=del size=1413413 2024-09-12T17:28:53.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.841+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~WKCXC3P0Y1ZW.0 size=454694 2024-09-12T17:28:53.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.844+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=WKCXC3P0Y1ZW tag=8DQQZPSX77MR type=write size=1503270 2024-09-12T17:28:53.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.846+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~JIOFJ7OL77WQ.0 size=364109 2024-09-12T17:28:53.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.846+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=JIOFJ7OL77WQ tag=NMBU8HOTL5E0 type=write size=1412685 2024-09-12T17:28:53.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.848+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=SPSTAXVFLJU1 type=del 2024-09-12T17:28:53.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.849+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=WTGPJQR9MK6N type=write size=720665 2024-09-12T17:28:53.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.852+0000 7f9d7bc0c780 1 < suggested update operation key=9B83KWC5E4ZV tag=RX83JYBYNB0W type=del size=1115448 2024-09-12T17:28:53.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.855+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~K4IE7N9LLMJP.0 size=1048576 2024-09-12T17:28:53.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.856+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~K4IE7N9LLMJP.1 size=59718 2024-09-12T17:28:53.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.856+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=K4IE7N9LLMJP tag=GFP7HVYMIBT3 type=write size=2156870 2024-09-12T17:28:53.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.857+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~QW1ZOCY4BND9.0 size=1048576 2024-09-12T17:28:53.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.858+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~QW1ZOCY4BND9.1 size=501273 2024-09-12T17:28:53.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.860+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=QW1ZOCY4BND9 tag=X6IE2X43MOJM type=write size=2598425 2024-09-12T17:28:53.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.862+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=KYDE9I8VXG0B type=del size=1424422 2024-09-12T17:28:53.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.863+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~61F6BTZ0K0QE.0 size=903605 2024-09-12T17:28:53.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.865+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=61F6BTZ0K0QE tag=UNONN267AAJD type=write size=1952181 2024-09-12T17:28:53.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.866+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=HBU54WGYHJJ5 type=del size=1481108 2024-09-12T17:28:53.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.868+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~DA388574PE9Y.0 size=1048576 2024-09-12T17:28:53.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.868+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~DA388574PE9Y.1 size=1048576 2024-09-12T17:28:53.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.870+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~DA388574PE9Y.2 size=483527 2024-09-12T17:28:53.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.872+0000 7f9d7bc0c780 1 < canceled multipart upload key=AOT2ZKFTD0HY upload=DA388574PE9Y tag=JKLZN93EELMX type=write size=3629255 2024-09-12T17:28:53.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.875+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~3K9GXMMBJ0U2.0 size=1048576 2024-09-12T17:28:53.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.876+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~3K9GXMMBJ0U2.1 size=991424 2024-09-12T17:28:53.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.876+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=3K9GXMMBJ0U2 tag=RETE5JTXZ0CW type=write size=3088576 2024-09-12T17:28:53.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.876+0000 7f9d7bc0c780 1 < canceled part key=_multipart_X7J78IOJR0HA.2~1LGWZ4KGF23V.0 size=1048576 2024-09-12T17:28:53.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.877+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~1LGWZ4KGF23V.1 size=764911 2024-09-12T17:28:53.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.880+0000 7f9d7bc0c780 1 < canceled multipart upload key=X7J78IOJR0HA upload=1LGWZ4KGF23V tag=149R6PFDUY2U type=write size=2862063 2024-09-12T17:28:53.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.881+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=0XXTKCEPWM8S type=del size=3471827 2024-09-12T17:28:53.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.883+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=OMFUQLA0BSLH type=del 2024-09-12T17:28:53.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.884+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=LQ7KHJ3PZHWM type=del size=3523632 2024-09-12T17:28:53.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.885+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=QB2R3RHOEH92 type=del 2024-09-12T17:28:53.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.887+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=2FO8YY6U4N1S type=write size=367530 2024-09-12T17:28:53.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.888+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=4E8EWDUAYM5Q type=write size=817966 2024-09-12T17:28:53.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.889+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=K75OENAFE1BI type=del size=2357233 2024-09-12T17:28:53.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.892+0000 7f9d7bc0c780 1 < suggested remove operation key=M3Q7I7MD7M4I tag=OS1ZAT1ZNZTB type=del 2024-09-12T17:28:53.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.894+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=RBSG1NI27WJU type=del size=1589487 2024-09-12T17:28:53.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.895+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=XG4C1V9LDUZL type=del 2024-09-12T17:28:53.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.897+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=8APT5UZO4DDE type=del size=3656153 2024-09-12T17:28:53.899 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.898+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~OUMRGXNOZH27.0 size=1048576 2024-09-12T17:28:53.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.899+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~OUMRGXNOZH27.1 size=1048576 2024-09-12T17:28:53.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.902+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~OUMRGXNOZH27.2 size=210567 2024-09-12T17:28:53.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.905+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=OUMRGXNOZH27 tag=U0U2L8W005O5 type=write size=3356295 2024-09-12T17:28:53.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.908+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~Q71S5LGQMY1Z.0 size=1048576 2024-09-12T17:28:53.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.909+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~Q71S5LGQMY1Z.1 size=1048576 2024-09-12T17:28:53.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.910+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~Q71S5LGQMY1Z.2 size=794085 2024-09-12T17:28:53.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.910+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=Q71S5LGQMY1Z tag=EGXZ7NVVIW08 type=write size=3939813 2024-09-12T17:28:53.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.912+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~K7BW8JDR3FBZ.0 size=363361 2024-09-12T17:28:53.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.914+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=K7BW8JDR3FBZ tag=XHNEMSC3PHKB type=write size=1411937 2024-09-12T17:28:53.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.915+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=NRWAPZPO6778 type=del size=284276 2024-09-12T17:28:53.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.917+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~ORLK9P5YRXLN.0 size=1048576 2024-09-12T17:28:53.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.918+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~ORLK9P5YRXLN.1 size=714439 2024-09-12T17:28:53.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.921+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=ORLK9P5YRXLN tag=2PODSDCRLQZ3 type=write size=2811591 2024-09-12T17:28:53.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.922+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=Z2UK4P1T1SN8 type=del size=830933 2024-09-12T17:28:53.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.926+0000 7f9d7bc0c780 1 < suggested update operation key=5B96YH46VAK3 tag=YUM62YWSCG1N type=del size=1413413 2024-09-12T17:28:53.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.928+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~3K69O5G24A2I.0 size=401830 2024-09-12T17:28:53.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.928+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=3K69O5G24A2I tag=RAX88IG910E9 type=write size=1450406 2024-09-12T17:28:53.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.930+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~JIOFJ7OL77WQ.0 size=364109 2024-09-12T17:28:53.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.932+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=JIOFJ7OL77WQ tag=NMBU8HOTL5E0 type=write size=1412685 2024-09-12T17:28:53.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.934+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=3I5SA2G3186N type=del size=1451814 2024-09-12T17:28:53.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.937+0000 7f9d7bc0c780 1 < suggested remove operation key=J7MREXK6R3C4 tag=WTGPJQR9MK6N type=write 2024-09-12T17:28:53.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.938+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=I7FGZY0UWGY0 type=del size=4122089 2024-09-12T17:28:53.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.940+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~K4IE7N9LLMJP.0 size=1048576 2024-09-12T17:28:53.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.940+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~K4IE7N9LLMJP.1 size=59718 2024-09-12T17:28:53.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.943+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=K4IE7N9LLMJP tag=GFP7HVYMIBT3 type=write size=2156870 2024-09-12T17:28:53.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.946+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~RGMSXL6Y66XL.0 size=653082 2024-09-12T17:28:53.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.946+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=RGMSXL6Y66XL tag=DF1YZDQ0TLPM type=write size=1701658 2024-09-12T17:28:53.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.947+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=KYDE9I8VXG0B type=del 2024-09-12T17:28:53.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.950+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~C3A12YQFV7HI.0 size=1048576 2024-09-12T17:28:53.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.951+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~C3A12YQFV7HI.1 size=367066 2024-09-12T17:28:53.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.951+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=C3A12YQFV7HI tag=Q0X4AYMN7IWB type=write size=2464218 2024-09-12T17:28:53.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.953+0000 7f9d7bc0c780 1 < canceled operation key=QB8C0OJA1L4X tag=HBU54WGYHJJ5 type=del size=1481108 2024-09-12T17:28:53.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.956+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~YQTVLD1CMINF.0 size=1048576 2024-09-12T17:28:53.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.957+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~YQTVLD1CMINF.1 size=1048576 2024-09-12T17:28:53.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.958+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~YQTVLD1CMINF.2 size=829924 2024-09-12T17:28:53.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.958+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=YQTVLD1CMINF tag=5CIN8YPQIBEL type=write size=3975652 2024-09-12T17:28:53.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.960+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~3K9GXMMBJ0U2.0 size=1048576 2024-09-12T17:28:53.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.961+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~3K9GXMMBJ0U2.1 size=991424 2024-09-12T17:28:53.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.963+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=3K9GXMMBJ0U2 tag=RETE5JTXZ0CW type=write size=3088576 2024-09-12T17:28:53.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.966+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~SX3VJTTBSVO1.0 size=1048576 2024-09-12T17:28:53.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.968+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~SX3VJTTBSVO1.1 size=872709 2024-09-12T17:28:53.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.968+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=SX3VJTTBSVO1 tag=H6ES954W6NZY type=write size=2969861 2024-09-12T17:28:53.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.971+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=0XXTKCEPWM8S type=del 2024-09-12T17:28:53.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.972+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=ZDC8TI7ZILK4 type=del size=3095426 2024-09-12T17:28:53.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.974+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=LQ7KHJ3PZHWM type=del 2024-09-12T17:28:53.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.977+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~4K41FKOF3CVC.0 size=1048576 2024-09-12T17:28:53.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.978+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~4K41FKOF3CVC.1 size=1040767 2024-09-12T17:28:53.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.978+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=4K41FKOF3CVC tag=SED3L5A36A6T type=write size=3137919 2024-09-12T17:28:53.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.980+0000 7f9d7bc0c780 1 < completed write operation key=X7J78IOJR0HA tag=2FO8YY6U4N1S type=write size=367530 2024-09-12T17:28:53.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.988+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~DQI3UL87VY3H.0 size=1048576 2024-09-12T17:28:53.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.989+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~DQI3UL87VY3H.1 size=102953 2024-09-12T17:28:53.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.989+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=DQI3UL87VY3H tag=ATFXLZ8K9NA3 type=write size=2200105 2024-09-12T17:28:53.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.990+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=K75OENAFE1BI type=del 2024-09-12T17:28:53.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.992+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=MR74VRT6D8BB type=write size=469868 2024-09-12T17:28:53.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.995+0000 7f9d7bc0c780 1 < suggested update operation key=0NGHC5GMSGRX tag=RBSG1NI27WJU type=del size=1589487 2024-09-12T17:28:53.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.998+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~AP35NRG8C201.0 size=1048576 2024-09-12T17:28:54.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:53.999+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~AP35NRG8C201.1 size=1048576 2024-09-12T17:28:54.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.000+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~AP35NRG8C201.2 size=959934 2024-09-12T17:28:54.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.000+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=AP35NRG8C201 tag=3OVXX2NOK5L0 type=write size=4105662 2024-09-12T17:28:54.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.002+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=8APT5UZO4DDE type=del 2024-09-12T17:28:54.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.005+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~HH4O1VM7KA7B.0 size=655739 2024-09-12T17:28:54.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.005+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=HH4O1VM7KA7B tag=3U82A33CDS9R type=write size=1704315 2024-09-12T17:28:54.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.005+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~Q71S5LGQMY1Z.0 size=1048576 2024-09-12T17:28:54.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.006+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~Q71S5LGQMY1Z.1 size=1048576 2024-09-12T17:28:54.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.008+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~Q71S5LGQMY1Z.2 size=794085 2024-09-12T17:28:54.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.010+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=Q71S5LGQMY1Z tag=EGXZ7NVVIW08 type=write size=3939813 2024-09-12T17:28:54.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.012+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=NOT7NRSKB3Q7 type=del size=1152444 2024-09-12T17:28:54.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.013+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=NRWAPZPO6778 type=del 2024-09-12T17:28:54.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.015+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=CY63Y0MHOL8U type=write size=4640 2024-09-12T17:28:54.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.016+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=Z2UK4P1T1SN8 type=del 2024-09-12T17:28:54.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.018+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=54E0IEEC3TXS type=del size=614672 2024-09-12T17:28:54.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.019+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~3K69O5G24A2I.0 size=401830 2024-09-12T17:28:54.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.022+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=3K69O5G24A2I tag=RAX88IG910E9 type=write size=1450406 2024-09-12T17:28:54.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.023+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=FRLZH31Q1PQW type=del size=2866552 2024-09-12T17:28:54.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.027+0000 7f9d7bc0c780 1 < suggested update operation key=G5ZKTTY1XQ9T tag=3I5SA2G3186N type=del size=1451814 2024-09-12T17:28:54.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.028+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=3B0J2A3S3OPJ type=del size=591441 2024-09-12T17:28:54.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.030+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=I7FGZY0UWGY0 type=del 2024-09-12T17:28:54.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.033+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~Y7UI2ATOX2MZ.0 size=1048576 2024-09-12T17:28:54.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.035+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~Y7UI2ATOX2MZ.1 size=1048576 2024-09-12T17:28:54.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.036+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~Y7UI2ATOX2MZ.2 size=726287 2024-09-12T17:28:54.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.036+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=Y7UI2ATOX2MZ tag=9CIXF5GFC5XV type=write size=3872015 2024-09-12T17:28:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.037+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~RGMSXL6Y66XL.0 size=653082 2024-09-12T17:28:54.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.039+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=RGMSXL6Y66XL tag=DF1YZDQ0TLPM type=write size=1701658 2024-09-12T17:28:54.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.041+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=RAPLF0L5X1KI type=del size=3817086 2024-09-12T17:28:54.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.042+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~C3A12YQFV7HI.0 size=1048576 2024-09-12T17:28:54.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.043+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~C3A12YQFV7HI.1 size=367066 2024-09-12T17:28:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.046+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=C3A12YQFV7HI tag=Q0X4AYMN7IWB type=write size=2464218 2024-09-12T17:28:54.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.048+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=V1JY10M397PF type=del size=9871 2024-09-12T17:28:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.049+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~YQTVLD1CMINF.0 size=1048576 2024-09-12T17:28:54.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.051+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~YQTVLD1CMINF.1 size=1048576 2024-09-12T17:28:54.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.052+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~YQTVLD1CMINF.2 size=829924 2024-09-12T17:28:54.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.054+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=YQTVLD1CMINF tag=5CIN8YPQIBEL type=write size=3975652 2024-09-12T17:28:54.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.056+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=CF7AM1GIVHXF type=del size=2192521 2024-09-12T17:28:54.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.057+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~SX3VJTTBSVO1.0 size=1048576 2024-09-12T17:28:54.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.058+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~SX3VJTTBSVO1.1 size=872709 2024-09-12T17:28:54.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.061+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=SX3VJTTBSVO1 tag=H6ES954W6NZY type=write size=2969861 2024-09-12T17:28:54.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.062+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=KVVE2U34BPW1 type=del size=1769119 2024-09-12T17:28:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.065+0000 7f9d7bc0c780 1 < suggested update operation key=CYKLX4CJWVJE tag=ZDC8TI7ZILK4 type=del size=3095426 2024-09-12T17:28:54.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.068+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=TTXWZ8HNAGN2 type=del size=1122784 2024-09-12T17:28:54.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.069+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~4K41FKOF3CVC.0 size=1048576 2024-09-12T17:28:54.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.070+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~4K41FKOF3CVC.1 size=1040767 2024-09-12T17:28:54.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.073+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=4K41FKOF3CVC tag=SED3L5A36A6T type=write size=3137919 2024-09-12T17:28:54.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.075+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~H7S56QS29Y4R.0 size=1048576 2024-09-12T17:28:54.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.076+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~H7S56QS29Y4R.1 size=936390 2024-09-12T17:28:54.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.077+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=H7S56QS29Y4R tag=TSSIR8DQ2ZYZ type=write size=3033542 2024-09-12T17:28:54.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.078+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~DQI3UL87VY3H.0 size=1048576 2024-09-12T17:28:54.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.079+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~DQI3UL87VY3H.1 size=102953 2024-09-12T17:28:54.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.082+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=DQI3UL87VY3H tag=ATFXLZ8K9NA3 type=write size=2200105 2024-09-12T17:28:54.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.085+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~S5K3CNRBDC92.0 size=1048576 2024-09-12T17:28:54.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.086+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~S5K3CNRBDC92.1 size=1048576 2024-09-12T17:28:54.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.087+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~S5K3CNRBDC92.2 size=201168 2024-09-12T17:28:54.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.087+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=S5K3CNRBDC92 tag=ODHRW8XOJVYT type=write size=3346896 2024-09-12T17:28:54.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.090+0000 7f9d7bc0c780 1 < suggested update operation key=ZM8NMC18RN3I tag=MR74VRT6D8BB type=write size=469868 2024-09-12T17:28:54.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.092+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~W8DKMQI21LTB.0 size=581675 2024-09-12T17:28:54.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.092+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=W8DKMQI21LTB tag=HIB06H3QMNZF type=write size=1630251 2024-09-12T17:28:54.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.094+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~AP35NRG8C201.0 size=1048576 2024-09-12T17:28:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.095+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~AP35NRG8C201.1 size=1048576 2024-09-12T17:28:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.096+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~AP35NRG8C201.2 size=959934 2024-09-12T17:28:54.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.099+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=AP35NRG8C201 tag=3OVXX2NOK5L0 type=write size=4105662 2024-09-12T17:28:54.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.102+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~GR4Y04RTLEUS.0 size=221031 2024-09-12T17:28:54.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.102+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=GR4Y04RTLEUS tag=4HU1S6RWTKS1 type=write size=1269607 2024-09-12T17:28:54.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.103+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~HH4O1VM7KA7B.0 size=655739 2024-09-12T17:28:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.106+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=HH4O1VM7KA7B tag=3U82A33CDS9R type=write size=1704315 2024-09-12T17:28:54.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.107+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=B2TZ91Q8B2GO type=del size=447895 2024-09-12T17:28:54.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.111+0000 7f9d7bc0c780 1 < suggested remove operation key=LJZNPSVLS9AF tag=NOT7NRSKB3Q7 type=del 2024-09-12T17:28:54.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.113+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=RNH4E21PRLWB type=del size=2688990 2024-09-12T17:28:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.114+0000 7f9d7bc0c780 1 < canceled operation key=X7J78IOJR0HA tag=CY63Y0MHOL8U type=write size=4640 2024-09-12T17:28:54.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.117+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~SSX1302X88JV.0 size=477392 2024-09-12T17:28:54.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.117+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=SSX1302X88JV tag=B9IBMQFNUX2X type=write size=1525968 2024-09-12T17:28:54.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.119+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=54E0IEEC3TXS type=del 2024-09-12T17:28:54.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.120+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=6B4EAL23K6R7 type=del size=2174111 2024-09-12T17:28:54.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.122+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=FRLZH31Q1PQW type=del 2024-09-12T17:28:54.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.123+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=OP3EEYOTYFFM type=write size=997676 2024-09-12T17:28:54.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.125+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=3B0J2A3S3OPJ type=del 2024-09-12T17:28:54.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.127+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=886H12N8UN4X type=del size=3965124 2024-09-12T17:28:54.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.129+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~Y7UI2ATOX2MZ.0 size=1048576 2024-09-12T17:28:54.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.130+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~Y7UI2ATOX2MZ.1 size=1048576 2024-09-12T17:28:54.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.131+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~Y7UI2ATOX2MZ.2 size=726287 2024-09-12T17:28:54.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.134+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=Y7UI2ATOX2MZ tag=9CIXF5GFC5XV type=write size=3872015 2024-09-12T17:28:54.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.136+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=VW8AZ2C241L1 type=del size=497612 2024-09-12T17:28:54.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.137+0000 7f9d7bc0c780 1 < canceled operation key=58C4SS3TN12K tag=RAPLF0L5X1KI type=del size=3817086 2024-09-12T17:28:54.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.139+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=6P58GFEL58UJ type=write size=674665 2024-09-12T17:28:54.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.142+0000 7f9d7bc0c780 1 < suggested update operation key=NQ0768B94GVV tag=V1JY10M397PF type=del size=9871 2024-09-12T17:28:54.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.143+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=NKHR9Y3CV874 type=del size=37431 2024-09-12T17:28:54.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.145+0000 7f9d7bc0c780 -1 < failed to complete operation key=LJZNPSVLS9AF tag=CF7AM1GIVHXF type=del size=2192521: (22) Invalid argument 2024-09-12T17:28:54.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.147+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=U9GD35H728YK type=del size=3437928 2024-09-12T17:28:54.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.151+0000 7f9d7bc0c780 1 < suggested remove operation key=LTG0UQEYPUGO tag=KVVE2U34BPW1 type=del 2024-09-12T17:28:54.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.152+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=AIVKI4YNVXM2 type=del size=2139007 2024-09-12T17:28:54.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.154+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=TTXWZ8HNAGN2 type=del 2024-09-12T17:28:54.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.157+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~XHDX6J7WFES0.0 size=1048576 2024-09-12T17:28:54.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.158+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~XHDX6J7WFES0.1 size=766552 2024-09-12T17:28:54.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.158+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=XHDX6J7WFES0 tag=YVJM6R7XNBYP type=write size=2863704 2024-09-12T17:28:54.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.160+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~H7S56QS29Y4R.0 size=1048576 2024-09-12T17:28:54.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.161+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~H7S56QS29Y4R.1 size=936390 2024-09-12T17:28:54.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.163+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=H7S56QS29Y4R tag=TSSIR8DQ2ZYZ type=write size=3033542 2024-09-12T17:28:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.165+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=N242X91LJ5QI type=del size=1897118 2024-09-12T17:28:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.165+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~S5K3CNRBDC92.0 size=1048576 2024-09-12T17:28:54.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.166+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~S5K3CNRBDC92.1 size=1048576 2024-09-12T17:28:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.167+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~S5K3CNRBDC92.2 size=201168 2024-09-12T17:28:54.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.170+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=S5K3CNRBDC92 tag=ODHRW8XOJVYT type=write size=3346896 2024-09-12T17:28:54.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.171+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=WT7OHTSLW4OQ type=del size=4119456 2024-09-12T17:28:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.173+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~W8DKMQI21LTB.0 size=581675 2024-09-12T17:28:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.176+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=W8DKMQI21LTB tag=HIB06H3QMNZF type=write size=1630251 2024-09-12T17:28:54.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.177+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=8UQRXSL5IDZZ type=write size=174330 2024-09-12T17:28:54.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.179+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~GR4Y04RTLEUS.0 size=221031 2024-09-12T17:28:54.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.181+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=GR4Y04RTLEUS tag=4HU1S6RWTKS1 type=write size=1269607 2024-09-12T17:28:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.183+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=2FN9PBW805R3 type=write size=889551 2024-09-12T17:28:54.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.184+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=B2TZ91Q8B2GO type=del 2024-09-12T17:28:54.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.187+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~PWBYUJ87SAKH.0 size=1048576 2024-09-12T17:28:54.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.188+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~PWBYUJ87SAKH.1 size=1048576 2024-09-12T17:28:54.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.189+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~PWBYUJ87SAKH.2 size=451122 2024-09-12T17:28:54.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.189+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=PWBYUJ87SAKH tag=UMNB4WT0H4FT type=write size=3596850 2024-09-12T17:28:54.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.191+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=RNH4E21PRLWB type=del 2024-09-12T17:28:54.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.193+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=2TEF7Y70H6BF type=write size=178225 2024-09-12T17:28:54.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.194+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~SSX1302X88JV.0 size=477392 2024-09-12T17:28:54.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.197+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=SSX1302X88JV tag=B9IBMQFNUX2X type=write size=1525968 2024-09-12T17:28:54.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.199+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~O1NTEBW96WQK.0 size=1048576 2024-09-12T17:28:54.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.200+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~O1NTEBW96WQK.1 size=388972 2024-09-12T17:28:54.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.200+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=O1NTEBW96WQK tag=8U327LFM4WWD type=write size=2486124 2024-09-12T17:28:54.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.202+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=6B4EAL23K6R7 type=del 2024-09-12T17:28:54.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.204+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~XS4B4NV1X88Q.0 size=1048576 2024-09-12T17:28:54.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.206+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~XS4B4NV1X88Q.1 size=1048576 2024-09-12T17:28:54.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.207+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~XS4B4NV1X88Q.2 size=599199 2024-09-12T17:28:54.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.207+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=XS4B4NV1X88Q tag=HOQKKF7CS9Z7 type=write size=3744927 2024-09-12T17:28:54.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.208+0000 7f9d7bc0c780 1 < completed write operation key=X7J78IOJR0HA tag=OP3EEYOTYFFM type=write size=997676 2024-09-12T17:28:54.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.212+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~IT0FHKUGBGCU.0 size=1048576 2024-09-12T17:28:54.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.213+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~IT0FHKUGBGCU.1 size=1048576 2024-09-12T17:28:54.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.214+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~IT0FHKUGBGCU.2 size=62206 2024-09-12T17:28:54.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.214+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=IT0FHKUGBGCU tag=BGTEIBI74C8W type=write size=3207934 2024-09-12T17:28:54.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.216+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=886H12N8UN4X type=del 2024-09-12T17:28:54.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.217+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=MDFQ2A9EE1LC type=del size=2415031 2024-09-12T17:28:54.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.219+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=VW8AZ2C241L1 type=del 2024-09-12T17:28:54.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.222+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~FCI6DM0OEUYZ.0 size=1048576 2024-09-12T17:28:54.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.223+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~FCI6DM0OEUYZ.1 size=1048576 2024-09-12T17:28:54.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.224+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~FCI6DM0OEUYZ.2 size=716687 2024-09-12T17:28:54.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.224+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=FCI6DM0OEUYZ tag=FE5FBBZIF0BK type=write size=3862415 2024-09-12T17:28:54.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.225+0000 7f9d7bc0c780 1 < completed write operation key=ZA6JC3WXS8Y5 tag=6P58GFEL58UJ type=write size=674665 2024-09-12T17:28:54.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.228+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~WU5XAOYD9XY2.0 size=1048576 2024-09-12T17:28:54.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.229+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~WU5XAOYD9XY2.1 size=1048576 2024-09-12T17:28:54.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.230+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~WU5XAOYD9XY2.2 size=57292 2024-09-12T17:28:54.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.230+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=WU5XAOYD9XY2 tag=KIRMDR0WBPFA type=write size=3203020 2024-09-12T17:28:54.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.231+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=NKHR9Y3CV874 type=del 2024-09-12T17:28:54.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.233+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=KLE395QHBFCC type=del size=2505834 2024-09-12T17:28:54.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.234+0000 7f9d7bc0c780 -1 < failed to complete operation key=LTG0UQEYPUGO tag=U9GD35H728YK type=del size=3437928: (22) Invalid argument 2024-09-12T17:28:54.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.235+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=EBZ97HOUPCO5 type=write size=770651 2024-09-12T17:28:54.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.237+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=AIVKI4YNVXM2 type=del size=2139007 2024-09-12T17:28:54.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.239+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~78KM3K67VLP9.0 size=296845 2024-09-12T17:28:54.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.239+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=78KM3K67VLP9 tag=KNWURRKE2Y8S type=write size=1345421 2024-09-12T17:28:54.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.241+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~XHDX6J7WFES0.0 size=1048576 2024-09-12T17:28:54.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.242+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~XHDX6J7WFES0.1 size=766552 2024-09-12T17:28:54.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.244+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=XHDX6J7WFES0 tag=YVJM6R7XNBYP type=write size=2863704 2024-09-12T17:28:54.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.245+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=GUTYCPPUDCRL type=del size=3947392 2024-09-12T17:28:54.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.247+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=N242X91LJ5QI type=del 2024-09-12T17:28:54.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.249+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~R5VBVE158TIS.0 size=1048576 2024-09-12T17:28:54.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.250+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~R5VBVE158TIS.1 size=921330 2024-09-12T17:28:54.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.250+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=R5VBVE158TIS tag=4R0VOQYVYYCP type=write size=3018482 2024-09-12T17:28:54.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.252+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=WT7OHTSLW4OQ type=del 2024-09-12T17:28:54.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.253+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=B6YJZXTCO1FJ type=del size=3011744 2024-09-12T17:28:54.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.255+0000 7f9d7bc0c780 1 < completed write operation key=0BYGD7FTPQF3 tag=8UQRXSL5IDZZ type=write size=174330 2024-09-12T17:28:54.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.257+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~1TKXCU74R29I.0 size=1048576 2024-09-12T17:28:54.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.258+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~1TKXCU74R29I.1 size=1048576 2024-09-12T17:28:54.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.259+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~1TKXCU74R29I.2 size=596205 2024-09-12T17:28:54.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.259+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=1TKXCU74R29I tag=8GI7OUAXU44T type=write size=3741933 2024-09-12T17:28:54.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.261+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=2FN9PBW805R3 type=write size=889551 2024-09-12T17:28:54.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.263+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~SKUOTJPBQ7UJ.0 size=1048576 2024-09-12T17:28:54.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.264+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~SKUOTJPBQ7UJ.1 size=374369 2024-09-12T17:28:54.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.264+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=SKUOTJPBQ7UJ tag=DQ1VTRNQ3QX4 type=write size=2471521 2024-09-12T17:28:54.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.266+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~PWBYUJ87SAKH.0 size=1048576 2024-09-12T17:28:54.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.267+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~PWBYUJ87SAKH.1 size=1048576 2024-09-12T17:28:54.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.268+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~PWBYUJ87SAKH.2 size=451122 2024-09-12T17:28:54.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.270+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=PWBYUJ87SAKH tag=UMNB4WT0H4FT type=write size=3596850 2024-09-12T17:28:54.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.272+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=245P1TA4XWCX type=del size=1335507 2024-09-12T17:28:54.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.273+0000 7f9d7bc0c780 1 < canceled operation key=9B83KWC5E4ZV tag=2TEF7Y70H6BF type=write size=178225 2024-09-12T17:28:54.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.275+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=UCW8N83QNJZ2 type=del size=1290889 2024-09-12T17:28:54.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.276+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~O1NTEBW96WQK.0 size=1048576 2024-09-12T17:28:54.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.277+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~O1NTEBW96WQK.1 size=388972 2024-09-12T17:28:54.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.280+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=O1NTEBW96WQK tag=8U327LFM4WWD type=write size=2486124 2024-09-12T17:28:54.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.281+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=AUDUCH92BCT1 type=del size=513741 2024-09-12T17:28:54.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.283+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~XS4B4NV1X88Q.0 size=1048576 2024-09-12T17:28:54.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.283+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~XS4B4NV1X88Q.1 size=1048576 2024-09-12T17:28:54.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.284+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~XS4B4NV1X88Q.2 size=599199 2024-09-12T17:28:54.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.286+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=XS4B4NV1X88Q tag=HOQKKF7CS9Z7 type=write size=3744927 2024-09-12T17:28:54.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.288+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=6L8EQPJX6WTC type=del size=3265765 2024-09-12T17:28:54.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.289+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~IT0FHKUGBGCU.0 size=1048576 2024-09-12T17:28:54.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.291+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~IT0FHKUGBGCU.1 size=1048576 2024-09-12T17:28:54.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.292+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~IT0FHKUGBGCU.2 size=62206 2024-09-12T17:28:54.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.294+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=IT0FHKUGBGCU tag=BGTEIBI74C8W type=write size=3207934 2024-09-12T17:28:54.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.297+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~4W9N26MEP5CS.0 size=1048576 2024-09-12T17:28:54.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.298+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~4W9N26MEP5CS.1 size=896864 2024-09-12T17:28:54.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.298+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=4W9N26MEP5CS tag=7E71ZT6KJULA type=write size=2994016 2024-09-12T17:28:54.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.299+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=MDFQ2A9EE1LC type=del 2024-09-12T17:28:54.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.301+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=461KQR016H17 type=del size=2116272 2024-09-12T17:28:54.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.302+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~FCI6DM0OEUYZ.0 size=1048576 2024-09-12T17:28:54.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.303+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~FCI6DM0OEUYZ.1 size=1048576 2024-09-12T17:28:54.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.305+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~FCI6DM0OEUYZ.2 size=716687 2024-09-12T17:28:54.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.307+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=FCI6DM0OEUYZ tag=FE5FBBZIF0BK type=write size=3862415 2024-09-12T17:28:54.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.311+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~LX80PT0LIGHV.0 size=1048576 2024-09-12T17:28:54.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.312+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~LX80PT0LIGHV.1 size=1048576 2024-09-12T17:28:54.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.313+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~LX80PT0LIGHV.2 size=943110 2024-09-12T17:28:54.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.313+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=LX80PT0LIGHV tag=72VEMA3DFWS3 type=write size=4088838 2024-09-12T17:28:54.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.315+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~WU5XAOYD9XY2.0 size=1048576 2024-09-12T17:28:54.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.316+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~WU5XAOYD9XY2.1 size=1048576 2024-09-12T17:28:54.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.317+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~WU5XAOYD9XY2.2 size=57292 2024-09-12T17:28:54.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.320+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=WU5XAOYD9XY2 tag=KIRMDR0WBPFA type=write size=3203020 2024-09-12T17:28:54.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.321+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=5U40KPDR5KOV type=del size=285272 2024-09-12T17:28:54.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.323+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=KLE395QHBFCC type=del 2024-09-12T17:28:54.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.324+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=S1720ZBZOBMH type=write size=630106 2024-09-12T17:28:54.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.326+0000 7f9d7bc0c780 1 < completed write operation key=58C4SS3TN12K tag=EBZ97HOUPCO5 type=write size=770651 2024-09-12T17:28:54.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.327+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=E5R2RDK50K5D type=del size=326567 2024-09-12T17:28:54.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.328+0000 7f9d7bc0c780 1 < canceled part key=_multipart_5B96YH46VAK3.2~78KM3K67VLP9.0 size=296845 2024-09-12T17:28:54.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.330+0000 7f9d7bc0c780 1 < canceled multipart upload key=5B96YH46VAK3 upload=78KM3K67VLP9 tag=KNWURRKE2Y8S type=write size=1345421 2024-09-12T17:28:54.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.331+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=NBCVHG7E7JTZ type=del size=1198289 2024-09-12T17:28:54.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.334+0000 7f9d7bc0c780 1 < suggested remove operation key=LJZNPSVLS9AF tag=GUTYCPPUDCRL type=del 2024-09-12T17:28:54.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.335+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=NNMW96HWA63V type=del size=951053 2024-09-12T17:28:54.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.337+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~R5VBVE158TIS.0 size=1048576 2024-09-12T17:28:54.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.337+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~R5VBVE158TIS.1 size=921330 2024-09-12T17:28:54.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.339+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=R5VBVE158TIS tag=4R0VOQYVYYCP type=write size=3018482 2024-09-12T17:28:54.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.340+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=N3ILT7UFJ8KC type=del size=2292869 2024-09-12T17:28:54.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.343+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=B6YJZXTCO1FJ type=del 2024-09-12T17:28:54.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.344+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=0MVK97HAKJ2G type=del size=2208240 2024-09-12T17:28:54.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.346+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~1TKXCU74R29I.0 size=1048576 2024-09-12T17:28:54.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.347+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~1TKXCU74R29I.1 size=1048576 2024-09-12T17:28:54.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.347+0000 7f9d7bc0c780 1 < canceled part key=_multipart_NQ0768B94GVV.2~1TKXCU74R29I.2 size=596205 2024-09-12T17:28:54.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.349+0000 7f9d7bc0c780 1 < canceled multipart upload key=NQ0768B94GVV upload=1TKXCU74R29I tag=8GI7OUAXU44T type=write size=3741933 2024-09-12T17:28:54.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.351+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=R97YNI0H1R50 type=del size=2593003 2024-09-12T17:28:54.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.352+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~SKUOTJPBQ7UJ.0 size=1048576 2024-09-12T17:28:54.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.353+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~SKUOTJPBQ7UJ.1 size=374369 2024-09-12T17:28:54.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.356+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=SKUOTJPBQ7UJ tag=DQ1VTRNQ3QX4 type=write size=2471521 2024-09-12T17:28:54.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.358+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~VMAB5JZSB618.0 size=1048576 2024-09-12T17:28:54.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.359+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~VMAB5JZSB618.1 size=1048576 2024-09-12T17:28:54.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.360+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~VMAB5JZSB618.2 size=982926 2024-09-12T17:28:54.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.360+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=VMAB5JZSB618 tag=ACG5YJM0WUU8 type=write size=4128654 2024-09-12T17:28:54.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.362+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=245P1TA4XWCX type=del 2024-09-12T17:28:54.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.364+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~563V3HN4MYZ9.0 size=1048576 2024-09-12T17:28:54.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.365+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~563V3HN4MYZ9.1 size=934594 2024-09-12T17:28:54.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.365+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=563V3HN4MYZ9 tag=PR46OOO5AOX5 type=write size=3031746 2024-09-12T17:28:54.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.367+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=UCW8N83QNJZ2 type=del 2024-09-12T17:28:54.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.368+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=21YV0KXCFP4O type=write size=609210 2024-09-12T17:28:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.370+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=AUDUCH92BCT1 type=del 2024-09-12T17:28:54.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.371+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=EQE6E32115IK type=del size=1545637 2024-09-12T17:28:54.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.373+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=6L8EQPJX6WTC type=del 2024-09-12T17:28:54.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.375+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~B4EYDYM90YS3.0 size=1048576 2024-09-12T17:28:54.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.377+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~B4EYDYM90YS3.1 size=1048576 2024-09-12T17:28:54.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.378+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~B4EYDYM90YS3.2 size=19899 2024-09-12T17:28:54.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.378+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=B4EYDYM90YS3 tag=VQC00QEUTUX9 type=write size=3165627 2024-09-12T17:28:54.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.379+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~4W9N26MEP5CS.0 size=1048576 2024-09-12T17:28:54.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.379+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9B83KWC5E4ZV.2~4W9N26MEP5CS.1 size=896864 2024-09-12T17:28:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.382+0000 7f9d7bc0c780 1 < canceled multipart upload key=9B83KWC5E4ZV upload=4W9N26MEP5CS tag=7E71ZT6KJULA type=write size=2994016 2024-09-12T17:28:54.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.386+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~UZEX6T13I8EA.0 size=1048576 2024-09-12T17:28:54.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.387+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~UZEX6T13I8EA.1 size=1048576 2024-09-12T17:28:54.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.388+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~UZEX6T13I8EA.2 size=542599 2024-09-12T17:28:54.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.388+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=UZEX6T13I8EA tag=IL9A1GSCFJS8 type=write size=3688327 2024-09-12T17:28:54.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.390+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=461KQR016H17 type=del 2024-09-12T17:28:54.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.392+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=N3OZ3EDQ0RWY type=del size=3188118 2024-09-12T17:28:54.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.393+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~LX80PT0LIGHV.0 size=1048576 2024-09-12T17:28:54.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.394+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~LX80PT0LIGHV.1 size=1048576 2024-09-12T17:28:54.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.396+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~LX80PT0LIGHV.2 size=943110 2024-09-12T17:28:54.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.398+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=LX80PT0LIGHV tag=72VEMA3DFWS3 type=write size=4088838 2024-09-12T17:28:54.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.400+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=NSB846LF818F type=del size=1211710 2024-09-12T17:28:54.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.401+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=5U40KPDR5KOV type=del 2024-09-12T17:28:54.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.403+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=6VCIBL4XMNSW type=del size=1726687 2024-09-12T17:28:54.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.404+0000 7f9d7bc0c780 1 < completed write operation key=LU8MLGM7H0CE tag=S1720ZBZOBMH type=write size=630106 2024-09-12T17:28:54.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.408+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~61ZESPEUF3YU.0 size=1048576 2024-09-12T17:28:54.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.409+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~61ZESPEUF3YU.1 size=1048576 2024-09-12T17:28:54.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.410+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~61ZESPEUF3YU.2 size=229504 2024-09-12T17:28:54.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.410+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=61ZESPEUF3YU tag=IX1TBSZD41PT type=write size=3375232 2024-09-12T17:28:54.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.412+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=E5R2RDK50K5D type=del 2024-09-12T17:28:54.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.413+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=7010S1G9XLTX type=del size=1125273 2024-09-12T17:28:54.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.416+0000 7f9d7bc0c780 1 < suggested remove operation key=0JN5WWDYEM6Q tag=NBCVHG7E7JTZ type=del 2024-09-12T17:28:54.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.419+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~2L70ECF1RXFP.0 size=955343 2024-09-12T17:28:54.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.419+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=2L70ECF1RXFP tag=MH1OTXLTWP4S type=write size=2003919 2024-09-12T17:28:54.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.422+0000 7f9d7bc0c780 1 < suggested remove operation key=ZA6JC3WXS8Y5 tag=NNMW96HWA63V type=del 2024-09-12T17:28:54.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.424+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=GZD9KVKMI89D type=del size=156345 2024-09-12T17:28:54.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.427+0000 7f9d7bc0c780 1 < suggested remove operation key=QB8C0OJA1L4X tag=N3ILT7UFJ8KC type=del 2024-09-12T17:28:54.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.429+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=TPKNDTTOT7TB type=del size=3922059 2024-09-12T17:28:54.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.430+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=0MVK97HAKJ2G type=del 2024-09-12T17:28:54.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.432+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=QVPXBJ3T5368 type=del size=3162125 2024-09-12T17:28:54.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.435+0000 7f9d7bc0c780 1 < suggested remove operation key=X7J78IOJR0HA tag=R97YNI0H1R50 type=del 2024-09-12T17:28:54.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.437+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~0SY1YR1JW399.0 size=527502 2024-09-12T17:28:54.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.437+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=0SY1YR1JW399 tag=UWHVSVPHFMKC type=write size=1576078 2024-09-12T17:28:54.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.439+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~VMAB5JZSB618.0 size=1048576 2024-09-12T17:28:54.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.440+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~VMAB5JZSB618.1 size=1048576 2024-09-12T17:28:54.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.441+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~VMAB5JZSB618.2 size=982926 2024-09-12T17:28:54.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.443+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=VMAB5JZSB618 tag=ACG5YJM0WUU8 type=write size=4128654 2024-09-12T17:28:54.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.446+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~BX1SHTBFSILY.0 size=1048576 2024-09-12T17:28:54.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.447+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~BX1SHTBFSILY.1 size=973458 2024-09-12T17:28:54.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.447+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=BX1SHTBFSILY tag=7DJ75OJKABLM type=write size=3070610 2024-09-12T17:28:54.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.449+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~563V3HN4MYZ9.0 size=1048576 2024-09-12T17:28:54.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.450+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~563V3HN4MYZ9.1 size=934594 2024-09-12T17:28:54.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.452+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=563V3HN4MYZ9 tag=PR46OOO5AOX5 type=write size=3031746 2024-09-12T17:28:54.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.454+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=QMGQZTST7KZV type=del size=2699821 2024-09-12T17:28:54.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.456+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=21YV0KXCFP4O type=write size=609210 2024-09-12T17:28:54.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.457+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=2V1227NQVVD2 type=del size=3983472 2024-09-12T17:28:54.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.459+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=EQE6E32115IK type=del 2024-09-12T17:28:54.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.460+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=IVBVKK9EIQKB type=del size=2806092 2024-09-12T17:28:54.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.462+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~B4EYDYM90YS3.0 size=1048576 2024-09-12T17:28:54.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.463+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~B4EYDYM90YS3.1 size=1048576 2024-09-12T17:28:54.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.464+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~B4EYDYM90YS3.2 size=19899 2024-09-12T17:28:54.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.466+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=B4EYDYM90YS3 tag=VQC00QEUTUX9 type=write size=3165627 2024-09-12T17:28:54.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.469+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~7P8UMYRAI3RG.0 size=1048576 2024-09-12T17:28:54.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.470+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~7P8UMYRAI3RG.1 size=1048576 2024-09-12T17:28:54.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.471+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~7P8UMYRAI3RG.2 size=361073 2024-09-12T17:28:54.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.471+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=7P8UMYRAI3RG tag=L8TFBCRXY9MQ type=write size=3506801 2024-09-12T17:28:54.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.473+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~UZEX6T13I8EA.0 size=1048576 2024-09-12T17:28:54.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.474+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~UZEX6T13I8EA.1 size=1048576 2024-09-12T17:28:54.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.475+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~UZEX6T13I8EA.2 size=542599 2024-09-12T17:28:54.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.477+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=UZEX6T13I8EA tag=IL9A1GSCFJS8 type=write size=3688327 2024-09-12T17:28:54.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.479+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=INOXJ6UJ7ZDH type=write size=821096 2024-09-12T17:28:54.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.481+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=N3OZ3EDQ0RWY type=del 2024-09-12T17:28:54.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.486+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~LRPI9VKT8VWY.0 size=492536 2024-09-12T17:28:54.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.486+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=LRPI9VKT8VWY tag=K32TS038T1Z2 type=write size=1541112 2024-09-12T17:28:54.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.488+0000 7f9d7bc0c780 -1 < failed to complete operation key=X7J78IOJR0HA tag=NSB846LF818F type=del size=1211710: (22) Invalid argument 2024-09-12T17:28:54.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.489+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=KBVYUFIMWUMX type=del size=3828913 2024-09-12T17:28:54.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.491+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=6VCIBL4XMNSW type=del 2024-09-12T17:28:54.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.492+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=UHMSDXRMID35 type=write size=670315 2024-09-12T17:28:54.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.494+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~61ZESPEUF3YU.0 size=1048576 2024-09-12T17:28:54.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.495+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~61ZESPEUF3YU.1 size=1048576 2024-09-12T17:28:54.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.496+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~61ZESPEUF3YU.2 size=229504 2024-09-12T17:28:54.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.499+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=61ZESPEUF3YU tag=IX1TBSZD41PT type=write size=3375232 2024-09-12T17:28:54.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.502+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~DQUWPCWQP4QT.0 size=179687 2024-09-12T17:28:54.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.502+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=DQUWPCWQP4QT tag=IXVRM0UZQYT7 type=write size=1228263 2024-09-12T17:28:54.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.505+0000 7f9d7bc0c780 1 < suggested update operation key=LU8MLGM7H0CE tag=7010S1G9XLTX type=del size=1125273 2024-09-12T17:28:54.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.507+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~Z702BY4IF9A6.0 size=1048576 2024-09-12T17:28:54.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.509+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~Z702BY4IF9A6.1 size=1048576 2024-09-12T17:28:54.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.510+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~Z702BY4IF9A6.2 size=786839 2024-09-12T17:28:54.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.510+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=Z702BY4IF9A6 tag=POKN1WQ02X10 type=write size=3932567 2024-09-12T17:28:54.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.511+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~2L70ECF1RXFP.0 size=955343 2024-09-12T17:28:54.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.513+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=2L70ECF1RXFP tag=MH1OTXLTWP4S type=write size=2003919 2024-09-12T17:28:54.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.517+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~DF9KSWLH55DX.0 size=1048576 2024-09-12T17:28:54.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.518+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~DF9KSWLH55DX.1 size=546782 2024-09-12T17:28:54.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.518+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=DF9KSWLH55DX tag=91GHVUKPFDBM type=write size=2643934 2024-09-12T17:28:54.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.519+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=GZD9KVKMI89D type=del 2024-09-12T17:28:54.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.522+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~EHU234Z4QNTX.0 size=1048576 2024-09-12T17:28:54.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.523+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~EHU234Z4QNTX.1 size=1048576 2024-09-12T17:28:54.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.524+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~EHU234Z4QNTX.2 size=37751 2024-09-12T17:28:54.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.524+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=EHU234Z4QNTX tag=WHAIH0TBSEIZ type=write size=3183479 2024-09-12T17:28:54.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.526+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=TPKNDTTOT7TB type=del 2024-09-12T17:28:54.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.527+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=LQBVGCOJM3IC type=del size=1320407 2024-09-12T17:28:54.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.529+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=QVPXBJ3T5368 type=del 2024-09-12T17:28:54.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.532+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~62PI122KETT0.0 size=1048576 2024-09-12T17:28:54.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.533+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~62PI122KETT0.1 size=1048576 2024-09-12T17:28:54.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.534+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~62PI122KETT0.2 size=207925 2024-09-12T17:28:54.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.534+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=62PI122KETT0 tag=IL3TO59Z7PAX type=write size=3353653 2024-09-12T17:28:54.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.536+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~0SY1YR1JW399.0 size=527502 2024-09-12T17:28:54.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.538+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=0SY1YR1JW399 tag=UWHVSVPHFMKC type=write size=1576078 2024-09-12T17:28:54.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.540+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=J1GIG1341PZS type=del size=3756036 2024-09-12T17:28:54.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.542+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~BX1SHTBFSILY.0 size=1048576 2024-09-12T17:28:54.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.542+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LTG0UQEYPUGO.2~BX1SHTBFSILY.1 size=973458 2024-09-12T17:28:54.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.544+0000 7f9d7bc0c780 1 < canceled multipart upload key=LTG0UQEYPUGO upload=BX1SHTBFSILY tag=7DJ75OJKABLM type=write size=3070610 2024-09-12T17:28:54.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.546+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=SXR82JQPAHAV type=del size=1364033 2024-09-12T17:28:54.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.549+0000 7f9d7bc0c780 1 < suggested update operation key=FU7ARIH2X839 tag=QMGQZTST7KZV type=del size=2699821 2024-09-12T17:28:54.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.551+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~FHXEI3Y8B7DC.0 size=1048576 2024-09-12T17:28:54.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.553+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~FHXEI3Y8B7DC.1 size=1048576 2024-09-12T17:28:54.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.554+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~FHXEI3Y8B7DC.2 size=239090 2024-09-12T17:28:54.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.554+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=FHXEI3Y8B7DC tag=AC6D522X5ZL7 type=write size=3384818 2024-09-12T17:28:54.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.555+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=2V1227NQVVD2 type=del 2024-09-12T17:28:54.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.558+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~R531I71ZVOZ2.0 size=1048576 2024-09-12T17:28:54.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.559+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~R531I71ZVOZ2.1 size=834343 2024-09-12T17:28:54.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.559+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=R531I71ZVOZ2 tag=7MRIS73U2QAJ type=write size=2931495 2024-09-12T17:28:54.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.561+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=IVBVKK9EIQKB type=del 2024-09-12T17:28:54.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.563+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=SZZ7VNK3ZT35 type=write size=337649 2024-09-12T17:28:54.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.564+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~7P8UMYRAI3RG.0 size=1048576 2024-09-12T17:28:54.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.565+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~7P8UMYRAI3RG.1 size=1048576 2024-09-12T17:28:54.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.566+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~7P8UMYRAI3RG.2 size=361073 2024-09-12T17:28:54.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.568+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=7P8UMYRAI3RG tag=L8TFBCRXY9MQ type=write size=3506801 2024-09-12T17:28:54.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.570+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=A6Q9TC1APCI4 type=del size=1145158 2024-09-12T17:28:54.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.571+0000 7f9d7bc0c780 1 < completed write operation key=QB8C0OJA1L4X tag=INOXJ6UJ7ZDH type=write size=821096 2024-09-12T17:28:54.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.573+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~JQPZIRHJ8RQ1.0 size=571693 2024-09-12T17:28:54.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.573+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=JQPZIRHJ8RQ1 tag=0XDENKFNDELX type=write size=1620269 2024-09-12T17:28:54.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.575+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~LRPI9VKT8VWY.0 size=492536 2024-09-12T17:28:54.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.578+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=LRPI9VKT8VWY tag=K32TS038T1Z2 type=write size=1541112 2024-09-12T17:28:54.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.579+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=Z8P9PS2T5ZWU type=del size=1517299 2024-09-12T17:28:54.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.580+0000 7f9d7bc0c780 1 < canceled operation key=EUHRVHNVI83I tag=KBVYUFIMWUMX type=del size=3828913 2024-09-12T17:28:54.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.582+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=R9DFOZYLHC5E type=del size=3754673 2024-09-12T17:28:54.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.583+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=UHMSDXRMID35 type=write size=670315 2024-09-12T17:28:54.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.585+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=F1AMCPY67VWA type=del size=1582529 2024-09-12T17:28:54.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.586+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~DQUWPCWQP4QT.0 size=179687 2024-09-12T17:28:54.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.588+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=DQUWPCWQP4QT tag=IXVRM0UZQYT7 type=write size=1228263 2024-09-12T17:28:54.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.591+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~VGBUA46WI37F.0 size=61635 2024-09-12T17:28:54.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.591+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=VGBUA46WI37F tag=ZCC174KPT3N0 type=write size=1110211 2024-09-12T17:28:54.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.592+0000 7f9d7bc0c780 1 < canceled part key=_multipart_5B96YH46VAK3.2~Z702BY4IF9A6.0 size=1048576 2024-09-12T17:28:54.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.593+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~Z702BY4IF9A6.1 size=1048576 2024-09-12T17:28:54.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.594+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~Z702BY4IF9A6.2 size=786839 2024-09-12T17:28:54.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.596+0000 7f9d7bc0c780 1 < canceled multipart upload key=5B96YH46VAK3 upload=Z702BY4IF9A6 tag=POKN1WQ02X10 type=write size=3932567 2024-09-12T17:28:54.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.598+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=U9IQ5C0C86NV type=del size=1078474 2024-09-12T17:28:54.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.599+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~DF9KSWLH55DX.0 size=1048576 2024-09-12T17:28:54.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.600+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~DF9KSWLH55DX.1 size=546782 2024-09-12T17:28:54.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.602+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=DF9KSWLH55DX tag=91GHVUKPFDBM type=write size=2643934 2024-09-12T17:28:54.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.605+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~Y4KQHB99XC96.0 size=1048576 2024-09-12T17:28:54.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.606+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~Y4KQHB99XC96.1 size=285749 2024-09-12T17:28:54.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.606+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=Y4KQHB99XC96 tag=L6NSBJGQD6E5 type=write size=2382901 2024-09-12T17:28:54.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.607+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~EHU234Z4QNTX.0 size=1048576 2024-09-12T17:28:54.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.608+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~EHU234Z4QNTX.1 size=1048576 2024-09-12T17:28:54.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.610+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~EHU234Z4QNTX.2 size=37751 2024-09-12T17:28:54.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.612+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=EHU234Z4QNTX tag=WHAIH0TBSEIZ type=write size=3183479 2024-09-12T17:28:54.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.614+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=HOST2U4U0SPM type=del size=1971163 2024-09-12T17:28:54.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.618+0000 7f9d7bc0c780 1 < suggested remove operation key=31PU0U6IEAV2 tag=LQBVGCOJM3IC type=del 2024-09-12T17:28:54.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.622+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~J201FRD3RODO.0 size=1048576 2024-09-12T17:28:54.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.623+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~J201FRD3RODO.1 size=1048576 2024-09-12T17:28:54.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.625+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~J201FRD3RODO.2 size=678469 2024-09-12T17:28:54.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.625+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=J201FRD3RODO tag=3PPAAC0YBSLL type=write size=3824197 2024-09-12T17:28:54.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.625+0000 7f9d7bc0c780 1 < canceled part key=_multipart_R94VERREGANN.2~62PI122KETT0.0 size=1048576 2024-09-12T17:28:54.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.625+0000 7f9d7bc0c780 1 < canceled part key=_multipart_R94VERREGANN.2~62PI122KETT0.1 size=1048576 2024-09-12T17:28:54.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.626+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~62PI122KETT0.2 size=207925 2024-09-12T17:28:54.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.629+0000 7f9d7bc0c780 1 < canceled multipart upload key=R94VERREGANN upload=62PI122KETT0 tag=IL3TO59Z7PAX type=write size=3353653 2024-09-12T17:28:54.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.631+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~2Z4OGGHXXYAM.0 size=384971 2024-09-12T17:28:54.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.631+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=2Z4OGGHXXYAM tag=LHDNCGTO3ZSK type=write size=1433547 2024-09-12T17:28:54.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.635+0000 7f9d7bc0c780 1 < suggested update operation key=G5ZKTTY1XQ9T tag=J1GIG1341PZS type=del size=3756036 2024-09-12T17:28:54.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.636+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=MRLJ4OJ7X2EB type=write size=226862 2024-09-12T17:28:54.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.639+0000 7f9d7bc0c780 1 < suggested remove operation key=0NGHC5GMSGRX tag=SXR82JQPAHAV type=del 2024-09-12T17:28:54.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.641+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=J5GMRKMFMQA3 type=write size=438984 2024-09-12T17:28:54.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.642+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~FHXEI3Y8B7DC.0 size=1048576 2024-09-12T17:28:54.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.644+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~FHXEI3Y8B7DC.1 size=1048576 2024-09-12T17:28:54.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.645+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~FHXEI3Y8B7DC.2 size=239090 2024-09-12T17:28:54.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.648+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=FHXEI3Y8B7DC tag=AC6D522X5ZL7 type=write size=3384818 2024-09-12T17:28:54.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.650+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=21FUY592ZL08 type=write size=143130 2024-09-12T17:28:54.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.651+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~R531I71ZVOZ2.0 size=1048576 2024-09-12T17:28:54.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.652+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~R531I71ZVOZ2.1 size=834343 2024-09-12T17:28:54.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.655+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=R531I71ZVOZ2 tag=7MRIS73U2QAJ type=write size=2931495 2024-09-12T17:28:54.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.656+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=W3KNJRPDRNDZ type=del size=2770330 2024-09-12T17:28:54.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.657+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=SZZ7VNK3ZT35 type=write size=337649 2024-09-12T17:28:54.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.659+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=GGMDUMCGZSJS type=del size=1164568 2024-09-12T17:28:54.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.660+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=A6Q9TC1APCI4 type=del 2024-09-12T17:28:54.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.663+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~E399MZ4NSG5J.0 size=397152 2024-09-12T17:28:54.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.663+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=E399MZ4NSG5J tag=QDPZ7CPJQ5JS type=write size=1445728 2024-09-12T17:28:54.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.664+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~JQPZIRHJ8RQ1.0 size=571693 2024-09-12T17:28:54.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.667+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=JQPZIRHJ8RQ1 tag=0XDENKFNDELX type=write size=1620269 2024-09-12T17:28:54.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.669+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~PH1ER68MCE77.0 size=1048576 2024-09-12T17:28:54.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.670+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~PH1ER68MCE77.1 size=410591 2024-09-12T17:28:54.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.670+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=PH1ER68MCE77 tag=XRRBZ9CE3XN8 type=write size=2507743 2024-09-12T17:28:54.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.673+0000 7f9d7bc0c780 1 < suggested update operation key=EUHRVHNVI83I tag=Z8P9PS2T5ZWU type=del size=1517299 2024-09-12T17:28:54.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.676+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~FEPEUL0N6S37.0 size=1048576 2024-09-12T17:28:54.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.677+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~FEPEUL0N6S37.1 size=1048576 2024-09-12T17:28:54.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.678+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~FEPEUL0N6S37.2 size=158696 2024-09-12T17:28:54.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.678+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=FEPEUL0N6S37 tag=NNERQSQ5M3HK type=write size=3304424 2024-09-12T17:28:54.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.681+0000 7f9d7bc0c780 1 < suggested remove operation key=J3YYRIVKQ5AU tag=R9DFOZYLHC5E type=del 2024-09-12T17:28:54.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.683+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=XHS0Q0PUDWQH type=write size=232453 2024-09-12T17:28:54.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.684+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=F1AMCPY67VWA type=del 2024-09-12T17:28:54.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.687+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~AV6DJVSOMI99.0 size=1048576 2024-09-12T17:28:54.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.688+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~AV6DJVSOMI99.1 size=325657 2024-09-12T17:28:54.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.688+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=AV6DJVSOMI99 tag=LGKRPATD9FR3 type=write size=2422809 2024-09-12T17:28:54.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.689+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~VGBUA46WI37F.0 size=61635 2024-09-12T17:28:54.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.692+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=VGBUA46WI37F tag=ZCC174KPT3N0 type=write size=1110211 2024-09-12T17:28:54.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.693+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=SPD5GZ40DIW3 type=del size=265934 2024-09-12T17:28:54.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.695+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=U9IQ5C0C86NV type=del 2024-09-12T17:28:54.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.698+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~7S1LZKMQS5YH.0 size=871553 2024-09-12T17:28:54.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.698+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=7S1LZKMQS5YH tag=M3B78UU7FVN5 type=write size=1920129 2024-09-12T17:28:54.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.699+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~Y4KQHB99XC96.0 size=1048576 2024-09-12T17:28:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.700+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~Y4KQHB99XC96.1 size=285749 2024-09-12T17:28:54.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.703+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=Y4KQHB99XC96 tag=L6NSBJGQD6E5 type=write size=2382901 2024-09-12T17:28:54.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.705+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=PZIQUPXPGMR3 type=del size=2919940 2024-09-12T17:28:54.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.706+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=HOST2U4U0SPM type=del 2024-09-12T17:28:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.709+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~Q8DXWJUT21PY.0 size=1004687 2024-09-12T17:28:54.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.709+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=Q8DXWJUT21PY tag=MPA34BUKCZI4 type=write size=2053263 2024-09-12T17:28:54.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.710+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~J201FRD3RODO.0 size=1048576 2024-09-12T17:28:54.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.710+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~J201FRD3RODO.1 size=1048576 2024-09-12T17:28:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.711+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~J201FRD3RODO.2 size=678469 2024-09-12T17:28:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.713+0000 7f9d7bc0c780 1 < canceled multipart upload key=FU7ARIH2X839 upload=J201FRD3RODO tag=3PPAAC0YBSLL type=write size=3824197 2024-09-12T17:28:54.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.718+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~UYRMSMSSGD3P.0 size=217359 2024-09-12T17:28:54.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.718+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=UYRMSMSSGD3P tag=HMWWKU7WUFYC type=write size=1265935 2024-09-12T17:28:54.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.720+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~2Z4OGGHXXYAM.0 size=384971 2024-09-12T17:28:54.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.722+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=2Z4OGGHXXYAM tag=LHDNCGTO3ZSK type=write size=1433547 2024-09-12T17:28:54.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.725+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~PAKIDGO992OU.0 size=685109 2024-09-12T17:28:54.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.725+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=PAKIDGO992OU tag=EIONUS4RQ2UW type=write size=1733685 2024-09-12T17:28:54.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.727+0000 7f9d7bc0c780 1 < completed write operation key=OZKAXB0ET9R7 tag=MRLJ4OJ7X2EB type=write size=226862 2024-09-12T17:28:54.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.728+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=AXY2CV8N3Z7N type=del size=405433 2024-09-12T17:28:54.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.729+0000 7f9d7bc0c780 1 < completed write operation key=QB8C0OJA1L4X tag=J5GMRKMFMQA3 type=write size=438984 2024-09-12T17:28:54.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.732+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~Z1I21GSCXTXK.0 size=163413 2024-09-12T17:28:54.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.732+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=Z1I21GSCXTXK tag=1ZYN21Y8N7OY type=write size=1211989 2024-09-12T17:28:54.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.734+0000 7f9d7bc0c780 1 < canceled operation key=LJZNPSVLS9AF tag=21FUY592ZL08 type=write size=143130 2024-09-12T17:28:54.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.735+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=AHFQPK6O114B type=del size=3267705 2024-09-12T17:28:54.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.737+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=W3KNJRPDRNDZ type=del 2024-09-12T17:28:54.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.739+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~3YU0HR269Y5B.0 size=1048576 2024-09-12T17:28:54.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.740+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~3YU0HR269Y5B.1 size=1048576 2024-09-12T17:28:54.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.743+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~3YU0HR269Y5B.2 size=193158 2024-09-12T17:28:54.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.743+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=3YU0HR269Y5B tag=0IDKV7WTI3VI type=write size=3338886 2024-09-12T17:28:54.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.746+0000 7f9d7bc0c780 1 < suggested update operation key=J7MREXK6R3C4 tag=GGMDUMCGZSJS type=del size=1164568 2024-09-12T17:28:54.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.748+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~IZLICFVGLXPH.0 size=1048576 2024-09-12T17:28:54.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.749+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~IZLICFVGLXPH.1 size=426207 2024-09-12T17:28:54.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.749+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=IZLICFVGLXPH tag=CRGXACNDSXMP type=write size=2523359 2024-09-12T17:28:54.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.751+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~E399MZ4NSG5J.0 size=397152 2024-09-12T17:28:54.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.753+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=E399MZ4NSG5J tag=QDPZ7CPJQ5JS type=write size=1445728 2024-09-12T17:28:54.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.755+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=ONY1JMNIKI13 type=del size=1814427 2024-09-12T17:28:54.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.756+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~PH1ER68MCE77.0 size=1048576 2024-09-12T17:28:54.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.756+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J3YYRIVKQ5AU.2~PH1ER68MCE77.1 size=410591 2024-09-12T17:28:54.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.758+0000 7f9d7bc0c780 1 < canceled multipart upload key=J3YYRIVKQ5AU upload=PH1ER68MCE77 tag=XRRBZ9CE3XN8 type=write size=2507743 2024-09-12T17:28:54.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.761+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=5E5INO5P0F1G type=del size=75832 2024-09-12T17:28:54.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.763+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~FEPEUL0N6S37.0 size=1048576 2024-09-12T17:28:54.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.764+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~FEPEUL0N6S37.1 size=1048576 2024-09-12T17:28:54.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.765+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~FEPEUL0N6S37.2 size=158696 2024-09-12T17:28:54.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.767+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=FEPEUL0N6S37 tag=NNERQSQ5M3HK type=write size=3304424 2024-09-12T17:28:54.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.768+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=FKNDR1ZRYNAP type=del size=988746 2024-09-12T17:28:54.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.772+0000 7f9d7bc0c780 1 < suggested remove operation key=ZM8NMC18RN3I tag=XHS0Q0PUDWQH type=write 2024-09-12T17:28:54.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.774+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=O6EIKUXT6UOQ type=del size=65541 2024-09-12T17:28:54.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.775+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~AV6DJVSOMI99.0 size=1048576 2024-09-12T17:28:54.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.777+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~AV6DJVSOMI99.1 size=325657 2024-09-12T17:28:54.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.779+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=AV6DJVSOMI99 tag=LGKRPATD9FR3 type=write size=2422809 2024-09-12T17:28:54.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.781+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=QVXEA5SKR5N0 type=del size=870816 2024-09-12T17:28:54.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.782+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=SPD5GZ40DIW3 type=del 2024-09-12T17:28:54.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.783+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=TIBGW37NE9HG type=write size=305435 2024-09-12T17:28:54.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.785+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~7S1LZKMQS5YH.0 size=871553 2024-09-12T17:28:54.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.788+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=7S1LZKMQS5YH tag=M3B78UU7FVN5 type=write size=1920129 2024-09-12T17:28:54.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.791+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~OUI4TM6URKVC.0 size=283707 2024-09-12T17:28:54.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.791+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=OUI4TM6URKVC tag=WKSVHKJHYU01 type=write size=1332283 2024-09-12T17:28:54.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.793+0000 7f9d7bc0c780 1 < suggested update operation key=FU7ARIH2X839 tag=PZIQUPXPGMR3 type=del size=2919940 2024-09-12T17:28:54.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.794+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=O65CSZBWDLOV type=write size=581324 2024-09-12T17:28:54.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.796+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~Q8DXWJUT21PY.0 size=1004687 2024-09-12T17:28:54.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.798+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=Q8DXWJUT21PY tag=MPA34BUKCZI4 type=write size=2053263 2024-09-12T17:28:54.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.800+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~CC8C9TR43G88.0 size=1048576 2024-09-12T17:28:54.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.801+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~CC8C9TR43G88.1 size=947880 2024-09-12T17:28:54.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.801+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=CC8C9TR43G88 tag=U008VRB29E9R type=write size=3045032 2024-09-12T17:28:54.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.803+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~UYRMSMSSGD3P.0 size=217359 2024-09-12T17:28:54.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.805+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=UYRMSMSSGD3P tag=HMWWKU7WUFYC type=write size=1265935 2024-09-12T17:28:54.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.806+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=KKGQIWZXUNSM type=write size=107494 2024-09-12T17:28:54.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.808+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~PAKIDGO992OU.0 size=685109 2024-09-12T17:28:54.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.810+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=PAKIDGO992OU tag=EIONUS4RQ2UW type=write size=1733685 2024-09-12T17:28:54.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.811+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=3AI200QAITZ1 type=del size=185483 2024-09-12T17:28:54.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.813+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=AXY2CV8N3Z7N type=del 2024-09-12T17:28:54.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.816+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~AP5PWA24DG75.0 size=1048576 2024-09-12T17:28:54.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.818+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~AP5PWA24DG75.1 size=262988 2024-09-12T17:28:54.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.818+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=AP5PWA24DG75 tag=ZAY0BGT7XUMR type=write size=2360140 2024-09-12T17:28:54.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.820+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~Z1I21GSCXTXK.0 size=163413 2024-09-12T17:28:54.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.822+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=Z1I21GSCXTXK tag=1ZYN21Y8N7OY type=write size=1211989 2024-09-12T17:28:54.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.825+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~8Z6FGNSOJ04Z.0 size=1048576 2024-09-12T17:28:54.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.826+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~8Z6FGNSOJ04Z.1 size=1048576 2024-09-12T17:28:54.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.827+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~8Z6FGNSOJ04Z.2 size=233618 2024-09-12T17:28:54.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.827+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=8Z6FGNSOJ04Z tag=KE3F1BS8N3BX type=write size=3379346 2024-09-12T17:28:54.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.829+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=AHFQPK6O114B type=del 2024-09-12T17:28:54.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.831+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~ZOJIDBXR2U1U.0 size=1048576 2024-09-12T17:28:54.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.833+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~ZOJIDBXR2U1U.1 size=1048576 2024-09-12T17:28:54.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.834+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~ZOJIDBXR2U1U.2 size=343728 2024-09-12T17:28:54.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.834+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=ZOJIDBXR2U1U tag=W4XV15EY09JK type=write size=3489456 2024-09-12T17:28:54.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.835+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~3YU0HR269Y5B.0 size=1048576 2024-09-12T17:28:54.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.837+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~3YU0HR269Y5B.1 size=1048576 2024-09-12T17:28:54.839 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.838+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~3YU0HR269Y5B.2 size=193158 2024-09-12T17:28:54.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.840+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=3YU0HR269Y5B tag=0IDKV7WTI3VI type=write size=3338886 2024-09-12T17:28:54.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.843+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~MIKP7Q8I0WRM.0 size=1048576 2024-09-12T17:28:54.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.844+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~MIKP7Q8I0WRM.1 size=512505 2024-09-12T17:28:54.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.844+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=MIKP7Q8I0WRM tag=3EAQMROATR9F type=write size=2609657 2024-09-12T17:28:54.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.846+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~IZLICFVGLXPH.0 size=1048576 2024-09-12T17:28:54.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.847+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~IZLICFVGLXPH.1 size=426207 2024-09-12T17:28:54.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.849+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=IZLICFVGLXPH tag=CRGXACNDSXMP type=write size=2523359 2024-09-12T17:28:54.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.852+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~JFRBN2P1LGED.0 size=1039994 2024-09-12T17:28:54.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.852+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=JFRBN2P1LGED tag=62HXO3BHLCLM type=write size=2088570 2024-09-12T17:28:54.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.854+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=ONY1JMNIKI13 type=del 2024-09-12T17:28:54.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.855+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=G3N3250XIE7Z type=del size=459788 2024-09-12T17:28:54.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.857+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=5E5INO5P0F1G type=del 2024-09-12T17:28:54.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.858+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=PYH8S4KFGGCQ type=del size=4094987 2024-09-12T17:28:54.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.860+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=FKNDR1ZRYNAP type=del 2024-09-12T17:28:54.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.862+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=FZCBKVJ7XKV2 type=del size=2822674 2024-09-12T17:28:54.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.863+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=O6EIKUXT6UOQ type=del 2024-09-12T17:28:54.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.865+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=EO24DDZNUVE3 type=del size=4097116 2024-09-12T17:28:54.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.867+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=QVXEA5SKR5N0 type=del 2024-09-12T17:28:54.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.869+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=DUMSN7033S2Y type=del size=1390144 2024-09-12T17:28:54.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.871+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=TIBGW37NE9HG type=write size=305435 2024-09-12T17:28:54.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.872+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=L3A2IGQPSP5J type=del size=3237822 2024-09-12T17:28:54.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.874+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~OUI4TM6URKVC.0 size=283707 2024-09-12T17:28:54.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.878+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=OUI4TM6URKVC tag=WKSVHKJHYU01 type=write size=1332283 2024-09-12T17:28:54.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.879+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=BNT2154QBQL4 type=del size=1077028 2024-09-12T17:28:54.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.880+0000 7f9d7bc0c780 1 < completed write operation key=NQ0768B94GVV tag=O65CSZBWDLOV type=write size=581324 2024-09-12T17:28:54.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.883+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~868IW2FV7OUW.0 size=1048576 2024-09-12T17:28:54.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.884+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~868IW2FV7OUW.1 size=1048576 2024-09-12T17:28:54.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.886+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~868IW2FV7OUW.2 size=710443 2024-09-12T17:28:54.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.886+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=868IW2FV7OUW tag=MJVVE9UQ10KK type=write size=3856171 2024-09-12T17:28:54.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.887+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~CC8C9TR43G88.0 size=1048576 2024-09-12T17:28:54.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.888+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~CC8C9TR43G88.1 size=947880 2024-09-12T17:28:54.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.891+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=CC8C9TR43G88 tag=U008VRB29E9R type=write size=3045032 2024-09-12T17:28:54.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.892+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=LDV4CW0849G0 type=del size=2901092 2024-09-12T17:28:54.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.895+0000 7f9d7bc0c780 1 < suggested remove operation key=LTG0UQEYPUGO tag=KKGQIWZXUNSM type=write 2024-09-12T17:28:54.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.897+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=6HTMVUP54AVS type=del size=313899 2024-09-12T17:28:54.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.899+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=3AI200QAITZ1 type=del 2024-09-12T17:28:54.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.902+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~LTFGR9A01XF3.0 size=1048576 2024-09-12T17:28:54.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.904+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~LTFGR9A01XF3.1 size=821968 2024-09-12T17:28:54.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.904+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=LTFGR9A01XF3 tag=TV5AA7PG9U1Q type=write size=2919120 2024-09-12T17:28:54.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.905+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~AP5PWA24DG75.0 size=1048576 2024-09-12T17:28:54.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.906+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~AP5PWA24DG75.1 size=262988 2024-09-12T17:28:54.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.908+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=AP5PWA24DG75 tag=ZAY0BGT7XUMR type=write size=2360140 2024-09-12T17:28:54.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.910+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=2C36HIPWWXAW type=write size=419589 2024-09-12T17:28:54.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.910+0000 7f9d7bc0c780 1 < canceled part key=_multipart_EUHRVHNVI83I.2~8Z6FGNSOJ04Z.0 size=1048576 2024-09-12T17:28:54.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.911+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~8Z6FGNSOJ04Z.1 size=1048576 2024-09-12T17:28:54.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.911+0000 7f9d7bc0c780 1 < canceled part key=_multipart_EUHRVHNVI83I.2~8Z6FGNSOJ04Z.2 size=233618 2024-09-12T17:28:54.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.914+0000 7f9d7bc0c780 1 < canceled multipart upload key=EUHRVHNVI83I upload=8Z6FGNSOJ04Z tag=KE3F1BS8N3BX type=write size=3379346 2024-09-12T17:28:54.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.917+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~N7JXI9CV1NSH.0 size=1048576 2024-09-12T17:28:54.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.918+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~N7JXI9CV1NSH.1 size=80920 2024-09-12T17:28:54.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.918+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=N7JXI9CV1NSH tag=Z1R5RV0OFI0V type=write size=2178072 2024-09-12T17:28:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.920+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~ZOJIDBXR2U1U.0 size=1048576 2024-09-12T17:28:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.921+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~ZOJIDBXR2U1U.1 size=1048576 2024-09-12T17:28:54.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.921+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~ZOJIDBXR2U1U.2 size=343728 2024-09-12T17:28:54.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.923+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=ZOJIDBXR2U1U tag=W4XV15EY09JK type=write size=3489456 2024-09-12T17:28:54.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.924+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=PM6J6FUK3ZEK type=del size=3286397 2024-09-12T17:28:54.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.926+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~MIKP7Q8I0WRM.0 size=1048576 2024-09-12T17:28:54.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.927+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~MIKP7Q8I0WRM.1 size=512505 2024-09-12T17:28:54.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.929+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=MIKP7Q8I0WRM tag=3EAQMROATR9F type=write size=2609657 2024-09-12T17:28:54.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.931+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=L9IU7RAJP2SX type=del size=2064601 2024-09-12T17:28:54.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.932+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~JFRBN2P1LGED.0 size=1039994 2024-09-12T17:28:54.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.935+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=JFRBN2P1LGED tag=62HXO3BHLCLM type=write size=2088570 2024-09-12T17:28:54.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.938+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~J7XKYS044IY7.0 size=558926 2024-09-12T17:28:54.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.938+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=J7XKYS044IY7 tag=ERQSXMWJXNE9 type=write size=1607502 2024-09-12T17:28:54.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.940+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=G3N3250XIE7Z type=del 2024-09-12T17:28:54.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.941+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=OBZTCBOBLTYW type=del size=4161380 2024-09-12T17:28:54.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.942+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=PYH8S4KFGGCQ type=del 2024-09-12T17:28:54.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.944+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=WBPSQK35QGCS type=del size=532051 2024-09-12T17:28:54.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.946+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=FZCBKVJ7XKV2 type=del 2024-09-12T17:28:54.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.947+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=7KT8LT4JVEHT type=del size=1302689 2024-09-12T17:28:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.948+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=EO24DDZNUVE3 type=del 2024-09-12T17:28:54.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.950+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=8SJSMBF8QJZ6 type=del size=1706800 2024-09-12T17:28:54.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.952+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=DUMSN7033S2Y type=del 2024-09-12T17:28:54.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.953+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=2L9XZCOIB0RZ type=del size=3397581 2024-09-12T17:28:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.955+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=L3A2IGQPSP5J type=del 2024-09-12T17:28:54.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.957+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~DOCB0FCTHCGF.0 size=122231 2024-09-12T17:28:54.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.957+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=DOCB0FCTHCGF tag=IGHOG0NXXJ1Y type=write size=1170807 2024-09-12T17:28:54.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.959+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=BNT2154QBQL4 type=del 2024-09-12T17:28:54.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.961+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~B7NEGR8BB03A.0 size=1048576 2024-09-12T17:28:54.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.962+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~B7NEGR8BB03A.1 size=1048576 2024-09-12T17:28:54.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.963+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~B7NEGR8BB03A.2 size=967936 2024-09-12T17:28:54.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.963+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=B7NEGR8BB03A tag=USF7H99ASXWT type=write size=4113664 2024-09-12T17:28:54.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.965+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~868IW2FV7OUW.0 size=1048576 2024-09-12T17:28:54.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.966+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~868IW2FV7OUW.1 size=1048576 2024-09-12T17:28:54.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.967+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~868IW2FV7OUW.2 size=710443 2024-09-12T17:28:54.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.969+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=868IW2FV7OUW tag=MJVVE9UQ10KK type=write size=3856171 2024-09-12T17:28:54.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.972+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~HZVGIWX77SNE.0 size=898333 2024-09-12T17:28:54.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.972+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=HZVGIWX77SNE tag=1SYZ3K3BPK7J type=write size=1946909 2024-09-12T17:28:54.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.975+0000 7f9d7bc0c780 1 < suggested remove operation key=J7MREXK6R3C4 tag=LDV4CW0849G0 type=del 2024-09-12T17:28:54.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.977+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=HAIVL3L4DX9F type=del size=167818 2024-09-12T17:28:54.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.980+0000 7f9d7bc0c780 1 < suggested update operation key=ZA6JC3WXS8Y5 tag=6HTMVUP54AVS type=del size=313899 2024-09-12T17:28:54.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.981+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=XS1Z3K2UGPJ0 type=del size=1114120 2024-09-12T17:28:54.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.983+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~LTFGR9A01XF3.0 size=1048576 2024-09-12T17:28:54.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.983+0000 7f9d7bc0c780 1 < canceled part key=_multipart_SDX69F30A2RK.2~LTFGR9A01XF3.1 size=821968 2024-09-12T17:28:54.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.985+0000 7f9d7bc0c780 1 < canceled multipart upload key=SDX69F30A2RK upload=LTFGR9A01XF3 tag=TV5AA7PG9U1Q type=write size=2919120 2024-09-12T17:28:54.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.987+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=9YPT8UOM9SJS type=del size=174976 2024-09-12T17:28:54.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.989+0000 7f9d7bc0c780 -1 < failed to complete operation key=J7MREXK6R3C4 tag=2C36HIPWWXAW type=write size=419589: (22) Invalid argument 2024-09-12T17:28:54.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.990+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=616I2BH0DE3R type=del size=389460 2024-09-12T17:28:54.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.992+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~N7JXI9CV1NSH.0 size=1048576 2024-09-12T17:28:54.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.993+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~N7JXI9CV1NSH.1 size=80920 2024-09-12T17:28:54.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.995+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=N7JXI9CV1NSH tag=Z1R5RV0OFI0V type=write size=2178072 2024-09-12T17:28:54.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.998+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~S2LX93WMTU1Y.0 size=1048576 2024-09-12T17:28:55.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:54.999+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~S2LX93WMTU1Y.1 size=1048576 2024-09-12T17:28:55.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.000+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~S2LX93WMTU1Y.2 size=132023 2024-09-12T17:28:55.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.000+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=S2LX93WMTU1Y tag=VDEXOGQ85ID3 type=write size=3277751 2024-09-12T17:28:55.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.002+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=PM6J6FUK3ZEK type=del 2024-09-12T17:28:55.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.003+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=59VUPXXIF3G1 type=del size=2487033 2024-09-12T17:28:55.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.005+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=L9IU7RAJP2SX type=del 2024-09-12T17:28:55.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.006+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=X11J6FHH3X9D type=write size=844949 2024-09-12T17:28:55.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.008+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~J7XKYS044IY7.0 size=558926 2024-09-12T17:28:55.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.010+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=J7XKYS044IY7 tag=ERQSXMWJXNE9 type=write size=1607502 2024-09-12T17:28:55.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.013+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~SB4RRWUJ563M.0 size=1048576 2024-09-12T17:28:55.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.014+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~SB4RRWUJ563M.1 size=1048576 2024-09-12T17:28:55.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.015+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~SB4RRWUJ563M.2 size=1013326 2024-09-12T17:28:55.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.015+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=SB4RRWUJ563M tag=UYLK9N9HXO50 type=write size=4159054 2024-09-12T17:28:55.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.017+0000 7f9d7bc0c780 1 < suggested update operation key=CYKLX4CJWVJE tag=OBZTCBOBLTYW type=del size=4161380 2024-09-12T17:28:55.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.020+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~0LYHOJJSWZ05.0 size=1048576 2024-09-12T17:28:55.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.021+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~0LYHOJJSWZ05.1 size=1048576 2024-09-12T17:28:55.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.022+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~0LYHOJJSWZ05.2 size=806915 2024-09-12T17:28:55.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.022+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=0LYHOJJSWZ05 tag=HSTGUYU1U18S type=write size=3952643 2024-09-12T17:28:55.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.024+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=WBPSQK35QGCS type=del 2024-09-12T17:28:55.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.025+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=AM5JOKUKDIJK type=write size=666505 2024-09-12T17:28:55.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.027+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=7KT8LT4JVEHT type=del 2024-09-12T17:28:55.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.028+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=CZI39SGMC2NG type=del size=3078598 2024-09-12T17:28:55.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.031+0000 7f9d7bc0c780 1 < suggested update operation key=W1SE9R6KU04G tag=8SJSMBF8QJZ6 type=del size=1706800 2024-09-12T17:28:55.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.032+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=8L76MHKP3L59 type=del size=1353871 2024-09-12T17:28:55.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.034+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=2L9XZCOIB0RZ type=del 2024-09-12T17:28:55.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.036+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~AY2528SPQLB3.0 size=1048576 2024-09-12T17:28:55.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.039+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~AY2528SPQLB3.1 size=370486 2024-09-12T17:28:55.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.039+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=AY2528SPQLB3 tag=WX3S5K096I26 type=write size=2467638 2024-09-12T17:28:55.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.040+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~DOCB0FCTHCGF.0 size=122231 2024-09-12T17:28:55.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.043+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=DOCB0FCTHCGF tag=IGHOG0NXXJ1Y type=write size=1170807 2024-09-12T17:28:55.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.046+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~032Q3CXA14T6.0 size=176804 2024-09-12T17:28:55.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.046+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=032Q3CXA14T6 tag=AGS64MWF5PJK type=write size=1225380 2024-09-12T17:28:55.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.047+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~B7NEGR8BB03A.0 size=1048576 2024-09-12T17:28:55.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.048+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~B7NEGR8BB03A.1 size=1048576 2024-09-12T17:28:55.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.049+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~B7NEGR8BB03A.2 size=967936 2024-09-12T17:28:55.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.052+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=B7NEGR8BB03A tag=USF7H99ASXWT type=write size=4113664 2024-09-12T17:28:55.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.055+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~LZUIA35MENH6.0 size=1048576 2024-09-12T17:28:55.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.056+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~LZUIA35MENH6.1 size=1048576 2024-09-12T17:28:55.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.057+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~LZUIA35MENH6.2 size=86588 2024-09-12T17:28:55.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.057+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=LZUIA35MENH6 tag=IIZ5AS5C44UN type=write size=3232316 2024-09-12T17:28:55.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.058+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~HZVGIWX77SNE.0 size=898333 2024-09-12T17:28:55.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.060+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=HZVGIWX77SNE tag=1SYZ3K3BPK7J type=write size=1946909 2024-09-12T17:28:55.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.063+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~U6UUBB8QJ6CM.0 size=1048576 2024-09-12T17:28:55.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.064+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~U6UUBB8QJ6CM.1 size=353067 2024-09-12T17:28:55.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.064+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=U6UUBB8QJ6CM tag=XU60YL700ZRG type=write size=2450219 2024-09-12T17:28:55.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.066+0000 7f9d7bc0c780 1 < canceled operation key=J3YYRIVKQ5AU tag=HAIVL3L4DX9F type=del size=167818 2024-09-12T17:28:55.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.067+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=IE1Q1LANWIL4 type=del size=3038561 2024-09-12T17:28:55.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.069+0000 7f9d7bc0c780 1 < canceled operation key=58C4SS3TN12K tag=XS1Z3K2UGPJ0 type=del size=1114120 2024-09-12T17:28:55.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.070+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=H3D60NKLHW73 type=write size=804239 2024-09-12T17:28:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.072+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=9YPT8UOM9SJS type=del 2024-09-12T17:28:55.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.073+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=4887R6M9OFJ9 type=del size=1178875 2024-09-12T17:28:55.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.075+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=616I2BH0DE3R type=del 2024-09-12T17:28:55.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.077+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~WW5800M6MMKC.0 size=1048576 2024-09-12T17:28:55.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.079+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~WW5800M6MMKC.1 size=1048576 2024-09-12T17:28:55.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.080+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~WW5800M6MMKC.2 size=800566 2024-09-12T17:28:55.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.080+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=WW5800M6MMKC tag=XR0KJMLTUL8J type=write size=3946294 2024-09-12T17:28:55.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.081+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~S2LX93WMTU1Y.0 size=1048576 2024-09-12T17:28:55.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.083+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~S2LX93WMTU1Y.1 size=1048576 2024-09-12T17:28:55.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.084+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~S2LX93WMTU1Y.2 size=132023 2024-09-12T17:28:55.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.086+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=S2LX93WMTU1Y tag=VDEXOGQ85ID3 type=write size=3277751 2024-09-12T17:28:55.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.089+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~LUE6RDDBOCZ6.0 size=1048576 2024-09-12T17:28:55.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.090+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~LUE6RDDBOCZ6.1 size=594805 2024-09-12T17:28:55.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.090+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=LUE6RDDBOCZ6 tag=LFTDXJJ2WT7R type=write size=2691957 2024-09-12T17:28:55.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.091+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=59VUPXXIF3G1 type=del 2024-09-12T17:28:55.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.093+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=XW0EMOX0WD95 type=del size=3008748 2024-09-12T17:28:55.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.094+0000 7f9d7bc0c780 1 < completed write operation key=9TE5N5TIB7AD tag=X11J6FHH3X9D type=write size=844949 2024-09-12T17:28:55.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.096+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=952WFG2QQ5IF type=write size=333307 2024-09-12T17:28:55.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.098+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~SB4RRWUJ563M.0 size=1048576 2024-09-12T17:28:55.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.099+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~SB4RRWUJ563M.1 size=1048576 2024-09-12T17:28:55.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.100+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~SB4RRWUJ563M.2 size=1013326 2024-09-12T17:28:55.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.102+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=SB4RRWUJ563M tag=UYLK9N9HXO50 type=write size=4159054 2024-09-12T17:28:55.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.105+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~BCQW35GYSPTS.0 size=1048576 2024-09-12T17:28:55.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.106+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~BCQW35GYSPTS.1 size=852975 2024-09-12T17:28:55.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.106+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=BCQW35GYSPTS tag=0DQG1GZLF2S0 type=write size=2950127 2024-09-12T17:28:55.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.108+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~0LYHOJJSWZ05.0 size=1048576 2024-09-12T17:28:55.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.109+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~0LYHOJJSWZ05.1 size=1048576 2024-09-12T17:28:55.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.110+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~0LYHOJJSWZ05.2 size=806915 2024-09-12T17:28:55.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.113+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=0LYHOJJSWZ05 tag=HSTGUYU1U18S type=write size=3952643 2024-09-12T17:28:55.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.115+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~DO8FCUQP2I7X.0 size=1048576 2024-09-12T17:28:55.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.117+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~DO8FCUQP2I7X.1 size=109008 2024-09-12T17:28:55.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.117+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=DO8FCUQP2I7X tag=91QUKH2KFML3 type=write size=2206160 2024-09-12T17:28:55.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.118+0000 7f9d7bc0c780 1 < canceled operation key=SDX69F30A2RK tag=AM5JOKUKDIJK type=write size=666505 2024-09-12T17:28:55.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.120+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=J8DAF77IEPPS type=del size=2263812 2024-09-12T17:28:55.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.121+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=CZI39SGMC2NG type=del 2024-09-12T17:28:55.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.123+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=ISNXEEJQ3B01 type=del size=2671522 2024-09-12T17:28:55.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.126+0000 7f9d7bc0c780 1 < suggested update operation key=0BYGD7FTPQF3 tag=8L76MHKP3L59 type=del size=1353871 2024-09-12T17:28:55.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.127+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=PV8Q7MM3M5C5 type=del size=3978476 2024-09-12T17:28:55.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.128+0000 7f9d7bc0c780 1 < canceled part key=_multipart_5B96YH46VAK3.2~AY2528SPQLB3.0 size=1048576 2024-09-12T17:28:55.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.129+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~AY2528SPQLB3.1 size=370486 2024-09-12T17:28:55.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.131+0000 7f9d7bc0c780 1 < canceled multipart upload key=5B96YH46VAK3 upload=AY2528SPQLB3 tag=WX3S5K096I26 type=write size=2467638 2024-09-12T17:28:55.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.133+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=1KIO5QTMLJ51 type=del size=3912847 2024-09-12T17:28:55.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.134+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~032Q3CXA14T6.0 size=176804 2024-09-12T17:28:55.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.136+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=032Q3CXA14T6 tag=AGS64MWF5PJK type=write size=1225380 2024-09-12T17:28:55.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.139+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~3OQ4RXSFMJW6.0 size=985586 2024-09-12T17:28:55.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.139+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=3OQ4RXSFMJW6 tag=4SCVQIL373RP type=write size=2034162 2024-09-12T17:28:55.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.141+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~LZUIA35MENH6.0 size=1048576 2024-09-12T17:28:55.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.142+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~LZUIA35MENH6.1 size=1048576 2024-09-12T17:28:55.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.142+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~LZUIA35MENH6.2 size=86588 2024-09-12T17:28:55.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.144+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=LZUIA35MENH6 tag=IIZ5AS5C44UN type=write size=3232316 2024-09-12T17:28:55.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.147+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~UWFENL24KGPT.0 size=1005232 2024-09-12T17:28:55.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.147+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=UWFENL24KGPT tag=4Z7LVWETELT3 type=write size=2053808 2024-09-12T17:28:55.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.148+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~U6UUBB8QJ6CM.0 size=1048576 2024-09-12T17:28:55.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.149+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~U6UUBB8QJ6CM.1 size=353067 2024-09-12T17:28:55.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.152+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=U6UUBB8QJ6CM tag=XU60YL700ZRG type=write size=2450219 2024-09-12T17:28:55.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.153+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=2SWWW6HOHGHM type=del size=3979646 2024-09-12T17:28:55.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.155+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=IE1Q1LANWIL4 type=del 2024-09-12T17:28:55.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.157+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=H3WSSII6V61H type=del size=2233587 2024-09-12T17:28:55.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.158+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=H3D60NKLHW73 type=write size=804239 2024-09-12T17:28:55.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.159+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=06BHTIZOQCOA type=write size=550192 2024-09-12T17:28:55.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.161+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=4887R6M9OFJ9 type=del 2024-09-12T17:28:55.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.163+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=ZBW08J3BR6AW type=del size=3899374 2024-09-12T17:28:55.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.164+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~WW5800M6MMKC.0 size=1048576 2024-09-12T17:28:55.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.165+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~WW5800M6MMKC.1 size=1048576 2024-09-12T17:28:55.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.166+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~WW5800M6MMKC.2 size=800566 2024-09-12T17:28:55.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.168+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=WW5800M6MMKC tag=XR0KJMLTUL8J type=write size=3946294 2024-09-12T17:28:55.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.171+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~15PKHAEQHDMQ.0 size=744580 2024-09-12T17:28:55.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.171+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=15PKHAEQHDMQ tag=E37HSOWGD7E8 type=write size=1793156 2024-09-12T17:28:55.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.173+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~LUE6RDDBOCZ6.0 size=1048576 2024-09-12T17:28:55.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.174+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~LUE6RDDBOCZ6.1 size=594805 2024-09-12T17:28:55.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.176+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=LUE6RDDBOCZ6 tag=LFTDXJJ2WT7R type=write size=2691957 2024-09-12T17:28:55.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.178+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~U3ROAP7SCQ8O.0 size=1048576 2024-09-12T17:28:55.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.179+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~U3ROAP7SCQ8O.1 size=1048576 2024-09-12T17:28:55.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.181+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~U3ROAP7SCQ8O.2 size=401526 2024-09-12T17:28:55.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.181+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=U3ROAP7SCQ8O tag=HV0R5GFK6US4 type=write size=3547254 2024-09-12T17:28:55.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.182+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=XW0EMOX0WD95 type=del 2024-09-12T17:28:55.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.183+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=COZYBZHWZOIA type=del size=2728678 2024-09-12T17:28:55.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.185+0000 7f9d7bc0c780 1 < completed write operation key=NQ0768B94GVV tag=952WFG2QQ5IF type=write size=333307 2024-09-12T17:28:55.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.188+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~2IDS91DC3X2L.0 size=1048576 2024-09-12T17:28:55.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.189+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~2IDS91DC3X2L.1 size=794934 2024-09-12T17:28:55.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.189+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=2IDS91DC3X2L tag=GDW184MWOXW0 type=write size=2892086 2024-09-12T17:28:55.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.190+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~BCQW35GYSPTS.0 size=1048576 2024-09-12T17:28:55.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.191+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~BCQW35GYSPTS.1 size=852975 2024-09-12T17:28:55.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.196+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=BCQW35GYSPTS tag=0DQG1GZLF2S0 type=write size=2950127 2024-09-12T17:28:55.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.197+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=UM0924EWWK5X type=del size=3887684 2024-09-12T17:28:55.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.198+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~DO8FCUQP2I7X.0 size=1048576 2024-09-12T17:28:55.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.198+0000 7f9d7bc0c780 1 < canceled part key=_multipart_58C4SS3TN12K.2~DO8FCUQP2I7X.1 size=109008 2024-09-12T17:28:55.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.201+0000 7f9d7bc0c780 1 < canceled multipart upload key=58C4SS3TN12K upload=DO8FCUQP2I7X tag=91QUKH2KFML3 type=write size=2206160 2024-09-12T17:28:55.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.202+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=W3ZTBTM3QOFN type=del size=1489095 2024-09-12T17:28:55.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.205+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=J8DAF77IEPPS type=del 2024-09-12T17:28:55.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.206+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=7PKTU0N7U2Z4 type=write size=547984 2024-09-12T17:28:55.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.207+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=ISNXEEJQ3B01 type=del 2024-09-12T17:28:55.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.210+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=JTGFA53SABFL type=write size=659882 2024-09-12T17:28:55.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.211+0000 7f9d7bc0c780 1 < canceled operation key=EUHRVHNVI83I tag=PV8Q7MM3M5C5 type=del size=3978476 2024-09-12T17:28:55.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.213+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=6F3329KHYF77 type=del size=2593943 2024-09-12T17:28:55.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.214+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=1KIO5QTMLJ51 type=del 2024-09-12T17:28:55.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.216+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=PI5XC19R53VU type=del size=825747 2024-09-12T17:28:55.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.217+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~3OQ4RXSFMJW6.0 size=985586 2024-09-12T17:28:55.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.219+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=3OQ4RXSFMJW6 tag=4SCVQIL373RP type=write size=2034162 2024-09-12T17:28:55.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.221+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~B8KR88IH0NDW.0 size=244914 2024-09-12T17:28:55.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.221+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=B8KR88IH0NDW tag=1KBZL7J7RUUW type=write size=1293490 2024-09-12T17:28:55.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.222+0000 7f9d7bc0c780 1 < canceled part key=_multipart_QB8C0OJA1L4X.2~UWFENL24KGPT.0 size=1005232 2024-09-12T17:28:55.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.224+0000 7f9d7bc0c780 1 < canceled multipart upload key=QB8C0OJA1L4X upload=UWFENL24KGPT tag=4Z7LVWETELT3 type=write size=2053808 2024-09-12T17:28:55.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.226+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~244WPJ7OZ8BY.0 size=1048576 2024-09-12T17:28:55.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.227+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~244WPJ7OZ8BY.1 size=1048576 2024-09-12T17:28:55.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.229+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~244WPJ7OZ8BY.2 size=938984 2024-09-12T17:28:55.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.229+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=244WPJ7OZ8BY tag=3HVOIJEOLE0R type=write size=4084712 2024-09-12T17:28:55.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.230+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=2SWWW6HOHGHM type=del 2024-09-12T17:28:55.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.232+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~S2OWD4WI2K4D.0 size=451499 2024-09-12T17:28:55.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.232+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=S2OWD4WI2K4D tag=Q7US2LLPGOQ1 type=write size=1500075 2024-09-12T17:28:55.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.235+0000 7f9d7bc0c780 1 < suggested remove operation key=LTG0UQEYPUGO tag=H3WSSII6V61H type=del 2024-09-12T17:28:55.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.237+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=8MSQ66CZY58E type=write size=1001473 2024-09-12T17:28:55.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.239+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=06BHTIZOQCOA type=write size=550192 2024-09-12T17:28:55.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.241+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=EQVGEQOWJ0W2 type=del size=3526613 2024-09-12T17:28:55.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.242+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=ZBW08J3BR6AW type=del 2024-09-12T17:28:55.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.243+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=6XZPIVDKIDXX type=del size=3784108 2024-09-12T17:28:55.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.245+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~15PKHAEQHDMQ.0 size=744580 2024-09-12T17:28:55.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.247+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=15PKHAEQHDMQ tag=E37HSOWGD7E8 type=write size=1793156 2024-09-12T17:28:55.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.250+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~HAE62PNX5VT4.0 size=1048576 2024-09-12T17:28:55.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.251+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~HAE62PNX5VT4.1 size=1048576 2024-09-12T17:28:55.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.252+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~HAE62PNX5VT4.2 size=854529 2024-09-12T17:28:55.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.252+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=HAE62PNX5VT4 tag=2YCYIBLVJ270 type=write size=4000257 2024-09-12T17:28:55.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.254+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~U3ROAP7SCQ8O.0 size=1048576 2024-09-12T17:28:55.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.255+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~U3ROAP7SCQ8O.1 size=1048576 2024-09-12T17:28:55.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.256+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~U3ROAP7SCQ8O.2 size=401526 2024-09-12T17:28:55.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.259+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=U3ROAP7SCQ8O tag=HV0R5GFK6US4 type=write size=3547254 2024-09-12T17:28:55.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.261+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~9NXB47ATUUUE.0 size=1048576 2024-09-12T17:28:55.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.263+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~9NXB47ATUUUE.1 size=1048576 2024-09-12T17:28:55.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.264+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~9NXB47ATUUUE.2 size=470255 2024-09-12T17:28:55.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.264+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=9NXB47ATUUUE tag=LFIWW3WI0WT4 type=write size=3615983 2024-09-12T17:28:55.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.265+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=COZYBZHWZOIA type=del 2024-09-12T17:28:55.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.267+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=UKRX81MV4JDQ type=del size=527782 2024-09-12T17:28:55.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.269+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~2IDS91DC3X2L.0 size=1048576 2024-09-12T17:28:55.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.270+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~2IDS91DC3X2L.1 size=794934 2024-09-12T17:28:55.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.272+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=2IDS91DC3X2L tag=GDW184MWOXW0 type=write size=2892086 2024-09-12T17:28:55.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.275+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~B98DWQ7B7L80.0 size=1048576 2024-09-12T17:28:55.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.276+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~B98DWQ7B7L80.1 size=976329 2024-09-12T17:28:55.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.276+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=B98DWQ7B7L80 tag=1GVHRVEYLFA7 type=write size=3073481 2024-09-12T17:28:55.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.277+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=UM0924EWWK5X type=del 2024-09-12T17:28:55.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.278+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=NUGQ3ZEMTNUQ type=write size=774792 2024-09-12T17:28:55.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.280+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=W3ZTBTM3QOFN type=del 2024-09-12T17:28:55.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.282+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~YQ3RULTX8ZUR.0 size=338655 2024-09-12T17:28:55.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.282+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=YQ3RULTX8ZUR tag=JOYR65DP3RW4 type=write size=1387231 2024-09-12T17:28:55.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.284+0000 7f9d7bc0c780 1 < completed write operation key=LJZNPSVLS9AF tag=7PKTU0N7U2Z4 type=write size=547984 2024-09-12T17:28:55.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.285+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=S9GS29ZPT12O type=write size=743560 2024-09-12T17:28:55.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.286+0000 7f9d7bc0c780 1 < completed write operation key=R94VERREGANN tag=JTGFA53SABFL type=write size=659882 2024-09-12T17:28:55.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.288+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=LI1MK5MKT4U6 type=write size=987615 2024-09-12T17:28:55.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.289+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=6F3329KHYF77 type=del 2024-09-12T17:28:55.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.290+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=51ZD7FPOTD6P type=del size=1355357 2024-09-12T17:28:55.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.292+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=PI5XC19R53VU type=del 2024-09-12T17:28:55.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.294+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~6U96NHJ0UF5D.0 size=1048576 2024-09-12T17:28:55.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.295+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~6U96NHJ0UF5D.1 size=1048576 2024-09-12T17:28:55.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.296+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~6U96NHJ0UF5D.2 size=624174 2024-09-12T17:28:55.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.296+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=6U96NHJ0UF5D tag=BI2V5PIH3JOG type=write size=3769902 2024-09-12T17:28:55.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.298+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~B8KR88IH0NDW.0 size=244914 2024-09-12T17:28:55.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.300+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=B8KR88IH0NDW tag=1KBZL7J7RUUW type=write size=1293490 2024-09-12T17:28:55.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.302+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=5GIQRW1F5H4X type=del size=2733486 2024-09-12T17:28:55.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.303+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~244WPJ7OZ8BY.0 size=1048576 2024-09-12T17:28:55.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.306+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~244WPJ7OZ8BY.1 size=1048576 2024-09-12T17:28:55.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.307+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~244WPJ7OZ8BY.2 size=938984 2024-09-12T17:28:55.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.309+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=244WPJ7OZ8BY tag=3HVOIJEOLE0R type=write size=4084712 2024-09-12T17:28:55.311 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.310+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=WBS10QP1S67K type=del size=2601200 2024-09-12T17:28:55.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.312+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~S2OWD4WI2K4D.0 size=451499 2024-09-12T17:28:55.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.314+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=S2OWD4WI2K4D tag=Q7US2LLPGOQ1 type=write size=1500075 2024-09-12T17:28:55.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.316+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=16ZPE2NL9828 type=del size=885583 2024-09-12T17:28:55.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.317+0000 7f9d7bc0c780 1 < completed write operation key=LU8MLGM7H0CE tag=8MSQ66CZY58E type=write size=1001473 2024-09-12T17:28:55.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.319+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=DMK5R92W1Z4H type=write size=463520 2024-09-12T17:28:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.320+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=EQVGEQOWJ0W2 type=del 2024-09-12T17:28:55.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.321+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=31OC6GSIYJNE type=del size=2470165 2024-09-12T17:28:55.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.323+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=6XZPIVDKIDXX type=del 2024-09-12T17:28:55.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.324+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=0N77T4UT3XQJ type=del size=2201825 2024-09-12T17:28:55.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.326+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~HAE62PNX5VT4.0 size=1048576 2024-09-12T17:28:55.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.327+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~HAE62PNX5VT4.1 size=1048576 2024-09-12T17:28:55.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.329+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~HAE62PNX5VT4.2 size=854529 2024-09-12T17:28:55.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.331+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=HAE62PNX5VT4 tag=2YCYIBLVJ270 type=write size=4000257 2024-09-12T17:28:55.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.332+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=PA5SKBLK5V4L type=del size=1283156 2024-09-12T17:28:55.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.334+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~9NXB47ATUUUE.0 size=1048576 2024-09-12T17:28:55.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.335+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~9NXB47ATUUUE.1 size=1048576 2024-09-12T17:28:55.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.337+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~9NXB47ATUUUE.2 size=470255 2024-09-12T17:28:55.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.339+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=9NXB47ATUUUE tag=LFIWW3WI0WT4 type=write size=3615983 2024-09-12T17:28:55.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.341+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~XWM3R8U8D5XX.0 size=515284 2024-09-12T17:28:55.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.341+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=XWM3R8U8D5XX tag=LWYR99ZAWBQE type=write size=1563860 2024-09-12T17:28:55.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.343+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=UKRX81MV4JDQ type=del 2024-09-12T17:28:55.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.346+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~T10MZ1OT6LFX.0 size=556978 2024-09-12T17:28:55.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.346+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=T10MZ1OT6LFX tag=L2631NAMNC46 type=write size=1605554 2024-09-12T17:28:55.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.346+0000 7f9d7bc0c780 1 < canceled part key=_multipart_SDX69F30A2RK.2~B98DWQ7B7L80.0 size=1048576 2024-09-12T17:28:55.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.347+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~B98DWQ7B7L80.1 size=976329 2024-09-12T17:28:55.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.349+0000 7f9d7bc0c780 1 < canceled multipart upload key=SDX69F30A2RK upload=B98DWQ7B7L80 tag=1GVHRVEYLFA7 type=write size=3073481 2024-09-12T17:28:55.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.351+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=YO4K48PBT4IO type=del size=1549568 2024-09-12T17:28:55.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.354+0000 7f9d7bc0c780 1 < suggested update operation key=FU7ARIH2X839 tag=NUGQ3ZEMTNUQ type=write size=774792 2024-09-12T17:28:55.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.355+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=89JT8ZPGXUXX type=del size=2952001 2024-09-12T17:28:55.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.357+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~YQ3RULTX8ZUR.0 size=338655 2024-09-12T17:28:55.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.359+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=YQ3RULTX8ZUR tag=JOYR65DP3RW4 type=write size=1387231 2024-09-12T17:28:55.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.362+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~FK9D3QT246XL.0 size=1048576 2024-09-12T17:28:55.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.363+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~FK9D3QT246XL.1 size=1048576 2024-09-12T17:28:55.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.364+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~FK9D3QT246XL.2 size=234067 2024-09-12T17:28:55.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.364+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=FK9D3QT246XL tag=9IPR510U5NLC type=write size=3379795 2024-09-12T17:28:55.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.365+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=S9GS29ZPT12O type=write size=743560 2024-09-12T17:28:55.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.367+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=UCKA4ID80TTX type=write size=213525 2024-09-12T17:28:55.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.368+0000 7f9d7bc0c780 1 < completed write operation key=LTG0UQEYPUGO tag=LI1MK5MKT4U6 type=write size=987615 2024-09-12T17:28:55.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.369+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=Q7EEOVQ8SY8S type=del size=3585685 2024-09-12T17:28:55.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.372+0000 7f9d7bc0c780 1 < suggested update operation key=R94VERREGANN tag=51ZD7FPOTD6P type=del size=1355357 2024-09-12T17:28:55.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.374+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=ISEF1RF10ZAJ type=del size=1643420 2024-09-12T17:28:55.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.375+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~6U96NHJ0UF5D.0 size=1048576 2024-09-12T17:28:55.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.376+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~6U96NHJ0UF5D.1 size=1048576 2024-09-12T17:28:55.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.377+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~6U96NHJ0UF5D.2 size=624174 2024-09-12T17:28:55.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.380+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=6U96NHJ0UF5D tag=BI2V5PIH3JOG type=write size=3769902 2024-09-12T17:28:55.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.383+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~PBPMLADZ2J40.0 size=1048576 2024-09-12T17:28:55.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.384+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~PBPMLADZ2J40.1 size=1048576 2024-09-12T17:28:55.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.385+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~PBPMLADZ2J40.2 size=981872 2024-09-12T17:28:55.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.385+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=PBPMLADZ2J40 tag=7TBDUUZVV2BW type=write size=4127600 2024-09-12T17:28:55.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.387+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=5GIQRW1F5H4X type=del 2024-09-12T17:28:55.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.388+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=FDRSE8S1CAFH type=write size=956270 2024-09-12T17:28:55.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.390+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=WBS10QP1S67K type=del 2024-09-12T17:28:55.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.391+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=Y2E1RMIOQZCT type=del size=664378 2024-09-12T17:28:55.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.393+0000 7f9d7bc0c780 1 < canceled operation key=4V2IYJRP2PZI tag=16ZPE2NL9828 type=del size=885583 2024-09-12T17:28:55.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.394+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=8JXI4IF8WA6I type=del size=3613981 2024-09-12T17:28:55.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.395+0000 7f9d7bc0c780 1 < completed write operation key=X7J78IOJR0HA tag=DMK5R92W1Z4H type=write size=463520 2024-09-12T17:28:55.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.398+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~BOWC5O5V5PE4.0 size=514322 2024-09-12T17:28:55.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.398+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=BOWC5O5V5PE4 tag=DBQZN0NZFYYP type=write size=1562898 2024-09-12T17:28:55.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.399+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=31OC6GSIYJNE type=del 2024-09-12T17:28:55.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.402+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~SNIWJIX1D9W6.0 size=563322 2024-09-12T17:28:55.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.402+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=SNIWJIX1D9W6 tag=FN0MNPVS0OBF type=write size=1611898 2024-09-12T17:28:55.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.403+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=0N77T4UT3XQJ type=del 2024-09-12T17:28:55.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.405+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=TC734S81G2N7 type=write size=945548 2024-09-12T17:28:55.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.406+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=PA5SKBLK5V4L type=del 2024-09-12T17:28:55.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.407+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=XEAAA75R3RRF type=del size=140627 2024-09-12T17:28:55.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.409+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~XWM3R8U8D5XX.0 size=515284 2024-09-12T17:28:55.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.411+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=XWM3R8U8D5XX tag=LWYR99ZAWBQE type=write size=1563860 2024-09-12T17:28:55.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.413+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~I92Y8OG4RO7J.0 size=1048576 2024-09-12T17:28:55.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.415+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~I92Y8OG4RO7J.1 size=1048576 2024-09-12T17:28:55.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.416+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~I92Y8OG4RO7J.2 size=611256 2024-09-12T17:28:55.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.416+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=I92Y8OG4RO7J tag=6OSJIY7R3KN6 type=write size=3756984 2024-09-12T17:28:55.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.417+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~T10MZ1OT6LFX.0 size=556978 2024-09-12T17:28:55.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.420+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=T10MZ1OT6LFX tag=L2631NAMNC46 type=write size=1605554 2024-09-12T17:28:55.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.421+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=S0GJDFAJNPH4 type=del size=229111 2024-09-12T17:28:55.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.424+0000 7f9d7bc0c780 1 < suggested remove operation key=NQ0768B94GVV tag=YO4K48PBT4IO type=del 2024-09-12T17:28:55.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.427+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~40B6VPGY7IPT.0 size=569463 2024-09-12T17:28:55.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.427+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=40B6VPGY7IPT tag=9O4KIW6QFLX5 type=write size=1618039 2024-09-12T17:28:55.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.428+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=89JT8ZPGXUXX type=del 2024-09-12T17:28:55.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.430+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=M2GTHTUQC270 type=del size=194108 2024-09-12T17:28:55.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.431+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~FK9D3QT246XL.0 size=1048576 2024-09-12T17:28:55.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.432+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~FK9D3QT246XL.1 size=1048576 2024-09-12T17:28:55.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.434+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~FK9D3QT246XL.2 size=234067 2024-09-12T17:28:55.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.436+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=FK9D3QT246XL tag=9IPR510U5NLC type=write size=3379795 2024-09-12T17:28:55.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.440+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~FIMPIUEKDGFU.0 size=1048576 2024-09-12T17:28:55.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.443+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~FIMPIUEKDGFU.1 size=354043 2024-09-12T17:28:55.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.443+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=FIMPIUEKDGFU tag=EOUV8P9T3MD0 type=write size=2451195 2024-09-12T17:28:55.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.444+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=UCKA4ID80TTX type=write size=213525 2024-09-12T17:28:55.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.446+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=GCCLTFZ85NUU type=del size=3234177 2024-09-12T17:28:55.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.447+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=Q7EEOVQ8SY8S type=del 2024-09-12T17:28:55.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.449+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=3NOH729V2LUO type=del size=1526489 2024-09-12T17:28:55.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.450+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=ISEF1RF10ZAJ type=del 2024-09-12T17:28:55.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.453+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~86OZD76EHXP2.0 size=1048576 2024-09-12T17:28:55.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.454+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~86OZD76EHXP2.1 size=1048576 2024-09-12T17:28:55.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.455+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~86OZD76EHXP2.2 size=187568 2024-09-12T17:28:55.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.455+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=86OZD76EHXP2 tag=33W61RTHJJQ2 type=write size=3333296 2024-09-12T17:28:55.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.457+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~PBPMLADZ2J40.0 size=1048576 2024-09-12T17:28:55.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.458+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~PBPMLADZ2J40.1 size=1048576 2024-09-12T17:28:55.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.459+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~PBPMLADZ2J40.2 size=981872 2024-09-12T17:28:55.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.461+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=PBPMLADZ2J40 tag=7TBDUUZVV2BW type=write size=4127600 2024-09-12T17:28:55.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.465+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~ADRM8EXIUQYT.0 size=1048576 2024-09-12T17:28:55.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.467+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~ADRM8EXIUQYT.1 size=1048576 2024-09-12T17:28:55.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.468+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~ADRM8EXIUQYT.2 size=279320 2024-09-12T17:28:55.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.468+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=ADRM8EXIUQYT tag=7GZK3INI7AQM type=write size=3425048 2024-09-12T17:28:55.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.469+0000 7f9d7bc0c780 1 < completed write operation key=31PU0U6IEAV2 tag=FDRSE8S1CAFH type=write size=956270 2024-09-12T17:28:55.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.472+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~P8ARTK3BMAY3.0 size=1048576 2024-09-12T17:28:55.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.473+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~P8ARTK3BMAY3.1 size=1048576 2024-09-12T17:28:55.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.474+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~P8ARTK3BMAY3.2 size=908487 2024-09-12T17:28:55.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.474+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=P8ARTK3BMAY3 tag=KN4DDPESB2ZK type=write size=4054215 2024-09-12T17:28:55.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.476+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=Y2E1RMIOQZCT type=del 2024-09-12T17:28:55.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.477+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=ZSY57HD4K6LY type=del size=329499 2024-09-12T17:28:55.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.479+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=8JXI4IF8WA6I type=del 2024-09-12T17:28:55.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.481+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~UT0AWOS2L81Y.0 size=608238 2024-09-12T17:28:55.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.481+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=UT0AWOS2L81Y tag=HGI80JH2X49E type=write size=1656814 2024-09-12T17:28:55.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.481+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J7MREXK6R3C4.2~BOWC5O5V5PE4.0 size=514322 2024-09-12T17:28:55.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.484+0000 7f9d7bc0c780 1 < canceled multipart upload key=J7MREXK6R3C4 upload=BOWC5O5V5PE4 tag=DBQZN0NZFYYP type=write size=1562898 2024-09-12T17:28:55.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.485+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=OL9Z3VZX74EM type=del size=3791684 2024-09-12T17:28:55.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.487+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~SNIWJIX1D9W6.0 size=563322 2024-09-12T17:28:55.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.489+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=SNIWJIX1D9W6 tag=FN0MNPVS0OBF type=write size=1611898 2024-09-12T17:28:55.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.491+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=PSXM4RXDJRLY type=write size=113393 2024-09-12T17:28:55.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.492+0000 7f9d7bc0c780 1 < completed write operation key=ZM8NMC18RN3I tag=TC734S81G2N7 type=write size=945548 2024-09-12T17:28:55.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.495+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~J605F6VIXVZG.0 size=602856 2024-09-12T17:28:55.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.495+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=J605F6VIXVZG tag=Y1XXEF36WZKY type=write size=1651432 2024-09-12T17:28:55.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.496+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=XEAAA75R3RRF type=del 2024-09-12T17:28:55.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.499+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~NC45HFGAGZU6.0 size=1048576 2024-09-12T17:28:55.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.500+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~NC45HFGAGZU6.1 size=1048576 2024-09-12T17:28:55.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.501+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~NC45HFGAGZU6.2 size=998918 2024-09-12T17:28:55.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.501+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=NC45HFGAGZU6 tag=3E5C0LCEZ4IP type=write size=4144646 2024-09-12T17:28:55.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.502+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~I92Y8OG4RO7J.0 size=1048576 2024-09-12T17:28:55.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.503+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~I92Y8OG4RO7J.1 size=1048576 2024-09-12T17:28:55.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.505+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~I92Y8OG4RO7J.2 size=611256 2024-09-12T17:28:55.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.507+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=I92Y8OG4RO7J tag=6OSJIY7R3KN6 type=write size=3756984 2024-09-12T17:28:55.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.509+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~910S9YLU3S3H.0 size=1048576 2024-09-12T17:28:55.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.511+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~910S9YLU3S3H.1 size=1048576 2024-09-12T17:28:55.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.512+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~910S9YLU3S3H.2 size=133835 2024-09-12T17:28:55.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.512+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=910S9YLU3S3H tag=69K2IV0XQMYG type=write size=3279563 2024-09-12T17:28:55.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.513+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=S0GJDFAJNPH4 type=del 2024-09-12T17:28:55.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.515+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=WDLLEEFAYPI4 type=write size=966312 2024-09-12T17:28:55.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.516+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~40B6VPGY7IPT.0 size=569463 2024-09-12T17:28:55.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.519+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=40B6VPGY7IPT tag=9O4KIW6QFLX5 type=write size=1618039 2024-09-12T17:28:55.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.522+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~CTVM7L8M6ZU7.0 size=256402 2024-09-12T17:28:55.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.522+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=CTVM7L8M6ZU7 tag=SZVK08RB69P5 type=write size=1304978 2024-09-12T17:28:55.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.524+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=M2GTHTUQC270 type=del 2024-09-12T17:28:55.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.526+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=4D0MTADB3T32 type=del size=1864127 2024-09-12T17:28:55.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.527+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~FIMPIUEKDGFU.0 size=1048576 2024-09-12T17:28:55.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.529+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~FIMPIUEKDGFU.1 size=354043 2024-09-12T17:28:55.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.531+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=FIMPIUEKDGFU tag=EOUV8P9T3MD0 type=write size=2451195 2024-09-12T17:28:55.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.533+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=U5FBN7TT2SLZ type=del size=2719859 2024-09-12T17:28:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.534+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=GCCLTFZ85NUU type=del 2024-09-12T17:28:55.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.537+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~KMW2BXLG9FS6.0 size=1048576 2024-09-12T17:28:55.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.538+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~KMW2BXLG9FS6.1 size=1044159 2024-09-12T17:28:55.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.538+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=KMW2BXLG9FS6 tag=2OXUF536UMCP type=write size=3141311 2024-09-12T17:28:55.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.540+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=3NOH729V2LUO type=del 2024-09-12T17:28:55.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.542+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~0EJLXRALSOWG.0 size=252203 2024-09-12T17:28:55.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.542+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=0EJLXRALSOWG tag=H4HW9J3DHSJZ type=write size=1300779 2024-09-12T17:28:55.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.544+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~86OZD76EHXP2.0 size=1048576 2024-09-12T17:28:55.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.545+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~86OZD76EHXP2.1 size=1048576 2024-09-12T17:28:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.546+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~86OZD76EHXP2.2 size=187568 2024-09-12T17:28:55.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.548+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=86OZD76EHXP2 tag=33W61RTHJJQ2 type=write size=3333296 2024-09-12T17:28:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.550+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=LACXTE2H921W type=del size=1935857 2024-09-12T17:28:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.550+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~ADRM8EXIUQYT.0 size=1048576 2024-09-12T17:28:55.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.551+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~ADRM8EXIUQYT.1 size=1048576 2024-09-12T17:28:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.552+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~ADRM8EXIUQYT.2 size=279320 2024-09-12T17:28:55.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.555+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=ADRM8EXIUQYT tag=7GZK3INI7AQM type=write size=3425048 2024-09-12T17:28:55.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.556+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=FLIB50LNSHBQ type=del size=3026283 2024-09-12T17:28:55.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.557+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~P8ARTK3BMAY3.0 size=1048576 2024-09-12T17:28:55.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.559+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~P8ARTK3BMAY3.1 size=1048576 2024-09-12T17:28:55.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.560+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~P8ARTK3BMAY3.2 size=908487 2024-09-12T17:28:55.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.562+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=P8ARTK3BMAY3 tag=KN4DDPESB2ZK type=write size=4054215 2024-09-12T17:28:55.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.564+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~BAVE83KUCHLW.0 size=1048576 2024-09-12T17:28:55.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.565+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~BAVE83KUCHLW.1 size=1048576 2024-09-12T17:28:55.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.567+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~BAVE83KUCHLW.2 size=308405 2024-09-12T17:28:55.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.567+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=BAVE83KUCHLW tag=APFOWH76LXGG type=write size=3454133 2024-09-12T17:28:55.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.568+0000 7f9d7bc0c780 1 < canceled operation key=M3Q7I7MD7M4I tag=ZSY57HD4K6LY type=del size=329499 2024-09-12T17:28:55.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.571+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~QQGMKY0C7UCE.0 size=1048576 2024-09-12T17:28:55.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.572+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~QQGMKY0C7UCE.1 size=1048576 2024-09-12T17:28:55.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.573+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~QQGMKY0C7UCE.2 size=148138 2024-09-12T17:28:55.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.573+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=QQGMKY0C7UCE tag=HNTLDARV2O4M type=write size=3293866 2024-09-12T17:28:55.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.573+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9TE5N5TIB7AD.2~UT0AWOS2L81Y.0 size=608238 2024-09-12T17:28:55.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.577+0000 7f9d7bc0c780 1 < canceled multipart upload key=9TE5N5TIB7AD upload=UT0AWOS2L81Y tag=HGI80JH2X49E type=write size=1656814 2024-09-12T17:28:55.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.580+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=P08M1YPTGTJT type=del size=2366742 2024-09-12T17:28:55.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.583+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=OL9Z3VZX74EM type=del 2024-09-12T17:28:55.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.584+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=UEYXVHS8DP3Q type=del size=1084235 2024-09-12T17:28:55.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.587+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=PSXM4RXDJRLY type=write size=113393 2024-09-12T17:28:55.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.590+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~1DODBM4TEEF1.0 size=1048576 2024-09-12T17:28:55.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.591+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~1DODBM4TEEF1.1 size=1048576 2024-09-12T17:28:55.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.592+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~1DODBM4TEEF1.2 size=518869 2024-09-12T17:28:55.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.592+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=1DODBM4TEEF1 tag=SXMOQ5HR40M4 type=write size=3664597 2024-09-12T17:28:55.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.593+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~J605F6VIXVZG.0 size=602856 2024-09-12T17:28:55.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.595+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=J605F6VIXVZG tag=Y1XXEF36WZKY type=write size=1651432 2024-09-12T17:28:55.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.597+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=AA075GMHGEFF type=write size=263239 2024-09-12T17:28:55.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.598+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~NC45HFGAGZU6.0 size=1048576 2024-09-12T17:28:55.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.599+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~NC45HFGAGZU6.1 size=1048576 2024-09-12T17:28:55.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.600+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~NC45HFGAGZU6.2 size=998918 2024-09-12T17:28:55.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.603+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=NC45HFGAGZU6 tag=3E5C0LCEZ4IP type=write size=4144646 2024-09-12T17:28:55.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.604+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=PHW2IO433NYY type=del size=3892576 2024-09-12T17:28:55.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.605+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~910S9YLU3S3H.0 size=1048576 2024-09-12T17:28:55.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.606+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~910S9YLU3S3H.1 size=1048576 2024-09-12T17:28:55.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.608+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~910S9YLU3S3H.2 size=133835 2024-09-12T17:28:55.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.610+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=910S9YLU3S3H tag=69K2IV0XQMYG type=write size=3279563 2024-09-12T17:28:55.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.612+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=NEL7L4R7A0XG type=del size=2457597 2024-09-12T17:28:55.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.613+0000 7f9d7bc0c780 1 < completed write operation key=LJZNPSVLS9AF tag=WDLLEEFAYPI4 type=write size=966312 2024-09-12T17:28:55.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.615+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=3NQDE4F7MRLN type=write size=942150 2024-09-12T17:28:55.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.616+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~CTVM7L8M6ZU7.0 size=256402 2024-09-12T17:28:55.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.619+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=CTVM7L8M6ZU7 tag=SZVK08RB69P5 type=write size=1304978 2024-09-12T17:28:55.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.620+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=LNSL5A9UBRBX type=del size=1346237 2024-09-12T17:28:55.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.622+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=4D0MTADB3T32 type=del 2024-09-12T17:28:55.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.623+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=4MI8YVTVONFM type=write size=992673 2024-09-12T17:28:55.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.624+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=U5FBN7TT2SLZ type=del 2024-09-12T17:28:55.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.626+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=WY6QJ3BK3MUU type=write size=102155 2024-09-12T17:28:55.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.627+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~KMW2BXLG9FS6.0 size=1048576 2024-09-12T17:28:55.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.629+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~KMW2BXLG9FS6.1 size=1044159 2024-09-12T17:28:55.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.631+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=KMW2BXLG9FS6 tag=2OXUF536UMCP type=write size=3141311 2024-09-12T17:28:55.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.633+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=N898WMCL8Y64 type=del size=854407 2024-09-12T17:28:55.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.633+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~0EJLXRALSOWG.0 size=252203 2024-09-12T17:28:55.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.635+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=0EJLXRALSOWG tag=H4HW9J3DHSJZ type=write size=1300779 2024-09-12T17:28:55.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.638+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~4LOE0N9R70S1.0 size=1048576 2024-09-12T17:28:55.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.639+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~4LOE0N9R70S1.1 size=1048576 2024-09-12T17:28:55.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.640+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~4LOE0N9R70S1.2 size=626339 2024-09-12T17:28:55.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.640+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=4LOE0N9R70S1 tag=P2ZKA9LSZP4M type=write size=3772067 2024-09-12T17:28:55.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.641+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=LACXTE2H921W type=del 2024-09-12T17:28:55.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.644+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~V0GGJJ5IG3EW.0 size=1048576 2024-09-12T17:28:55.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.645+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~V0GGJJ5IG3EW.1 size=1048576 2024-09-12T17:28:55.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.646+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~V0GGJJ5IG3EW.2 size=321910 2024-09-12T17:28:55.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.646+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=V0GGJJ5IG3EW tag=ONBCGM3E7461 type=write size=3467638 2024-09-12T17:28:55.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.647+0000 7f9d7bc0c780 1 < canceled operation key=31PU0U6IEAV2 tag=FLIB50LNSHBQ type=del size=3026283 2024-09-12T17:28:55.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.650+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~HGD22PSWB9CP.0 size=1048576 2024-09-12T17:28:55.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.651+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~HGD22PSWB9CP.1 size=1048576 2024-09-12T17:28:55.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.653+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~HGD22PSWB9CP.2 size=196260 2024-09-12T17:28:55.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.653+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=HGD22PSWB9CP tag=TQL4KQUG7LM9 type=write size=3341988 2024-09-12T17:28:55.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.654+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~BAVE83KUCHLW.0 size=1048576 2024-09-12T17:28:55.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.654+0000 7f9d7bc0c780 1 < canceled part key=_multipart_NQ0768B94GVV.2~BAVE83KUCHLW.1 size=1048576 2024-09-12T17:28:55.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.656+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~BAVE83KUCHLW.2 size=308405 2024-09-12T17:28:55.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.658+0000 7f9d7bc0c780 1 < canceled multipart upload key=NQ0768B94GVV upload=BAVE83KUCHLW tag=APFOWH76LXGG type=write size=3454133 2024-09-12T17:28:55.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.660+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~5R32CRP9VIIM.0 size=936274 2024-09-12T17:28:55.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.660+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=5R32CRP9VIIM tag=GXBMNSUF44SP type=write size=1984850 2024-09-12T17:28:55.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.662+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~QQGMKY0C7UCE.0 size=1048576 2024-09-12T17:28:55.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.663+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~QQGMKY0C7UCE.1 size=1048576 2024-09-12T17:28:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.664+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~QQGMKY0C7UCE.2 size=148138 2024-09-12T17:28:55.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.666+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=QQGMKY0C7UCE tag=HNTLDARV2O4M type=write size=3293866 2024-09-12T17:28:55.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.668+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=BMGVFPAMOABK type=del size=3038849 2024-09-12T17:28:55.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.671+0000 7f9d7bc0c780 1 < suggested update operation key=ZM8NMC18RN3I tag=P08M1YPTGTJT type=del size=2366742 2024-09-12T17:28:55.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.675+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~NU1BTRI2XO44.0 size=1048576 2024-09-12T17:28:55.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.677+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~NU1BTRI2XO44.1 size=1048576 2024-09-12T17:28:55.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.678+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~NU1BTRI2XO44.2 size=243105 2024-09-12T17:28:55.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.678+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=NU1BTRI2XO44 tag=TLCOAAJ5JLBS type=write size=3388833 2024-09-12T17:28:55.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.679+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=UEYXVHS8DP3Q type=del 2024-09-12T17:28:55.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.681+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=UIPWCUN64CG3 type=write size=632123 2024-09-12T17:28:55.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.681+0000 7f9d7bc0c780 1 < canceled part key=_multipart_64T291B0U226.2~1DODBM4TEEF1.0 size=1048576 2024-09-12T17:28:55.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.683+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~1DODBM4TEEF1.1 size=1048576 2024-09-12T17:28:55.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.683+0000 7f9d7bc0c780 1 < canceled part key=_multipart_64T291B0U226.2~1DODBM4TEEF1.2 size=518869 2024-09-12T17:28:55.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.685+0000 7f9d7bc0c780 1 < canceled multipart upload key=64T291B0U226 upload=1DODBM4TEEF1 tag=SXMOQ5HR40M4 type=write size=3664597 2024-09-12T17:28:55.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.687+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=GBRUXU7AM3E9 type=del size=1616991 2024-09-12T17:28:55.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.688+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=AA075GMHGEFF type=write size=263239 2024-09-12T17:28:55.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.689+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=HW0H7MU6ZTNL type=del size=1607338 2024-09-12T17:28:55.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.692+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=PHW2IO433NYY type=del size=3892576 2024-09-12T17:28:55.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.694+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=BJ0GDR75YRAR type=write size=840199 2024-09-12T17:28:55.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.697+0000 7f9d7bc0c780 1 < suggested update operation key=LU8MLGM7H0CE tag=NEL7L4R7A0XG type=del size=2457597 2024-09-12T17:28:55.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.698+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=EPOK2VXG3Y27 type=del size=2048139 2024-09-12T17:28:55.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.700+0000 7f9d7bc0c780 1 < canceled operation key=L72DVWQ63XUW tag=3NQDE4F7MRLN type=write size=942150 2024-09-12T17:28:55.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.701+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=CS7FCO8NPGFL type=del size=3057483 2024-09-12T17:28:55.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.703+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=LNSL5A9UBRBX type=del 2024-09-12T17:28:55.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.704+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=OTM19ZKK2ZJH type=del size=2662151 2024-09-12T17:28:55.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.706+0000 7f9d7bc0c780 1 < completed write operation key=CYKLX4CJWVJE tag=4MI8YVTVONFM type=write size=992673 2024-09-12T17:28:55.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.708+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~GD05US9GGTOF.0 size=1048576 2024-09-12T17:28:55.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.709+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~GD05US9GGTOF.1 size=1048576 2024-09-12T17:28:55.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.710+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~GD05US9GGTOF.2 size=172185 2024-09-12T17:28:55.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.710+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=GD05US9GGTOF tag=52T3HZQQ9V79 type=write size=3317913 2024-09-12T17:28:55.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.715+0000 7f9d7bc0c780 1 < suggested remove operation key=LJZNPSVLS9AF tag=WY6QJ3BK3MUU type=write 2024-09-12T17:28:55.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.718+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6CCLHMHLPSIK.0 size=1048576 2024-09-12T17:28:55.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.720+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6CCLHMHLPSIK.1 size=1048576 2024-09-12T17:28:55.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.721+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6CCLHMHLPSIK.2 size=712158 2024-09-12T17:28:55.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.721+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=6CCLHMHLPSIK tag=SYKAC13UWRF9 type=write size=3857886 2024-09-12T17:28:55.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.722+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=N898WMCL8Y64 type=del 2024-09-12T17:28:55.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.725+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~IK4ITBGBYF9Y.0 size=1048576 2024-09-12T17:28:55.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.726+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~IK4ITBGBYF9Y.1 size=1048576 2024-09-12T17:28:55.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.727+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~IK4ITBGBYF9Y.2 size=751081 2024-09-12T17:28:55.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.727+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=IK4ITBGBYF9Y tag=G0F6QRZJ5DKD type=write size=3896809 2024-09-12T17:28:55.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.729+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~4LOE0N9R70S1.0 size=1048576 2024-09-12T17:28:55.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.729+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~4LOE0N9R70S1.1 size=1048576 2024-09-12T17:28:55.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.730+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~4LOE0N9R70S1.2 size=626339 2024-09-12T17:28:55.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.733+0000 7f9d7bc0c780 1 < canceled multipart upload key=AOT2ZKFTD0HY upload=4LOE0N9R70S1 tag=P2ZKA9LSZP4M type=write size=3772067 2024-09-12T17:28:55.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.736+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~PDSNROW551CR.0 size=187061 2024-09-12T17:28:55.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.736+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=PDSNROW551CR tag=S72KRMNFQT8J type=write size=1235637 2024-09-12T17:28:55.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.737+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~V0GGJJ5IG3EW.0 size=1048576 2024-09-12T17:28:55.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.738+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~V0GGJJ5IG3EW.1 size=1048576 2024-09-12T17:28:55.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.739+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~V0GGJJ5IG3EW.2 size=321910 2024-09-12T17:28:55.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.742+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=V0GGJJ5IG3EW tag=ONBCGM3E7461 type=write size=3467638 2024-09-12T17:28:55.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.743+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=BPKFA52B0EX4 type=del size=184534 2024-09-12T17:28:55.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.744+0000 7f9d7bc0c780 1 < canceled part key=_multipart_5B96YH46VAK3.2~HGD22PSWB9CP.0 size=1048576 2024-09-12T17:28:55.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.745+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~HGD22PSWB9CP.1 size=1048576 2024-09-12T17:28:55.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.746+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~HGD22PSWB9CP.2 size=196260 2024-09-12T17:28:55.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.748+0000 7f9d7bc0c780 1 < canceled multipart upload key=5B96YH46VAK3 upload=HGD22PSWB9CP tag=TQL4KQUG7LM9 type=write size=3341988 2024-09-12T17:28:55.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.751+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~B7LDSC63P5Z8.0 size=1048576 2024-09-12T17:28:55.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.752+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~B7LDSC63P5Z8.1 size=1048576 2024-09-12T17:28:55.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.753+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~B7LDSC63P5Z8.2 size=492171 2024-09-12T17:28:55.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.753+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=B7LDSC63P5Z8 tag=H02AO5619UXM type=write size=3637899 2024-09-12T17:28:55.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.755+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~5R32CRP9VIIM.0 size=936274 2024-09-12T17:28:55.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.757+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=5R32CRP9VIIM tag=GXBMNSUF44SP type=write size=1984850 2024-09-12T17:28:55.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.759+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~PJFLG7BUF0CO.0 size=463608 2024-09-12T17:28:55.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.759+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=PJFLG7BUF0CO tag=4CQILYWWYDR2 type=write size=1512184 2024-09-12T17:28:55.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.761+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=BMGVFPAMOABK type=del 2024-09-12T17:28:55.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.762+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=GRQMF3X7N36T type=del size=2486396 2024-09-12T17:28:55.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.764+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~NU1BTRI2XO44.0 size=1048576 2024-09-12T17:28:55.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.765+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~NU1BTRI2XO44.1 size=1048576 2024-09-12T17:28:55.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.766+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~NU1BTRI2XO44.2 size=243105 2024-09-12T17:28:55.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.768+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=NU1BTRI2XO44 tag=TLCOAAJ5JLBS type=write size=3388833 2024-09-12T17:28:55.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.770+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=NFDU7ZNZS7AT type=del size=2893930 2024-09-12T17:28:55.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.771+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=UIPWCUN64CG3 type=write size=632123 2024-09-12T17:28:55.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.772+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=2SAINF9RE67N type=del size=2902652 2024-09-12T17:28:55.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.774+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=GBRUXU7AM3E9 type=del 2024-09-12T17:28:55.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.777+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~4OXHPSQBPMWJ.0 size=1048576 2024-09-12T17:28:55.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.778+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~4OXHPSQBPMWJ.1 size=578448 2024-09-12T17:28:55.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.778+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=4OXHPSQBPMWJ tag=R413JXH012VX type=write size=2675600 2024-09-12T17:28:55.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.779+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=HW0H7MU6ZTNL type=del 2024-09-12T17:28:55.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.781+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=KO280HYDUNID type=del size=1557331 2024-09-12T17:28:55.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.784+0000 7f9d7bc0c780 1 < suggested update operation key=64T291B0U226 tag=BJ0GDR75YRAR type=write size=840199 2024-09-12T17:28:55.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.785+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=AQCDBX221NVS type=del size=2469264 2024-09-12T17:28:55.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.788+0000 7f9d7bc0c780 1 < suggested remove operation key=64T291B0U226 tag=EPOK2VXG3Y27 type=del 2024-09-12T17:28:55.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.790+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=SOSR2CSCSO71 type=del size=4090087 2024-09-12T17:28:55.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.791+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=CS7FCO8NPGFL type=del 2024-09-12T17:28:55.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.793+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=UO25YYZA90E3 type=del size=2010857 2024-09-12T17:28:55.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.794+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=OTM19ZKK2ZJH type=del 2024-09-12T17:28:55.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.796+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=MVPFBGN9IBY9 type=del size=2103658 2024-09-12T17:28:55.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.797+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~GD05US9GGTOF.0 size=1048576 2024-09-12T17:28:55.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.798+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~GD05US9GGTOF.1 size=1048576 2024-09-12T17:28:55.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.799+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~GD05US9GGTOF.2 size=172185 2024-09-12T17:28:55.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.802+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=GD05US9GGTOF tag=52T3HZQQ9V79 type=write size=3317913 2024-09-12T17:28:55.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.803+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=62ZFOZ4DDGFS type=del size=299505 2024-09-12T17:28:55.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.805+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6CCLHMHLPSIK.0 size=1048576 2024-09-12T17:28:55.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.806+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6CCLHMHLPSIK.1 size=1048576 2024-09-12T17:28:55.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.807+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6CCLHMHLPSIK.2 size=712158 2024-09-12T17:28:55.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.809+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=6CCLHMHLPSIK tag=SYKAC13UWRF9 type=write size=3857886 2024-09-12T17:28:55.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.810+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=BOYWO6TBGW4P type=del size=1580897 2024-09-12T17:28:55.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.812+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~IK4ITBGBYF9Y.0 size=1048576 2024-09-12T17:28:55.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.813+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~IK4ITBGBYF9Y.1 size=1048576 2024-09-12T17:28:55.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.814+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~IK4ITBGBYF9Y.2 size=751081 2024-09-12T17:28:55.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.817+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=IK4ITBGBYF9Y tag=G0F6QRZJ5DKD type=write size=3896809 2024-09-12T17:28:55.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.818+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=TFKP3WXUTA8J type=del size=2758453 2024-09-12T17:28:55.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.820+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~PDSNROW551CR.0 size=187061 2024-09-12T17:28:55.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.822+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=PDSNROW551CR tag=S72KRMNFQT8J type=write size=1235637 2024-09-12T17:28:55.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.825+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BOULRCOZ0AQT.0 size=1048576 2024-09-12T17:28:55.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.826+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BOULRCOZ0AQT.1 size=1048576 2024-09-12T17:28:55.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.827+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~BOULRCOZ0AQT.2 size=307953 2024-09-12T17:28:55.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.827+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=BOULRCOZ0AQT tag=QGESO8HJE0IM type=write size=3453681 2024-09-12T17:28:55.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.828+0000 7f9d7bc0c780 -1 < no bi entry to suggest for operation key=64T291B0U226 tag=BPKFA52B0EX4 type=del size=184534: (2) No such file or directory 2024-09-12T17:28:55.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.829+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=SX2PQNMJ02KO type=del size=2285696 2024-09-12T17:28:55.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.831+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~B7LDSC63P5Z8.0 size=1048576 2024-09-12T17:28:55.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.832+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~B7LDSC63P5Z8.1 size=1048576 2024-09-12T17:28:55.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.833+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~B7LDSC63P5Z8.2 size=492171 2024-09-12T17:28:55.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.836+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=B7LDSC63P5Z8 tag=H02AO5619UXM type=write size=3637899 2024-09-12T17:28:55.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.839+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~VE0TEB3ZRILK.0 size=1048576 2024-09-12T17:28:55.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.840+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~VE0TEB3ZRILK.1 size=919482 2024-09-12T17:28:55.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.840+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=VE0TEB3ZRILK tag=0ZBC5IUSRT3Z type=write size=3016634 2024-09-12T17:28:55.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.842+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~PJFLG7BUF0CO.0 size=463608 2024-09-12T17:28:55.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.844+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=PJFLG7BUF0CO tag=4CQILYWWYDR2 type=write size=1512184 2024-09-12T17:28:55.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.846+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=HECEFP2L6AZB type=write size=338513 2024-09-12T17:28:55.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.849+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=GRQMF3X7N36T type=del 2024-09-12T17:28:55.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.851+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~DN4OSQQ2X1Y9.0 size=534403 2024-09-12T17:28:55.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.851+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=DN4OSQQ2X1Y9 tag=VQIB0BWAZFYI type=write size=1582979 2024-09-12T17:28:55.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.853+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=NFDU7ZNZS7AT type=del 2024-09-12T17:28:55.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.855+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=I1NDUVEMUASH type=del size=2649783 2024-09-12T17:28:55.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.857+0000 7f9d7bc0c780 1 < suggested remove operation key=M3Q7I7MD7M4I tag=2SAINF9RE67N type=del 2024-09-12T17:28:55.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.860+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~TU87EHDXW056.0 size=854676 2024-09-12T17:28:55.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.860+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=TU87EHDXW056 tag=3K7OHTQVYEGE type=write size=1903252 2024-09-12T17:28:55.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.861+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~4OXHPSQBPMWJ.0 size=1048576 2024-09-12T17:28:55.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.863+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~4OXHPSQBPMWJ.1 size=578448 2024-09-12T17:28:55.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.865+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=4OXHPSQBPMWJ tag=R413JXH012VX type=write size=2675600 2024-09-12T17:28:55.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.866+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=TUDJY1W37K4N type=write size=7155 2024-09-12T17:28:55.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.868+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=KO280HYDUNID type=del 2024-09-12T17:28:55.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.870+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~ILUGH0MYADLS.0 size=983559 2024-09-12T17:28:55.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.870+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=ILUGH0MYADLS tag=GSHCNZ2V5J6U type=write size=2032135 2024-09-12T17:28:55.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.872+0000 7f9d7bc0c780 1 < canceled operation key=NQ0768B94GVV tag=AQCDBX221NVS type=del size=2469264 2024-09-12T17:28:55.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.874+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=SCMGVI3SRPVD type=del size=2059302 2024-09-12T17:28:55.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.875+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=SOSR2CSCSO71 type=del 2024-09-12T17:28:55.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.877+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=9WZVYL7Q0KEM type=del size=1260975 2024-09-12T17:28:55.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.878+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=UO25YYZA90E3 type=del 2024-09-12T17:28:55.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.880+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=HTNX5S5EPGGT type=del size=753590 2024-09-12T17:28:55.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.881+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=MVPFBGN9IBY9 type=del 2024-09-12T17:28:55.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.883+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=0M9S0OWC6HK0 type=del size=870761 2024-09-12T17:28:55.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.884+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=62ZFOZ4DDGFS type=del 2024-09-12T17:28:55.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.886+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=F1ABWGCDOTXN type=write size=176455 2024-09-12T17:28:55.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.888+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=BOYWO6TBGW4P type=del 2024-09-12T17:28:55.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.889+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=32EPW55WHTT7 type=del size=2867133 2024-09-12T17:28:55.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.891+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=TFKP3WXUTA8J type=del 2024-09-12T17:28:55.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.893+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=5ZTNAO6PI2D9 type=del size=3648777 2024-09-12T17:28:55.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.895+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~BOULRCOZ0AQT.0 size=1048576 2024-09-12T17:28:55.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.896+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~BOULRCOZ0AQT.1 size=1048576 2024-09-12T17:28:55.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.897+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~BOULRCOZ0AQT.2 size=307953 2024-09-12T17:28:55.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.900+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=BOULRCOZ0AQT tag=QGESO8HJE0IM type=write size=3453681 2024-09-12T17:28:55.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.902+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=G8BY8MTWQAC1 type=write size=24593 2024-09-12T17:28:55.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.903+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=SX2PQNMJ02KO type=del 2024-09-12T17:28:55.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.905+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=N5OPD2FCNP6W type=del size=651925 2024-09-12T17:28:55.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.906+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~VE0TEB3ZRILK.0 size=1048576 2024-09-12T17:28:55.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.907+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~VE0TEB3ZRILK.1 size=919482 2024-09-12T17:28:55.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.910+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=VE0TEB3ZRILK tag=0ZBC5IUSRT3Z type=write size=3016634 2024-09-12T17:28:55.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.911+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=VNI97ESZIECL type=write size=658847 2024-09-12T17:28:55.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.913+0000 7f9d7bc0c780 1 < completed write operation key=X7J78IOJR0HA tag=HECEFP2L6AZB type=write size=338513 2024-09-12T17:28:55.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.915+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~VXK18B12RR26.0 size=719871 2024-09-12T17:28:55.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.915+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=VXK18B12RR26 tag=WJ8FFHD4GMCS type=write size=1768447 2024-09-12T17:28:55.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.917+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~DN4OSQQ2X1Y9.0 size=534403 2024-09-12T17:28:55.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.919+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=DN4OSQQ2X1Y9 tag=VQIB0BWAZFYI type=write size=1582979 2024-09-12T17:28:55.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.921+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=K8LX5FXMDJK9 type=del size=3443834 2024-09-12T17:28:55.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.923+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=I1NDUVEMUASH type=del 2024-09-12T17:28:55.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.925+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~UV65P8SDF6GG.0 size=1048576 2024-09-12T17:28:55.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.926+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~UV65P8SDF6GG.1 size=546238 2024-09-12T17:28:55.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.926+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=UV65P8SDF6GG tag=OYG8TK6517SX type=write size=2643390 2024-09-12T17:28:55.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.928+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~TU87EHDXW056.0 size=854676 2024-09-12T17:28:55.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.932+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=TU87EHDXW056 tag=3K7OHTQVYEGE type=write size=1903252 2024-09-12T17:28:55.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.933+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=J6I3OBVEZ1ZQ type=del size=2929908 2024-09-12T17:28:55.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.935+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=TUDJY1W37K4N type=write size=7155 2024-09-12T17:28:55.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.936+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=OKXUQ153YQ5Y type=del size=1502688 2024-09-12T17:28:55.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.938+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~ILUGH0MYADLS.0 size=983559 2024-09-12T17:28:55.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.940+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=ILUGH0MYADLS tag=GSHCNZ2V5J6U type=write size=2032135 2024-09-12T17:28:55.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.942+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~0O7KNUHUOJ20.0 size=1048576 2024-09-12T17:28:55.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.943+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~0O7KNUHUOJ20.1 size=363515 2024-09-12T17:28:55.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.943+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=0O7KNUHUOJ20 tag=F8E5Q3AAPF9G type=write size=2460667 2024-09-12T17:28:55.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.945+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=SCMGVI3SRPVD type=del 2024-09-12T17:28:55.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.948+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~SFGLAFBXD4HU.0 size=1048576 2024-09-12T17:28:55.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.949+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~SFGLAFBXD4HU.1 size=1013938 2024-09-12T17:28:55.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.949+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=SFGLAFBXD4HU tag=DPRC7IQ4O1D7 type=write size=3111090 2024-09-12T17:28:55.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.952+0000 7f9d7bc0c780 1 < suggested update operation key=FU7ARIH2X839 tag=9WZVYL7Q0KEM type=del size=1260975 2024-09-12T17:28:55.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.953+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=521MKRE35HEM type=write size=121787 2024-09-12T17:28:55.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.955+0000 7f9d7bc0c780 1 < canceled operation key=R94VERREGANN tag=HTNX5S5EPGGT type=del size=753590 2024-09-12T17:28:55.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.956+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=IH1HONDBGZNN type=write size=528583 2024-09-12T17:28:55.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.957+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=0M9S0OWC6HK0 type=del 2024-09-12T17:28:55.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.959+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=ASZ8KZHFXIQ4 type=del size=2552929 2024-09-12T17:28:55.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.960+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=F1ABWGCDOTXN type=write size=176455 2024-09-12T17:28:55.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.962+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~2WGRAKN3YCTM.0 size=1048576 2024-09-12T17:28:55.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.963+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~2WGRAKN3YCTM.1 size=1048576 2024-09-12T17:28:55.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.965+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~2WGRAKN3YCTM.2 size=997684 2024-09-12T17:28:55.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.965+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=2WGRAKN3YCTM tag=VT7JCIAHJ3Z0 type=write size=4143412 2024-09-12T17:28:55.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.966+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=32EPW55WHTT7 type=del 2024-09-12T17:28:55.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.969+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~1MYBTETWQK84.0 size=1048576 2024-09-12T17:28:55.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.970+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~1MYBTETWQK84.1 size=1048576 2024-09-12T17:28:55.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.971+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~1MYBTETWQK84.2 size=738261 2024-09-12T17:28:55.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.971+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=1MYBTETWQK84 tag=CA5OLBOUNMTV type=write size=3883989 2024-09-12T17:28:55.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.974+0000 7f9d7bc0c780 1 < suggested update operation key=LU8MLGM7H0CE tag=5ZTNAO6PI2D9 type=del size=3648777 2024-09-12T17:28:55.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.975+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=MCD7XRFPXGYD type=del size=3145711 2024-09-12T17:28:55.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.977+0000 7f9d7bc0c780 1 < completed write operation key=ZM8NMC18RN3I tag=G8BY8MTWQAC1 type=write size=24593 2024-09-12T17:28:55.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.978+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=16Z9ZQXKOSD6 type=del size=3737106 2024-09-12T17:28:55.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.979+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=N5OPD2FCNP6W type=del 2024-09-12T17:28:55.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.981+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=TMXDN391J3C3 type=write size=661882 2024-09-12T17:28:55.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.982+0000 7f9d7bc0c780 1 < canceled operation key=R94VERREGANN tag=VNI97ESZIECL type=write size=658847 2024-09-12T17:28:55.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.984+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=08KVPNMFXQ55 type=del size=1203421 2024-09-12T17:28:55.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.985+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~VXK18B12RR26.0 size=719871 2024-09-12T17:28:55.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.987+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=VXK18B12RR26 tag=WJ8FFHD4GMCS type=write size=1768447 2024-09-12T17:28:55.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.990+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=L6B5RAP5NT5I type=write size=611279 2024-09-12T17:28:55.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.992+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=K8LX5FXMDJK9 type=del 2024-09-12T17:28:55.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.993+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=5G8I5Z13SWU8 type=del size=162602 2024-09-12T17:28:55.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.995+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~UV65P8SDF6GG.0 size=1048576 2024-09-12T17:28:55.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.996+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~UV65P8SDF6GG.1 size=546238 2024-09-12T17:28:55.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.998+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=UV65P8SDF6GG tag=OYG8TK6517SX type=write size=2643390 2024-09-12T17:28:56.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:55.999+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=7MJASN1RZQSI type=write size=414502 2024-09-12T17:28:56.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.001+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=J6I3OBVEZ1ZQ type=del 2024-09-12T17:28:56.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.003+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~8A1YC18UJ5KO.0 size=1048576 2024-09-12T17:28:56.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.004+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~8A1YC18UJ5KO.1 size=1048576 2024-09-12T17:28:56.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.006+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~8A1YC18UJ5KO.2 size=674184 2024-09-12T17:28:56.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.006+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=8A1YC18UJ5KO tag=TNEIQ61NVC07 type=write size=3819912 2024-09-12T17:28:56.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.007+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=OKXUQ153YQ5Y type=del 2024-09-12T17:28:56.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.010+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~1XEQUDK5DDQF.0 size=1048576 2024-09-12T17:28:56.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.011+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~1XEQUDK5DDQF.1 size=640771 2024-09-12T17:28:56.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.011+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=1XEQUDK5DDQF tag=KJZM10HCNRIH type=write size=2737923 2024-09-12T17:28:56.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.012+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~0O7KNUHUOJ20.0 size=1048576 2024-09-12T17:28:56.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.013+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~0O7KNUHUOJ20.1 size=363515 2024-09-12T17:28:56.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.016+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=0O7KNUHUOJ20 tag=F8E5Q3AAPF9G type=write size=2460667 2024-09-12T17:28:56.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.017+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=H0DQT2FLS6OR type=del size=3085459 2024-09-12T17:28:56.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.018+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~SFGLAFBXD4HU.0 size=1048576 2024-09-12T17:28:56.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.020+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~SFGLAFBXD4HU.1 size=1013938 2024-09-12T17:28:56.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.022+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=SFGLAFBXD4HU tag=DPRC7IQ4O1D7 type=write size=3111090 2024-09-12T17:28:56.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.023+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=047SY5YROBQY type=del size=58154 2024-09-12T17:28:56.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.024+0000 7f9d7bc0c780 1 < completed write operation key=FU7ARIH2X839 tag=521MKRE35HEM type=write size=121787 2024-09-12T17:28:56.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.026+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=4AE94S8EEKGE type=del size=1573398 2024-09-12T17:28:56.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.027+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=IH1HONDBGZNN type=write size=528583 2024-09-12T17:28:56.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.029+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~VZPZ9PM3FJM6.0 size=1048576 2024-09-12T17:28:56.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.031+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~VZPZ9PM3FJM6.1 size=229973 2024-09-12T17:28:56.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.031+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=VZPZ9PM3FJM6 tag=Q2R1UNDF379V type=write size=2327125 2024-09-12T17:28:56.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.032+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=ASZ8KZHFXIQ4 type=del 2024-09-12T17:28:56.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.034+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~8UGIOX9OUI2D.0 size=376399 2024-09-12T17:28:56.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.034+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=8UGIOX9OUI2D tag=1YE6LP36HJFO type=write size=1424975 2024-09-12T17:28:56.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.036+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~2WGRAKN3YCTM.0 size=1048576 2024-09-12T17:28:56.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.037+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~2WGRAKN3YCTM.1 size=1048576 2024-09-12T17:28:56.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.038+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~2WGRAKN3YCTM.2 size=997684 2024-09-12T17:28:56.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.040+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=2WGRAKN3YCTM tag=VT7JCIAHJ3Z0 type=write size=4143412 2024-09-12T17:28:56.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.043+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~FADRMEH0ABG3.0 size=1048576 2024-09-12T17:28:56.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.044+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~FADRMEH0ABG3.1 size=602808 2024-09-12T17:28:56.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.044+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=FADRMEH0ABG3 tag=PTHHX4GVYSV6 type=write size=2699960 2024-09-12T17:28:56.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.045+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~1MYBTETWQK84.0 size=1048576 2024-09-12T17:28:56.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.046+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~1MYBTETWQK84.1 size=1048576 2024-09-12T17:28:56.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.047+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~1MYBTETWQK84.2 size=738261 2024-09-12T17:28:56.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.050+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=1MYBTETWQK84 tag=CA5OLBOUNMTV type=write size=3883989 2024-09-12T17:28:56.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.051+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=ZYLLXKWLN4F1 type=del size=2886163 2024-09-12T17:28:56.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.053+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=MCD7XRFPXGYD type=del 2024-09-12T17:28:56.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.054+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=Y2GAN38I8T14 type=del size=2876630 2024-09-12T17:28:56.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.056+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=16Z9ZQXKOSD6 type=del 2024-09-12T17:28:56.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.057+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=U9S2YQ8HJ51S type=del size=3115081 2024-09-12T17:28:56.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.059+0000 7f9d7bc0c780 1 < canceled operation key=ZM8NMC18RN3I tag=TMXDN391J3C3 type=write size=661882 2024-09-12T17:28:56.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.060+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=ENCVBUSC9EK0 type=del size=3014609 2024-09-12T17:28:56.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.063+0000 7f9d7bc0c780 1 < suggested remove operation key=CYKLX4CJWVJE tag=08KVPNMFXQ55 type=del 2024-09-12T17:28:56.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.066+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~1AHEH0YFS1TS.0 size=1036988 2024-09-12T17:28:56.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.066+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=1AHEH0YFS1TS tag=P09KZURFF2XE type=write size=2085564 2024-09-12T17:28:56.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.067+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=L6B5RAP5NT5I type=write size=611279 2024-09-12T17:28:56.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.070+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6S6DU381CW12.0 size=1048576 2024-09-12T17:28:56.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.071+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6S6DU381CW12.1 size=1048576 2024-09-12T17:28:56.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.072+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6S6DU381CW12.2 size=841677 2024-09-12T17:28:56.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.072+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=6S6DU381CW12 tag=INEUM6XLDL05 type=write size=3987405 2024-09-12T17:28:56.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.073+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=5G8I5Z13SWU8 type=del 2024-09-12T17:28:56.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.076+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~647C62HMTDGP.0 size=1048576 2024-09-12T17:28:56.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.077+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~647C62HMTDGP.1 size=1048576 2024-09-12T17:28:56.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.078+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~647C62HMTDGP.2 size=1038463 2024-09-12T17:28:56.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.078+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=647C62HMTDGP tag=XUCF0PZAUX5E type=write size=4184191 2024-09-12T17:28:56.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.080+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=7MJASN1RZQSI type=write size=414502 2024-09-12T17:28:56.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.082+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~YQ2PUXPVJ7R1.0 size=903345 2024-09-12T17:28:56.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.082+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=YQ2PUXPVJ7R1 tag=WJNBKE9COGTV type=write size=1951921 2024-09-12T17:28:56.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.084+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~8A1YC18UJ5KO.0 size=1048576 2024-09-12T17:28:56.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.085+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~8A1YC18UJ5KO.1 size=1048576 2024-09-12T17:28:56.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.085+0000 7f9d7bc0c780 1 < canceled part key=_multipart_QB8C0OJA1L4X.2~8A1YC18UJ5KO.2 size=674184 2024-09-12T17:28:56.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.087+0000 7f9d7bc0c780 1 < canceled multipart upload key=QB8C0OJA1L4X upload=8A1YC18UJ5KO tag=TNEIQ61NVC07 type=write size=3819912 2024-09-12T17:28:56.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.089+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=HF43XQO62K81 type=del size=3336992 2024-09-12T17:28:56.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.090+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~1XEQUDK5DDQF.0 size=1048576 2024-09-12T17:28:56.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.091+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~1XEQUDK5DDQF.1 size=640771 2024-09-12T17:28:56.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.094+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=1XEQUDK5DDQF tag=KJZM10HCNRIH type=write size=2737923 2024-09-12T17:28:56.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.095+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=DMCYDNZAL4WX type=write size=261883 2024-09-12T17:28:56.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.097+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=H0DQT2FLS6OR type=del 2024-09-12T17:28:56.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.098+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=ZWLPD2T9MX6I type=del size=2871792 2024-09-12T17:28:56.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.100+0000 7f9d7bc0c780 1 < canceled operation key=QB8C0OJA1L4X tag=047SY5YROBQY type=del size=58154 2024-09-12T17:28:56.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.102+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=5DAB1FE29D6T type=del size=1410703 2024-09-12T17:28:56.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.103+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=4AE94S8EEKGE type=del 2024-09-12T17:28:56.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.104+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=LDVL8A9G88Y5 type=del size=1939028 2024-09-12T17:28:56.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.106+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~VZPZ9PM3FJM6.0 size=1048576 2024-09-12T17:28:56.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.107+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~VZPZ9PM3FJM6.1 size=229973 2024-09-12T17:28:56.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.110+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=VZPZ9PM3FJM6 tag=Q2R1UNDF379V type=write size=2327125 2024-09-12T17:28:56.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.112+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~CB0712Y3BEXB.0 size=1048576 2024-09-12T17:28:56.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.113+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~CB0712Y3BEXB.1 size=340832 2024-09-12T17:28:56.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.113+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=CB0712Y3BEXB tag=H6SWQZ20439X type=write size=2437984 2024-09-12T17:28:56.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.115+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~8UGIOX9OUI2D.0 size=376399 2024-09-12T17:28:56.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.117+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=8UGIOX9OUI2D tag=1YE6LP36HJFO type=write size=1424975 2024-09-12T17:28:56.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.121+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~3WJ8VHHBLQRG.0 size=1048576 2024-09-12T17:28:56.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.122+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~3WJ8VHHBLQRG.1 size=87391 2024-09-12T17:28:56.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.122+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=3WJ8VHHBLQRG tag=45HRK3YHVUT6 type=write size=2184543 2024-09-12T17:28:56.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.123+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~FADRMEH0ABG3.0 size=1048576 2024-09-12T17:28:56.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.125+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~FADRMEH0ABG3.1 size=602808 2024-09-12T17:28:56.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.127+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=FADRMEH0ABG3 tag=PTHHX4GVYSV6 type=write size=2699960 2024-09-12T17:28:56.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.128+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=5V0UWM7V5LJD type=del size=406960 2024-09-12T17:28:56.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.130+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=ZYLLXKWLN4F1 type=del 2024-09-12T17:28:56.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.132+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~QKQLMV2YJDK0.0 size=847542 2024-09-12T17:28:56.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.132+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=QKQLMV2YJDK0 tag=X14C5PFGUNI4 type=write size=1896118 2024-09-12T17:28:56.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.134+0000 7f9d7bc0c780 1 < canceled operation key=LU8MLGM7H0CE tag=Y2GAN38I8T14 type=del size=2876630 2024-09-12T17:28:56.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.135+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=9C1A7D0PV5FD type=write size=87111 2024-09-12T17:28:56.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.137+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=U9S2YQ8HJ51S type=del 2024-09-12T17:28:56.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.138+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=DKSAHHIRWWCJ type=del size=537498 2024-09-12T17:28:56.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.140+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=ENCVBUSC9EK0 type=del 2024-09-12T17:28:56.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.143+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~DYTE5IORP5X6.0 size=1048576 2024-09-12T17:28:56.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.144+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~DYTE5IORP5X6.1 size=228634 2024-09-12T17:28:56.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.144+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=DYTE5IORP5X6 tag=L4GEVWYLLIBT type=write size=2325786 2024-09-12T17:28:56.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.145+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~1AHEH0YFS1TS.0 size=1036988 2024-09-12T17:28:56.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.148+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=1AHEH0YFS1TS tag=P09KZURFF2XE type=write size=2085564 2024-09-12T17:28:56.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.149+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=AOBNYB4RWHQX type=del size=1809968 2024-09-12T17:28:56.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.150+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6S6DU381CW12.0 size=1048576 2024-09-12T17:28:56.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.151+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6S6DU381CW12.1 size=1048576 2024-09-12T17:28:56.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.153+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6S6DU381CW12.2 size=841677 2024-09-12T17:28:56.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.155+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=6S6DU381CW12 tag=INEUM6XLDL05 type=write size=3987405 2024-09-12T17:28:56.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.157+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=FCEAYT5L1KU1 type=del size=3051697 2024-09-12T17:28:56.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.158+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~647C62HMTDGP.0 size=1048576 2024-09-12T17:28:56.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.158+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LU8MLGM7H0CE.2~647C62HMTDGP.1 size=1048576 2024-09-12T17:28:56.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.159+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~647C62HMTDGP.2 size=1038463 2024-09-12T17:28:56.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.162+0000 7f9d7bc0c780 1 < canceled multipart upload key=LU8MLGM7H0CE upload=647C62HMTDGP tag=XUCF0PZAUX5E type=write size=4184191 2024-09-12T17:28:56.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.165+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~3LHJMXIBKNT5.0 size=354321 2024-09-12T17:28:56.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.165+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=3LHJMXIBKNT5 tag=DCEI2P7H1Y3W type=write size=1402897 2024-09-12T17:28:56.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.166+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~YQ2PUXPVJ7R1.0 size=903345 2024-09-12T17:28:56.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.168+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=YQ2PUXPVJ7R1 tag=WJNBKE9COGTV type=write size=1951921 2024-09-12T17:28:56.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.171+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~JNV9E0FO6L3V.0 size=1048576 2024-09-12T17:28:56.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.172+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~JNV9E0FO6L3V.1 size=96267 2024-09-12T17:28:56.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.172+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=JNV9E0FO6L3V tag=95VZ00TE8I5S type=write size=2193419 2024-09-12T17:28:56.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.173+0000 7f9d7bc0c780 1 < canceled operation key=LU8MLGM7H0CE tag=HF43XQO62K81 type=del size=3336992 2024-09-12T17:28:56.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.174+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=YIIKC01365HR type=del size=1409176 2024-09-12T17:28:56.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.176+0000 7f9d7bc0c780 1 < completed write operation key=NQ0768B94GVV tag=DMCYDNZAL4WX type=write size=261883 2024-09-12T17:28:56.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.177+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=1VTZLMWEH5W5 type=del size=3679866 2024-09-12T17:28:56.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.178+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=ZWLPD2T9MX6I type=del 2024-09-12T17:28:56.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.181+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~35CQS7CT8SDC.0 size=670175 2024-09-12T17:28:56.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.181+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=35CQS7CT8SDC tag=6ISTTWB9BVBP type=write size=1718751 2024-09-12T17:28:56.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.182+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=5DAB1FE29D6T type=del 2024-09-12T17:28:56.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.184+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~1VBNHNWUMNZS.0 size=1048576 2024-09-12T17:28:56.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.185+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~1VBNHNWUMNZS.1 size=268361 2024-09-12T17:28:56.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.185+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=1VBNHNWUMNZS tag=BS5HRHPPSY1P type=write size=2365513 2024-09-12T17:28:56.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.187+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=LDVL8A9G88Y5 type=del 2024-09-12T17:28:56.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.188+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=E80HRWK5OE78 type=write size=81383 2024-09-12T17:28:56.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.190+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~CB0712Y3BEXB.0 size=1048576 2024-09-12T17:28:56.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.191+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~CB0712Y3BEXB.1 size=340832 2024-09-12T17:28:56.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.193+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=CB0712Y3BEXB tag=H6SWQZ20439X type=write size=2437984 2024-09-12T17:28:56.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.194+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=K3OKE1RWMU94 type=del size=1525922 2024-09-12T17:28:56.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.196+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~3WJ8VHHBLQRG.0 size=1048576 2024-09-12T17:28:56.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.199+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~3WJ8VHHBLQRG.1 size=87391 2024-09-12T17:28:56.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.201+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=3WJ8VHHBLQRG tag=45HRK3YHVUT6 type=write size=2184543 2024-09-12T17:28:56.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.202+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=SEZSFA2RS12A type=del size=3630248 2024-09-12T17:28:56.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.204+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=5V0UWM7V5LJD type=del 2024-09-12T17:28:56.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.205+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=152G5RKESDUP type=del size=2110803 2024-09-12T17:28:56.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.207+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~QKQLMV2YJDK0.0 size=847542 2024-09-12T17:28:56.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.209+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=QKQLMV2YJDK0 tag=X14C5PFGUNI4 type=write size=1896118 2024-09-12T17:28:56.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.211+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~3PKCX0VTBG97.0 size=1048576 2024-09-12T17:28:56.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.212+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~3PKCX0VTBG97.1 size=1048576 2024-09-12T17:28:56.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.213+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~3PKCX0VTBG97.2 size=340194 2024-09-12T17:28:56.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.213+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=3PKCX0VTBG97 tag=NCC3IEEA1UEU type=write size=3485922 2024-09-12T17:28:56.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.216+0000 7f9d7bc0c780 1 < suggested update operation key=0JN5WWDYEM6Q tag=9C1A7D0PV5FD type=write size=87111 2024-09-12T17:28:56.219 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.217+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=APRP24XMS4JT type=write size=949330 2024-09-12T17:28:56.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.219+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=DKSAHHIRWWCJ type=del 2024-09-12T17:28:56.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.221+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~N4QJIO7R1TVR.0 size=367273 2024-09-12T17:28:56.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.221+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=N4QJIO7R1TVR tag=IKJA4YWYAXNH type=write size=1415849 2024-09-12T17:28:56.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.222+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~DYTE5IORP5X6.0 size=1048576 2024-09-12T17:28:56.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.223+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~DYTE5IORP5X6.1 size=228634 2024-09-12T17:28:56.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.225+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=DYTE5IORP5X6 tag=L4GEVWYLLIBT type=write size=2325786 2024-09-12T17:28:56.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.227+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=MIV49BFWCLJG type=del size=577966 2024-09-12T17:28:56.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.228+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=AOBNYB4RWHQX type=del 2024-09-12T17:28:56.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.231+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~PVXL5UP88E21.0 size=1048576 2024-09-12T17:28:56.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.232+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~PVXL5UP88E21.1 size=1048576 2024-09-12T17:28:56.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.233+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~PVXL5UP88E21.2 size=460721 2024-09-12T17:28:56.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.233+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=PVXL5UP88E21 tag=0ZDQAFU772FM type=write size=3606449 2024-09-12T17:28:56.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.236+0000 7f9d7bc0c780 1 < suggested update operation key=31PU0U6IEAV2 tag=FCEAYT5L1KU1 type=del size=3051697 2024-09-12T17:28:56.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.239+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~4TBN2WSC833Z.0 size=1048576 2024-09-12T17:28:56.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.240+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~4TBN2WSC833Z.1 size=1048576 2024-09-12T17:28:56.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.241+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~4TBN2WSC833Z.2 size=327149 2024-09-12T17:28:56.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.241+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=4TBN2WSC833Z tag=YKF9HFFRTXV6 type=write size=3472877 2024-09-12T17:28:56.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.243+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~3LHJMXIBKNT5.0 size=354321 2024-09-12T17:28:56.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.246+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=3LHJMXIBKNT5 tag=DCEI2P7H1Y3W type=write size=1402897 2024-09-12T17:28:56.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.247+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=DU6O7TURZ7GP type=del size=901591 2024-09-12T17:28:56.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.248+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~JNV9E0FO6L3V.0 size=1048576 2024-09-12T17:28:56.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.250+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~JNV9E0FO6L3V.1 size=96267 2024-09-12T17:28:56.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.253+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=JNV9E0FO6L3V tag=95VZ00TE8I5S type=write size=2193419 2024-09-12T17:28:56.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.256+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~2A8KQ49OSGBO.0 size=1048576 2024-09-12T17:28:56.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.257+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~2A8KQ49OSGBO.1 size=1048576 2024-09-12T17:28:56.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.258+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~2A8KQ49OSGBO.2 size=642922 2024-09-12T17:28:56.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.258+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=2A8KQ49OSGBO tag=VMUW1TJYYG5Q type=write size=3788650 2024-09-12T17:28:56.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.259+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=YIIKC01365HR type=del 2024-09-12T17:28:56.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.261+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=7504XW1B5FO8 type=write size=206992 2024-09-12T17:28:56.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.262+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=1VTZLMWEH5W5 type=del 2024-09-12T17:28:56.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.265+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~Z6RP3HHJL4H0.0 size=1048576 2024-09-12T17:28:56.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.266+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~Z6RP3HHJL4H0.1 size=1048576 2024-09-12T17:28:56.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.267+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~Z6RP3HHJL4H0.2 size=349539 2024-09-12T17:28:56.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.267+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=Z6RP3HHJL4H0 tag=R1W7770EH5B1 type=write size=3495267 2024-09-12T17:28:56.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.268+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~35CQS7CT8SDC.0 size=670175 2024-09-12T17:28:56.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.271+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=35CQS7CT8SDC tag=6ISTTWB9BVBP type=write size=1718751 2024-09-12T17:28:56.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.273+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~FVN25403XCRP.0 size=1048576 2024-09-12T17:28:56.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.274+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~FVN25403XCRP.1 size=1048576 2024-09-12T17:28:56.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.275+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~FVN25403XCRP.2 size=704434 2024-09-12T17:28:56.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.275+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=FVN25403XCRP tag=3ZL81G7X47XW type=write size=3850162 2024-09-12T17:28:56.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.277+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~1VBNHNWUMNZS.0 size=1048576 2024-09-12T17:28:56.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.278+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~1VBNHNWUMNZS.1 size=268361 2024-09-12T17:28:56.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.280+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=1VBNHNWUMNZS tag=BS5HRHPPSY1P type=write size=2365513 2024-09-12T17:28:56.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.281+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=J14VMPIOAJIA type=write size=396063 2024-09-12T17:28:56.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.283+0000 7f9d7bc0c780 1 < completed write operation key=4V2IYJRP2PZI tag=E80HRWK5OE78 type=write size=81383 2024-09-12T17:28:56.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.284+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=PQZGID2JAJI3 type=del size=3277719 2024-09-12T17:28:56.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.286+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=K3OKE1RWMU94 type=del 2024-09-12T17:28:56.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.287+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=SHZUFH2N0WR2 type=del size=3317982 2024-09-12T17:28:56.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.288+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=SEZSFA2RS12A type=del 2024-09-12T17:28:56.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.291+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~6T90LD2DONFD.0 size=1048576 2024-09-12T17:28:56.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.292+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~6T90LD2DONFD.1 size=355906 2024-09-12T17:28:56.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.292+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=6T90LD2DONFD tag=7S7NXLBUU3PN type=write size=2453058 2024-09-12T17:28:56.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.294+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=152G5RKESDUP type=del 2024-09-12T17:28:56.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.295+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=TSMIC2JL1S8D type=write size=522564 2024-09-12T17:28:56.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.297+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~3PKCX0VTBG97.0 size=1048576 2024-09-12T17:28:56.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.298+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~3PKCX0VTBG97.1 size=1048576 2024-09-12T17:28:56.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.299+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~3PKCX0VTBG97.2 size=340194 2024-09-12T17:28:56.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.301+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=3PKCX0VTBG97 tag=NCC3IEEA1UEU type=write size=3485922 2024-09-12T17:28:56.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.304+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~VVMUYJ86PGRQ.0 size=428933 2024-09-12T17:28:56.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.304+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=VVMUYJ86PGRQ tag=4N3Y580BKVVB type=write size=1477509 2024-09-12T17:28:56.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.305+0000 7f9d7bc0c780 1 < completed write operation key=QB8C0OJA1L4X tag=APRP24XMS4JT type=write size=949330 2024-09-12T17:28:56.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.306+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=LZKIIFNGNWK5 type=del size=1780054 2024-09-12T17:28:56.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.308+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~N4QJIO7R1TVR.0 size=367273 2024-09-12T17:28:56.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.310+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=N4QJIO7R1TVR tag=IKJA4YWYAXNH type=write size=1415849 2024-09-12T17:28:56.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.313+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6K4C8YHC7TOG.0 size=1048576 2024-09-12T17:28:56.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.314+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6K4C8YHC7TOG.1 size=1048576 2024-09-12T17:28:56.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.315+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~6K4C8YHC7TOG.2 size=235878 2024-09-12T17:28:56.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.315+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=6K4C8YHC7TOG tag=SQ9FPMYA91LY type=write size=3381606 2024-09-12T17:28:56.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.317+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=MIV49BFWCLJG type=del 2024-09-12T17:28:56.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.318+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=6VUSIPVBGTS2 type=write size=105119 2024-09-12T17:28:56.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.319+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~PVXL5UP88E21.0 size=1048576 2024-09-12T17:28:56.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.321+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~PVXL5UP88E21.1 size=1048576 2024-09-12T17:28:56.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.322+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~PVXL5UP88E21.2 size=460721 2024-09-12T17:28:56.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.324+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=PVXL5UP88E21 tag=0ZDQAFU772FM type=write size=3606449 2024-09-12T17:28:56.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.327+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~YOSHZLMUSMA2.0 size=1048576 2024-09-12T17:28:56.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.328+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~YOSHZLMUSMA2.1 size=1048576 2024-09-12T17:28:56.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.329+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~YOSHZLMUSMA2.2 size=892640 2024-09-12T17:28:56.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.329+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=YOSHZLMUSMA2 tag=WOUC531PKCWK type=write size=4038368 2024-09-12T17:28:56.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.331+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~4TBN2WSC833Z.0 size=1048576 2024-09-12T17:28:56.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.332+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~4TBN2WSC833Z.1 size=1048576 2024-09-12T17:28:56.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.333+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~4TBN2WSC833Z.2 size=327149 2024-09-12T17:28:56.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.336+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=4TBN2WSC833Z tag=YKF9HFFRTXV6 type=write size=3472877 2024-09-12T17:28:56.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.337+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=FOIBLBY2GJAR type=del size=990632 2024-09-12T17:28:56.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.338+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=DU6O7TURZ7GP type=del 2024-09-12T17:28:56.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.340+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=ETMTS4S7BZGS type=write size=654756 2024-09-12T17:28:56.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.341+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~2A8KQ49OSGBO.0 size=1048576 2024-09-12T17:28:56.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.343+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~2A8KQ49OSGBO.1 size=1048576 2024-09-12T17:28:56.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.344+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~2A8KQ49OSGBO.2 size=642922 2024-09-12T17:28:56.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.346+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=2A8KQ49OSGBO tag=VMUW1TJYYG5Q type=write size=3788650 2024-09-12T17:28:56.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.348+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=RTL07ITIA6OZ type=del size=3869482 2024-09-12T17:28:56.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.351+0000 7f9d7bc0c780 1 < suggested update operation key=5B96YH46VAK3 tag=7504XW1B5FO8 type=write size=206992 2024-09-12T17:28:56.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.352+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=OC62J1B6JBL1 type=del size=366552 2024-09-12T17:28:56.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.354+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~Z6RP3HHJL4H0.0 size=1048576 2024-09-12T17:28:56.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.355+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~Z6RP3HHJL4H0.1 size=1048576 2024-09-12T17:28:56.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.356+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~Z6RP3HHJL4H0.2 size=349539 2024-09-12T17:28:56.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.358+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=Z6RP3HHJL4H0 tag=R1W7770EH5B1 type=write size=3495267 2024-09-12T17:28:56.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.360+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=ZCHTD7IR26KT type=del size=1802307 2024-09-12T17:28:56.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.361+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~FVN25403XCRP.0 size=1048576 2024-09-12T17:28:56.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.362+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~FVN25403XCRP.1 size=1048576 2024-09-12T17:28:56.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.363+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~FVN25403XCRP.2 size=704434 2024-09-12T17:28:56.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.366+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=FVN25403XCRP tag=3ZL81G7X47XW type=write size=3850162 2024-09-12T17:28:56.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.367+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=Z30050E33C6G type=del size=3811043 2024-09-12T17:28:56.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.369+0000 7f9d7bc0c780 1 < completed write operation key=58C4SS3TN12K tag=J14VMPIOAJIA type=write size=396063 2024-09-12T17:28:56.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.370+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=2HUCSPQVIFSF type=del size=1505314 2024-09-12T17:28:56.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.373+0000 7f9d7bc0c780 1 < suggested update operation key=31PU0U6IEAV2 tag=PQZGID2JAJI3 type=del size=3277719 2024-09-12T17:28:56.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.376+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~WB69WBMGBHWB.0 size=1048576 2024-09-12T17:28:56.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.377+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~WB69WBMGBHWB.1 size=1048576 2024-09-12T17:28:56.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.378+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~WB69WBMGBHWB.2 size=211201 2024-09-12T17:28:56.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.378+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=WB69WBMGBHWB tag=U89ZPUHMHRHF type=write size=3356929 2024-09-12T17:28:56.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.382+0000 7f9d7bc0c780 1 < suggested remove operation key=QB8C0OJA1L4X tag=SHZUFH2N0WR2 type=del 2024-09-12T17:28:56.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.383+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=INRUA2LH0RW2 type=del size=1634798 2024-09-12T17:28:56.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.383+0000 7f9d7bc0c780 1 < canceled part key=_multipart_SDX69F30A2RK.2~6T90LD2DONFD.0 size=1048576 2024-09-12T17:28:56.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.384+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~6T90LD2DONFD.1 size=355906 2024-09-12T17:28:56.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.387+0000 7f9d7bc0c780 1 < canceled multipart upload key=SDX69F30A2RK upload=6T90LD2DONFD tag=7S7NXLBUU3PN type=write size=2453058 2024-09-12T17:28:56.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.388+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=G7CY57MWKP14 type=del size=559523 2024-09-12T17:28:56.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.389+0000 7f9d7bc0c780 1 < completed write operation key=0BYGD7FTPQF3 tag=TSMIC2JL1S8D type=write size=522564 2024-09-12T17:28:56.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.392+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~4ROVX2UK1C4Z.0 size=1048576 2024-09-12T17:28:56.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.393+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~4ROVX2UK1C4Z.1 size=1048576 2024-09-12T17:28:56.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.394+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~4ROVX2UK1C4Z.2 size=927765 2024-09-12T17:28:56.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.394+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=4ROVX2UK1C4Z tag=O9VZXDVMQS3E type=write size=4073493 2024-09-12T17:28:56.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.394+0000 7f9d7bc0c780 1 < canceled part key=_multipart_EUHRVHNVI83I.2~VVMUYJ86PGRQ.0 size=428933 2024-09-12T17:28:56.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.396+0000 7f9d7bc0c780 1 < canceled multipart upload key=EUHRVHNVI83I upload=VVMUYJ86PGRQ tag=4N3Y580BKVVB type=write size=1477509 2024-09-12T17:28:56.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.399+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~EA523OXVN6YL.0 size=1048576 2024-09-12T17:28:56.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.400+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~EA523OXVN6YL.1 size=1048576 2024-09-12T17:28:56.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.401+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~EA523OXVN6YL.2 size=964728 2024-09-12T17:28:56.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.401+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=EA523OXVN6YL tag=1RFHIZC9FJSM type=write size=4110456 2024-09-12T17:28:56.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.403+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=LZKIIFNGNWK5 type=del 2024-09-12T17:28:56.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.404+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=52EA12FWDOAK type=del size=2219810 2024-09-12T17:28:56.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.406+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6K4C8YHC7TOG.0 size=1048576 2024-09-12T17:28:56.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.407+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6K4C8YHC7TOG.1 size=1048576 2024-09-12T17:28:56.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.408+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~6K4C8YHC7TOG.2 size=235878 2024-09-12T17:28:56.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.412+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=6K4C8YHC7TOG tag=SQ9FPMYA91LY type=write size=3381606 2024-09-12T17:28:56.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.413+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=7JJDEPO3UL58 type=write size=138309 2024-09-12T17:28:56.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.416+0000 7f9d7bc0c780 1 < suggested update operation key=EUHRVHNVI83I tag=6VUSIPVBGTS2 type=write size=105119 2024-09-12T17:28:56.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.418+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~GPKD8QP1LBED.0 size=1048576 2024-09-12T17:28:56.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.419+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~GPKD8QP1LBED.1 size=1048576 2024-09-12T17:28:56.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.420+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~GPKD8QP1LBED.2 size=553388 2024-09-12T17:28:56.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.420+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=GPKD8QP1LBED tag=DRKYODGA50A1 type=write size=3699116 2024-09-12T17:28:56.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.422+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~YOSHZLMUSMA2.0 size=1048576 2024-09-12T17:28:56.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.423+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~YOSHZLMUSMA2.1 size=1048576 2024-09-12T17:28:56.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.424+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~YOSHZLMUSMA2.2 size=892640 2024-09-12T17:28:56.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.427+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=YOSHZLMUSMA2 tag=WOUC531PKCWK type=write size=4038368 2024-09-12T17:28:56.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.428+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=PH5O9O1EFCJP type=del size=307987 2024-09-12T17:28:56.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.429+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=FOIBLBY2GJAR type=del 2024-09-12T17:28:56.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.431+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=MUJULOI55MHM type=del size=2900947 2024-09-12T17:28:56.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.432+0000 7f9d7bc0c780 1 < completed write operation key=OZKAXB0ET9R7 tag=ETMTS4S7BZGS type=write size=654756 2024-09-12T17:28:56.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.434+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=Y86EVXFP9E7U type=del size=3421980 2024-09-12T17:28:56.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.435+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=RTL07ITIA6OZ type=del 2024-09-12T17:28:56.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.437+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=5NV1OVV9QR8V type=del size=3015399 2024-09-12T17:28:56.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.438+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=OC62J1B6JBL1 type=del 2024-09-12T17:28:56.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.441+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~TLO3C2BW8RR8.0 size=423030 2024-09-12T17:28:56.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.441+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=TLO3C2BW8RR8 tag=J4GBUK4FENW1 type=write size=1471606 2024-09-12T17:28:56.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.442+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=ZCHTD7IR26KT type=del 2024-09-12T17:28:56.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.445+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~V2B29KP8NVE9.0 size=248708 2024-09-12T17:28:56.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.445+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=V2B29KP8NVE9 tag=769B6JJIV1S4 type=write size=1297284 2024-09-12T17:28:56.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.448+0000 7f9d7bc0c780 1 < suggested update operation key=ZA6JC3WXS8Y5 tag=Z30050E33C6G type=del size=3811043 2024-09-12T17:28:56.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.449+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=T7AZE8XER93Q type=del size=4067991 2024-09-12T17:28:56.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.450+0000 7f9d7bc0c780 1 < canceled operation key=ZM8NMC18RN3I tag=2HUCSPQVIFSF type=del size=1505314 2024-09-12T17:28:56.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.452+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=3CTYA40UOLGF type=del size=365790 2024-09-12T17:28:56.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.453+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~WB69WBMGBHWB.0 size=1048576 2024-09-12T17:28:56.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.454+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~WB69WBMGBHWB.1 size=1048576 2024-09-12T17:28:56.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.455+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~WB69WBMGBHWB.2 size=211201 2024-09-12T17:28:56.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.458+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=WB69WBMGBHWB tag=U89ZPUHMHRHF type=write size=3356929 2024-09-12T17:28:56.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.460+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~TBD99A4GEGPC.0 size=1048576 2024-09-12T17:28:56.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.462+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~TBD99A4GEGPC.1 size=385905 2024-09-12T17:28:56.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.462+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=TBD99A4GEGPC tag=F06BPXPNKTNK type=write size=2483057 2024-09-12T17:28:56.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.463+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=INRUA2LH0RW2 type=del 2024-09-12T17:28:56.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.465+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=TCKE2H55ZVU4 type=write size=688665 2024-09-12T17:28:56.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.468+0000 7f9d7bc0c780 1 < suggested update operation key=J3YYRIVKQ5AU tag=G7CY57MWKP14 type=del size=559523 2024-09-12T17:28:56.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.471+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~DB1SM3GE84KV.0 size=401302 2024-09-12T17:28:56.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.471+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=DB1SM3GE84KV tag=J5APAHQ226HB type=write size=1449878 2024-09-12T17:28:56.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.472+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~4ROVX2UK1C4Z.0 size=1048576 2024-09-12T17:28:56.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.473+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~4ROVX2UK1C4Z.1 size=1048576 2024-09-12T17:28:56.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.474+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~4ROVX2UK1C4Z.2 size=927765 2024-09-12T17:28:56.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.477+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=4ROVX2UK1C4Z tag=O9VZXDVMQS3E type=write size=4073493 2024-09-12T17:28:56.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.479+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~DE0NA5QU25AU.0 size=1048576 2024-09-12T17:28:56.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.481+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~DE0NA5QU25AU.1 size=255913 2024-09-12T17:28:56.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.481+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=DE0NA5QU25AU tag=05ZONBDJW532 type=write size=2353065 2024-09-12T17:28:56.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.482+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~EA523OXVN6YL.0 size=1048576 2024-09-12T17:28:56.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.485+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~EA523OXVN6YL.1 size=1048576 2024-09-12T17:28:56.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.486+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~EA523OXVN6YL.2 size=964728 2024-09-12T17:28:56.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.489+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=EA523OXVN6YL tag=1RFHIZC9FJSM type=write size=4110456 2024-09-12T17:28:56.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.490+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=61AG7V01S60Y type=del size=2575282 2024-09-12T17:28:56.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.493+0000 7f9d7bc0c780 1 < suggested remove operation key=J3YYRIVKQ5AU tag=52EA12FWDOAK type=del 2024-09-12T17:28:56.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.495+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~YTNZNOVZOEQP.0 size=778793 2024-09-12T17:28:56.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.495+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=YTNZNOVZOEQP tag=WHXFBAMKU801 type=write size=1827369 2024-09-12T17:28:56.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.498+0000 7f9d7bc0c780 1 < suggested update operation key=M3Q7I7MD7M4I tag=7JJDEPO3UL58 type=write size=138309 2024-09-12T17:28:56.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.500+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=054JJS4YL82B type=write size=13585 2024-09-12T17:28:56.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.501+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~GPKD8QP1LBED.0 size=1048576 2024-09-12T17:28:56.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.502+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~GPKD8QP1LBED.1 size=1048576 2024-09-12T17:28:56.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.503+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~GPKD8QP1LBED.2 size=553388 2024-09-12T17:28:56.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.505+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=GPKD8QP1LBED tag=DRKYODGA50A1 type=write size=3699116 2024-09-12T17:28:56.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.510+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~0Q5ODK2I5570.0 size=1048576 2024-09-12T17:28:56.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.511+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~0Q5ODK2I5570.1 size=1048576 2024-09-12T17:28:56.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.512+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~0Q5ODK2I5570.2 size=332320 2024-09-12T17:28:56.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.512+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=0Q5ODK2I5570 tag=NJ2XUSOK3JWO type=write size=3478048 2024-09-12T17:28:56.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.513+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=PH5O9O1EFCJP type=del 2024-09-12T17:28:56.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.515+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=132807R83OAK type=del size=3696895 2024-09-12T17:28:56.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.517+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=MUJULOI55MHM type=del 2024-09-12T17:28:56.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.519+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=HKH4ATR0KWCM type=del size=1703972 2024-09-12T17:28:56.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.520+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=Y86EVXFP9E7U type=del 2024-09-12T17:28:56.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.523+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~Z6TZ450RYJ7K.0 size=1048576 2024-09-12T17:28:56.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.524+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~Z6TZ450RYJ7K.1 size=651081 2024-09-12T17:28:56.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.524+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=Z6TZ450RYJ7K tag=D4P4VDOFDK6I type=write size=2748233 2024-09-12T17:28:56.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.525+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=5NV1OVV9QR8V type=del 2024-09-12T17:28:56.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.527+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=T5QKDM8ADQU8 type=write size=644244 2024-09-12T17:28:56.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.528+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~TLO3C2BW8RR8.0 size=423030 2024-09-12T17:28:56.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.531+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=TLO3C2BW8RR8 tag=J4GBUK4FENW1 type=write size=1471606 2024-09-12T17:28:56.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.532+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=U81N7IMAC2GT type=del size=2247027 2024-09-12T17:28:56.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.533+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~V2B29KP8NVE9.0 size=248708 2024-09-12T17:28:56.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.536+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=V2B29KP8NVE9 tag=769B6JJIV1S4 type=write size=1297284 2024-09-12T17:28:56.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.538+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~A50NN1GAY1G6.0 size=1048576 2024-09-12T17:28:56.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.540+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~A50NN1GAY1G6.1 size=1048576 2024-09-12T17:28:56.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.541+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~A50NN1GAY1G6.2 size=754394 2024-09-12T17:28:56.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.541+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=A50NN1GAY1G6 tag=UZDNGFVHQNO8 type=write size=3900122 2024-09-12T17:28:56.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.542+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=T7AZE8XER93Q type=del 2024-09-12T17:28:56.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.545+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~DGX0QPNJBZ2H.0 size=1048576 2024-09-12T17:28:56.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.546+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~DGX0QPNJBZ2H.1 size=149013 2024-09-12T17:28:56.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.546+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=DGX0QPNJBZ2H tag=FHPYF9KKL5LP type=write size=2246165 2024-09-12T17:28:56.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.547+0000 7f9d7bc0c780 1 < canceled operation key=9TE5N5TIB7AD tag=3CTYA40UOLGF type=del size=365790 2024-09-12T17:28:56.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.548+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=K3QITUZMUOTI type=write size=554320 2024-09-12T17:28:56.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.550+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~TBD99A4GEGPC.0 size=1048576 2024-09-12T17:28:56.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.551+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~TBD99A4GEGPC.1 size=385905 2024-09-12T17:28:56.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.554+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=TBD99A4GEGPC tag=F06BPXPNKTNK type=write size=2483057 2024-09-12T17:28:56.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.556+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=6DJ9OQG34YUW type=del size=433380 2024-09-12T17:28:56.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.560+0000 7f9d7bc0c780 1 < suggested remove operation key=9B83KWC5E4ZV tag=TCKE2H55ZVU4 type=write 2024-09-12T17:28:56.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.563+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~GNPZAS952RCG.0 size=917576 2024-09-12T17:28:56.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.563+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=GNPZAS952RCG tag=RJONSUNMUZRM type=write size=1966152 2024-09-12T17:28:56.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.564+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~DB1SM3GE84KV.0 size=401302 2024-09-12T17:28:56.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.566+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=DB1SM3GE84KV tag=J5APAHQ226HB type=write size=1449878 2024-09-12T17:28:56.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.568+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=TBRN9NTQ8QBT type=del size=3251903 2024-09-12T17:28:56.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.569+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~DE0NA5QU25AU.0 size=1048576 2024-09-12T17:28:56.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.570+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~DE0NA5QU25AU.1 size=255913 2024-09-12T17:28:56.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.573+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=DE0NA5QU25AU tag=05ZONBDJW532 type=write size=2353065 2024-09-12T17:28:56.575 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.574+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=1QNZ699M5MOH type=del size=38681 2024-09-12T17:28:56.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.576+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=61AG7V01S60Y type=del 2024-09-12T17:28:56.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.579+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~CGBGVAJISPUT.0 size=956805 2024-09-12T17:28:56.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.579+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=CGBGVAJISPUT tag=MHN45NFY389F type=write size=2005381 2024-09-12T17:28:56.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.579+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~YTNZNOVZOEQP.0 size=778793 2024-09-12T17:28:56.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.581+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=YTNZNOVZOEQP tag=WHXFBAMKU801 type=write size=1827369 2024-09-12T17:28:56.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.584+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1UUWCW57DEWU.0 size=1048576 2024-09-12T17:28:56.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.585+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1UUWCW57DEWU.1 size=1048576 2024-09-12T17:28:56.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.586+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1UUWCW57DEWU.2 size=311286 2024-09-12T17:28:56.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.586+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=1UUWCW57DEWU tag=44LFN5MRXWDV type=write size=3457014 2024-09-12T17:28:56.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.588+0000 7f9d7bc0c780 1 < completed write operation key=G5ZKTTY1XQ9T tag=054JJS4YL82B type=write size=13585 2024-09-12T17:28:56.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.589+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=LNA7Z838FZH3 type=write size=614927 2024-09-12T17:28:56.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.591+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~0Q5ODK2I5570.0 size=1048576 2024-09-12T17:28:56.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.591+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~0Q5ODK2I5570.1 size=1048576 2024-09-12T17:28:56.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.592+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~0Q5ODK2I5570.2 size=332320 2024-09-12T17:28:56.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.594+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=0Q5ODK2I5570 tag=NJ2XUSOK3JWO type=write size=3478048 2024-09-12T17:28:56.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.597+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~X5CRCK24XOQM.0 size=1048576 2024-09-12T17:28:56.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.598+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~X5CRCK24XOQM.1 size=464799 2024-09-12T17:28:56.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.598+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=X5CRCK24XOQM tag=NR4X40PN52R3 type=write size=2561951 2024-09-12T17:28:56.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.599+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=132807R83OAK type=del 2024-09-12T17:28:56.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.601+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=5HEX9VXRHZ8K type=del size=2111079 2024-09-12T17:28:56.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.602+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=HKH4ATR0KWCM type=del 2024-09-12T17:28:56.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.604+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=4VUQ4W85CIUX type=del size=2658533 2024-09-12T17:28:56.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.605+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~Z6TZ450RYJ7K.0 size=1048576 2024-09-12T17:28:56.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.606+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~Z6TZ450RYJ7K.1 size=651081 2024-09-12T17:28:56.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.608+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=Z6TZ450RYJ7K tag=D4P4VDOFDK6I type=write size=2748233 2024-09-12T17:28:56.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.610+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=UGVRSWDTW8BV type=del size=607931 2024-09-12T17:28:56.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.612+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=T5QKDM8ADQU8 type=write 2024-09-12T17:28:56.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.615+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~0EWLINT7QYRY.0 size=1048576 2024-09-12T17:28:56.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.616+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~0EWLINT7QYRY.1 size=1048576 2024-09-12T17:28:56.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.618+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~0EWLINT7QYRY.2 size=497234 2024-09-12T17:28:56.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.618+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=0EWLINT7QYRY tag=XD9SGGD9GQQ9 type=write size=3642962 2024-09-12T17:28:56.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.621+0000 7f9d7bc0c780 1 < suggested remove operation key=0NGHC5GMSGRX tag=U81N7IMAC2GT type=del 2024-09-12T17:28:56.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.623+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~WS60D9L9MNQM.0 size=1048576 2024-09-12T17:28:56.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.624+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~WS60D9L9MNQM.1 size=1048576 2024-09-12T17:28:56.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.626+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~WS60D9L9MNQM.2 size=312423 2024-09-12T17:28:56.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.626+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=WS60D9L9MNQM tag=QUBIAHOD2JQ7 type=write size=3458151 2024-09-12T17:28:56.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.626+0000 7f9d7bc0c780 1 < canceled part key=_multipart_W1SE9R6KU04G.2~A50NN1GAY1G6.0 size=1048576 2024-09-12T17:28:56.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.627+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~A50NN1GAY1G6.1 size=1048576 2024-09-12T17:28:56.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.628+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~A50NN1GAY1G6.2 size=754394 2024-09-12T17:28:56.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.630+0000 7f9d7bc0c780 1 < canceled multipart upload key=W1SE9R6KU04G upload=A50NN1GAY1G6 tag=UZDNGFVHQNO8 type=write size=3900122 2024-09-12T17:28:56.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.633+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~NFT7ASC1PBF2.0 size=1048576 2024-09-12T17:28:56.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.634+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~NFT7ASC1PBF2.1 size=436104 2024-09-12T17:28:56.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.634+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=NFT7ASC1PBF2 tag=XC2XALGDR9UQ type=write size=2533256 2024-09-12T17:28:56.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.636+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~DGX0QPNJBZ2H.0 size=1048576 2024-09-12T17:28:56.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.637+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~DGX0QPNJBZ2H.1 size=149013 2024-09-12T17:28:56.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.639+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=DGX0QPNJBZ2H tag=FHPYF9KKL5LP type=write size=2246165 2024-09-12T17:28:56.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.642+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~SPFN5089J9H4.0 size=1048576 2024-09-12T17:28:56.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.643+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~SPFN5089J9H4.1 size=1048576 2024-09-12T17:28:56.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.644+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~SPFN5089J9H4.2 size=840794 2024-09-12T17:28:56.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.644+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=SPFN5089J9H4 tag=B4J3VVME8U1H type=write size=3986522 2024-09-12T17:28:56.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.647+0000 7f9d7bc0c780 1 < suggested update operation key=0JN5WWDYEM6Q tag=K3QITUZMUOTI type=write size=554320 2024-09-12T17:28:56.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.648+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=5J5LVWTZVTKT type=del size=900937 2024-09-12T17:28:56.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.651+0000 7f9d7bc0c780 1 < canceled operation key=AOT2ZKFTD0HY tag=6DJ9OQG34YUW type=del size=433380 2024-09-12T17:28:56.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.652+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=43Y0SFKELE64 type=del size=4139514 2024-09-12T17:28:56.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.652+0000 7f9d7bc0c780 1 < canceled part key=_multipart_QB8C0OJA1L4X.2~GNPZAS952RCG.0 size=917576 2024-09-12T17:28:56.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.655+0000 7f9d7bc0c780 1 < canceled multipart upload key=QB8C0OJA1L4X upload=GNPZAS952RCG tag=RJONSUNMUZRM type=write size=1966152 2024-09-12T17:28:56.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.656+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=4Y3JJV5VU8VW type=write size=434177 2024-09-12T17:28:56.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.657+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=TBRN9NTQ8QBT type=del 2024-09-12T17:28:56.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.660+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~AP8IRCIOP6W5.0 size=1048576 2024-09-12T17:28:56.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.661+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~AP8IRCIOP6W5.1 size=985853 2024-09-12T17:28:56.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.661+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=AP8IRCIOP6W5 tag=8M0C3YPN58X5 type=write size=3083005 2024-09-12T17:28:56.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.663+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=1QNZ699M5MOH type=del 2024-09-12T17:28:56.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.665+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=WQBQZ1LB4AWB type=write size=591450 2024-09-12T17:28:56.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.666+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~CGBGVAJISPUT.0 size=956805 2024-09-12T17:28:56.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.669+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=CGBGVAJISPUT tag=MHN45NFY389F type=write size=2005381 2024-09-12T17:28:56.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.672+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~6LG9D0LP81J0.0 size=1048576 2024-09-12T17:28:56.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.673+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~6LG9D0LP81J0.1 size=1048576 2024-09-12T17:28:56.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.674+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~6LG9D0LP81J0.2 size=349688 2024-09-12T17:28:56.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.674+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=6LG9D0LP81J0 tag=2KCY29SY3ZU4 type=write size=3495416 2024-09-12T17:28:56.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.676+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1UUWCW57DEWU.0 size=1048576 2024-09-12T17:28:56.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.677+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1UUWCW57DEWU.1 size=1048576 2024-09-12T17:28:56.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.678+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1UUWCW57DEWU.2 size=311286 2024-09-12T17:28:56.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.680+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=1UUWCW57DEWU tag=44LFN5MRXWDV type=write size=3457014 2024-09-12T17:28:56.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.682+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=9XIGXLEO0U3B type=del size=552672 2024-09-12T17:28:56.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.685+0000 7f9d7bc0c780 1 < suggested remove operation key=R94VERREGANN tag=LNA7Z838FZH3 type=write 2024-09-12T17:28:56.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.687+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~0XKH4MV6X7OU.0 size=597337 2024-09-12T17:28:56.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.687+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=0XKH4MV6X7OU tag=FWYC0U9LGTT2 type=write size=1645913 2024-09-12T17:28:56.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.689+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~X5CRCK24XOQM.0 size=1048576 2024-09-12T17:28:56.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.690+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~X5CRCK24XOQM.1 size=464799 2024-09-12T17:28:56.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.692+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=X5CRCK24XOQM tag=NR4X40PN52R3 type=write size=2561951 2024-09-12T17:28:56.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.694+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=4VMFBADAFI95 type=del size=2051641 2024-09-12T17:28:56.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.695+0000 7f9d7bc0c780 1 < canceled operation key=LU8MLGM7H0CE tag=5HEX9VXRHZ8K type=del size=2111079 2024-09-12T17:28:56.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.697+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=VJ1Z4D5K53MK type=del size=2921461 2024-09-12T17:28:56.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.699+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=4VUQ4W85CIUX type=del 2024-09-12T17:28:56.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.701+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~P1ATVSRP84K4.0 size=1048576 2024-09-12T17:28:56.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.703+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~P1ATVSRP84K4.1 size=1048576 2024-09-12T17:28:56.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.704+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~P1ATVSRP84K4.2 size=850626 2024-09-12T17:28:56.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.704+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=P1ATVSRP84K4 tag=ZX9Z4ZZ89UDC type=write size=3996354 2024-09-12T17:28:56.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.705+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=UGVRSWDTW8BV type=del 2024-09-12T17:28:56.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.708+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~8L8FCNWZZDU1.0 size=1048576 2024-09-12T17:28:56.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.709+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~8L8FCNWZZDU1.1 size=1048576 2024-09-12T17:28:56.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.710+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~8L8FCNWZZDU1.2 size=215828 2024-09-12T17:28:56.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.710+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=8L8FCNWZZDU1 tag=X54TZLV61AA7 type=write size=3361556 2024-09-12T17:28:56.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.711+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~0EWLINT7QYRY.0 size=1048576 2024-09-12T17:28:56.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.713+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~0EWLINT7QYRY.1 size=1048576 2024-09-12T17:28:56.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.714+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~0EWLINT7QYRY.2 size=497234 2024-09-12T17:28:56.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.716+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=0EWLINT7QYRY tag=XD9SGGD9GQQ9 type=write size=3642962 2024-09-12T17:28:56.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.720+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~8SVYWT31S3AP.0 size=1048576 2024-09-12T17:28:56.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.721+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~8SVYWT31S3AP.1 size=294116 2024-09-12T17:28:56.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.721+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=8SVYWT31S3AP tag=7N9H8Y47O68L type=write size=2391268 2024-09-12T17:28:56.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.723+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~WS60D9L9MNQM.0 size=1048576 2024-09-12T17:28:56.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.724+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~WS60D9L9MNQM.1 size=1048576 2024-09-12T17:28:56.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.726+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~WS60D9L9MNQM.2 size=312423 2024-09-12T17:28:56.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.729+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=WS60D9L9MNQM tag=QUBIAHOD2JQ7 type=write size=3458151 2024-09-12T17:28:56.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.731+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=79EXLFPW47WD type=del size=438717 2024-09-12T17:28:56.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.734+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~NFT7ASC1PBF2.0 size=1048576 2024-09-12T17:28:56.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.735+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~NFT7ASC1PBF2.1 size=436104 2024-09-12T17:28:56.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.737+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=NFT7ASC1PBF2 tag=XC2XALGDR9UQ type=write size=2533256 2024-09-12T17:28:56.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.739+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=QF2FBARM9XK9 type=del size=76667 2024-09-12T17:28:56.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.740+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~SPFN5089J9H4.0 size=1048576 2024-09-12T17:28:56.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.741+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~SPFN5089J9H4.1 size=1048576 2024-09-12T17:28:56.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.743+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~SPFN5089J9H4.2 size=840794 2024-09-12T17:28:56.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.745+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=SPFN5089J9H4 tag=B4J3VVME8U1H type=write size=3986522 2024-09-12T17:28:56.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.747+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=A54K7ZRA3RKC type=del size=3657210 2024-09-12T17:28:56.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.749+0000 7f9d7bc0c780 1 < suggested update operation key=QB8C0OJA1L4X tag=5J5LVWTZVTKT type=del size=900937 2024-09-12T17:28:56.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.751+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=S2Y7VY9JZU6A type=del size=3932756 2024-09-12T17:28:56.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.754+0000 7f9d7bc0c780 1 < suggested update operation key=31PU0U6IEAV2 tag=43Y0SFKELE64 type=del size=4139514 2024-09-12T17:28:56.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.756+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~G18AOR8CC3X5.0 size=587060 2024-09-12T17:28:56.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.756+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=G18AOR8CC3X5 tag=A6E9LU9OM46Z type=write size=1635636 2024-09-12T17:28:56.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.757+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=4Y3JJV5VU8VW type=write size=434177 2024-09-12T17:28:56.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.760+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~5Y7J54LGOVKR.0 size=1048576 2024-09-12T17:28:56.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.761+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~5Y7J54LGOVKR.1 size=1048576 2024-09-12T17:28:56.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.762+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~5Y7J54LGOVKR.2 size=182444 2024-09-12T17:28:56.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.762+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=5Y7J54LGOVKR tag=QDIQ5U5YE5CZ type=write size=3328172 2024-09-12T17:28:56.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.764+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~AP8IRCIOP6W5.0 size=1048576 2024-09-12T17:28:56.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.765+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~AP8IRCIOP6W5.1 size=985853 2024-09-12T17:28:56.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.768+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=AP8IRCIOP6W5 tag=8M0C3YPN58X5 type=write size=3083005 2024-09-12T17:28:56.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.769+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=31TMZPNQBB4R type=write size=569390 2024-09-12T17:28:56.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.772+0000 7f9d7bc0c780 1 < suggested update operation key=ZM8NMC18RN3I tag=WQBQZ1LB4AWB type=write size=591450 2024-09-12T17:28:56.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.774+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=JUR4QB29ZRHU type=del size=637422 2024-09-12T17:28:56.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.775+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~6LG9D0LP81J0.0 size=1048576 2024-09-12T17:28:56.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.777+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~6LG9D0LP81J0.1 size=1048576 2024-09-12T17:28:56.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.777+0000 7f9d7bc0c780 1 < canceled part key=_multipart_G5ZKTTY1XQ9T.2~6LG9D0LP81J0.2 size=349688 2024-09-12T17:28:56.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.779+0000 7f9d7bc0c780 1 < canceled multipart upload key=G5ZKTTY1XQ9T upload=6LG9D0LP81J0 tag=2KCY29SY3ZU4 type=write size=3495416 2024-09-12T17:28:56.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.781+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=ARM4YBIDEOMM type=del size=3708745 2024-09-12T17:28:56.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.784+0000 7f9d7bc0c780 1 < suggested remove operation key=QB8C0OJA1L4X tag=9XIGXLEO0U3B type=del 2024-09-12T17:28:56.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.785+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=FUOQ1E1FXMBR type=del size=1707244 2024-09-12T17:28:56.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.787+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~0XKH4MV6X7OU.0 size=597337 2024-09-12T17:28:56.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.790+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=0XKH4MV6X7OU tag=FWYC0U9LGTT2 type=write size=1645913 2024-09-12T17:28:56.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.792+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=ENV1U1GLTN26 type=del size=2011801 2024-09-12T17:28:56.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.793+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=4VMFBADAFI95 type=del 2024-09-12T17:28:56.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.796+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~QCEQOS8A01X1.0 size=1048576 2024-09-12T17:28:56.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.797+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~QCEQOS8A01X1.1 size=22384 2024-09-12T17:28:56.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.797+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=QCEQOS8A01X1 tag=CCL1AQ6JPGO5 type=write size=2119536 2024-09-12T17:28:56.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.798+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=VJ1Z4D5K53MK type=del 2024-09-12T17:28:56.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.800+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=O27IOOHZIO0I type=del size=3876725 2024-09-12T17:28:56.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.800+0000 7f9d7bc0c780 1 < canceled part key=_multipart_31PU0U6IEAV2.2~P1ATVSRP84K4.0 size=1048576 2024-09-12T17:28:56.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.801+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~P1ATVSRP84K4.1 size=1048576 2024-09-12T17:28:56.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.801+0000 7f9d7bc0c780 1 < canceled part key=_multipart_31PU0U6IEAV2.2~P1ATVSRP84K4.2 size=850626 2024-09-12T17:28:56.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.803+0000 7f9d7bc0c780 1 < canceled multipart upload key=31PU0U6IEAV2 upload=P1ATVSRP84K4 tag=ZX9Z4ZZ89UDC type=write size=3996354 2024-09-12T17:28:56.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.805+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=1LXO7E4JDMZX type=del size=508095 2024-09-12T17:28:56.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.805+0000 7f9d7bc0c780 1 < canceled part key=_multipart_W1SE9R6KU04G.2~8L8FCNWZZDU1.0 size=1048576 2024-09-12T17:28:56.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.806+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~8L8FCNWZZDU1.1 size=1048576 2024-09-12T17:28:56.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.807+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~8L8FCNWZZDU1.2 size=215828 2024-09-12T17:28:56.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.811+0000 7f9d7bc0c780 1 < canceled multipart upload key=W1SE9R6KU04G upload=8L8FCNWZZDU1 tag=X54TZLV61AA7 type=write size=3361556 2024-09-12T17:28:56.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.813+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=JZ81DO2VWC65 type=del size=1474785 2024-09-12T17:28:56.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.813+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9TE5N5TIB7AD.2~8SVYWT31S3AP.0 size=1048576 2024-09-12T17:28:56.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.814+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~8SVYWT31S3AP.1 size=294116 2024-09-12T17:28:56.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.817+0000 7f9d7bc0c780 1 < canceled multipart upload key=9TE5N5TIB7AD upload=8SVYWT31S3AP tag=7N9H8Y47O68L type=write size=2391268 2024-09-12T17:28:56.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.819+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~MJRRQFL3SPCJ.0 size=1048576 2024-09-12T17:28:56.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.820+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~MJRRQFL3SPCJ.1 size=1048576 2024-09-12T17:28:56.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.821+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~MJRRQFL3SPCJ.2 size=30690 2024-09-12T17:28:56.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.821+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=MJRRQFL3SPCJ tag=Z4ICUJD3H8Z7 type=write size=3176418 2024-09-12T17:28:56.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.823+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=79EXLFPW47WD type=del 2024-09-12T17:28:56.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.826+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~5YJ08KY501H6.0 size=1048576 2024-09-12T17:28:56.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.827+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~5YJ08KY501H6.1 size=960523 2024-09-12T17:28:56.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.827+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=5YJ08KY501H6 tag=QGFON5LW5CAI type=write size=3057675 2024-09-12T17:28:56.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.829+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=QF2FBARM9XK9 type=del 2024-09-12T17:28:56.831 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.830+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=YWTRYUF8KF2O type=del size=1078195 2024-09-12T17:28:56.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.832+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=A54K7ZRA3RKC type=del 2024-09-12T17:28:56.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.834+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=ZM11P2SAA6SE type=del size=3722349 2024-09-12T17:28:56.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.836+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=S2Y7VY9JZU6A type=del 2024-09-12T17:28:56.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.837+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=IQMFGY3Z6Z5B type=del size=1587185 2024-09-12T17:28:56.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.839+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~G18AOR8CC3X5.0 size=587060 2024-09-12T17:28:56.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.841+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=G18AOR8CC3X5 tag=A6E9LU9OM46Z type=write size=1635636 2024-09-12T17:28:56.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.844+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~WBPS7B8IB9PI.0 size=392572 2024-09-12T17:28:56.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.844+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=WBPS7B8IB9PI tag=7HMF587IEB8Z type=write size=1441148 2024-09-12T17:28:56.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.845+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~5Y7J54LGOVKR.0 size=1048576 2024-09-12T17:28:56.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.846+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~5Y7J54LGOVKR.1 size=1048576 2024-09-12T17:28:56.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.847+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~5Y7J54LGOVKR.2 size=182444 2024-09-12T17:28:56.851 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.850+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=5Y7J54LGOVKR tag=QDIQ5U5YE5CZ type=write size=3328172 2024-09-12T17:28:56.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.852+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~1L0PMXE85ZP0.0 size=8801 2024-09-12T17:28:56.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.852+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=1L0PMXE85ZP0 tag=4326RGH6INCI type=write size=1057377 2024-09-12T17:28:56.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.854+0000 7f9d7bc0c780 1 < completed write operation key=0BYGD7FTPQF3 tag=31TMZPNQBB4R type=write size=569390 2024-09-12T17:28:56.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.855+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=MAM3403Y3HNI type=del size=2496852 2024-09-12T17:28:56.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.857+0000 7f9d7bc0c780 1 < completed delete operation key=SDX69F30A2RK tag=JUR4QB29ZRHU type=del 2024-09-12T17:28:56.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.859+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~GBBU90L73M2E.0 size=451004 2024-09-12T17:28:56.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.859+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=GBBU90L73M2E tag=WLDF23OU9MWK type=write size=1499580 2024-09-12T17:28:56.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.862+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=ARM4YBIDEOMM type=del 2024-09-12T17:28:56.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.865+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~8Z8G1R6LXQIE.0 size=1048576 2024-09-12T17:28:56.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.866+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~8Z8G1R6LXQIE.1 size=662020 2024-09-12T17:28:56.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.866+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=8Z8G1R6LXQIE tag=R3HDY7RQUYGS type=write size=2759172 2024-09-12T17:28:56.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.868+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=FUOQ1E1FXMBR type=del 2024-09-12T17:28:56.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.870+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~Q1STW0ACB82K.0 size=1048576 2024-09-12T17:28:56.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.872+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~Q1STW0ACB82K.1 size=210093 2024-09-12T17:28:56.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.872+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=Q1STW0ACB82K tag=9TWJ3LNHV2U3 type=write size=2307245 2024-09-12T17:28:56.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.873+0000 7f9d7bc0c780 -1 < failed to complete operation key=W1SE9R6KU04G tag=ENV1U1GLTN26 type=del size=2011801: (22) Invalid argument 2024-09-12T17:28:56.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.875+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=VAYLAZH9BPJ1 type=del size=2449123 2024-09-12T17:28:56.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.876+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~QCEQOS8A01X1.0 size=1048576 2024-09-12T17:28:56.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.878+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~QCEQOS8A01X1.1 size=22384 2024-09-12T17:28:56.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.880+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=QCEQOS8A01X1 tag=CCL1AQ6JPGO5 type=write size=2119536 2024-09-12T17:28:56.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.881+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=H9Z3U619X53U type=del size=812195 2024-09-12T17:28:56.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.884+0000 7f9d7bc0c780 1 < suggested update operation key=LJZNPSVLS9AF tag=O27IOOHZIO0I type=del size=3876725 2024-09-12T17:28:56.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.887+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~OY9I02I5KYPT.0 size=1048576 2024-09-12T17:28:56.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.888+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~OY9I02I5KYPT.1 size=248632 2024-09-12T17:28:56.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.888+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=OY9I02I5KYPT tag=V8NW6H9NLWOH type=write size=2345784 2024-09-12T17:28:56.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.889+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=1LXO7E4JDMZX type=del 2024-09-12T17:28:56.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.893+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~VH032CDAJX65.0 size=245865 2024-09-12T17:28:56.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.893+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=VH032CDAJX65 tag=VS8IUVE9LJGE type=write size=1294441 2024-09-12T17:28:56.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.894+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=JZ81DO2VWC65 type=del 2024-09-12T17:28:56.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.897+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~60VBUOS62SUS.0 size=1048576 2024-09-12T17:28:56.899 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.898+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~60VBUOS62SUS.1 size=1048576 2024-09-12T17:28:56.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.899+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~60VBUOS62SUS.2 size=504534 2024-09-12T17:28:56.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.899+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=60VBUOS62SUS tag=2T26242E3XHC type=write size=3650262 2024-09-12T17:28:56.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.901+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~MJRRQFL3SPCJ.0 size=1048576 2024-09-12T17:28:56.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.902+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~MJRRQFL3SPCJ.1 size=1048576 2024-09-12T17:28:56.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.903+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~MJRRQFL3SPCJ.2 size=30690 2024-09-12T17:28:56.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.905+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=MJRRQFL3SPCJ tag=Z4ICUJD3H8Z7 type=write size=3176418 2024-09-12T17:28:56.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.908+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~M3UF91N5JQC0.0 size=1048576 2024-09-12T17:28:56.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.909+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~M3UF91N5JQC0.1 size=882036 2024-09-12T17:28:56.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.910+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=M3UF91N5JQC0 tag=A17XNGHZ3931 type=write size=2979188 2024-09-12T17:28:56.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.911+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~5YJ08KY501H6.0 size=1048576 2024-09-12T17:28:56.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.912+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~5YJ08KY501H6.1 size=960523 2024-09-12T17:28:56.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.914+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=5YJ08KY501H6 tag=QGFON5LW5CAI type=write size=3057675 2024-09-12T17:28:56.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.917+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~D2JL7N4Z92FW.0 size=1048576 2024-09-12T17:28:56.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.918+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~D2JL7N4Z92FW.1 size=1048576 2024-09-12T17:28:56.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.919+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~D2JL7N4Z92FW.2 size=376066 2024-09-12T17:28:56.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.919+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=D2JL7N4Z92FW tag=YSCDWTP2V5EE type=write size=3521794 2024-09-12T17:28:56.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.921+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=YWTRYUF8KF2O type=del 2024-09-12T17:28:56.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.922+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=MCFD050MGNKC type=del size=3457520 2024-09-12T17:28:56.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.924+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=ZM11P2SAA6SE type=del 2024-09-12T17:28:56.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.925+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=4RL6XGNQXSZJ type=del size=2003766 2024-09-12T17:28:56.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.929+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=IQMFGY3Z6Z5B type=del 2024-09-12T17:28:56.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.930+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=ORO1S7U6QTEL type=del size=3335254 2024-09-12T17:28:56.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.932+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~WBPS7B8IB9PI.0 size=392572 2024-09-12T17:28:56.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.934+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=WBPS7B8IB9PI tag=7HMF587IEB8Z type=write size=1441148 2024-09-12T17:28:56.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.935+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=GKA2N3N2LCQ9 type=del size=3134968 2024-09-12T17:28:56.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.937+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~1L0PMXE85ZP0.0 size=8801 2024-09-12T17:28:56.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.940+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=1L0PMXE85ZP0 tag=4326RGH6INCI type=write size=1057377 2024-09-12T17:28:56.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.943+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~K9ID0H1QQL98.0 size=393736 2024-09-12T17:28:56.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.943+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=K9ID0H1QQL98 tag=FMTU5UBIU3Q9 type=write size=1442312 2024-09-12T17:28:56.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.945+0000 7f9d7bc0c780 1 < suggested remove operation key=L72DVWQ63XUW tag=MAM3403Y3HNI type=del 2024-09-12T17:28:56.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.948+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~XEUYFZXLFM24.0 size=853408 2024-09-12T17:28:56.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.948+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=XEUYFZXLFM24 tag=1Z349FNOLTVH type=write size=1901984 2024-09-12T17:28:56.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.949+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~GBBU90L73M2E.0 size=451004 2024-09-12T17:28:56.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.952+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=GBBU90L73M2E tag=WLDF23OU9MWK type=write size=1499580 2024-09-12T17:28:56.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.953+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=AIDDDEVG32S3 type=del size=1143759 2024-09-12T17:28:56.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.955+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~8Z8G1R6LXQIE.0 size=1048576 2024-09-12T17:28:56.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.956+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~8Z8G1R6LXQIE.1 size=662020 2024-09-12T17:28:56.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.958+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=8Z8G1R6LXQIE tag=R3HDY7RQUYGS type=write size=2759172 2024-09-12T17:28:56.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.961+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~RO7E6KRJRJ72.0 size=1048576 2024-09-12T17:28:56.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.962+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~RO7E6KRJRJ72.1 size=1048576 2024-09-12T17:28:56.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.963+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~RO7E6KRJRJ72.2 size=288484 2024-09-12T17:28:56.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.963+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=RO7E6KRJRJ72 tag=MYU1WWS6T0FH type=write size=3434212 2024-09-12T17:28:56.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.965+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~Q1STW0ACB82K.0 size=1048576 2024-09-12T17:28:56.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.966+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~Q1STW0ACB82K.1 size=210093 2024-09-12T17:28:56.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.968+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=Q1STW0ACB82K tag=9TWJ3LNHV2U3 type=write size=2307245 2024-09-12T17:28:56.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.971+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~43F4G5F9J3HB.0 size=1048576 2024-09-12T17:28:56.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.972+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~43F4G5F9J3HB.1 size=654286 2024-09-12T17:28:56.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.972+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=43F4G5F9J3HB tag=BQV4BGS0GALG type=write size=2751438 2024-09-12T17:28:56.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.973+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=VAYLAZH9BPJ1 type=del 2024-09-12T17:28:56.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.975+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=Y81LYT9ABKA3 type=del size=3449521 2024-09-12T17:28:56.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.976+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=H9Z3U619X53U type=del 2024-09-12T17:28:56.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.978+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=M2FWO1RDFG00 type=del size=3047233 2024-09-12T17:28:56.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.979+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~OY9I02I5KYPT.0 size=1048576 2024-09-12T17:28:56.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.980+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~OY9I02I5KYPT.1 size=248632 2024-09-12T17:28:56.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.983+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=OY9I02I5KYPT tag=V8NW6H9NLWOH type=write size=2345784 2024-09-12T17:28:56.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.984+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=2E28XJYIANYW type=del size=1519073 2024-09-12T17:28:56.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.986+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~VH032CDAJX65.0 size=245865 2024-09-12T17:28:56.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.988+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=VH032CDAJX65 tag=VS8IUVE9LJGE type=write size=1294441 2024-09-12T17:28:56.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.990+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~8CRQ3CPT2JGT.0 size=992398 2024-09-12T17:28:56.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.990+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=8CRQ3CPT2JGT tag=VHN2O2UFGMIP type=write size=2040974 2024-09-12T17:28:56.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.992+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~60VBUOS62SUS.0 size=1048576 2024-09-12T17:28:56.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.993+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~60VBUOS62SUS.1 size=1048576 2024-09-12T17:28:56.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.994+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~60VBUOS62SUS.2 size=504534 2024-09-12T17:28:56.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.997+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=60VBUOS62SUS tag=2T26242E3XHC type=write size=3650262 2024-09-12T17:28:56.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:56.998+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=HQV1BQBPBTJ4 type=del size=3483762 2024-09-12T17:28:57.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.000+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~M3UF91N5JQC0.0 size=1048576 2024-09-12T17:28:57.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.000+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~M3UF91N5JQC0.1 size=882036 2024-09-12T17:28:57.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.002+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=M3UF91N5JQC0 tag=A17XNGHZ3931 type=write size=2979188 2024-09-12T17:28:57.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.005+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~I5Y8P7D01V5F.0 size=1048576 2024-09-12T17:28:57.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.006+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~I5Y8P7D01V5F.1 size=882784 2024-09-12T17:28:57.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.006+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=I5Y8P7D01V5F tag=GTX3N040TDD8 type=write size=2979936 2024-09-12T17:28:57.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.008+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~D2JL7N4Z92FW.0 size=1048576 2024-09-12T17:28:57.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.009+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~D2JL7N4Z92FW.1 size=1048576 2024-09-12T17:28:57.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.010+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~D2JL7N4Z92FW.2 size=376066 2024-09-12T17:28:57.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.012+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=D2JL7N4Z92FW tag=YSCDWTP2V5EE type=write size=3521794 2024-09-12T17:28:57.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.013+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=59Z7AEOBFIRS type=write size=413350 2024-09-12T17:28:57.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.015+0000 7f9d7bc0c780 1 < canceled operation key=R94VERREGANN tag=MCFD050MGNKC type=del size=3457520 2024-09-12T17:28:57.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.017+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~45AT78B5APQZ.0 size=300687 2024-09-12T17:28:57.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.017+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=45AT78B5APQZ tag=BJRUAW3IR9JD type=write size=1349263 2024-09-12T17:28:57.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.018+0000 7f9d7bc0c780 1 < canceled operation key=ZA6JC3WXS8Y5 tag=4RL6XGNQXSZJ type=del size=2003766 2024-09-12T17:28:57.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.020+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=XBKBGCOO5MHJ type=del size=261055 2024-09-12T17:28:57.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.021+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=ORO1S7U6QTEL type=del size=3335254 2024-09-12T17:28:57.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.023+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=BWCD0DRIY2FG type=write size=284801 2024-09-12T17:28:57.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.024+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=GKA2N3N2LCQ9 type=del 2024-09-12T17:28:57.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.025+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=PQKXTAXUFE8O type=del size=2540551 2024-09-12T17:28:57.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.027+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~K9ID0H1QQL98.0 size=393736 2024-09-12T17:28:57.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.029+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=K9ID0H1QQL98 tag=FMTU5UBIU3Q9 type=write size=1442312 2024-09-12T17:28:57.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.030+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=51JQ46NGW9GB type=del size=2779931 2024-09-12T17:28:57.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.032+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~XEUYFZXLFM24.0 size=853408 2024-09-12T17:28:57.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.034+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=XEUYFZXLFM24 tag=1Z349FNOLTVH type=write size=1901984 2024-09-12T17:28:57.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.035+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=46IDVR88BXOQ type=del size=1029461 2024-09-12T17:28:57.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.037+0000 7f9d7bc0c780 1 < canceled operation key=LTG0UQEYPUGO tag=AIDDDEVG32S3 type=del size=1143759 2024-09-12T17:28:57.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.038+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=CICTQAWZHMNF type=del size=3614454 2024-09-12T17:28:57.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.040+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~RO7E6KRJRJ72.0 size=1048576 2024-09-12T17:28:57.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.040+0000 7f9d7bc0c780 1 < canceled part key=_multipart_64T291B0U226.2~RO7E6KRJRJ72.1 size=1048576 2024-09-12T17:28:57.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.041+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~RO7E6KRJRJ72.2 size=288484 2024-09-12T17:28:57.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.043+0000 7f9d7bc0c780 1 < canceled multipart upload key=64T291B0U226 upload=RO7E6KRJRJ72 tag=MYU1WWS6T0FH type=write size=3434212 2024-09-12T17:28:57.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.046+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~78YDE01A5Y2H.0 size=1048576 2024-09-12T17:28:57.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.047+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~78YDE01A5Y2H.1 size=1048576 2024-09-12T17:28:57.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.048+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~78YDE01A5Y2H.2 size=780389 2024-09-12T17:28:57.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.048+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=78YDE01A5Y2H tag=Q29SUHX7Q76S type=write size=3926117 2024-09-12T17:28:57.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.050+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~43F4G5F9J3HB.0 size=1048576 2024-09-12T17:28:57.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.051+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~43F4G5F9J3HB.1 size=654286 2024-09-12T17:28:57.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.053+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=43F4G5F9J3HB tag=BQV4BGS0GALG type=write size=2751438 2024-09-12T17:28:57.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.056+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~J4TDAAQQD4KA.0 size=1048576 2024-09-12T17:28:57.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.057+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~J4TDAAQQD4KA.1 size=703136 2024-09-12T17:28:57.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.057+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=J4TDAAQQD4KA tag=47TPL1LZVHO6 type=write size=2800288 2024-09-12T17:28:57.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.062+0000 7f9d7bc0c780 1 < suggested update operation key=80JXIGQWQGR9 tag=Y81LYT9ABKA3 type=del size=3449521 2024-09-12T17:28:57.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.065+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~6DGOSSCK7MJ5.0 size=980367 2024-09-12T17:28:57.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.065+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=6DGOSSCK7MJ5 tag=C7NWU4PC10C0 type=write size=2028943 2024-09-12T17:28:57.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.067+0000 7f9d7bc0c780 1 < suggested remove operation key=NQ0768B94GVV tag=M2FWO1RDFG00 type=del 2024-09-12T17:28:57.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.069+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=Z6NA5O4RHGRZ type=del size=2989462 2024-09-12T17:28:57.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.071+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=2E28XJYIANYW type=del 2024-09-12T17:28:57.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.072+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=EX28Y7DX7QMX type=del size=3090895 2024-09-12T17:28:57.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.073+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~8CRQ3CPT2JGT.0 size=992398 2024-09-12T17:28:57.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.076+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=8CRQ3CPT2JGT tag=VHN2O2UFGMIP type=write size=2040974 2024-09-12T17:28:57.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.077+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=MC7MJWPVHL2N type=del size=1137367 2024-09-12T17:28:57.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.078+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=HQV1BQBPBTJ4 type=del 2024-09-12T17:28:57.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.081+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~32EEJMABILCO.0 size=1005916 2024-09-12T17:28:57.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.081+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=32EEJMABILCO tag=WG1SR3TDRYVZ type=write size=2054492 2024-09-12T17:28:57.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.083+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~I5Y8P7D01V5F.0 size=1048576 2024-09-12T17:28:57.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.084+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~I5Y8P7D01V5F.1 size=882784 2024-09-12T17:28:57.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.086+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=I5Y8P7D01V5F tag=GTX3N040TDD8 type=write size=2979936 2024-09-12T17:28:57.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.088+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=YCJFZ9UG8DIB type=write size=1007349 2024-09-12T17:28:57.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.089+0000 7f9d7bc0c780 1 < completed write operation key=LJZNPSVLS9AF tag=59Z7AEOBFIRS type=write size=413350 2024-09-12T17:28:57.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.092+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~EONUK4B0HWMG.0 size=1048576 2024-09-12T17:28:57.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.093+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~EONUK4B0HWMG.1 size=894805 2024-09-12T17:28:57.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.093+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=EONUK4B0HWMG tag=QC5TB6N5SOGM type=write size=2991957 2024-09-12T17:28:57.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.094+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~45AT78B5APQZ.0 size=300687 2024-09-12T17:28:57.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.096+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=45AT78B5APQZ tag=BJRUAW3IR9JD type=write size=1349263 2024-09-12T17:28:57.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.098+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=KRXTT85SKON3 type=del size=2814975 2024-09-12T17:28:57.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.099+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=XBKBGCOO5MHJ type=del 2024-09-12T17:28:57.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.102+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~42FYCM99AIL6.0 size=1048576 2024-09-12T17:28:57.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.103+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~42FYCM99AIL6.1 size=1048576 2024-09-12T17:28:57.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.105+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~42FYCM99AIL6.2 size=838960 2024-09-12T17:28:57.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.105+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=42FYCM99AIL6 tag=1R30GSNL3A11 type=write size=3984688 2024-09-12T17:28:57.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.106+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=BWCD0DRIY2FG type=write size=284801 2024-09-12T17:28:57.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.109+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~76SJRR32MSVT.0 size=884579 2024-09-12T17:28:57.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.109+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=76SJRR32MSVT tag=Z1W7TNXUCQO5 type=write size=1933155 2024-09-12T17:28:57.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.112+0000 7f9d7bc0c780 1 < suggested remove operation key=80JXIGQWQGR9 tag=PQKXTAXUFE8O type=del 2024-09-12T17:28:57.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.113+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=Z88I546OYQLB type=del size=392433 2024-09-12T17:28:57.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.114+0000 7f9d7bc0c780 -1 < failed to complete operation key=80JXIGQWQGR9 tag=51JQ46NGW9GB type=del size=2779931: (22) Invalid argument 2024-09-12T17:28:57.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.117+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~NNXR8WGG7DNQ.0 size=1048576 2024-09-12T17:28:57.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.118+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~NNXR8WGG7DNQ.1 size=1048576 2024-09-12T17:28:57.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.119+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~NNXR8WGG7DNQ.2 size=657567 2024-09-12T17:28:57.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.119+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=NNXR8WGG7DNQ tag=ORZABNQ6IZLG type=write size=3803295 2024-09-12T17:28:57.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.121+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=46IDVR88BXOQ type=del 2024-09-12T17:28:57.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.124+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~F28E2IO0A4L1.0 size=76666 2024-09-12T17:28:57.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.124+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=F28E2IO0A4L1 tag=35S039GOVXOA type=write size=1125242 2024-09-12T17:28:57.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.128+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=CICTQAWZHMNF type=del size=3614454 2024-09-12T17:28:57.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.131+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~XVF33V5WA7CT.0 size=379872 2024-09-12T17:28:57.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.131+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=XVF33V5WA7CT tag=QW2M408RU2B4 type=write size=1428448 2024-09-12T17:28:57.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.133+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~78YDE01A5Y2H.0 size=1048576 2024-09-12T17:28:57.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.133+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J7MREXK6R3C4.2~78YDE01A5Y2H.1 size=1048576 2024-09-12T17:28:57.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.133+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J7MREXK6R3C4.2~78YDE01A5Y2H.2 size=780389 2024-09-12T17:28:57.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.135+0000 7f9d7bc0c780 1 < canceled multipart upload key=J7MREXK6R3C4 upload=78YDE01A5Y2H tag=Q29SUHX7Q76S type=write size=3926117 2024-09-12T17:28:57.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.138+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~PIRLUWY9DFZ3.0 size=529384 2024-09-12T17:28:57.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.138+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=PIRLUWY9DFZ3 tag=KLS5NNMUSAT5 type=write size=1577960 2024-09-12T17:28:57.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.140+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~J4TDAAQQD4KA.0 size=1048576 2024-09-12T17:28:57.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.141+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~J4TDAAQQD4KA.1 size=703136 2024-09-12T17:28:57.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.144+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=J4TDAAQQD4KA tag=47TPL1LZVHO6 type=write size=2800288 2024-09-12T17:28:57.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.145+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=UVTVKSGMNH7R type=write size=512743 2024-09-12T17:28:57.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.147+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~6DGOSSCK7MJ5.0 size=980367 2024-09-12T17:28:57.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.149+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=6DGOSSCK7MJ5 tag=C7NWU4PC10C0 type=write size=2028943 2024-09-12T17:28:57.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.151+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=7SEOMGT1T3WM type=del size=1841901 2024-09-12T17:28:57.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.154+0000 7f9d7bc0c780 1 < suggested remove operation key=CYKLX4CJWVJE tag=Z6NA5O4RHGRZ type=del 2024-09-12T17:28:57.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.155+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=MKCF1K2WRZ8V type=write size=422700 2024-09-12T17:28:57.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.157+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=EX28Y7DX7QMX type=del 2024-09-12T17:28:57.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.159+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~OKLDL1QZ3CB8.0 size=1048576 2024-09-12T17:28:57.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.160+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~OKLDL1QZ3CB8.1 size=262794 2024-09-12T17:28:57.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.160+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=OKLDL1QZ3CB8 tag=AFYCH2JB61IO type=write size=2359946 2024-09-12T17:28:57.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.161+0000 7f9d7bc0c780 1 < canceled operation key=OZKAXB0ET9R7 tag=MC7MJWPVHL2N type=del size=1137367 2024-09-12T17:28:57.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.163+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=0BDFKRTQJGOS type=del size=139940 2024-09-12T17:28:57.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.164+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~32EEJMABILCO.0 size=1005916 2024-09-12T17:28:57.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.167+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=32EEJMABILCO tag=WG1SR3TDRYVZ type=write size=2054492 2024-09-12T17:28:57.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.168+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=9CIV0GLS38FF type=del size=625028 2024-09-12T17:28:57.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.170+0000 7f9d7bc0c780 1 < completed write operation key=31PU0U6IEAV2 tag=YCJFZ9UG8DIB type=write size=1007349 2024-09-12T17:28:57.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.172+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~HI98TR7FIIXP.0 size=1048576 2024-09-12T17:28:57.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.174+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~HI98TR7FIIXP.1 size=1048576 2024-09-12T17:28:57.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.175+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~HI98TR7FIIXP.2 size=741631 2024-09-12T17:28:57.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.175+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=HI98TR7FIIXP tag=OXUDZVZYJFH2 type=write size=3887359 2024-09-12T17:28:57.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.176+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~EONUK4B0HWMG.0 size=1048576 2024-09-12T17:28:57.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.178+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~EONUK4B0HWMG.1 size=894805 2024-09-12T17:28:57.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.180+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=EONUK4B0HWMG tag=QC5TB6N5SOGM type=write size=2991957 2024-09-12T17:28:57.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.182+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=X52GYXS7QUFB type=write size=133152 2024-09-12T17:28:57.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.183+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=KRXTT85SKON3 type=del 2024-09-12T17:28:57.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.188+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~QS8TV4MJ6DM0.0 size=720337 2024-09-12T17:28:57.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.188+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=QS8TV4MJ6DM0 tag=MXP5F1HNO843 type=write size=1768913 2024-09-12T17:28:57.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.189+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~42FYCM99AIL6.0 size=1048576 2024-09-12T17:28:57.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.190+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~42FYCM99AIL6.1 size=1048576 2024-09-12T17:28:57.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.191+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~42FYCM99AIL6.2 size=838960 2024-09-12T17:28:57.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.194+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=42FYCM99AIL6 tag=1R30GSNL3A11 type=write size=3984688 2024-09-12T17:28:57.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.195+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=DWI68F0GE5A3 type=del size=2738833 2024-09-12T17:28:57.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.197+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~76SJRR32MSVT.0 size=884579 2024-09-12T17:28:57.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.201+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=76SJRR32MSVT tag=Z1W7TNXUCQO5 type=write size=1933155 2024-09-12T17:28:57.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.204+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=SXF4IME5JHCW type=del size=2394051 2024-09-12T17:28:57.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.205+0000 7f9d7bc0c780 -1 < failed to complete operation key=SDX69F30A2RK tag=Z88I546OYQLB type=del size=392433: (22) Invalid argument 2024-09-12T17:28:57.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.208+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~6KGVWJSKPRBZ.0 size=210363 2024-09-12T17:28:57.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.208+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=6KGVWJSKPRBZ tag=30FLCFG2QRTN type=write size=1258939 2024-09-12T17:28:57.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.209+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~NNXR8WGG7DNQ.0 size=1048576 2024-09-12T17:28:57.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.211+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~NNXR8WGG7DNQ.1 size=1048576 2024-09-12T17:28:57.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.212+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~NNXR8WGG7DNQ.2 size=657567 2024-09-12T17:28:57.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.214+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=NNXR8WGG7DNQ tag=ORZABNQ6IZLG type=write size=3803295 2024-09-12T17:28:57.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.216+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~AK5HR0X9O951.0 size=1048576 2024-09-12T17:28:57.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.217+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~AK5HR0X9O951.1 size=487087 2024-09-12T17:28:57.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.218+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=AK5HR0X9O951 tag=J5FXM263CUFY type=write size=2584239 2024-09-12T17:28:57.219 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.218+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J7MREXK6R3C4.2~F28E2IO0A4L1.0 size=76666 2024-09-12T17:28:57.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.220+0000 7f9d7bc0c780 1 < canceled multipart upload key=J7MREXK6R3C4 upload=F28E2IO0A4L1 tag=35S039GOVXOA type=write size=1125242 2024-09-12T17:28:57.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.221+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=TLRKF6YQ93NR type=del size=1572954 2024-09-12T17:28:57.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.223+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~XVF33V5WA7CT.0 size=379872 2024-09-12T17:28:57.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.225+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=XVF33V5WA7CT tag=QW2M408RU2B4 type=write size=1428448 2024-09-12T17:28:57.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.226+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=3GPHXYDC7WJP type=del size=3840715 2024-09-12T17:28:57.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.226+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~PIRLUWY9DFZ3.0 size=529384 2024-09-12T17:28:57.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.229+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=PIRLUWY9DFZ3 tag=KLS5NNMUSAT5 type=write size=1577960 2024-09-12T17:28:57.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.230+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=LZ59OH1LV2FE type=del size=1194929 2024-09-12T17:28:57.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.232+0000 7f9d7bc0c780 1 < completed write operation key=NQ0768B94GVV tag=UVTVKSGMNH7R type=write size=512743 2024-09-12T17:28:57.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.233+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=H69AYCNY1YJL type=del size=3174510 2024-09-12T17:28:57.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.235+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=7SEOMGT1T3WM type=del 2024-09-12T17:28:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.236+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=M86AOQ0JNMKS type=write size=813438 2024-09-12T17:28:57.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.240+0000 7f9d7bc0c780 1 < suggested update operation key=4V2IYJRP2PZI tag=MKCF1K2WRZ8V type=write size=422700 2024-09-12T17:28:57.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.241+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=220HS6OBWWFE type=del size=1870873 2024-09-12T17:28:57.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.243+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~OKLDL1QZ3CB8.0 size=1048576 2024-09-12T17:28:57.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.244+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~OKLDL1QZ3CB8.1 size=262794 2024-09-12T17:28:57.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.246+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=OKLDL1QZ3CB8 tag=AFYCH2JB61IO type=write size=2359946 2024-09-12T17:28:57.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.248+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=FCIZRP9SL3A2 type=write size=689671 2024-09-12T17:28:57.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.251+0000 7f9d7bc0c780 1 < suggested update operation key=NQ0768B94GVV tag=0BDFKRTQJGOS type=del size=139940 2024-09-12T17:28:57.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.252+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=1LD57QCVDSRD type=del size=4178436 2024-09-12T17:28:57.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.254+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=9CIV0GLS38FF type=del 2024-09-12T17:28:57.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.257+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~XYZ5BA6NGCSC.0 size=1048576 2024-09-12T17:28:57.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.258+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~XYZ5BA6NGCSC.1 size=1048576 2024-09-12T17:28:57.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.259+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~XYZ5BA6NGCSC.2 size=386251 2024-09-12T17:28:57.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.259+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=XYZ5BA6NGCSC tag=PLADX4U40MTY type=write size=3531979 2024-09-12T17:28:57.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.261+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~HI98TR7FIIXP.0 size=1048576 2024-09-12T17:28:57.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.262+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~HI98TR7FIIXP.1 size=1048576 2024-09-12T17:28:57.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.265+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~HI98TR7FIIXP.2 size=741631 2024-09-12T17:28:57.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.267+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=HI98TR7FIIXP tag=OXUDZVZYJFH2 type=write size=3887359 2024-09-12T17:28:57.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.269+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=OFTUY49PZAYJ type=del size=4010504 2024-09-12T17:28:57.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.272+0000 7f9d7bc0c780 1 < suggested update operation key=0BYGD7FTPQF3 tag=X52GYXS7QUFB type=write size=133152 2024-09-12T17:28:57.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.274+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~TN12VTY8RT2P.0 size=1048576 2024-09-12T17:28:57.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.276+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~TN12VTY8RT2P.1 size=1048576 2024-09-12T17:28:57.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.277+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~TN12VTY8RT2P.2 size=966260 2024-09-12T17:28:57.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.277+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=TN12VTY8RT2P tag=Z6VQ2OHE5BDC type=write size=4111988 2024-09-12T17:28:57.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.278+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~QS8TV4MJ6DM0.0 size=720337 2024-09-12T17:28:57.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.281+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=QS8TV4MJ6DM0 tag=MXP5F1HNO843 type=write size=1768913 2024-09-12T17:28:57.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.282+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=LK4SH5DKHJJK type=write size=580209 2024-09-12T17:28:57.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.284+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=DWI68F0GE5A3 type=del 2024-09-12T17:28:57.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.285+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=S118SESGXHJM type=del size=1899963 2024-09-12T17:28:57.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.286+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=SXF4IME5JHCW type=del 2024-09-12T17:28:57.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.289+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~9E1AW2K4QYKC.0 size=1048576 2024-09-12T17:28:57.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.290+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~9E1AW2K4QYKC.1 size=1048576 2024-09-12T17:28:57.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.291+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~9E1AW2K4QYKC.2 size=973027 2024-09-12T17:28:57.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.291+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=9E1AW2K4QYKC tag=LRQ24MHBEL12 type=write size=4118755 2024-09-12T17:28:57.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.291+0000 7f9d7bc0c780 1 < canceled part key=_multipart_X7J78IOJR0HA.2~6KGVWJSKPRBZ.0 size=210363 2024-09-12T17:28:57.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.294+0000 7f9d7bc0c780 1 < canceled multipart upload key=X7J78IOJR0HA upload=6KGVWJSKPRBZ tag=30FLCFG2QRTN type=write size=1258939 2024-09-12T17:28:57.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.295+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=UYQ8G0DDA0PV type=del size=439760 2024-09-12T17:28:57.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.297+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~AK5HR0X9O951.0 size=1048576 2024-09-12T17:28:57.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.298+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~AK5HR0X9O951.1 size=487087 2024-09-12T17:28:57.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.300+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=AK5HR0X9O951 tag=J5FXM263CUFY type=write size=2584239 2024-09-12T17:28:57.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.301+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=680CNQNX056Q type=del size=895671 2024-09-12T17:28:57.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.303+0000 7f9d7bc0c780 1 < canceled operation key=J7MREXK6R3C4 tag=TLRKF6YQ93NR type=del size=1572954 2024-09-12T17:28:57.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.304+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=X49HNC3E0QG7 type=write size=569024 2024-09-12T17:28:57.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.306+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=3GPHXYDC7WJP type=del 2024-09-12T17:28:57.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.308+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~9A44DEVX8RMP.0 size=1048576 2024-09-12T17:28:57.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.309+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~9A44DEVX8RMP.1 size=1048576 2024-09-12T17:28:57.311 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.310+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~9A44DEVX8RMP.2 size=479587 2024-09-12T17:28:57.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.310+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=9A44DEVX8RMP tag=KYVBC2ZU2N6Y type=write size=3625315 2024-09-12T17:28:57.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.312+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=LZ59OH1LV2FE type=del 2024-09-12T17:28:57.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.313+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=41O1ILQK8PBX type=del size=3138657 2024-09-12T17:28:57.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.315+0000 7f9d7bc0c780 1 < completed delete operation key=ZA6JC3WXS8Y5 tag=H69AYCNY1YJL type=del 2024-09-12T17:28:57.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.317+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=SN0DJBHX5BNU type=write size=348143 2024-09-12T17:28:57.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.318+0000 7f9d7bc0c780 1 < completed write operation key=31PU0U6IEAV2 tag=M86AOQ0JNMKS type=write size=813438 2024-09-12T17:28:57.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.321+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~3KQ3G30FZ5O4.0 size=493516 2024-09-12T17:28:57.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.321+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=3KQ3G30FZ5O4 tag=PTDJPTYX6SYR type=write size=1542092 2024-09-12T17:28:57.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.323+0000 7f9d7bc0c780 1 < suggested remove operation key=R94VERREGANN tag=220HS6OBWWFE type=del 2024-09-12T17:28:57.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.325+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=R2PY1EJB7N60 type=del size=2661851 2024-09-12T17:28:57.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.326+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=FCIZRP9SL3A2 type=write size=689671 2024-09-12T17:28:57.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.328+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=KPU796G8J2GY type=del size=3397250 2024-09-12T17:28:57.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.329+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=1LD57QCVDSRD type=del 2024-09-12T17:28:57.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.331+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=ML9IFWIVI6DN type=del size=1959177 2024-09-12T17:28:57.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.332+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~XYZ5BA6NGCSC.0 size=1048576 2024-09-12T17:28:57.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.333+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~XYZ5BA6NGCSC.1 size=1048576 2024-09-12T17:28:57.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.334+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~XYZ5BA6NGCSC.2 size=386251 2024-09-12T17:28:57.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.337+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=XYZ5BA6NGCSC tag=PLADX4U40MTY type=write size=3531979 2024-09-12T17:28:57.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.342+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~ZR5EMPSJ2HZ5.0 size=1048576 2024-09-12T17:28:57.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.343+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~ZR5EMPSJ2HZ5.1 size=1048576 2024-09-12T17:28:57.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.345+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~ZR5EMPSJ2HZ5.2 size=385381 2024-09-12T17:28:57.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.345+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=ZR5EMPSJ2HZ5 tag=T67B92158D9O type=write size=3531109 2024-09-12T17:28:57.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.347+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=OFTUY49PZAYJ type=del 2024-09-12T17:28:57.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.349+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=DU5ZU7EEPBQ8 type=write size=917229 2024-09-12T17:28:57.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.351+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~TN12VTY8RT2P.0 size=1048576 2024-09-12T17:28:57.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.352+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~TN12VTY8RT2P.1 size=1048576 2024-09-12T17:28:57.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.354+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~TN12VTY8RT2P.2 size=966260 2024-09-12T17:28:57.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.356+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=TN12VTY8RT2P tag=Z6VQ2OHE5BDC type=write size=4111988 2024-09-12T17:28:57.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.358+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=AF2E9K26DVHY type=del size=2154027 2024-09-12T17:28:57.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.359+0000 7f9d7bc0c780 1 < completed write operation key=LU8MLGM7H0CE tag=LK4SH5DKHJJK type=write size=580209 2024-09-12T17:28:57.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.362+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~OTXY6S8F4AV1.0 size=792991 2024-09-12T17:28:57.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.362+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=OTXY6S8F4AV1 tag=LJMHSDDXOKOE type=write size=1841567 2024-09-12T17:28:57.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.363+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=S118SESGXHJM type=del 2024-09-12T17:28:57.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.364+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=Q7N9WZ3Z7L3Q type=write size=330673 2024-09-12T17:28:57.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.366+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~9E1AW2K4QYKC.0 size=1048576 2024-09-12T17:28:57.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.367+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~9E1AW2K4QYKC.1 size=1048576 2024-09-12T17:28:57.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.368+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~9E1AW2K4QYKC.2 size=973027 2024-09-12T17:28:57.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.371+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=9E1AW2K4QYKC tag=LRQ24MHBEL12 type=write size=4118755 2024-09-12T17:28:57.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.373+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=A18XZ2A4HHL1 type=write size=668669 2024-09-12T17:28:57.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.376+0000 7f9d7bc0c780 1 < suggested update operation key=5B96YH46VAK3 tag=UYQ8G0DDA0PV type=del size=439760 2024-09-12T17:28:57.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.377+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=3SLVXFA3U3LY type=del size=3427356 2024-09-12T17:28:57.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.378+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=680CNQNX056Q type=del 2024-09-12T17:28:57.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.381+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~D647EWSJ3Q3A.0 size=1048576 2024-09-12T17:28:57.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.382+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~D647EWSJ3Q3A.1 size=360331 2024-09-12T17:28:57.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.382+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=D647EWSJ3Q3A tag=EA5PVXO44547 type=write size=2457483 2024-09-12T17:28:57.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.385+0000 7f9d7bc0c780 1 < suggested update operation key=W1SE9R6KU04G tag=X49HNC3E0QG7 type=write size=569024 2024-09-12T17:28:57.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.387+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~122O3MOAW3KM.0 size=43650 2024-09-12T17:28:57.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.387+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=122O3MOAW3KM tag=RIUGUS2TECTM type=write size=1092226 2024-09-12T17:28:57.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.389+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~9A44DEVX8RMP.0 size=1048576 2024-09-12T17:28:57.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.389+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LJZNPSVLS9AF.2~9A44DEVX8RMP.1 size=1048576 2024-09-12T17:28:57.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.389+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LJZNPSVLS9AF.2~9A44DEVX8RMP.2 size=479587 2024-09-12T17:28:57.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.391+0000 7f9d7bc0c780 1 < canceled multipart upload key=LJZNPSVLS9AF upload=9A44DEVX8RMP tag=KYVBC2ZU2N6Y type=write size=3625315 2024-09-12T17:28:57.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.392+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=X72GGUZK1QDR type=del size=3866758 2024-09-12T17:28:57.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.395+0000 7f9d7bc0c780 1 < suggested remove operation key=5B96YH46VAK3 tag=41O1ILQK8PBX type=del 2024-09-12T17:28:57.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.396+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=7IUO6MY66CUZ type=del size=505115 2024-09-12T17:28:57.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.398+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=SN0DJBHX5BNU type=write size=348143 2024-09-12T17:28:57.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.402+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~R9ZI8ZQUMZFR.0 size=1048576 2024-09-12T17:28:57.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.403+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~R9ZI8ZQUMZFR.1 size=1048576 2024-09-12T17:28:57.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.405+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~R9ZI8ZQUMZFR.2 size=550152 2024-09-12T17:28:57.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.405+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=R9ZI8ZQUMZFR tag=HHUIL39UW80I type=write size=3695880 2024-09-12T17:28:57.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.406+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~3KQ3G30FZ5O4.0 size=493516 2024-09-12T17:28:57.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.409+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=3KQ3G30FZ5O4 tag=PTDJPTYX6SYR type=write size=1542092 2024-09-12T17:28:57.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.410+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=DLNC8N9S19IV type=write size=616355 2024-09-12T17:28:57.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.411+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=R2PY1EJB7N60 type=del 2024-09-12T17:28:57.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.413+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=N11LWKL3MCUB type=del size=57627 2024-09-12T17:28:57.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.414+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=KPU796G8J2GY type=del 2024-09-12T17:28:57.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.415+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=IKJ52KUZXD3R type=del size=3538717 2024-09-12T17:28:57.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.417+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=ML9IFWIVI6DN type=del 2024-09-12T17:28:57.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.418+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=JG66G904CE4O type=del size=433881 2024-09-12T17:28:57.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.419+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~ZR5EMPSJ2HZ5.0 size=1048576 2024-09-12T17:28:57.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.420+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~ZR5EMPSJ2HZ5.1 size=1048576 2024-09-12T17:28:57.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.421+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~ZR5EMPSJ2HZ5.2 size=385381 2024-09-12T17:28:57.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.424+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=ZR5EMPSJ2HZ5 tag=T67B92158D9O type=write size=3531109 2024-09-12T17:28:57.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.425+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=SDBEXEALHS1W type=del size=2342996 2024-09-12T17:28:57.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.429+0000 7f9d7bc0c780 1 < suggested remove operation key=J7MREXK6R3C4 tag=DU5ZU7EEPBQ8 type=write 2024-09-12T17:28:57.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.430+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=7LN530D2VCJ6 type=del size=1257382 2024-09-12T17:28:57.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.431+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=AF2E9K26DVHY type=del 2024-09-12T17:28:57.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.434+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=ICP37TSNWVSY type=del size=3080104 2024-09-12T17:28:57.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.435+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~OTXY6S8F4AV1.0 size=792991 2024-09-12T17:28:57.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.437+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=OTXY6S8F4AV1 tag=LJMHSDDXOKOE type=write size=1841567 2024-09-12T17:28:57.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.439+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=LLGZ4YVWKKQ8 type=write size=178959 2024-09-12T17:28:57.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.440+0000 7f9d7bc0c780 1 < completed write operation key=ZA6JC3WXS8Y5 tag=Q7N9WZ3Z7L3Q type=write size=330673 2024-09-12T17:28:57.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.442+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=EP55VWXL9TGW type=del size=1551472 2024-09-12T17:28:57.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.443+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=A18XZ2A4HHL1 type=write size=668669 2024-09-12T17:28:57.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.446+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~1HBCH71OGVF5.0 size=1048576 2024-09-12T17:28:57.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.447+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~1HBCH71OGVF5.1 size=1048576 2024-09-12T17:28:57.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.448+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~1HBCH71OGVF5.2 size=467159 2024-09-12T17:28:57.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.448+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=1HBCH71OGVF5 tag=WMLJP4KS6AXQ type=write size=3612887 2024-09-12T17:28:57.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.449+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=3SLVXFA3U3LY type=del 2024-09-12T17:28:57.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.450+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=570PFQ0F8TOA type=del size=2814166 2024-09-12T17:28:57.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.452+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~D647EWSJ3Q3A.0 size=1048576 2024-09-12T17:28:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.453+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~D647EWSJ3Q3A.1 size=360331 2024-09-12T17:28:57.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.456+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=D647EWSJ3Q3A tag=EA5PVXO44547 type=write size=2457483 2024-09-12T17:28:57.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.457+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=0HE20FIUE0CZ type=del size=2490764 2024-09-12T17:28:57.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.459+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~122O3MOAW3KM.0 size=43650 2024-09-12T17:28:57.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.461+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=122O3MOAW3KM tag=RIUGUS2TECTM type=write size=1092226 2024-09-12T17:28:57.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.462+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=DOZN3Y0CPIUW type=del size=380753 2024-09-12T17:28:57.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.464+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=X72GGUZK1QDR type=del 2024-09-12T17:28:57.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.465+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=ENWSGZ1Y5K8G type=del size=2079042 2024-09-12T17:28:57.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.467+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=7IUO6MY66CUZ type=del 2024-09-12T17:28:57.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.470+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~EO04I270IJP8.0 size=1048576 2024-09-12T17:28:57.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.471+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~EO04I270IJP8.1 size=1048576 2024-09-12T17:28:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.472+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~EO04I270IJP8.2 size=961594 2024-09-12T17:28:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.472+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=EO04I270IJP8 tag=R37H1J672M6B type=write size=4107322 2024-09-12T17:28:57.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.473+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~R9ZI8ZQUMZFR.0 size=1048576 2024-09-12T17:28:57.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.475+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~R9ZI8ZQUMZFR.1 size=1048576 2024-09-12T17:28:57.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.476+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~R9ZI8ZQUMZFR.2 size=550152 2024-09-12T17:28:57.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.479+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=R9ZI8ZQUMZFR tag=HHUIL39UW80I type=write size=3695880 2024-09-12T17:28:57.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.481+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=ZJ3IQIPEXJKA type=del size=3397325 2024-09-12T17:28:57.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.482+0000 7f9d7bc0c780 1 < completed write operation key=ZA6JC3WXS8Y5 tag=DLNC8N9S19IV type=write size=616355 2024-09-12T17:28:57.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.485+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~F3A9LJ5SQWN1.0 size=619663 2024-09-12T17:28:57.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.485+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=F3A9LJ5SQWN1 tag=X7TB9QEO3CLZ type=write size=1668239 2024-09-12T17:28:57.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.486+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=N11LWKL3MCUB type=del 2024-09-12T17:28:57.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.488+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=H08HULH78JAW type=del size=3372596 2024-09-12T17:28:57.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.489+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=IKJ52KUZXD3R type=del 2024-09-12T17:28:57.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.492+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~XTOHJE6QVDGA.0 size=1048576 2024-09-12T17:28:57.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.493+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~XTOHJE6QVDGA.1 size=1048576 2024-09-12T17:28:57.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.494+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~XTOHJE6QVDGA.2 size=669904 2024-09-12T17:28:57.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.494+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=XTOHJE6QVDGA tag=UKXAFJT0RT1C type=write size=3815632 2024-09-12T17:28:57.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.495+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=JG66G904CE4O type=del 2024-09-12T17:28:57.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.497+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=XTN69WHHVTES type=del size=664208 2024-09-12T17:28:57.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.498+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=SDBEXEALHS1W type=del 2024-09-12T17:28:57.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.500+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=SMB5WC2NJVRJ type=write size=814892 2024-09-12T17:28:57.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.501+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=7LN530D2VCJ6 type=del 2024-09-12T17:28:57.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.502+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=DU1JGINZFE23 type=del size=836355 2024-09-12T17:28:57.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.504+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=ICP37TSNWVSY type=del 2024-09-12T17:28:57.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.505+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=VSQ9BLHB8ZRN type=del size=4054562 2024-09-12T17:28:57.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.507+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=LLGZ4YVWKKQ8 type=write size=178959 2024-09-12T17:28:57.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.508+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=NUUW1AF3JAIP type=del size=543863 2024-09-12T17:28:57.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.510+0000 7f9d7bc0c780 1 < canceled operation key=W1SE9R6KU04G tag=EP55VWXL9TGW type=del size=1551472 2024-09-12T17:28:57.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.511+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=JEA0YJ0JDNNK type=del size=3613644 2024-09-12T17:28:57.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.513+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~1HBCH71OGVF5.0 size=1048576 2024-09-12T17:28:57.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.513+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~1HBCH71OGVF5.1 size=1048576 2024-09-12T17:28:57.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.514+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~1HBCH71OGVF5.2 size=467159 2024-09-12T17:28:57.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.516+0000 7f9d7bc0c780 1 < canceled multipart upload key=AOT2ZKFTD0HY upload=1HBCH71OGVF5 tag=WMLJP4KS6AXQ type=write size=3612887 2024-09-12T17:28:57.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.518+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=UKIHSANOL3SW type=del size=2252156 2024-09-12T17:28:57.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.519+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=570PFQ0F8TOA type=del 2024-09-12T17:28:57.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.521+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=DUYTLNOQBSGR type=del size=1349738 2024-09-12T17:28:57.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.522+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=0HE20FIUE0CZ type=del 2024-09-12T17:28:57.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.524+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=OLD4WJZF33MM type=write size=21959 2024-09-12T17:28:57.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.525+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=DOZN3Y0CPIUW type=del 2024-09-12T17:28:57.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.527+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=G4U7ZCATAQLH type=del size=639570 2024-09-12T17:28:57.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.528+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=ENWSGZ1Y5K8G type=del 2024-09-12T17:28:57.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.530+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=Q792XZ6V29HD type=del size=1211267 2024-09-12T17:28:57.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.531+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~EO04I270IJP8.0 size=1048576 2024-09-12T17:28:57.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.532+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~EO04I270IJP8.1 size=1048576 2024-09-12T17:28:57.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.533+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~EO04I270IJP8.2 size=961594 2024-09-12T17:28:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.536+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=EO04I270IJP8 tag=R37H1J672M6B type=write size=4107322 2024-09-12T17:28:57.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.537+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=DB3Q90813DT9 type=del size=3972380 2024-09-12T17:28:57.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.539+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=ZJ3IQIPEXJKA type=del 2024-09-12T17:28:57.543 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.542+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~28DPVI1TEFMJ.0 size=1048576 2024-09-12T17:28:57.544 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.543+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~28DPVI1TEFMJ.1 size=1048576 2024-09-12T17:28:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.544+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~28DPVI1TEFMJ.2 size=443332 2024-09-12T17:28:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.544+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=28DPVI1TEFMJ tag=7CLWUNV56II7 type=write size=3589060 2024-09-12T17:28:57.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.545+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~F3A9LJ5SQWN1.0 size=619663 2024-09-12T17:28:57.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.548+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=F3A9LJ5SQWN1 tag=X7TB9QEO3CLZ type=write size=1668239 2024-09-12T17:28:57.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.551+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0JN5WWDYEM6Q.2~36Z3A935KZZ0.0 size=512620 2024-09-12T17:28:57.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.551+0000 7f9d7bc0c780 1 > prepared multipart upload key=0JN5WWDYEM6Q upload=36Z3A935KZZ0 tag=GCCL5WLJQVR3 type=write size=1561196 2024-09-12T17:28:57.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.552+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=H08HULH78JAW type=del 2024-09-12T17:28:57.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.554+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=HRI41074BHIZ type=del size=2475749 2024-09-12T17:28:57.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.555+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~XTOHJE6QVDGA.0 size=1048576 2024-09-12T17:28:57.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.556+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~XTOHJE6QVDGA.1 size=1048576 2024-09-12T17:28:57.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.556+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0NGHC5GMSGRX.2~XTOHJE6QVDGA.2 size=669904 2024-09-12T17:28:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.559+0000 7f9d7bc0c780 1 < canceled multipart upload key=0NGHC5GMSGRX upload=XTOHJE6QVDGA tag=UKXAFJT0RT1C type=write size=3815632 2024-09-12T17:28:57.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.562+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~BCQZ3YFLFKCZ.0 size=367213 2024-09-12T17:28:57.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.562+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=BCQZ3YFLFKCZ tag=O870MR5S30I1 type=write size=1415789 2024-09-12T17:28:57.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.564+0000 7f9d7bc0c780 1 < suggested update operation key=L72DVWQ63XUW tag=XTN69WHHVTES type=del size=664208 2024-09-12T17:28:57.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.567+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~1PNJ4EXPDQH4.0 size=1048576 2024-09-12T17:28:57.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.568+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~1PNJ4EXPDQH4.1 size=314945 2024-09-12T17:28:57.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.568+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=1PNJ4EXPDQH4 tag=XPEFIDDHKOK7 type=write size=2412097 2024-09-12T17:28:57.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.570+0000 7f9d7bc0c780 1 < completed write operation key=0BYGD7FTPQF3 tag=SMB5WC2NJVRJ type=write size=814892 2024-09-12T17:28:57.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.573+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~6719ZNX0M77R.0 size=416043 2024-09-12T17:28:57.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.573+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=6719ZNX0M77R tag=ESSC69ABPZZ4 type=write size=1464619 2024-09-12T17:28:57.575 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.574+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=DU1JGINZFE23 type=del 2024-09-12T17:28:57.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.577+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~F6JJ83UAN206.0 size=1048576 2024-09-12T17:28:57.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.578+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~F6JJ83UAN206.1 size=732495 2024-09-12T17:28:57.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.578+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=F6JJ83UAN206 tag=JU195026KQOM type=write size=2829647 2024-09-12T17:28:57.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.580+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=VSQ9BLHB8ZRN type=del 2024-09-12T17:28:57.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.581+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=GVIBVWE8TM3T type=del size=237701 2024-09-12T17:28:57.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.583+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=NUUW1AF3JAIP type=del 2024-09-12T17:28:57.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.586+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~AQWAIQUBTIFS.0 size=864219 2024-09-12T17:28:57.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.586+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=AQWAIQUBTIFS tag=9RJSQ8NB2XOV type=write size=1912795 2024-09-12T17:28:57.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.587+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=JEA0YJ0JDNNK type=del 2024-09-12T17:28:57.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.589+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=GKXB93BLM7PJ type=del size=4175050 2024-09-12T17:28:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.592+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=UKIHSANOL3SW type=del size=2252156 2024-09-12T17:28:57.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.594+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=PRCBGZLE26AX type=del size=2395146 2024-09-12T17:28:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.595+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=DUYTLNOQBSGR type=del 2024-09-12T17:28:57.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.597+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=8QG6MGCAE54C type=del size=3111497 2024-09-12T17:28:57.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.598+0000 7f9d7bc0c780 1 < completed write operation key=CYKLX4CJWVJE tag=OLD4WJZF33MM type=write size=21959 2024-09-12T17:28:57.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.600+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=HQG0JV00GXMQ type=del size=887857 2024-09-12T17:28:57.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.601+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=G4U7ZCATAQLH type=del 2024-09-12T17:28:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.604+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~GTG9DY2Q2TXR.0 size=1048576 2024-09-12T17:28:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.605+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~GTG9DY2Q2TXR.1 size=85526 2024-09-12T17:28:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.605+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=GTG9DY2Q2TXR tag=HFRCEWBZ375R type=write size=2182678 2024-09-12T17:28:57.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.608+0000 7f9d7bc0c780 1 < suggested update operation key=CYKLX4CJWVJE tag=Q792XZ6V29HD type=del size=1211267 2024-09-12T17:28:57.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.610+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=GMRZRDCHQ9F9 type=del size=2098259 2024-09-12T17:28:57.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.611+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=DB3Q90813DT9 type=del 2024-09-12T17:28:57.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.613+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=PZZLAYKHJTSU type=del size=3359692 2024-09-12T17:28:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.614+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~28DPVI1TEFMJ.0 size=1048576 2024-09-12T17:28:57.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.615+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~28DPVI1TEFMJ.1 size=1048576 2024-09-12T17:28:57.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.616+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~28DPVI1TEFMJ.2 size=443332 2024-09-12T17:28:57.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.620+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=28DPVI1TEFMJ tag=7CLWUNV56II7 type=write size=3589060 2024-09-12T17:28:57.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.621+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=ZH69RAZ5HZPF type=del size=2356540 2024-09-12T17:28:57.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.624+0000 7f9d7bc0c780 1 < completed part key=_multipart_0JN5WWDYEM6Q.2~36Z3A935KZZ0.0 size=512620 2024-09-12T17:28:57.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.626+0000 7f9d7bc0c780 1 < completed multipart upload key=0JN5WWDYEM6Q upload=36Z3A935KZZ0 tag=GCCL5WLJQVR3 type=write size=1561196 2024-09-12T17:28:57.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.628+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=PX91OKNQWF0V type=del size=1791948 2024-09-12T17:28:57.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.629+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=HRI41074BHIZ type=del 2024-09-12T17:28:57.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.633+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~NY1OLCA15QK2.0 size=1048576 2024-09-12T17:28:57.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.634+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~NY1OLCA15QK2.1 size=583043 2024-09-12T17:28:57.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.634+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=NY1OLCA15QK2 tag=KEWCGDXFEQ32 type=write size=2680195 2024-09-12T17:28:57.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.635+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~BCQZ3YFLFKCZ.0 size=367213 2024-09-12T17:28:57.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.638+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=BCQZ3YFLFKCZ tag=O870MR5S30I1 type=write size=1415789 2024-09-12T17:28:57.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.640+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~RP9N92LU0VNK.0 size=1048576 2024-09-12T17:28:57.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.641+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~RP9N92LU0VNK.1 size=559796 2024-09-12T17:28:57.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.641+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=RP9N92LU0VNK tag=YSZPS90C1VT0 type=write size=2656948 2024-09-12T17:28:57.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.643+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~1PNJ4EXPDQH4.0 size=1048576 2024-09-12T17:28:57.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.644+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~1PNJ4EXPDQH4.1 size=314945 2024-09-12T17:28:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.646+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=1PNJ4EXPDQH4 tag=XPEFIDDHKOK7 type=write size=2412097 2024-09-12T17:28:57.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.649+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~3WOC188TTD1Z.0 size=217797 2024-09-12T17:28:57.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.649+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=3WOC188TTD1Z tag=RLRYVOKDO4UV type=write size=1266373 2024-09-12T17:28:57.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.651+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~6719ZNX0M77R.0 size=416043 2024-09-12T17:28:57.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.653+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=6719ZNX0M77R tag=ESSC69ABPZZ4 type=write size=1464619 2024-09-12T17:28:57.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.654+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=MX9JS54KQMDR type=del size=4185701 2024-09-12T17:28:57.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.656+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~F6JJ83UAN206.0 size=1048576 2024-09-12T17:28:57.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.657+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~F6JJ83UAN206.1 size=732495 2024-09-12T17:28:57.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.660+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=F6JJ83UAN206 tag=JU195026KQOM type=write size=2829647 2024-09-12T17:28:57.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.661+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=VVSDZI5KFJ9E type=del size=2803452 2024-09-12T17:28:57.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.662+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=GVIBVWE8TM3T type=del 2024-09-12T17:28:57.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.664+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=46BNAI3DY3LK type=del size=572948 2024-09-12T17:28:57.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.665+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~AQWAIQUBTIFS.0 size=864219 2024-09-12T17:28:57.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.668+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=AQWAIQUBTIFS tag=9RJSQ8NB2XOV type=write size=1912795 2024-09-12T17:28:57.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.669+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=6QIQ513DMIJ0 type=del size=10981 2024-09-12T17:28:57.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.671+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=GKXB93BLM7PJ type=del 2024-09-12T17:28:57.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.672+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=EM2M3YGFX24N type=del size=1406167 2024-09-12T17:28:57.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.674+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=PRCBGZLE26AX type=del 2024-09-12T17:28:57.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.675+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=VZXLFIN2FR0I type=del size=2511931 2024-09-12T17:28:57.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.677+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=8QG6MGCAE54C type=del 2024-09-12T17:28:57.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.678+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=0YHXV5GWAM38 type=write size=66647 2024-09-12T17:28:57.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.680+0000 7f9d7bc0c780 -1 < failed to complete operation key=CYKLX4CJWVJE tag=HQG0JV00GXMQ type=del size=887857: (22) Invalid argument 2024-09-12T17:28:57.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.681+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=P5B0NGGVFQQZ type=del size=3316396 2024-09-12T17:28:57.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.683+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~GTG9DY2Q2TXR.0 size=1048576 2024-09-12T17:28:57.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.684+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~GTG9DY2Q2TXR.1 size=85526 2024-09-12T17:28:57.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.686+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=GTG9DY2Q2TXR tag=HFRCEWBZ375R type=write size=2182678 2024-09-12T17:28:57.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.688+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=FSNE20E8MYT1 type=write size=975450 2024-09-12T17:28:57.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.689+0000 7f9d7bc0c780 1 < canceled operation key=LU8MLGM7H0CE tag=GMRZRDCHQ9F9 type=del size=2098259 2024-09-12T17:28:57.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.691+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=7N0RBZA3OQEB type=del size=3081251 2024-09-12T17:28:57.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.692+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=PZZLAYKHJTSU type=del 2024-09-12T17:28:57.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.694+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=BFR0X7A9A5SZ type=del size=2080874 2024-09-12T17:28:57.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.695+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=ZH69RAZ5HZPF type=del 2024-09-12T17:28:57.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.697+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=0MGP7232J6IW type=write size=944117 2024-09-12T17:28:57.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.698+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=PX91OKNQWF0V type=del 2024-09-12T17:28:57.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.701+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~ZI21JZ8OYZT2.0 size=1048576 2024-09-12T17:28:57.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.702+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~ZI21JZ8OYZT2.1 size=223742 2024-09-12T17:28:57.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.702+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=ZI21JZ8OYZT2 tag=1PXNAIEDOZVE type=write size=2320894 2024-09-12T17:28:57.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.703+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~NY1OLCA15QK2.0 size=1048576 2024-09-12T17:28:57.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.705+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~NY1OLCA15QK2.1 size=583043 2024-09-12T17:28:57.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.707+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=NY1OLCA15QK2 tag=KEWCGDXFEQ32 type=write size=2680195 2024-09-12T17:28:57.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.710+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~Z2LCVY09J8JT.0 size=1048576 2024-09-12T17:28:57.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.711+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~Z2LCVY09J8JT.1 size=1048576 2024-09-12T17:28:57.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.712+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~Z2LCVY09J8JT.2 size=361101 2024-09-12T17:28:57.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.712+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=Z2LCVY09J8JT tag=F6XZXIDYBWCL type=write size=3506829 2024-09-12T17:28:57.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.713+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~RP9N92LU0VNK.0 size=1048576 2024-09-12T17:28:57.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.715+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~RP9N92LU0VNK.1 size=559796 2024-09-12T17:28:57.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.717+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=RP9N92LU0VNK tag=YSZPS90C1VT0 type=write size=2656948 2024-09-12T17:28:57.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.720+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~1VC8OWLIMIEY.0 size=1048576 2024-09-12T17:28:57.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.721+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~1VC8OWLIMIEY.1 size=976018 2024-09-12T17:28:57.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.721+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=1VC8OWLIMIEY tag=B4436E91VVZM type=write size=3073170 2024-09-12T17:28:57.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.722+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~3WOC188TTD1Z.0 size=217797 2024-09-12T17:28:57.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.725+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=3WOC188TTD1Z tag=RLRYVOKDO4UV type=write size=1266373 2024-09-12T17:28:57.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.727+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=O3OC2D2VEEES type=del size=256436 2024-09-12T17:28:57.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.728+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=MX9JS54KQMDR type=del 2024-09-12T17:28:57.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.731+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~UPUNBWBCRGH3.0 size=959880 2024-09-12T17:28:57.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.731+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=UPUNBWBCRGH3 tag=UK27Q3B165NZ type=write size=2008456 2024-09-12T17:28:57.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.732+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=VVSDZI5KFJ9E type=del 2024-09-12T17:28:57.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.736+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~LQ28T8H788KU.0 size=1048576 2024-09-12T17:28:57.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.737+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~LQ28T8H788KU.1 size=1048576 2024-09-12T17:28:57.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.738+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~LQ28T8H788KU.2 size=110789 2024-09-12T17:28:57.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.738+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=LQ28T8H788KU tag=ED7QR85U8J2C type=write size=3256517 2024-09-12T17:28:57.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.740+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=46BNAI3DY3LK type=del 2024-09-12T17:28:57.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.743+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~VMXSG6K34YYN.0 size=111060 2024-09-12T17:28:57.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.743+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=VMXSG6K34YYN tag=EE8FGJ0HUKVF type=write size=1159636 2024-09-12T17:28:57.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.745+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=6QIQ513DMIJ0 type=del 2024-09-12T17:28:57.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.746+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=LZUFXIZQT35U type=write size=486125 2024-09-12T17:28:57.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.750+0000 7f9d7bc0c780 1 < suggested update operation key=31PU0U6IEAV2 tag=EM2M3YGFX24N type=del size=1406167 2024-09-12T17:28:57.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.752+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=RYASH2U8KET8 type=write size=688055 2024-09-12T17:28:57.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.753+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=VZXLFIN2FR0I type=del 2024-09-12T17:28:57.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.755+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=IF7UBFAOD2I8 type=del size=2692548 2024-09-12T17:28:57.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.759+0000 7f9d7bc0c780 1 < suggested remove operation key=CYKLX4CJWVJE tag=0YHXV5GWAM38 type=write 2024-09-12T17:28:57.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.763+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~IGNEN1LQZF34.0 size=198497 2024-09-12T17:28:57.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.763+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=IGNEN1LQZF34 tag=14JZ8XKFNB8Y type=write size=1247073 2024-09-12T17:28:57.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.764+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=P5B0NGGVFQQZ type=del 2024-09-12T17:28:57.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.766+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=QMKBKF1WPUCS type=del size=617229 2024-09-12T17:28:57.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.767+0000 7f9d7bc0c780 1 < completed write operation key=SDX69F30A2RK tag=FSNE20E8MYT1 type=write size=975450 2024-09-12T17:28:57.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.769+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=BDIF3JCI9PUI type=del size=4130897 2024-09-12T17:28:57.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.771+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=7N0RBZA3OQEB type=del 2024-09-12T17:28:57.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.773+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~D27W04Y4T576.0 size=1048576 2024-09-12T17:28:57.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.774+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~D27W04Y4T576.1 size=140974 2024-09-12T17:28:57.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.774+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=D27W04Y4T576 tag=EEFZ9E61HYW8 type=write size=2238126 2024-09-12T17:28:57.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.776+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=BFR0X7A9A5SZ type=del 2024-09-12T17:28:57.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.780+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~4EBS1NMMKIOG.0 size=1048576 2024-09-12T17:28:57.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.781+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~4EBS1NMMKIOG.1 size=1048576 2024-09-12T17:28:57.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.782+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~4EBS1NMMKIOG.2 size=71057 2024-09-12T17:28:57.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.782+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=4EBS1NMMKIOG tag=X90VVQ0DKWK3 type=write size=3216785 2024-09-12T17:28:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.784+0000 7f9d7bc0c780 -1 < failed to complete operation key=CYKLX4CJWVJE tag=0MGP7232J6IW type=write size=944117: (22) Invalid argument 2024-09-12T17:28:57.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.785+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=2VRLKAA7YJ2N type=write size=819689 2024-09-12T17:28:57.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.787+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~ZI21JZ8OYZT2.0 size=1048576 2024-09-12T17:28:57.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.788+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~ZI21JZ8OYZT2.1 size=223742 2024-09-12T17:28:57.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.790+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=ZI21JZ8OYZT2 tag=1PXNAIEDOZVE type=write size=2320894 2024-09-12T17:28:57.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.792+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=40E332KBLZTJ type=del size=3364225 2024-09-12T17:28:57.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.794+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~Z2LCVY09J8JT.0 size=1048576 2024-09-12T17:28:57.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.795+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~Z2LCVY09J8JT.1 size=1048576 2024-09-12T17:28:57.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.796+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~Z2LCVY09J8JT.2 size=361101 2024-09-12T17:28:57.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.798+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=Z2LCVY09J8JT tag=F6XZXIDYBWCL type=write size=3506829 2024-09-12T17:28:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.800+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=EE5Z7RBCEFUW type=write size=483700 2024-09-12T17:28:57.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.801+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~1VC8OWLIMIEY.0 size=1048576 2024-09-12T17:28:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.802+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~1VC8OWLIMIEY.1 size=976018 2024-09-12T17:28:57.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.805+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=1VC8OWLIMIEY tag=B4436E91VVZM type=write size=3073170 2024-09-12T17:28:57.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.806+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=J5P9WW6DSIM6 type=write size=906583 2024-09-12T17:28:57.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.808+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=O3OC2D2VEEES type=del 2024-09-12T17:28:57.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.810+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=IU61NJZ8TK38 type=write size=631598 2024-09-12T17:28:57.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.811+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~UPUNBWBCRGH3.0 size=959880 2024-09-12T17:28:57.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.813+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=UPUNBWBCRGH3 tag=UK27Q3B165NZ type=write size=2008456 2024-09-12T17:28:57.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.816+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~J4WLR47F1IB0.0 size=707551 2024-09-12T17:28:57.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.816+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=J4WLR47F1IB0 tag=LWVU42Z08O2A type=write size=1756127 2024-09-12T17:28:57.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.818+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~LQ28T8H788KU.0 size=1048576 2024-09-12T17:28:57.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.820+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~LQ28T8H788KU.1 size=1048576 2024-09-12T17:28:57.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.821+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~LQ28T8H788KU.2 size=110789 2024-09-12T17:28:57.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.824+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=LQ28T8H788KU tag=ED7QR85U8J2C type=write size=3256517 2024-09-12T17:28:57.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.827+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~ZP5INQMJDD6K.0 size=1048576 2024-09-12T17:28:57.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.828+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~ZP5INQMJDD6K.1 size=258746 2024-09-12T17:28:57.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.828+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=ZP5INQMJDD6K tag=KCDC13XH1VXF type=write size=2355898 2024-09-12T17:28:57.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.829+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~VMXSG6K34YYN.0 size=111060 2024-09-12T17:28:57.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.832+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=VMXSG6K34YYN tag=EE8FGJ0HUKVF type=write size=1159636 2024-09-12T17:28:57.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.835+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~73M4GISMSSZV.0 size=1048576 2024-09-12T17:28:57.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.836+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~73M4GISMSSZV.1 size=1048576 2024-09-12T17:28:57.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.837+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~73M4GISMSSZV.2 size=815696 2024-09-12T17:28:57.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.837+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=73M4GISMSSZV tag=UORJZ3T32DZO type=write size=3961424 2024-09-12T17:28:57.839 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.838+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=LZUFXIZQT35U type=write size=486125 2024-09-12T17:28:57.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.840+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=ZD5Y089GH1VN type=del size=1582535 2024-09-12T17:28:57.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.841+0000 7f9d7bc0c780 1 < completed write operation key=0JN5WWDYEM6Q tag=RYASH2U8KET8 type=write size=688055 2024-09-12T17:28:57.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.844+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~U1AEOHG6S4PR.0 size=1048576 2024-09-12T17:28:57.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.845+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~U1AEOHG6S4PR.1 size=612130 2024-09-12T17:28:57.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.845+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=U1AEOHG6S4PR tag=OIZ7AH1KXEM1 type=write size=2709282 2024-09-12T17:28:57.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.848+0000 7f9d7bc0c780 1 < suggested update operation key=EUHRVHNVI83I tag=IF7UBFAOD2I8 type=del size=2692548 2024-09-12T17:28:57.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.849+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=HIYSCCBJABTT type=del size=1023546 2024-09-12T17:28:57.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.851+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~IGNEN1LQZF34.0 size=198497 2024-09-12T17:28:57.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.853+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=IGNEN1LQZF34 tag=14JZ8XKFNB8Y type=write size=1247073 2024-09-12T17:28:57.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.856+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~NAZJR7ABC8HW.0 size=980073 2024-09-12T17:28:57.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.856+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=NAZJR7ABC8HW tag=CN9C9R08L8V0 type=write size=2028649 2024-09-12T17:28:57.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.858+0000 7f9d7bc0c780 1 < suggested update operation key=SDX69F30A2RK tag=QMKBKF1WPUCS type=del size=617229 2024-09-12T17:28:57.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.861+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~NWUIRUWB9KO3.0 size=857118 2024-09-12T17:28:57.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.861+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=NWUIRUWB9KO3 tag=Z4PBLA0N3LCW type=write size=1905694 2024-09-12T17:28:57.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.862+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=BDIF3JCI9PUI type=del 2024-09-12T17:28:57.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.865+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~PMYLW78CYVMT.0 size=1048576 2024-09-12T17:28:57.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.866+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~PMYLW78CYVMT.1 size=732204 2024-09-12T17:28:57.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.866+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=PMYLW78CYVMT tag=1MQL3CGS8FWD type=write size=2829356 2024-09-12T17:28:57.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.868+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~D27W04Y4T576.0 size=1048576 2024-09-12T17:28:57.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.869+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~D27W04Y4T576.1 size=140974 2024-09-12T17:28:57.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.871+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=D27W04Y4T576 tag=EEFZ9E61HYW8 type=write size=2238126 2024-09-12T17:28:57.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.873+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=WPNDO8N0A2R0 type=write size=779908 2024-09-12T17:28:57.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.873+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~4EBS1NMMKIOG.0 size=1048576 2024-09-12T17:28:57.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.874+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~4EBS1NMMKIOG.1 size=1048576 2024-09-12T17:28:57.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.875+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~4EBS1NMMKIOG.2 size=71057 2024-09-12T17:28:57.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.878+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=4EBS1NMMKIOG tag=X90VVQ0DKWK3 type=write size=3216785 2024-09-12T17:28:57.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.880+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=PGMR1QSKF4LL type=write size=478293 2024-09-12T17:28:57.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.881+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=2VRLKAA7YJ2N type=write size=819689 2024-09-12T17:28:57.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.883+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=FYFTRP0XZOJ9 type=del size=4065594 2024-09-12T17:28:57.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.884+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=40E332KBLZTJ type=del 2024-09-12T17:28:57.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.886+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~FA4K085G7MYN.0 size=211975 2024-09-12T17:28:57.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.886+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=FA4K085G7MYN tag=LUXHGII4SYKS type=write size=1260551 2024-09-12T17:28:57.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.889+0000 7f9d7bc0c780 1 < suggested remove operation key=L72DVWQ63XUW tag=EE5Z7RBCEFUW type=write 2024-09-12T17:28:57.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.891+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=E8LF5F93SP0X type=del size=3712804 2024-09-12T17:28:57.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.892+0000 7f9d7bc0c780 1 < completed write operation key=0BYGD7FTPQF3 tag=J5P9WW6DSIM6 type=write size=906583 2024-09-12T17:28:57.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.894+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=3RJ0V78U92JK type=write size=407006 2024-09-12T17:28:57.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.895+0000 7f9d7bc0c780 1 < completed write operation key=CYKLX4CJWVJE tag=IU61NJZ8TK38 type=write size=631598 2024-09-12T17:28:57.898 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.897+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=UXW12IAIL1KC type=del size=3160695 2024-09-12T17:28:57.899 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.898+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~J4WLR47F1IB0.0 size=707551 2024-09-12T17:28:57.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.902+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=J4WLR47F1IB0 tag=LWVU42Z08O2A type=write size=1756127 2024-09-12T17:28:57.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.903+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=SOF62Z6VJH22 type=write size=923856 2024-09-12T17:28:57.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.905+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~ZP5INQMJDD6K.0 size=1048576 2024-09-12T17:28:57.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.906+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~ZP5INQMJDD6K.1 size=258746 2024-09-12T17:28:57.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.909+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=ZP5INQMJDD6K tag=KCDC13XH1VXF type=write size=2355898 2024-09-12T17:28:57.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.910+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=DPULQUJZKSKO type=del size=477441 2024-09-12T17:28:57.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.912+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~73M4GISMSSZV.0 size=1048576 2024-09-12T17:28:57.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.913+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~73M4GISMSSZV.1 size=1048576 2024-09-12T17:28:57.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.914+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~73M4GISMSSZV.2 size=815696 2024-09-12T17:28:57.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.916+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=73M4GISMSSZV tag=UORJZ3T32DZO type=write size=3961424 2024-09-12T17:28:57.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.919+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~OBB1G9H9Q5OI.0 size=1048576 2024-09-12T17:28:57.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.920+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~OBB1G9H9Q5OI.1 size=357803 2024-09-12T17:28:57.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.920+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=OBB1G9H9Q5OI tag=QLDE6N4WF21G type=write size=2454955 2024-09-12T17:28:57.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.921+0000 7f9d7bc0c780 1 < canceled operation key=58C4SS3TN12K tag=ZD5Y089GH1VN type=del size=1582535 2024-09-12T17:28:57.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.923+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=ZQIBA9QIP4DI type=del size=2231048 2024-09-12T17:28:57.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.925+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~U1AEOHG6S4PR.0 size=1048576 2024-09-12T17:28:57.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.926+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~U1AEOHG6S4PR.1 size=612130 2024-09-12T17:28:57.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.928+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=U1AEOHG6S4PR tag=OIZ7AH1KXEM1 type=write size=2709282 2024-09-12T17:28:57.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.930+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=0JHCQ0P8PSKA type=write size=911987 2024-09-12T17:28:57.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.932+0000 7f9d7bc0c780 1 < suggested remove operation key=0JN5WWDYEM6Q tag=HIYSCCBJABTT type=del 2024-09-12T17:28:57.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.935+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~DQXQ2X4E3ZQZ.0 size=1048576 2024-09-12T17:28:57.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.936+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~DQXQ2X4E3ZQZ.1 size=1048576 2024-09-12T17:28:57.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.938+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~DQXQ2X4E3ZQZ.2 size=493711 2024-09-12T17:28:57.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.938+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=DQXQ2X4E3ZQZ tag=1QDOMTZDK5TM type=write size=3639439 2024-09-12T17:28:57.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.939+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~NAZJR7ABC8HW.0 size=980073 2024-09-12T17:28:57.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.942+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=NAZJR7ABC8HW tag=CN9C9R08L8V0 type=write size=2028649 2024-09-12T17:28:57.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.944+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~2C0GVN4HJE8Y.0 size=1048576 2024-09-12T17:28:57.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.946+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~2C0GVN4HJE8Y.1 size=672761 2024-09-12T17:28:57.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.946+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=2C0GVN4HJE8Y tag=9JEWVLD51WS5 type=write size=2769913 2024-09-12T17:28:57.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.947+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~NWUIRUWB9KO3.0 size=857118 2024-09-12T17:28:57.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.949+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=NWUIRUWB9KO3 tag=Z4PBLA0N3LCW type=write size=1905694 2024-09-12T17:28:57.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.951+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=W2FOZ5X3JH29 type=write size=413796 2024-09-12T17:28:57.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.953+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~PMYLW78CYVMT.0 size=1048576 2024-09-12T17:28:57.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.954+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~PMYLW78CYVMT.1 size=732204 2024-09-12T17:28:57.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.956+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=PMYLW78CYVMT tag=1MQL3CGS8FWD type=write size=2829356 2024-09-12T17:28:57.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.958+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=WGH4XC3CUGRR type=del size=1631679 2024-09-12T17:28:57.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.960+0000 7f9d7bc0c780 1 < completed write operation key=5B96YH46VAK3 tag=WPNDO8N0A2R0 type=write size=779908 2024-09-12T17:28:57.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.962+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=456XZ0QG5FN8 type=del size=315213 2024-09-12T17:28:57.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.964+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=PGMR1QSKF4LL type=write size=478293 2024-09-12T17:28:57.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.965+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=5TS4CUQDQXV2 type=del size=643649 2024-09-12T17:28:57.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.969+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=FYFTRP0XZOJ9 type=del size=4065594 2024-09-12T17:28:57.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.970+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=QPBPJF12U3GA type=del size=2774862 2024-09-12T17:28:57.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.972+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~FA4K085G7MYN.0 size=211975 2024-09-12T17:28:57.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.974+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=FA4K085G7MYN tag=LUXHGII4SYKS type=write size=1260551 2024-09-12T17:28:57.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.977+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~6TPDM2XYKXSV.0 size=1048576 2024-09-12T17:28:57.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.978+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~6TPDM2XYKXSV.1 size=1048576 2024-09-12T17:28:57.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.979+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~6TPDM2XYKXSV.2 size=408715 2024-09-12T17:28:57.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.979+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=6TPDM2XYKXSV tag=IH96Z3D848IH type=write size=3554443 2024-09-12T17:28:57.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.982+0000 7f9d7bc0c780 1 < suggested update operation key=OZKAXB0ET9R7 tag=E8LF5F93SP0X type=del size=3712804 2024-09-12T17:28:57.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.985+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~RYYV4UADPHQL.0 size=1048576 2024-09-12T17:28:57.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.986+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~RYYV4UADPHQL.1 size=1048576 2024-09-12T17:28:57.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.987+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~RYYV4UADPHQL.2 size=42821 2024-09-12T17:28:57.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.987+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=RYYV4UADPHQL tag=N19YLFJRKZ15 type=write size=3188549 2024-09-12T17:28:57.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.989+0000 7f9d7bc0c780 -1 < failed to complete operation key=9TE5N5TIB7AD tag=3RJ0V78U92JK type=write size=407006: (22) Invalid argument 2024-09-12T17:28:57.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.991+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~OBD525J8LHOF.0 size=1048576 2024-09-12T17:28:57.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.993+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~OBD525J8LHOF.1 size=115729 2024-09-12T17:28:57.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.993+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=OBD525J8LHOF tag=7PA7QZZGLP8E type=write size=2212881 2024-09-12T17:28:57.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.994+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=UXW12IAIL1KC type=del 2024-09-12T17:28:57.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.997+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~V5TIYJN045OQ.0 size=1048576 2024-09-12T17:28:57.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.998+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~V5TIYJN045OQ.1 size=439392 2024-09-12T17:28:57.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.998+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=V5TIYJN045OQ tag=09XVCE2H6CPA type=write size=2536544 2024-09-12T17:28:58.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:57.999+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=SOF62Z6VJH22 type=write size=923856 2024-09-12T17:28:58.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.002+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~RULIO35A79ZG.0 size=1048576 2024-09-12T17:28:58.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.003+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~RULIO35A79ZG.1 size=1048576 2024-09-12T17:28:58.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.004+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~RULIO35A79ZG.2 size=222835 2024-09-12T17:28:58.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.004+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=RULIO35A79ZG tag=H2W6ZV6KPQTG type=write size=3368563 2024-09-12T17:28:58.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.005+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=DPULQUJZKSKO type=del 2024-09-12T17:28:58.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.007+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=RHONOI4W31FK type=del size=2310282 2024-09-12T17:28:58.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.008+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~OBB1G9H9Q5OI.0 size=1048576 2024-09-12T17:28:58.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.009+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~OBB1G9H9Q5OI.1 size=357803 2024-09-12T17:28:58.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.012+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=OBB1G9H9Q5OI tag=QLDE6N4WF21G type=write size=2454955 2024-09-12T17:28:58.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.013+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=0J47JUOLO03L type=del size=1429865 2024-09-12T17:28:58.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.015+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=ZQIBA9QIP4DI type=del 2024-09-12T17:28:58.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.016+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=6QV6PUO93L7O type=del size=3679100 2024-09-12T17:28:58.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.017+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=0JHCQ0P8PSKA type=write size=911987 2024-09-12T17:28:58.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.020+0000 7f9d7bc0c780 1 > prepared part key=_multipart_58C4SS3TN12K.2~S4YDGZD570NM.0 size=288556 2024-09-12T17:28:58.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.020+0000 7f9d7bc0c780 1 > prepared multipart upload key=58C4SS3TN12K upload=S4YDGZD570NM tag=IQQS38C1GL8P type=write size=1337132 2024-09-12T17:28:58.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.021+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~DQXQ2X4E3ZQZ.0 size=1048576 2024-09-12T17:28:58.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.022+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~DQXQ2X4E3ZQZ.1 size=1048576 2024-09-12T17:28:58.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.024+0000 7f9d7bc0c780 1 < completed part key=_multipart_R94VERREGANN.2~DQXQ2X4E3ZQZ.2 size=493711 2024-09-12T17:28:58.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.026+0000 7f9d7bc0c780 1 < completed multipart upload key=R94VERREGANN upload=DQXQ2X4E3ZQZ tag=1QDOMTZDK5TM type=write size=3639439 2024-09-12T17:28:58.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.027+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=KFVPX7ANEWWF type=del size=1640255 2024-09-12T17:28:58.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.029+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~2C0GVN4HJE8Y.0 size=1048576 2024-09-12T17:28:58.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.030+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~2C0GVN4HJE8Y.1 size=672761 2024-09-12T17:28:58.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.032+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=2C0GVN4HJE8Y tag=9JEWVLD51WS5 type=write size=2769913 2024-09-12T17:28:58.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.034+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~D7V4TL11EXTR.0 size=361801 2024-09-12T17:28:58.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.034+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=D7V4TL11EXTR tag=6QIPTZ631HI3 type=write size=1410377 2024-09-12T17:28:58.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.037+0000 7f9d7bc0c780 -1 < failed to complete operation key=9TE5N5TIB7AD tag=W2FOZ5X3JH29 type=write size=413796: (22) Invalid argument 2024-09-12T17:28:58.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.041+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~329L9525L128.0 size=1048576 2024-09-12T17:28:58.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.042+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~329L9525L128.1 size=1048576 2024-09-12T17:28:58.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.043+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~329L9525L128.2 size=503846 2024-09-12T17:28:58.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.043+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=329L9525L128 tag=F7S3P498DB6X type=write size=3649574 2024-09-12T17:28:58.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.045+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=WGH4XC3CUGRR type=del 2024-09-12T17:28:58.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.046+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=AO83Y1Y2CJF0 type=del size=766279 2024-09-12T17:28:58.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.048+0000 7f9d7bc0c780 -1 < failed to complete operation key=9TE5N5TIB7AD tag=456XZ0QG5FN8 type=del size=315213: (22) Invalid argument 2024-09-12T17:28:58.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.050+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~GV4KXDZCVNU3.0 size=1048576 2024-09-12T17:28:58.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.051+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~GV4KXDZCVNU3.1 size=1048576 2024-09-12T17:28:58.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.053+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~GV4KXDZCVNU3.2 size=615592 2024-09-12T17:28:58.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.053+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=GV4KXDZCVNU3 tag=32CKFRJU9L4C type=write size=3761320 2024-09-12T17:28:58.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.054+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=5TS4CUQDQXV2 type=del 2024-09-12T17:28:58.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.056+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=M0RQQMQAJOMX type=del size=3859839 2024-09-12T17:28:58.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.057+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=QPBPJF12U3GA type=del 2024-09-12T17:28:58.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.059+0000 7f9d7bc0c780 1 > prepared part key=_multipart_R94VERREGANN.2~N1E1QVQT2ZR4.0 size=245250 2024-09-12T17:28:58.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.059+0000 7f9d7bc0c780 1 > prepared multipart upload key=R94VERREGANN upload=N1E1QVQT2ZR4 tag=ODFG0XJSJQNY type=write size=1293826 2024-09-12T17:28:58.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.061+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~6TPDM2XYKXSV.0 size=1048576 2024-09-12T17:28:58.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.062+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~6TPDM2XYKXSV.1 size=1048576 2024-09-12T17:28:58.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.063+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~6TPDM2XYKXSV.2 size=408715 2024-09-12T17:28:58.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.065+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=6TPDM2XYKXSV tag=IH96Z3D848IH type=write size=3554443 2024-09-12T17:28:58.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.067+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=GE2NCD0WZ6OA type=del size=1269617 2024-09-12T17:28:58.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.069+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~RYYV4UADPHQL.0 size=1048576 2024-09-12T17:28:58.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.070+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~RYYV4UADPHQL.1 size=1048576 2024-09-12T17:28:58.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.071+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~RYYV4UADPHQL.2 size=42821 2024-09-12T17:28:58.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.075+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=RYYV4UADPHQL tag=N19YLFJRKZ15 type=write size=3188549 2024-09-12T17:28:58.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.077+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=EC52AXB873MH type=del size=83896 2024-09-12T17:28:58.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.078+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~OBD525J8LHOF.0 size=1048576 2024-09-12T17:28:58.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.079+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~OBD525J8LHOF.1 size=115729 2024-09-12T17:28:58.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.082+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=OBD525J8LHOF tag=7PA7QZZGLP8E type=write size=2212881 2024-09-12T17:28:58.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.083+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=AR4W7W3DM6O0 type=del size=350271 2024-09-12T17:28:58.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.085+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~V5TIYJN045OQ.0 size=1048576 2024-09-12T17:28:58.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.086+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~V5TIYJN045OQ.1 size=439392 2024-09-12T17:28:58.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.088+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=V5TIYJN045OQ tag=09XVCE2H6CPA type=write size=2536544 2024-09-12T17:28:58.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.091+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~EHXNMPBW72DV.0 size=629157 2024-09-12T17:28:58.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.091+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=EHXNMPBW72DV tag=X44GD7X16ABT type=write size=1677733 2024-09-12T17:28:58.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.092+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~RULIO35A79ZG.0 size=1048576 2024-09-12T17:28:58.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.093+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~RULIO35A79ZG.1 size=1048576 2024-09-12T17:28:58.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.095+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~RULIO35A79ZG.2 size=222835 2024-09-12T17:28:58.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.097+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=RULIO35A79ZG tag=H2W6ZV6KPQTG type=write size=3368563 2024-09-12T17:28:58.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.098+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=5ZNURI9N5D4E type=del size=1930351 2024-09-12T17:28:58.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.100+0000 7f9d7bc0c780 1 < canceled operation key=R94VERREGANN tag=RHONOI4W31FK type=del size=2310282 2024-09-12T17:28:58.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.101+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=NPBDD5UQ7W3E type=del size=4184375 2024-09-12T17:28:58.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.103+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=0J47JUOLO03L type=del 2024-09-12T17:28:58.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.105+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=0YS6SCWSLZDM type=write size=365064 2024-09-12T17:28:58.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.106+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=6QV6PUO93L7O type=del 2024-09-12T17:28:58.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.108+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=PN5ON3LH80X1 type=write size=366312 2024-09-12T17:28:58.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.109+0000 7f9d7bc0c780 1 < completed part key=_multipart_58C4SS3TN12K.2~S4YDGZD570NM.0 size=288556 2024-09-12T17:28:58.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.111+0000 7f9d7bc0c780 1 < completed multipart upload key=58C4SS3TN12K upload=S4YDGZD570NM tag=IQQS38C1GL8P type=write size=1337132 2024-09-12T17:28:58.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.113+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=SBNF81EPT05W type=del size=1820334 2024-09-12T17:28:58.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.114+0000 7f9d7bc0c780 1 < canceled operation key=G5ZKTTY1XQ9T tag=KFVPX7ANEWWF type=del size=1640255 2024-09-12T17:28:58.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.117+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~5VA0FLHL33H4.0 size=1048576 2024-09-12T17:28:58.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.118+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~5VA0FLHL33H4.1 size=1048576 2024-09-12T17:28:58.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.120+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~5VA0FLHL33H4.2 size=539345 2024-09-12T17:28:58.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.120+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=5VA0FLHL33H4 tag=W20A6YEZ1CP9 type=write size=3685073 2024-09-12T17:28:58.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.121+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~D7V4TL11EXTR.0 size=361801 2024-09-12T17:28:58.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.124+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=D7V4TL11EXTR tag=6QIPTZ631HI3 type=write size=1410377 2024-09-12T17:28:58.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.125+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=WFL7JSD29TRH type=del size=4155983 2024-09-12T17:28:58.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.126+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~329L9525L128.0 size=1048576 2024-09-12T17:28:58.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.128+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~329L9525L128.1 size=1048576 2024-09-12T17:28:58.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.129+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~329L9525L128.2 size=503846 2024-09-12T17:28:58.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.131+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=329L9525L128 tag=F7S3P498DB6X type=write size=3649574 2024-09-12T17:28:58.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.133+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=WUN86IFQCJZ3 type=del size=3079003 2024-09-12T17:28:58.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.134+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=AO83Y1Y2CJF0 type=del 2024-09-12T17:28:58.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.136+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=EFORS84QA2EZ type=del size=3278601 2024-09-12T17:28:58.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.136+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~GV4KXDZCVNU3.0 size=1048576 2024-09-12T17:28:58.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.137+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~GV4KXDZCVNU3.1 size=1048576 2024-09-12T17:28:58.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.139+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~GV4KXDZCVNU3.2 size=615592 2024-09-12T17:28:58.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.141+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=GV4KXDZCVNU3 tag=32CKFRJU9L4C type=write size=3761320 2024-09-12T17:28:58.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.142+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=SYUZSV1K8XMO type=del size=1630787 2024-09-12T17:28:58.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.144+0000 7f9d7bc0c780 1 < completed delete operation key=J3YYRIVKQ5AU tag=M0RQQMQAJOMX type=del 2024-09-12T17:28:58.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.145+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=5U78B95H65JP type=del size=4167775 2024-09-12T17:28:58.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.146+0000 7f9d7bc0c780 1 < canceled part key=_multipart_R94VERREGANN.2~N1E1QVQT2ZR4.0 size=245250 2024-09-12T17:28:58.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.149+0000 7f9d7bc0c780 1 < canceled multipart upload key=R94VERREGANN upload=N1E1QVQT2ZR4 tag=ODFG0XJSJQNY type=write size=1293826 2024-09-12T17:28:58.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.151+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=T5BBRK6IW53B type=del size=1920023 2024-09-12T17:28:58.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.152+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=GE2NCD0WZ6OA type=del 2024-09-12T17:28:58.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.155+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~FBSE5T00IP7W.0 size=1048576 2024-09-12T17:28:58.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.156+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~FBSE5T00IP7W.1 size=78184 2024-09-12T17:28:58.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.156+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=FBSE5T00IP7W tag=9TOQDLRUPCN8 type=write size=2175336 2024-09-12T17:28:58.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.158+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=EC52AXB873MH type=del 2024-09-12T17:28:58.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.159+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=MHVZLUBO1FLC type=write size=197439 2024-09-12T17:28:58.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.161+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=AR4W7W3DM6O0 type=del 2024-09-12T17:28:58.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.162+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=WSP27J44NN34 type=del size=2853413 2024-09-12T17:28:58.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.164+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~EHXNMPBW72DV.0 size=629157 2024-09-12T17:28:58.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.166+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=EHXNMPBW72DV tag=X44GD7X16ABT type=write size=1677733 2024-09-12T17:28:58.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.168+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~606D7D0KBF70.0 size=1048576 2024-09-12T17:28:58.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.169+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~606D7D0KBF70.1 size=1048576 2024-09-12T17:28:58.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.170+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~606D7D0KBF70.2 size=100219 2024-09-12T17:28:58.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.170+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=606D7D0KBF70 tag=E5AYDT4NVE6J type=write size=3245947 2024-09-12T17:28:58.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.173+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=5ZNURI9N5D4E type=del 2024-09-12T17:28:58.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.177+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~HI1TTVNO4N2K.0 size=888659 2024-09-12T17:28:58.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.177+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=HI1TTVNO4N2K tag=AQZPJO4O537I type=write size=1937235 2024-09-12T17:28:58.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.178+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=NPBDD5UQ7W3E type=del 2024-09-12T17:28:58.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.181+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=Q3W2FQMVAO3U type=del size=2213612 2024-09-12T17:28:58.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.183+0000 7f9d7bc0c780 1 < completed write operation key=CYKLX4CJWVJE tag=0YS6SCWSLZDM type=write size=365064 2024-09-12T17:28:58.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.184+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=4UXYWTUS8375 type=write size=158140 2024-09-12T17:28:58.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.186+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=PN5ON3LH80X1 type=write size=366312 2024-09-12T17:28:58.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.188+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~AFI1R0MDN0QH.0 size=1048576 2024-09-12T17:28:58.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.189+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~AFI1R0MDN0QH.1 size=967420 2024-09-12T17:28:58.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.189+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=AFI1R0MDN0QH tag=FG79OA8HAXPQ type=write size=3064572 2024-09-12T17:28:58.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.191+0000 7f9d7bc0c780 1 < canceled operation key=9B83KWC5E4ZV tag=SBNF81EPT05W type=del size=1820334 2024-09-12T17:28:58.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.192+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=3C3PDJZ4XF9X type=write size=1005349 2024-09-12T17:28:58.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.193+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~5VA0FLHL33H4.0 size=1048576 2024-09-12T17:28:58.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.195+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~5VA0FLHL33H4.1 size=1048576 2024-09-12T17:28:58.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.196+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~5VA0FLHL33H4.2 size=539345 2024-09-12T17:28:58.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.198+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=5VA0FLHL33H4 tag=W20A6YEZ1CP9 type=write size=3685073 2024-09-12T17:28:58.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.200+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=QT841MC29M5U type=del size=1468525 2024-09-12T17:28:58.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.201+0000 7f9d7bc0c780 1 < canceled operation key=LTG0UQEYPUGO tag=WFL7JSD29TRH type=del size=4155983 2024-09-12T17:28:58.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.203+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=TC6140WESWAK type=del size=4169057 2024-09-12T17:28:58.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.205+0000 7f9d7bc0c780 1 < suggested remove operation key=64T291B0U226 tag=WUN86IFQCJZ3 type=del 2024-09-12T17:28:58.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.207+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=TJWB8KKXYZYO type=del size=3126099 2024-09-12T17:28:58.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.210+0000 7f9d7bc0c780 1 < suggested update operation key=ZM8NMC18RN3I tag=EFORS84QA2EZ type=del size=3278601 2024-09-12T17:28:58.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.211+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=OKWVWB60839K type=write size=17989 2024-09-12T17:28:58.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.213+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=SYUZSV1K8XMO type=del 2024-09-12T17:28:58.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.215+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~WHDFKRC0KPUA.0 size=1048576 2024-09-12T17:28:58.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.216+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~WHDFKRC0KPUA.1 size=1019985 2024-09-12T17:28:58.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.216+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=WHDFKRC0KPUA tag=F9EMIRDINCFH type=write size=3117137 2024-09-12T17:28:58.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.219+0000 7f9d7bc0c780 1 < suggested remove operation key=0BYGD7FTPQF3 tag=5U78B95H65JP type=del 2024-09-12T17:28:58.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.221+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~29TOAMR96GSA.0 size=1048576 2024-09-12T17:28:58.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.223+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~29TOAMR96GSA.1 size=728543 2024-09-12T17:28:58.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.223+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=29TOAMR96GSA tag=W3ZBNYXORHN2 type=write size=2825695 2024-09-12T17:28:58.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.224+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=T5BBRK6IW53B type=del 2024-09-12T17:28:58.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.226+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=DFYNIX3W4W0E type=del size=44413 2024-09-12T17:28:58.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.227+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~FBSE5T00IP7W.0 size=1048576 2024-09-12T17:28:58.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.228+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~FBSE5T00IP7W.1 size=78184 2024-09-12T17:28:58.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.231+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=FBSE5T00IP7W tag=9TOQDLRUPCN8 type=write size=2175336 2024-09-12T17:28:58.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.234+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~GAFP2T6FKCR4.0 size=1048576 2024-09-12T17:28:58.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.235+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~GAFP2T6FKCR4.1 size=1048576 2024-09-12T17:28:58.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.236+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~GAFP2T6FKCR4.2 size=395219 2024-09-12T17:28:58.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.236+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=GAFP2T6FKCR4 tag=3R0SMG5BGLQJ type=write size=3540947 2024-09-12T17:28:58.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.239+0000 7f9d7bc0c780 1 < suggested remove operation key=9B83KWC5E4ZV tag=MHVZLUBO1FLC type=write 2024-09-12T17:28:58.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.242+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~Q9DKV4TN1DNC.0 size=1048576 2024-09-12T17:28:58.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.243+0000 7f9d7bc0c780 1 > prepared part key=_multipart_W1SE9R6KU04G.2~Q9DKV4TN1DNC.1 size=101358 2024-09-12T17:28:58.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.243+0000 7f9d7bc0c780 1 > prepared multipart upload key=W1SE9R6KU04G upload=Q9DKV4TN1DNC tag=TP69GUW3B3W4 type=write size=2198510 2024-09-12T17:28:58.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.244+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=WSP27J44NN34 type=del 2024-09-12T17:28:58.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.246+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=ZV5NHF1640SH type=del size=884798 2024-09-12T17:28:58.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.247+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~606D7D0KBF70.0 size=1048576 2024-09-12T17:28:58.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.248+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~606D7D0KBF70.1 size=1048576 2024-09-12T17:28:58.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.250+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~606D7D0KBF70.2 size=100219 2024-09-12T17:28:58.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.252+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=606D7D0KBF70 tag=E5AYDT4NVE6J type=write size=3245947 2024-09-12T17:28:58.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.253+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=P5HJ4R93K03V type=del size=4171776 2024-09-12T17:28:58.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.254+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0NGHC5GMSGRX.2~HI1TTVNO4N2K.0 size=888659 2024-09-12T17:28:58.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.256+0000 7f9d7bc0c780 1 < canceled multipart upload key=0NGHC5GMSGRX upload=HI1TTVNO4N2K tag=AQZPJO4O537I type=write size=1937235 2024-09-12T17:28:58.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.257+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=ZQ62WXUE3HUA type=del size=427414 2024-09-12T17:28:58.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.259+0000 7f9d7bc0c780 -1 < failed to complete operation key=64T291B0U226 tag=Q3W2FQMVAO3U type=del size=2213612: (22) Invalid argument 2024-09-12T17:28:58.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.261+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=3BX9A6LLEAOP type=write size=1005920 2024-09-12T17:28:58.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.262+0000 7f9d7bc0c780 1 < completed write operation key=80JXIGQWQGR9 tag=4UXYWTUS8375 type=write size=158140 2024-09-12T17:28:58.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.265+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~ZPCSQGM6FPFA.0 size=1048576 2024-09-12T17:28:58.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.266+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~ZPCSQGM6FPFA.1 size=879667 2024-09-12T17:28:58.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.266+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=ZPCSQGM6FPFA tag=B355NGGH4XK7 type=write size=2976819 2024-09-12T17:28:58.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.267+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~AFI1R0MDN0QH.0 size=1048576 2024-09-12T17:28:58.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.269+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~AFI1R0MDN0QH.1 size=967420 2024-09-12T17:28:58.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.271+0000 7f9d7bc0c780 1 < completed multipart upload key=ZM8NMC18RN3I upload=AFI1R0MDN0QH tag=FG79OA8HAXPQ type=write size=3064572 2024-09-12T17:28:58.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.272+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=M7HBGKA0M2F7 type=del size=2249162 2024-09-12T17:28:58.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.274+0000 7f9d7bc0c780 1 < canceled operation key=58C4SS3TN12K tag=3C3PDJZ4XF9X type=write size=1005349 2024-09-12T17:28:58.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.276+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~GBBVHCFHB2FP.0 size=1048576 2024-09-12T17:28:58.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.278+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~GBBVHCFHB2FP.1 size=1048576 2024-09-12T17:28:58.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.279+0000 7f9d7bc0c780 1 > prepared part key=_multipart_G5ZKTTY1XQ9T.2~GBBVHCFHB2FP.2 size=441648 2024-09-12T17:28:58.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.279+0000 7f9d7bc0c780 1 > prepared multipart upload key=G5ZKTTY1XQ9T upload=GBBVHCFHB2FP tag=KC0ABXXJH30I type=write size=3587376 2024-09-12T17:28:58.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.280+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=QT841MC29M5U type=del 2024-09-12T17:28:58.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.282+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=56U5BRJ2TOPT type=del size=826819 2024-09-12T17:28:58.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.283+0000 7f9d7bc0c780 1 < completed delete operation key=58C4SS3TN12K tag=TC6140WESWAK type=del 2024-09-12T17:28:58.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.285+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=TVGFHDUPS74P type=del size=1267360 2024-09-12T17:28:58.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.286+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=TJWB8KKXYZYO type=del 2024-09-12T17:28:58.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.287+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=UDKZKLTD8BOV type=del size=3105607 2024-09-12T17:28:58.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.290+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=OKWVWB60839K type=write size=17989 2024-09-12T17:28:58.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.291+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=VPIU0005T336 type=del size=3283704 2024-09-12T17:28:58.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.293+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~WHDFKRC0KPUA.0 size=1048576 2024-09-12T17:28:58.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.294+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~WHDFKRC0KPUA.1 size=1019985 2024-09-12T17:28:58.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.297+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=WHDFKRC0KPUA tag=F9EMIRDINCFH type=write size=3117137 2024-09-12T17:28:58.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.300+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~PC36TRQY5EO7.0 size=1048576 2024-09-12T17:28:58.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.301+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~PC36TRQY5EO7.1 size=511975 2024-09-12T17:28:58.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.301+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=PC36TRQY5EO7 tag=628UML3DS2FL type=write size=2609127 2024-09-12T17:28:58.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.302+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~29TOAMR96GSA.0 size=1048576 2024-09-12T17:28:58.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.302+0000 7f9d7bc0c780 1 < canceled part key=_multipart_LTG0UQEYPUGO.2~29TOAMR96GSA.1 size=728543 2024-09-12T17:28:58.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.305+0000 7f9d7bc0c780 1 < canceled multipart upload key=LTG0UQEYPUGO upload=29TOAMR96GSA tag=W3ZBNYXORHN2 type=write size=2825695 2024-09-12T17:28:58.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.307+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=IHTIBSBPIU4U type=del size=2827223 2024-09-12T17:28:58.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.308+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=DFYNIX3W4W0E type=del 2024-09-12T17:28:58.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.309+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=V30COII0QK2Y type=del size=1085913 2024-09-12T17:28:58.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.311+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~GAFP2T6FKCR4.0 size=1048576 2024-09-12T17:28:58.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.313+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~GAFP2T6FKCR4.1 size=1048576 2024-09-12T17:28:58.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.316+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~GAFP2T6FKCR4.2 size=395219 2024-09-12T17:28:58.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.319+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=GAFP2T6FKCR4 tag=3R0SMG5BGLQJ type=write size=3540947 2024-09-12T17:28:58.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.321+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=8N0TVZ6ECYV5 type=write size=893127 2024-09-12T17:28:58.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.323+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~Q9DKV4TN1DNC.0 size=1048576 2024-09-12T17:28:58.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.324+0000 7f9d7bc0c780 1 < completed part key=_multipart_W1SE9R6KU04G.2~Q9DKV4TN1DNC.1 size=101358 2024-09-12T17:28:58.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.326+0000 7f9d7bc0c780 1 < completed multipart upload key=W1SE9R6KU04G upload=Q9DKV4TN1DNC tag=TP69GUW3B3W4 type=write size=2198510 2024-09-12T17:28:58.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.329+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~JA6FXEGTNJMM.0 size=1048576 2024-09-12T17:28:58.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.330+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~JA6FXEGTNJMM.1 size=1048576 2024-09-12T17:28:58.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.331+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~JA6FXEGTNJMM.2 size=1027028 2024-09-12T17:28:58.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.331+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=JA6FXEGTNJMM tag=NV0MH7R7884G type=write size=4172756 2024-09-12T17:28:58.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.332+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=ZV5NHF1640SH type=del 2024-09-12T17:28:58.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.334+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=CYXWFF5FAMSC type=del size=1032002 2024-09-12T17:28:58.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.337+0000 7f9d7bc0c780 1 < suggested remove operation key=9B83KWC5E4ZV tag=P5HJ4R93K03V type=del 2024-09-12T17:28:58.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.338+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=JE4LJX4LL2O3 type=del size=2863412 2024-09-12T17:28:58.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.340+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=ZQ62WXUE3HUA type=del 2024-09-12T17:28:58.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.342+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~DA93Z5Y6LPW7.0 size=1048576 2024-09-12T17:28:58.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.343+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~DA93Z5Y6LPW7.1 size=1048576 2024-09-12T17:28:58.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.345+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~DA93Z5Y6LPW7.2 size=568519 2024-09-12T17:28:58.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.345+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=DA93Z5Y6LPW7 tag=4DX99YCLDLWI type=write size=3714247 2024-09-12T17:28:58.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.347+0000 7f9d7bc0c780 1 < suggested remove operation key=J3YYRIVKQ5AU tag=3BX9A6LLEAOP type=write 2024-09-12T17:28:58.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.349+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=1EEUFIEFBAIG type=del size=2799347 2024-09-12T17:28:58.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.350+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~ZPCSQGM6FPFA.0 size=1048576 2024-09-12T17:28:58.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.350+0000 7f9d7bc0c780 1 < canceled part key=_multipart_FU7ARIH2X839.2~ZPCSQGM6FPFA.1 size=879667 2024-09-12T17:28:58.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.352+0000 7f9d7bc0c780 1 < canceled multipart upload key=FU7ARIH2X839 upload=ZPCSQGM6FPFA tag=B355NGGH4XK7 type=write size=2976819 2024-09-12T17:28:58.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.354+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=DFYKBUY6UQ08 type=write size=588469 2024-09-12T17:28:58.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.356+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=M7HBGKA0M2F7 type=del 2024-09-12T17:28:58.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.357+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=A6JNVAWT8PH5 type=del size=3710136 2024-09-12T17:28:58.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.359+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~GBBVHCFHB2FP.0 size=1048576 2024-09-12T17:28:58.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.360+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~GBBVHCFHB2FP.1 size=1048576 2024-09-12T17:28:58.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.361+0000 7f9d7bc0c780 1 < completed part key=_multipart_G5ZKTTY1XQ9T.2~GBBVHCFHB2FP.2 size=441648 2024-09-12T17:28:58.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.364+0000 7f9d7bc0c780 1 < completed multipart upload key=G5ZKTTY1XQ9T upload=GBBVHCFHB2FP tag=KC0ABXXJH30I type=write size=3587376 2024-09-12T17:28:58.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.366+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~H6NJ0ZCDFRIC.0 size=350451 2024-09-12T17:28:58.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.366+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=H6NJ0ZCDFRIC tag=6NRZ7VIAGPTA type=write size=1399027 2024-09-12T17:28:58.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.368+0000 7f9d7bc0c780 1 < canceled operation key=CYKLX4CJWVJE tag=56U5BRJ2TOPT type=del size=826819 2024-09-12T17:28:58.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.370+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~HN8KF41E9GU5.0 size=142454 2024-09-12T17:28:58.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.370+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=HN8KF41E9GU5 tag=N2ODO052CN92 type=write size=1191030 2024-09-12T17:28:58.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.373+0000 7f9d7bc0c780 1 < suggested remove operation key=31PU0U6IEAV2 tag=TVGFHDUPS74P type=del 2024-09-12T17:28:58.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.375+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=TFVAP0WKU0F3 type=del size=1704296 2024-09-12T17:28:58.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.376+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=UDKZKLTD8BOV type=del 2024-09-12T17:28:58.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.379+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~R8M602KLJI5Y.0 size=1048576 2024-09-12T17:28:58.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.380+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~R8M602KLJI5Y.1 size=882286 2024-09-12T17:28:58.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.380+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=R8M602KLJI5Y tag=5WJ1NTAK8QQA type=write size=2979438 2024-09-12T17:28:58.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.382+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=VPIU0005T336 type=del 2024-09-12T17:28:58.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.383+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=RWN982FYS0RQ type=del size=2747598 2024-09-12T17:28:58.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.385+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~PC36TRQY5EO7.0 size=1048576 2024-09-12T17:28:58.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.386+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~PC36TRQY5EO7.1 size=511975 2024-09-12T17:28:58.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.388+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=PC36TRQY5EO7 tag=628UML3DS2FL type=write size=2609127 2024-09-12T17:28:58.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.391+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~LU2DJQWDXWFG.0 size=1048576 2024-09-12T17:28:58.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.392+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~LU2DJQWDXWFG.1 size=232138 2024-09-12T17:28:58.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.392+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=LU2DJQWDXWFG tag=0QKKZVFXFLDV type=write size=2329290 2024-09-12T17:28:58.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.393+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=IHTIBSBPIU4U type=del 2024-09-12T17:28:58.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.396+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~A8ZMEUWR3ZET.0 size=163768 2024-09-12T17:28:58.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.396+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=A8ZMEUWR3ZET tag=O83R73H9Z12Y type=write size=1212344 2024-09-12T17:28:58.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.397+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=V30COII0QK2Y type=del 2024-09-12T17:28:58.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.400+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~BS86HDNVD0K0.0 size=1048576 2024-09-12T17:28:58.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.401+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~BS86HDNVD0K0.1 size=1048576 2024-09-12T17:28:58.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.402+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~BS86HDNVD0K0.2 size=431169 2024-09-12T17:28:58.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.402+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=BS86HDNVD0K0 tag=IMOON24ZS3GU type=write size=3576897 2024-09-12T17:28:58.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.404+0000 7f9d7bc0c780 1 < completed write operation key=CYKLX4CJWVJE tag=8N0TVZ6ECYV5 type=write size=893127 2024-09-12T17:28:58.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.405+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=PIC6RPVM23RM type=del size=3366713 2024-09-12T17:28:58.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.407+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~JA6FXEGTNJMM.0 size=1048576 2024-09-12T17:28:58.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.408+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~JA6FXEGTNJMM.1 size=1048576 2024-09-12T17:28:58.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.409+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~JA6FXEGTNJMM.2 size=1027028 2024-09-12T17:28:58.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.411+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=JA6FXEGTNJMM tag=NV0MH7R7884G type=write size=4172756 2024-09-12T17:28:58.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.413+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=MVZW3M9Q46HC type=del size=644033 2024-09-12T17:28:58.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.414+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=CYXWFF5FAMSC type=del 2024-09-12T17:28:58.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.415+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=6EL08E95AFN4 type=write size=302044 2024-09-12T17:28:58.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.417+0000 7f9d7bc0c780 1 < completed delete operation key=0NGHC5GMSGRX tag=JE4LJX4LL2O3 type=del 2024-09-12T17:28:58.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.419+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~ZQA7FCWK3UJP.0 size=308014 2024-09-12T17:28:58.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.419+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=ZQA7FCWK3UJP tag=66C6Q75L7H5G type=write size=1356590 2024-09-12T17:28:58.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.421+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~DA93Z5Y6LPW7.0 size=1048576 2024-09-12T17:28:58.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.422+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~DA93Z5Y6LPW7.1 size=1048576 2024-09-12T17:28:58.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.423+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~DA93Z5Y6LPW7.2 size=568519 2024-09-12T17:28:58.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.425+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=DA93Z5Y6LPW7 tag=4DX99YCLDLWI type=write size=3714247 2024-09-12T17:28:58.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.428+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~GC0620TV00KA.0 size=1048576 2024-09-12T17:28:58.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.429+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~GC0620TV00KA.1 size=357393 2024-09-12T17:28:58.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.429+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=GC0620TV00KA tag=SURER12A8IUC type=write size=2454545 2024-09-12T17:28:58.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.430+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=1EEUFIEFBAIG type=del 2024-09-12T17:28:58.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.432+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=4J4CCKJL3TG8 type=del size=3654489 2024-09-12T17:28:58.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.433+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=DFYKBUY6UQ08 type=write size=588469 2024-09-12T17:28:58.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.435+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=AQSJGDKP9ET4 type=del size=2227390 2024-09-12T17:28:58.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.436+0000 7f9d7bc0c780 1 < completed delete operation key=CYKLX4CJWVJE tag=A6JNVAWT8PH5 type=del 2024-09-12T17:28:58.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.437+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=IPHBASRW9AXN type=del size=4003175 2024-09-12T17:28:58.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.439+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~H6NJ0ZCDFRIC.0 size=350451 2024-09-12T17:28:58.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.441+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=H6NJ0ZCDFRIC tag=6NRZ7VIAGPTA type=write size=1399027 2024-09-12T17:28:58.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.444+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~XYV66OD78MRY.0 size=1048576 2024-09-12T17:28:58.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.445+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~XYV66OD78MRY.1 size=497867 2024-09-12T17:28:58.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.445+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=XYV66OD78MRY tag=4WXJXJA9TTPU type=write size=2595019 2024-09-12T17:28:58.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.446+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~HN8KF41E9GU5.0 size=142454 2024-09-12T17:28:58.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.450+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=HN8KF41E9GU5 tag=N2ODO052CN92 type=write size=1191030 2024-09-12T17:28:58.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.453+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~3Q3CLNLPBLBF.0 size=1048576 2024-09-12T17:28:58.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.454+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~3Q3CLNLPBLBF.1 size=1048576 2024-09-12T17:28:58.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.455+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~3Q3CLNLPBLBF.2 size=273985 2024-09-12T17:28:58.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.455+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=3Q3CLNLPBLBF tag=C23GUMD56PAE type=write size=3419713 2024-09-12T17:28:58.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.457+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=TFVAP0WKU0F3 type=del 2024-09-12T17:28:58.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.458+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=1JT6Q5274L05 type=del size=338604 2024-09-12T17:28:58.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.459+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~R8M602KLJI5Y.0 size=1048576 2024-09-12T17:28:58.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.461+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~R8M602KLJI5Y.1 size=882286 2024-09-12T17:28:58.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.463+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=R8M602KLJI5Y tag=5WJ1NTAK8QQA type=write size=2979438 2024-09-12T17:28:58.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.464+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=4T1G5T07FUPH type=del size=1866575 2024-09-12T17:28:58.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.466+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=RWN982FYS0RQ type=del 2024-09-12T17:28:58.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.467+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=XKJCUOS6ANOJ type=del size=2065197 2024-09-12T17:28:58.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.468+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~LU2DJQWDXWFG.0 size=1048576 2024-09-12T17:28:58.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.470+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~LU2DJQWDXWFG.1 size=232138 2024-09-12T17:28:58.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.472+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=LU2DJQWDXWFG tag=0QKKZVFXFLDV type=write size=2329290 2024-09-12T17:28:58.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.473+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=PTLCV6QA4UAC type=del size=3811969 2024-09-12T17:28:58.476 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.475+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~A8ZMEUWR3ZET.0 size=163768 2024-09-12T17:28:58.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.477+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=A8ZMEUWR3ZET tag=O83R73H9Z12Y type=write size=1212344 2024-09-12T17:28:58.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.479+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~CYCLEX16U1HO.0 size=1048576 2024-09-12T17:28:58.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.481+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~CYCLEX16U1HO.1 size=333068 2024-09-12T17:28:58.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.481+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=CYCLEX16U1HO tag=OSZ1VXIL19H2 type=write size=2430220 2024-09-12T17:28:58.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.482+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~BS86HDNVD0K0.0 size=1048576 2024-09-12T17:28:58.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.483+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~BS86HDNVD0K0.1 size=1048576 2024-09-12T17:28:58.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.485+0000 7f9d7bc0c780 1 < completed part key=_multipart_80JXIGQWQGR9.2~BS86HDNVD0K0.2 size=431169 2024-09-12T17:28:58.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.487+0000 7f9d7bc0c780 1 < completed multipart upload key=80JXIGQWQGR9 upload=BS86HDNVD0K0 tag=IMOON24ZS3GU type=write size=3576897 2024-09-12T17:28:58.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.489+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=10PUJ544JVVT type=del size=3721488 2024-09-12T17:28:58.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.492+0000 7f9d7bc0c780 1 < suggested remove operation key=NQ0768B94GVV tag=PIC6RPVM23RM type=del 2024-09-12T17:28:58.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.494+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=NFQ2D1MZ0I6H type=write size=270617 2024-09-12T17:28:58.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.497+0000 7f9d7bc0c780 1 < suggested remove operation key=64T291B0U226 tag=MVZW3M9Q46HC type=del 2024-09-12T17:28:58.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.498+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=N8LJYHXWJPM4 type=del size=3937525 2024-09-12T17:28:58.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.501+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=6EL08E95AFN4 type=write 2024-09-12T17:28:58.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.502+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=1ECSD9GHQ20Y type=del size=3170801 2024-09-12T17:28:58.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.504+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~ZQA7FCWK3UJP.0 size=308014 2024-09-12T17:28:58.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.506+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=ZQA7FCWK3UJP tag=66C6Q75L7H5G type=write size=1356590 2024-09-12T17:28:58.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.507+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=2SLWW20FSVM3 type=del size=2862857 2024-09-12T17:28:58.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.509+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~GC0620TV00KA.0 size=1048576 2024-09-12T17:28:58.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.510+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~GC0620TV00KA.1 size=357393 2024-09-12T17:28:58.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.512+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=GC0620TV00KA tag=SURER12A8IUC type=write size=2454545 2024-09-12T17:28:58.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.514+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=HS2RYPB5WECI type=del size=1243812 2024-09-12T17:28:58.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.515+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=4J4CCKJL3TG8 type=del 2024-09-12T17:28:58.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.516+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=RRFM09BN1EHL type=del size=3705320 2024-09-12T17:28:58.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.518+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=AQSJGDKP9ET4 type=del 2024-09-12T17:28:58.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.519+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=K4EB0LYWSO1M type=del size=942753 2024-09-12T17:28:58.521 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.521+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=IPHBASRW9AXN type=del 2024-09-12T17:28:58.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.522+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=18HSBWNYCJG2 type=del size=3522053 2024-09-12T17:28:58.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.524+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~XYV66OD78MRY.0 size=1048576 2024-09-12T17:28:58.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.525+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~XYV66OD78MRY.1 size=497867 2024-09-12T17:28:58.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.527+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=XYV66OD78MRY tag=4WXJXJA9TTPU type=write size=2595019 2024-09-12T17:28:58.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.529+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=4DHYSO2CDZSK type=del size=1512953 2024-09-12T17:28:58.531 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.530+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~3Q3CLNLPBLBF.0 size=1048576 2024-09-12T17:28:58.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.531+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~3Q3CLNLPBLBF.1 size=1048576 2024-09-12T17:28:58.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.532+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~3Q3CLNLPBLBF.2 size=273985 2024-09-12T17:28:58.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.535+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=3Q3CLNLPBLBF tag=C23GUMD56PAE type=write size=3419713 2024-09-12T17:28:58.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.537+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~3JKZEBL5MDOR.0 size=1048576 2024-09-12T17:28:58.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.539+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LJZNPSVLS9AF.2~3JKZEBL5MDOR.1 size=5865 2024-09-12T17:28:58.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.539+0000 7f9d7bc0c780 1 > prepared multipart upload key=LJZNPSVLS9AF upload=3JKZEBL5MDOR tag=CFO1B0H7R9I1 type=write size=2103017 2024-09-12T17:28:58.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.540+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=1JT6Q5274L05 type=del 2024-09-12T17:28:58.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.541+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=XMZCIG0MQ50C type=del size=1804363 2024-09-12T17:28:58.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.544+0000 7f9d7bc0c780 1 < suggested update operation key=58C4SS3TN12K tag=4T1G5T07FUPH type=del size=1866575 2024-09-12T17:28:58.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.547+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~MQSOANBZ3HKD.0 size=463750 2024-09-12T17:28:58.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.547+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=MQSOANBZ3HKD tag=LAZ3SJID8SYO type=write size=1512326 2024-09-12T17:28:58.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.550+0000 7f9d7bc0c780 1 < suggested remove operation key=M3Q7I7MD7M4I tag=XKJCUOS6ANOJ type=del 2024-09-12T17:28:58.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.551+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=D5DCAIOOLDG6 type=write size=876662 2024-09-12T17:28:58.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.553+0000 7f9d7bc0c780 1 < canceled operation key=31PU0U6IEAV2 tag=PTLCV6QA4UAC type=del size=3811969 2024-09-12T17:28:58.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.554+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=5YURM6XOWZ82 type=del size=2223441 2024-09-12T17:28:58.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.555+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~CYCLEX16U1HO.0 size=1048576 2024-09-12T17:28:58.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.557+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~CYCLEX16U1HO.1 size=333068 2024-09-12T17:28:58.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.559+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=CYCLEX16U1HO tag=OSZ1VXIL19H2 type=write size=2430220 2024-09-12T17:28:58.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.561+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~2TZ9C4X77318.0 size=1048576 2024-09-12T17:28:58.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.562+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~2TZ9C4X77318.1 size=734834 2024-09-12T17:28:58.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.562+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=2TZ9C4X77318 tag=JAER9M13PB6I type=write size=2831986 2024-09-12T17:28:58.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.564+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=10PUJ544JVVT type=del 2024-09-12T17:28:58.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.565+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=ZFVZQF1NEEK4 type=del size=1309579 2024-09-12T17:28:58.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.566+0000 7f9d7bc0c780 1 < completed write operation key=AOT2ZKFTD0HY tag=NFQ2D1MZ0I6H type=write size=270617 2024-09-12T17:28:58.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.569+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~IIIDVAK1ISJR.0 size=1048576 2024-09-12T17:28:58.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.570+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~IIIDVAK1ISJR.1 size=1048576 2024-09-12T17:28:58.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.571+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~IIIDVAK1ISJR.2 size=272694 2024-09-12T17:28:58.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.571+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=IIIDVAK1ISJR tag=TCWDNE6FEGW2 type=write size=3418422 2024-09-12T17:28:58.575 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.574+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=N8LJYHXWJPM4 type=del 2024-09-12T17:28:58.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.575+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=LP7AB2IPEHNP type=del size=2445332 2024-09-12T17:28:58.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.577+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=1ECSD9GHQ20Y type=del 2024-09-12T17:28:58.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.578+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=OABSS072VXGP type=del size=3527389 2024-09-12T17:28:58.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.580+0000 7f9d7bc0c780 -1 < failed to complete operation key=M3Q7I7MD7M4I tag=2SLWW20FSVM3 type=del size=2862857: (22) Invalid argument 2024-09-12T17:28:58.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.581+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=34V2OKHH21IF type=del size=2344862 2024-09-12T17:28:58.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.585+0000 7f9d7bc0c780 -1 < failed to complete operation key=58C4SS3TN12K tag=HS2RYPB5WECI type=del size=1243812: (22) Invalid argument 2024-09-12T17:28:58.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.586+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=SB8JKUBRUM6Z type=del size=1193888 2024-09-12T17:28:58.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.588+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=RRFM09BN1EHL type=del 2024-09-12T17:28:58.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.589+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=K34ESR68INYO type=del size=3150817 2024-09-12T17:28:58.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.591+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=K4EB0LYWSO1M type=del 2024-09-12T17:28:58.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.592+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=V53YSEPZEZ02 type=del size=3200845 2024-09-12T17:28:58.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.593+0000 7f9d7bc0c780 1 < canceled operation key=G5ZKTTY1XQ9T tag=18HSBWNYCJG2 type=del size=3522053 2024-09-12T17:28:58.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.595+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=OXZVX7S986DE type=del size=3338893 2024-09-12T17:28:58.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.598+0000 7f9d7bc0c780 1 < suggested update operation key=5B96YH46VAK3 tag=4DHYSO2CDZSK type=del size=1512953 2024-09-12T17:28:58.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.600+0000 7f9d7bc0c780 1 > prepared part key=_multipart_FU7ARIH2X839.2~HV7HCFPPE4D2.0 size=924668 2024-09-12T17:28:58.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.600+0000 7f9d7bc0c780 1 > prepared multipart upload key=FU7ARIH2X839 upload=HV7HCFPPE4D2 tag=UB1A7U9Y2GCP type=write size=1973244 2024-09-12T17:28:58.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.602+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~3JKZEBL5MDOR.0 size=1048576 2024-09-12T17:28:58.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.603+0000 7f9d7bc0c780 1 < completed part key=_multipart_LJZNPSVLS9AF.2~3JKZEBL5MDOR.1 size=5865 2024-09-12T17:28:58.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.605+0000 7f9d7bc0c780 1 < completed multipart upload key=LJZNPSVLS9AF upload=3JKZEBL5MDOR tag=CFO1B0H7R9I1 type=write size=2103017 2024-09-12T17:28:58.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.608+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~M9YTIN0DDDAL.0 size=1048576 2024-09-12T17:28:58.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.609+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~M9YTIN0DDDAL.1 size=755607 2024-09-12T17:28:58.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.609+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=M9YTIN0DDDAL tag=KTXBBBJGX5O9 type=write size=2852759 2024-09-12T17:28:58.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.610+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=XMZCIG0MQ50C type=del 2024-09-12T17:28:58.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.612+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=F1NG3MPEVJTL type=write size=551313 2024-09-12T17:28:58.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.613+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~MQSOANBZ3HKD.0 size=463750 2024-09-12T17:28:58.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.615+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=MQSOANBZ3HKD tag=LAZ3SJID8SYO type=write size=1512326 2024-09-12T17:28:58.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.617+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=AVBJFFQFB8X9 type=write size=898911 2024-09-12T17:28:58.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.618+0000 7f9d7bc0c780 1 < completed write operation key=0JN5WWDYEM6Q tag=D5DCAIOOLDG6 type=write size=876662 2024-09-12T17:28:58.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.620+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=CIF7VNGAHDSM type=del size=2213489 2024-09-12T17:28:58.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.621+0000 7f9d7bc0c780 1 < completed delete operation key=R94VERREGANN tag=5YURM6XOWZ82 type=del 2024-09-12T17:28:58.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.622+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=JW3OJ9BTSVQP type=del size=2644249 2024-09-12T17:28:58.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.623+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J7MREXK6R3C4.2~2TZ9C4X77318.0 size=1048576 2024-09-12T17:28:58.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.624+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~2TZ9C4X77318.1 size=734834 2024-09-12T17:28:58.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.626+0000 7f9d7bc0c780 1 < canceled multipart upload key=J7MREXK6R3C4 upload=2TZ9C4X77318 tag=JAER9M13PB6I type=write size=2831986 2024-09-12T17:28:58.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.628+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~VZI727Q49UZ1.0 size=1048576 2024-09-12T17:28:58.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.630+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~VZI727Q49UZ1.1 size=865453 2024-09-12T17:28:58.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.630+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=VZI727Q49UZ1 tag=GIAI4Z034XCN type=write size=2962605 2024-09-12T17:28:58.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.632+0000 7f9d7bc0c780 1 < suggested remove operation key=0NGHC5GMSGRX tag=ZFVZQF1NEEK4 type=del 2024-09-12T17:28:58.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.635+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~A71DODYCYSCZ.0 size=1048576 2024-09-12T17:28:58.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.636+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~A71DODYCYSCZ.1 size=1048576 2024-09-12T17:28:58.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.637+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~A71DODYCYSCZ.2 size=1040148 2024-09-12T17:28:58.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.637+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=A71DODYCYSCZ tag=GE99RIOMTV6C type=write size=4185876 2024-09-12T17:28:58.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.639+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~IIIDVAK1ISJR.0 size=1048576 2024-09-12T17:28:58.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.640+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~IIIDVAK1ISJR.1 size=1048576 2024-09-12T17:28:58.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.641+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~IIIDVAK1ISJR.2 size=272694 2024-09-12T17:28:58.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.644+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=IIIDVAK1ISJR tag=TCWDNE6FEGW2 type=write size=3418422 2024-09-12T17:28:58.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.645+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=6WCIAD0DBIB9 type=del size=2753262 2024-09-12T17:28:58.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.647+0000 7f9d7bc0c780 1 < canceled operation key=EUHRVHNVI83I tag=LP7AB2IPEHNP type=del size=2445332 2024-09-12T17:28:58.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.648+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=MZRZ8ALNTSU6 type=del size=3730860 2024-09-12T17:28:58.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.649+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=OABSS072VXGP type=del 2024-09-12T17:28:58.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.651+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=YN3F26Z5VM85 type=del size=3843293 2024-09-12T17:28:58.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.652+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=34V2OKHH21IF type=del 2024-09-12T17:28:58.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.654+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=H3D312MSU1ZM type=del size=3403484 2024-09-12T17:28:58.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.655+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=SB8JKUBRUM6Z type=del 2024-09-12T17:28:58.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.658+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KECYHUV7XZLE.0 size=1048576 2024-09-12T17:28:58.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.659+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KECYHUV7XZLE.1 size=1048576 2024-09-12T17:28:58.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.660+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~KECYHUV7XZLE.2 size=437295 2024-09-12T17:28:58.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.660+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=KECYHUV7XZLE tag=KOXZ0EPLQX4I type=write size=3583023 2024-09-12T17:28:58.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.661+0000 7f9d7bc0c780 1 < completed delete operation key=OZKAXB0ET9R7 tag=K34ESR68INYO type=del 2024-09-12T17:28:58.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.664+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~6P30UA6J61X6.0 size=1048576 2024-09-12T17:28:58.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.665+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~6P30UA6J61X6.1 size=1048576 2024-09-12T17:28:58.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.666+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~6P30UA6J61X6.2 size=146534 2024-09-12T17:28:58.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.666+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=6P30UA6J61X6 tag=KPAUV9C7VLUS type=write size=3292262 2024-09-12T17:28:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.668+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=V53YSEPZEZ02 type=del 2024-09-12T17:28:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.670+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~MEPBZW9JJCAR.0 size=1048576 2024-09-12T17:28:58.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.672+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~MEPBZW9JJCAR.1 size=1048576 2024-09-12T17:28:58.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.673+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~MEPBZW9JJCAR.2 size=474144 2024-09-12T17:28:58.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.673+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=MEPBZW9JJCAR tag=2K2Q31APKYJ5 type=write size=3619872 2024-09-12T17:28:58.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.674+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=OXZVX7S986DE type=del 2024-09-12T17:28:58.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.677+0000 7f9d7bc0c780 1 > prepared part key=_multipart_5B96YH46VAK3.2~YA04OF50XZE5.0 size=623065 2024-09-12T17:28:58.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.677+0000 7f9d7bc0c780 1 > prepared multipart upload key=5B96YH46VAK3 upload=YA04OF50XZE5 tag=RCW28U4C10SF type=write size=1671641 2024-09-12T17:28:58.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.678+0000 7f9d7bc0c780 1 < completed part key=_multipart_FU7ARIH2X839.2~HV7HCFPPE4D2.0 size=924668 2024-09-12T17:28:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.681+0000 7f9d7bc0c780 1 < completed multipart upload key=FU7ARIH2X839 upload=HV7HCFPPE4D2 tag=UB1A7U9Y2GCP type=write size=1973244 2024-09-12T17:28:58.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.682+0000 7f9d7bc0c780 1 > prepared operation key=5B96YH46VAK3 tag=FF6DCGNRD5GW type=del size=3652515 2024-09-12T17:28:58.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.684+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~M9YTIN0DDDAL.0 size=1048576 2024-09-12T17:28:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.685+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~M9YTIN0DDDAL.1 size=755607 2024-09-12T17:28:58.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.687+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=M9YTIN0DDDAL tag=KTXBBBJGX5O9 type=write size=2852759 2024-09-12T17:28:58.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.690+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~TL2TYCOERQDV.0 size=1048576 2024-09-12T17:28:58.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.691+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~TL2TYCOERQDV.1 size=900196 2024-09-12T17:28:58.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.691+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=TL2TYCOERQDV tag=G277829CNIUI type=write size=2997348 2024-09-12T17:28:58.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.694+0000 7f9d7bc0c780 1 < suggested remove operation key=OZKAXB0ET9R7 tag=F1NG3MPEVJTL type=write 2024-09-12T17:28:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.696+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~GYPSB19SFDFT.0 size=1048576 2024-09-12T17:28:58.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.698+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~GYPSB19SFDFT.1 size=491641 2024-09-12T17:28:58.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.698+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=GYPSB19SFDFT tag=6RSTI8WPWK6Q type=write size=2588793 2024-09-12T17:28:58.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.698+0000 7f9d7bc0c780 -1 < no bi entry to suggest for operation key=0NGHC5GMSGRX tag=AVBJFFQFB8X9 type=write size=898911: (2) No such file or directory 2024-09-12T17:28:58.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.701+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~O33F6HFYMSGK.0 size=1048576 2024-09-12T17:28:58.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.702+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~O33F6HFYMSGK.1 size=1048576 2024-09-12T17:28:58.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.703+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~O33F6HFYMSGK.2 size=227081 2024-09-12T17:28:58.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.703+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=O33F6HFYMSGK tag=DG07RDUPVCTA type=write size=3372809 2024-09-12T17:28:58.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.705+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=CIF7VNGAHDSM type=del 2024-09-12T17:28:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.706+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=ZQ0XIRPT2Z7Z type=del size=1316238 2024-09-12T17:28:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.707+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=JW3OJ9BTSVQP type=del 2024-09-12T17:28:58.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.710+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~SN2BX9IF1TIN.0 size=818671 2024-09-12T17:28:58.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.710+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=SN2BX9IF1TIN tag=ET51UH85YA5K type=write size=1867247 2024-09-12T17:28:58.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.711+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~VZI727Q49UZ1.0 size=1048576 2024-09-12T17:28:58.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.712+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~VZI727Q49UZ1.1 size=865453 2024-09-12T17:28:58.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.715+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=VZI727Q49UZ1 tag=GIAI4Z034XCN type=write size=2962605 2024-09-12T17:28:58.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.718+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=JS08MQSI8188 type=del size=3559576 2024-09-12T17:28:58.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.719+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~A71DODYCYSCZ.0 size=1048576 2024-09-12T17:28:58.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.720+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~A71DODYCYSCZ.1 size=1048576 2024-09-12T17:28:58.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.721+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~A71DODYCYSCZ.2 size=1040148 2024-09-12T17:28:58.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.723+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=A71DODYCYSCZ tag=GE99RIOMTV6C type=write size=4185876 2024-09-12T17:28:58.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.726+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~MAM7HY7NCMJK.0 size=1048576 2024-09-12T17:28:58.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.727+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~MAM7HY7NCMJK.1 size=1048576 2024-09-12T17:28:58.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.728+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~MAM7HY7NCMJK.2 size=308102 2024-09-12T17:28:58.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.728+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=MAM7HY7NCMJK tag=DC1RJ26PZUF1 type=write size=3453830 2024-09-12T17:28:58.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.729+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=6WCIAD0DBIB9 type=del 2024-09-12T17:28:58.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.730+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=YXD0QAMXN0I4 type=del size=1256486 2024-09-12T17:28:58.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.732+0000 7f9d7bc0c780 1 < canceled operation key=EUHRVHNVI83I tag=MZRZ8ALNTSU6 type=del size=3730860 2024-09-12T17:28:58.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.734+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~D16SDDN9P4MS.0 size=1048576 2024-09-12T17:28:58.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.735+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~D16SDDN9P4MS.1 size=565682 2024-09-12T17:28:58.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.735+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=D16SDDN9P4MS tag=4FW9W0VKMK1B type=write size=2662834 2024-09-12T17:28:58.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.737+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=YN3F26Z5VM85 type=del 2024-09-12T17:28:58.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.738+0000 7f9d7bc0c780 1 > prepared operation key=FU7ARIH2X839 tag=0IEWLXQMRUW7 type=del size=3578083 2024-09-12T17:28:58.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.739+0000 7f9d7bc0c780 1 < completed delete operation key=9TE5N5TIB7AD tag=H3D312MSU1ZM type=del 2024-09-12T17:28:58.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.741+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=GKGLXCCR9CK9 type=del size=1167167 2024-09-12T17:28:58.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.742+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~KECYHUV7XZLE.0 size=1048576 2024-09-12T17:28:58.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.743+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~KECYHUV7XZLE.1 size=1048576 2024-09-12T17:28:58.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.744+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~KECYHUV7XZLE.2 size=437295 2024-09-12T17:28:58.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.746+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=KECYHUV7XZLE tag=KOXZ0EPLQX4I type=write size=3583023 2024-09-12T17:28:58.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.748+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=BH6XW7TKCHRE type=del size=613693 2024-09-12T17:28:58.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.749+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~6P30UA6J61X6.0 size=1048576 2024-09-12T17:28:58.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.750+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~6P30UA6J61X6.1 size=1048576 2024-09-12T17:28:58.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.751+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~6P30UA6J61X6.2 size=146534 2024-09-12T17:28:58.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.754+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=6P30UA6J61X6 tag=KPAUV9C7VLUS type=write size=3292262 2024-09-12T17:28:58.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.757+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~843OTHCIAENV.0 size=461718 2024-09-12T17:28:58.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.757+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=843OTHCIAENV tag=RBPREZ29M005 type=write size=1510294 2024-09-12T17:28:58.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.757+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZA6JC3WXS8Y5.2~MEPBZW9JJCAR.0 size=1048576 2024-09-12T17:28:58.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.758+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~MEPBZW9JJCAR.1 size=1048576 2024-09-12T17:28:58.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.759+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~MEPBZW9JJCAR.2 size=474144 2024-09-12T17:28:58.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.762+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZA6JC3WXS8Y5 upload=MEPBZW9JJCAR tag=2K2Q31APKYJ5 type=write size=3619872 2024-09-12T17:28:58.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.765+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~CEQC2M20JWDW.0 size=1048576 2024-09-12T17:28:58.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.766+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~CEQC2M20JWDW.1 size=1048576 2024-09-12T17:28:58.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.767+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~CEQC2M20JWDW.2 size=903845 2024-09-12T17:28:58.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.767+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=CEQC2M20JWDW tag=6MWWGQDOI6H9 type=write size=4049573 2024-09-12T17:28:58.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.768+0000 7f9d7bc0c780 1 < completed part key=_multipart_5B96YH46VAK3.2~YA04OF50XZE5.0 size=623065 2024-09-12T17:28:58.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.773+0000 7f9d7bc0c780 1 < completed multipart upload key=5B96YH46VAK3 upload=YA04OF50XZE5 tag=RCW28U4C10SF type=write size=1671641 2024-09-12T17:28:58.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.774+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=TMNKA7GEF344 type=del size=3516227 2024-09-12T17:28:58.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.776+0000 7f9d7bc0c780 1 < completed delete operation key=5B96YH46VAK3 tag=FF6DCGNRD5GW type=del 2024-09-12T17:28:58.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.779+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~ZC0EIDPGDGYL.0 size=1048576 2024-09-12T17:28:58.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.780+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~ZC0EIDPGDGYL.1 size=416097 2024-09-12T17:28:58.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.780+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=ZC0EIDPGDGYL tag=DC6040KFPNWS type=write size=2513249 2024-09-12T17:28:58.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.782+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~TL2TYCOERQDV.0 size=1048576 2024-09-12T17:28:58.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.783+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~TL2TYCOERQDV.1 size=900196 2024-09-12T17:28:58.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.785+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=TL2TYCOERQDV tag=G277829CNIUI type=write size=2997348 2024-09-12T17:28:58.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.788+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~EH7X8UV65XOS.0 size=1048576 2024-09-12T17:28:58.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.789+0000 7f9d7bc0c780 1 > prepared part key=_multipart_QB8C0OJA1L4X.2~EH7X8UV65XOS.1 size=712010 2024-09-12T17:28:58.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.789+0000 7f9d7bc0c780 1 > prepared multipart upload key=QB8C0OJA1L4X upload=EH7X8UV65XOS tag=OC3BC98K95VY type=write size=2809162 2024-09-12T17:28:58.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.790+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~GYPSB19SFDFT.0 size=1048576 2024-09-12T17:28:58.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.792+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~GYPSB19SFDFT.1 size=491641 2024-09-12T17:28:58.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.794+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=GYPSB19SFDFT tag=6RSTI8WPWK6Q type=write size=2588793 2024-09-12T17:28:58.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.796+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=PU39TJ3Y9GGB type=del size=243457 2024-09-12T17:28:58.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.797+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~O33F6HFYMSGK.0 size=1048576 2024-09-12T17:28:58.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.798+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~O33F6HFYMSGK.1 size=1048576 2024-09-12T17:28:58.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.799+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~O33F6HFYMSGK.2 size=227081 2024-09-12T17:28:58.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.802+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=O33F6HFYMSGK tag=DG07RDUPVCTA type=write size=3372809 2024-09-12T17:28:58.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.804+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~TWNCFDIRA2L7.0 size=1048576 2024-09-12T17:28:58.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.806+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~TWNCFDIRA2L7.1 size=1048576 2024-09-12T17:28:58.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.807+0000 7f9d7bc0c780 1 > prepared part key=_multipart_X7J78IOJR0HA.2~TWNCFDIRA2L7.2 size=9099 2024-09-12T17:28:58.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.807+0000 7f9d7bc0c780 1 > prepared multipart upload key=X7J78IOJR0HA upload=TWNCFDIRA2L7 tag=ZKNA5IGEY4I9 type=write size=3154827 2024-09-12T17:28:58.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.808+0000 7f9d7bc0c780 1 < canceled operation key=0NGHC5GMSGRX tag=ZQ0XIRPT2Z7Z type=del size=1316238 2024-09-12T17:28:58.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.811+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~D8L9COUT0R0P.0 size=632573 2024-09-12T17:28:58.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.811+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=D8L9COUT0R0P tag=O07MXPQA2OXO type=write size=1681149 2024-09-12T17:28:58.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.813+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~SN2BX9IF1TIN.0 size=818671 2024-09-12T17:28:58.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.815+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=SN2BX9IF1TIN tag=ET51UH85YA5K type=write size=1867247 2024-09-12T17:28:58.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.817+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=PPX4PMQNWYN4 type=del size=3165461 2024-09-12T17:28:58.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.818+0000 7f9d7bc0c780 1 < completed delete operation key=0JN5WWDYEM6Q tag=JS08MQSI8188 type=del 2024-09-12T17:28:58.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.820+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=7R3FHW8UQ01O type=del size=2589310 2024-09-12T17:28:58.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.821+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~MAM7HY7NCMJK.0 size=1048576 2024-09-12T17:28:58.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.822+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~MAM7HY7NCMJK.1 size=1048576 2024-09-12T17:28:58.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.824+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~MAM7HY7NCMJK.2 size=308102 2024-09-12T17:28:58.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.826+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=MAM7HY7NCMJK tag=DC1RJ26PZUF1 type=write size=3453830 2024-09-12T17:28:58.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.828+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=77TT3KKBV65Q type=del size=4048473 2024-09-12T17:28:58.831 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.830+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=YXD0QAMXN0I4 type=del 2024-09-12T17:28:58.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.831+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=0B42FOLMPCYV type=del size=2792856 2024-09-12T17:28:58.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.833+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~D16SDDN9P4MS.0 size=1048576 2024-09-12T17:28:58.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.834+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~D16SDDN9P4MS.1 size=565682 2024-09-12T17:28:58.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.836+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=D16SDDN9P4MS tag=4FW9W0VKMK1B type=write size=2662834 2024-09-12T17:28:58.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.838+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=8QGF278078T6 type=del size=1463727 2024-09-12T17:28:58.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.839+0000 7f9d7bc0c780 1 < completed delete operation key=FU7ARIH2X839 tag=0IEWLXQMRUW7 type=del 2024-09-12T17:28:58.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.842+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~8WUBRX5S4N4Z.0 size=1048576 2024-09-12T17:28:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.843+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~8WUBRX5S4N4Z.1 size=1048576 2024-09-12T17:28:58.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.844+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~8WUBRX5S4N4Z.2 size=975845 2024-09-12T17:28:58.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.844+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=8WUBRX5S4N4Z tag=64107LIHVJ6N type=write size=4121573 2024-09-12T17:28:58.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.847+0000 7f9d7bc0c780 1 < suggested remove operation key=ZA6JC3WXS8Y5 tag=GKGLXCCR9CK9 type=del 2024-09-12T17:28:58.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.852+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~309328ZSRNC4.0 size=1048576 2024-09-12T17:28:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.854+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZA6JC3WXS8Y5.2~309328ZSRNC4.1 size=816752 2024-09-12T17:28:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.854+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZA6JC3WXS8Y5 upload=309328ZSRNC4 tag=J8J8CLNMQQDR type=write size=2913904 2024-09-12T17:28:58.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.856+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=BH6XW7TKCHRE type=del 2024-09-12T17:28:58.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.858+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=7PA28MR5ANU3 type=del size=3027296 2024-09-12T17:28:58.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.859+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~843OTHCIAENV.0 size=461718 2024-09-12T17:28:58.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.861+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=843OTHCIAENV tag=RBPREZ29M005 type=write size=1510294 2024-09-12T17:28:58.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.864+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~7RT4Q162AMRW.0 size=1048576 2024-09-12T17:28:58.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.865+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~7RT4Q162AMRW.1 size=1048576 2024-09-12T17:28:58.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.866+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~7RT4Q162AMRW.2 size=44990 2024-09-12T17:28:58.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.866+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=7RT4Q162AMRW tag=94SMXP2QUMWA type=write size=3190718 2024-09-12T17:28:58.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.867+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~CEQC2M20JWDW.0 size=1048576 2024-09-12T17:28:58.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.868+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~CEQC2M20JWDW.1 size=1048576 2024-09-12T17:28:58.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.871+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~CEQC2M20JWDW.2 size=903845 2024-09-12T17:28:58.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.873+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=CEQC2M20JWDW tag=6MWWGQDOI6H9 type=write size=4049573 2024-09-12T17:28:58.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.876+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~5YMZ4QIKAEV1.0 size=1048576 2024-09-12T17:28:58.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.877+0000 7f9d7bc0c780 1 > prepared part key=_multipart_4V2IYJRP2PZI.2~5YMZ4QIKAEV1.1 size=399739 2024-09-12T17:28:58.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.877+0000 7f9d7bc0c780 1 > prepared multipart upload key=4V2IYJRP2PZI upload=5YMZ4QIKAEV1 tag=PGZQB1NK32JM type=write size=2496891 2024-09-12T17:28:58.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.879+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=TMNKA7GEF344 type=del 2024-09-12T17:28:58.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.880+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=WFAB9DUQA3M3 type=del size=2369453 2024-09-12T17:28:58.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.881+0000 7f9d7bc0c780 1 < canceled part key=_multipart_AOT2ZKFTD0HY.2~ZC0EIDPGDGYL.0 size=1048576 2024-09-12T17:28:58.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.882+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~ZC0EIDPGDGYL.1 size=416097 2024-09-12T17:28:58.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.885+0000 7f9d7bc0c780 1 < canceled multipart upload key=AOT2ZKFTD0HY upload=ZC0EIDPGDGYL tag=DC6040KFPNWS type=write size=2513249 2024-09-12T17:28:58.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.886+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=ZNQ0TQ0XO9O1 type=write size=440266 2024-09-12T17:28:58.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.888+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~EH7X8UV65XOS.0 size=1048576 2024-09-12T17:28:58.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.889+0000 7f9d7bc0c780 1 < completed part key=_multipart_QB8C0OJA1L4X.2~EH7X8UV65XOS.1 size=712010 2024-09-12T17:28:58.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.892+0000 7f9d7bc0c780 1 < completed multipart upload key=QB8C0OJA1L4X upload=EH7X8UV65XOS tag=OC3BC98K95VY type=write size=2809162 2024-09-12T17:28:58.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.893+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=VEGBH96VW3XG type=write size=302462 2024-09-12T17:28:58.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.895+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=PU39TJ3Y9GGB type=del 2024-09-12T17:28:58.899 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.898+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~0J0AMZBQ33VR.0 size=1048576 2024-09-12T17:28:58.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.900+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~0J0AMZBQ33VR.1 size=777068 2024-09-12T17:28:58.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.900+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=0J0AMZBQ33VR tag=F9LG30DLF23S type=write size=2874220 2024-09-12T17:28:58.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.901+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~TWNCFDIRA2L7.0 size=1048576 2024-09-12T17:28:58.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.902+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~TWNCFDIRA2L7.1 size=1048576 2024-09-12T17:28:58.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.904+0000 7f9d7bc0c780 1 < completed part key=_multipart_X7J78IOJR0HA.2~TWNCFDIRA2L7.2 size=9099 2024-09-12T17:28:58.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.906+0000 7f9d7bc0c780 1 < completed multipart upload key=X7J78IOJR0HA upload=TWNCFDIRA2L7 tag=ZKNA5IGEY4I9 type=write size=3154827 2024-09-12T17:28:58.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.908+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=G5U3RBXILJRZ type=del size=1640581 2024-09-12T17:28:58.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.909+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~D8L9COUT0R0P.0 size=632573 2024-09-12T17:28:58.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.912+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=D8L9COUT0R0P tag=O07MXPQA2OXO type=write size=1681149 2024-09-12T17:28:58.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.915+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~6ISPSJ6QK270.0 size=776807 2024-09-12T17:28:58.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.915+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=6ISPSJ6QK270 tag=Y1FS8B9DBH5B type=write size=1825383 2024-09-12T17:28:58.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.918+0000 7f9d7bc0c780 1 < suggested remove operation key=L72DVWQ63XUW tag=PPX4PMQNWYN4 type=del 2024-09-12T17:28:58.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.921+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~DX3ICNET48G8.0 size=1048576 2024-09-12T17:28:58.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.922+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~DX3ICNET48G8.1 size=114046 2024-09-12T17:28:58.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.922+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=DX3ICNET48G8 tag=06T4CUB8WPGI type=write size=2211198 2024-09-12T17:28:58.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.925+0000 7f9d7bc0c780 1 < suggested update operation key=W1SE9R6KU04G tag=7R3FHW8UQ01O type=del size=2589310 2024-09-12T17:28:58.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.926+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=IW3LHWR05KNN type=write size=955172 2024-09-12T17:28:58.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.928+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=77TT3KKBV65Q type=del 2024-09-12T17:28:58.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.931+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~X2J8S08SRVKQ.0 size=1048576 2024-09-12T17:28:58.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.932+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~X2J8S08SRVKQ.1 size=1048576 2024-09-12T17:28:58.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.933+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LTG0UQEYPUGO.2~X2J8S08SRVKQ.2 size=727903 2024-09-12T17:28:58.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.933+0000 7f9d7bc0c780 1 > prepared multipart upload key=LTG0UQEYPUGO upload=X2J8S08SRVKQ tag=GNFC3RVKKSTF type=write size=3873631 2024-09-12T17:28:58.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.935+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=0B42FOLMPCYV type=del 2024-09-12T17:28:58.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.937+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=DHMBE6VUS6JN type=del size=3095779 2024-09-12T17:28:58.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.938+0000 7f9d7bc0c780 -1 < failed to complete operation key=L72DVWQ63XUW tag=8QGF278078T6 type=del size=1463727: (22) Invalid argument 2024-09-12T17:28:58.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.940+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=TNF3SG49CT15 type=del size=3880690 2024-09-12T17:28:58.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.941+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~8WUBRX5S4N4Z.0 size=1048576 2024-09-12T17:28:58.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.943+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~8WUBRX5S4N4Z.1 size=1048576 2024-09-12T17:28:58.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.944+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~8WUBRX5S4N4Z.2 size=975845 2024-09-12T17:28:58.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.946+0000 7f9d7bc0c780 1 < completed multipart upload key=J7MREXK6R3C4 upload=8WUBRX5S4N4Z tag=64107LIHVJ6N type=write size=4121573 2024-09-12T17:28:58.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.948+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=KD86AAPFPO3W type=del size=2906147 2024-09-12T17:28:58.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.950+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~309328ZSRNC4.0 size=1048576 2024-09-12T17:28:58.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.951+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZA6JC3WXS8Y5.2~309328ZSRNC4.1 size=816752 2024-09-12T17:28:58.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.953+0000 7f9d7bc0c780 1 < completed multipart upload key=ZA6JC3WXS8Y5 upload=309328ZSRNC4 tag=J8J8CLNMQQDR type=write size=2913904 2024-09-12T17:28:58.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.955+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=ZPDT9WSWP3SG type=del size=119314 2024-09-12T17:28:58.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.957+0000 7f9d7bc0c780 1 < suggested update operation key=CYKLX4CJWVJE tag=7PA28MR5ANU3 type=del size=3027296 2024-09-12T17:28:58.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.960+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~5Z8QMUO7FP0I.0 size=276383 2024-09-12T17:28:58.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.960+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=5Z8QMUO7FP0I tag=IBMP8XK6KRO1 type=write size=1324959 2024-09-12T17:28:58.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.962+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~7RT4Q162AMRW.0 size=1048576 2024-09-12T17:28:58.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.963+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~7RT4Q162AMRW.1 size=1048576 2024-09-12T17:28:58.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.964+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~7RT4Q162AMRW.2 size=44990 2024-09-12T17:28:58.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.966+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=7RT4Q162AMRW tag=94SMXP2QUMWA type=write size=3190718 2024-09-12T17:28:58.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.968+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=TB0MIP0CQ80N type=del size=3726062 2024-09-12T17:28:58.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.970+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~5YMZ4QIKAEV1.0 size=1048576 2024-09-12T17:28:58.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.971+0000 7f9d7bc0c780 1 < completed part key=_multipart_4V2IYJRP2PZI.2~5YMZ4QIKAEV1.1 size=399739 2024-09-12T17:28:58.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.973+0000 7f9d7bc0c780 1 < completed multipart upload key=4V2IYJRP2PZI upload=5YMZ4QIKAEV1 tag=PGZQB1NK32JM type=write size=2496891 2024-09-12T17:28:58.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.974+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=O47T3OP453S5 type=del size=1665403 2024-09-12T17:28:58.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.976+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=WFAB9DUQA3M3 type=del 2024-09-12T17:28:58.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.978+0000 7f9d7bc0c780 1 > prepared operation key=ZA6JC3WXS8Y5 tag=LR9SNDYP2MKR type=del size=702902 2024-09-12T17:28:58.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.979+0000 7f9d7bc0c780 -1 < failed to complete operation key=L72DVWQ63XUW tag=ZNQ0TQ0XO9O1 type=write size=440266: (22) Invalid argument 2024-09-12T17:28:58.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.981+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=A2R6LZPUMIXT type=del size=3579692 2024-09-12T17:28:58.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.984+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=VEGBH96VW3XG type=write size=302462 2024-09-12T17:28:58.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.985+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=A6700MKWSCE2 type=write size=734461 2024-09-12T17:28:58.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.986+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~0J0AMZBQ33VR.0 size=1048576 2024-09-12T17:28:58.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.988+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~0J0AMZBQ33VR.1 size=777068 2024-09-12T17:28:58.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.990+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=0J0AMZBQ33VR tag=F9LG30DLF23S type=write size=2874220 2024-09-12T17:28:58.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.991+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=XP1H50XUHIS7 type=del size=2929296 2024-09-12T17:28:58.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.994+0000 7f9d7bc0c780 1 < canceled operation key=80JXIGQWQGR9 tag=G5U3RBXILJRZ type=del size=1640581 2024-09-12T17:28:58.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.996+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=9JCZVGQ9UW2I type=del size=1842831 2024-09-12T17:28:58.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:58.997+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~6ISPSJ6QK270.0 size=776807 2024-09-12T17:28:59.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.000+0000 7f9d7bc0c780 1 < completed multipart upload key=9TE5N5TIB7AD upload=6ISPSJ6QK270 tag=Y1FS8B9DBH5B type=write size=1825383 2024-09-12T17:28:59.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.001+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=UEOD4JQD0FSZ type=del size=2985039 2024-09-12T17:28:59.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.003+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~DX3ICNET48G8.0 size=1048576 2024-09-12T17:28:59.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.004+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~DX3ICNET48G8.1 size=114046 2024-09-12T17:28:59.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.006+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=DX3ICNET48G8 tag=06T4CUB8WPGI type=write size=2211198 2024-09-12T17:28:59.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.008+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=XKPTJ4OT596B type=del size=1720300 2024-09-12T17:28:59.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.009+0000 7f9d7bc0c780 1 < completed write operation key=G5ZKTTY1XQ9T tag=IW3LHWR05KNN type=write size=955172 2024-09-12T17:28:59.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.010+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=H277BU3NW4SB type=del size=1355043 2024-09-12T17:28:59.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.012+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~X2J8S08SRVKQ.0 size=1048576 2024-09-12T17:28:59.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.013+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~X2J8S08SRVKQ.1 size=1048576 2024-09-12T17:28:59.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.014+0000 7f9d7bc0c780 1 < completed part key=_multipart_LTG0UQEYPUGO.2~X2J8S08SRVKQ.2 size=727903 2024-09-12T17:28:59.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.016+0000 7f9d7bc0c780 1 < completed multipart upload key=LTG0UQEYPUGO upload=X2J8S08SRVKQ tag=GNFC3RVKKSTF type=write size=3873631 2024-09-12T17:28:59.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.018+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=W9URBMV12FSZ type=write size=493871 2024-09-12T17:28:59.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.021+0000 7f9d7bc0c780 1 < suggested update operation key=QB8C0OJA1L4X tag=DHMBE6VUS6JN type=del size=3095779 2024-09-12T17:28:59.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.024+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~2YU23LQTHA4G.0 size=327285 2024-09-12T17:28:59.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.024+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=2YU23LQTHA4G tag=1HCQ86SLV8BD type=write size=1375861 2024-09-12T17:28:59.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.025+0000 7f9d7bc0c780 -1 < failed to complete operation key=CYKLX4CJWVJE tag=TNF3SG49CT15 type=del size=3880690: (22) Invalid argument 2024-09-12T17:28:59.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.027+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=AGHKTI7X2G5U type=del size=1231654 2024-09-12T17:28:59.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.028+0000 7f9d7bc0c780 1 < completed delete operation key=X7J78IOJR0HA tag=KD86AAPFPO3W type=del 2024-09-12T17:28:59.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.030+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=GCQM5EFIN59Y type=del size=4124067 2024-09-12T17:28:59.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.033+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=ZPDT9WSWP3SG type=del 2024-09-12T17:28:59.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.034+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=JC8SMH59EF8Z type=write size=253342 2024-09-12T17:28:59.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.035+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~5Z8QMUO7FP0I.0 size=276383 2024-09-12T17:28:59.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.038+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=5Z8QMUO7FP0I tag=IBMP8XK6KRO1 type=write size=1324959 2024-09-12T17:28:59.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.039+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=12YCK349ID3D type=write size=737271 2024-09-12T17:28:59.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.040+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=TB0MIP0CQ80N type=del 2024-09-12T17:28:59.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.043+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~L0N1O13327RW.0 size=107801 2024-09-12T17:28:59.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.043+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=L0N1O13327RW tag=14EFA68DMKZX type=write size=1156377 2024-09-12T17:28:59.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.045+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=O47T3OP453S5 type=del 2024-09-12T17:28:59.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.046+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=NI22Z0TQH3DO type=del size=1352752 2024-09-12T17:28:59.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.048+0000 7f9d7bc0c780 1 < canceled operation key=ZA6JC3WXS8Y5 tag=LR9SNDYP2MKR type=del size=702902 2024-09-12T17:28:59.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.049+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=8SBC7IA0UM0I type=del size=2335736 2024-09-12T17:28:59.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.052+0000 7f9d7bc0c780 1 < suggested remove operation key=OZKAXB0ET9R7 tag=A2R6LZPUMIXT type=del 2024-09-12T17:28:59.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.055+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1UCIFOM62WK0.0 size=1048576 2024-09-12T17:28:59.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.056+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1UCIFOM62WK0.1 size=1048576 2024-09-12T17:28:59.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.057+0000 7f9d7bc0c780 1 > prepared part key=_multipart_OZKAXB0ET9R7.2~1UCIFOM62WK0.2 size=375033 2024-09-12T17:28:59.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.057+0000 7f9d7bc0c780 1 > prepared multipart upload key=OZKAXB0ET9R7 upload=1UCIFOM62WK0 tag=LUM52S317J55 type=write size=3520761 2024-09-12T17:28:59.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.058+0000 7f9d7bc0c780 1 < completed write operation key=64T291B0U226 tag=A6700MKWSCE2 type=write size=734461 2024-09-12T17:28:59.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.061+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~2M28GZ133GIT.0 size=1048576 2024-09-12T17:28:59.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.062+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J3YYRIVKQ5AU.2~2M28GZ133GIT.1 size=109152 2024-09-12T17:28:59.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.062+0000 7f9d7bc0c780 1 > prepared multipart upload key=J3YYRIVKQ5AU upload=2M28GZ133GIT tag=RFOT6AXQNQC3 type=write size=2206304 2024-09-12T17:28:59.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.063+0000 7f9d7bc0c780 1 < completed delete operation key=EUHRVHNVI83I tag=XP1H50XUHIS7 type=del 2024-09-12T17:28:59.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.065+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=E42O7MJ4GWP4 type=del size=757795 2024-09-12T17:28:59.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.066+0000 7f9d7bc0c780 1 < completed delete operation key=LU8MLGM7H0CE tag=9JCZVGQ9UW2I type=del 2024-09-12T17:28:59.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.069+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~XRDX7L778Z89.0 size=1040481 2024-09-12T17:28:59.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.069+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=XRDX7L778Z89 tag=YXUBWYV3KEVB type=write size=2089057 2024-09-12T17:28:59.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.070+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=UEOD4JQD0FSZ type=del 2024-09-12T17:28:59.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.073+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~1YUXNAF5UIDJ.0 size=814414 2024-09-12T17:28:59.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.073+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=1YUXNAF5UIDJ tag=CH3M7HSTADOT type=write size=1862990 2024-09-12T17:28:59.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.074+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=XKPTJ4OT596B type=del 2024-09-12T17:28:59.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.075+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=7CLX4DE3Q8I5 type=del size=2836804 2024-09-12T17:28:59.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.078+0000 7f9d7bc0c780 1 < suggested update operation key=80JXIGQWQGR9 tag=H277BU3NW4SB type=del size=1355043 2024-09-12T17:28:59.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.079+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=TK7PKXNZCCER type=del size=1688283 2024-09-12T17:28:59.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.081+0000 7f9d7bc0c780 1 < completed write operation key=4V2IYJRP2PZI tag=W9URBMV12FSZ type=write size=493871 2024-09-12T17:28:59.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.082+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=MAOJPC196VH9 type=del size=588169 2024-09-12T17:28:59.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.083+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~2YU23LQTHA4G.0 size=327285 2024-09-12T17:28:59.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.086+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=2YU23LQTHA4G tag=1HCQ86SLV8BD type=write size=1375861 2024-09-12T17:28:59.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.087+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=3KCI03RGPGS9 type=del size=2145633 2024-09-12T17:28:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.089+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=AGHKTI7X2G5U type=del 2024-09-12T17:28:59.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.090+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=Z4TPZ0QW2E5T type=del size=242052 2024-09-12T17:28:59.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.092+0000 7f9d7bc0c780 1 < canceled operation key=SDX69F30A2RK tag=GCQM5EFIN59Y type=del size=4124067 2024-09-12T17:28:59.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.093+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=5SD6F24W5153 type=del size=158680 2024-09-12T17:28:59.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.095+0000 7f9d7bc0c780 1 < completed write operation key=NQ0768B94GVV tag=JC8SMH59EF8Z type=write size=253342 2024-09-12T17:28:59.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.098+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~ZED2O2D5I049.0 size=1048576 2024-09-12T17:28:59.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.099+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~ZED2O2D5I049.1 size=840042 2024-09-12T17:28:59.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.099+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=ZED2O2D5I049 tag=XGMQW42SBZKH type=write size=2937194 2024-09-12T17:28:59.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.101+0000 7f9d7bc0c780 1 < completed write operation key=L72DVWQ63XUW tag=12YCK349ID3D type=write size=737271 2024-09-12T17:28:59.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.102+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=Q55B61QBW373 type=del size=2691524 2024-09-12T17:28:59.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.104+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~L0N1O13327RW.0 size=107801 2024-09-12T17:28:59.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.106+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=L0N1O13327RW tag=14EFA68DMKZX type=write size=1156377 2024-09-12T17:28:59.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.109+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~3M0F9SFMSBTN.0 size=1048576 2024-09-12T17:28:59.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.110+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~3M0F9SFMSBTN.1 size=616109 2024-09-12T17:28:59.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.110+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=3M0F9SFMSBTN tag=9Y7EQL1OXPOU type=write size=2713261 2024-09-12T17:28:59.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.111+0000 7f9d7bc0c780 1 < canceled operation key=0JN5WWDYEM6Q tag=NI22Z0TQH3DO type=del size=1352752 2024-09-12T17:28:59.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.113+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=B6ZV3D5UJB2Z type=del size=1490980 2024-09-12T17:28:59.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.114+0000 7f9d7bc0c780 1 < completed delete operation key=M3Q7I7MD7M4I tag=8SBC7IA0UM0I type=del 2024-09-12T17:28:59.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.116+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=1TECN49Z5LTS type=write size=967612 2024-09-12T17:28:59.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.117+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1UCIFOM62WK0.0 size=1048576 2024-09-12T17:28:59.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.118+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1UCIFOM62WK0.1 size=1048576 2024-09-12T17:28:59.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.119+0000 7f9d7bc0c780 1 < completed part key=_multipart_OZKAXB0ET9R7.2~1UCIFOM62WK0.2 size=375033 2024-09-12T17:28:59.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.122+0000 7f9d7bc0c780 1 < completed multipart upload key=OZKAXB0ET9R7 upload=1UCIFOM62WK0 tag=LUM52S317J55 type=write size=3520761 2024-09-12T17:28:59.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.123+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=WPD82LHHCFZ6 type=write size=387250 2024-09-12T17:28:59.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.125+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~2M28GZ133GIT.0 size=1048576 2024-09-12T17:28:59.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.126+0000 7f9d7bc0c780 1 < completed part key=_multipart_J3YYRIVKQ5AU.2~2M28GZ133GIT.1 size=109152 2024-09-12T17:28:59.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.128+0000 7f9d7bc0c780 1 < completed multipart upload key=J3YYRIVKQ5AU upload=2M28GZ133GIT tag=RFOT6AXQNQC3 type=write size=2206304 2024-09-12T17:28:59.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.131+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=IPGQQJ1QGVYM type=del size=9157 2024-09-12T17:28:59.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.133+0000 7f9d7bc0c780 1 < completed delete operation key=AOT2ZKFTD0HY tag=E42O7MJ4GWP4 type=del 2024-09-12T17:28:59.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.134+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=WAX5OAZ0XFL8 type=write size=118071 2024-09-12T17:28:59.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.136+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~XRDX7L778Z89.0 size=1040481 2024-09-12T17:28:59.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.138+0000 7f9d7bc0c780 1 < completed multipart upload key=CYKLX4CJWVJE upload=XRDX7L778Z89 tag=YXUBWYV3KEVB type=write size=2089057 2024-09-12T17:28:59.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.140+0000 7f9d7bc0c780 1 > prepared operation key=64T291B0U226 tag=NXMT5IBURYQN type=del size=1480346 2024-09-12T17:28:59.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.141+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~1YUXNAF5UIDJ.0 size=814414 2024-09-12T17:28:59.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.144+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=1YUXNAF5UIDJ tag=CH3M7HSTADOT type=write size=1862990 2024-09-12T17:28:59.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.145+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=RKDFX8WMCQ2W type=del size=3920311 2024-09-12T17:28:59.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.147+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=7CLX4DE3Q8I5 type=del 2024-09-12T17:28:59.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.150+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~H9IH6PR8XL4T.0 size=1048576 2024-09-12T17:28:59.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.151+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~H9IH6PR8XL4T.1 size=1048576 2024-09-12T17:28:59.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.152+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~H9IH6PR8XL4T.2 size=666171 2024-09-12T17:28:59.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.152+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=H9IH6PR8XL4T tag=EKIO497UJG52 type=write size=3811899 2024-09-12T17:28:59.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.153+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=TK7PKXNZCCER type=del 2024-09-12T17:28:59.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.156+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~H31S8RXDB6PK.0 size=1048576 2024-09-12T17:28:59.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.157+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9TE5N5TIB7AD.2~H31S8RXDB6PK.1 size=689362 2024-09-12T17:28:59.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.157+0000 7f9d7bc0c780 1 > prepared multipart upload key=9TE5N5TIB7AD upload=H31S8RXDB6PK tag=NE815E5WL6OW type=write size=2786514 2024-09-12T17:28:59.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.158+0000 7f9d7bc0c780 1 < canceled operation key=G5ZKTTY1XQ9T tag=MAOJPC196VH9 type=del size=588169 2024-09-12T17:28:59.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.160+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=T240I6WH49ZN type=del size=11089 2024-09-12T17:28:59.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.161+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=3KCI03RGPGS9 type=del 2024-09-12T17:28:59.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.163+0000 7f9d7bc0c780 1 > prepared part key=_multipart_NQ0768B94GVV.2~3U851BELYP5J.0 size=535927 2024-09-12T17:28:59.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.164+0000 7f9d7bc0c780 1 > prepared multipart upload key=NQ0768B94GVV upload=3U851BELYP5J tag=VECUG5UKNXUP type=write size=1584503 2024-09-12T17:28:59.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.165+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=Z4TPZ0QW2E5T type=del 2024-09-12T17:28:59.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.166+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=MQ5SN80RWDCT type=del size=4075227 2024-09-12T17:28:59.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.168+0000 7f9d7bc0c780 1 < completed delete operation key=31PU0U6IEAV2 tag=5SD6F24W5153 type=del 2024-09-12T17:28:59.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.170+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~BJJIVH62FXAH.0 size=1048576 2024-09-12T17:28:59.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.171+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~BJJIVH62FXAH.1 size=1048576 2024-09-12T17:28:59.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.173+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0NGHC5GMSGRX.2~BJJIVH62FXAH.2 size=909839 2024-09-12T17:28:59.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.173+0000 7f9d7bc0c780 1 > prepared multipart upload key=0NGHC5GMSGRX upload=BJJIVH62FXAH tag=W2V54BVEWDAR type=write size=4055567 2024-09-12T17:28:59.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.174+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~ZED2O2D5I049.0 size=1048576 2024-09-12T17:28:59.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.175+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~ZED2O2D5I049.1 size=840042 2024-09-12T17:28:59.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.178+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=ZED2O2D5I049 tag=XGMQW42SBZKH type=write size=2937194 2024-09-12T17:28:59.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.179+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=TH7SO2782N9Y type=del size=1585148 2024-09-12T17:28:59.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.181+0000 7f9d7bc0c780 1 < completed delete operation key=NQ0768B94GVV tag=Q55B61QBW373 type=del 2024-09-12T17:28:59.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.182+0000 7f9d7bc0c780 1 > prepared operation key=0JN5WWDYEM6Q tag=36VY1YE82PFD type=del size=2113184 2024-09-12T17:28:59.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.183+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~3M0F9SFMSBTN.0 size=1048576 2024-09-12T17:28:59.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.185+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~3M0F9SFMSBTN.1 size=616109 2024-09-12T17:28:59.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.187+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=3M0F9SFMSBTN tag=9Y7EQL1OXPOU type=write size=2713261 2024-09-12T17:28:59.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.190+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~G9TXL3X2PMKV.0 size=1048576 2024-09-12T17:28:59.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.191+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~G9TXL3X2PMKV.1 size=1048576 2024-09-12T17:28:59.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.192+0000 7f9d7bc0c780 1 > prepared part key=_multipart_J7MREXK6R3C4.2~G9TXL3X2PMKV.2 size=39908 2024-09-12T17:28:59.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.192+0000 7f9d7bc0c780 1 > prepared multipart upload key=J7MREXK6R3C4 upload=G9TXL3X2PMKV tag=VYQ9XNWBHAPG type=write size=3185636 2024-09-12T17:28:59.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.195+0000 7f9d7bc0c780 1 < suggested remove operation key=58C4SS3TN12K tag=B6ZV3D5UJB2Z type=del 2024-09-12T17:28:59.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.197+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~5O7QS85ETCL7.0 size=1048576 2024-09-12T17:28:59.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.198+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~5O7QS85ETCL7.1 size=1048576 2024-09-12T17:28:59.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.199+0000 7f9d7bc0c780 1 > prepared part key=_multipart_9B83KWC5E4ZV.2~5O7QS85ETCL7.2 size=585653 2024-09-12T17:28:59.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.199+0000 7f9d7bc0c780 1 > prepared multipart upload key=9B83KWC5E4ZV upload=5O7QS85ETCL7 tag=YQVJFTWA2CW5 type=write size=3731381 2024-09-12T17:28:59.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.201+0000 7f9d7bc0c780 1 < completed write operation key=M3Q7I7MD7M4I tag=1TECN49Z5LTS type=write size=967612 2024-09-12T17:28:59.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.202+0000 7f9d7bc0c780 1 > prepared operation key=SDX69F30A2RK tag=8JJ8V1OHL97Y type=write size=482407 2024-09-12T17:28:59.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.205+0000 7f9d7bc0c780 1 < suggested remove operation key=0JN5WWDYEM6Q tag=WPD82LHHCFZ6 type=write 2024-09-12T17:28:59.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.207+0000 7f9d7bc0c780 1 > prepared operation key=LJZNPSVLS9AF tag=G8VUYUWLLEGN type=del size=2071433 2024-09-12T17:28:59.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.210+0000 7f9d7bc0c780 1 < suggested remove operation key=W1SE9R6KU04G tag=IPGQQJ1QGVYM type=del 2024-09-12T17:28:59.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.211+0000 7f9d7bc0c780 1 > prepared operation key=LTG0UQEYPUGO tag=M58PDZ3H7P0A type=del size=3162636 2024-09-12T17:28:59.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.214+0000 7f9d7bc0c780 1 < suggested remove operation key=0NGHC5GMSGRX tag=WAX5OAZ0XFL8 type=write 2024-09-12T17:28:59.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.216+0000 7f9d7bc0c780 1 > prepared operation key=9B83KWC5E4ZV tag=YDMBXZCW6H64 type=del size=347722 2024-09-12T17:28:59.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.217+0000 7f9d7bc0c780 1 < completed delete operation key=64T291B0U226 tag=NXMT5IBURYQN type=del 2024-09-12T17:28:59.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.219+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=M4ADORWMIYVD type=del size=1109393 2024-09-12T17:28:59.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.221+0000 7f9d7bc0c780 1 < completed delete operation key=J7MREXK6R3C4 tag=RKDFX8WMCQ2W type=del 2024-09-12T17:28:59.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.222+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=LWT0M2Q8Q6WK type=del size=2420300 2024-09-12T17:28:59.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.224+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~H9IH6PR8XL4T.0 size=1048576 2024-09-12T17:28:59.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.225+0000 7f9d7bc0c780 1 < completed part key=_multipart_CYKLX4CJWVJE.2~H9IH6PR8XL4T.1 size=1048576 2024-09-12T17:28:59.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.225+0000 7f9d7bc0c780 1 < canceled part key=_multipart_CYKLX4CJWVJE.2~H9IH6PR8XL4T.2 size=666171 2024-09-12T17:28:59.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.227+0000 7f9d7bc0c780 1 < canceled multipart upload key=CYKLX4CJWVJE upload=H9IH6PR8XL4T tag=EKIO497UJG52 type=write size=3811899 2024-09-12T17:28:59.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.230+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~36EL74W73E0L.0 size=1048576 2024-09-12T17:28:59.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.232+0000 7f9d7bc0c780 1 > prepared part key=_multipart_EUHRVHNVI83I.2~36EL74W73E0L.1 size=162516 2024-09-12T17:28:59.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.232+0000 7f9d7bc0c780 1 > prepared multipart upload key=EUHRVHNVI83I upload=36EL74W73E0L tag=8LMV0MOS1LZI type=write size=2259668 2024-09-12T17:28:59.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.232+0000 7f9d7bc0c780 1 < canceled part key=_multipart_9TE5N5TIB7AD.2~H31S8RXDB6PK.0 size=1048576 2024-09-12T17:28:59.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.234+0000 7f9d7bc0c780 1 < completed part key=_multipart_9TE5N5TIB7AD.2~H31S8RXDB6PK.1 size=689362 2024-09-12T17:28:59.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.236+0000 7f9d7bc0c780 1 < canceled multipart upload key=9TE5N5TIB7AD upload=H31S8RXDB6PK tag=NE815E5WL6OW type=write size=2786514 2024-09-12T17:28:59.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.239+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~IL12ATHZ6XFG.0 size=261410 2024-09-12T17:28:59.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.239+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=IL12ATHZ6XFG tag=TSGM2P8YQYG2 type=write size=1309986 2024-09-12T17:28:59.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.240+0000 7f9d7bc0c780 1 < completed delete operation key=LTG0UQEYPUGO tag=T240I6WH49ZN type=del 2024-09-12T17:28:59.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.242+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=68P7EBJ4J1VP type=del size=3111865 2024-09-12T17:28:59.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.243+0000 7f9d7bc0c780 1 < completed part key=_multipart_NQ0768B94GVV.2~3U851BELYP5J.0 size=535927 2024-09-12T17:28:59.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.246+0000 7f9d7bc0c780 1 < completed multipart upload key=NQ0768B94GVV upload=3U851BELYP5J tag=VECUG5UKNXUP type=write size=1584503 2024-09-12T17:28:59.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.247+0000 7f9d7bc0c780 1 > prepared operation key=J3YYRIVKQ5AU tag=0V44VGVWOLUG type=write size=188748 2024-09-12T17:28:59.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.249+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=MQ5SN80RWDCT type=del 2024-09-12T17:28:59.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.252+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~OQ3XVNEP097W.0 size=901580 2024-09-12T17:28:59.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.252+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=OQ3XVNEP097W tag=OTVI7OZHDLO5 type=write size=1950156 2024-09-12T17:28:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.253+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~BJJIVH62FXAH.0 size=1048576 2024-09-12T17:28:59.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.255+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~BJJIVH62FXAH.1 size=1048576 2024-09-12T17:28:59.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.256+0000 7f9d7bc0c780 1 < completed part key=_multipart_0NGHC5GMSGRX.2~BJJIVH62FXAH.2 size=909839 2024-09-12T17:28:59.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.258+0000 7f9d7bc0c780 1 < completed multipart upload key=0NGHC5GMSGRX upload=BJJIVH62FXAH tag=W2V54BVEWDAR type=write size=4055567 2024-09-12T17:28:59.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.260+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=ISIQJE1ACMEL type=del size=1927066 2024-09-12T17:28:59.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.261+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=TH7SO2782N9Y type=del 2024-09-12T17:28:59.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.264+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~374V86KKZPKW.0 size=737995 2024-09-12T17:28:59.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.264+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=374V86KKZPKW tag=DC628K459EEX type=write size=1786571 2024-09-12T17:28:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.266+0000 7f9d7bc0c780 -1 < failed to complete operation key=0JN5WWDYEM6Q tag=36VY1YE82PFD type=del size=2113184: (22) Invalid argument 2024-09-12T17:28:59.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.267+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=W366ZINEH26C type=del size=3384119 2024-09-12T17:28:59.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.268+0000 7f9d7bc0c780 1 < canceled part key=_multipart_J7MREXK6R3C4.2~G9TXL3X2PMKV.0 size=1048576 2024-09-12T17:28:59.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.270+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~G9TXL3X2PMKV.1 size=1048576 2024-09-12T17:28:59.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.271+0000 7f9d7bc0c780 1 < completed part key=_multipart_J7MREXK6R3C4.2~G9TXL3X2PMKV.2 size=39908 2024-09-12T17:28:59.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.274+0000 7f9d7bc0c780 1 < canceled multipart upload key=J7MREXK6R3C4 upload=G9TXL3X2PMKV tag=VYQ9XNWBHAPG type=write size=3185636 2024-09-12T17:28:59.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.276+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~FRF3PBSLKONS.0 size=24535 2024-09-12T17:28:59.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.276+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=FRF3PBSLKONS tag=FE6I5FYNXYSJ type=write size=1073111 2024-09-12T17:28:59.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.278+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~5O7QS85ETCL7.0 size=1048576 2024-09-12T17:28:59.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.279+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~5O7QS85ETCL7.1 size=1048576 2024-09-12T17:28:59.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.280+0000 7f9d7bc0c780 1 < completed part key=_multipart_9B83KWC5E4ZV.2~5O7QS85ETCL7.2 size=585653 2024-09-12T17:28:59.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.283+0000 7f9d7bc0c780 1 < completed multipart upload key=9B83KWC5E4ZV upload=5O7QS85ETCL7 tag=YQVJFTWA2CW5 type=write size=3731381 2024-09-12T17:28:59.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.286+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~Z9JLK7PTTF85.0 size=1048576 2024-09-12T17:28:59.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.287+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~Z9JLK7PTTF85.1 size=172690 2024-09-12T17:28:59.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.287+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=Z9JLK7PTTF85 tag=RZL7TSWJDJUQ type=write size=2269842 2024-09-12T17:28:59.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.289+0000 7f9d7bc0c780 1 < completed write operation key=SDX69F30A2RK tag=8JJ8V1OHL97Y type=write size=482407 2024-09-12T17:28:59.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.291+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~L5UXUOE478NB.0 size=1048576 2024-09-12T17:28:59.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.293+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~L5UXUOE478NB.1 size=468010 2024-09-12T17:28:59.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.293+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=L5UXUOE478NB tag=FDWKX4ASFOYC type=write size=2565162 2024-09-12T17:28:59.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.294+0000 7f9d7bc0c780 1 < completed delete operation key=LJZNPSVLS9AF tag=G8VUYUWLLEGN type=del 2024-09-12T17:28:59.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.296+0000 7f9d7bc0c780 1 > prepared operation key=X7J78IOJR0HA tag=CNI59M50BRI3 type=del size=315632 2024-09-12T17:28:59.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.299+0000 7f9d7bc0c780 1 < suggested remove operation key=LTG0UQEYPUGO tag=M58PDZ3H7P0A type=del 2024-09-12T17:28:59.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.301+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~L4RIRHSK9G3T.0 size=1048576 2024-09-12T17:28:59.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.302+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~L4RIRHSK9G3T.1 size=1048576 2024-09-12T17:28:59.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.304+0000 7f9d7bc0c780 1 > prepared part key=_multipart_LU8MLGM7H0CE.2~L4RIRHSK9G3T.2 size=845211 2024-09-12T17:28:59.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.304+0000 7f9d7bc0c780 1 > prepared multipart upload key=LU8MLGM7H0CE upload=L4RIRHSK9G3T tag=P0TCLSD3304C type=write size=3990939 2024-09-12T17:28:59.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.305+0000 7f9d7bc0c780 1 < completed delete operation key=9B83KWC5E4ZV tag=YDMBXZCW6H64 type=del 2024-09-12T17:28:59.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.308+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~6KY39SJI2Y8V.0 size=1048576 2024-09-12T17:28:59.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.309+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~6KY39SJI2Y8V.1 size=267178 2024-09-12T17:28:59.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.309+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=6KY39SJI2Y8V tag=K94L17IUBNEB type=write size=2364330 2024-09-12T17:28:59.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.311+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=M4ADORWMIYVD type=del 2024-09-12T17:28:59.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.312+0000 7f9d7bc0c780 1 > prepared operation key=W1SE9R6KU04G tag=7HZJC8XCTHJJ type=del size=3950314 2024-09-12T17:28:59.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.314+0000 7f9d7bc0c780 1 < completed delete operation key=QB8C0OJA1L4X tag=LWT0M2Q8Q6WK type=del 2024-09-12T17:28:59.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.317+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~1YOSH2EWISES.0 size=1048576 2024-09-12T17:28:59.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.318+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~1YOSH2EWISES.1 size=1048576 2024-09-12T17:28:59.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.319+0000 7f9d7bc0c780 1 > prepared part key=_multipart_L72DVWQ63XUW.2~1YOSH2EWISES.2 size=793910 2024-09-12T17:28:59.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.319+0000 7f9d7bc0c780 1 > prepared multipart upload key=L72DVWQ63XUW upload=1YOSH2EWISES tag=I4G2EL1D8735 type=write size=3939638 2024-09-12T17:28:59.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.320+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~36EL74W73E0L.0 size=1048576 2024-09-12T17:28:59.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.321+0000 7f9d7bc0c780 1 < completed part key=_multipart_EUHRVHNVI83I.2~36EL74W73E0L.1 size=162516 2024-09-12T17:28:59.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.324+0000 7f9d7bc0c780 1 < completed multipart upload key=EUHRVHNVI83I upload=36EL74W73E0L tag=8LMV0MOS1LZI type=write size=2259668 2024-09-12T17:28:59.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.325+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=89S5PN5KUWQM type=del size=851535 2024-09-12T17:28:59.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.327+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~IL12ATHZ6XFG.0 size=261410 2024-09-12T17:28:59.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.331+0000 7f9d7bc0c780 1 < completed multipart upload key=L72DVWQ63XUW upload=IL12ATHZ6XFG tag=TSGM2P8YQYG2 type=write size=1309986 2024-09-12T17:28:59.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.332+0000 7f9d7bc0c780 1 > prepared operation key=9TE5N5TIB7AD tag=EEE87ELMBQX5 type=del size=3100356 2024-09-12T17:28:59.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.335+0000 7f9d7bc0c780 1 < suggested update operation key=X7J78IOJR0HA tag=68P7EBJ4J1VP type=del size=3111865 2024-09-12T17:28:59.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.336+0000 7f9d7bc0c780 1 > prepared operation key=AOT2ZKFTD0HY tag=95RHL7JA3LE4 type=del size=1429240 2024-09-12T17:28:59.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.338+0000 7f9d7bc0c780 1 < completed write operation key=J3YYRIVKQ5AU tag=0V44VGVWOLUG type=write size=188748 2024-09-12T17:28:59.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.341+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~L0TXHFQUD73H.0 size=1048576 2024-09-12T17:28:59.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.342+0000 7f9d7bc0c780 1 > prepared part key=_multipart_0BYGD7FTPQF3.2~L0TXHFQUD73H.1 size=749255 2024-09-12T17:28:59.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.342+0000 7f9d7bc0c780 1 > prepared multipart upload key=0BYGD7FTPQF3 upload=L0TXHFQUD73H tag=MCT0T9EG679I type=write size=2846407 2024-09-12T17:28:59.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.343+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~OQ3XVNEP097W.0 size=901580 2024-09-12T17:28:59.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.346+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=OQ3XVNEP097W tag=OTVI7OZHDLO5 type=write size=1950156 2024-09-12T17:28:59.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.348+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~C77E1SJA587U.0 size=1048576 2024-09-12T17:28:59.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.350+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~C77E1SJA587U.1 size=1048576 2024-09-12T17:28:59.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.351+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~C77E1SJA587U.2 size=102890 2024-09-12T17:28:59.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.351+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=C77E1SJA587U tag=0P7B9E8MRVNU type=write size=3248618 2024-09-12T17:28:59.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.354+0000 7f9d7bc0c780 1 < suggested update operation key=9TE5N5TIB7AD tag=ISIQJE1ACMEL type=del size=1927066 2024-09-12T17:28:59.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.357+0000 7f9d7bc0c780 1 > prepared part key=_multipart_SDX69F30A2RK.2~7OJ52O2NQKTT.0 size=888524 2024-09-12T17:28:59.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.357+0000 7f9d7bc0c780 1 > prepared multipart upload key=SDX69F30A2RK upload=7OJ52O2NQKTT tag=Z8SKIRWCO5GW type=write size=1937100 2024-09-12T17:28:59.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.358+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~374V86KKZPKW.0 size=737995 2024-09-12T17:28:59.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.360+0000 7f9d7bc0c780 1 < completed multipart upload key=0BYGD7FTPQF3 upload=374V86KKZPKW tag=DC628K459EEX type=write size=1786571 2024-09-12T17:28:59.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.362+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=UDDORJ4PJ0DO type=write size=846299 2024-09-12T17:28:59.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.363+0000 7f9d7bc0c780 -1 < failed to complete operation key=9TE5N5TIB7AD tag=W366ZINEH26C type=del size=3384119: (22) Invalid argument 2024-09-12T17:28:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.367+0000 7f9d7bc0c780 1 > prepared part key=_multipart_31PU0U6IEAV2.2~T54S09L5J91Z.0 size=634732 2024-09-12T17:28:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.367+0000 7f9d7bc0c780 1 > prepared multipart upload key=31PU0U6IEAV2 upload=T54S09L5J91Z tag=3G6K9WBJRXK4 type=write size=1683308 2024-09-12T17:28:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.367+0000 7f9d7bc0c780 1 < canceled part key=_multipart_SDX69F30A2RK.2~FRF3PBSLKONS.0 size=24535 2024-09-12T17:28:59.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.369+0000 7f9d7bc0c780 1 < canceled multipart upload key=SDX69F30A2RK upload=FRF3PBSLKONS tag=FE6I5FYNXYSJ type=write size=1073111 2024-09-12T17:28:59.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.371+0000 7f9d7bc0c780 1 > prepared operation key=J7MREXK6R3C4 tag=3987FTHQX8F2 type=write size=59431 2024-09-12T17:28:59.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.372+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~Z9JLK7PTTF85.0 size=1048576 2024-09-12T17:28:59.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.374+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~Z9JLK7PTTF85.1 size=172690 2024-09-12T17:28:59.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.376+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=Z9JLK7PTTF85 tag=RZL7TSWJDJUQ type=write size=2269842 2024-09-12T17:28:59.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.378+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=36MN1BNDEI62 type=del size=2427478 2024-09-12T17:28:59.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.380+0000 7f9d7bc0c780 1 < completed part key=_multipart_ZM8NMC18RN3I.2~L5UXUOE478NB.0 size=1048576 2024-09-12T17:28:59.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.380+0000 7f9d7bc0c780 1 < canceled part key=_multipart_ZM8NMC18RN3I.2~L5UXUOE478NB.1 size=468010 2024-09-12T17:28:59.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.382+0000 7f9d7bc0c780 1 < canceled multipart upload key=ZM8NMC18RN3I upload=L5UXUOE478NB tag=FDWKX4ASFOYC type=write size=2565162 2024-09-12T17:28:59.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.384+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=8BMTGPA6IF61 type=del size=3626638 2024-09-12T17:28:59.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.385+0000 7f9d7bc0c780 -1 < failed to complete operation key=X7J78IOJR0HA tag=CNI59M50BRI3 type=del size=315632: (22) Invalid argument 2024-09-12T17:28:59.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.387+0000 7f9d7bc0c780 1 > prepared operation key=0BYGD7FTPQF3 tag=NOAPVBXBHY3Q type=del size=3081141 2024-09-12T17:28:59.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.389+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~L4RIRHSK9G3T.0 size=1048576 2024-09-12T17:28:59.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.390+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~L4RIRHSK9G3T.1 size=1048576 2024-09-12T17:28:59.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.391+0000 7f9d7bc0c780 1 < completed part key=_multipart_LU8MLGM7H0CE.2~L4RIRHSK9G3T.2 size=845211 2024-09-12T17:28:59.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.393+0000 7f9d7bc0c780 1 < completed multipart upload key=LU8MLGM7H0CE upload=L4RIRHSK9G3T tag=P0TCLSD3304C type=write size=3990939 2024-09-12T17:28:59.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.396+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~5VNDPYS1047A.0 size=1048576 2024-09-12T17:28:59.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.397+0000 7f9d7bc0c780 1 > prepared part key=_multipart_64T291B0U226.2~5VNDPYS1047A.1 size=316588 2024-09-12T17:28:59.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.397+0000 7f9d7bc0c780 1 > prepared multipart upload key=64T291B0U226 upload=5VNDPYS1047A tag=ZHAR83PR4MJ4 type=write size=2413740 2024-09-12T17:28:59.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.399+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~6KY39SJI2Y8V.0 size=1048576 2024-09-12T17:28:59.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.400+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~6KY39SJI2Y8V.1 size=267178 2024-09-12T17:28:59.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.403+0000 7f9d7bc0c780 1 < completed multipart upload key=M3Q7I7MD7M4I upload=6KY39SJI2Y8V tag=K94L17IUBNEB type=write size=2364330 2024-09-12T17:28:59.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.405+0000 7f9d7bc0c780 1 > prepared part key=_multipart_AOT2ZKFTD0HY.2~CNWVARW6F5YS.0 size=525337 2024-09-12T17:28:59.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.405+0000 7f9d7bc0c780 1 > prepared multipart upload key=AOT2ZKFTD0HY upload=CNWVARW6F5YS tag=53D2X1WQLXDY type=write size=1573913 2024-09-12T17:28:59.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.407+0000 7f9d7bc0c780 1 < completed delete operation key=W1SE9R6KU04G tag=7HZJC8XCTHJJ type=del 2024-09-12T17:28:59.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.410+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=5UHFAR4MJHFY type=del size=622898 2024-09-12T17:28:59.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.411+0000 7f9d7bc0c780 1 < completed part key=_multipart_L72DVWQ63XUW.2~1YOSH2EWISES.0 size=1048576 2024-09-12T17:28:59.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.411+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~1YOSH2EWISES.1 size=1048576 2024-09-12T17:28:59.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.411+0000 7f9d7bc0c780 1 < canceled part key=_multipart_L72DVWQ63XUW.2~1YOSH2EWISES.2 size=793910 2024-09-12T17:28:59.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.414+0000 7f9d7bc0c780 1 < canceled multipart upload key=L72DVWQ63XUW upload=1YOSH2EWISES tag=I4G2EL1D8735 type=write size=3939638 2024-09-12T17:28:59.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.415+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=P0B2IG2CK5B9 type=del size=131687 2024-09-12T17:28:59.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.416+0000 7f9d7bc0c780 -1 < failed to complete operation key=9TE5N5TIB7AD tag=89S5PN5KUWQM type=del size=851535: (22) Invalid argument 2024-09-12T17:28:59.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.418+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=X4DUOOUPA0EL type=del size=2271609 2024-09-12T17:28:59.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.419+0000 7f9d7bc0c780 -1 < failed to complete operation key=9TE5N5TIB7AD tag=EEE87ELMBQX5 type=del size=3100356: (22) Invalid argument 2024-09-12T17:28:59.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.420+0000 7f9d7bc0c780 1 > prepared operation key=80JXIGQWQGR9 tag=G9OU6D5K7UXN type=del size=1084018 2024-09-12T17:28:59.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.423+0000 7f9d7bc0c780 1 < suggested remove operation key=AOT2ZKFTD0HY tag=95RHL7JA3LE4 type=del 2024-09-12T17:28:59.425 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.424+0000 7f9d7bc0c780 1 > prepared operation key=0NGHC5GMSGRX tag=THVIV6K8FNLY type=write size=509866 2024-09-12T17:28:59.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.425+0000 7f9d7bc0c780 1 < canceled part key=_multipart_0BYGD7FTPQF3.2~L0TXHFQUD73H.0 size=1048576 2024-09-12T17:28:59.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.426+0000 7f9d7bc0c780 1 < completed part key=_multipart_0BYGD7FTPQF3.2~L0TXHFQUD73H.1 size=749255 2024-09-12T17:28:59.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.428+0000 7f9d7bc0c780 1 < canceled multipart upload key=0BYGD7FTPQF3 upload=L0TXHFQUD73H tag=MCT0T9EG679I type=write size=2846407 2024-09-12T17:28:59.430 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.429+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=1FEYQODRK6ET type=del size=1751573 2024-09-12T17:28:59.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.430+0000 7f9d7bc0c780 1 < canceled part key=_multipart_M3Q7I7MD7M4I.2~C77E1SJA587U.0 size=1048576 2024-09-12T17:28:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.431+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~C77E1SJA587U.1 size=1048576 2024-09-12T17:28:59.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.432+0000 7f9d7bc0c780 1 < completed part key=_multipart_M3Q7I7MD7M4I.2~C77E1SJA587U.2 size=102890 2024-09-12T17:28:59.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.436+0000 7f9d7bc0c780 1 < canceled multipart upload key=M3Q7I7MD7M4I upload=C77E1SJA587U tag=0P7B9E8MRVNU type=write size=3248618 2024-09-12T17:28:59.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.438+0000 7f9d7bc0c780 1 > prepared operation key=G5ZKTTY1XQ9T tag=7IDWTRRRQ409 type=del size=3417534 2024-09-12T17:28:59.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.439+0000 7f9d7bc0c780 1 < completed part key=_multipart_SDX69F30A2RK.2~7OJ52O2NQKTT.0 size=888524 2024-09-12T17:28:59.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.442+0000 7f9d7bc0c780 1 < completed multipart upload key=SDX69F30A2RK upload=7OJ52O2NQKTT tag=Z8SKIRWCO5GW type=write size=1937100 2024-09-12T17:28:59.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.443+0000 7f9d7bc0c780 1 > prepared operation key=L72DVWQ63XUW tag=HHWZX2VU85NN type=del size=2941863 2024-09-12T17:28:59.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.445+0000 7f9d7bc0c780 1 < completed write operation key=EUHRVHNVI83I tag=UDDORJ4PJ0DO type=write size=846299 2024-09-12T17:28:59.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.446+0000 7f9d7bc0c780 1 > prepared operation key=4V2IYJRP2PZI tag=AAGTMYOR63FI type=del size=280356 2024-09-12T17:28:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.448+0000 7f9d7bc0c780 1 < completed part key=_multipart_31PU0U6IEAV2.2~T54S09L5J91Z.0 size=634732 2024-09-12T17:28:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.450+0000 7f9d7bc0c780 1 < completed multipart upload key=31PU0U6IEAV2 upload=T54S09L5J91Z tag=3G6K9WBJRXK4 type=write size=1683308 2024-09-12T17:28:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.451+0000 7f9d7bc0c780 1 > prepared operation key=M3Q7I7MD7M4I tag=D1UER2I6RUL6 type=del size=799082 2024-09-12T17:28:59.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.453+0000 7f9d7bc0c780 1 < completed write operation key=J7MREXK6R3C4 tag=3987FTHQX8F2 type=write size=59431 2024-09-12T17:28:59.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.454+0000 7f9d7bc0c780 1 > prepared operation key=QB8C0OJA1L4X tag=SOE5BGX9T4A4 type=del size=2602223 2024-09-12T17:28:59.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.456+0000 7f9d7bc0c780 1 < canceled operation key=NQ0768B94GVV tag=36MN1BNDEI62 type=del size=2427478 2024-09-12T17:28:59.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.459+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~5DLXNK3WXOAI.0 size=1048576 2024-09-12T17:28:59.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.460+0000 7f9d7bc0c780 1 > prepared part key=_multipart_80JXIGQWQGR9.2~5DLXNK3WXOAI.1 size=2829 2024-09-12T17:28:59.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.460+0000 7f9d7bc0c780 1 > prepared multipart upload key=80JXIGQWQGR9 upload=5DLXNK3WXOAI tag=ZO77JW9B51PE type=write size=2099981 2024-09-12T17:28:59.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.461+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=8BMTGPA6IF61 type=del 2024-09-12T17:28:59.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.464+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~7HSHO4HTFVH8.0 size=1048576 2024-09-12T17:28:59.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.465+0000 7f9d7bc0c780 1 > prepared part key=_multipart_M3Q7I7MD7M4I.2~7HSHO4HTFVH8.1 size=358269 2024-09-12T17:28:59.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.465+0000 7f9d7bc0c780 1 > prepared multipart upload key=M3Q7I7MD7M4I upload=7HSHO4HTFVH8 tag=AVE28VQKSOWA type=write size=2455421 2024-09-12T17:28:59.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.466+0000 7f9d7bc0c780 1 < completed delete operation key=0BYGD7FTPQF3 tag=NOAPVBXBHY3Q type=del 2024-09-12T17:28:59.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.468+0000 7f9d7bc0c780 1 > prepared operation key=OZKAXB0ET9R7 tag=AUKFQLB4HQ0V type=del size=1962994 2024-09-12T17:28:59.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.469+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~5VNDPYS1047A.0 size=1048576 2024-09-12T17:28:59.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.470+0000 7f9d7bc0c780 1 < completed part key=_multipart_64T291B0U226.2~5VNDPYS1047A.1 size=316588 2024-09-12T17:28:59.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.473+0000 7f9d7bc0c780 1 < completed multipart upload key=64T291B0U226 upload=5VNDPYS1047A tag=ZHAR83PR4MJ4 type=write size=2413740 2024-09-12T17:28:59.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.474+0000 7f9d7bc0c780 1 > prepared operation key=31PU0U6IEAV2 tag=E6E9WNOWYD8N type=del size=2518348 2024-09-12T17:28:59.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.476+0000 7f9d7bc0c780 1 < completed part key=_multipart_AOT2ZKFTD0HY.2~CNWVARW6F5YS.0 size=525337 2024-09-12T17:28:59.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.478+0000 7f9d7bc0c780 1 < completed multipart upload key=AOT2ZKFTD0HY upload=CNWVARW6F5YS tag=53D2X1WQLXDY type=write size=1573913 2024-09-12T17:28:59.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.480+0000 7f9d7bc0c780 1 > prepared operation key=R94VERREGANN tag=YCNPZ991G49K type=del size=2376701 2024-09-12T17:28:59.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.482+0000 7f9d7bc0c780 1 < canceled operation key=NQ0768B94GVV tag=5UHFAR4MJHFY type=del size=622898 2024-09-12T17:28:59.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.483+0000 7f9d7bc0c780 1 > prepared operation key=EUHRVHNVI83I tag=TJRPLW1TDC7H type=del size=3590845 2024-09-12T17:28:59.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.485+0000 7f9d7bc0c780 1 < completed delete operation key=ZM8NMC18RN3I tag=P0B2IG2CK5B9 type=del 2024-09-12T17:28:59.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.487+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~X1695VW0UH14.0 size=1048576 2024-09-12T17:28:59.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.489+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~X1695VW0UH14.1 size=1048576 2024-09-12T17:28:59.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.490+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~X1695VW0UH14.2 size=71974 2024-09-12T17:28:59.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.490+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=X1695VW0UH14 tag=LNC3U050UJLH type=write size=3217702 2024-09-12T17:28:59.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.492+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=X4DUOOUPA0EL type=del 2024-09-12T17:28:59.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.493+0000 7f9d7bc0c780 1 > prepared operation key=NQ0768B94GVV tag=OMF5O16ZYGUZ type=del size=1997314 2024-09-12T17:28:59.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.495+0000 7f9d7bc0c780 1 < completed delete operation key=80JXIGQWQGR9 tag=G9OU6D5K7UXN type=del 2024-09-12T17:28:59.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.496+0000 7f9d7bc0c780 1 > prepared operation key=CYKLX4CJWVJE tag=Z8NGWV1HZTAQ type=del size=3412507 2024-09-12T17:28:59.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.498+0000 7f9d7bc0c780 1 < completed write operation key=0NGHC5GMSGRX tag=THVIV6K8FNLY type=write size=509866 2024-09-12T17:28:59.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.500+0000 7f9d7bc0c780 1 > prepared operation key=58C4SS3TN12K tag=9FSG09T2HWV2 type=del size=2655270 2024-09-12T17:28:59.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.503+0000 7f9d7bc0c780 1 < suggested update operation key=LU8MLGM7H0CE tag=1FEYQODRK6ET type=del size=1751573 2024-09-12T17:28:59.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.506+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~VFOEDIVZNOL5.0 size=1048576 2024-09-12T17:28:59.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.507+0000 7f9d7bc0c780 1 > prepared part key=_multipart_ZM8NMC18RN3I.2~VFOEDIVZNOL5.1 size=908120 2024-09-12T17:28:59.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.507+0000 7f9d7bc0c780 1 > prepared multipart upload key=ZM8NMC18RN3I upload=VFOEDIVZNOL5 tag=VGN8IHPLBOCH type=write size=3005272 2024-09-12T17:28:59.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.508+0000 7f9d7bc0c780 1 < completed delete operation key=G5ZKTTY1XQ9T tag=7IDWTRRRQ409 type=del 2024-09-12T17:28:59.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.510+0000 7f9d7bc0c780 1 > prepared operation key=ZM8NMC18RN3I tag=4OYF9Q0TJ53S type=del size=3452083 2024-09-12T17:28:59.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.511+0000 7f9d7bc0c780 1 < completed delete operation key=L72DVWQ63XUW tag=HHWZX2VU85NN type=del 2024-09-12T17:28:59.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.514+0000 7f9d7bc0c780 1 > prepared part key=_multipart_CYKLX4CJWVJE.2~R3UZ26943V48.0 size=326282 2024-09-12T17:28:59.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.514+0000 7f9d7bc0c780 1 > prepared multipart upload key=CYKLX4CJWVJE upload=R3UZ26943V48 tag=EF7CD0HKHEZK type=write size=1374858 2024-09-12T17:28:59.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.515+0000 7f9d7bc0c780 1 < completed delete operation key=4V2IYJRP2PZI tag=AAGTMYOR63FI type=del 2024-09-12T17:28:59.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:28:59.517+0000 7f9d7bc0c780 1 > prepared operation key=LU8MLGM7H0CE tag=ABT7M9JR7FBB type=del size=2853066 2024-09-12T17:28:59.518 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] cls_rgw_stats.simulate (11028 ms) 2024-09-12T17:28:59.518 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 1 test from cls_rgw_stats (11028 ms total) 2024-09-12T17:28:59.518 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:28:59.518 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:29:00.428 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 1 test from 1 test suite ran. (13807 ms total) 2024-09-12T17:29:00.428 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 1 test. 2024-09-12T17:29:00.431 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:29:00.432 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:29:00.518 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:29:00.519 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:29:00.520 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:29:00.569 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:29:00.569 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:29:00.569 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:29:02.451 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:29:02.452 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:29:02.468 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (16 ms) 2024-09-12T17:29:02.468 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:29:02.475 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2024-09-12T17:29:02.475 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:29:02.478 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T17:29:02.478 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:29:02.482 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-12T17:29:02.482 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:29:02.488 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-12T17:29:02.488 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:29:02.495 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-12T17:29:02.495 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:29:02.498 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T17:29:02.498 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:29:02.500 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (2 ms) 2024-09-12T17:29:02.501 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:29:02.706 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (206 ms) 2024-09-12T17:29:02.706 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:29:02.710 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T17:29:02.711 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:29:02.711 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:29:02.711 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:29:02.712 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T17:29:02.712 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:29:02.720 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-12T17:29:02.720 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:29:02.727 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-09-12T17:29:02.727 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:29:02.734 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-12T17:29:02.735 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:29:02.742 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (8 ms) 2024-09-12T17:29:02.742 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:29:02.751 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-09-12T17:29:02.751 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:29:02.761 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (10 ms) 2024-09-12T17:29:02.761 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:29:02.763 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-12T17:29:02.763 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:29:02.766 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T17:29:02.767 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:29:02.767 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T17:29:02.768 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:29:02.768 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T17:29:02.768 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:29:02.777 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (9 ms) 2024-09-12T17:29:02.777 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:29:02.784 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-12T17:29:02.785 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:29:02.793 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (9 ms) 2024-09-12T17:29:02.793 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:29:02.801 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-12T17:29:02.801 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:29:02.804 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (3 ms) 2024-09-12T17:29:02.804 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:29:02.807 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T17:29:02.807 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:29:02.808 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T17:29:02.808 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:29:02.809 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-12T17:29:02.809 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:29:02.817 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T17:29:02.817 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 31 tests from CmpOmap (365 ms total) 2024-09-12T17:29:02.817 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:29:02.817 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:29:03.449 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 31 tests from 1 test suite ran. (2881 ms total) 2024-09-12T17:29:03.450 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 31 tests. 2024-09-12T17:29:03.453 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:29:03.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:29:03.498 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:29:03.499 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:29:03.500 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:29:03.548 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:29:03.548 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:29:03.548 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:29:03.548 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:29:03.549 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:29:06.476 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2928 ms) 2024-09-12T17:29:06.476 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:29:09.492 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3015 ms) 2024-09-12T17:29:09.492 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:29:12.515 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.Reserve (3023 ms) 2024-09-12T17:29:12.515 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:29:15.529 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3014 ms) 2024-09-12T17:29:15.529 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:29:18.558 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.Commit (3030 ms) 2024-09-12T17:29:18.558 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:29:21.583 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.Stats (3024 ms) 2024-09-12T17:29:21.583 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:29:25.799 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4217 ms) 2024-09-12T17:29:25.800 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:29:28.829 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.Abort (3030 ms) 2024-09-12T17:29:28.830 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:29:31.838 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.ReserveError (3008 ms) 2024-09-12T17:29:31.838 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:29:34.861 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.CommitError (3022 ms) 2024-09-12T17:29:34.861 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:29:37.886 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.AbortError (3027 ms) 2024-09-12T17:29:37.886 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:29:40.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3027 ms) 2024-09-12T17:29:40.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:29:43.927 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3013 ms) 2024-09-12T17:29:43.927 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:29:46.953 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3026 ms) 2024-09-12T17:29:46.953 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:29:49.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3007 ms) 2024-09-12T17:29:49.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:29:52.986 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3027 ms) 2024-09-12T17:29:52.987 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:29:56.003 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3016 ms) 2024-09-12T17:29:56.003 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:29:59.031 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.Cleanup (3028 ms) 2024-09-12T17:29:59.031 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:30:09.443 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10413 ms) 2024-09-12T17:30:09.444 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:30:12.465 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3022 ms) 2024-09-12T17:30:12.466 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:30:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14058 ms) 2024-09-12T17:30:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:30:30.551 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4027 ms) 2024-09-12T17:30:30.551 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:30:35.569 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5018 ms) 2024-09-12T17:30:35.569 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:30:40.607 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5038 ms) 2024-09-12T17:30:40.607 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from TestCls2PCQueue (97058 ms total) 2024-09-12T17:30:40.607 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:30:40.607 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:40.607 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 24 tests from 1 test suite ran. (97058 ms total) 2024-09-12T17:30:40.607 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 24 tests. 2024-09-12T17:30:40.610 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:40.610 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:40.652 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:30:40.653 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:30:40.653 DEBUG:teuthology.orchestra.run.smithi063:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:30:40.745 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:40.745 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:40.745 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:30:40.745 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:42.623 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:30:42.623 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:30:42.644 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsAccount.add (21 ms) 2024-09-12T17:30:42.644 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:30:42.649 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-12T17:30:42.649 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:30:42.656 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-09-12T17:30:42.656 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:30:42.671 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] ClsAccount.list (15 ms) 2024-09-12T17:30:42.672 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 4 tests from ClsAccount (48 ms total) 2024-09-12T17:30:42.672 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:30:42.672 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:43.629 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 4 tests from 1 test suite ran. (2885 ms total) 2024-09-12T17:30:43.629 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 4 tests. 2024-09-12T17:30:43.633 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:43.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:43.679 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:30:43.680 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:30:43.680 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:30:43.737 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:43.737 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:43.737 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:30:43.738 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:45.646 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:30:45.646 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:30:45.653 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] rgw_gc_log.init_existing_queue (8 ms) 2024-09-12T17:30:45.653 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:30:45.656 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T17:30:45.657 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:30:45.873 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (217 ms) 2024-09-12T17:30:45.873 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:30:45.876 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T17:30:45.876 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:30:45.877 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T17:30:45.877 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:30:45.879 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T17:30:45.879 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 6 tests from rgw_gc_log (234 ms total) 2024-09-12T17:30:45.879 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:30:45.880 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:46.651 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 6 tests from 1 test suite ran. (2915 ms total) 2024-09-12T17:30:46.651 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 6 tests. 2024-09-12T17:30:46.655 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:46.655 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:46.702 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:30:46.704 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:30:46.704 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:30:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:Running main() from gmock_main.cc 2024-09-12T17:30:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:30:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:30:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:30:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns= i= 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns= i= 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns= i= 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.765 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.766 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.767 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.768 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.769 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.770 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns=ns i= 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns=ns i= 2024-09-12T17:30:46.771 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns=ns i= 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.772 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.773 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.774 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.775 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.776 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns= i=v1 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.777 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns= i=v1 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns= i=v1 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.778 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.779 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.780 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.781 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.782 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.783 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: _obj[v1] 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.784 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.785 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.786 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.787 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.788 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_obj", 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.789 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns= i= 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns= i= 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns= i= 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.790 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.791 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.792 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.793 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.794 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.795 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns=ns i= 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns=ns i= 2024-09-12T17:30:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns=ns i= 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.797 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.798 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.799 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.800 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.801 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.802 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns= i=v1 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns= i=v1 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns= i=v1 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.803 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.804 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.805 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.806 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.807 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.808 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:parsed: obj[v1] 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout: "obj1": { 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.809 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.810 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "obj2": { 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.811 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3": { 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.812 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "obj3-2": { 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.813 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "obj", 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "v1", 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.814 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestRGWObj.no_underscore (1 ms) 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.815 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.816 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker_myobj", 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.817 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.818 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.819 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.820 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.821 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker_myobj", 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.822 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.823 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.824 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.825 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.826 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.827 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.828 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.829 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.830 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.831 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.832 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.833 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.834 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.835 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.836 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.837 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.838 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.839 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.839 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.839 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.839 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.839 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.841 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.842 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.843 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.844 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.845 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.846 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.847 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.848 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.849 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.850 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.851 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.852 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.853 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.854 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj", 2024-09-12T17:30:46.855 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.856 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.857 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.859 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj", 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.860 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.861 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.862 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.863 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.864 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.865 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.867 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.868 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.869 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.870 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.871 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.872 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.873 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.874 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.875 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.876 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.877 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:30:46.878 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.879 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.880 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.881 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.882 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.883 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.884 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.885 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.886 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.887 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.888 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.889 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.890 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.891 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj_", 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.892 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.893 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.894 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.895 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj_", 2024-09-12T17:30:46.896 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.897 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.898 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.899 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.900 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.901 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.902 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.903 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.904 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.905 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.906 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.907 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.908 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.909 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.910 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.911 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.912 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.913 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.914 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.915 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.916 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.917 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.918 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.919 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": "default-placement.data", 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "test", 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.920 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": "", 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": "" 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.921 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.922 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "obj": { 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.923 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.924 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.925 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker_myobj", 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.926 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.927 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.928 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker_myobj", 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.929 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:30:46.930 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.931 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.932 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.933 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.934 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:30:46.935 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.936 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.937 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.938 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.939 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.940 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.941 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.942 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "myobj", 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.943 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj", 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.944 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.945 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj", 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.946 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.947 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.948 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.949 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.950 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.951 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.952 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.953 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.954 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj" 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.955 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:30:46.956 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.957 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.958 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.959 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.960 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj_", 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.961 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.962 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker___myobj_", 2024-09-12T17:30:46.963 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.964 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:30:46.965 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.966 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.967 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.968 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.969 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "", 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:30:46.970 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.971 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.972 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "marker__myobj_" 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.973 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "" 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.974 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj": { 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj": { 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.975 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: "raw_obj2": { 2024-09-12T17:30:46.976 INFO:tasks.workunit.client.0.smithi063.stdout: "pool": ".data-pool", 2024-09-12T17:30:46.977 INFO:tasks.workunit.client.0.smithi063.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:30:46.977 INFO:tasks.workunit.client.0.smithi063.stdout: "loc": "" 2024-09-12T17:30:46.977 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.977 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.977 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "new_obj2": { 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket": { 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "ebtest", 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "marker": "marker", 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_id": "bucket-id", 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "tenant": "", 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "explicit_placement": { 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "data_pool": ".data-pool", 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "data_extra_pool": "", 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "index_pool": ".index-pool" 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:46.978 INFO:tasks.workunit.client.0.smithi063.stdout: "key": { 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout: "name": "_myobj_", 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout: "instance": "inst", 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout: "ns": "ns" 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:30:46.979 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 4 tests. 2024-09-12T17:30:46.980 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:46.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:47.021 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:30:47.023 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:30:47.023 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:30:47.162 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:47.162 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:47.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.200+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.201+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.201+0000 7fe4d0e10800 20 realm 2024-09-12T17:30:47.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.201+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.202+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.202+0000 7fe4d0e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:47.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.202+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.202+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.202+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.203+0000 7fe4d0e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:47.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.203+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.203+0000 7fe4d0e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:47.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.203+0000 7fe4d0e10800 20 searching for the correct realm 2024-09-12T17:30:47.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.207+0000 7fe4cbdbb640 0 -- 172.21.15.63:0/1738129651 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fe4c0036960 msgr2=0x7fe4c0008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:47.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.413+0000 7fe4ccdbd640 0 -- 172.21.15.63:0/1738129651 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x558300564560 msgr2=0x558300566990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:47.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:47.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:30:47.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:47.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:30:47.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:47.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:47.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:47.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.418+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:47.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 20 zone default found 2024-09-12T17:30:47.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 4 Realm: () 2024-09-12T17:30:47.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 20 zonegroup default 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.419+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.420+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.420+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.420+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.420+0000 7fe4d0e10800 20 started sync module instance, tier type = 2024-09-12T17:30:47.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.420+0000 7fe4d0e10800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:30:47.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.431+0000 7fe4d0e10800 20 add_watcher() i=0 2024-09-12T17:30:47.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.431+0000 7fe4d0e10800 20 add_watcher() i=1 2024-09-12T17:30:47.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.431+0000 7fe4d0e10800 20 add_watcher() i=2 2024-09-12T17:30:47.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.431+0000 7fe4d0e10800 20 add_watcher() i=3 2024-09-12T17:30:47.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.431+0000 7fe4d0e10800 20 add_watcher() i=4 2024-09-12T17:30:47.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.431+0000 7fe4d0e10800 20 add_watcher() i=5 2024-09-12T17:30:47.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.431+0000 7fe4d0e10800 20 add_watcher() i=6 2024-09-12T17:30:47.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.432+0000 7fe4d0e10800 20 add_watcher() i=7 2024-09-12T17:30:47.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.432+0000 7fe4d0e10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:47.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.434+0000 7fe382fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:47.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.434+0000 7fe4d0e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:47.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.434+0000 7fe4d0e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:47.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.434+0000 7fe4d0e10800 5 note: GC not initialized 2024-09-12T17:30:47.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe381fe3640 20 reqs_thread_entry: start 2024-09-12T17:30:47.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 20 init_complete bucket index max shards: 11 2024-09-12T17:30:47.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 20 Filter name: none 2024-09-12T17:30:47.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe37b7fe640 20 reqs_thread_entry: start 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.435+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 10 cache get: name=default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= : miss 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 20 rados->read ofs=0 len=0 2024-09-12T17:30:47.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:47.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 10 cache put: name=default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= info.flags=0x0 2024-09-12T17:30:47.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 10 adding default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= to cache LRU end 2024-09-12T17:30:47.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 10 cache get: name=default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= : hit (negative entry) 2024-09-12T17:30:47.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.436+0000 7fe4d0e10800 10 cache get: name=default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= : hit (negative entry) 2024-09-12T17:30:47.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.437+0000 7fe4d0e10800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:30:47.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.437+0000 7fe4d0e10800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:30:47.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.437+0000 7fe4d0e10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:30:47.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.438+0000 7fe3ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725891 cookie 94021134784160 notifier 5351 bl.length()=697 2024-09-12T17:30:47.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.438+0000 7fe3ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:30:47.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.438+0000 7fe3ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:30:47.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.440+0000 7fe4d0e10800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:30:47.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.440+0000 7fe4d0e10800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:30:47.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.440+0000 7fe4d0e10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:30:47.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.440+0000 7fe3ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725888 cookie 94021134783104 notifier 5351 bl.length()=194 2024-09-12T17:30:47.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.440+0000 7fe3ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:30:47.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.440+0000 7fe3ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.442+0000 7fe4d0e10800 10 cache put: name=default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= info.flags=0x7 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.442+0000 7fe4d0e10800 10 moving default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= to cache LRU end 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.442+0000 7fe4d0e10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:xf9i+kgFhFn5qVQet6tvRY9gL4s=, ofs0, ns] 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.443+0000 7fe3aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94021134783104 notifier 5351 bl.length()=203 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.443+0000 7fe3aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= info.flags=0x7 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.443+0000 7fe3aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+xf9i+kgFhFn5qVQet6tvRY9gL4s= to cache LRU end 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:30:47.444 INFO:tasks.workunit.client.0.smithi063.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "display_name": "librgw test user", 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "email": "librgw@example.com", 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "suspended": 0, 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "subusers": [], 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "keys": [ 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: { 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "access_key": "xf9i+kgFhFn5qVQet6tvRY9gL4s=", 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "secret_key": "/K9TcJDiIQ5WG/a3rdUeGxUjoTCUSVba90cHR4hRfKpHd37sH6f0Nw==", 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "active": true, 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: "create_date": "2024-09-12T17:30:47.437448Z" 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:30:47.445 INFO:tasks.workunit.client.0.smithi063.stdout: ], 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "swift_keys": [], 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "caps": [], 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "default_placement": "", 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "placement_tags": [], 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_quota": { 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "enabled": false, 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size": -1, 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "max_objects": -1 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:47.446 INFO:tasks.workunit.client.0.smithi063.stdout: "user_quota": { 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "enabled": false, 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size": -1, 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "max_objects": -1 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "type": "rgw", 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "account_id": "", 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "path": "/", 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "create_date": "2024-09-12T17:30:47.437435Z", 2024-09-12T17:30:47.447 INFO:tasks.workunit.client.0.smithi063.stdout: "tags": [], 2024-09-12T17:30:47.448 INFO:tasks.workunit.client.0.smithi063.stdout: "group_ids": [] 2024-09-12T17:30:47.448 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:30:47.448 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:30:47.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.444+0000 7fe382fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:47.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.447+0000 7fe4d0e10800 20 remove_watcher() i=0 2024-09-12T17:30:47.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.447+0000 7fe4d0e10800 2 removed watcher, disabling cache 2024-09-12T17:30:47.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.448+0000 7fe4d0e10800 20 remove_watcher() i=1 2024-09-12T17:30:47.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.449+0000 7fe4d0e10800 20 remove_watcher() i=2 2024-09-12T17:30:47.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.450+0000 7fe4d0e10800 20 remove_watcher() i=3 2024-09-12T17:30:47.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.451+0000 7fe4d0e10800 20 remove_watcher() i=4 2024-09-12T17:30:47.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.452+0000 7fe4d0e10800 20 remove_watcher() i=5 2024-09-12T17:30:47.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.453+0000 7fe4d0e10800 20 remove_watcher() i=6 2024-09-12T17:30:47.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:47.454+0000 7fe4d0e10800 20 remove_watcher() i=7 2024-09-12T17:30:47.466 INFO:tasks.workunit.client.0.smithi063.stdout:phase 1.1 2024-09-12T17:30:47.488 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:30:47.488 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:47.488 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:30:47.489 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:30:47.499 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:47.500 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:47.877 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-12T17:30:47.877 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:30:47.878 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:30:47.878 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:30:47.878 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:30:47.878 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:30:47.886 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:30:47.891 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/f1 2024-09-12T17:30:47.894 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/f2 2024-09-12T17:30:47.898 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:30:47.901 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:30:47.904 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:30:47.907 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:30:47.910 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:30:47.914 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:30:47.917 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:30:47.920 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:30:47.923 INFO:tasks.workunit.client.0.smithi063.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:30:47.926 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETUP_HIER1 (48 ms) 2024-09-12T17:30:47.926 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:30:48.035 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETUP_DIRS1 (109 ms) 2024-09-12T17:30:48.035 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:30:48.035 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:30:48.036 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:30:48.054 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (19 ms) 2024-09-12T17:30:48.054 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:30:48.099 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (45 ms) 2024-09-12T17:30:48.099 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:30:48.099 INFO:tasks.workunit.client.0.smithi063.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:30:48.106 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T17:30:48.106 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:30:48.106 INFO:tasks.workunit.client.0.smithi063.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:30:48.113 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-12T17:30:48.113 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:30:48.114 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:30:48.115 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:30:48.115 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:30:48.115 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:30:48.115 INFO:tasks.workunit.client.0.smithi063.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:30:48.115 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:30:48.115 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:30:48.115 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:30:48.116 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:30:48.117 INFO:tasks.workunit.client.0.smithi063.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:30:48.117 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:30:48.118 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:30:48.118 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:30:48.120 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:30:48.120 INFO:tasks.workunit.client.0.smithi063.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:30:48.120 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:30:48.121 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:30:48.121 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:30:48.123 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:30:48.123 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-12T17:30:48.123 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:30:48.303 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READF_SETUP1 (179 ms) 2024-09-12T17:30:48.303 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:30:48.303 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:30:48.303 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:30:48.303 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:30:48.303 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:30:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:30:48.305 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:30:48.305 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:30:48.305 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:30:48.311 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:30:48.311 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:30:48.314 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:30:48.316 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:30:48.319 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:30:48.320 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:30:48.320 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:30:48.321 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:30:48.321 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:30:48.321 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:30:48.322 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:30:48.324 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:30:48.324 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:30:48.324 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:30:48.324 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.HIER1 (22 ms) 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:30:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:30:48.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:30:48.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:30:48.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:48.323+0000 7fbc2e9208c0 -1 shutting down 2024-09-12T17:30:48.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:30:48.324+0000 7fbb06804640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65834, si_uid : 1000, si_addr0x3e80001012a, si_status0 2024-09-12T17:31:18.268 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (29943 ms) 2024-09-12T17:31:18.269 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from LibRGW (30779 ms total) 2024-09-12T17:31:18.269 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:31:18.269 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:31:18.269 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 24 tests from 1 test suite ran. (30779 ms total) 2024-09-12T17:31:18.269 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 24 tests. 2024-09-12T17:31:18.275 INFO:tasks.workunit.client.0.smithi063.stdout:phase 1.2 2024-09-12T17:31:18.302 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:31:18.302 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:31:18.302 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:31:18.302 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:31:18.311 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:18.311 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:18.700 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (397 ms) 2024-09-12T17:31:18.700 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:31:18.702 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:31:18.703 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:31:18.704 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:31:18.700+0000 7f48ab2808c0 -1 shutting down 2024-09-12T17:31:18.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:31:18.701+0000 7f4784fbf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66457, si_uid : 1000, si_addr0x3e800010399, si_status0 2024-09-12T17:31:48.859 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (30157 ms) 2024-09-12T17:31:48.859 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from LibRGW (30556 ms total) 2024-09-12T17:31:48.859 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:31:48.860 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:31:48.860 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 24 tests from 1 test suite ran. (30556 ms total) 2024-09-12T17:31:48.860 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 24 tests. 2024-09-12T17:31:48.865 INFO:tasks.workunit.client.0.smithi063.stdout:phase 1.3 2024-09-12T17:31:48.890 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:31:48.890 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:31:48.890 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:31:48.890 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:31:48.901 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:48.901 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:49.291 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (401 ms) 2024-09-12T17:31:49.292 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:31:49.292 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:31:49.292 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:31:49.292 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:31:49.292 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:31:49.297 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-12T17:31:49.297 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETUP_DIRS1 (61 ms) 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:31:49.359 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:31:49.360 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:31:49.361 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:31:49.362 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:31:49.362 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:31:49.362 INFO:tasks.workunit.client.0.smithi063.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:31:49.362 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:31:49.363 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:31:49.363 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:31:49.364 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:31:49.364 INFO:tasks.workunit.client.0.smithi063.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:31:49.364 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:31:49.365 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:31:49.365 INFO:tasks.workunit.client.0.smithi063.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:31:49.366 INFO:tasks.workunit.client.0.smithi063.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:31:49.366 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-12T17:31:49.366 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:31:49.367 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:31:49.367 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:31:49.367 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:31:49.367 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:31:49.367 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:31:49.367 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:31:49.367 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:31:49.368 INFO:tasks.workunit.client.0.smithi063.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:31:49.369 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:31:49.369 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:31:49.373 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:31:49.373 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:31:49.377 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:31:49.378 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:31:49.381 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:31:49.382 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:31:49.383 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:31:49.383 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:31:49.384 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:31:49.384 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:31:49.384 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:31:49.387 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:31:49.387 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:31:49.387 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:31:49.387 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:31:49.387 INFO:tasks.workunit.client.0.smithi063.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:31:49.388 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-12T17:31:49.388 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:31:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:31:49.390 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:31:49.390 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:31:49.390 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:31:49.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:31:49.384+0000 7f6506d1f8c0 -1 shutting down 2024-09-12T17:31:49.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:31:49.385+0000 7f63de227640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67076, si_uid : 1000, si_addr0x3e800010604, si_status0 2024-09-12T17:32:19.433 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (30045 ms) 2024-09-12T17:32:19.433 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 24 tests from LibRGW (30541 ms total) 2024-09-12T17:32:19.433 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:32:19.433 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:32:19.433 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 24 tests from 1 test suite ran. (30541 ms total) 2024-09-12T17:32:19.434 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 24 tests. 2024-09-12T17:32:19.438 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2.1 2024-09-12T17:32:19.464 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:32:19.464 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:32:19.464 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:32:19.465 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:32:19.474 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:19.474 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:19.865 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-12T17:32:19.865 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:32:19.865 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:32:19.865 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:32:19.874 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-12T17:32:19.874 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:32:19.874 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:32:19.874 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:32:19.882 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave0 2024-09-12T17:32:19.891 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave1 2024-09-12T17:32:19.899 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave2 2024-09-12T17:32:19.907 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave3 2024-09-12T17:32:19.917 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave4 2024-09-12T17:32:19.927 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave5 2024-09-12T17:32:19.935 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave6 2024-09-12T17:32:19.943 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave7 2024-09-12T17:32:19.953 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave8 2024-09-12T17:32:19.963 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave9 2024-09-12T17:32:19.963 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (89 ms) 2024-09-12T17:32:19.963 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:32:20.231 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (268 ms) 2024-09-12T17:32:20.231 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:32:20.231 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:32:20.232 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:32:20.232 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:32:20.232 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:32:20.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:32:20.230+0000 7f81b90c18c0 -1 shutting down 2024-09-12T17:32:20.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:32:20.231+0000 7f8090004640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67699, si_uid : 1000, si_addr0x3e800010873, si_status0 2024-09-12T17:32:50.147 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (29916 ms) 2024-09-12T17:32:50.148 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 9 tests from LibRGW (30683 ms total) 2024-09-12T17:32:50.148 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:32:50.148 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:32:50.148 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 9 tests from 1 test suite ran. (30683 ms total) 2024-09-12T17:32:50.148 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 9 tests. 2024-09-12T17:32:50.154 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2.2 2024-09-12T17:32:50.181 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:32:50.181 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:32:50.181 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:32:50.182 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:32:50.191 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:50.191 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:50.582 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (401 ms) 2024-09-12T17:32:50.582 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:32:50.583 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:32:50.583 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:32:50.583 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:32:50.583 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:32:50.611 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-12T17:32:50.611 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:32:50.623 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave0 2024-09-12T17:32:50.631 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave1 2024-09-12T17:32:50.640 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave2 2024-09-12T17:32:50.647 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave3 2024-09-12T17:32:50.657 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave4 2024-09-12T17:32:50.663 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave5 2024-09-12T17:32:50.671 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave6 2024-09-12T17:32:50.679 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave7 2024-09-12T17:32:50.688 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave8 2024-09-12T17:32:50.696 INFO:tasks.workunit.client.0.smithi063.stdout:created: sorrydave9 2024-09-12T17:32:50.696 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (85 ms) 2024-09-12T17:32:50.697 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:32:50.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (263 ms) 2024-09-12T17:32:50.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:32:50.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:32:50.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:32:50.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:32:50.959 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:32:50.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:32:50.958+0000 7f03d6ec58c0 -1 shutting down 2024-09-12T17:32:50.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:32:50.959+0000 7f02ade04640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68319, si_uid : 1000, si_addr0x3e800010adf, si_status0 2024-09-12T17:33:20.663 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (29704 ms) 2024-09-12T17:33:20.664 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 9 tests from LibRGW (30482 ms total) 2024-09-12T17:33:20.664 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:33:20.664 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:33:20.664 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 9 tests from 1 test suite ran. (30482 ms total) 2024-09-12T17:33:20.664 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 9 tests. 2024-09-12T17:33:20.670 INFO:tasks.workunit.client.0.smithi063.stdout:phase 3.1 2024-09-12T17:33:21.003 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:33:21.004 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:33:21.004 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:33:21.004 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:33:21.013 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:21.013 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:21.395 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (392 ms) 2024-09-12T17:33:21.395 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:33:21.396 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:33:21.396 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:33:21.404 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-12T17:33:21.405 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:33:21.407 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T17:33:21.407 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:33:21.409 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:33:21.409 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:33:21.851 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LARGE1 (442 ms) 2024-09-12T17:33:21.851 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:33:21.910 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LARGE2 (59 ms) 2024-09-12T17:33:21.910 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:33:21.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:33:21.912 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:33:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:33:21.909+0000 7fee63cbf8c0 -1 shutting down 2024-09-12T17:33:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:33:21.910+0000 7fed3ac04640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68938, si_uid : 1000, si_addr0x3e800010d4a, si_status0 2024-09-12T17:33:51.456 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (29545 ms) 2024-09-12T17:33:51.456 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 13 tests from LibRGW (30452 ms total) 2024-09-12T17:33:51.456 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:33:51.456 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:33:51.456 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 13 tests from 1 test suite ran. (30452 ms total) 2024-09-12T17:33:51.456 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 13 tests. 2024-09-12T17:33:51.463 INFO:tasks.workunit.client.0.smithi063.stdout:phase 3.2 2024-09-12T17:33:51.794 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:33:51.794 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:33:51.794 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:33:51.794 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:33:51.802 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:51.802 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:51.981 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-12T17:33:51.981 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:33:51.982 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:33:51.982 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:33:51.982 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:33:51.982 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:33:51.987 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:33:51.987 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:33:51.991 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T17:33:51.991 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:33:52.047 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LARGE1 (56 ms) 2024-09-12T17:33:52.047 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:33:52.048 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:33:52.048 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:33:52.048 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:33:52.048 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:33:52.055 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_OBJECT (8 ms) 2024-09-12T17:33:52.055 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:33:52.081 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET (25 ms) 2024-09-12T17:33:52.081 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:33:52.081 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-12T17:33:52.081 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:33:52.081 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:33:52.082 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:33:52.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:33:52.080+0000 7ffaa251f8c0 -1 shutting down 2024-09-12T17:33:52.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:33:52.081+0000 7ff979831640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69558, si_uid : 1000, si_addr0x3e800010fb6, si_status0 2024-09-12T17:34:22.117 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (30036 ms) 2024-09-12T17:34:22.118 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 13 tests from LibRGW (30323 ms total) 2024-09-12T17:34:22.118 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:34:22.118 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:34:22.118 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 13 tests from 1 test suite ran. (30323 ms total) 2024-09-12T17:34:22.118 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 13 tests. 2024-09-12T17:34:22.125 INFO:tasks.workunit.client.0.smithi063.stdout:phase 4.1 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:read i1: 64001 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:read s1: blunderbuss 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:34:22.151 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:34:22.163 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:22.163 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:22.553 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-12T17:34:22.553 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:34:22.553 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:34:22.554 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:34:22.570 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-12T17:34:22.570 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:34:23.180 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_0 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_1 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_2 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_3 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_4 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_5 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_6 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_7 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_8 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_9 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_10 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_11 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_12 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_13 2024-09-12T17:34:23.181 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_14 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_15 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_16 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_17 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_18 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_19 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_20 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_21 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_22 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_23 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_24 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_25 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_26 2024-09-12T17:34:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_27 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_28 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_29 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_30 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_31 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_32 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_33 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_34 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_35 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_36 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_37 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_38 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_39 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_40 2024-09-12T17:34:23.183 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_41 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_42 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_43 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_44 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_45 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_46 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_47 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_48 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_49 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_50 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_51 2024-09-12T17:34:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_52 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_53 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_54 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_55 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_56 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_57 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_58 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_59 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_60 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_61 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_62 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_63 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_64 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_65 2024-09-12T17:34:23.185 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_66 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_67 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_68 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_69 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_70 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_71 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_72 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_73 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_74 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_75 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_76 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_77 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_78 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_79 2024-09-12T17:34:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_80 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_81 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_82 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_83 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_84 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_85 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_86 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_87 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_88 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_89 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_90 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_91 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_92 2024-09-12T17:34:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_93 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_94 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_95 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_96 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_97 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_98 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:created: dmarker:f_99 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (610 ms) 2024-09-12T17:34:23.188 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:34:23.193 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:34:23.193 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:34:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:34:23.195 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:34:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:34:23.197 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:34:23.198 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:34:23.199 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:34:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:34:23.201 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:34:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:34:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:34:23.204 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:34:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:34:23.206 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:34:23.207 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:34:23.208 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:34:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:34:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:34:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:34:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:34:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:34:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:34:23.184+0000 7fee0cf0c8c0 -1 shutting down 2024-09-12T17:34:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:34:23.185+0000 7fece6c4b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70178, si_uid : 1000, si_addr0x3e800011222, si_status0 2024-09-12T17:34:52.876 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (29689 ms) 2024-09-12T17:34:52.876 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 11 tests from LibRGW (30724 ms total) 2024-09-12T17:34:52.876 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:34:52.876 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:34:52.877 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 11 tests from 1 test suite ran. (30724 ms total) 2024-09-12T17:34:52.877 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 11 tests. 2024-09-12T17:34:52.882 INFO:tasks.workunit.client.0.smithi063.stdout:phase 4.2 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:read i1: 64001 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:read s1: blunderbuss 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:34:52.908 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:34:52.916 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:52.917 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:53.306 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (398 ms) 2024-09-12T17:34:53.306 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:34:53.307 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:34:53.307 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:34:53.315 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (8 ms) 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:34:53.320 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:34:53.321 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:34:53.322 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:34:53.323 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:34:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:34:53.325 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:34:53.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:34:53.317+0000 7fa072b338c0 -1 shutting down 2024-09-12T17:34:53.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:34:53.318+0000 7f9f4ab01640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70797, si_uid : 1000, si_addr0x3e80001148d, si_status0 2024-09-12T17:35:23.452 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (30134 ms) 2024-09-12T17:35:23.453 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 11 tests from LibRGW (30544 ms total) 2024-09-12T17:35:23.453 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:35:23.453 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:35:23.453 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 11 tests from 1 test suite ran. (30544 ms total) 2024-09-12T17:35:23.453 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 11 tests. 2024-09-12T17:35:23.459 INFO:tasks.workunit.client.0.smithi063.stdout:phase 5.1 2024-09-12T17:35:23.494 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:35:23.494 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:35:23.494 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:35:23.495 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:35:23.509 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:23.509 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:23.891 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (398 ms) 2024-09-12T17:35:23.892 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:35:23.892 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:35:23.892 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:35:23.901 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-12T17:35:23.901 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:35:23.904 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T17:35:23.904 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:35:23.904 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:35:23.904 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:35:23.906 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:35:23.906 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:35:23.906 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:35:23.906 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:35:23.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-12T17:35:23.911 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:35:23.913 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:35:23.914 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:35:23.915 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:35:23.915 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:35:23.915 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:35:23.915 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:35:23.915 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:35:23.915 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:35:23.915 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:35:23.916 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:35:23.916 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:35:23.916 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:35:23.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:35:23.912+0000 7fd33033c8c0 -1 shutting down 2024-09-12T17:35:23.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:35:23.913+0000 7fd20830f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71417, si_uid : 1000, si_addr0x3e8000116f9, si_status0 2024-09-12T17:35:53.940 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (30027 ms) 2024-09-12T17:35:53.941 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 19 tests from LibRGW (30447 ms total) 2024-09-12T17:35:53.941 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:35:53.941 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:35:53.941 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 19 tests from 1 test suite ran. (30447 ms total) 2024-09-12T17:35:53.941 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 19 tests. 2024-09-12T17:35:53.946 INFO:tasks.workunit.client.0.smithi063.stdout:phase 5.2 2024-09-12T17:35:53.981 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:35:53.981 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:35:53.981 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:35:53.981 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:35:53.989 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:53.989 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:54.173 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (192 ms) 2024-09-12T17:35:54.174 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:35:54.174 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:35:54.174 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:35:54.174 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:35:54.174 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:35:54.179 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:35:54.179 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:35:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:35:54.181 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:35:54.184 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T17:35:54.184 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:35:54.212 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.DELETE_BUCKET (27 ms) 2024-09-12T17:35:54.212 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:35:54.212 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:35:54.212 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:35:54.212 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:35:54.212 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:35:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:35:54.211+0000 7fc333f418c0 -1 shutting down 2024-09-12T17:35:54.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:35:54.212+0000 7fc20dc80640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72037, si_uid : 1000, si_addr0x3e800011965, si_status0 2024-09-12T17:36:24.541 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (30328 ms) 2024-09-12T17:36:24.541 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 19 tests from LibRGW (30559 ms total) 2024-09-12T17:36:24.541 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:36:24.542 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:24.542 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 19 tests from 1 test suite ran. (30559 ms total) 2024-09-12T17:36:24.542 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 19 tests. 2024-09-12T17:36:24.547 INFO:tasks.workunit.client.0.smithi063.stdout:phase 6.1 2024-09-12T17:36:24.573 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:36:24.573 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:24.573 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:36:24.574 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:36:24.581 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:24.581 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:24.973 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-12T17:36:24.973 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:36:24.974 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:36:24.974 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:36:24.992 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CREATE_BUCKETS (18 ms) 2024-09-12T17:36:24.992 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:36:24.998 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-12T17:36:24.998 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:36:25.019 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.TOPDIR_RENAME (21 ms) 2024-09-12T17:36:25.019 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:36:25.044 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SUBDIR_RENAME (25 ms) 2024-09-12T17:36:25.044 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:36:25.070 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (26 ms) 2024-09-12T17:36:25.070 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:36:25.070 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:36:25.070 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:36:25.070 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:36:25.070 INFO:tasks.workunit.client.0.smithi063.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:36:25.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:25.069+0000 7f9c7b1528c0 -1 shutting down 2024-09-12T17:36:25.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:25.072+0000 7f9b54e8f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72656, si_uid : 1000, si_addr0x3e800011bd0, si_status0 2024-09-12T17:36:55.148 INFO:tasks.workunit.client.0.smithi063.stdout:[ OK ] LibRGW.SHUTDOWN (30077 ms) 2024-09-12T17:36:55.148 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] 10 tests from LibRGW (30574 ms total) 2024-09-12T17:36:55.148 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:36:55.148 INFO:tasks.workunit.client.0.smithi063.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:55.148 INFO:tasks.workunit.client.0.smithi063.stdout:[==========] 10 tests from 1 test suite ran. (30574 ms total) 2024-09-12T17:36:55.149 INFO:tasks.workunit.client.0.smithi063.stdout:[ PASSED ] 10 tests. 2024-09-12T17:36:55.155 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:55.155 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:55.202 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:36:55.203 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:36:55.203 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:36:55.240 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -z ']' 2024-09-12T17:36:55.240 INFO:tasks.workunit.client.0.smithi063.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:36:55.240 INFO:tasks.workunit.client.0.smithi063.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:36:55.241 INFO:tasks.workunit.client.0.smithi063.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:36:55.241 INFO:tasks.workunit.client.0.smithi063.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:36:55.241 INFO:tasks.workunit.client.0.smithi063.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T17:36:55.278 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:55.279 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:55.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.317+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.318+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.318+0000 7f5aa731f800 20 realm 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.318+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.319+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.319+0000 7f5aa731f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.319+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.319+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.319+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.319+0000 7f5aa731f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:55.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.319+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.320+0000 7f5aa731f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:55.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.320+0000 7f5aa731f800 20 searching for the correct realm 2024-09-12T17:36:55.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.323+0000 7f5aa28a8640 0 -- 172.21.15.63:0/439025864 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5a98015030 msgr2=0x7f5a98096860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:55.530 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.528+0000 7f5aa38aa640 0 -- 172.21.15.63:0/439025864 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x556ba7b59c40 msgr2=0x556ba7b5c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.532+0000 7f5aa731f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.532+0000 7f5aa731f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.532+0000 7f5aa731f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.532+0000 7f5aa731f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.532+0000 7f5aa731f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.532+0000 7f5aa731f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.532+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 20 zone default found 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 4 Realm: () 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.533+0000 7f5aa731f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 zonegroup default 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 started sync module instance, tier type = 2024-09-12T17:36:55.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.534+0000 7f5aa731f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:36:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.545+0000 7f5aa731f800 20 add_watcher() i=0 2024-09-12T17:36:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.545+0000 7f5aa731f800 20 add_watcher() i=1 2024-09-12T17:36:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.545+0000 7f5aa731f800 20 add_watcher() i=2 2024-09-12T17:36:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.545+0000 7f5aa731f800 20 add_watcher() i=3 2024-09-12T17:36:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.545+0000 7f5aa731f800 20 add_watcher() i=4 2024-09-12T17:36:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.545+0000 7f5aa731f800 20 add_watcher() i=5 2024-09-12T17:36:55.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.545+0000 7f5aa731f800 20 add_watcher() i=6 2024-09-12T17:36:55.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.546+0000 7f5aa731f800 20 add_watcher() i=7 2024-09-12T17:36:55.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.546+0000 7f5aa731f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:55.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.548+0000 7f595a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.548+0000 7f5aa731f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.548+0000 7f5aa731f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.548+0000 7f5aa731f800 5 note: GC not initialized 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f59597e2640 20 reqs_thread_entry: start 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 20 Filter name: none 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f59527fc640 20 reqs_thread_entry: start 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:36:55.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:36:55.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:36:55.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:36:55.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.549+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:36:55.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.550+0000 7f5aa731f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:36:55.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.551+0000 7f5aa731f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:36:55.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.551+0000 7f5aa731f800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:36:55.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.551+0000 7f5aa731f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:36:55.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.552+0000 7f5986ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725909 cookie 93920863627680 notifier 5570 bl.length()=677 2024-09-12T17:36:55.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.552+0000 7f5986ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:36:55.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.552+0000 7f5986ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:36:55.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.554+0000 7f5aa731f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:36:55.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.554+0000 7f5aa731f800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:36:55.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.554+0000 7f5aa731f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:36:55.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.554+0000 7f5986ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725902 cookie 93920863612688 notifier 5570 bl.length()=187 2024-09-12T17:36:55.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.554+0000 7f5986ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:36:55.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.554+0000 7f5986ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.556+0000 7f5aa731f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.556+0000 7f5aa731f800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.556+0000 7f5aa731f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.556+0000 7f59867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725903 cookie 93920863612688 notifier 5570 bl.length()=197 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.556+0000 7f59867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.556+0000 7f59867fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi063.stdout: "display_name": "maven test user", 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "email": "sigv4@example.com", 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "suspended": 0, 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "subusers": [], 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "keys": [ 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: { 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "user": "ceph-test-maven", 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "active": true, 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "create_date": "2024-09-12T17:36:55.552279Z" 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: ], 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi063.stdout: "swift_keys": [], 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "caps": [], 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "default_placement": "", 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "placement_tags": [], 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_quota": { 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "enabled": false, 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size": -1, 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "max_objects": -1 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "user_quota": { 2024-09-12T17:36:55.560 INFO:tasks.workunit.client.0.smithi063.stdout: "enabled": false, 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size": -1, 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "max_objects": -1 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "type": "rgw", 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "account_id": "", 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "path": "/", 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "create_date": "2024-09-12T17:36:55.552268Z", 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "tags": [], 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout: "group_ids": [] 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:36:55.562 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:36:55.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.557+0000 7f595a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:55.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.560+0000 7f5aa731f800 20 remove_watcher() i=0 2024-09-12T17:36:55.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.560+0000 7f5aa731f800 2 removed watcher, disabling cache 2024-09-12T17:36:55.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.561+0000 7f5aa731f800 20 remove_watcher() i=1 2024-09-12T17:36:55.564 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.562+0000 7f5aa731f800 20 remove_watcher() i=2 2024-09-12T17:36:55.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.563+0000 7f5aa731f800 20 remove_watcher() i=3 2024-09-12T17:36:55.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.564+0000 7f5aa731f800 20 remove_watcher() i=4 2024-09-12T17:36:55.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.565+0000 7f5aa731f800 20 remove_watcher() i=5 2024-09-12T17:36:55.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.566+0000 7f5aa731f800 20 remove_watcher() i=6 2024-09-12T17:36:55.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:36:55.568+0000 7f5aa731f800 20 remove_watcher() i=7 2024-09-12T17:36:55.580 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -z ']' 2024-09-12T17:36:55.581 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T17:36:55.581 INFO:tasks.workunit.client.0.smithi063.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:36:55.582 INFO:tasks.workunit.client.0.smithi063.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi063.front.sepia.ceph.com:80 2024-09-12T17:36:55.582 INFO:tasks.workunit.client.0.smithi063.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi063.front.sepia.ceph.com:80 2024-09-12T17:36:55.582 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T17:36:55.582 INFO:tasks.workunit.client.0.smithi063.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:36:55.582 INFO:tasks.workunit.client.0.smithi063.stderr:+ ./mvnw clean package 2024-09-12T17:36:55.601 INFO:tasks.workunit.client.0.smithi063.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:36:57.137 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Scanning for projects... 2024-09-12T17:36:57.257 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:36:57.339 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 66 kB/s) 2024-09-12T17:36:57.350 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:36:57.391 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T17:36:57.399 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:36:57.420 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T17:36:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:36:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:36:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:36:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] from pom.xml 2024-09-12T17:36:57.443 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:36:57.445 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:36:57.460 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-12T17:36:57.466 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:36:57.481 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-12T17:36:57.484 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:36:57.499 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 3.0 MB/s) 2024-09-12T17:36:57.506 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:36:57.521 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-12T17:36:57.532 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:36:57.548 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-12T17:36:57.555 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:36:57.569 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 583 kB/s) 2024-09-12T17:36:57.572 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:36:57.586 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 578 kB/s) 2024-09-12T17:36:57.589 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:36:57.604 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-12T17:36:57.608 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:36:57.622 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T17:36:57.628 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:36:57.643 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T17:36:57.648 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:36:57.664 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-12T17:36:57.669 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:36:57.686 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-12T17:36:57.692 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:36:57.707 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-12T17:36:57.709 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:36:57.724 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-12T17:36:57.728 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:36:57.743 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.3 MB/s) 2024-09-12T17:36:57.748 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:36:57.762 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.7 MB/s) 2024-09-12T17:36:57.768 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:36:57.783 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T17:36:57.786 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:36:57.801 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 3.0 MB/s) 2024-09-12T17:36:57.809 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:36:57.823 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-12T17:36:57.826 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:36:57.841 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-12T17:36:57.843 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:36:57.859 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-12T17:36:57.862 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:36:57.876 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.5 MB/s) 2024-09-12T17:36:57.883 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:36:57.899 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-12T17:36:57.917 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:36:57.933 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 380 kB/s) 2024-09-12T17:36:57.936 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:36:57.950 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-12T17:36:57.956 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:36:57.972 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-12T17:36:57.984 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:36:58.002 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-12T17:36:58.005 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:36:58.021 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T17:36:58.024 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:36:58.039 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T17:36:58.044 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:36:58.059 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T17:36:58.066 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:36:58.081 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-12T17:36:58.085 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:36:58.100 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-12T17:36:58.104 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:36:58.119 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-12T17:36:58.123 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:36:58.137 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 273 kB/s) 2024-09-12T17:36:58.140 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:36:58.155 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-12T17:36:58.158 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:36:58.172 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-12T17:36:58.175 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:36:58.188 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-12T17:36:58.190 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:36:58.204 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-12T17:36:58.207 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:36:58.221 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-12T17:36:58.225 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:36:58.242 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T17:36:58.245 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:36:58.260 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-12T17:36:58.266 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:36:58.280 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T17:36:58.284 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:36:58.298 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-12T17:36:58.302 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:36:58.319 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 205 kB/s) 2024-09-12T17:36:58.323 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:36:58.338 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 314 kB/s) 2024-09-12T17:36:58.340 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:36:58.355 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-12T17:36:58.359 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:36:58.374 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-12T17:36:58.378 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:36:58.392 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-12T17:36:58.396 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:36:58.410 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 212 kB/s) 2024-09-12T17:36:58.414 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:36:58.430 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 217 kB/s) 2024-09-12T17:36:58.434 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:36:58.449 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T17:36:58.451 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:36:58.465 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-12T17:36:58.468 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:36:58.482 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-12T17:36:58.485 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:36:58.500 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T17:36:58.502 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:36:58.516 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.5 MB/s) 2024-09-12T17:36:58.519 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:36:58.534 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-12T17:36:58.537 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:36:58.551 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-12T17:36:58.553 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:36:58.567 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-12T17:36:58.571 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:36:58.586 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-12T17:36:58.589 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:36:58.606 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-12T17:36:58.612 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:36:58.627 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T17:36:58.631 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:36:58.645 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:36:58.647 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:36:58.663 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-12T17:36:58.667 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:36:58.681 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-12T17:36:58.684 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:36:58.699 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-12T17:36:58.702 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:36:58.718 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-12T17:36:58.723 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:36:58.738 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-12T17:36:58.740 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:36:58.754 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-12T17:36:58.757 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:36:58.771 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:36:58.773 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:36:58.787 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-12T17:36:58.790 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:36:58.804 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T17:36:58.805 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:36:58.820 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-12T17:36:58.822 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:36:58.836 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-12T17:36:58.838 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:36:58.853 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-12T17:36:58.855 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:36:58.870 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:36:58.872 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:36:58.887 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:36:58.890 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:36:58.904 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-12T17:36:58.907 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:36:58.922 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T17:36:58.924 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:36:58.939 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T17:36:58.941 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:36:58.955 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-12T17:36:58.957 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:36:58.971 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-12T17:36:58.973 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:36:58.989 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T17:36:58.991 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:36:59.006 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:36:59.023 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:36:59.103 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 41 MB/s) 2024-09-12T17:36:59.105 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:36:59.105 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:36:59.106 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:36:59.106 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:36:59.106 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:36:59.125 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.4 MB/s) 2024-09-12T17:36:59.125 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:36:59.139 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 472 kB/s) 2024-09-12T17:36:59.139 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:36:59.156 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (2): 4.1/16 kB | 1.4/35 kB Progress (2): 5.5/16 kB | 1.4/35 kB Progress (2): 5.5/16 kB | 2.8/35 kB Progress (2): 6.9/16 kB | 2.8/35 kB Progress (2): 6.9/16 kB | 4.1/35 kB Progress (3): 6.9/16 kB | 4.1/35 kB | 1.4/49 kB Progress (3): 6.9/16 kB | 5.5/35 kB | 1.4/49 kB Progress (3): 8.3/16 kB | 5.5/35 kB | 1.4/49 kB Progress (3): 8.3/16 kB | 6.9/35 kB | 1.4/49 kB Progress (3): 9.7/16 kB | 6.9/35 kB | 1.4/49 kB Progress (3): 9.7/16 kB | 6.9/35 kB | 2.8/49 kB Progress (3): 11/16 kB | 6.9/35 kB | 2.8/49 kB Progress (3): 11/16 kB | 8.3/35 kB | 2.8/49 kB Progress (3): 11/16 kB | 8.3/35 kB | 4.1/49 kB Progress (3): 12/16 kB | 8.3/35 kB | 4.1/49 kB Progress (3): 12/16 kB | 9.7/35 kB | 4.1/49 kB Progress (3): 14/16 kB | 9.7/35 kB | 4.1/49 kB Progress (3): 14/16 kB | 9.7/35 kB | 5.5/49 kB Progress (3): 14/16 kB | 11/35 kB | 5.5/49 kB Progress (3): 15/16 kB | 11/35 kB | 5.5/49 kB Progress (3): 15/16 kB | 12/35 kB | 5.5/49 kB Progress (3): 16 kB | 12/35 kB | 5.5/49 kB Progress (3): 16 kB | 12/35 kB | 6.9/49 kB Progress (3): 16 kB | 14/35 kB | 6.9/49 kB Progress (3): 16 kB | 14/35 kB | 8.3/49 kB Progress (3): 16 kB | 15/35 kB | 8.3/49 kB Progress (3): 16 kB | 15/35 kB | 9.7/49 kB Progress (3): 16 kB | 16/35 kB | 9.7/49 kB Progress (3): 16 kB | 16/35 kB | 11/49 kB Progress (4): 16 kB | 16/35 kB | 11/49 kB | 16/98 kB Progress (4): 16 kB | 16/35 kB | 12/49 kB | 16/98 kB Progress (4): 16 kB | 18/35 kB | 12/49 kB | 16/98 kB Progress (4): 16 kB | 18/35 kB | 14/49 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 329 kB/s) 2024-09-12T17:36:59.156 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 18/35 kB | 15/49 kB | 16/98 kB Progress (3): 19/35 kB | 15/49 kB | 16/98 kB Progress (3): 19/35 kB | 16/49 kB | 16/98 kB Progress (3): 21/35 kB | 16/49 kB | 16/98 kB Progress (3): 21/35 kB | 18/49 kB | 16/98 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:36:59.169 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 22/35 kB | 18/49 kB | 16/98 kB Progress (3): 22/35 kB | 19/49 kB | 16/98 kB Progress (3): 23/35 kB | 19/49 kB | 16/98 kB Progress (3): 23/35 kB | 21/49 kB | 16/98 kB Progress (3): 23/35 kB | 22/49 kB | 16/98 kB Progress (4): 23/35 kB | 22/49 kB | 16/98 kB | 16/782 kB Progress (4): 23/35 kB | 23/49 kB | 16/98 kB | 16/782 kB Progress (4): 25/35 kB | 23/49 kB | 16/98 kB | 16/782 kB Progress (4): 26/35 kB | 23/49 kB | 16/98 kB | 16/782 kB Progress (4): 26/35 kB | 23/49 kB | 16/98 kB | 33/782 kB Progress (4): 26/35 kB | 25/49 kB | 16/98 kB | 33/782 kB Progress (4): 26/35 kB | 25/49 kB | 16/98 kB | 49/782 kB Progress (4): 26/35 kB | 26/49 kB | 16/98 kB | 49/782 kB Progress (4): 27/35 kB | 26/49 kB | 16/98 kB | 49/782 kB Progress (4): 27/35 kB | 27/49 kB | 16/98 kB | 49/782 kB Progress (4): 29/35 kB | 27/49 kB | 16/98 kB | 49/782 kB Progress (4): 29/35 kB | 27/49 kB | 16/98 kB | 66/782 kB Progress (4): 30/35 kB | 27/49 kB | 16/98 kB | 66/782 kB Progress (4): 30/35 kB | 27/49 kB | 16/98 kB | 82/782 kB Progress (4): 30/35 kB | 29/49 kB | 16/98 kB | 82/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 82/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 98/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 115/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 131/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 147/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 164/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 180/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 197/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 213/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 229/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 246/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 262/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 278/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 295/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 311/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 328/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 344/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 360/782 kB Progress (4): 32/35 kB | 30/49 kB | 16/98 kB | 360/782 kB Progress (4): 32/35 kB | 30/49 kB | 16/98 kB | 377/782 kB Progress (4): 33/35 kB | 30/49 kB | 16/98 kB | 377/782 kB Progress (4): 34/35 kB | 30/49 kB | 16/98 kB | 377/782 kB Progress (4): 34/35 kB | 32/49 kB | 16/98 kB | 377/782 kB Progress (4): 35 kB | 32/49 kB | 16/98 kB | 377/782 kB Progress (4): 35 kB | 33/49 kB | 16/98 kB | 377/782 kB Progress (4): 35 kB | 33/49 kB | 16/98 kB | 393/782 kB Progress (4): 35 kB | 34/49 kB | 16/98 kB | 393/782 kB Progress (4): 35 kB | 36/49 kB | 16/98 kB | 393/782 kB Progress (4): 35 kB | 37/49 kB | 16/98 kB | 393/782 kB Progress (4): 35 kB | 37/49 kB | 16/98 kB | 410/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 606 kB/s) 2024-09-12T17:36:59.170 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:36:59.170 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 37/49 kB | 33/98 kB | 410/782 kB Progress (3): 38/49 kB | 33/98 kB | 410/782 kB Progress (3): 38/49 kB | 33/98 kB | 426/782 kB Progress (3): 40/49 kB | 33/98 kB | 426/782 kB Progress (3): 41/49 kB | 33/98 kB | 426/782 kB Progress (3): 43/49 kB | 33/98 kB | 426/782 kB Progress (3): 43/49 kB | 33/98 kB | 442/782 kB Progress (3): 43/49 kB | 33/98 kB | 459/782 kB Progress (3): 43/49 kB | 49/98 kB | 459/782 kB Progress (3): 43/49 kB | 49/98 kB | 475/782 kB Progress (3): 43/49 kB | 49/98 kB | 491/782 kB Progress (3): 44/49 kB | 49/98 kB | 491/782 kB Progress (3): 45/49 kB | 49/98 kB | 491/782 kB Progress (3): 47/49 kB | 49/98 kB | 491/782 kB Progress (3): 47/49 kB | 49/98 kB | 508/782 kB Progress (3): 48/49 kB | 49/98 kB | 508/782 kB Progress (3): 49 kB | 49/98 kB | 508/782 kB Progress (3): 49 kB | 49/98 kB | 524/782 kB Progress (3): 49 kB | 49/98 kB | 541/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 807 kB/s) 2024-09-12T17:36:59.170 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:36:59.170 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 49/98 kB | 557/782 kB Progress (3): 49/98 kB | 557/782 kB | 1.4/11 kB Progress (3): 49/98 kB | 557/782 kB | 2.8/11 kB Progress (3): 49/98 kB | 573/782 kB | 2.8/11 kB Progress (3): 49/98 kB | 573/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 590/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 590/782 kB | 5.5/11 kB Progress (3): 49/98 kB | 590/782 kB | 6.9/11 kB Progress (3): 49/98 kB | 590/782 kB | 8.3/11 kB Progress (3): 49/98 kB | 606/782 kB | 8.3/11 kB Progress (3): 49/98 kB | 606/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 623/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 623/782 kB | 11/11 kB Progress (3): 49/98 kB | 623/782 kB | 11 kB Progress (3): 49/98 kB | 639/782 kB | 11 kB Progress (3): 49/98 kB | 655/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 180 kB/s) 2024-09-12T17:36:59.170 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:36:59.173 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 49/98 kB | 672/782 kB Progress (2): 49/98 kB | 688/782 kB Progress (2): 49/98 kB | 704/782 kB Progress (2): 49/98 kB | 721/782 kB Progress (2): 49/98 kB | 737/782 kB Progress (2): 49/98 kB | 754/782 kB Progress (2): 49/98 kB | 770/782 kB Progress (2): 49/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T17:36:59.173 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:36:59.178 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 66/98 kB Progress (1): 82/98 kB Progress (1): 98 kB Progress (2): 98 kB | 1.4/205 kB Progress (2): 98 kB | 2.8/205 kB Progress (2): 98 kB | 4.1/205 kB Progress (2): 98 kB | 5.5/205 kB Progress (2): 98 kB | 6.9/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-12T17:36:59.178 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.3/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:36:59.184 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 16/205 kB | 30 kB Progress (3): 16/205 kB | 30 kB | 1.4/81 kB Progress (3): 16/205 kB | 30 kB | 2.8/81 kB Progress (3): 16/205 kB | 30 kB | 4.1/81 kB Progress (3): 16/205 kB | 30 kB | 5.5/81 kB Progress (3): 16/205 kB | 30 kB | 6.9/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 387 kB/s) 2024-09-12T17:36:59.185 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 16/205 kB | 8.3/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:36:59.194 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 16/205 kB | 9.7/81 kB Progress (2): 16/205 kB | 11/81 kB Progress (2): 16/205 kB | 12/81 kB Progress (2): 16/205 kB | 14/81 kB Progress (2): 16/205 kB | 15/81 kB Progress (2): 16/205 kB | 16/81 kB Progress (3): 16/205 kB | 16/81 kB | 16/798 kB Progress (3): 33/205 kB | 16/81 kB | 16/798 kB Progress (3): 33/205 kB | 16/81 kB | 33/798 kB Progress (3): 33/205 kB | 16/81 kB | 49/798 kB Progress (3): 33/205 kB | 16/81 kB | 62/798 kB Progress (3): 33/205 kB | 16/81 kB | 78/798 kB Progress (3): 49/205 kB | 16/81 kB | 78/798 kB Progress (3): 49/205 kB | 16/81 kB | 95/798 kB Progress (3): 49/205 kB | 16/81 kB | 111/798 kB Progress (3): 49/205 kB | 16/81 kB | 128/798 kB Progress (3): 49/205 kB | 16/81 kB | 144/798 kB Progress (3): 49/205 kB | 16/81 kB | 160/798 kB Progress (3): 49/205 kB | 16/81 kB | 177/798 kB Progress (3): 64/205 kB | 16/81 kB | 177/798 kB Progress (3): 64/205 kB | 16/81 kB | 193/798 kB Progress (3): 64/205 kB | 16/81 kB | 209/798 kB Progress (3): 64/205 kB | 16/81 kB | 226/798 kB Progress (3): 64/205 kB | 16/81 kB | 242/798 kB Progress (3): 80/205 kB | 16/81 kB | 242/798 kB Progress (3): 80/205 kB | 16/81 kB | 259/798 kB Progress (4): 80/205 kB | 16/81 kB | 259/798 kB | 13 kB Progress (4): 80/205 kB | 16/81 kB | 275/798 kB | 13 kB Progress (4): 80/205 kB | 16/81 kB | 291/798 kB | 13 kB Progress (4): 80/205 kB | 16/81 kB | 308/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 152 kB/s) 2024-09-12T17:36:59.194 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 97/205 kB | 16/81 kB | 308/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:36:59.200 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 97/205 kB | 16/81 kB | 324/798 kB Progress (3): 97/205 kB | 16/81 kB | 341/798 kB Progress (3): 97/205 kB | 16/81 kB | 357/798 kB Progress (3): 97/205 kB | 16/81 kB | 373/798 kB Progress (3): 113/205 kB | 16/81 kB | 373/798 kB Progress (3): 113/205 kB | 16/81 kB | 390/798 kB Progress (3): 113/205 kB | 16/81 kB | 406/798 kB Progress (3): 113/205 kB | 33/81 kB | 406/798 kB Progress (3): 113/205 kB | 33/81 kB | 422/798 kB Progress (3): 113/205 kB | 33/81 kB | 439/798 kB Progress (3): 113/205 kB | 33/81 kB | 455/798 kB Progress (3): 113/205 kB | 33/81 kB | 472/798 kB Progress (3): 113/205 kB | 49/81 kB | 472/798 kB Progress (3): 113/205 kB | 49/81 kB | 488/798 kB Progress (3): 113/205 kB | 49/81 kB | 504/798 kB Progress (3): 113/205 kB | 49/81 kB | 521/798 kB Progress (3): 113/205 kB | 49/81 kB | 537/798 kB Progress (3): 113/205 kB | 49/81 kB | 554/798 kB Progress (3): 113/205 kB | 49/81 kB | 570/798 kB Progress (4): 113/205 kB | 49/81 kB | 570/798 kB | 4.2/182 kB Progress (4): 113/205 kB | 49/81 kB | 586/798 kB | 4.2/182 kB Progress (4): 113/205 kB | 64/81 kB | 586/798 kB | 4.2/182 kB Progress (4): 113/205 kB | 64/81 kB | 603/798 kB | 4.2/182 kB Progress (4): 113/205 kB | 64/81 kB | 619/798 kB | 4.2/182 kB Progress (4): 113/205 kB | 64/81 kB | 635/798 kB | 4.2/182 kB Progress (4): 113/205 kB | 64/81 kB | 635/798 kB | 21/182 kB Progress (4): 113/205 kB | 64/81 kB | 652/798 kB | 21/182 kB Progress (4): 113/205 kB | 64/81 kB | 668/798 kB | 21/182 kB Progress (4): 113/205 kB | 64/81 kB | 685/798 kB | 21/182 kB Progress (4): 113/205 kB | 80/81 kB | 685/798 kB | 21/182 kB Progress (4): 113/205 kB | 80/81 kB | 701/798 kB | 21/182 kB Progress (4): 113/205 kB | 81 kB | 701/798 kB | 21/182 kB Progress (4): 113/205 kB | 81 kB | 717/798 kB | 21/182 kB Progress (4): 113/205 kB | 81 kB | 734/798 kB | 21/182 kB Progress (4): 113/205 kB | 81 kB | 734/798 kB | 37/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 864 kB/s) 2024-09-12T17:36:59.200 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:36:59.201 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 113/205 kB | 750/798 kB | 37/182 kB Progress (3): 129/205 kB | 750/798 kB | 37/182 kB Progress (3): 129/205 kB | 766/798 kB | 37/182 kB Progress (3): 129/205 kB | 783/798 kB | 37/182 kB Progress (3): 129/205 kB | 798 kB | 37/182 kB Progress (3): 146/205 kB | 798 kB | 37/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 8.4 MB/s) 2024-09-12T17:36:59.201 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:36:59.204 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 146/205 kB | 53/182 kB Progress (2): 162/205 kB | 53/182 kB Progress (2): 179/205 kB | 53/182 kB Progress (2): 195/205 kB | 53/182 kB Progress (2): 205 kB | 53/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-12T17:36:59.204 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:36:59.215 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 53/182 kB | 16/151 kB Progress (2): 70/182 kB | 16/151 kB Progress (2): 70/182 kB | 33/151 kB Progress (2): 70/182 kB | 49/151 kB Progress (2): 86/182 kB | 49/151 kB Progress (2): 86/182 kB | 62/151 kB Progress (2): 102/182 kB | 62/151 kB Progress (2): 119/182 kB | 62/151 kB Progress (2): 119/182 kB | 79/151 kB Progress (2): 135/182 kB | 79/151 kB Progress (2): 135/182 kB | 95/151 kB Progress (2): 152/182 kB | 95/151 kB Progress (3): 152/182 kB | 95/151 kB | 16/27 kB Progress (3): 168/182 kB | 95/151 kB | 16/27 kB Progress (3): 168/182 kB | 95/151 kB | 27 kB Progress (3): 182 kB | 95/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 253 kB/s) 2024-09-12T17:36:59.215 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:36:59.215 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 182 kB | 95/151 kB | 16/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-12T17:36:59.216 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:36:59.216 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 95/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 276 kB/s) 2024-09-12T17:36:59.216 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:36:59.222 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 95/151 kB | 16/385 kB Progress (2): 95/151 kB | 33/385 kB Progress (2): 95/151 kB | 49/385 kB Progress (2): 95/151 kB | 65/385 kB Progress (2): 95/151 kB | 82/385 kB Progress (2): 95/151 kB | 86/385 kB Progress (2): 111/151 kB | 86/385 kB Progress (2): 111/151 kB | 102/385 kB Progress (2): 111/151 kB | 118/385 kB Progress (2): 111/151 kB | 131/385 kB Progress (2): 111/151 kB | 147/385 kB Progress (2): 128/151 kB | 147/385 kB Progress (2): 128/151 kB | 164/385 kB Progress (2): 144/151 kB | 164/385 kB Progress (2): 151 kB | 164/385 kB Progress (2): 151 kB | 180/385 kB Progress (2): 151 kB | 196/385 kB Progress (2): 151 kB | 213/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-12T17:36:59.222 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:36:59.231 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (2): 262/385 kB | 13 kB Progress (3): 262/385 kB | 13 kB | 16/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 107 kB/s) 2024-09-12T17:36:59.231 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 278/385 kB | 16/75 kB Progress (2): 278/385 kB | 33/75 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:36:59.233 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 278/385 kB | 33/75 kB | 16/780 kB Progress (3): 295/385 kB | 33/75 kB | 16/780 kB Progress (3): 295/385 kB | 49/75 kB | 16/780 kB Progress (3): 295/385 kB | 49/75 kB | 32/780 kB Progress (3): 311/385 kB | 49/75 kB | 32/780 kB Progress (3): 311/385 kB | 66/75 kB | 32/780 kB Progress (3): 311/385 kB | 75 kB | 32/780 kB Progress (3): 327/385 kB | 75 kB | 32/780 kB Progress (3): 327/385 kB | 75 kB | 49/780 kB Progress (3): 344/385 kB | 75 kB | 49/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 601 kB/s) 2024-09-12T17:36:59.233 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:36:59.233 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 360/385 kB | 49/780 kB Progress (2): 360/385 kB | 65/780 kB Progress (2): 376/385 kB | 65/780 kB Progress (2): 385 kB | 65/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-12T17:36:59.233 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:36:59.251 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 81/780 kB Progress (1): 98/780 kB Progress (1): 114/780 kB Progress (2): 114/780 kB | 16/329 kB Progress (2): 114/780 kB | 33/329 kB Progress (2): 114/780 kB | 49/329 kB Progress (2): 114/780 kB | 66/329 kB Progress (2): 114/780 kB | 82/329 kB Progress (2): 114/780 kB | 98/329 kB Progress (2): 114/780 kB | 115/329 kB Progress (2): 114/780 kB | 131/329 kB Progress (2): 114/780 kB | 147/329 kB Progress (2): 114/780 kB | 164/329 kB Progress (2): 114/780 kB | 180/329 kB Progress (2): 114/780 kB | 197/329 kB Progress (2): 130/780 kB | 197/329 kB Progress (2): 130/780 kB | 213/329 kB Progress (2): 147/780 kB | 213/329 kB Progress (2): 147/780 kB | 229/329 kB Progress (2): 163/780 kB | 229/329 kB Progress (2): 163/780 kB | 246/329 kB Progress (2): 180/780 kB | 246/329 kB Progress (2): 196/780 kB | 246/329 kB Progress (2): 212/780 kB | 246/329 kB Progress (2): 229/780 kB | 246/329 kB Progress (2): 245/780 kB | 246/329 kB Progress (2): 262/780 kB | 246/329 kB Progress (3): 262/780 kB | 246/329 kB | 16/501 kB Progress (4): 262/780 kB | 246/329 kB | 16/501 kB | 16/354 kB Progress (4): 278/780 kB | 246/329 kB | 16/501 kB | 16/354 kB Progress (4): 278/780 kB | 246/329 kB | 33/501 kB | 16/354 kB Progress (4): 278/780 kB | 246/329 kB | 33/501 kB | 33/354 kB Progress (4): 294/780 kB | 246/329 kB | 33/501 kB | 33/354 kB Progress (5): 294/780 kB | 246/329 kB | 33/501 kB | 33/354 kB | 16/41 kB Progress (5): 294/780 kB | 246/329 kB | 49/501 kB | 33/354 kB | 16/41 kB Progress (5): 294/780 kB | 246/329 kB | 49/501 kB | 49/354 kB | 16/41 kB Progress (5): 294/780 kB | 246/329 kB | 66/501 kB | 49/354 kB | 16/41 kB Progress (5): 294/780 kB | 246/329 kB | 66/501 kB | 49/354 kB | 33/41 kB Progress (5): 311/780 kB | 246/329 kB | 66/501 kB | 49/354 kB | 33/41 kB Progress (5): 311/780 kB | 246/329 kB | 82/501 kB | 49/354 kB | 33/41 kB Progress (5): 311/780 kB | 246/329 kB | 82/501 kB | 49/354 kB | 41 kB Progress (5): 311/780 kB | 246/329 kB | 82/501 kB | 66/354 kB | 41 kB Progress (5): 311/780 kB | 246/329 kB | 98/501 kB | 66/354 kB | 41 kB Progress (5): 327/780 kB | 246/329 kB | 98/501 kB | 66/354 kB | 41 kB Progress (5): 327/780 kB | 246/329 kB | 98/501 kB | 82/354 kB | 41 kB Progress (5): 327/780 kB | 246/329 kB | 115/501 kB | 82/354 kB | 41 kB Progress (5): 343/780 kB | 246/329 kB | 115/501 kB | 82/354 kB | 41 kB Progress (5): 343/780 kB | 256/329 kB | 115/501 kB | 82/354 kB | 41 kB Progress (5): 343/780 kB | 256/329 kB | 115/501 kB | 98/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 294 kB/s) 2024-09-12T17:36:59.252 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (4): 343/780 kB | 256/329 kB | 131/501 kB | 98/354 kB Progress (4): 360/780 kB | 256/329 kB | 131/501 kB | 98/354 kB Progress (4): 360/780 kB | 272/329 kB | 131/501 kB | 98/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:36:59.252 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (4): 360/780 kB | 272/329 kB | 131/501 kB | 115/354 kB Progress (4): 360/780 kB | 272/329 kB | 147/501 kB | 115/354 kB Progress (4): 360/780 kB | 289/329 kB | 147/501 kB | 115/354 kB Progress (4): 360/780 kB | 289/329 kB | 164/501 kB | 115/354 kB Progress (4): 360/780 kB | 289/329 kB | 164/501 kB | 131/354 kB Progress (4): 360/780 kB | 305/329 kB | 164/501 kB | 131/354 kB Progress (4): 360/780 kB | 305/329 kB | 180/501 kB | 131/354 kB Progress (4): 360/780 kB | 305/329 kB | 180/501 kB | 147/354 kB Progress (4): 360/780 kB | 321/329 kB | 180/501 kB | 147/354 kB Progress (4): 360/780 kB | 321/329 kB | 197/501 kB | 147/354 kB Progress (4): 360/780 kB | 321/329 kB | 197/501 kB | 164/354 kB Progress (4): 360/780 kB | 329 kB | 197/501 kB | 164/354 kB Progress (4): 360/780 kB | 329 kB | 213/501 kB | 164/354 kB Progress (4): 360/780 kB | 329 kB | 213/501 kB | 180/354 kB Progress (4): 360/780 kB | 329 kB | 213/501 kB | 197/354 kB Progress (4): 360/780 kB | 329 kB | 229/501 kB | 197/354 kB Progress (4): 360/780 kB | 329 kB | 229/501 kB | 213/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.3 MB/s) 2024-09-12T17:36:59.252 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 360/780 kB | 246/501 kB | 213/354 kB Progress (3): 360/780 kB | 246/501 kB | 229/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:36:59.254 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 360/780 kB | 246/501 kB | 246/354 kB Progress (3): 360/780 kB | 246/501 kB | 262/354 kB Progress (3): 360/780 kB | 246/501 kB | 279/354 kB Progress (3): 360/780 kB | 246/501 kB | 295/354 kB Progress (3): 360/780 kB | 246/501 kB | 311/354 kB Progress (3): 360/780 kB | 246/501 kB | 328/354 kB Progress (3): 360/780 kB | 246/501 kB | 344/354 kB Progress (3): 376/780 kB | 246/501 kB | 344/354 kB Progress (3): 376/780 kB | 246/501 kB | 354 kB Progress (3): 393/780 kB | 246/501 kB | 354 kB Progress (3): 402/780 kB | 246/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.4 MB/s) 2024-09-12T17:36:59.254 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:36:59.261 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 418/780 kB | 246/501 kB Progress (2): 435/780 kB | 246/501 kB Progress (2): 451/780 kB | 246/501 kB Progress (2): 468/780 kB | 246/501 kB Progress (2): 484/780 kB | 246/501 kB Progress (2): 500/780 kB | 246/501 kB Progress (2): 517/780 kB | 246/501 kB Progress (2): 533/780 kB | 246/501 kB Progress (2): 549/780 kB | 246/501 kB Progress (2): 566/780 kB | 246/501 kB Progress (2): 582/780 kB | 246/501 kB Progress (2): 599/780 kB | 246/501 kB Progress (2): 599/780 kB | 256/501 kB Progress (2): 615/780 kB | 256/501 kB Progress (2): 615/780 kB | 272/501 kB Progress (2): 631/780 kB | 272/501 kB Progress (2): 631/780 kB | 289/501 kB Progress (2): 648/780 kB | 289/501 kB Progress (2): 648/780 kB | 305/501 kB Progress (2): 664/780 kB | 305/501 kB Progress (2): 681/780 kB | 305/501 kB Progress (2): 681/780 kB | 321/501 kB Progress (2): 697/780 kB | 321/501 kB Progress (2): 697/780 kB | 338/501 kB Progress (2): 713/780 kB | 338/501 kB Progress (2): 713/780 kB | 354/501 kB Progress (2): 730/780 kB | 354/501 kB Progress (2): 730/780 kB | 370/501 kB Progress (2): 746/780 kB | 370/501 kB Progress (2): 746/780 kB | 387/501 kB Progress (2): 762/780 kB | 387/501 kB Progress (2): 762/780 kB | 403/501 kB Progress (2): 779/780 kB | 403/501 kB Progress (2): 780 kB | 403/501 kB Progress (2): 780 kB | 420/501 kB Progress (2): 780 kB | 436/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.1 MB/s) 2024-09-12T17:36:59.261 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 452/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:36:59.261 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 469/501 kB Progress (1): 485/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.2 MB/s) 2024-09-12T17:36:59.261 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:36:59.263 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 41 kB/s) 2024-09-12T17:36:59.263 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:36:59.285 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 62/586 kB Progress (1): 78/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (2): 144/586 kB | 16/211 kB Progress (2): 160/586 kB | 16/211 kB Progress (2): 160/586 kB | 33/211 kB Progress (2): 176/586 kB | 33/211 kB Progress (2): 176/586 kB | 49/211 kB Progress (2): 193/586 kB | 49/211 kB Progress (2): 193/586 kB | 65/211 kB Progress (2): 209/586 kB | 65/211 kB Progress (2): 209/586 kB | 81/211 kB Progress (2): 226/586 kB | 81/211 kB Progress (2): 226/586 kB | 98/211 kB Progress (2): 242/586 kB | 98/211 kB Progress (2): 258/586 kB | 98/211 kB Progress (2): 258/586 kB | 114/211 kB Progress (2): 275/586 kB | 114/211 kB Progress (2): 275/586 kB | 131/211 kB Progress (2): 291/586 kB | 131/211 kB Progress (2): 308/586 kB | 131/211 kB Progress (2): 308/586 kB | 147/211 kB Progress (2): 324/586 kB | 147/211 kB Progress (2): 324/586 kB | 163/211 kB Progress (2): 340/586 kB | 163/211 kB Progress (2): 340/586 kB | 180/211 kB Progress (3): 340/586 kB | 180/211 kB | 6.8 kB Progress (3): 357/586 kB | 180/211 kB | 6.8 kB Progress (4): 357/586 kB | 180/211 kB | 6.8 kB | 14 kB Progress (5): 357/586 kB | 180/211 kB | 6.8 kB | 14 kB | 16/106 kB Progress (5): 357/586 kB | 196/211 kB | 6.8 kB | 14 kB | 16/106 kB Progress (5): 373/586 kB | 196/211 kB | 6.8 kB | 14 kB | 16/106 kB Progress (5): 373/586 kB | 196/211 kB | 6.8 kB | 14 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 81 kB/s) 2024-09-12T17:36:59.285 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 39 kB/s) 2024-09-12T17:36:59.285 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 389/586 kB | 196/211 kB | 33/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:36:59.286 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 389/586 kB | 211 kB | 33/106 kB Progress (3): 389/586 kB | 211 kB | 49/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:36:59.286 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T17:36:59.286 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 406/586 kB | 49/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:36:59.288 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 406/586 kB | 66/106 kB Progress (2): 422/586 kB | 66/106 kB Progress (2): 422/586 kB | 82/106 kB Progress (2): 422/586 kB | 98/106 kB Progress (2): 439/586 kB | 98/106 kB Progress (2): 439/586 kB | 106 kB Progress (2): 455/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 590 kB/s) 2024-09-12T17:36:59.288 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:36:59.291 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 471/586 kB Progress (1): 488/586 kB Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-12T17:36:59.291 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:36:59.303 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 63/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (2): 95/245 kB | 16/205 kB Progress (3): 95/245 kB | 16/205 kB | 15 kB Progress (3): 112/245 kB | 16/205 kB | 15 kB Progress (3): 112/245 kB | 33/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 79 kB/s) 2024-09-12T17:36:59.303 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 128/245 kB | 33/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:36:59.303 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 128/245 kB | 49/205 kB Progress (2): 145/245 kB | 49/205 kB Progress (3): 145/245 kB | 49/205 kB | 16/16 kB Progress (3): 145/245 kB | 65/205 kB | 16/16 kB Progress (3): 161/245 kB | 65/205 kB | 16/16 kB Progress (3): 161/245 kB | 65/205 kB | 16 kB Progress (3): 161/245 kB | 81/205 kB | 16 kB Progress (3): 177/245 kB | 81/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 84 kB/s) 2024-09-12T17:36:59.303 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:36:59.305 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 177/245 kB | 98/205 kB Progress (2): 194/245 kB | 98/205 kB Progress (2): 194/245 kB | 114/205 kB Progress (2): 210/245 kB | 114/205 kB Progress (2): 210/245 kB | 130/205 kB Progress (2): 226/245 kB | 130/205 kB Progress (2): 226/245 kB | 147/205 kB Progress (2): 243/245 kB | 147/205 kB Progress (2): 245 kB | 147/205 kB Progress (2): 245 kB | 163/205 kB Progress (2): 245 kB | 180/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:36:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 180/205 kB | 6.4 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:36:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 196/205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T17:36:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:36:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T17:36:59.317 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 109 kB/s) 2024-09-12T17:36:59.317 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 115 kB/s) 2024-09-12T17:36:59.320 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/184 kB Progress (2): 16/184 kB | 16/17 kB Progress (2): 16/184 kB | 17 kB Progress (2): 33/184 kB | 17 kB Progress (2): 49/184 kB | 17 kB Progress (2): 65/184 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 82 kB/s) 2024-09-12T17:36:59.322 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 859 kB/s) 2024-09-12T17:36:59.349 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:36:59.349 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:36:59.355 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:36:59.369 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 416 kB/s) 2024-09-12T17:36:59.373 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:36:59.385 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-12T17:36:59.387 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:36:59.401 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-12T17:36:59.405 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:36:59.419 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-12T17:36:59.424 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:36:59.441 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-12T17:36:59.441 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:36:59.460 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T17:36:59.497 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:36:59.497 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:36:59.500 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:36:59.514 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:36:59.515 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:36:59.529 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T17:36:59.532 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:36:59.546 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-12T17:36:59.548 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:36:59.562 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-12T17:36:59.564 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:36:59.578 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 464 kB/s) 2024-09-12T17:36:59.580 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:36:59.593 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 248 kB/s) 2024-09-12T17:36:59.596 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:36:59.610 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-12T17:36:59.612 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:36:59.626 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T17:36:59.627 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:36:59.641 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:36:59.643 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:36:59.657 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T17:36:59.658 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:36:59.672 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 643 kB/s) 2024-09-12T17:36:59.673 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:36:59.687 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 643 kB/s) 2024-09-12T17:36:59.689 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:36:59.703 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T17:36:59.706 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:36:59.720 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T17:36:59.724 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:36:59.737 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T17:36:59.739 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:36:59.754 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T17:36:59.758 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:36:59.771 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T17:36:59.777 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:36:59.790 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T17:36:59.790 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:36:59.790 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:36:59.791 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:36:59.791 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:36:59.791 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:36:59.806 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (3): 2.5 kB | 16/55 kB | 16/41 kB Progress (4): 2.5 kB | 16/55 kB | 16/41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T17:36:59.806 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 16/55 kB | 33/41 kB | 8.5 kB Progress (3): 32/55 kB | 33/41 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:36:59.806 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 652 kB/s) 2024-09-12T17:36:59.806 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 32/55 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:36:59.806 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 32/55 kB | 41 kB | 16/269 kB Progress (3): 49/55 kB | 41 kB | 16/269 kB Progress (3): 55 kB | 41 kB | 16/269 kB Progress (3): 55 kB | 41 kB | 33/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T17:36:59.806 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-12T17:36:59.810 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 13 MB/s) 2024-09-12T17:36:59.822 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 65/327 kB Progress (1): 81/327 kB Progress (1): 98/327 kB Progress (1): 114/327 kB Progress (1): 130/327 kB Progress (1): 147/327 kB Progress (2): 147/327 kB | 16/587 kB Progress (2): 163/327 kB | 16/587 kB Progress (2): 163/327 kB | 33/587 kB Progress (2): 179/327 kB | 33/587 kB Progress (2): 179/327 kB | 49/587 kB Progress (2): 196/327 kB | 49/587 kB Progress (2): 196/327 kB | 66/587 kB Progress (2): 212/327 kB | 66/587 kB Progress (2): 212/327 kB | 82/587 kB Progress (2): 229/327 kB | 82/587 kB Progress (2): 245/327 kB | 82/587 kB Progress (2): 245/327 kB | 98/587 kB Progress (2): 261/327 kB | 98/587 kB Progress (2): 261/327 kB | 115/587 kB Progress (2): 278/327 kB | 115/587 kB Progress (2): 278/327 kB | 131/587 kB Progress (2): 294/327 kB | 131/587 kB Progress (2): 294/327 kB | 147/587 kB Progress (2): 311/327 kB | 147/587 kB Progress (2): 311/327 kB | 164/587 kB Progress (2): 327/327 kB | 164/587 kB Progress (2): 327 kB | 164/587 kB Progress (2): 327 kB | 180/587 kB Progress (2): 327 kB | 197/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 11 MB/s) 2024-09-12T17:36:59.827 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 213/587 kB Progress (1): 229/587 kB Progress (1): 246/587 kB Progress (1): 256/587 kB Progress (1): 272/587 kB Progress (1): 289/587 kB Progress (1): 305/587 kB Progress (1): 321/587 kB Progress (1): 338/587 kB Progress (1): 354/587 kB Progress (1): 370/587 kB Progress (1): 387/587 kB Progress (1): 403/587 kB Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 16 MB/s) 2024-09-12T17:36:59.859 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:36:59.859 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:36:59.859 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:36:59.863 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:36:59.877 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T17:36:59.879 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:36:59.892 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T17:36:59.894 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:36:59.909 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T17:36:59.912 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:36:59.925 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T17:36:59.929 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:36:59.944 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T17:36:59.946 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:36:59.959 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T17:36:59.961 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:36:59.975 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:36:59.981 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:36:59.993 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-12T17:36:59.995 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:37:00.009 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-12T17:37:00.012 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:37:00.027 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T17:37:00.028 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:37:00.042 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-12T17:37:00.044 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:37:00.058 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T17:37:00.061 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:37:00.075 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-12T17:37:00.077 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:37:00.092 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T17:37:00.094 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:37:00.110 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-09-12T17:37:00.112 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:37:00.127 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T17:37:00.130 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-12T17:37:00.146 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:37:00.162 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-09-12T17:37:00.166 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:37:00.179 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T17:37:00.181 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:37:00.195 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:37:00.197 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:37:00.211 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T17:37:00.214 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:37:00.228 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T17:37:00.229 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:37:00.244 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-12T17:37:00.250 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:37:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T17:37:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:37:00.265 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:37:00.265 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:37:00.265 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:37:00.265 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:37:00.280 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Progress (3): 4.2 kB | 16/122 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T17:37:00.280 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:37:00.280 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 33/122 kB | 16/55 kB Progress (2): 33/122 kB | 33/55 kB Progress (2): 49/122 kB | 33/55 kB Progress (2): 66/122 kB | 33/55 kB Progress (2): 66/122 kB | 49/55 kB Progress (3): 66/122 kB | 49/55 kB | 16/27 kB Progress (3): 82/122 kB | 49/55 kB | 16/27 kB Progress (3): 82/122 kB | 55 kB | 16/27 kB Progress (3): 82/122 kB | 55 kB | 27 kB Progress (3): 98/122 kB | 55 kB | 27 kB Progress (4): 98/122 kB | 55 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-12T17:37:00.281 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:37:00.281 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-12T17:37:00.281 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 113/122 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:37:00.281 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 113/122 kB | 32/334 kB Progress (2): 122 kB | 32/334 kB Progress (2): 122 kB | 49/334 kB Progress (2): 122 kB | 65/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-12T17:37:00.284 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 81/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T17:37:00.294 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 4.7 kB Progress (2): 33/267 kB | 4.7 kB Progress (3): 33/267 kB | 4.7 kB | 16/23 kB Progress (3): 49/267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-12T17:37:00.294 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 49/267 kB | 23 kB Progress (2): 66/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-12T17:37:00.296 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.6 MB/s) 2024-09-12T17:37:00.358 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:37:00.359 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:37:00.997 INFO:tasks.workunit.client.0.smithi063.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:37:00.998 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:00.998 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:37:01.000 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:37:01.000 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:01.000 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:37:01.005 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:37:01.005 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:37:01.165 INFO:tasks.workunit.client.0.smithi063.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:37:01.165 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:01.165 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:37:01.171 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:37:01.187 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-09-12T17:37:01.192 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:37:01.208 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-12T17:37:01.213 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:37:01.229 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-12T17:37:01.234 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:37:01.251 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 239 kB/s) 2024-09-12T17:37:01.255 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:37:01.270 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T17:37:01.274 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:37:01.289 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T17:37:01.293 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:37:01.308 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T17:37:01.313 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:37:01.327 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-12T17:37:01.329 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:37:01.342 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T17:37:01.345 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:37:01.359 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-12T17:37:01.363 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:37:01.378 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-12T17:37:01.382 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:37:01.396 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-12T17:37:01.398 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:37:01.412 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-12T17:37:01.417 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:37:01.428 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-12T17:37:01.430 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 152 kB/s) 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-12T17:37:01.566 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 118 kB/s) 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:37:01.662 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T17:37:01.664 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:37:01.678 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T17:37:01.679 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:37:01.693 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T17:37:01.696 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:37:01.710 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T17:37:01.711 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:37:01.725 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T17:37:01.726 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:37:01.739 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T17:37:01.742 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:37:01.760 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 109 kB/s) 2024-09-12T17:37:01.762 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:37:01.777 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-12T17:37:01.780 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:37:01.814 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:37:01.828 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-12T17:37:01.830 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:37:01.844 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-12T17:37:01.846 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:37:01.860 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T17:37:01.862 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:37:01.877 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 418 kB/s) 2024-09-12T17:37:01.879 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:37:01.893 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-12T17:37:01.896 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:37:01.910 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T17:37:01.912 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:37:01.955 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 344 kB/s) 2024-09-12T17:37:01.957 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:37:01.971 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 58 kB/s) 2024-09-12T17:37:01.972 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:37:01.989 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-09-12T17:37:01.991 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:37:02.005 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-12T17:37:02.007 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:37:02.021 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T17:37:02.023 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:37:02.037 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T17:37:02.040 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:37:02.053 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-12T17:37:02.056 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:37:02.069 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T17:37:02.072 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:37:02.086 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-12T17:37:02.088 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:37:02.102 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-12T17:37:02.103 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:37:02.117 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.4 MB/s) 2024-09-12T17:37:02.119 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:37:02.133 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T17:37:02.134 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:37:02.148 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-12T17:37:02.150 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-12T17:37:02.165 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:37:02.194 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 562 kB/s) 2024-09-12T17:37:02.197 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:37:02.211 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-12T17:37:02.213 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:37:02.227 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.6 MB/s) 2024-09-12T17:37:02.230 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:37:02.243 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T17:37:02.246 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:37:02.260 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T17:37:02.262 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:37:02.275 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 329 kB/s) 2024-09-12T17:37:02.277 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:37:02.289 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-12T17:37:02.291 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:37:02.304 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-12T17:37:02.307 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:37:02.320 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-12T17:37:02.325 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:37:02.344 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-12T17:37:02.344 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:37:02.344 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:37:02.344 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:37:02.345 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:37:02.345 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:37:02.360 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 64/171 kB Progress (1): 81/171 kB Progress (2): 81/171 kB | 16/26 kB Progress (2): 97/171 kB | 16/26 kB Progress (3): 97/171 kB | 16/26 kB | 14 kB Progress (3): 97/171 kB | 26 kB | 14 kB Progress (4): 97/171 kB | 26 kB | 14 kB | 8.2 kB Progress (4): 113/171 kB | 26 kB | 14 kB | 8.2 kB Progress (4): 130/171 kB | 26 kB | 14 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 545 kB/s) 2024-09-12T17:37:02.360 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T17:37:02.360 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:37:02.360 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:37:02.361 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 146/171 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-12T17:37:02.361 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:37:02.362 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 146/171 kB | 15/118 kB Progress (2): 163/171 kB | 15/118 kB Progress (2): 171 kB | 15/118 kB Progress (2): 171 kB | 31/118 kB Progress (2): 171 kB | 48/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 10 MB/s) 2024-09-12T17:37:02.362 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:37:02.362 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 64/118 kB Progress (1): 80/118 kB Progress (1): 97/118 kB Progress (1): 113/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-12T17:37:02.363 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:37:02.378 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/61 kB Progress (2): 33/146 kB | 16/61 kB Progress (2): 33/146 kB | 33/61 kB Progress (2): 49/146 kB | 33/61 kB Progress (2): 49/146 kB | 49/61 kB Progress (2): 66/146 kB | 49/61 kB Progress (2): 66/146 kB | 61 kB Progress (2): 82/146 kB | 61 kB Progress (2): 98/146 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-12T17:37:02.378 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:37:02.378 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 98/146 kB | 16/501 kB Progress (2): 115/146 kB | 16/501 kB Progress (2): 115/146 kB | 32/501 kB Progress (2): 131/146 kB | 32/501 kB Progress (2): 131/146 kB | 49/501 kB Progress (2): 146 kB | 49/501 kB Progress (2): 146 kB | 65/501 kB Progress (2): 146 kB | 81/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-12T17:37:02.378 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:37:02.378 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 98/501 kB Progress (2): 98/501 kB | 16/136 kB Progress (2): 98/501 kB | 32/136 kB Progress (2): 114/501 kB | 32/136 kB Progress (3): 114/501 kB | 32/136 kB | 16/58 kB Progress (3): 114/501 kB | 49/136 kB | 16/58 kB Progress (3): 130/501 kB | 49/136 kB | 16/58 kB Progress (3): 130/501 kB | 65/136 kB | 16/58 kB Progress (3): 130/501 kB | 65/136 kB | 33/58 kB Progress (3): 130/501 kB | 81/136 kB | 33/58 kB Progress (3): 147/501 kB | 81/136 kB | 33/58 kB Progress (3): 147/501 kB | 81/136 kB | 49/58 kB Progress (3): 147/501 kB | 98/136 kB | 49/58 kB Progress (3): 163/501 kB | 98/136 kB | 49/58 kB Progress (3): 163/501 kB | 98/136 kB | 58 kB Progress (3): 163/501 kB | 114/136 kB | 58 kB Progress (3): 163/501 kB | 130/136 kB | 58 kB Progress (3): 180/501 kB | 130/136 kB | 58 kB Progress (3): 180/501 kB | 136 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-12T17:37:02.378 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 196/501 kB | 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-12T17:37:02.385 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 475/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-12T17:37:02.390 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Progress (2): 124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-12T17:37:02.428 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 29 MB/s) 2024-09-12T17:37:02.494 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:02.494 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:37:02.497 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:37:02.511 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T17:37:02.513 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:37:02.526 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 376 kB/s) 2024-09-12T17:37:02.527 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:37:02.541 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-12T17:37:02.543 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:37:02.557 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.6 MB/s) 2024-09-12T17:37:02.560 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:37:02.573 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 399 kB/s) 2024-09-12T17:37:02.575 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:37:02.589 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:37:02.591 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:37:02.610 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 301 kB/s) 2024-09-12T17:37:02.613 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:37:02.627 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:37:02.629 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:37:02.643 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:37:02.649 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:37:02.660 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:37:02.662 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:37:02.676 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T17:37:02.678 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:37:02.692 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:37:02.694 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:37:02.708 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-12T17:37:02.713 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:37:02.727 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-12T17:37:02.727 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:37:02.727 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:37:02.728 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:37:02.728 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:37:02.728 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:37:02.744 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/58 kB Progress (3): 16/26 kB | 16/58 kB | 16/79 kB Progress (3): 26 kB | 16/58 kB | 16/79 kB Progress (4): 26 kB | 16/58 kB | 16/79 kB | 16/211 kB Progress (4): 26 kB | 33/58 kB | 16/79 kB | 16/211 kB Progress (4): 26 kB | 33/58 kB | 33/79 kB | 16/211 kB Progress (4): 26 kB | 33/58 kB | 33/79 kB | 32/211 kB Progress (4): 26 kB | 49/58 kB | 33/79 kB | 32/211 kB Progress (4): 26 kB | 49/58 kB | 49/79 kB | 32/211 kB Progress (4): 26 kB | 49/58 kB | 49/79 kB | 49/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-12T17:37:02.744 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 58 kB | 49/79 kB | 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:37:02.744 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 58 kB | 66/79 kB | 49/211 kB Progress (3): 58 kB | 66/79 kB | 65/211 kB Progress (3): 58 kB | 79 kB | 65/211 kB Progress (4): 58 kB | 79 kB | 65/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T17:37:02.745 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 79 kB | 81/211 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:37:02.745 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-12T17:37:02.747 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 81/211 kB | 0/1.0 MB Progress (2): 98/211 kB | 0/1.0 MB Progress (2): 98/211 kB | 0/1.0 MB Progress (2): 114/211 kB | 0/1.0 MB Progress (2): 114/211 kB | 0.1/1.0 MB Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 163/211 kB | 0.1/1.0 MB Progress (2): 163/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 196/211 kB | 0.1/1.0 MB Progress (2): 196/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T17:37:02.761 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 32/116 kB Progress (2): 0.9/1.0 MB | 32/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0/1.0 MB | 65/116 kB Progress (2): 1.0/1.0 MB | 65/116 kB Progress (3): 1.0/1.0 MB | 65/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 81/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 81/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 98/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 114/116 kB | 33/267 kB Progress (3): 1.0 MB | 114/116 kB | 33/267 kB Progress (3): 1.0 MB | 116 kB | 33/267 kB Progress (3): 1.0 MB | 116 kB | 49/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T17:37:02.761 INFO:tasks.workunit.client.0.smithi063.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 32 MB/s) 2024-09-12T17:37:02.764 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T17:37:02.915 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:37:02.938 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:37:02.938 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:37:02.938 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:37:02.939 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Total time: 5.836 s 2024-09-12T17:37:02.939 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Finished at: 2024-09-12T17:37:02Z 2024-09-12T17:37:02.939 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:37:02.961 INFO:tasks.workunit.client.0.smithi063.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:37:02.970 INFO:tasks.workunit.client.0.smithi063.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:37:04.012 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Scanning for projects... 2024-09-12T17:37:04.105 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:04.106 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:37:04.106 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:37:04.106 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] from pom.xml 2024-09-12T17:37:04.106 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:37:04.447 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:04.447 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:37:04.551 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:37:04.551 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:04.551 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:37:04.641 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:37:04.641 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:04.642 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:37:04.644 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:37:04.644 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:04.644 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:37:04.651 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:37:04.651 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:04.652 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:37:04.890 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:37:05.104 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:37:05.302 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T17:37:05.314 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:37:05.333 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-12T17:37:05.340 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:37:05.358 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T17:37:05.364 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:37:05.382 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T17:37:05.386 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:37:05.404 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 178 kB/s) 2024-09-12T17:37:05.407 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:37:05.424 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-12T17:37:05.427 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:37:05.444 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T17:37:05.451 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:37:05.475 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T17:37:05.477 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:37:05.477 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:37:05.477 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:37:05.477 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:37:05.478 INFO:tasks.workunit.client.0.smithi063.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:37:05.513 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 111/169 kB Progress (1): 127/169 kB Progress (1): 143/169 kB Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.6 MB/s) 2024-09-12T17:37:05.531 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/103 kB Progress (2): 2.8/7.7 kB | 1.4/103 kB Progress (3): 2.8/7.7 kB | 1.4/103 kB | 1.4/189 kB Progress (3): 4.1/7.7 kB | 1.4/103 kB | 1.4/189 kB Progress (4): 4.1/7.7 kB | 1.4/103 kB | 1.4/189 kB | 1.4/18 kB Progress (4): 4.1/7.7 kB | 2.8/103 kB | 1.4/189 kB | 1.4/18 kB Progress (4): 4.1/7.7 kB | 2.8/103 kB | 1.4/189 kB | 2.8/18 kB Progress (4): 5.5/7.7 kB | 2.8/103 kB | 1.4/189 kB | 2.8/18 kB Progress (4): 5.5/7.7 kB | 2.8/103 kB | 2.8/189 kB | 2.8/18 kB Progress (4): 6.9/7.7 kB | 2.8/103 kB | 2.8/189 kB | 2.8/18 kB Progress (4): 6.9/7.7 kB | 2.8/103 kB | 2.8/189 kB | 4.1/18 kB Progress (4): 6.9/7.7 kB | 4.1/103 kB | 2.8/189 kB | 4.1/18 kB Progress (4): 6.9/7.7 kB | 4.1/103 kB | 2.8/189 kB | 5.5/18 kB Progress (4): 7.7 kB | 4.1/103 kB | 2.8/189 kB | 5.5/18 kB Progress (4): 7.7 kB | 4.1/103 kB | 4.1/189 kB | 5.5/18 kB Progress (4): 7.7 kB | 4.1/103 kB | 4.1/189 kB | 6.9/18 kB Progress (4): 7.7 kB | 5.5/103 kB | 4.1/189 kB | 6.9/18 kB Progress (4): 7.7 kB | 5.5/103 kB | 4.1/189 kB | 8.3/18 kB Progress (4): 7.7 kB | 5.5/103 kB | 5.5/189 kB | 8.3/18 kB Progress (4): 7.7 kB | 5.5/103 kB | 5.5/189 kB | 9.7/18 kB Progress (4): 7.7 kB | 6.9/103 kB | 5.5/189 kB | 9.7/18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 142 kB/s) 2024-09-12T17:37:05.535 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (3): 8.3/103 kB | 5.5/189 kB | 9.7/18 kB Progress (3): 8.3/103 kB | 5.5/189 kB | 11/18 kB Progress (3): 8.3/103 kB | 6.9/189 kB | 11/18 kB Progress (3): 8.3/103 kB | 6.9/189 kB | 12/18 kB Progress (3): 9.7/103 kB | 6.9/189 kB | 12/18 kB Progress (3): 9.7/103 kB | 6.9/189 kB | 14/18 kB Progress (3): 9.7/103 kB | 8.3/189 kB | 14/18 kB Progress (3): 9.7/103 kB | 8.3/189 kB | 15/18 kB Progress (3): 11/103 kB | 8.3/189 kB | 15/18 kB Progress (3): 11/103 kB | 8.3/189 kB | 17/18 kB Progress (3): 11/103 kB | 9.7/189 kB | 17/18 kB Progress (3): 11/103 kB | 9.7/189 kB | 18 kB Progress (3): 12/103 kB | 9.7/189 kB | 18 kB Progress (3): 12/103 kB | 11/189 kB | 18 kB Progress (3): 14/103 kB | 11/189 kB | 18 kB Progress (3): 14/103 kB | 12/189 kB | 18 kB Progress (3): 15/103 kB | 12/189 kB | 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 293 kB/s) 2024-09-12T17:37:05.552 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (2): 16/103 kB | 12/189 kB Progress (2): 16/103 kB | 14/189 kB Progress (2): 18/103 kB | 14/189 kB Progress (2): 18/103 kB | 15/189 kB Progress (2): 19/103 kB | 15/189 kB Progress (2): 19/103 kB | 16/189 kB Progress (2): 21/103 kB | 16/189 kB Progress (2): 21/103 kB | 18/189 kB Progress (2): 22/103 kB | 18/189 kB Progress (2): 22/103 kB | 19/189 kB Progress (2): 23/103 kB | 19/189 kB Progress (2): 23/103 kB | 21/189 kB Progress (2): 25/103 kB | 21/189 kB Progress (2): 25/103 kB | 22/189 kB Progress (2): 26/103 kB | 22/189 kB Progress (2): 26/103 kB | 23/189 kB Progress (2): 27/103 kB | 23/189 kB Progress (2): 27/103 kB | 25/189 kB Progress (2): 29/103 kB | 25/189 kB Progress (2): 29/103 kB | 26/189 kB Progress (2): 30/103 kB | 26/189 kB Progress (2): 30/103 kB | 27/189 kB Progress (2): 32/103 kB | 27/189 kB Progress (2): 32/103 kB | 29/189 kB Progress (2): 33/103 kB | 29/189 kB Progress (2): 33/103 kB | 30/189 kB Progress (2): 34/103 kB | 30/189 kB Progress (2): 34/103 kB | 32/189 kB Progress (2): 36/103 kB | 32/189 kB Progress (2): 36/103 kB | 33/189 kB Progress (2): 37/103 kB | 33/189 kB Progress (2): 37/103 kB | 34/189 kB Progress (2): 38/103 kB | 34/189 kB Progress (2): 38/103 kB | 36/189 kB Progress (2): 40/103 kB | 36/189 kB Progress (2): 40/103 kB | 37/189 kB Progress (2): 41/103 kB | 37/189 kB Progress (2): 41/103 kB | 38/189 kB Progress (2): 43/103 kB | 38/189 kB Progress (2): 43/103 kB | 40/189 kB Progress (2): 44/103 kB | 40/189 kB Progress (2): 44/103 kB | 41/189 kB Progress (2): 45/103 kB | 41/189 kB Progress (2): 45/103 kB | 43/189 kB Progress (2): 47/103 kB | 43/189 kB Progress (2): 47/103 kB | 44/189 kB Progress (2): 48/103 kB | 44/189 kB Progress (2): 48/103 kB | 45/189 kB Progress (2): 49/103 kB | 45/189 kB Progress (2): 49/103 kB | 47/189 kB Progress (2): 51/103 kB | 47/189 kB Progress (2): 51/103 kB | 48/189 kB Progress (2): 52/103 kB | 48/189 kB Progress (2): 52/103 kB | 49/189 kB Progress (2): 54/103 kB | 49/189 kB Progress (2): 55/103 kB | 49/189 kB Progress (2): 56/103 kB | 49/189 kB Progress (2): 58/103 kB | 49/189 kB Progress (2): 59/103 kB | 49/189 kB Progress (2): 61/103 kB | 49/189 kB Progress (2): 62/103 kB | 49/189 kB Progress (2): 62/103 kB | 49/189 kB Progress (2): 62/103 kB | 66/189 kB Progress (2): 79/103 kB | 66/189 kB Progress (2): 95/103 kB | 66/189 kB Progress (2): 95/103 kB | 79/189 kB Progress (2): 103 kB | 79/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.4 MB/s) 2024-09-12T17:37:05.572 INFO:tasks.workunit.client.0.smithi063.stdout:Progress (1): 96/189 kB Progress (1): 112/189 kB Progress (1): 128/189 kB Progress (1): 145/189 kB Progress (1): 161/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T17:37:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:37:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] T E S T S 2024-09-12T17:37:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:37:06.050 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:37:06.164 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjects.java: starting test run: 2024-09-12T17:37:06.164 INFO:tasks.workunit.client.0.smithi063.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:37:06.164 INFO:tasks.workunit.client.0.smithi063.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:37:06.164 INFO:tasks.workunit.client.0.smithi063.stdout: EndpointUrl=http://smithi063.front.sepia.ceph.com:80 2024-09-12T17:37:06.165 INFO:tasks.workunit.client.0.smithi063.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:37:06.262 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Environment Variables Read 2024-09-12T17:37:06.563 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:37:06.563 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Generating File 2024-09-12T17:37:06.563 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: File Generated 2024-09-12T17:37:06.563 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Generating File 2024-09-12T17:37:06.563 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: File Generated 2024-09-12T17:37:06.563 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Generating File 2024-09-12T17:37:06.663 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: File Generated 2024-09-12T17:37:06.663 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Generating File 2024-09-12T17:37:06.663 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: File Generated 2024-09-12T17:37:06.663 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Generating File 2024-09-12T17:37:06.663 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: File Generated 2024-09-12T17:37:06.663 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Generating File 2024-09-12T17:37:06.664 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: File Generated 2024-09-12T17:37:06.664 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Generated Big Files 2024-09-12T17:37:06.763 INFO:tasks.workunit.client.0.smithi063.stdout:HeadBucketResponse() 2024-09-12T17:37:06.763 INFO:tasks.workunit.client.0.smithi063.stdout:sheik is ready 2024-09-12T17:37:06.763 INFO:tasks.workunit.client.0.smithi063.stdout:DEBUG: Test Bucket Created 2024-09-12T17:37:06.863 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:37:06.963 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:37:07.061 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:37:07.063 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:37:07.153 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:37:07.163 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:37:07.260 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:37:07.263 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:37:07.363 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:37:07.464 INFO:tasks.workunit.client.0.smithi063.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:37:09.066 INFO:tasks.workunit.client.0.smithi063.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:37:09.367 INFO:tasks.workunit.client.0.smithi063.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:37:11.619 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-0b 2024-09-12T17:37:11.620 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-8b 2024-09-12T17:37:11.622 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-200b 2024-09-12T17:37:11.622 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-21983b 2024-09-12T17:37:11.623 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-5519b 2024-09-12T17:37:11.624 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-204329b 2024-09-12T17:37:11.625 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-256k 2024-09-12T17:37:11.626 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-1m 2024-09-12T17:37:11.627 INFO:tasks.workunit.client.0.smithi063.stdout:arg: file-1038757b 2024-09-12T17:37:11.659 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:37:11.659 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:11.670 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:37:11.716 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:11.770 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:37:11.770 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:11.842 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:37:11.842 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:11.870 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:37:11.871 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:11.920 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:37:11.920 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:11.945 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:37:11.945 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:11.971 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:37:11.986 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:12.028 INFO:tasks.workunit.client.0.smithi063.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:37:12.028 INFO:tasks.workunit.client.0.smithi063.stdout:PutObjectResponse 2024-09-12T17:37:12.071 INFO:tasks.workunit.client.0.smithi063.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:37:12.271 INFO:tasks.workunit.client.0.smithi063.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:37:12.671 INFO:tasks.workunit.client.0.smithi063.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:37:15.055 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.999 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:37:15.065 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:15.065 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Results: 2024-09-12T17:37:15.065 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:15.065 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:37:15.065 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] 2024-09-12T17:37:15.067 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:37:15.068 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:37:15.068 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:37:15.068 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Total time: 11.077 s 2024-09-12T17:37:15.069 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] Finished at: 2024-09-12T17:37:15Z 2024-09-12T17:37:15.069 INFO:tasks.workunit.client.0.smithi063.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:37:15.080 INFO:tasks.workunit.client.0.smithi063.stderr:+ exit 2024-09-12T17:37:15.081 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:37:15.081 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:37:15.160 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:37:15.161 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:37:15.537 DEBUG:teuthology.parallel:result is None 2024-09-12T17:37:15.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:37:15.577 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:37:15.577 DEBUG:teuthology.orchestra.run.smithi063:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:15.646 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:37:15.646 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:37:15.656 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:15.656 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:37:15.656 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:15.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:37:15.715 INFO:teuthology.orchestra.run.smithi063.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:37:15.716 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:15.785 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:15.785 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:37:15.855 INFO:tasks.workunit:timeout=3h 2024-09-12T17:37:15.855 INFO:tasks.workunit:cleanup=True 2024-09-12T17:37:15.856 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:15.927 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:38:15.633 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 91% (11644/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:38:16.432 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:38:16.433 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-12T17:38:16.434 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:38:16.434 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:38:16.434 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:38:16.434 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:38:16.438 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:38:16.508 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:38:16.510 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:38:16.511 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:38:16.560 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:38:16.611 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:38:16.651 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:38:16.652 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:38:16.652 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:38:16.692 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:38:16.695 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:38:16.696 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:38:16.766 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:38:16.767 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:38:16.767 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:38:16.842 INFO:tasks.workunit.client.0.smithi063.stdout:INFO: fully qualified domain name: smithi063.front.sepia.ceph.com 2024-09-12T17:38:16.842 INFO:tasks.workunit.client.0.smithi063.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:38:16.842 INFO:tasks.workunit.client.0.smithi063.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T17:38:19.461 INFO:tasks.workunit.client.0.smithi063.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:38:19.646 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting pip 2024-09-12T17:38:19.652 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:38:19.698 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: pip 2024-09-12T17:38:19.699 INFO:tasks.workunit.client.0.smithi063.stdout: Attempting uninstall: pip 2024-09-12T17:38:19.699 INFO:tasks.workunit.client.0.smithi063.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:38:19.863 INFO:tasks.workunit.client.0.smithi063.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:38:19.869 INFO:tasks.workunit.client.0.smithi063.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:38:20.641 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed pip-24.2 2024-09-12T17:38:21.498 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting boto3 2024-09-12T17:38:21.499 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:38:22.066 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:38:22.068 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:38:22.118 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:38:22.119 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:38:22.173 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:38:22.174 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:38:22.224 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:38:22.225 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:38:22.301 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:38:22.302 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:38:22.446 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:38:22.447 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:38:22.451 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:38:22.453 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:38:22.462 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:38:22.463 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:38:22.465 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:38:22.467 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:38:22.468 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:38:22.544 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:38:23.583 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:38:24.026 INFO:tasks.workunit.client.0.smithi063.stdout:INFO: creating user 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout:{ 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "user_id": "testid", 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "display_name": "M. Tester", 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "email": "tester@ceph.com", 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "suspended": 0, 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "subusers": [], 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "keys": [ 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: { 2024-09-12T17:38:24.140 INFO:tasks.workunit.client.0.smithi063.stdout: "user": "testid", 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "active": true, 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "create_date": "2024-09-12T17:38:24.133482Z" 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: } 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: ], 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "swift_keys": [], 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "caps": [], 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "default_placement": "", 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "placement_tags": [], 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "bucket_quota": { 2024-09-12T17:38:24.141 INFO:tasks.workunit.client.0.smithi063.stdout: "enabled": false, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size": -1, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "max_objects": -1 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "user_quota": { 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "enabled": false, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size": -1, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "max_objects": -1 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: }, 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:38:24.142 INFO:tasks.workunit.client.0.smithi063.stdout: "type": "rgw", 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout: "account_id": "", 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout: "path": "/", 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout: "create_date": "2024-09-12T17:38:24.133471Z", 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout: "tags": [], 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout: "group_ids": [] 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout:} 2024-09-12T17:38:24.143 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-09-12T17:38:24.401 INFO:tasks.workunit.client.0.smithi063.stderr:5+0 records in 2024-09-12T17:38:24.401 INFO:tasks.workunit.client.0.smithi063.stderr:5+0 records out 2024-09-12T17:38:24.401 INFO:tasks.workunit.client.0.smithi063.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0143748 s, 365 MB/s 2024-09-12T17:38:25.541 INFO:tasks.workunit.client.0.smithi063.stdout:bucket nams is reupload-bkt-126191 2024-09-12T17:38:25.541 INFO:tasks.workunit.client.0.smithi063.stdout:endpoint is http://smithi063.front.sepia.ceph.com:80 2024-09-12T17:38:25.541 INFO:tasks.workunit.client.0.smithi063.stdout:start UploadId=2~PyVKPJnFKykU9xGz0YlmLlC0i7hrC-b 2024-09-12T17:38:25.541 INFO:tasks.workunit.client.0.smithi063.stdout:phase 1 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.541 INFO:tasks.workunit.client.0.smithi063.stdout:phase 1 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 2} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:phase 2 uploaded part {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1} 2024-09-12T17:38:25.542 INFO:tasks.workunit.client.0.smithi063.stdout:completing multipart upload, parts=[{'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 1}, {'ETag': '"30382cda2ac0d2747924b1e9b067a936"', 'PartNumber': 2}] 2024-09-12T17:38:26.788 INFO:tasks.workunit.client.0.smithi063.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:38:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4_mpu_test4 2024-09-12T17:38:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__multipart_mpu_test4.2~PyVKPJnFKykU9xGz0YlmLlC0i7hrC-b.2 2024-09-12T17:38:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__multipart_mpu_test4.QLMdlDqRb23ZOiykhXIEeZIFVR3Prl-l.1 2024-09-12T17:38:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__shadow_mpu_test4.2~PyVKPJnFKykU9xGz0YlmLlC0i7hrC-b.2_1 2024-09-12T17:38:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__shadow_mpu_test4.QLMdlDqRb23ZOiykhXIEeZIFVR3Prl-l.1_1 2024-09-12T17:38:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__:y61Hg52h.1KbOIbhOc-4V.uVcrRTt0s_mpu_test4 2024-09-12T17:38:26.849 INFO:tasks.workunit.client.0.smithi063.stdout:rados ls: 2024-09-12T17:38:26.850 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4_mpu_test4 2024-09-12T17:38:26.850 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__multipart_mpu_test4.2~PyVKPJnFKykU9xGz0YlmLlC0i7hrC-b.2 2024-09-12T17:38:26.850 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__multipart_mpu_test4.QLMdlDqRb23ZOiykhXIEeZIFVR3Prl-l.1 2024-09-12T17:38:26.850 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__shadow_mpu_test4.2~PyVKPJnFKykU9xGz0YlmLlC0i7hrC-b.2_1 2024-09-12T17:38:26.850 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__shadow_mpu_test4.QLMdlDqRb23ZOiykhXIEeZIFVR3Prl-l.1_1 2024-09-12T17:38:26.850 INFO:tasks.workunit.client.0.smithi063.stdout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4__:y61Hg52h.1KbOIbhOc-4V.uVcrRTt0s_mpu_test4 2024-09-12T17:38:26.854 INFO:tasks.workunit.client.0.smithi063.stdout:== PASSED == 2024-09-12T17:38:26.854 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:26.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:26.933 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:38:26.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:38:27.314 DEBUG:teuthology.parallel:result is None 2024-09-12T17:38:27.314 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:27.354 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:27.354 DEBUG:teuthology.orchestra.run.smithi063:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:27.423 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:27.423 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:38:27.441 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:38:27.441 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:38:27.441 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:38:27.442 DEBUG:teuthology.orchestra.run.smithi063:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:38:27.492 INFO:teuthology.orchestra.run.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:38:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:38:27.520 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:38:27.521 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:38:27.521 DEBUG:teuthology.orchestra.run.smithi063:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:38:27.591 INFO:teuthology.orchestra.run.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:38:27.774 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:38:27.774 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:38:27.775 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key XWLYDCJNTMJNQGKLGTLL --secret iKnQyFJ+XC9ZIfdE4G/LL8Gbu/y7rZKECeemkyK+JhGCQ3XLAK08Vw== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:38:27.883 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:27.883 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:27.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.918+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 20 realm 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.920+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.921+0000 7fc27b1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:27.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.921+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.921+0000 7fc27b1af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:27.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.921+0000 7fc27b1af800 20 searching for the correct realm 2024-09-12T17:38:27.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:27.924+0000 7fc278498640 0 -- 172.21.15.63:0/2861591780 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fc26c0b2770 msgr2=0x7fc26c0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.129+0000 7fc278498640 0 -- 172.21.15.63:0/2861591780 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55ca2b1737f0 msgr2=0x55ca2b175c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:28.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:28.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:38:28.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:28.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:38:28.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:28.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.134+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 zone default found 2024-09-12T17:38:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 4 Realm: () 2024-09-12T17:38:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:38:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 zonegroup default 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.135+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.136+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.136+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.136+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.136+0000 7fc27b1af800 20 started sync module instance, tier type = 2024-09-12T17:38:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.136+0000 7fc27b1af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:38:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.146+0000 7fc27b1af800 20 add_watcher() i=0 2024-09-12T17:38:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.146+0000 7fc27b1af800 20 add_watcher() i=1 2024-09-12T17:38:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.146+0000 7fc27b1af800 20 add_watcher() i=2 2024-09-12T17:38:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.146+0000 7fc27b1af800 20 add_watcher() i=3 2024-09-12T17:38:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.146+0000 7fc27b1af800 20 add_watcher() i=4 2024-09-12T17:38:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.146+0000 7fc27b1af800 20 add_watcher() i=5 2024-09-12T17:38:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.146+0000 7fc27b1af800 20 add_watcher() i=6 2024-09-12T17:38:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.147+0000 7fc27b1af800 20 add_watcher() i=7 2024-09-12T17:38:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.147+0000 7fc27b1af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.149+0000 7fc12f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.149+0000 7fc27b1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.149+0000 7fc27b1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.149+0000 7fc27b1af800 5 note: GC not initialized 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc12e7e4640 20 reqs_thread_entry: start 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 20 Filter name: none 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc1277fe640 20 reqs_thread_entry: start 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:38:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:38:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.150+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 10 cache get: name=default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL : miss 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 10 cache put: name=default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL info.flags=0x0 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 10 adding default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL to cache LRU end 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 10 cache get: name=default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL : hit (negative entry) 2024-09-12T17:38:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.151+0000 7fc27b1af800 10 cache get: name=default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL : hit (negative entry) 2024-09-12T17:38:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.152+0000 7fc27b1af800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:38:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.152+0000 7fc27b1af800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:38:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.152+0000 7fc27b1af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:38:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.152+0000 7fc14ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627833 cookie 94326794755056 notifier 5675 bl.length()=675 2024-09-12T17:38:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.152+0000 7fc14ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:38:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.152+0000 7fc14ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:38:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.154+0000 7fc27b1af800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:38:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.154+0000 7fc27b1af800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:38:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.154+0000 7fc27b1af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:38:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.154+0000 7fc14f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627792 cookie 94326794747648 notifier 5675 bl.length()=202 2024-09-12T17:38:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.154+0000 7fc14f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:38:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.154+0000 7fc14f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:38:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.156+0000 7fc27b1af800 10 cache put: name=default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL info.flags=0x7 2024-09-12T17:38:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.156+0000 7fc27b1af800 10 moving default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL to cache LRU end 2024-09-12T17:38:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.156+0000 7fc27b1af800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:XWLYDCJNTMJNQGKLGTLL, ofs0, ns] 2024-09-12T17:38:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.156+0000 7fc14ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627834 cookie 94326794704768 notifier 5675 bl.length()=190 2024-09-12T17:38:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.156+0000 7fc14ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL info.flags=0x7 2024-09-12T17:38:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.156+0000 7fc14ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XWLYDCJNTMJNQGKLGTLL to cache LRU end 2024-09-12T17:38:28.158 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "ragweed.client.0", 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "XWLYDCJNTMJNQGKLGTLL", 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "iKnQyFJ+XC9ZIfdE4G/LL8Gbu/y7rZKECeemkyK+JhGCQ3XLAK08Vw==", 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:38:28.153169Z" 2024-09-12T17:38:28.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:38:28.160 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:38:28.153151Z", 2024-09-12T17:38:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:38:28.162 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:38:28.162 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:38:28.162 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:38:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.157+0000 7fc12f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.159+0000 7fc27b1af800 20 remove_watcher() i=0 2024-09-12T17:38:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.159+0000 7fc27b1af800 2 removed watcher, disabling cache 2024-09-12T17:38:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.160+0000 7fc27b1af800 20 remove_watcher() i=1 2024-09-12T17:38:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.162+0000 7fc27b1af800 20 remove_watcher() i=2 2024-09-12T17:38:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.163+0000 7fc27b1af800 20 remove_watcher() i=3 2024-09-12T17:38:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.164+0000 7fc27b1af800 20 remove_watcher() i=4 2024-09-12T17:38:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.165+0000 7fc27b1af800 20 remove_watcher() i=5 2024-09-12T17:38:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.166+0000 7fc27b1af800 20 remove_watcher() i=6 2024-09-12T17:38:28.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.167+0000 7fc27b1af800 20 remove_watcher() i=7 2024-09-12T17:38:28.180 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:38:28.180 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key IUQJYEIPYWAMGYEPYWQQ --secret nP22yig1AyMLCkovFsyQyM2bVPT9Ay/IhoEdy2UQyhq0DIZPfupwVg== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:38:28.250 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:28.250 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:28.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.284+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.285+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.285+0000 7f6b1b811800 20 realm 2024-09-12T17:38:28.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.285+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.285+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.285+0000 7f6b1b811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:28.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.285+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.286+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.286+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.286+0000 7f6b1b811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:28.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.286+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.287+0000 7f6b1b811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:28.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.287+0000 7f6b1b811800 20 searching for the correct realm 2024-09-12T17:38:28.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.290+0000 7f6b16747640 0 -- 172.21.15.63:0/1151620277 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f6b0c04a040 msgr2=0x7f6b0c08b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:28.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.496+0000 7f6b17749640 0 -- 172.21.15.63:0/1151620277 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x555e5ca66420 msgr2=0x555e5ca68890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:28.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.500+0000 7f6b1b811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:28.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.500+0000 7f6b1b811800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:38:28.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.500+0000 7f6b1b811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:28.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.500+0000 7f6b1b811800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:38:28.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.500+0000 7f6b1b811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:28.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.500+0000 7f6b1b811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:28.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.500+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:28.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 zone default found 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 4 Realm: () 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 zonegroup default 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.501+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.502+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.502+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.502+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.502+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.502+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.502+0000 7f6b1b811800 20 started sync module instance, tier type = 2024-09-12T17:38:28.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.502+0000 7f6b1b811800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:38:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.512+0000 7f6b1b811800 20 add_watcher() i=0 2024-09-12T17:38:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.512+0000 7f6b1b811800 20 add_watcher() i=1 2024-09-12T17:38:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.512+0000 7f6b1b811800 20 add_watcher() i=2 2024-09-12T17:38:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.512+0000 7f6b1b811800 20 add_watcher() i=3 2024-09-12T17:38:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.512+0000 7f6b1b811800 20 add_watcher() i=4 2024-09-12T17:38:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.512+0000 7f6b1b811800 20 add_watcher() i=5 2024-09-12T17:38:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.512+0000 7f6b1b811800 20 add_watcher() i=6 2024-09-12T17:38:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.513+0000 7f6b1b811800 20 add_watcher() i=7 2024-09-12T17:38:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.513+0000 7f6b1b811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.515+0000 7f69cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6b1b811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6b1b811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6b1b811800 5 note: GC not initialized 2024-09-12T17:38:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6947fff640 20 reqs_thread_entry: start 2024-09-12T17:38:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6b1b811800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6b1b811800 20 Filter name: none 2024-09-12T17:38:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6945ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6b1b811800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:38:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.516+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 cache get: name=default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ : miss 2024-09-12T17:38:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 20 rados->read ofs=0 len=0 2024-09-12T17:38:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 cache put: name=default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ info.flags=0x0 2024-09-12T17:38:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 adding default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ to cache LRU end 2024-09-12T17:38:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 cache get: name=default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ : hit (negative entry) 2024-09-12T17:38:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.517+0000 7f6b1b811800 10 cache get: name=default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ : hit (negative entry) 2024-09-12T17:38:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.519+0000 7f6b1b811800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:38:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.519+0000 7f6b1b811800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:38:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.519+0000 7f6b1b811800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:38:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.519+0000 7f69fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627793 cookie 93863769702224 notifier 6003 bl.length()=675 2024-09-12T17:38:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.519+0000 7f69fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:38:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.519+0000 7f69fa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:38:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.521+0000 7f6b1b811800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:38:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.521+0000 7f6b1b811800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:38:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.521+0000 7f6b1b811800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:38:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.521+0000 7f69fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627835 cookie 93863769753104 notifier 6003 bl.length()=202 2024-09-12T17:38:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.521+0000 7f69fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:38:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.521+0000 7f69fa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:38:28.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.523+0000 7f6b1b811800 10 cache put: name=default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ info.flags=0x7 2024-09-12T17:38:28.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.523+0000 7f6b1b811800 10 moving default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ to cache LRU end 2024-09-12T17:38:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.523+0000 7f6b1b811800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:IUQJYEIPYWAMGYEPYWQQ, ofs0, ns] 2024-09-12T17:38:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.523+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627801 cookie 93863769758016 notifier 6003 bl.length()=190 2024-09-12T17:38:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.523+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ info.flags=0x7 2024-09-12T17:38:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.523+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IUQJYEIPYWAMGYEPYWQQ to cache LRU end 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "sysuser.client.0", 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "IUQJYEIPYWAMGYEPYWQQ", 2024-09-12T17:38:28.526 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "nP22yig1AyMLCkovFsyQyM2bVPT9Ay/IhoEdy2UQyhq0DIZPfupwVg==", 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:38:28.519633Z" 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "system": true, 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:38:28.527 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:38:28.528 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:38:28.519618Z", 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:38:28.529 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:38:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.525+0000 7f69cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.527+0000 7f6b1b811800 20 remove_watcher() i=0 2024-09-12T17:38:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.527+0000 7f6b1b811800 2 removed watcher, disabling cache 2024-09-12T17:38:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.528+0000 7f6b1b811800 20 remove_watcher() i=1 2024-09-12T17:38:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.529+0000 7f6b1b811800 20 remove_watcher() i=2 2024-09-12T17:38:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.530+0000 7f6b1b811800 20 remove_watcher() i=3 2024-09-12T17:38:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.531+0000 7f6b1b811800 20 remove_watcher() i=4 2024-09-12T17:38:28.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.532+0000 7f6b1b811800 20 remove_watcher() i=5 2024-09-12T17:38:28.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.533+0000 7f6b1b811800 20 remove_watcher() i=6 2024-09-12T17:38:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:28.534+0000 7f6b1b811800 20 remove_watcher() i=7 2024-09-12T17:38:28.548 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:38:28.549 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:38:28.549 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:38:28.578 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:38:28.579 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:38:28.579 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:38:28.648 DEBUG:teuthology.orchestra.run.smithi063:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:38:28.844 INFO:teuthology.orchestra.run.smithi063.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:38:35.882 INFO:teuthology.orchestra.run.smithi063.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:38:39.438 INFO:teuthology.orchestra.run.smithi063.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=1fd51c9740cd13c249e720b0d85962f5e6c8d53e1ea00f30f76cee28fe7f922e,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:38:39.438 INFO:teuthology.orchestra.run.smithi063.stdout:py run-test-pre: PYTHONHASHSEED='1142254061' 2024-09-12T17:38:39.438 INFO:teuthology.orchestra.run.smithi063.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:38:39.638 INFO:teuthology.orchestra.run.smithi063.stdout:============================= test session starts ============================== 2024-09-12T17:38:39.638 INFO:teuthology.orchestra.run.smithi063.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:38:39.638 INFO:teuthology.orchestra.run.smithi063.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:38:39.638 INFO:teuthology.orchestra.run.smithi063.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:38:39.638 INFO:teuthology.orchestra.run.smithi063.stdout:configfile: pytest.ini 2024-09-12T17:38:39.739 INFO:teuthology.orchestra.run.smithi063.stdout:collecting ... collected 9 items 2024-09-12T17:38:39.739 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:38:40.226 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:38:40.735 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:38:41.168 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:38:48.456 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:38:49.710 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:38:50.894 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:38:53.189 INFO:teuthology.orchestra.run.smithi063.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout:=============================== warnings summary =============================== 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout: import imp 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:38:53.190 INFO:teuthology.orchestra.run.smithi063.stdout:======================== 9 passed, 1 warning in 13.55s ========================= 2024-09-12T17:38:53.220 INFO:teuthology.orchestra.run.smithi063.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:38:53.221 INFO:teuthology.orchestra.run.smithi063.stdout: py: commands succeeded 2024-09-12T17:38:53.221 INFO:teuthology.orchestra.run.smithi063.stdout: congratulations :) 2024-09-12T17:38:53.239 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:38:53.239 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:38:53.274 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:38:53.381 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:53.382 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:53.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.416+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.417+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.417+0000 7fcf43a96800 20 realm 2024-09-12T17:38:53.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.417+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.418+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.418+0000 7fcf43a96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:53.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.418+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.418+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.418+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.419+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:53.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.419+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.419+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:53.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.419+0000 7fcf43a96800 20 searching for the correct realm 2024-09-12T17:38:53.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.422+0000 7fcf41580640 0 -- 172.21.15.63:0/1732509355 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fcf340443e0 msgr2=0x7fcf34044860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:53.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.425+0000 7fcf41580640 0 -- 172.21.15.63:0/1732509355 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fcf3c064ee0 msgr2=0x7fcf3c063950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:53.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:53.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:38:53.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:53.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:38:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.632+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:53.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 zone default found 2024-09-12T17:38:53.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 4 Realm: () 2024-09-12T17:38:53.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 zonegroup default 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.633+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.634+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.634+0000 7fcf43a96800 20 started sync module instance, tier type = 2024-09-12T17:38:53.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.634+0000 7fcf43a96800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:38:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.643+0000 7fcf43a96800 20 add_watcher() i=0 2024-09-12T17:38:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.643+0000 7fcf43a96800 20 add_watcher() i=1 2024-09-12T17:38:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.643+0000 7fcf43a96800 20 add_watcher() i=2 2024-09-12T17:38:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.643+0000 7fcf43a96800 20 add_watcher() i=3 2024-09-12T17:38:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.643+0000 7fcf43a96800 20 add_watcher() i=4 2024-09-12T17:38:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.643+0000 7fcf43a96800 20 add_watcher() i=5 2024-09-12T17:38:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.643+0000 7fcf43a96800 20 add_watcher() i=6 2024-09-12T17:38:53.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.644+0000 7fcf43a96800 20 add_watcher() i=7 2024-09-12T17:38:53.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.644+0000 7fcf43a96800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:53.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.645+0000 7fcdf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:53.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.645+0000 7fcf43a96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:53.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.645+0000 7fcf43a96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:53.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.682+0000 7fcdf67e4640 20 reqs_thread_entry: start 2024-09-12T17:38:53.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:53.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 20 Filter name: none 2024-09-12T17:38:53.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcd67fff640 20 reqs_thread_entry: start 2024-09-12T17:38:53.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:38:53.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.683+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 : miss 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 info.flags=0x17 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 to cache LRU end 2024-09-12T17:38:53.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.684+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 2024-09-12T17:38:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.685+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:38:53.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.686+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:38:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.686+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:38:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.686+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:38:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.687+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:38:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.687+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:38:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.687+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:38:53.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.688+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:38:53.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.689+0000 7fcf43a96800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:38:53.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.689+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x559c8e6486f8 s->prefetch_data=0 2024-09-12T17:38:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.690+0000 7fcf43a96800 10 manifest: total_size = 7742 2024-09-12T17:38:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.690+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4817609501868175766 2024-09-12T17:38:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.690+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x559c8e6486f8 s->prefetch_data=0 2024-09-12T17:38:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.690+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6486f8 2024-09-12T17:38:53.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.690+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.1 2024-09-12T17:38:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=7742 stripe_ofs=7742 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4817609501868175766 2024-09-12T17:38:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.LlKOnW8xEWUWSU6tIreVoBt8XxDXU2X_0 2024-09-12T17:38:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.693+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4817609501868175766 2024-09-12T17:38:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.694+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:38:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.694+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.695+0000 7fcf43a96800 10 manifest: total_size = 7408 2024-09-12T17:38:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.695+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12887123126376645968 2024-09-12T17:38:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.695+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.695+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.695+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.2 2024-09-12T17:38:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=7408 stripe_ofs=7408 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12887123126376645968 2024-09-12T17:38:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.8nHvItIUhiRS_7ULxF_MohZSpBvTvBW_0 2024-09-12T17:38:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:38:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.697+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12887123126376645968 2024-09-12T17:38:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.698+0000 7fce13fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:38:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.698+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.699+0000 7fcf43a96800 10 manifest: total_size = 5009 2024-09-12T17:38:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.699+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9377258730288145717 2024-09-12T17:38:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.699+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.699+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.699+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.2 2024-09-12T17:38:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5009 stripe_ofs=5009 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9377258730288145717 2024-09-12T17:38:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.T9dzvA5sgo-eJZqdhL7zOvk1ibJ6JFB_0 2024-09-12T17:38:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.701+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9377258730288145717 2024-09-12T17:38:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.702+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:38:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.703+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.703+0000 7fcf43a96800 10 manifest: total_size = 13086 2024-09-12T17:38:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.703+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16532944081775054579 2024-09-12T17:38:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.703+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e56d140 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.703+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.703+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.3 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=13086 stripe_ofs=13086 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16532944081775054579 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.vPs41NKryOwyAVIlVeeptABdXOKyzkz_0 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.706+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16532944081775054579 2024-09-12T17:38:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.707+0000 7fce13fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:38:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.707+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c064b70 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.708+0000 7fcf43a96800 10 manifest: total_size = 7546 2024-09-12T17:38:53.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.708+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15443319512532237876 2024-09-12T17:38:53.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.708+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c064b70 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.708+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.708+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.4 2024-09-12T17:38:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=7546 stripe_ofs=7546 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15443319512532237876 2024-09-12T17:38:53.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.Et8xCar--rUzw5vGPZMrezGb5Lq-0zP_0 2024-09-12T17:38:53.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:38:53.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.711+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15443319512532237876 2024-09-12T17:38:53.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.713+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf380a6f80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.713+0000 7fcf43a96800 10 manifest: total_size = 5199 2024-09-12T17:38:53.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.713+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2983645858664195491 2024-09-12T17:38:53.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.713+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf380a6f80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.713+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.713+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.4 2024-09-12T17:38:53.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.716+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:38:53.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5199 stripe_ofs=5199 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2983645858664195491 2024-09-12T17:38:53.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.A03C0tyrlukFk1S2VJxspyVfx_zEuZU_0 2024-09-12T17:38:53.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:53.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.718+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2983645858664195491 2024-09-12T17:38:53.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.720+0000 7fce13fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:38:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.720+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf380a6f80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.720+0000 7fcf43a96800 10 manifest: total_size = 7520 2024-09-12T17:38:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.720+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8800330626856408305 2024-09-12T17:38:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.720+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf380a6f80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.720+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.720+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.5 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=7520 stripe_ofs=7520 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8800330626856408305 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.Np0QhzPQUgMWg7e8AzGnAiBnywbJVXL_0 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.723+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8800330626856408305 2024-09-12T17:38:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.726+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:38:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.726+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d4a50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.726+0000 7fcf43a96800 10 manifest: total_size = 7804 2024-09-12T17:38:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.726+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12169596922728131145 2024-09-12T17:38:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.726+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d4a50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.726+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.726+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.7 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=7804 stripe_ofs=7804 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12169596922728131145 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.7XNvxOuxS72MZwqSOrlbw5Ub21f4Pj-_0 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.730+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12169596922728131145 2024-09-12T17:38:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.731+0000 7fce13fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:38:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.731+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003470 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.731+0000 7fcf43a96800 10 manifest: total_size = 8751 2024-09-12T17:38:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.731+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743818386706277867 2024-09-12T17:38:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.731+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003470 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x559c8e6481a8 s->prefetch_data=0 2024-09-12T17:38:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.731+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e6481a8 2024-09-12T17:38:53.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.731+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5.8 2024-09-12T17:38:53.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=8751 stripe_ofs=8751 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743818386706277867 2024-09-12T17:38:53.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.g1ghhkT3R8znmo6Apm3ftGnmrExFlS7_0 2024-09-12T17:38:53.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T17:38:53.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.734+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743818386706277867 2024-09-12T17:38:53.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.736+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:38:53.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.736+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.736+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.737+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.737+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.737+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.737+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.737+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.738+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:38:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.738+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.738+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:38:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.738+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:38:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.738+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:38:53.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.740+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:38:53.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.740+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:38:53.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.740+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431565 cookie 94130891432736 notifier 6036 bl.length()=162 2024-09-12T17:38:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.741+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 from cache 2024-09-12T17:38:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.741+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5, ofs0, ns] 2024-09-12T17:38:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.742+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94130891439248 notifier 6036 bl.length()=219 2024-09-12T17:38:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.744+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 : miss 2024-09-12T17:38:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.744+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.744+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.744+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 info.flags=0x0 2024-09-12T17:38:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.744+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5 to cache LRU end 2024-09-12T17:38:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.746+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 : miss 2024-09-12T17:38:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.746+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.747+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:38:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.747+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 info.flags=0x17 2024-09-12T17:38:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.747+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 to cache LRU end 2024-09-12T17:38:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.747+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.747+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.747+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 2024-09-12T17:38:53.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.751+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:38:53.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.751+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d22e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559c8e5e7808 s->prefetch_data=0 2024-09-12T17:38:53.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.751+0000 7fcf43a96800 10 manifest: total_size = 1667 2024-09-12T17:38:53.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.751+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7195650118022146785 2024-09-12T17:38:53.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.751+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d22e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559c8e5e7808 s->prefetch_data=0 2024-09-12T17:38:53.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.751+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5e7808 2024-09-12T17:38:53.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.751+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12.10 2024-09-12T17:38:53.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T17:38:53.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:38:53.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T17:38:53.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T17:38:53.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=516 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4191756 part_ofs=1548 rule->part_size=119 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7195650118022146785 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.1 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.2 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:38:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.3 2024-09-12T17:38:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:38:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.4 2024-09-12T17:38:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:38:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.754+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7195650118022146785 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.755+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.756+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.756+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.757+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.757+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.757+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.757+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.757+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.758+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:38:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.758+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.759+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:38:53.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.759+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:38:53.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.759+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:38:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.760+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:38:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.760+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:38:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.760+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94130891436912 notifier 6036 bl.length()=191 2024-09-12T17:38:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.761+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 from cache 2024-09-12T17:38:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.761+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12, ofs0, ns] 2024-09-12T17:38:53.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.762+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 94130891432736 notifier 6036 bl.length()=249 2024-09-12T17:38:53.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.764+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 : miss 2024-09-12T17:38:53.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.764+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.765+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.765+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 info.flags=0x0 2024-09-12T17:38:53.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.765+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12 to cache LRU end 2024-09-12T17:38:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.766+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 : miss 2024-09-12T17:38:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.766+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.767+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:38:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.767+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 info.flags=0x17 2024-09-12T17:38:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.767+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 to cache LRU end 2024-09-12T17:38:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.767+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.767+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.767+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 2024-09-12T17:38:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.771+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:38:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.771+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e649dc0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x559c8e52db18 s->prefetch_data=0 2024-09-12T17:38:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.771+0000 7fcf43a96800 10 manifest: total_size = 18874368 2024-09-12T17:38:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.771+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12994591421420392263 2024-09-12T17:38:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.771+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e649dc0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x559c8e52db18 s->prefetch_data=0 2024-09-12T17:38:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.771+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e52db18 2024-09-12T17:38:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.771+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13.10 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:38:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12994591421420392263 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.1 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__shadow_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.1_1 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.2 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__shadow_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.2_1 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.3 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__shadow_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.3_1 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-09-12T17:38:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.4 2024-09-12T17:38:53.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-09-12T17:38:53.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.773+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12994591421420392263 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.775+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.775+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.775+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.776+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.776+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.776+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.776+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.776+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.777+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:38:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.777+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.778+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:38:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.778+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:38:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.778+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:38:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.779+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:38:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.779+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:38:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.779+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94130891439248 notifier 6036 bl.length()=198 2024-09-12T17:38:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.781+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 from cache 2024-09-12T17:38:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.781+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13, ofs0, ns] 2024-09-12T17:38:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.781+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94130891450960 notifier 6036 bl.length()=256 2024-09-12T17:38:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.783+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 : miss 2024-09-12T17:38:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.783+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.783+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.783+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 info.flags=0x0 2024-09-12T17:38:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.784+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13 to cache LRU end 2024-09-12T17:38:53.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 : miss 2024-09-12T17:38:53.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:38:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 info.flags=0x17 2024-09-12T17:38:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 to cache LRU end 2024-09-12T17:38:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.786+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 2024-09-12T17:38:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.790+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo[v5vI3Gfum0dXdf2YERjJsoqTY1-gBSy] 2024-09-12T17:38:53.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.790+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11.10 2024-09-12T17:38:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.790+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d22e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x559c8e5e7778 s->prefetch_data=0 2024-09-12T17:38:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.790+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to cklvsk0170e8qnyw5hv4s0r37oab7ffc 2024-09-12T17:38:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.790+0000 7fcf43a96800 20 get_obj_state_impl: setting s->olh_tag to er9dlxceyu6btm256gilkl0rm5znbsou 2024-09-12T17:38:53.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.790+0000 7fcf43a96800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=er9dlxceyu6btm256gilkl0rm5znbsou 2024-09-12T17:38:53.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.792+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11.10 2024-09-12T17:38:53.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.793+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11.10 2024-09-12T17:38:53.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.793+0000 7fcf43a96800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:38:53.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.793+0000 7fcf43a96800 20 olh_log_entry: epoch=3 op=3 key=foo[v5vI3Gfum0dXdf2YERjJsoqTY1-gBSy] 2024-09-12T17:38:53.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.793+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d22e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:v5vI3Gfum0dXdf2YERjJsoqTY1-gBSy_foo state=0x559c8e5e1cb8 s->prefetch_data=0 2024-09-12T17:38:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.794+0000 7fcf43a96800 10 manifest: total_size = 1667 2024-09-12T17:38:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.794+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7155220720436364623 2024-09-12T17:38:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.794+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d22e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:v5vI3Gfum0dXdf2YERjJsoqTY1-gBSy_foo state=0x559c8e5e1cb8 s->prefetch_data=0 2024-09-12T17:38:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.794+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5e1cb8 2024-09-12T17:38:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.794+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11.10 2024-09-12T17:38:53.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T17:38:53.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:38:53.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T17:38:53.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T17:38:53.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=516 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4191756 part_ofs=1548 rule->part_size=119 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7155220720436364623 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.1 2024-09-12T17:38:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:38:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.2 2024-09-12T17:38:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:38:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.3 2024-09-12T17:38:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:38:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.4 2024-09-12T17:38:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:38:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.796+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7155220720436364623 2024-09-12T17:38:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.797+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo[v5vI3Gfum0dXdf2YERjJsoqTY1-gBSy] 2024-09-12T17:38:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.799+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d22e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x559c8e5e7778 s->prefetch_data=0 2024-09-12T17:38:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.800+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11.10 2024-09-12T17:38:53.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.801+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11.10 2024-09-12T17:38:53.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.801+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.801+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.802+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.802+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.802+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.802+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.802+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.804+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:38:53.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.804+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.804+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:38:53.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.804+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:38:53.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.804+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:38:53.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.805+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:38:53.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.805+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:38:53.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.805+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431579 cookie 94130891439248 notifier 6036 bl.length()=193 2024-09-12T17:38:53.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.807+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 from cache 2024-09-12T17:38:53.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.807+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11, ofs0, ns] 2024-09-12T17:38:53.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.807+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94130891442560 notifier 6036 bl.length()=251 2024-09-12T17:38:53.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.810+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 : miss 2024-09-12T17:38:53.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.810+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.810+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.810+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 info.flags=0x0 2024-09-12T17:38:53.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.810+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11 to cache LRU end 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.813+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 : miss 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.813+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.814+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.814+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 info.flags=0x17 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.814+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 to cache LRU end 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.814+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.814+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.814+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 2024-09-12T17:38:53.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.818+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:38:53.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.818+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5923c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x559c8e5e0248 s->prefetch_data=0 2024-09-12T17:38:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.818+0000 7fcf43a96800 10 manifest: total_size = 886297 2024-09-12T17:38:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.818+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17841756963435020265 2024-09-12T17:38:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.818+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5923c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x559c8e5e0248 s->prefetch_data=0 2024-09-12T17:38:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.818+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5e0248 2024-09-12T17:38:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.818+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10.10 2024-09-12T17:38:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:38:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T17:38:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T17:38:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:38:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17841756963435020265 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.1 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.2 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:38:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.3 2024-09-12T17:38:53.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:38:53.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.4 2024-09-12T17:38:53.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:38:53.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.821+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17841756963435020265 2024-09-12T17:38:53.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:38:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.823+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.825+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:38:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.825+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.826+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T17:38:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.826+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:38:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.826+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:38:53.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.827+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:38:53.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.827+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:38:53.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.827+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94130891445984 notifier 6036 bl.length()=183 2024-09-12T17:38:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.828+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 from cache 2024-09-12T17:38:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.828+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10, ofs0, ns] 2024-09-12T17:38:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.829+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94130891436912 notifier 6036 bl.length()=241 2024-09-12T17:38:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.831+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 : miss 2024-09-12T17:38:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.831+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.832+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.832+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 info.flags=0x0 2024-09-12T17:38:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.832+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10 to cache LRU end 2024-09-12T17:38:53.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 : miss 2024-09-12T17:38:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:38:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 info.flags=0x17 2024-09-12T17:38:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 to cache LRU end 2024-09-12T17:38:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.834+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 2024-09-12T17:38:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.835+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:38:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.836+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:38:53.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.836+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:38:53.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.837+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:38:53.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.837+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:38:53.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.837+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:38:53.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.837+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:38:53.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.837+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:38:53.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.837+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:38:53.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.838+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:38:53.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.838+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:38:53.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.838+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:38:53.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.838+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e40f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.839+0000 7fcf43a96800 10 manifest: total_size = 27199 2024-09-12T17:38:53.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.839+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _mWdfkipM96Nm1XmD9vLPXJ40ygeysQc 2024-09-12T17:38:53.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.839+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e40f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.839+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3148 2024-09-12T17:38:53.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.839+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.0 2024-09-12T17:38:53.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _mWdfkipM96Nm1XmD9vLPXJ40ygeysQc 2024-09-12T17:38:53.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.m08cQywAyvBSy7Nx_cXezMauqsNWGvJ_0 2024-09-12T17:38:53.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:38:53.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.841+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _mWdfkipM96Nm1XmD9vLPXJ40ygeysQc 2024-09-12T17:38:53.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.843+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:38:53.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.843+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e40f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.843+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.843+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _qm9lsSpCcG4dNvqoFwOPDpQhYRiE-XO 2024-09-12T17:38:53.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.843+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e40f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.843+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3148 2024-09-12T17:38:53.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.843+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.2 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _qm9lsSpCcG4dNvqoFwOPDpQhYRiE-XO 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.zArZsfhL6FGvkkQw4CIkAvEH6Lgxl3g_0 2024-09-12T17:38:53.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:38:53.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.zArZsfhL6FGvkkQw4CIkAvEH6Lgxl3g_1 2024-09-12T17:38:53.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:38:53.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.845+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _qm9lsSpCcG4dNvqoFwOPDpQhYRiE-XO 2024-09-12T17:38:53.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.846+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:38:53.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.847+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e648810 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.847+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.847+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6871039996888060935 2024-09-12T17:38:53.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.847+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e648810 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.847+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3148 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.847+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.3 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6871039996888060935 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_0 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_1 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T17:38:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.849+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6871039996888060935 2024-09-12T17:38:53.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.850+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:38:53.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.851+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.851+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.851+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _IVVSSpgHUu7g_GenfZF_GqkvQYtjbeB 2024-09-12T17:38:53.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.851+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.851+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3148 2024-09-12T17:38:53.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.851+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.5 2024-09-12T17:38:53.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _IVVSSpgHUu7g_GenfZF_GqkvQYtjbeB 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.G_wdfFnkBy7cDSRVLOPFitGPzLTPyx1_0 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.G_wdfFnkBy7cDSRVLOPFitGPzLTPyx1_1 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.854+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _IVVSSpgHUu7g_GenfZF_GqkvQYtjbeB 2024-09-12T17:38:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.855+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:38:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.855+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf34046600 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.855+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.855+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _xiNPIAYVO-udnwXiXQkD2aSKKQ0K_ar 2024-09-12T17:38:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.855+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf34046600 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559c8e5f3148 s->prefetch_data=0 2024-09-12T17:38:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.855+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3148 2024-09-12T17:38:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.855+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.5 2024-09-12T17:38:53.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _xiNPIAYVO-udnwXiXQkD2aSKKQ0K_ar 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.B8dkGizCHRohTxSkXLQJCaxmoScDlHn_0 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.B8dkGizCHRohTxSkXLQJCaxmoScDlHn_1 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.858+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _xiNPIAYVO-udnwXiXQkD2aSKKQ0K_ar 2024-09-12T17:38:53.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.859+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:38:53.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.859+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.859+0000 7fcf43a96800 10 manifest: total_size = 27199 2024-09-12T17:38:53.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.859+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14543854310956338570 2024-09-12T17:38:53.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.859+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.859+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ea068 2024-09-12T17:38:53.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.859+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.5 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14543854310956338570 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.T1WvK2vEVbgv7t8K02DR8Zd7vhK-XTh_0 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.862+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14543854310956338570 2024-09-12T17:38:53.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.863+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:38:53.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.865+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5c9d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.865+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.865+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _5ouc2jdTuPQCJMQIlLgV3mOQyATbI2E 2024-09-12T17:38:53.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.865+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5c9d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.865+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ea068 2024-09-12T17:38:53.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.865+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.7 2024-09-12T17:38:53.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _5ouc2jdTuPQCJMQIlLgV3mOQyATbI2E 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.97BW1Wc6FOvf9AAAPZwPm1UzIFmnZJn_0 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.97BW1Wc6FOvf9AAAPZwPm1UzIFmnZJn_1 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.868+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _5ouc2jdTuPQCJMQIlLgV3mOQyATbI2E 2024-09-12T17:38:53.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.870+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5ec960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.870+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:38:53.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.871+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.871+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5008790407583146598 2024-09-12T17:38:53.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.871+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5ec960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.871+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ea068 2024-09-12T17:38:53.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.871+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.7 2024-09-12T17:38:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5008790407583146598 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_0 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_1 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.873+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5008790407583146598 2024-09-12T17:38:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.874+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:38:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.875+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3403bca0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.875+0000 7fcf43a96800 10 manifest: total_size = 27199 2024-09-12T17:38:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.875+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14508652410513579194 2024-09-12T17:38:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.875+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3403bca0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.875+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ea068 2024-09-12T17:38:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.875+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.7 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14508652410513579194 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.T1WvK2vEVbgv7t8K02DR8Zd7vhK-XTh_0 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.878+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14508652410513579194 2024-09-12T17:38:53.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.879+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:38:53.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.879+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.880+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.880+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17036667429545280426 2024-09-12T17:38:53.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.880+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.880+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ea068 2024-09-12T17:38:53.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.880+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.8 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17036667429545280426 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_0 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_1 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.883+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17036667429545280426 2024-09-12T17:38:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.884+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:38:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.884+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.885+0000 7fcf43a96800 10 manifest: total_size = 27199 2024-09-12T17:38:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.885+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _h0G9WHZgDVc3tnpxmHXZbXOnNTVdb01 2024-09-12T17:38:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.885+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.885+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ea068 2024-09-12T17:38:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.885+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.8 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _h0G9WHZgDVc3tnpxmHXZbXOnNTVdb01 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.54Vpx6FKjseT8whf_weiZ-eZWIRXjjk_0 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.887+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _h0G9WHZgDVc3tnpxmHXZbXOnNTVdb01 2024-09-12T17:38:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.889+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:38:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.889+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c0612d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.889+0000 7fcf43a96800 10 manifest: total_size = 5242880 2024-09-12T17:38:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.889+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13132960841371927727 2024-09-12T17:38:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.889+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c0612d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559c8e5ea068 s->prefetch_data=0 2024-09-12T17:38:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.889+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ea068 2024-09-12T17:38:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.889+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16.9 2024-09-12T17:38:53.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13132960841371927727 2024-09-12T17:38:53.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_0 2024-09-12T17:38:53.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:38:53.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_1 2024-09-12T17:38:53.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:38:53.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.892+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13132960841371927727 2024-09-12T17:38:53.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.893+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:38:53.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.894+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.894+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.894+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.894+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.894+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.894+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.894+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.896+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:38:53.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.896+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.897+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:38:53.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.897+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:38:53.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.897+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:38:53.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.897+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:38:53.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.897+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:38:53.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.898+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94130891439248 notifier 6036 bl.length()=189 2024-09-12T17:38:53.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.899+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 from cache 2024-09-12T17:38:53.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.899+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16, ofs0, ns] 2024-09-12T17:38:53.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.900+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94130891442560 notifier 6036 bl.length()=247 2024-09-12T17:38:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.904+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 : miss 2024-09-12T17:38:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.904+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.904+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.904+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 info.flags=0x0 2024-09-12T17:38:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.904+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16 to cache LRU end 2024-09-12T17:38:53.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.906+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 : miss 2024-09-12T17:38:53.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.906+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.907+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:38:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.907+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 info.flags=0x17 2024-09-12T17:38:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.907+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 to cache LRU end 2024-09-12T17:38:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.907+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.907+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.907+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 2024-09-12T17:38:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.907+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:38:53.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.908+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:38:53.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.908+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:38:53.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.910+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:38:53.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.910+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:38:53.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.910+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:38:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.911+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:38:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.911+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:38:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.911+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:38:53.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.911+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:38:53.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.911+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:38:53.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.911+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:38:53.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.912+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e6670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.912+0000 7fcf43a96800 10 manifest: total_size = 16376 2024-09-12T17:38:53.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.912+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _IfQ2Tv0q7EIFK57jcvTarGi31c8WnCM 2024-09-12T17:38:53.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.912+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e6670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.912+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.912+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.0 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _IfQ2Tv0q7EIFK57jcvTarGi31c8WnCM 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lp7xA9xVRHoHRn_qGgWP0ORHJVlBrLc_0 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.915+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _IfQ2Tv0q7EIFK57jcvTarGi31c8WnCM 2024-09-12T17:38:53.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.916+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.916+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:38:53.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.916+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.916+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _LBxL6m-WyTLEdjjNx1uVG1OO0xkEC4L 2024-09-12T17:38:53.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.916+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.916+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.916+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.2 2024-09-12T17:38:53.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _LBxL6m-WyTLEdjjNx1uVG1OO0xkEC4L 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.8ZsQIb794Svy2ANgywtUePjb3-hspWA_0 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.8ZsQIb794Svy2ANgywtUePjb3-hspWA_1 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.8ZsQIb794Svy2ANgywtUePjb3-hspWA_2 2024-09-12T17:38:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:38:53.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.919+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _LBxL6m-WyTLEdjjNx1uVG1OO0xkEC4L 2024-09-12T17:38:53.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.920+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:38:53.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.920+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.920+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.920+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7701439051988211042 2024-09-12T17:38:53.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.920+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.920+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.920+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.3 2024-09-12T17:38:53.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7701439051988211042 2024-09-12T17:38:53.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1_1 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2_1 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.3 2024-09-12T17:38:53.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:38:53.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.923+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7701439051988211042 2024-09-12T17:38:53.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.924+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:38:53.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.924+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e6484f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.925+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.925+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _MmPX1xJfNYeOuZjuGBV-whRVPqRkegn 2024-09-12T17:38:53.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.925+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e6484f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.925+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.925+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.5 2024-09-12T17:38:53.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _MmPX1xJfNYeOuZjuGBV-whRVPqRkegn 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bQSf7jHXgQz1zb0hPVk-lIAfIZ1Bc11_0 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bQSf7jHXgQz1zb0hPVk-lIAfIZ1Bc11_1 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:38:53.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bQSf7jHXgQz1zb0hPVk-lIAfIZ1Bc11_2 2024-09-12T17:38:53.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T17:38:53.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.927+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _MmPX1xJfNYeOuZjuGBV-whRVPqRkegn 2024-09-12T17:38:53.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.928+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:38:53.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.928+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.929+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.929+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _wRqzu_TsBNOUGck3ka1CEPBq5igoMsT 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.929+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.929+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.929+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.5 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _wRqzu_TsBNOUGck3ka1CEPBq5igoMsT 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lz3wCFwUTEWaMU1-A9FCZs5y-VEL_Vs_0 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lz3wCFwUTEWaMU1-A9FCZs5y-VEL_Vs_1 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lz3wCFwUTEWaMU1-A9FCZs5y-VEL_Vs_2 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.931+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _wRqzu_TsBNOUGck3ka1CEPBq5igoMsT 2024-09-12T17:38:53.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.932+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:38:53.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.932+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.933+0000 7fcf43a96800 10 manifest: total_size = 16376 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.933+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3588420868909237933 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.933+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3405d040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.933+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.933+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.5 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7672 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7669 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=3 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4197880 part_ofs=7672 rule->part_size=7669 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=1035 2024-09-12T17:38:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4205549 part_ofs=15341 rule->part_size=1035 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=16376 rule->part_size=1035 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3588420868909237933 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.1 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.2 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.3 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.936+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3588420868909237933 2024-09-12T17:38:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.937+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:38:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.937+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c0612d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.937+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.937+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _wLx6uckmU1IkuaKwD9F6A1EGnQuKW43 2024-09-12T17:38:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.937+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c0612d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.937+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.937+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.7 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _wLx6uckmU1IkuaKwD9F6A1EGnQuKW43 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bVPc9E7H03FzWE10iTHFzlmd_vRZnCo_0 2024-09-12T17:38:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:38:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bVPc9E7H03FzWE10iTHFzlmd_vRZnCo_1 2024-09-12T17:38:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:38:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bVPc9E7H03FzWE10iTHFzlmd_vRZnCo_2 2024-09-12T17:38:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:38:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.940+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _wLx6uckmU1IkuaKwD9F6A1EGnQuKW43 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.941+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.941+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c064b70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.941+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.941+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1702479025952665293 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.941+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c064b70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.941+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.941+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.7 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1702479025952665293 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:38:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1_1 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2_1 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.3 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.944+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1702479025952665293 2024-09-12T17:38:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.945+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:38:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.945+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e4110 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.945+0000 7fcf43a96800 10 manifest: total_size = 16376 2024-09-12T17:38:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.945+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17361355683188347775 2024-09-12T17:38:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.945+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e4110 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.945+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.945+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.7 2024-09-12T17:38:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T17:38:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7672 2024-09-12T17:38:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7669 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=3 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4197880 part_ofs=7672 rule->part_size=7669 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=1035 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4205549 part_ofs=15341 rule->part_size=1035 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=16376 rule->part_size=1035 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17361355683188347775 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.1 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.2 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:38:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.3 2024-09-12T17:38:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:38:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.948+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17361355683188347775 2024-09-12T17:38:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.949+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:38:53.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.949+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.950+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.950+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14479100401225494045 2024-09-12T17:38:53.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.950+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.950+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.950+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.8 2024-09-12T17:38:53.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14479100401225494045 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1_1 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2_1 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.3 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.952+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14479100401225494045 2024-09-12T17:38:53.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.953+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:38:53.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.953+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5ece80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.954+0000 7fcf43a96800 10 manifest: total_size = 16376 2024-09-12T17:38:53.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.954+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to _L4xYiq0CaQl4Occ4qt2A46MorhDnPo- 2024-09-12T17:38:53.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.954+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5ece80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.954+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.954+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.8 2024-09-12T17:38:53.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:53.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=0 rule->part_size=0 2024-09-12T17:38:53.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: _L4xYiq0CaQl4Occ4qt2A46MorhDnPo- 2024-09-12T17:38:53.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.hgi3q1P7ybnipwgvF-hqvI_PeFkTa-t_0 2024-09-12T17:38:53.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:38:53.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.956+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _L4xYiq0CaQl4Occ4qt2A46MorhDnPo- 2024-09-12T17:38:53.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.958+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:38:53.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.958+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5ece80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.958+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.958+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8397306178104069296 2024-09-12T17:38:53.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.958+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5ece80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x559c8e5df1f8 s->prefetch_data=0 2024-09-12T17:38:53.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.958+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df1f8 2024-09-12T17:38:53.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.958+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17.9 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8397306178104069296 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1_1 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:38:53.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2_1 2024-09-12T17:38:53.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:38:53.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.3 2024-09-12T17:38:53.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:38:53.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.960+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8397306178104069296 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.962+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.962+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.962+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.963+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.963+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.963+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.963+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.963+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.964+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:38:53.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.964+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.965+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:38:53.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.965+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:38:53.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.965+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:38:53.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.966+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:38:53.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.966+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:38:53.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.966+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94130891442560 notifier 6036 bl.length()=199 2024-09-12T17:38:53.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.968+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 from cache 2024-09-12T17:38:53.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.968+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17, ofs0, ns] 2024-09-12T17:38:53.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.968+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94130891440992 notifier 6036 bl.length()=257 2024-09-12T17:38:53.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.971+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 : miss 2024-09-12T17:38:53.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.971+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.971+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:53.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.971+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 info.flags=0x0 2024-09-12T17:38:53.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.971+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17 to cache LRU end 2024-09-12T17:38:53.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.973+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 : miss 2024-09-12T17:38:53.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.973+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.974+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:38:53.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.974+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 info.flags=0x17 2024-09-12T17:38:53.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.974+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 to cache LRU end 2024-09-12T17:38:53.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.974+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:53.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.974+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:53.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.974+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 2024-09-12T17:38:53.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.976+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:38:53.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.976+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:38:53.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.977+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:38:53.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.978+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x559c8e5cf508 s->prefetch_data=0 2024-09-12T17:38:53.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.978+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.978+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.860461203120895824 2024-09-12T17:38:53.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.978+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x559c8e5cf508 s->prefetch_data=0 2024-09-12T17:38:53.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.978+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5cf508 2024-09-12T17:38:53.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.978+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15.3 2024-09-12T17:38:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.860461203120895824 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.1 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.1_1 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 631 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.2 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 898 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.2_1 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1163 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.3 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1430 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.981+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.860461203120895824 2024-09-12T17:38:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.982+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:38:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.983+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x559c8e5cf508 s->prefetch_data=0 2024-09-12T17:38:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.983+0000 7fcf43a96800 10 manifest: total_size = 1087 2024-09-12T17:38:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.983+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13270676448367995564 2024-09-12T17:38:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.983+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x559c8e5cf508 s->prefetch_data=0 2024-09-12T17:38:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.983+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5cf508 2024-09-12T17:38:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.983+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15.5 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=55 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13270676448367995564 2024-09-12T17:38:53.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-STANDARD.2~ga_EGywADQPpfw1G68NdD-bEVQWECyY.1 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-STANDARD.2~ga_EGywADQPpfw1G68NdD-bEVQWECyY.2 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-STANDARD.2~ga_EGywADQPpfw1G68NdD-bEVQWECyY.3 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.986+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13270676448367995564 2024-09-12T17:38:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.987+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:38:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.987+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e65c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x559c8e5cf508 s->prefetch_data=0 2024-09-12T17:38:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.987+0000 7fcf43a96800 10 manifest: total_size = 11534336 2024-09-12T17:38:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.987+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13849379604806785469 2024-09-12T17:38:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.987+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e65c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x559c8e5cf508 s->prefetch_data=0 2024-09-12T17:38:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.987+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5cf508 2024-09-12T17:38:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.987+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15.7 2024-09-12T17:38:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:38:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:38:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:38:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13849379604806785469 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.1 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.1_1 2024-09-12T17:38:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.2 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.2_1 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.3 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.990+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13849379604806785469 2024-09-12T17:38:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.991+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:38:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.992+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.992+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.992+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.992+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.992+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.992+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.992+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.994+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:38:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.994+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.994+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:38:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.994+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:38:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.994+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:38:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.995+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:38:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.995+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:38:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.996+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94130891450960 notifier 6036 bl.length()=194 2024-09-12T17:38:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.997+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 from cache 2024-09-12T17:38:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.997+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15, ofs0, ns] 2024-09-12T17:38:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:53.998+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94130891440992 notifier 6036 bl.length()=252 2024-09-12T17:38:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.000+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 : miss 2024-09-12T17:38:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.000+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.000+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.000+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 info.flags=0x0 2024-09-12T17:38:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.000+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15 to cache LRU end 2024-09-12T17:38:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 : miss 2024-09-12T17:38:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:38:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 info.flags=0x17 2024-09-12T17:38:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 to cache LRU end 2024-09-12T17:38:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.003+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 2024-09-12T17:38:54.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.005+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:38:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.005+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:38:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.006+0000 7fcf43a96800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:38:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.007+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf340990e0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559c8e5dfbb8 s->prefetch_data=0 2024-09-12T17:38:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.007+0000 7fcf43a96800 10 manifest: total_size = 10485760 2024-09-12T17:38:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.007+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8847413019500979159 2024-09-12T17:38:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.007+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf340990e0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559c8e5dfbb8 s->prefetch_data=0 2024-09-12T17:38:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.007+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5dfbb8 2024-09-12T17:38:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.007+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14.3 2024-09-12T17:38:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8847413019500979159 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.afdGEyNSauR3oDrMzITRnK47KkIk6Z3_0 2024-09-12T17:38:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:38:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.afdGEyNSauR3oDrMzITRnK47KkIk6Z3_1 2024-09-12T17:38:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T17:38:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.afdGEyNSauR3oDrMzITRnK47KkIk6Z3_2 2024-09-12T17:38:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-12T17:38:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.010+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8847413019500979159 2024-09-12T17:38:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.011+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:38:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.011+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3403bca0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559c8e5dfbb8 s->prefetch_data=0 2024-09-12T17:38:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.011+0000 7fcf43a96800 10 manifest: total_size = 53502 2024-09-12T17:38:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.011+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13093500823343196536 2024-09-12T17:38:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.011+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3403bca0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559c8e5dfbb8 s->prefetch_data=0 2024-09-12T17:38:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.011+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5dfbb8 2024-09-12T17:38:54.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.011+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14.5 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=53502 stripe_ofs=53502 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13093500823343196536 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.Ukz0OJlJLK1TSVzmNxx5ZXQQXvMyKXw_0 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.014+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13093500823343196536 2024-09-12T17:38:54.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.015+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:38:54.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.017+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5923c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559c8e5dfbb8 s->prefetch_data=0 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.017+0000 7fcf43a96800 10 manifest: total_size = 10485760 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.017+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1353714290024355722 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.017+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5923c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559c8e5dfbb8 s->prefetch_data=0 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.017+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5dfbb8 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.017+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14.7 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1353714290024355722 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.OVbNV8QfdfzSdSMXNx8xUPRJiTnpGyS_0 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.OVbNV8QfdfzSdSMXNx8xUPRJiTnpGyS_1 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.OVbNV8QfdfzSdSMXNx8xUPRJiTnpGyS_2 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.020+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1353714290024355722 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.021+0000 7fce13fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.021+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.021+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.022+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.022+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.022+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.022+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:54.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.022+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:54.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.024+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:38:54.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.024+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.024+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:38:54.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.024+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:38:54.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.024+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:38:54.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.025+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:38:54.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.025+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:38:54.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.025+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94130891439248 notifier 6036 bl.length()=184 2024-09-12T17:38:54.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.027+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 from cache 2024-09-12T17:38:54.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.027+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14, ofs0, ns] 2024-09-12T17:38:54.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.027+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94130891450960 notifier 6036 bl.length()=242 2024-09-12T17:38:54.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.030+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 : miss 2024-09-12T17:38:54.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.030+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.030+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.030+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 info.flags=0x0 2024-09-12T17:38:54.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.030+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14 to cache LRU end 2024-09-12T17:38:54.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.032+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 : miss 2024-09-12T17:38:54.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.032+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.033+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:38:54.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.033+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 info.flags=0x17 2024-09-12T17:38:54.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.033+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 to cache LRU end 2024-09-12T17:38:54.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.033+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:54.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.033+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:54.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.033+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 2024-09-12T17:38:54.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.034+0000 7fcf43a96800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:38:54.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.034+0000 7fcf43a96800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:38:54.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.035+0000 7fcf43a96800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:38:54.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.036+0000 7fcf43a96800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:38:54.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.037+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.037+0000 7fcf43a96800 10 manifest: total_size = 0 2024-09-12T17:38:54.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.037+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12308140026073803890 2024-09-12T17:38:54.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.037+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.037+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f4198 2024-09-12T17:38:54.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.037+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7.2 2024-09-12T17:38:54.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.040+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.040+0000 7fcf43a96800 10 manifest: total_size = 0 2024-09-12T17:38:54.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.040+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9737397427486417656 2024-09-12T17:38:54.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.040+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.040+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f4198 2024-09-12T17:38:54.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.040+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7.3 2024-09-12T17:38:54.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.042+0000 7fce13fff640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:38:54.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.044+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.044+0000 7fcf43a96800 10 manifest: total_size = 0 2024-09-12T17:38:54.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.044+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4988283487666096736 2024-09-12T17:38:54.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.044+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.044+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f4198 2024-09-12T17:38:54.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.044+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7.6 2024-09-12T17:38:54.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.045+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:38:54.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.046+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e0290 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.047+0000 7fcf43a96800 10 manifest: total_size = 0 2024-09-12T17:38:54.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.047+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1759619565537052778 2024-09-12T17:38:54.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.047+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e0290 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559c8e5f4198 s->prefetch_data=0 2024-09-12T17:38:54.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.047+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f4198 2024-09-12T17:38:54.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.047+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7.8 2024-09-12T17:38:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.049+0000 7fce13fff640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:38:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.049+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.049+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.051+0000 7fce13fff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:38:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.051+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.051+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.051+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:54.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.051+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:54.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.051+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:54.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.053+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:38:54.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.053+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.053+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:38:54.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.053+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:38:54.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.053+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:38:54.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.054+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:38:54.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.054+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:38:54.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.055+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94130891436912 notifier 6036 bl.length()=181 2024-09-12T17:38:54.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.056+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 from cache 2024-09-12T17:38:54.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.056+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7, ofs0, ns] 2024-09-12T17:38:54.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.057+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94130891450960 notifier 6036 bl.length()=238 2024-09-12T17:38:54.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.061+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 : miss 2024-09-12T17:38:54.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.061+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.061+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.061+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 info.flags=0x0 2024-09-12T17:38:54.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.061+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7 to cache LRU end 2024-09-12T17:38:54.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 : miss 2024-09-12T17:38:54.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:38:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 info.flags=0x17 2024-09-12T17:38:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 to cache LRU end 2024-09-12T17:38:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.064+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 2024-09-12T17:38:54.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.065+0000 7fcf43a96800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:38:54.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.066+0000 7fcf43a96800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:38:54.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.067+0000 7fcf43a96800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:38:54.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.067+0000 7fcf43a96800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:38:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.068+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.069+0000 7fcf43a96800 10 manifest: total_size = 527 2024-09-12T17:38:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.069+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1365187130805176022 2024-09-12T17:38:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.069+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.069+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3208 2024-09-12T17:38:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.069+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8.2 2024-09-12T17:38:54.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1365187130805176022 2024-09-12T17:38:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.DpkoIKitMX_ACAkbEZi1hhl1ZCIEHS8_0 2024-09-12T17:38:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.071+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1365187130805176022 2024-09-12T17:38:54.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.072+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:38:54.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.073+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.073+0000 7fcf43a96800 10 manifest: total_size = 24595 2024-09-12T17:38:54.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.073+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3157625835509693513 2024-09-12T17:38:54.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.073+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.073+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3208 2024-09-12T17:38:54.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.073+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8.3 2024-09-12T17:38:54.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3157625835509693513 2024-09-12T17:38:54.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.S9XFPokD_r7cMCu-OD4vl72lvF8LZW8_0 2024-09-12T17:38:54.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:54.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.075+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3157625835509693513 2024-09-12T17:38:54.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.077+0000 7fce13fff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:38:54.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.077+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.077+0000 7fcf43a96800 10 manifest: total_size = 527 2024-09-12T17:38:54.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.077+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9682073937427924726 2024-09-12T17:38:54.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.077+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.077+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3208 2024-09-12T17:38:54.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.077+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8.6 2024-09-12T17:38:54.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9682073937427924726 2024-09-12T17:38:54.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.AsFKYhzo2B8I7S8xbKMIEOm7BvuQ4Z5_0 2024-09-12T17:38:54.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:54.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.079+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9682073937427924726 2024-09-12T17:38:54.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.081+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:38:54.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.081+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.081+0000 7fcf43a96800 10 manifest: total_size = 2078 2024-09-12T17:38:54.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.081+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9361867794258095710 2024-09-12T17:38:54.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.081+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5e5490 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559c8e5f3208 s->prefetch_data=0 2024-09-12T17:38:54.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.081+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5f3208 2024-09-12T17:38:54.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.081+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8.8 2024-09-12T17:38:54.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9361867794258095710 2024-09-12T17:38:54.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.WL8rMY04YAVBgdXSPyyAUWSyo1HD2LD_0 2024-09-12T17:38:54.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:54.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.084+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9361867794258095710 2024-09-12T17:38:54.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.085+0000 7fce13fff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:38:54.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.086+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:54.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.086+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:54.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.086+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:54.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.086+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:54.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.086+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:54.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.086+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:54.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.086+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:54.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.088+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:38:54.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.088+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.089+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:38:54.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.089+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:38:54.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.089+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:38:54.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.090+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:38:54.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.090+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:38:54.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.090+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94130891436912 notifier 6036 bl.length()=181 2024-09-12T17:38:54.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.091+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 from cache 2024-09-12T17:38:54.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.091+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8, ofs0, ns] 2024-09-12T17:38:54.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.092+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94130891450960 notifier 6036 bl.length()=238 2024-09-12T17:38:54.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.094+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 : miss 2024-09-12T17:38:54.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.094+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.095+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.095+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 info.flags=0x0 2024-09-12T17:38:54.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.095+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8 to cache LRU end 2024-09-12T17:38:54.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 : miss 2024-09-12T17:38:54.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:38:54.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 info.flags=0x17 2024-09-12T17:38:54.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 to cache LRU end 2024-09-12T17:38:54.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:54.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:38:54.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.097+0000 7fcf43a96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 2024-09-12T17:38:54.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.098+0000 7fcf43a96800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:38:54.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.098+0000 7fcf43a96800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:38:54.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.100+0000 7fcf43a96800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:38:54.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.100+0000 7fcf43a96800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:38:54.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.101+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559c8e5ced28 s->prefetch_data=0 2024-09-12T17:38:54.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.101+0000 7fcf43a96800 10 manifest: total_size = 55 2024-09-12T17:38:54.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.101+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4427656836834026766 2024-09-12T17:38:54.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.101+0000 7fcf43a96800 20 get_obj_state: octx=0x559c8e5d5360 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559c8e5ced28 s->prefetch_data=0 2024-09-12T17:38:54.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.101+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ced28 2024-09-12T17:38:54.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.101+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9.2 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4427656836834026766 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.xUPnqn7vxkeMInREuqkl8_qJgC3566o_0 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.104+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4427656836834026766 2024-09-12T17:38:54.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.105+0000 7fce13fff640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:38:54.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.105+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c008f30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559c8e5ced28 s->prefetch_data=0 2024-09-12T17:38:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.106+0000 7fcf43a96800 10 manifest: total_size = 49187 2024-09-12T17:38:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.106+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9656201133291160305 2024-09-12T17:38:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.106+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf3c008f30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559c8e5ced28 s->prefetch_data=0 2024-09-12T17:38:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.106+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5ced28 2024-09-12T17:38:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.106+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9.3 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9656201133291160305 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.FyUWg53Y7sjyMwihVGUkKD7dgzg9Dhe_0 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.108+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9656201133291160305 2024-09-12T17:38:54.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.109+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:38:54.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.110+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559c8e5df368 s->prefetch_data=0 2024-09-12T17:38:54.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.110+0000 7fcf43a96800 10 manifest: total_size = 4134 2024-09-12T17:38:54.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.110+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11387412115418875937 2024-09-12T17:38:54.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.110+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559c8e5df368 s->prefetch_data=0 2024-09-12T17:38:54.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.110+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df368 2024-09-12T17:38:54.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.110+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9.6 2024-09-12T17:38:54.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11387412115418875937 2024-09-12T17:38:54.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.vqhI9lvDt6aa4AwR6mZQcLKQ9FAaG28_0 2024-09-12T17:38:54.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:38:54.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.112+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11387412115418875937 2024-09-12T17:38:54.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.113+0000 7fce13fff640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:38:54.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.114+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559c8e5df368 s->prefetch_data=0 2024-09-12T17:38:54.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.114+0000 7fcf43a96800 10 manifest: total_size = 49187 2024-09-12T17:38:54.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.114+0000 7fcf43a96800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17441666693944310441 2024-09-12T17:38:54.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.114+0000 7fcf43a96800 20 get_obj_state: octx=0x7fcf38003fb0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559c8e5df368 s->prefetch_data=0 2024-09-12T17:38:54.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.114+0000 7fcf43a96800 20 prepare_atomic_modification: state is not atomic. state=0x559c8e5df368 2024-09-12T17:38:54.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.114+0000 7fcf43a96800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9.8 2024-09-12T17:38:54.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.116+0000 7fcf43a96800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:54.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.116+0000 7fcf43a96800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T17:38:54.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.116+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17441666693944310441 2024-09-12T17:38:54.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.116+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:38:54.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.116+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.1NrMWBzBasVTHkQP0Vp3zkh_sMNsIgR_0 2024-09-12T17:38:54.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.116+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:38:54.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.116+0000 7fcf43a96800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:38:54.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.117+0000 7fcf43a96800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17441666693944310441 2024-09-12T17:38:54.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.118+0000 7fce24ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:38:54.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.118+0000 7fcf43a96800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:38:54.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.118+0000 7fcf43a96800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:38:54.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.119+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:38:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.119+0000 7fcf43a96800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:38:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.119+0000 7fcf43a96800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:38:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.119+0000 7fcf43a96800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:38:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.119+0000 7fcf43a96800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:38:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.121+0000 7fcf43a96800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:38:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.121+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.121+0000 7fcf43a96800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:38:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.121+0000 7fcf43a96800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:38:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.121+0000 7fcf43a96800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:38:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.122+0000 7fcf43a96800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:38:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.122+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:38:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.122+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94130891436912 notifier 6036 bl.length()=181 2024-09-12T17:38:54.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.124+0000 7fcf43a96800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 from cache 2024-09-12T17:38:54.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.124+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9, ofs0, ns] 2024-09-12T17:38:54.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.124+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94130891450960 notifier 6036 bl.length()=238 2024-09-12T17:38:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.127+0000 7fcf43a96800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 : miss 2024-09-12T17:38:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.127+0000 7fcf43a96800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.127+0000 7fcf43a96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.127+0000 7fcf43a96800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 info.flags=0x0 2024-09-12T17:38:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.127+0000 7fcf43a96800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9 to cache LRU end 2024-09-12T17:38:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.129+0000 7fcf43a96800 10 removing key index: XWLYDCJNTMJNQGKLGTLL 2024-09-12T17:38:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.130+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:XWLYDCJNTMJNQGKLGTLL, ofs0, ns] 2024-09-12T17:38:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.130+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94130891436912 notifier 6036 bl.length()=170 2024-09-12T17:38:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.130+0000 7fcf43a96800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:38:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.131+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:38:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.132+0000 7fce24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94130891439248 notifier 6036 bl.length()=182 2024-09-12T17:38:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.132+0000 7fcf43a96800 10 removing user buckets index 2024-09-12T17:38:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.133+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:38:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.133+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94130891450960 notifier 6036 bl.length()=173 2024-09-12T17:38:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.134+0000 7fcf43a96800 10 removing user index: ragweed.client.0 2024-09-12T17:38:54.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.135+0000 7fcf43a96800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:38:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.135+0000 7fcf43a96800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:38:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.135+0000 7fce13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94130891445984 notifier 6036 bl.length()=165 2024-09-12T17:38:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.136+0000 7fcdf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.139+0000 7fcf43a96800 20 remove_watcher() i=0 2024-09-12T17:38:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.139+0000 7fcf43a96800 2 removed watcher, disabling cache 2024-09-12T17:38:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.140+0000 7fcf43a96800 20 remove_watcher() i=1 2024-09-12T17:38:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.140+0000 7fcf43a96800 20 remove_watcher() i=2 2024-09-12T17:38:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.141+0000 7fcf43a96800 20 remove_watcher() i=3 2024-09-12T17:38:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.142+0000 7fcf43a96800 20 remove_watcher() i=4 2024-09-12T17:38:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.143+0000 7fcf43a96800 20 remove_watcher() i=5 2024-09-12T17:38:54.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.144+0000 7fcf43a96800 20 remove_watcher() i=6 2024-09-12T17:38:54.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.145+0000 7fcf43a96800 20 remove_watcher() i=7 2024-09-12T17:38:54.157 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:38:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.291+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.292+0000 7f1520531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.292+0000 7f1520531800 20 realm 2024-09-12T17:38:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.292+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.292+0000 7f1520531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.292+0000 7f1520531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.293+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.293+0000 7f1520531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.293+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.293+0000 7f1520531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.293+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.294+0000 7f1520531800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.294+0000 7f1520531800 20 searching for the correct realm 2024-09-12T17:38:54.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.297+0000 7f1513fff640 0 -- 172.21.15.63:0/804474068 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f150401a040 msgr2=0x7f15040243a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:54.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.503+0000 7f151ca77640 0 -- 172.21.15.63:0/804474068 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55ea24ceb010 msgr2=0x55ea24ced480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.507+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 zone default found 2024-09-12T17:38:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 4 Realm: () 2024-09-12T17:38:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:38:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:38:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 zonegroup default 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.508+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.509+0000 7f1520531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.509+0000 7f1520531800 20 started sync module instance, tier type = 2024-09-12T17:38:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.509+0000 7f1520531800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:38:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.518+0000 7f1520531800 20 add_watcher() i=0 2024-09-12T17:38:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.518+0000 7f1520531800 20 add_watcher() i=1 2024-09-12T17:38:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.518+0000 7f1520531800 20 add_watcher() i=2 2024-09-12T17:38:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.518+0000 7f1520531800 20 add_watcher() i=3 2024-09-12T17:38:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.518+0000 7f1520531800 20 add_watcher() i=4 2024-09-12T17:38:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.518+0000 7f1520531800 20 add_watcher() i=5 2024-09-12T17:38:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.518+0000 7f1520531800 20 add_watcher() i=6 2024-09-12T17:38:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.519+0000 7f1520531800 20 add_watcher() i=7 2024-09-12T17:38:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.519+0000 7f1520531800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.521+0000 7f13d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.522+0000 7f1520531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:54.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.522+0000 7f1520531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:54.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.558+0000 7f13d17e2640 20 reqs_thread_entry: start 2024-09-12T17:38:54.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.558+0000 7f1520531800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:54.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.558+0000 7f1520531800 20 Filter name: none 2024-09-12T17:38:54.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.558+0000 7f1342ffd640 20 reqs_thread_entry: start 2024-09-12T17:38:54.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.558+0000 7f1520531800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:38:54.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.558+0000 7f1520531800 20 rados->read ofs=0 len=0 2024-09-12T17:38:54.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.559+0000 7f1520531800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:38:54.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.559+0000 7f1520531800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:38:54.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.559+0000 7f1520531800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:38:54.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.559+0000 7f1520531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:54.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.559+0000 7f1520531800 10 removing key index: IUQJYEIPYWAMGYEPYWQQ 2024-09-12T17:38:54.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.560+0000 7f1520531800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:IUQJYEIPYWAMGYEPYWQQ, ofs0, ns] 2024-09-12T17:38:54.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.560+0000 7f13f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94464128305472 notifier 5738 bl.length()=170 2024-09-12T17:38:54.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.561+0000 7f1520531800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:38:54.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.562+0000 7f1520531800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:38:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.562+0000 7f13f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94464128296960 notifier 5738 bl.length()=182 2024-09-12T17:38:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.563+0000 7f1520531800 10 removing user buckets index 2024-09-12T17:38:54.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.564+0000 7f1520531800 10 removing user index: sysuser.client.0 2024-09-12T17:38:54.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.565+0000 7f1520531800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:38:54.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.565+0000 7f1520531800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:38:54.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.565+0000 7f13f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94464128289856 notifier 5738 bl.length()=165 2024-09-12T17:38:54.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.567+0000 7f13d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.569+0000 7f1520531800 20 remove_watcher() i=0 2024-09-12T17:38:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.569+0000 7f1520531800 2 removed watcher, disabling cache 2024-09-12T17:38:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.570+0000 7f1520531800 20 remove_watcher() i=1 2024-09-12T17:38:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.571+0000 7f1520531800 20 remove_watcher() i=2 2024-09-12T17:38:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.572+0000 7f1520531800 20 remove_watcher() i=3 2024-09-12T17:38:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.573+0000 7f1520531800 20 remove_watcher() i=4 2024-09-12T17:38:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.574+0000 7f1520531800 20 remove_watcher() i=5 2024-09-12T17:38:54.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.575+0000 7f1520531800 20 remove_watcher() i=6 2024-09-12T17:38:54.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:38:54.576+0000 7f1520531800 20 remove_watcher() i=7 2024-09-12T17:38:54.588 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:38:54.588 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:38:54.663 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:38:54.675 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:38:54.675 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:38:54.676 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:54.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:38:54.707 INFO:teuthology.orchestra.run.smithi063.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:38:54.707 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:54.777 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:54.777 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:38:54.846 INFO:tasks.workunit:timeout=3h 2024-09-12T17:38:54.846 INFO:tasks.workunit:cleanup=True 2024-09-12T17:38:54.847 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:38:54.917 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:39:55.303 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 92% (11766/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:39:55.878 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:39:55.879 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:39:55.879 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:39:55.879 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:39:55.879 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:39:55.879 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:39:55.879 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:39:55.880 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:39:55.881 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:39:55.884 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:39:55.954 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:39:55.956 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:39:55.956 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:39:56.008 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:39:56.058 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:39:56.099 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:39:56.100 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:39:56.100 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:39:56.141 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:39:56.144 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:39:56.144 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:39:56.215 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:39:56.217 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:39:56.217 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:39:56.289 INFO:tasks.workunit.client.0.smithi063.stderr:+ ulimit -c 0 2024-09-12T17:39:56.289 INFO:tasks.workunit.client.0.smithi063.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:39:56.290 INFO:tasks.workunit.client.0.smithi063.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:39:56.290 INFO:tasks.workunit.client.0.smithi063.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:39:58.667 INFO:tasks.workunit.client.0.smithi063.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ deactivate nondestructive 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ export VIRTUAL_ENV 2024-09-12T17:39:58.668 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:39:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:39:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PATH 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -z '' ']' 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:++ PS1='(rgw) ' 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PS1 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T17:39:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install pip --upgrade 2024-09-12T17:39:58.912 INFO:tasks.workunit.client.0.smithi063.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:39:59.106 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting pip 2024-09-12T17:39:59.112 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:39:59.158 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: pip 2024-09-12T17:39:59.159 INFO:tasks.workunit.client.0.smithi063.stdout: Attempting uninstall: pip 2024-09-12T17:39:59.159 INFO:tasks.workunit.client.0.smithi063.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:39:59.323 INFO:tasks.workunit.client.0.smithi063.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:39:59.329 INFO:tasks.workunit.client.0.smithi063.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:40:00.101 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed pip-24.2 2024-09-12T17:40:00.151 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install boto3 2024-09-12T17:40:00.961 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting boto3 2024-09-12T17:40:00.962 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:40:01.562 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:40:01.564 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:40:01.611 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:40:01.612 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:40:01.665 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:40:01.667 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:40:01.717 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:40:01.718 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:40:01.796 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:40:01.797 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:40:02.048 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:40:02.049 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:40:02.053 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:40:02.054 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:40:02.064 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:40:02.065 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:40:02.067 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:40:02.068 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:40:02.069 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:40:02.147 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:40:03.229 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:40:03.348 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:40:03.475 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:40:03.510 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:03.511 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:03.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.548+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.550+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.550+0000 7f9d24725800 20 realm 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.550+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.550+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.550+0000 7f9d24725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.550+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.551+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.551+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.551+0000 7f9d24725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:03.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.551+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.552+0000 7f9d24725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:03.555 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.552+0000 7f9d24725800 20 searching for the correct realm 2024-09-12T17:40:03.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.554+0000 7f9d203ae640 0 -- 172.21.15.63:0/2874532663 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f9d10099070 msgr2=0x7f9d1005e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:03.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.760+0000 7f9d203ae640 0 -- 172.21.15.63:0/2874532663 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f9d08003c60 msgr2=0x7f9d180617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:03.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:03.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:03.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:03.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:03.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:03.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:03.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:03.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.967+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 zone default found 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 4 Realm: () 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 zonegroup default 2024-09-12T17:40:03.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.968+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.969+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.969+0000 7f9d24725800 20 started sync module instance, tier type = 2024-09-12T17:40:03.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.969+0000 7f9d24725800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.978+0000 7f9d24725800 20 add_watcher() i=0 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.978+0000 7f9d24725800 20 add_watcher() i=1 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.978+0000 7f9d24725800 20 add_watcher() i=2 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.978+0000 7f9d24725800 20 add_watcher() i=3 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.978+0000 7f9d24725800 20 add_watcher() i=4 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.978+0000 7f9d24725800 20 add_watcher() i=5 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.978+0000 7f9d24725800 20 add_watcher() i=6 2024-09-12T17:40:03.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.980+0000 7f9d24725800 20 add_watcher() i=7 2024-09-12T17:40:03.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.980+0000 7f9d24725800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:03.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.981+0000 7f9bd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:03.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9d24725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:03.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9d24725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:03.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9d24725800 5 note: GC not initialized 2024-09-12T17:40:03.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9bd5fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:03.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9d24725800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:03.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9d24725800 20 Filter name: none 2024-09-12T17:40:03.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9b477fe640 20 reqs_thread_entry: start 2024-09-12T17:40:03.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.982+0000 7f9d24725800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:40:03.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.983+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.983+0000 7f9d24725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:03.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.983+0000 7f9d24725800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.983+0000 7f9d24725800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.983+0000 7f9d24725800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.983+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 20 rados->read ofs=0 len=0 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T17:40:03.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:03.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T17:40:03.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.984+0000 7f9d24725800 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:40:03.988 INFO:tasks.workunit.client.0.smithi063.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T17:40:03.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.985+0000 7f9bd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:03.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.987+0000 7f9d24725800 20 remove_watcher() i=0 2024-09-12T17:40:03.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.987+0000 7f9d24725800 2 removed watcher, disabling cache 2024-09-12T17:40:03.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.988+0000 7f9d24725800 20 remove_watcher() i=1 2024-09-12T17:40:03.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.990+0000 7f9d24725800 20 remove_watcher() i=2 2024-09-12T17:40:03.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.991+0000 7f9d24725800 20 remove_watcher() i=3 2024-09-12T17:40:03.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.992+0000 7f9d24725800 20 remove_watcher() i=4 2024-09-12T17:40:03.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.994+0000 7f9d24725800 20 remove_watcher() i=5 2024-09-12T17:40:03.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.995+0000 7f9d24725800 20 remove_watcher() i=6 2024-09-12T17:40:03.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:03.996+0000 7f9d24725800 20 remove_watcher() i=7 2024-09-12T17:40:04.240 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard add 2024-09-12T17:40:04.240 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:04.241 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:40:04.273 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:04.273 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:04.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.310+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 20 realm 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.312+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.313+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:04.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.313+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.313+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:04.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.313+0000 7f9fa120f800 20 searching for the correct realm 2024-09-12T17:40:04.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.317+0000 7f9f9e4ff640 0 -- 172.21.15.63:0/2407023293 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f9f940980b0 msgr2=0x7f9f9404b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:04.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.320+0000 7f9f9ed00640 0 -- 172.21.15.63:0/2407023293 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f9f98087910 msgr2=0x7f9f980793f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:04.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.324+0000 7f9fa120f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.324+0000 7f9fa120f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.324+0000 7f9fa120f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.324+0000 7f9fa120f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.324+0000 7f9fa120f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.324+0000 7f9fa120f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.324+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:04.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:04.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 zone default found 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 4 Realm: () 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 zonegroup default 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.325+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.326+0000 7f9fa120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.326+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.326+0000 7f9fa120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.326+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.326+0000 7f9fa120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.326+0000 7f9fa120f800 20 started sync module instance, tier type = 2024-09-12T17:40:04.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.326+0000 7f9fa120f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:04.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.336+0000 7f9fa120f800 20 add_watcher() i=0 2024-09-12T17:40:04.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.336+0000 7f9fa120f800 20 add_watcher() i=1 2024-09-12T17:40:04.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.336+0000 7f9fa120f800 20 add_watcher() i=2 2024-09-12T17:40:04.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.336+0000 7f9fa120f800 20 add_watcher() i=3 2024-09-12T17:40:04.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.336+0000 7f9fa120f800 20 add_watcher() i=4 2024-09-12T17:40:04.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.336+0000 7f9fa120f800 20 add_watcher() i=5 2024-09-12T17:40:04.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.336+0000 7f9fa120f800 20 add_watcher() i=6 2024-09-12T17:40:04.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.337+0000 7f9fa120f800 20 add_watcher() i=7 2024-09-12T17:40:04.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.337+0000 7f9fa120f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:04.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.339+0000 7f9e557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:04.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9fa120f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9fa120f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9fa120f800 5 note: GC not initialized 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9dcffff640 20 reqs_thread_entry: start 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9fa120f800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9fa120f800 20 Filter name: none 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9dcdffb640 20 reqs_thread_entry: start 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.340+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.341+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.341+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.341+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.341+0000 7f9fa120f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:04.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.341+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.342+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:04.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.342+0000 7f9fa120f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.342+0000 7f9fa120f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:04.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.342+0000 7f9fa120f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:04.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.344+0000 7f9e557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:04.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.347+0000 7f9fa120f800 20 remove_watcher() i=0 2024-09-12T17:40:04.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.347+0000 7f9fa120f800 2 removed watcher, disabling cache 2024-09-12T17:40:04.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.348+0000 7f9fa120f800 20 remove_watcher() i=1 2024-09-12T17:40:04.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.349+0000 7f9fa120f800 20 remove_watcher() i=2 2024-09-12T17:40:04.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.350+0000 7f9fa120f800 20 remove_watcher() i=3 2024-09-12T17:40:04.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.351+0000 7f9fa120f800 20 remove_watcher() i=4 2024-09-12T17:40:04.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.352+0000 7f9fa120f800 20 remove_watcher() i=5 2024-09-12T17:40:04.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.353+0000 7f9fa120f800 20 remove_watcher() i=6 2024-09-12T17:40:04.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.354+0000 7f9fa120f800 20 remove_watcher() i=7 2024-09-12T17:40:04.367 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:04.367 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:04.367 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:40:04.368 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:04.368 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T17:40:04.400 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:04.401 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:04.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.437+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.439+0000 7f8eae126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.439+0000 7f8eae126800 20 realm 2024-09-12T17:40:04.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.439+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.439+0000 7f8eae126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.439+0000 7f8eae126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:04.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.439+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.439+0000 7f8eae126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.440+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.440+0000 7f8eae126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:04.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.440+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.440+0000 7f8eae126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:04.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.440+0000 7f8eae126800 20 searching for the correct realm 2024-09-12T17:40:04.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.444+0000 7f8ea9508640 0 -- 172.21.15.63:0/3154142446 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f8ea0099910 msgr2=0x7f8ea007d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:04.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.650+0000 7f8ea9508640 0 -- 172.21.15.63:0/3154142446 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5621fcb07870 msgr2=0x5621fcb09d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:04.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:04.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:04.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:04.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:04.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:04.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:04.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:04.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.655+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:04.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 zone default found 2024-09-12T17:40:04.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 4 Realm: () 2024-09-12T17:40:04.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:04.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 zonegroup default 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.656+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.657+0000 7f8eae126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.657+0000 7f8eae126800 20 started sync module instance, tier type = 2024-09-12T17:40:04.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.657+0000 7f8eae126800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:04.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.667+0000 7f8eae126800 20 add_watcher() i=0 2024-09-12T17:40:04.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.667+0000 7f8eae126800 20 add_watcher() i=1 2024-09-12T17:40:04.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.667+0000 7f8eae126800 20 add_watcher() i=2 2024-09-12T17:40:04.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.667+0000 7f8eae126800 20 add_watcher() i=3 2024-09-12T17:40:04.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.667+0000 7f8eae126800 20 add_watcher() i=4 2024-09-12T17:40:04.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.667+0000 7f8eae126800 20 add_watcher() i=5 2024-09-12T17:40:04.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.667+0000 7f8eae126800 20 add_watcher() i=6 2024-09-12T17:40:04.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.668+0000 7f8eae126800 20 add_watcher() i=7 2024-09-12T17:40:04.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.668+0000 7f8eae126800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:04.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.669+0000 7f8d5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:04.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8eae126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:04.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8eae126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:04.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8eae126800 5 note: GC not initialized 2024-09-12T17:40:04.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8d5a7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:04.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8eae126800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:04.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8eae126800 20 Filter name: none 2024-09-12T17:40:04.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8ccffff640 20 reqs_thread_entry: start 2024-09-12T17:40:04.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8eae126800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:04.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.670+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:04.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.671+0000 7f8eae126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:04.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.673+0000 7f8d5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:04.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.676+0000 7f8eae126800 20 remove_watcher() i=0 2024-09-12T17:40:04.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.676+0000 7f8eae126800 2 removed watcher, disabling cache 2024-09-12T17:40:04.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.677+0000 7f8eae126800 20 remove_watcher() i=1 2024-09-12T17:40:04.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.678+0000 7f8eae126800 20 remove_watcher() i=2 2024-09-12T17:40:04.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.679+0000 7f8eae126800 20 remove_watcher() i=3 2024-09-12T17:40:04.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.680+0000 7f8eae126800 20 remove_watcher() i=4 2024-09-12T17:40:04.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.681+0000 7f8eae126800 20 remove_watcher() i=5 2024-09-12T17:40:04.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.682+0000 7f8eae126800 20 remove_watcher() i=6 2024-09-12T17:40:04.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.683+0000 7f8eae126800 20 remove_watcher() i=7 2024-09-12T17:40:04.698 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshard list 2024-09-12T17:40:04.725 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:04.725 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:04.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.763+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.765+0000 7ff1c75af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.765+0000 7ff1c75af800 20 realm 2024-09-12T17:40:04.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.765+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.765+0000 7ff1c75af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.765+0000 7ff1c75af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:04.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.765+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.766+0000 7ff1c75af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.766+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.766+0000 7ff1c75af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:04.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.767+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.767+0000 7ff1c75af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:04.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.767+0000 7ff1c75af800 20 searching for the correct realm 2024-09-12T17:40:04.770 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.769+0000 7ff1c589a640 0 -- 172.21.15.63:0/2168568348 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x558184ae27a0 msgr2=0x558184ae4bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:04.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.772+0000 7ff1c5099640 0 -- 172.21.15.63:0/2168568348 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x558184ae6870 msgr2=0x558184ae8d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:04.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:04.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:04.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:04.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:04.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:04.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.778+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 zone default found 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 4 Realm: () 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:04.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:04.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 zonegroup default 2024-09-12T17:40:04.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.779+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.780+0000 7ff1c75af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.780+0000 7ff1c75af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.780+0000 7ff1c75af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.780+0000 7ff1c75af800 20 started sync module instance, tier type = 2024-09-12T17:40:04.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.780+0000 7ff1c75af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:04.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.789+0000 7ff1c75af800 20 add_watcher() i=0 2024-09-12T17:40:04.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.789+0000 7ff1c75af800 20 add_watcher() i=1 2024-09-12T17:40:04.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.789+0000 7ff1c75af800 20 add_watcher() i=2 2024-09-12T17:40:04.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.789+0000 7ff1c75af800 20 add_watcher() i=3 2024-09-12T17:40:04.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.789+0000 7ff1c75af800 20 add_watcher() i=4 2024-09-12T17:40:04.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.789+0000 7ff1c75af800 20 add_watcher() i=5 2024-09-12T17:40:04.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.789+0000 7ff1c75af800 20 add_watcher() i=6 2024-09-12T17:40:04.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.790+0000 7ff1c75af800 20 add_watcher() i=7 2024-09-12T17:40:04.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.790+0000 7ff1c75af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:04.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.791+0000 7ff07bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:04.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.791+0000 7ff1c75af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:04.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.792+0000 7ff1c75af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:04.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.792+0000 7ff1c75af800 5 note: GC not initialized 2024-09-12T17:40:04.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.792+0000 7ff07afe5640 20 reqs_thread_entry: start 2024-09-12T17:40:04.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.792+0000 7ff1c75af800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:04.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.792+0000 7ff1c75af800 20 Filter name: none 2024-09-12T17:40:04.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.792+0000 7ff078fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:04.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.799+0000 7ff07bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:04.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.801+0000 7ff1c75af800 20 remove_watcher() i=0 2024-09-12T17:40:04.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.801+0000 7ff1c75af800 2 removed watcher, disabling cache 2024-09-12T17:40:04.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.802+0000 7ff1c75af800 20 remove_watcher() i=1 2024-09-12T17:40:04.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.803+0000 7ff1c75af800 20 remove_watcher() i=2 2024-09-12T17:40:04.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.804+0000 7ff1c75af800 20 remove_watcher() i=3 2024-09-12T17:40:04.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.805+0000 7ff1c75af800 20 remove_watcher() i=4 2024-09-12T17:40:04.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.806+0000 7ff1c75af800 20 remove_watcher() i=5 2024-09-12T17:40:04.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.807+0000 7ff1c75af800 20 remove_watcher() i=6 2024-09-12T17:40:04.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.808+0000 7ff1c75af800 20 remove_watcher() i=7 2024-09-12T17:40:04.821 INFO:tasks.workunit.client.0.smithi063.stderr:bucket name a-bucket 2024-09-12T17:40:04.822 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard process 2024-09-12T17:40:04.822 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:04.822 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshard process 2024-09-12T17:40:04.850 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:04.850 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:04.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.887+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 20 realm 2024-09-12T17:40:04.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:04.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:04.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.889+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.890+0000 7f5bf872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:04.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.890+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:04.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.890+0000 7f5bf872e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:04.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.890+0000 7f5bf872e800 20 searching for the correct realm 2024-09-12T17:40:04.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:04.893+0000 7f5bf3cdc640 0 -- 172.21.15.63:0/2895614127 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5be8018070 msgr2=0x7f5be805fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:05.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.098+0000 7f5bf3cdc640 0 -- 172.21.15.63:0/2895614127 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x555ea2258dc0 msgr2=0x555ea225b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:05.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:05.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:05.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:05.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:05.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:05.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:05.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:05.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:05.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:05.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 20 zone default found 2024-09-12T17:40:05.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 4 Realm: () 2024-09-12T17:40:05.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.103+0000 7f5bf872e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.104+0000 7f5bf872e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.104+0000 7f5bf872e800 20 zonegroup default 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.104+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.104+0000 7f5bf872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.104+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.104+0000 7f5bf872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.104+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.105+0000 7f5bf872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:05.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.105+0000 7f5bf872e800 20 started sync module instance, tier type = 2024-09-12T17:40:05.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.105+0000 7f5bf872e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:05.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.114+0000 7f5bf872e800 20 add_watcher() i=0 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.114+0000 7f5bf872e800 20 add_watcher() i=1 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.114+0000 7f5bf872e800 20 add_watcher() i=2 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.114+0000 7f5bf872e800 20 add_watcher() i=3 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.114+0000 7f5bf872e800 20 add_watcher() i=4 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.114+0000 7f5bf872e800 20 add_watcher() i=5 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.114+0000 7f5bf872e800 20 add_watcher() i=6 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.115+0000 7f5bf872e800 20 add_watcher() i=7 2024-09-12T17:40:05.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.115+0000 7f5bf872e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:05.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.117+0000 7f5aaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.117+0000 7f5bf872e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.117+0000 7f5bf872e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.118+0000 7f5bf872e800 5 note: GC not initialized 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.118+0000 7f5aa9fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.118+0000 7f5bf872e800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.118+0000 7f5bf872e800 20 Filter name: none 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.118+0000 7f5a1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:05.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.118+0000 7f5bf872e800 20 processing logshard = reshard.0000000000 2024-09-12T17:40:05.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.121+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:40:05.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.121+0000 7f5bf872e800 20 processing logshard = reshard.0000000001 2024-09-12T17:40:05.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.123+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:40:05.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.123+0000 7f5bf872e800 20 processing logshard = reshard.0000000002 2024-09-12T17:40:05.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.125+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:40:05.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.125+0000 7f5bf872e800 20 processing logshard = reshard.0000000003 2024-09-12T17:40:05.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.128+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:40:05.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.128+0000 7f5bf872e800 20 processing logshard = reshard.0000000004 2024-09-12T17:40:05.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.130+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:40:05.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.130+0000 7f5bf872e800 20 processing logshard = reshard.0000000005 2024-09-12T17:40:05.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.133+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:40:05.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.133+0000 7f5bf872e800 20 processing logshard = reshard.0000000006 2024-09-12T17:40:05.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 20 process_entry resharding a-bucket 2024-09-12T17:40:05.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:05.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.134+0000 7f5bf872e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.135+0000 7f5bf872e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.135+0000 7f5bf872e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.135+0000 7f5bf872e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.135+0000 7f5bf872e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.135+0000 7f5bf872e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:05.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.135+0000 7f5bf872e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:05.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5bf872e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5bf872e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5bf872e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5bf872e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5acb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431568 cookie 93864935663856 notifier 5819 bl.length()=911 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5acb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5acb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.141+0000 7f5acb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.142+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.142+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.142+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:40:05.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.142+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.0 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.0 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.1 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.1 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.2 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.2 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.3 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.3 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.4 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.4 2024-09-12T17:40:05.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.5 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.5 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.6 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.6 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.7 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.7 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.8 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.8 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.9 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.9 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.10 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.10 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.11 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.11 2024-09-12T17:40:05.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.0 2024-09-12T17:40:05.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1 2024-09-12T17:40:05.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.147+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2 2024-09-12T17:40:05.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.148+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3 2024-09-12T17:40:05.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.148+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.4 2024-09-12T17:40:05.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.149+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.5 2024-09-12T17:40:05.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.149+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.6 2024-09-12T17:40:05.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.150+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.7 2024-09-12T17:40:05.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.151+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.8 2024-09-12T17:40:05.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.151+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.9 2024-09-12T17:40:05.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.152+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.10 2024-09-12T17:40:05.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.152+0000 7f5bf872e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:05.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.152+0000 7f5bf872e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:05.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:05.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:05.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:05.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:40:05.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5acb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431569 cookie 93864935663856 notifier 5819 bl.length()=911 2024-09-12T17:40:05.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5acb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:05.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5acb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:05.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5acb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:05.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:40:05.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:40:05.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:40:05.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.154+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:40:05.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.159+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.0 2024-09-12T17:40:05.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.159+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1 2024-09-12T17:40:05.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.160+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2 2024-09-12T17:40:05.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.160+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3 2024-09-12T17:40:05.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.160+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.4 2024-09-12T17:40:05.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.161+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.5 2024-09-12T17:40:05.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.161+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.6 2024-09-12T17:40:05.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.162+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.7 2024-09-12T17:40:05.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.162+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.8 2024-09-12T17:40:05.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.162+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.9 2024-09-12T17:40:05.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.163+0000 7f5bf872e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.10 2024-09-12T17:40:05.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.163+0000 7f5bf872e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:05.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.163+0000 7f5bf872e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:05.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.164+0000 7f5bf872e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:05.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.164+0000 7f5bf872e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:05.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.164+0000 7f5bf872e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:05.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.164+0000 7f5bf872e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:40:05.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5acaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 93864935663856 notifier 5819 bl.length()=879 2024-09-12T17:40:05.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5acaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:05.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5acaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:05.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5acaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:05.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:40:05.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:40:05.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:40:05.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.165+0000 7f5bf872e800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:40:05.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.169+0000 7f5bf872e800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T17:40:05.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.170+0000 7f5bf872e800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:40:05.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.173+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:40:05.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.173+0000 7f5bf872e800 20 processing logshard = reshard.0000000007 2024-09-12T17:40:05.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.176+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:40:05.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.176+0000 7f5bf872e800 20 processing logshard = reshard.0000000008 2024-09-12T17:40:05.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.178+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:40:05.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.178+0000 7f5bf872e800 20 processing logshard = reshard.0000000009 2024-09-12T17:40:05.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.181+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:40:05.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.181+0000 7f5bf872e800 20 processing logshard = reshard.0000000010 2024-09-12T17:40:05.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.183+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:40:05.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.183+0000 7f5bf872e800 20 processing logshard = reshard.0000000011 2024-09-12T17:40:05.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.186+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:40:05.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.186+0000 7f5bf872e800 20 processing logshard = reshard.0000000012 2024-09-12T17:40:05.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.188+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:40:05.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.188+0000 7f5bf872e800 20 processing logshard = reshard.0000000013 2024-09-12T17:40:05.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.191+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:40:05.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.191+0000 7f5bf872e800 20 processing logshard = reshard.0000000014 2024-09-12T17:40:05.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.193+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:40:05.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.193+0000 7f5bf872e800 20 processing logshard = reshard.0000000015 2024-09-12T17:40:05.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.195+0000 7f5bf872e800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:40:05.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.196+0000 7f5aaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:05.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.199+0000 7f5bf872e800 20 remove_watcher() i=0 2024-09-12T17:40:05.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.199+0000 7f5bf872e800 2 removed watcher, disabling cache 2024-09-12T17:40:05.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.200+0000 7f5bf872e800 20 remove_watcher() i=1 2024-09-12T17:40:05.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.201+0000 7f5bf872e800 20 remove_watcher() i=2 2024-09-12T17:40:05.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.202+0000 7f5bf872e800 20 remove_watcher() i=3 2024-09-12T17:40:05.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.203+0000 7f5bf872e800 20 remove_watcher() i=4 2024-09-12T17:40:05.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.204+0000 7f5bf872e800 20 remove_watcher() i=5 2024-09-12T17:40:05.206 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.205+0000 7f5bf872e800 20 remove_watcher() i=6 2024-09-12T17:40:05.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:05.206+0000 7f5bf872e800 20 remove_watcher() i=7 2024-09-12T17:40:10.224 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:40:10.258 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:10.258 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:10.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.301+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.303+0000 7fd5c1d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.303+0000 7fd5c1d25800 20 realm 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.303+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.304+0000 7fd5c1d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.304+0000 7fd5c1d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.304+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.304+0000 7fd5c1d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.304+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.305+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:10.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.305+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.305+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:10.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.305+0000 7fd5c1d25800 20 searching for the correct realm 2024-09-12T17:40:10.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.309+0000 7fd5bd132640 0 -- 172.21.15.63:0/1828741459 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fd5b403f040 msgr2=0x7fd5b404b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:10.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.515+0000 7fd5be134640 0 -- 172.21.15.63:0/1828741459 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x558c6361d070 msgr2=0x558c6361f4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:10.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:10.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:10.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:10.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:10.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:10.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:10.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.520+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:10.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:10.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 20 zone default found 2024-09-12T17:40:10.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 4 Realm: () 2024-09-12T17:40:10.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 20 zonegroup default 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.521+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.522+0000 7fd5c1d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.522+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.522+0000 7fd5c1d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.522+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.522+0000 7fd5c1d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.522+0000 7fd5c1d25800 20 started sync module instance, tier type = 2024-09-12T17:40:10.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.522+0000 7fd5c1d25800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:10.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.533+0000 7fd5c1d25800 20 add_watcher() i=0 2024-09-12T17:40:10.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.533+0000 7fd5c1d25800 20 add_watcher() i=1 2024-09-12T17:40:10.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.533+0000 7fd5c1d25800 20 add_watcher() i=2 2024-09-12T17:40:10.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.533+0000 7fd5c1d25800 20 add_watcher() i=3 2024-09-12T17:40:10.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.533+0000 7fd5c1d25800 20 add_watcher() i=4 2024-09-12T17:40:10.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.533+0000 7fd5c1d25800 20 add_watcher() i=5 2024-09-12T17:40:10.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.533+0000 7fd5c1d25800 20 add_watcher() i=6 2024-09-12T17:40:10.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.534+0000 7fd5c1d25800 20 add_watcher() i=7 2024-09-12T17:40:10.536 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.534+0000 7fd5c1d25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:10.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.536+0000 7fd46f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:10.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.536+0000 7fd5c1d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:10.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.536+0000 7fd5c1d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:10.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.536+0000 7fd5c1d25800 5 note: GC not initialized 2024-09-12T17:40:10.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.536+0000 7fd46e7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:10.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.537+0000 7fd5c1d25800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:10.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.537+0000 7fd5c1d25800 20 Filter name: none 2024-09-12T17:40:10.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.537+0000 7fd3dffff640 20 reqs_thread_entry: start 2024-09-12T17:40:10.539 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.537+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.537+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:10.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.537+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.538+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:10.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.538+0000 7fd5c1d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:10.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.538+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.538+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:10.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.538+0000 7fd5c1d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.539+0000 7fd5c1d25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:10.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.539+0000 7fd5c1d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:10.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.541+0000 7fd46f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:10.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.543+0000 7fd5c1d25800 20 remove_watcher() i=0 2024-09-12T17:40:10.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.543+0000 7fd5c1d25800 2 removed watcher, disabling cache 2024-09-12T17:40:10.546 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.544+0000 7fd5c1d25800 20 remove_watcher() i=1 2024-09-12T17:40:10.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.545+0000 7fd5c1d25800 20 remove_watcher() i=2 2024-09-12T17:40:10.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.547+0000 7fd5c1d25800 20 remove_watcher() i=3 2024-09-12T17:40:10.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.548+0000 7fd5c1d25800 20 remove_watcher() i=4 2024-09-12T17:40:10.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.549+0000 7fd5c1d25800 20 remove_watcher() i=5 2024-09-12T17:40:10.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.550+0000 7fd5c1d25800 20 remove_watcher() i=6 2024-09-12T17:40:10.553 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.551+0000 7fd5c1d25800 20 remove_watcher() i=7 2024-09-12T17:40:10.567 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:10.567 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:10.567 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:40:10.567 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:10.567 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard add non empty bucket 2024-09-12T17:40:10.567 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:10.659 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:40:10.688 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:10.689 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:10.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.727+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 20 realm 2024-09-12T17:40:10.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:10.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.729+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.730+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:10.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.730+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.730+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:10.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.730+0000 7f289632d800 20 searching for the correct realm 2024-09-12T17:40:10.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.733+0000 7f2891875640 0 -- 172.21.15.63:0/4151346140 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f28880cb2d0 msgr2=0x7f28880ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:10.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.938+0000 7f2892877640 0 -- 172.21.15.63:0/4151346140 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559d72e72d00 msgr2=0x559d72e75170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.942+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 20 zone default found 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 4 Realm: () 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 20 zonegroup default 2024-09-12T17:40:10.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.943+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.944+0000 7f289632d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.944+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.944+0000 7f289632d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:10.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.944+0000 7f289632d800 20 started sync module instance, tier type = 2024-09-12T17:40:10.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.944+0000 7f289632d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.953+0000 7f289632d800 20 add_watcher() i=0 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.953+0000 7f289632d800 20 add_watcher() i=1 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.953+0000 7f289632d800 20 add_watcher() i=2 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.953+0000 7f289632d800 20 add_watcher() i=3 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.953+0000 7f289632d800 20 add_watcher() i=4 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.953+0000 7f289632d800 20 add_watcher() i=5 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.953+0000 7f289632d800 20 add_watcher() i=6 2024-09-12T17:40:10.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.954+0000 7f289632d800 20 add_watcher() i=7 2024-09-12T17:40:10.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.954+0000 7f289632d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:10.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.956+0000 7f2748fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:10.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.956+0000 7f289632d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:10.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.956+0000 7f289632d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:10.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.956+0000 7f289632d800 5 note: GC not initialized 2024-09-12T17:40:10.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.956+0000 7f26c37fe640 20 reqs_thread_entry: start 2024-09-12T17:40:10.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.956+0000 7f289632d800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:10.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f289632d800 20 Filter name: none 2024-09-12T17:40:10.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f26c17fa640 20 reqs_thread_entry: start 2024-09-12T17:40:10.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f289632d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.957+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.958+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.958+0000 7f289632d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:10.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.958+0000 7f289632d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:10.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.958+0000 7f289632d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:10.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.960+0000 7f2748fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:10.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.962+0000 7f289632d800 20 remove_watcher() i=0 2024-09-12T17:40:10.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.962+0000 7f289632d800 2 removed watcher, disabling cache 2024-09-12T17:40:10.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.963+0000 7f289632d800 20 remove_watcher() i=1 2024-09-12T17:40:10.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.964+0000 7f289632d800 20 remove_watcher() i=2 2024-09-12T17:40:10.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.966+0000 7f289632d800 20 remove_watcher() i=3 2024-09-12T17:40:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.967+0000 7f289632d800 20 remove_watcher() i=4 2024-09-12T17:40:10.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.968+0000 7f289632d800 20 remove_watcher() i=5 2024-09-12T17:40:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.969+0000 7f289632d800 20 remove_watcher() i=6 2024-09-12T17:40:10.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:10.970+0000 7f289632d800 20 remove_watcher() i=7 2024-09-12T17:40:10.983 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:10.983 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:10.983 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T17:40:10.983 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:10.984 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T17:40:11.015 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:11.016 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:11.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.054+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 20 realm 2024-09-12T17:40:11.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:11.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.056+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.057+0000 7f536cc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.057+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.057+0000 7f536cc10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:11.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.057+0000 7f536cc10800 20 searching for the correct realm 2024-09-12T17:40:11.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.060+0000 7f5367aca640 0 -- 172.21.15.63:0/3779812826 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f535c018070 msgr2=0x7f535c030400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:11.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.266+0000 7f5368acc640 0 -- 172.21.15.63:0/3779812826 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55eb3b20d030 msgr2=0x55eb3b20f4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:11.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:11.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:11.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:11.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:11.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:11.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.270+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:11.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 20 zone default found 2024-09-12T17:40:11.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 4 Realm: () 2024-09-12T17:40:11.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:11.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 20 zonegroup default 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.271+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.272+0000 7f536cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.272+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.272+0000 7f536cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.272+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.272+0000 7f536cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.272+0000 7f536cc10800 20 started sync module instance, tier type = 2024-09-12T17:40:11.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.272+0000 7f536cc10800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:11.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.282+0000 7f536cc10800 20 add_watcher() i=0 2024-09-12T17:40:11.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.282+0000 7f536cc10800 20 add_watcher() i=1 2024-09-12T17:40:11.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.282+0000 7f536cc10800 20 add_watcher() i=2 2024-09-12T17:40:11.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.282+0000 7f536cc10800 20 add_watcher() i=3 2024-09-12T17:40:11.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.282+0000 7f536cc10800 20 add_watcher() i=4 2024-09-12T17:40:11.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.282+0000 7f536cc10800 20 add_watcher() i=5 2024-09-12T17:40:11.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.282+0000 7f536cc10800 20 add_watcher() i=6 2024-09-12T17:40:11.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.283+0000 7f536cc10800 20 add_watcher() i=7 2024-09-12T17:40:11.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.283+0000 7f536cc10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:11.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.284+0000 7f521efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:11.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f536cc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:11.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f536cc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:11.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f536cc10800 5 note: GC not initialized 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f521dfdb640 20 reqs_thread_entry: start 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f536cc10800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f536cc10800 20 Filter name: none 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f518f7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f536cc10800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.285+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:11.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:11.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.286+0000 7f536cc10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:11.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.288+0000 7f521efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:11.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.291+0000 7f536cc10800 20 remove_watcher() i=0 2024-09-12T17:40:11.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.291+0000 7f536cc10800 2 removed watcher, disabling cache 2024-09-12T17:40:11.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.292+0000 7f536cc10800 20 remove_watcher() i=1 2024-09-12T17:40:11.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.293+0000 7f536cc10800 20 remove_watcher() i=2 2024-09-12T17:40:11.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.294+0000 7f536cc10800 20 remove_watcher() i=3 2024-09-12T17:40:11.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.295+0000 7f536cc10800 20 remove_watcher() i=4 2024-09-12T17:40:11.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.296+0000 7f536cc10800 20 remove_watcher() i=5 2024-09-12T17:40:11.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.297+0000 7f536cc10800 20 remove_watcher() i=6 2024-09-12T17:40:11.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.298+0000 7f536cc10800 20 remove_watcher() i=7 2024-09-12T17:40:11.312 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshard list 2024-09-12T17:40:11.339 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:11.339 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:11.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.377+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 20 realm 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.379+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.380+0000 7fb7c1b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.380+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.380+0000 7fb7c1b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.380+0000 7fb7c1b23800 20 searching for the correct realm 2024-09-12T17:40:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.383+0000 7fb7b5012640 0 -- 172.21.15.63:0/4046683809 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x56446caf9f10 msgr2=0x56446cafc300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.386+0000 7fb7bd813640 0 -- 172.21.15.63:0/4046683809 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fb7b8087940 msgr2=0x7fb7b806f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.593+0000 7fb7c1b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:11.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.593+0000 7fb7c1b23800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:11.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.593+0000 7fb7c1b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:11.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.593+0000 7fb7c1b23800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:11.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.593+0000 7fb7c1b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.593+0000 7fb7c1b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.593+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 zone default found 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 4 Realm: () 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:11.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 zonegroup default 2024-09-12T17:40:11.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.594+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.595+0000 7fb7c1b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.595+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.595+0000 7fb7c1b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.595+0000 7fb7c1b23800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.595+0000 7fb7c1b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.595+0000 7fb7c1b23800 20 started sync module instance, tier type = 2024-09-12T17:40:11.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.595+0000 7fb7c1b23800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:11.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.605+0000 7fb7c1b23800 20 add_watcher() i=0 2024-09-12T17:40:11.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.605+0000 7fb7c1b23800 20 add_watcher() i=1 2024-09-12T17:40:11.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.605+0000 7fb7c1b23800 20 add_watcher() i=2 2024-09-12T17:40:11.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.605+0000 7fb7c1b23800 20 add_watcher() i=3 2024-09-12T17:40:11.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.605+0000 7fb7c1b23800 20 add_watcher() i=4 2024-09-12T17:40:11.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.605+0000 7fb7c1b23800 20 add_watcher() i=5 2024-09-12T17:40:11.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.605+0000 7fb7c1b23800 20 add_watcher() i=6 2024-09-12T17:40:11.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.606+0000 7fb7c1b23800 20 add_watcher() i=7 2024-09-12T17:40:11.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.606+0000 7fb7c1b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:11.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.607+0000 7fb66f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:11.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.608+0000 7fb7c1b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:11.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.608+0000 7fb7c1b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:11.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.608+0000 7fb7c1b23800 5 note: GC not initialized 2024-09-12T17:40:11.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.608+0000 7fb66e7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:11.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.608+0000 7fb7c1b23800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:11.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.608+0000 7fb7c1b23800 20 Filter name: none 2024-09-12T17:40:11.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.608+0000 7fb5dffff640 20 reqs_thread_entry: start 2024-09-12T17:40:11.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.615+0000 7fb66f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:11.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.617+0000 7fb7c1b23800 20 remove_watcher() i=0 2024-09-12T17:40:11.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.617+0000 7fb7c1b23800 2 removed watcher, disabling cache 2024-09-12T17:40:11.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.618+0000 7fb7c1b23800 20 remove_watcher() i=1 2024-09-12T17:40:11.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.619+0000 7fb7c1b23800 20 remove_watcher() i=2 2024-09-12T17:40:11.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.620+0000 7fb7c1b23800 20 remove_watcher() i=3 2024-09-12T17:40:11.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.622+0000 7fb7c1b23800 20 remove_watcher() i=4 2024-09-12T17:40:11.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.623+0000 7fb7c1b23800 20 remove_watcher() i=5 2024-09-12T17:40:11.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.624+0000 7fb7c1b23800 20 remove_watcher() i=6 2024-09-12T17:40:11.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.625+0000 7fb7c1b23800 20 remove_watcher() i=7 2024-09-12T17:40:11.638 INFO:tasks.workunit.client.0.smithi063.stderr:bucket name a-bucket 2024-09-12T17:40:11.638 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard process non empty bucket 2024-09-12T17:40:11.638 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:11.639 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshard process 2024-09-12T17:40:11.666 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:11.667 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:11.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.705+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.706+0000 7f4c6a925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.706+0000 7f4c6a925800 20 realm 2024-09-12T17:40:11.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.706+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.707+0000 7f4c6a925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.707+0000 7f4c6a925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:11.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.707+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.707+0000 7f4c6a925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.707+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.708+0000 7f4c6a925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.708+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.708+0000 7f4c6a925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:11.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.708+0000 7f4c6a925800 20 searching for the correct realm 2024-09-12T17:40:11.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.711+0000 7f4c665ae640 0 -- 172.21.15.63:0/35422566 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f4c58085030 msgr2=0x7f4c5809e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.714+0000 7f4c665ae640 0 -- 172.21.15.63:0/35422566 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f4c60018040 msgr2=0x7f4c60083bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.920+0000 7f4c6a925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.920+0000 7f4c6a925800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.920+0000 7f4c6a925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.920+0000 7f4c6a925800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.920+0000 7f4c6a925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.920+0000 7f4c6a925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.920+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 zone default found 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 4 Realm: () 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 zonegroup default 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.921+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.922+0000 7f4c6a925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.922+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.922+0000 7f4c6a925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.922+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.922+0000 7f4c6a925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.922+0000 7f4c6a925800 20 started sync module instance, tier type = 2024-09-12T17:40:11.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.922+0000 7f4c6a925800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:11.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.932+0000 7f4c6a925800 20 add_watcher() i=0 2024-09-12T17:40:11.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.932+0000 7f4c6a925800 20 add_watcher() i=1 2024-09-12T17:40:11.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.932+0000 7f4c6a925800 20 add_watcher() i=2 2024-09-12T17:40:11.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.932+0000 7f4c6a925800 20 add_watcher() i=3 2024-09-12T17:40:11.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.932+0000 7f4c6a925800 20 add_watcher() i=4 2024-09-12T17:40:11.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.932+0000 7f4c6a925800 20 add_watcher() i=5 2024-09-12T17:40:11.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.932+0000 7f4c6a925800 20 add_watcher() i=6 2024-09-12T17:40:11.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.933+0000 7f4c6a925800 20 add_watcher() i=7 2024-09-12T17:40:11.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.933+0000 7f4c6a925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:11.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.934+0000 7f4b1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:11.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.934+0000 7f4c6a925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:11.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.934+0000 7f4c6a925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:11.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.935+0000 7f4c6a925800 5 note: GC not initialized 2024-09-12T17:40:11.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.935+0000 7f4a977fe640 20 reqs_thread_entry: start 2024-09-12T17:40:11.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.935+0000 7f4c6a925800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:11.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.935+0000 7f4c6a925800 20 Filter name: none 2024-09-12T17:40:11.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.935+0000 7f4a957fa640 20 reqs_thread_entry: start 2024-09-12T17:40:11.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.935+0000 7f4c6a925800 20 processing logshard = reshard.0000000000 2024-09-12T17:40:11.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.937+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:40:11.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.937+0000 7f4c6a925800 20 processing logshard = reshard.0000000001 2024-09-12T17:40:11.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.940+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:40:11.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.940+0000 7f4c6a925800 20 processing logshard = reshard.0000000002 2024-09-12T17:40:11.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.943+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:40:11.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.943+0000 7f4c6a925800 20 processing logshard = reshard.0000000003 2024-09-12T17:40:11.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.946+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:40:11.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.946+0000 7f4c6a925800 20 processing logshard = reshard.0000000004 2024-09-12T17:40:11.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.948+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:40:11.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.948+0000 7f4c6a925800 20 processing logshard = reshard.0000000005 2024-09-12T17:40:11.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.950+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:40:11.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.950+0000 7f4c6a925800 20 processing logshard = reshard.0000000006 2024-09-12T17:40:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.951+0000 7f4c6a925800 20 process_entry resharding a-bucket 2024-09-12T17:40:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.951+0000 7f4c6a925800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.951+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:40:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:40:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:11.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.952+0000 7f4c6a925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:11.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4c6a925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4c6a925800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4c6a925800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4c6a925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:40:11.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4b497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 94470111445776 notifier 6243 bl.length()=911 2024-09-12T17:40:11.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4b497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4b497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.959+0000 7f4b497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.960+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:40:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.960+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:40:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.960+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:40:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.960+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:40:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:40:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.0 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.0 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.1 2024-09-12T17:40:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.965+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.1 2024-09-12T17:40:11.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.966+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.2 2024-09-12T17:40:11.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.966+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.2 2024-09-12T17:40:11.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.966+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.3 2024-09-12T17:40:11.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.966+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.3 2024-09-12T17:40:11.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.966+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.4 2024-09-12T17:40:11.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.967+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.4 2024-09-12T17:40:11.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.967+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.5 2024-09-12T17:40:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.967+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.5 2024-09-12T17:40:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.968+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.6 2024-09-12T17:40:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.968+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.6 2024-09-12T17:40:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.968+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.7 2024-09-12T17:40:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.968+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.7 2024-09-12T17:40:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.968+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.8 2024-09-12T17:40:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.968+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.8 2024-09-12T17:40:11.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.969+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.9 2024-09-12T17:40:11.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.969+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.9 2024-09-12T17:40:11.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.969+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.10 2024-09-12T17:40:11.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.969+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.10 2024-09-12T17:40:11.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.970+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.11 2024-09-12T17:40:11.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.970+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.11 2024-09-12T17:40:11.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.972+0000 7f4c6a925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:11.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.972+0000 7f4c6a925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:11.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4b49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 94470111445776 notifier 6243 bl.length()=911 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4b49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4b49ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4b49ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:40:11.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:40:11.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:40:11.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.974+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:40:11.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.977+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.0 2024-09-12T17:40:11.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.977+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.0 2024-09-12T17:40:11.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.977+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.1 2024-09-12T17:40:11.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.977+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.1 2024-09-12T17:40:11.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.977+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.2 2024-09-12T17:40:11.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.977+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.2 2024-09-12T17:40:11.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.978+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.3 2024-09-12T17:40:11.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.978+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.3 2024-09-12T17:40:11.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.978+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.4 2024-09-12T17:40:11.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.978+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.4 2024-09-12T17:40:11.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.978+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.5 2024-09-12T17:40:11.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.978+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.5 2024-09-12T17:40:11.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.979+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.6 2024-09-12T17:40:11.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.979+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.6 2024-09-12T17:40:11.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.979+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.7 2024-09-12T17:40:11.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.979+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.7 2024-09-12T17:40:11.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.979+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.8 2024-09-12T17:40:11.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.979+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.8 2024-09-12T17:40:11.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.980+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.9 2024-09-12T17:40:11.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.980+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.9 2024-09-12T17:40:11.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.980+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.10 2024-09-12T17:40:11.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.980+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.10 2024-09-12T17:40:11.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.980+0000 7f4c6a925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.11 2024-09-12T17:40:11.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.980+0000 7f4c6a925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.1.11 2024-09-12T17:40:11.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.981+0000 7f4c6a925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:11.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.981+0000 7f4c6a925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4b49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 94470111445776 notifier 6243 bl.length()=879 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4b49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4b49ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:40:11.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4b49ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:11.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:40:11.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:40:11.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:40:11.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.982+0000 7f4c6a925800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:40:11.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.985+0000 7f4c6a925800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T17:40:11.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.986+0000 7f4c6a925800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:40:11.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.988+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:40:11.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.988+0000 7f4c6a925800 20 processing logshard = reshard.0000000007 2024-09-12T17:40:11.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.990+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:40:11.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.990+0000 7f4c6a925800 20 processing logshard = reshard.0000000008 2024-09-12T17:40:11.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.993+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:40:11.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.993+0000 7f4c6a925800 20 processing logshard = reshard.0000000009 2024-09-12T17:40:11.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.996+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:40:11.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.996+0000 7f4c6a925800 20 processing logshard = reshard.0000000010 2024-09-12T17:40:11.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.998+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:40:11.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:11.998+0000 7f4c6a925800 20 processing logshard = reshard.0000000011 2024-09-12T17:40:12.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.001+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:40:12.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.001+0000 7f4c6a925800 20 processing logshard = reshard.0000000012 2024-09-12T17:40:12.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.003+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:40:12.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.003+0000 7f4c6a925800 20 processing logshard = reshard.0000000013 2024-09-12T17:40:12.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.005+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:40:12.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.005+0000 7f4c6a925800 20 processing logshard = reshard.0000000014 2024-09-12T17:40:12.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.008+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:40:12.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.008+0000 7f4c6a925800 20 processing logshard = reshard.0000000015 2024-09-12T17:40:12.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.010+0000 7f4c6a925800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:40:12.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.011+0000 7f4b1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:12.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.013+0000 7f4c6a925800 20 remove_watcher() i=0 2024-09-12T17:40:12.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.013+0000 7f4c6a925800 2 removed watcher, disabling cache 2024-09-12T17:40:12.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.014+0000 7f4c6a925800 20 remove_watcher() i=1 2024-09-12T17:40:12.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.015+0000 7f4c6a925800 20 remove_watcher() i=2 2024-09-12T17:40:12.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.016+0000 7f4c6a925800 20 remove_watcher() i=3 2024-09-12T17:40:12.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.017+0000 7f4c6a925800 20 remove_watcher() i=4 2024-09-12T17:40:12.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.018+0000 7f4c6a925800 20 remove_watcher() i=5 2024-09-12T17:40:12.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.019+0000 7f4c6a925800 20 remove_watcher() i=6 2024-09-12T17:40:12.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.020+0000 7f4c6a925800 20 remove_watcher() i=7 2024-09-12T17:40:12.033 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:40:12.063 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:12.063 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:12.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.100+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.102+0000 7f603791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.102+0000 7f603791f800 20 realm 2024-09-12T17:40:12.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.102+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.102+0000 7f603791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.102+0000 7f603791f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:12.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.102+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.103+0000 7f603791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.103+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.103+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:12.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.103+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.104+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:12.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.104+0000 7f603791f800 20 searching for the correct realm 2024-09-12T17:40:12.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.106+0000 7f60336a9640 0 -- 172.21.15.63:0/2625369009 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f6024018070 msgr2=0x7f60240677c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:12.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.110+0000 7f60336a9640 0 -- 172.21.15.63:0/2625369009 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f602c061040 msgr2=0x7f602c078900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:12.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.317+0000 7f603791f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:12.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.317+0000 7f603791f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:12.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.317+0000 7f603791f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:12.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.317+0000 7f603791f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:12.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.317+0000 7f603791f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:12.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.318+0000 7f603791f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:12.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.318+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.318+0000 7f603791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.318+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.318+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:12.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.318+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.318+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 20 zone default found 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 4 Realm: () 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 20 zonegroup default 2024-09-12T17:40:12.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.319+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.320+0000 7f603791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.320+0000 7f603791f800 20 started sync module instance, tier type = 2024-09-12T17:40:12.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.320+0000 7f603791f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:12.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.328+0000 7f603791f800 20 add_watcher() i=0 2024-09-12T17:40:12.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.328+0000 7f603791f800 20 add_watcher() i=1 2024-09-12T17:40:12.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.328+0000 7f603791f800 20 add_watcher() i=2 2024-09-12T17:40:12.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.328+0000 7f603791f800 20 add_watcher() i=3 2024-09-12T17:40:12.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.328+0000 7f603791f800 20 add_watcher() i=4 2024-09-12T17:40:12.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.328+0000 7f603791f800 20 add_watcher() i=5 2024-09-12T17:40:12.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.328+0000 7f603791f800 20 add_watcher() i=6 2024-09-12T17:40:12.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.329+0000 7f603791f800 20 add_watcher() i=7 2024-09-12T17:40:12.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.329+0000 7f603791f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:12.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.331+0000 7f5ee9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:12.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.331+0000 7f603791f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:12.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.331+0000 7f603791f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:12.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.331+0000 7f603791f800 5 note: GC not initialized 2024-09-12T17:40:12.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.332+0000 7f5ee8fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:12.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.332+0000 7f603791f800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.332+0000 7f603791f800 20 Filter name: none 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.332+0000 7f5e627fc640 20 reqs_thread_entry: start 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.332+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.332+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.332+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.333+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.333+0000 7f603791f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.333+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.333+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:12.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.333+0000 7f603791f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.333+0000 7f603791f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:40:12.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.333+0000 7f603791f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:12.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.335+0000 7f5ee9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:12.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.337+0000 7f603791f800 20 remove_watcher() i=0 2024-09-12T17:40:12.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.337+0000 7f603791f800 2 removed watcher, disabling cache 2024-09-12T17:40:12.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.338+0000 7f603791f800 20 remove_watcher() i=1 2024-09-12T17:40:12.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.339+0000 7f603791f800 20 remove_watcher() i=2 2024-09-12T17:40:12.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.340+0000 7f603791f800 20 remove_watcher() i=3 2024-09-12T17:40:12.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.341+0000 7f603791f800 20 remove_watcher() i=4 2024-09-12T17:40:12.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.342+0000 7f603791f800 20 remove_watcher() i=5 2024-09-12T17:40:12.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.343+0000 7f603791f800 20 remove_watcher() i=6 2024-09-12T17:40:12.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.344+0000 7f603791f800 20 remove_watcher() i=7 2024-09-12T17:40:12.357 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:12.357 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:12.357 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:40:12.357 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:12.357 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:40:12.357 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:12.576 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:40:12.605 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:12.605 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:12.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.643+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 20 realm 2024-09-12T17:40:12.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:12.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.847+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.848+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:12.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.848+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.848+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:12.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.848+0000 7fc87bd35800 20 searching for the correct realm 2024-09-12T17:40:12.851 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:12.851+0000 7fc877a21640 0 -- 172.21.15.63:0/507643586 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fc8680777b0 msgr2=0x7fc868019460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:13.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.057+0000 7fc877a21640 0 -- 172.21.15.63:0/507643586 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fc870078410 msgr2=0x7fc870078870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.264+0000 7fc87bd35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.264+0000 7fc87bd35800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.264+0000 7fc87bd35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.264+0000 7fc87bd35800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.264+0000 7fc87bd35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.264+0000 7fc87bd35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.264+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:13.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 zone default found 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 4 Realm: () 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 zonegroup default 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.265+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.266+0000 7fc87bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.266+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.266+0000 7fc87bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.266+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.266+0000 7fc87bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.266+0000 7fc87bd35800 20 started sync module instance, tier type = 2024-09-12T17:40:13.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.266+0000 7fc87bd35800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:13.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.276+0000 7fc87bd35800 20 add_watcher() i=0 2024-09-12T17:40:13.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.276+0000 7fc87bd35800 20 add_watcher() i=1 2024-09-12T17:40:13.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.276+0000 7fc87bd35800 20 add_watcher() i=2 2024-09-12T17:40:13.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.276+0000 7fc87bd35800 20 add_watcher() i=3 2024-09-12T17:40:13.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.276+0000 7fc87bd35800 20 add_watcher() i=4 2024-09-12T17:40:13.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.276+0000 7fc87bd35800 20 add_watcher() i=5 2024-09-12T17:40:13.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.276+0000 7fc87bd35800 20 add_watcher() i=6 2024-09-12T17:40:13.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.277+0000 7fc87bd35800 20 add_watcher() i=7 2024-09-12T17:40:13.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.277+0000 7fc87bd35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:13.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.279+0000 7fc72dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc87bd35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc87bd35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc87bd35800 5 note: GC not initialized 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc72cfe1640 20 reqs_thread_entry: start 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc87bd35800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc87bd35800 20 Filter name: none 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc6a67fc640 20 reqs_thread_entry: start 2024-09-12T17:40:13.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.280+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.281+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:13.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.281+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.281+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:13.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.281+0000 7fc87bd35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:13.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.281+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.282+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:13.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.282+0000 7fc87bd35800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.282+0000 7fc87bd35800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:13.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.282+0000 7fc87bd35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:13.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.284+0000 7fc72dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:13.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.286+0000 7fc87bd35800 20 remove_watcher() i=0 2024-09-12T17:40:13.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.286+0000 7fc87bd35800 2 removed watcher, disabling cache 2024-09-12T17:40:13.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.287+0000 7fc87bd35800 20 remove_watcher() i=1 2024-09-12T17:40:13.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.288+0000 7fc87bd35800 20 remove_watcher() i=2 2024-09-12T17:40:13.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.289+0000 7fc87bd35800 20 remove_watcher() i=3 2024-09-12T17:40:13.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.290+0000 7fc87bd35800 20 remove_watcher() i=4 2024-09-12T17:40:13.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.291+0000 7fc87bd35800 20 remove_watcher() i=5 2024-09-12T17:40:13.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.292+0000 7fc87bd35800 20 remove_watcher() i=6 2024-09-12T17:40:13.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.293+0000 7fc87bd35800 20 remove_watcher() i=7 2024-09-12T17:40:13.306 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:13.306 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:13.306 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-init-index id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:13.306 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:13.307 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:40:13.343 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:13.343 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:13.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.381+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 20 realm 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.383+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.384+0000 7f7850c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:13.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.384+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.384+0000 7f7850c15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:13.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.384+0000 7f7850c15800 20 searching for the correct realm 2024-09-12T17:40:13.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.387+0000 7f784bb91640 0 -- 172.21.15.63:0/328887266 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f7840057b30 msgr2=0x7f78400c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:13.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.592+0000 7f784cb93640 0 -- 172.21.15.63:0/328887266 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55cce6cadcf0 msgr2=0x55cce6cb0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:13.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:13.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:13.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:13.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:13.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:13.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:13.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.596+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 zone default found 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 4 Realm: () 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:13.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:13.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 zonegroup default 2024-09-12T17:40:13.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.597+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.598+0000 7f7850c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.598+0000 7f7850c15800 20 started sync module instance, tier type = 2024-09-12T17:40:13.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.598+0000 7f7850c15800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:13.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=0 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=1 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=2 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=3 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=4 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=5 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=6 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 20 add_watcher() i=7 2024-09-12T17:40:13.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.607+0000 7f7850c15800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:13.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.609+0000 7f7702fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:13.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7850c15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:13.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7850c15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:13.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7850c15800 5 note: GC not initialized 2024-09-12T17:40:13.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7701fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:13.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7850c15800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:13.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7850c15800 20 Filter name: none 2024-09-12T17:40:13.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f76737fe640 20 reqs_thread_entry: start 2024-09-12T17:40:13.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7850c15800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:40:13.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.610+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:13.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:40:13.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:40:13.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 : miss 2024-09-12T17:40:13.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:13.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:13.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:13.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:13.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:13.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.611+0000 7f7850c15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 2024-09-12T17:40:13.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.612+0000 7f7850c15800 -1 Injecting error=-5 at location=init_index 2024-09-12T17:40:13.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.612+0000 7f7850c15800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:40:13.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.614+0000 7f7702fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:13.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.616+0000 7f7850c15800 20 remove_watcher() i=0 2024-09-12T17:40:13.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.616+0000 7f7850c15800 2 removed watcher, disabling cache 2024-09-12T17:40:13.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.617+0000 7f7850c15800 20 remove_watcher() i=1 2024-09-12T17:40:13.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.618+0000 7f7850c15800 20 remove_watcher() i=2 2024-09-12T17:40:13.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.619+0000 7f7850c15800 20 remove_watcher() i=3 2024-09-12T17:40:13.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.620+0000 7f7850c15800 20 remove_watcher() i=4 2024-09-12T17:40:13.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.621+0000 7f7850c15800 20 remove_watcher() i=5 2024-09-12T17:40:13.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.622+0000 7f7850c15800 20 remove_watcher() i=6 2024-09-12T17:40:13.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.623+0000 7f7850c15800 20 remove_watcher() i=7 2024-09-12T17:40:13.637 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:40:13.666 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:13.666 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:13.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.704+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.705+0000 7f662df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.705+0000 7f662df25800 20 realm 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.705+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.706+0000 7f662df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.706+0000 7f662df25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.706+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.706+0000 7f662df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.706+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.707+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:13.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.707+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.707+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:13.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.707+0000 7f662df25800 20 searching for the correct realm 2024-09-12T17:40:13.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.710+0000 7f66293ad640 0 -- 172.21.15.63:0/555727036 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x56069ebbd2f0 msgr2=0x56069ebbf720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:13.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.712+0000 7f6629bae640 0 -- 172.21.15.63:0/555727036 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f66240c7290 msgr2=0x7f66240a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:13.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:13.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:13.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:13.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:13.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:13.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:13.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.918+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 zone default found 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 4 Realm: () 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:13.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 zonegroup default 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.919+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.920+0000 7f662df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.920+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.920+0000 7f662df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.920+0000 7f662df25800 20 started sync module instance, tier type = 2024-09-12T17:40:13.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.920+0000 7f662df25800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:13.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.929+0000 7f662df25800 20 add_watcher() i=0 2024-09-12T17:40:13.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.929+0000 7f662df25800 20 add_watcher() i=1 2024-09-12T17:40:13.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.929+0000 7f662df25800 20 add_watcher() i=2 2024-09-12T17:40:13.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.929+0000 7f662df25800 20 add_watcher() i=3 2024-09-12T17:40:13.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.929+0000 7f662df25800 20 add_watcher() i=4 2024-09-12T17:40:13.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.929+0000 7f662df25800 20 add_watcher() i=5 2024-09-12T17:40:13.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.929+0000 7f662df25800 20 add_watcher() i=6 2024-09-12T17:40:13.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.931+0000 7f662df25800 20 add_watcher() i=7 2024-09-12T17:40:13.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.931+0000 7f662df25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:13.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.933+0000 7f64db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:13.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.933+0000 7f662df25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:13.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.933+0000 7f662df25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:13.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.933+0000 7f662df25800 5 note: GC not initialized 2024-09-12T17:40:13.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.933+0000 7f64da7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:13.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.933+0000 7f662df25800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:13.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.934+0000 7f662df25800 20 Filter name: none 2024-09-12T17:40:13.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.934+0000 7f644bfff640 20 reqs_thread_entry: start 2024-09-12T17:40:13.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.934+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.934+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:13.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.934+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.935+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:13.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.935+0000 7f662df25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:13.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.935+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.935+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:13.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.935+0000 7f662df25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:13.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.935+0000 7f662df25800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:13.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.935+0000 7f662df25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:13.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.937+0000 7f64db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:13.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.939+0000 7f662df25800 20 remove_watcher() i=0 2024-09-12T17:40:13.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.939+0000 7f662df25800 2 removed watcher, disabling cache 2024-09-12T17:40:13.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.940+0000 7f662df25800 20 remove_watcher() i=1 2024-09-12T17:40:13.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.941+0000 7f662df25800 20 remove_watcher() i=2 2024-09-12T17:40:13.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.942+0000 7f662df25800 20 remove_watcher() i=3 2024-09-12T17:40:13.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.943+0000 7f662df25800 20 remove_watcher() i=4 2024-09-12T17:40:13.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.944+0000 7f662df25800 20 remove_watcher() i=5 2024-09-12T17:40:13.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.945+0000 7f662df25800 20 remove_watcher() i=6 2024-09-12T17:40:13.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:13.946+0000 7f662df25800 20 remove_watcher() i=7 2024-09-12T17:40:13.957 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:13.958 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:13.958 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-init-index id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:13.958 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:14.011 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:40:14.044 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:14.044 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:14.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.082+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 20 realm 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.084+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.085+0000 7f1e515af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:14.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.085+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.085+0000 7f1e515af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:14.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.085+0000 7f1e515af800 20 searching for the correct realm 2024-09-12T17:40:14.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.088+0000 7f1e47fff640 0 -- 172.21.15.63:0/350795139 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1e3800d3e0 msgr2=0x7f1e3800d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:14.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.293+0000 7f1e4f89a640 0 -- 172.21.15.63:0/350795139 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5638221c39c0 msgr2=0x5638221c5e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.297+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 zone default found 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 4 Realm: () 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 zonegroup default 2024-09-12T17:40:14.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.298+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.299+0000 7f1e515af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.299+0000 7f1e515af800 20 started sync module instance, tier type = 2024-09-12T17:40:14.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.299+0000 7f1e515af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:14.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.308+0000 7f1e515af800 20 add_watcher() i=0 2024-09-12T17:40:14.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.308+0000 7f1e515af800 20 add_watcher() i=1 2024-09-12T17:40:14.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.308+0000 7f1e515af800 20 add_watcher() i=2 2024-09-12T17:40:14.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.308+0000 7f1e515af800 20 add_watcher() i=3 2024-09-12T17:40:14.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.308+0000 7f1e515af800 20 add_watcher() i=4 2024-09-12T17:40:14.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.308+0000 7f1e515af800 20 add_watcher() i=5 2024-09-12T17:40:14.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.308+0000 7f1e515af800 20 add_watcher() i=6 2024-09-12T17:40:14.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.309+0000 7f1e515af800 20 add_watcher() i=7 2024-09-12T17:40:14.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.309+0000 7f1e515af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:14.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.311+0000 7f1d05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.311+0000 7f1e515af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.311+0000 7f1e515af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.311+0000 7f1e515af800 5 note: GC not initialized 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1d04fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 20 Filter name: none 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1c7e7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 : miss 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.312+0000 7f1e515af800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.313+0000 7f1e515af800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.313+0000 7f1e515af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.313+0000 7f1e515af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.313+0000 7f1e515af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:14.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.313+0000 7f1e515af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:14.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.313+0000 7f1e515af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20, ofs0, ns] 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1d32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94799090486560 notifier 5984 bl.length()=995 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1d32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1d32ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:14.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1d32ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:14.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): orig_sources= new_sources= 2024-09-12T17:40:14.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): potential sources added=[] removed=[] 2024-09-12T17:40:14.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): orig_dests= new_dests= 2024-09-12T17:40:14.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.318+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): potential dests added=[] removed=[] 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.0 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.0 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.1 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.1 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.2 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.2 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.3 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.3 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.4 2024-09-12T17:40:14.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.4 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.5 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.5 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.6 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.6 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.7 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.7 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.8 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.8 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.9 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.9 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.10 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.10 2024-09-12T17:40:14.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.11 2024-09-12T17:40:14.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1.11 2024-09-12T17:40:14.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.0 2024-09-12T17:40:14.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.323+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1 2024-09-12T17:40:14.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.324+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.2 2024-09-12T17:40:14.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.324+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.3 2024-09-12T17:40:14.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.325+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.4 2024-09-12T17:40:14.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.325+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.5 2024-09-12T17:40:14.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.326+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.6 2024-09-12T17:40:14.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.326+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.7 2024-09-12T17:40:14.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.327+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.8 2024-09-12T17:40:14.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.327+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.9 2024-09-12T17:40:14.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.328+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.10 2024-09-12T17:40:14.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.331+0000 7f1e515af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:14.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.331+0000 7f1e515af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1e515af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1e515af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1e515af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1e515af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20, ofs0, ns] 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1d327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94799090486560 notifier 5984 bl.length()=995 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1d327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1d327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.332+0000 7f1d327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:14.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.333+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): orig_sources= new_sources= 2024-09-12T17:40:14.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.333+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): potential sources added=[] removed=[] 2024-09-12T17:40:14.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.333+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): orig_dests= new_dests= 2024-09-12T17:40:14.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.333+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): potential dests added=[] removed=[] 2024-09-12T17:40:14.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.335+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.0 2024-09-12T17:40:14.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.335+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.1 2024-09-12T17:40:14.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.336+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.2 2024-09-12T17:40:14.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.336+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.3 2024-09-12T17:40:14.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.336+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.4 2024-09-12T17:40:14.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.337+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.5 2024-09-12T17:40:14.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.337+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.6 2024-09-12T17:40:14.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.337+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.7 2024-09-12T17:40:14.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.338+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.8 2024-09-12T17:40:14.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.338+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.9 2024-09-12T17:40:14.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.338+0000 7f1e515af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20.10 2024-09-12T17:40:14.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.339+0000 7f1e515af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:14.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.339+0000 7f1e515af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 2024-09-12T17:40:14.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1e515af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:14.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1e515af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:14.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1e515af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:14.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1e515af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20, ofs0, ns] 2024-09-12T17:40:14.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1d327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94799090486560 notifier 5984 bl.length()=963 2024-09-12T17:40:14.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1d327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 info.flags=0x17 2024-09-12T17:40:14.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1d327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 to cache LRU end 2024-09-12T17:40:14.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.340+0000 7f1d327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:14.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.341+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): orig_sources= new_sources= 2024-09-12T17:40:14.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.341+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): potential sources added=[] removed=[] 2024-09-12T17:40:14.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.341+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): orig_dests= new_dests= 2024-09-12T17:40:14.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.341+0000 7f1e515af800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20]): potential dests added=[] removed=[] 2024-09-12T17:40:14.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.343+0000 7f1e515af800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:40:14.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.345+0000 7f1d05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:14.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.347+0000 7f1e515af800 20 remove_watcher() i=0 2024-09-12T17:40:14.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.347+0000 7f1e515af800 2 removed watcher, disabling cache 2024-09-12T17:40:14.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.348+0000 7f1e515af800 20 remove_watcher() i=1 2024-09-12T17:40:14.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.349+0000 7f1e515af800 20 remove_watcher() i=2 2024-09-12T17:40:14.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.350+0000 7f1e515af800 20 remove_watcher() i=3 2024-09-12T17:40:14.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.350+0000 7f1e515af800 20 remove_watcher() i=4 2024-09-12T17:40:14.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.351+0000 7f1e515af800 20 remove_watcher() i=5 2024-09-12T17:40:14.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.352+0000 7f1e515af800 20 remove_watcher() i=6 2024-09-12T17:40:14.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.353+0000 7f1e515af800 20 remove_watcher() i=7 2024-09-12T17:40:14.366 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:40:14.395 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:14.396 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:14.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.433+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.435+0000 7f9c8ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.435+0000 7f9c8ed24800 20 realm 2024-09-12T17:40:14.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.435+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.436+0000 7f9c8ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.436+0000 7f9c8ed24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:14.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.436+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.436+0000 7f9c8ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.436+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.437+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:14.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.437+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.437+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:14.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.437+0000 7f9c8ed24800 20 searching for the correct realm 2024-09-12T17:40:14.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.440+0000 7f9c8b269640 0 -- 172.21.15.63:0/937747265 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7f9c74037070 msgr2=0x7f9c74046920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:14.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.443+0000 7f9c8aa68640 0 -- 172.21.15.63:0/937747265 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f9c84064ac0 msgr2=0x7f9c8409bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:14.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:14.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:14.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:14.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.447+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:14.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 20 zone default found 2024-09-12T17:40:14.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 4 Realm: () 2024-09-12T17:40:14.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:14.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 20 zonegroup default 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.448+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.449+0000 7f9c8ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.449+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.449+0000 7f9c8ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.449+0000 7f9c8ed24800 20 started sync module instance, tier type = 2024-09-12T17:40:14.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.449+0000 7f9c8ed24800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:14.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.457+0000 7f9c8ed24800 20 add_watcher() i=0 2024-09-12T17:40:14.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.457+0000 7f9c8ed24800 20 add_watcher() i=1 2024-09-12T17:40:14.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.457+0000 7f9c8ed24800 20 add_watcher() i=2 2024-09-12T17:40:14.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.457+0000 7f9c8ed24800 20 add_watcher() i=3 2024-09-12T17:40:14.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.457+0000 7f9c8ed24800 20 add_watcher() i=4 2024-09-12T17:40:14.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.457+0000 7f9c8ed24800 20 add_watcher() i=5 2024-09-12T17:40:14.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.457+0000 7f9c8ed24800 20 add_watcher() i=6 2024-09-12T17:40:14.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.458+0000 7f9c8ed24800 20 add_watcher() i=7 2024-09-12T17:40:14.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.458+0000 7f9c8ed24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:14.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.459+0000 7f9b417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:14.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9c8ed24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:14.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9c8ed24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:14.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9c8ed24800 5 note: GC not initialized 2024-09-12T17:40:14.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9abbfff640 20 reqs_thread_entry: start 2024-09-12T17:40:14.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9c8ed24800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:14.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9c8ed24800 20 Filter name: none 2024-09-12T17:40:14.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9ab9ffb640 20 reqs_thread_entry: start 2024-09-12T17:40:14.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.460+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.461+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.461+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.461+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.461+0000 7f9c8ed24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.461+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.462+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.462+0000 7f9c8ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.462+0000 7f9c8ed24800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:14.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.462+0000 7f9c8ed24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:14.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.464+0000 7f9b417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:14.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.466+0000 7f9c8ed24800 20 remove_watcher() i=0 2024-09-12T17:40:14.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.466+0000 7f9c8ed24800 2 removed watcher, disabling cache 2024-09-12T17:40:14.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.467+0000 7f9c8ed24800 20 remove_watcher() i=1 2024-09-12T17:40:14.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.468+0000 7f9c8ed24800 20 remove_watcher() i=2 2024-09-12T17:40:14.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.469+0000 7f9c8ed24800 20 remove_watcher() i=3 2024-09-12T17:40:14.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.470+0000 7f9c8ed24800 20 remove_watcher() i=4 2024-09-12T17:40:14.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.471+0000 7f9c8ed24800 20 remove_watcher() i=5 2024-09-12T17:40:14.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.472+0000 7f9c8ed24800 20 remove_watcher() i=6 2024-09-12T17:40:14.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.472+0000 7f9c8ed24800 20 remove_watcher() i=7 2024-09-12T17:40:14.484 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:14.484 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:14.484 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-init-index id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:40:14.484 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:14.560 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:40:14.560 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:14.774 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:40:14.807 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:14.807 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:14.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.846+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.847+0000 7f7965d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.847+0000 7f7965d3d800 20 realm 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.847+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.847+0000 7f7965d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.847+0000 7f7965d3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.847+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.848+0000 7f7965d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:14.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.848+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.848+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:14.851 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.848+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:14.851 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.849+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:14.851 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.849+0000 7f7965d3d800 20 searching for the correct realm 2024-09-12T17:40:14.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:14.852+0000 7f7961229640 0 -- 172.21.15.63:0/2573457415 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f795801a040 msgr2=0x7f7958037920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:15.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.058+0000 7f796222b640 0 -- 172.21.15.63:0/2573457415 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e69796dfb0 msgr2=0x55e697970470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.062+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 zone default found 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 4 Realm: () 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 zonegroup default 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 started sync module instance, tier type = 2024-09-12T17:40:15.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.063+0000 7f7965d3d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:15.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.071+0000 7f7965d3d800 20 add_watcher() i=0 2024-09-12T17:40:15.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.071+0000 7f7965d3d800 20 add_watcher() i=1 2024-09-12T17:40:15.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.071+0000 7f7965d3d800 20 add_watcher() i=2 2024-09-12T17:40:15.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.071+0000 7f7965d3d800 20 add_watcher() i=3 2024-09-12T17:40:15.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.071+0000 7f7965d3d800 20 add_watcher() i=4 2024-09-12T17:40:15.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.071+0000 7f7965d3d800 20 add_watcher() i=5 2024-09-12T17:40:15.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.071+0000 7f7965d3d800 20 add_watcher() i=6 2024-09-12T17:40:15.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.072+0000 7f7965d3d800 20 add_watcher() i=7 2024-09-12T17:40:15.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.072+0000 7f7965d3d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:15.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.074+0000 7f78137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f7965d3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f7965d3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f7965d3d800 5 note: GC not initialized 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f78127fc640 20 reqs_thread_entry: start 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f7965d3d800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f7965d3d800 20 Filter name: none 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f7787fff640 20 reqs_thread_entry: start 2024-09-12T17:40:15.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.075+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.076+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:15.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.076+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.076+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:15.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.076+0000 7f7965d3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:15.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.076+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.077+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:15.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.077+0000 7f7965d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.077+0000 7f7965d3d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:15.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.077+0000 7f7965d3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:15.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.079+0000 7f78137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:15.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.081+0000 7f7965d3d800 20 remove_watcher() i=0 2024-09-12T17:40:15.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.081+0000 7f7965d3d800 2 removed watcher, disabling cache 2024-09-12T17:40:15.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.082+0000 7f7965d3d800 20 remove_watcher() i=1 2024-09-12T17:40:15.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.083+0000 7f7965d3d800 20 remove_watcher() i=2 2024-09-12T17:40:15.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.084+0000 7f7965d3d800 20 remove_watcher() i=3 2024-09-12T17:40:15.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.085+0000 7f7965d3d800 20 remove_watcher() i=4 2024-09-12T17:40:15.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.086+0000 7f7965d3d800 20 remove_watcher() i=5 2024-09-12T17:40:15.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.087+0000 7f7965d3d800 20 remove_watcher() i=6 2024-09-12T17:40:15.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.088+0000 7f7965d3d800 20 remove_watcher() i=7 2024-09-12T17:40:15.100 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:15.100 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:15.100 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-init-index id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:15.100 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:15.102 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:40:15.138 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:15.138 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:15.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.177+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 20 realm 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.179+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.180+0000 7ff696546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:15.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.180+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.180+0000 7ff696546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:15.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.180+0000 7ff696546800 20 searching for the correct realm 2024-09-12T17:40:15.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.183+0000 7ff693836640 0 -- 172.21.15.63:0/2610958497 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7ff688039930 msgr2=0x7ff68802c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:15.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.389+0000 7ff694838640 0 -- 172.21.15.63:0/2610958497 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55d2435c0180 msgr2=0x55d2435c25f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:15.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:15.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:15.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:15.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:15.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:15.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:15.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:15.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.393+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:15.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 20 zone default found 2024-09-12T17:40:15.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 4 Realm: () 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 20 zonegroup default 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.394+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.395+0000 7ff696546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.395+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.395+0000 7ff696546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.395+0000 7ff696546800 20 started sync module instance, tier type = 2024-09-12T17:40:15.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.395+0000 7ff696546800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:15.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.404+0000 7ff696546800 20 add_watcher() i=0 2024-09-12T17:40:15.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.404+0000 7ff696546800 20 add_watcher() i=1 2024-09-12T17:40:15.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.404+0000 7ff696546800 20 add_watcher() i=2 2024-09-12T17:40:15.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.404+0000 7ff696546800 20 add_watcher() i=3 2024-09-12T17:40:15.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.404+0000 7ff696546800 20 add_watcher() i=4 2024-09-12T17:40:15.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.404+0000 7ff696546800 20 add_watcher() i=5 2024-09-12T17:40:15.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.404+0000 7ff696546800 20 add_watcher() i=6 2024-09-12T17:40:15.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.405+0000 7ff696546800 20 add_watcher() i=7 2024-09-12T17:40:15.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.405+0000 7ff696546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:15.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff54a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:15.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff696546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:15.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff696546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:15.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff696546800 5 note: GC not initialized 2024-09-12T17:40:15.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff5497e2640 20 reqs_thread_entry: start 2024-09-12T17:40:15.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff696546800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:15.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff696546800 20 Filter name: none 2024-09-12T17:40:15.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff4baffd640 20 reqs_thread_entry: start 2024-09-12T17:40:15.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff696546800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:40:15.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.407+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 : miss 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 info.flags=0x17 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 to cache LRU end 2024-09-12T17:40:15.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:15.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:15.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.408+0000 7ff696546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 2024-09-12T17:40:15.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.410+0000 7ff696546800 -1 Injecting error=-95 at location=init_index 2024-09-12T17:40:15.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.410+0000 7ff696546800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:40:15.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff696546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 info.flags=0x17 2024-09-12T17:40:15.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff696546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 to cache LRU end 2024-09-12T17:40:15.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff696546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:15.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff696546800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21, ofs0, ns] 2024-09-12T17:40:15.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff56affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94361561646672 notifier 6393 bl.length()=995 2024-09-12T17:40:15.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff56affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 info.flags=0x17 2024-09-12T17:40:15.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff56affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 to cache LRU end 2024-09-12T17:40:15.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.413+0000 7ff56affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:15.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.414+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): orig_sources= new_sources= 2024-09-12T17:40:15.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.414+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): potential sources added=[] removed=[] 2024-09-12T17:40:15.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.414+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): orig_dests= new_dests= 2024-09-12T17:40:15.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.414+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): potential dests added=[] removed=[] 2024-09-12T17:40:15.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.0 2024-09-12T17:40:15.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.0 2024-09-12T17:40:15.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.1 2024-09-12T17:40:15.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.1 2024-09-12T17:40:15.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.2 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.2 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.3 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.3 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.4 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.4 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.5 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.5 2024-09-12T17:40:15.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.6 2024-09-12T17:40:15.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.6 2024-09-12T17:40:15.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.7 2024-09-12T17:40:15.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.7 2024-09-12T17:40:15.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.8 2024-09-12T17:40:15.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.8 2024-09-12T17:40:15.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.9 2024-09-12T17:40:15.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.9 2024-09-12T17:40:15.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.10 2024-09-12T17:40:15.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.10 2024-09-12T17:40:15.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.11 2024-09-12T17:40:15.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1.11 2024-09-12T17:40:15.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.416+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.0 2024-09-12T17:40:15.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.417+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.1 2024-09-12T17:40:15.422 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.418+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.2 2024-09-12T17:40:15.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.418+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.3 2024-09-12T17:40:15.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.418+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.4 2024-09-12T17:40:15.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.419+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.5 2024-09-12T17:40:15.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.420+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.6 2024-09-12T17:40:15.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.420+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.7 2024-09-12T17:40:15.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.421+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.8 2024-09-12T17:40:15.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.421+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.9 2024-09-12T17:40:15.424 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.422+0000 7ff696546800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21.10 2024-09-12T17:40:15.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.425+0000 7ff696546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:15.426 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.425+0000 7ff696546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 2024-09-12T17:40:15.427 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.426+0000 7ff696546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 info.flags=0x17 2024-09-12T17:40:15.427 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.426+0000 7ff696546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 to cache LRU end 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.426+0000 7ff696546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.426+0000 7ff696546800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21, ofs0, ns] 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff56b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94361561646672 notifier 6393 bl.length()=963 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff56b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 info.flags=0x17 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff56b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 to cache LRU end 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff56b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): orig_sources= new_sources= 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): potential sources added=[] removed=[] 2024-09-12T17:40:15.428 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): orig_dests= new_dests= 2024-09-12T17:40:15.429 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.427+0000 7ff696546800 20 handle_bi_update(): bucket=:error-at-init-index[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21]): potential dests added=[] removed=[] 2024-09-12T17:40:15.431 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.431+0000 7ff696546800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:40:15.433 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.433+0000 7ff54a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:15.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.435+0000 7ff696546800 20 remove_watcher() i=0 2024-09-12T17:40:15.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.435+0000 7ff696546800 2 removed watcher, disabling cache 2024-09-12T17:40:15.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.436+0000 7ff696546800 20 remove_watcher() i=1 2024-09-12T17:40:15.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.437+0000 7ff696546800 20 remove_watcher() i=2 2024-09-12T17:40:15.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.438+0000 7ff696546800 20 remove_watcher() i=3 2024-09-12T17:40:15.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.439+0000 7ff696546800 20 remove_watcher() i=4 2024-09-12T17:40:15.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.440+0000 7ff696546800 20 remove_watcher() i=5 2024-09-12T17:40:15.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.440+0000 7ff696546800 20 remove_watcher() i=6 2024-09-12T17:40:15.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.441+0000 7ff696546800 20 remove_watcher() i=7 2024-09-12T17:40:15.455 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:40:15.485 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:15.485 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:15.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.523+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.524+0000 7f730a346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.524+0000 7f730a346800 20 realm 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.524+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.525+0000 7f730a346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.525+0000 7f730a346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.525+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.525+0000 7f730a346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.525+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.526+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:15.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.526+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.526+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:15.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.526+0000 7f730a346800 20 searching for the correct realm 2024-09-12T17:40:15.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.528+0000 7f7307e37640 0 -- 172.21.15.63:0/1284311096 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x55ff779cabf0 msgr2=0x55ff779ccfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:15.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.531+0000 7f7308638640 0 -- 172.21.15.63:0/1284311096 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x55ff779cabf0 msgr2=0x7f72f805a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:15.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:15.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:15.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:15.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:15.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:15.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:15.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.739+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:15.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:15.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 zone default found 2024-09-12T17:40:15.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 4 Realm: () 2024-09-12T17:40:15.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 zonegroup default 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.740+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.741+0000 7f730a346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.741+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.741+0000 7f730a346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.741+0000 7f730a346800 20 started sync module instance, tier type = 2024-09-12T17:40:15.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.741+0000 7f730a346800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:15.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=0 2024-09-12T17:40:15.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=1 2024-09-12T17:40:15.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=2 2024-09-12T17:40:15.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=3 2024-09-12T17:40:15.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=4 2024-09-12T17:40:15.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=5 2024-09-12T17:40:15.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=6 2024-09-12T17:40:15.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 20 add_watcher() i=7 2024-09-12T17:40:15.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.750+0000 7f730a346800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:15.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.752+0000 7f71bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:15.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f730a346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:15.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f730a346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:15.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f730a346800 5 note: GC not initialized 2024-09-12T17:40:15.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f71bcfe1640 20 reqs_thread_entry: start 2024-09-12T17:40:15.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f730a346800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:15.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f730a346800 20 Filter name: none 2024-09-12T17:40:15.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f71367fc640 20 reqs_thread_entry: start 2024-09-12T17:40:15.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.753+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.754+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:15.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.754+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.754+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:15.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.754+0000 7f730a346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:15.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.754+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.755+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:40:15.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.755+0000 7f730a346800 20 rados->read ofs=0 len=0 2024-09-12T17:40:15.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.755+0000 7f730a346800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:40:15.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.755+0000 7f730a346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:15.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.757+0000 7f71bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:15.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.759+0000 7f730a346800 20 remove_watcher() i=0 2024-09-12T17:40:15.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.759+0000 7f730a346800 2 removed watcher, disabling cache 2024-09-12T17:40:15.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.760+0000 7f730a346800 20 remove_watcher() i=1 2024-09-12T17:40:15.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.761+0000 7f730a346800 20 remove_watcher() i=2 2024-09-12T17:40:15.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.762+0000 7f730a346800 20 remove_watcher() i=3 2024-09-12T17:40:15.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.763+0000 7f730a346800 20 remove_watcher() i=4 2024-09-12T17:40:15.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.764+0000 7f730a346800 20 remove_watcher() i=5 2024-09-12T17:40:15.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.765+0000 7f730a346800 20 remove_watcher() i=6 2024-09-12T17:40:15.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:15.766+0000 7f730a346800 20 remove_watcher() i=7 2024-09-12T17:40:15.778 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:15.778 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:15.778 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-init-index id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:40:15.778 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:15.854 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:40:15.854 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.071 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:40:16.100 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:16.100 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:16.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.138+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 20 realm 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.140+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.141+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.141+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.141+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:16.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.141+0000 7f5dc2813800 20 searching for the correct realm 2024-09-12T17:40:16.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.144+0000 7f5dbd747640 0 -- 172.21.15.63:0/1133232876 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5db406cb90 msgr2=0x7f5db406ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:16.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.350+0000 7f5dbe749640 0 -- 172.21.15.63:0/1133232876 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55f1648088c0 msgr2=0x55f16480ad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:16.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.353+0000 7f5dc2813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:16.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.353+0000 7f5dc2813800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.353+0000 7f5dc2813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.353+0000 7f5dc2813800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.353+0000 7f5dc2813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.353+0000 7f5dc2813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.353+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:16.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 zone default found 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 4 Realm: () 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 zonegroup default 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.354+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.355+0000 7f5dc2813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.355+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.355+0000 7f5dc2813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.355+0000 7f5dc2813800 20 started sync module instance, tier type = 2024-09-12T17:40:16.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.355+0000 7f5dc2813800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:16.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.363+0000 7f5dc2813800 20 add_watcher() i=0 2024-09-12T17:40:16.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.363+0000 7f5dc2813800 20 add_watcher() i=1 2024-09-12T17:40:16.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.363+0000 7f5dc2813800 20 add_watcher() i=2 2024-09-12T17:40:16.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.363+0000 7f5dc2813800 20 add_watcher() i=3 2024-09-12T17:40:16.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.363+0000 7f5dc2813800 20 add_watcher() i=4 2024-09-12T17:40:16.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.363+0000 7f5dc2813800 20 add_watcher() i=5 2024-09-12T17:40:16.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.364+0000 7f5dc2813800 20 add_watcher() i=6 2024-09-12T17:40:16.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.364+0000 7f5dc2813800 20 add_watcher() i=7 2024-09-12T17:40:16.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.364+0000 7f5dc2813800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:16.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.366+0000 7f5c6f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:16.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5dc2813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:16.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5dc2813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:16.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5dc2813800 5 note: GC not initialized 2024-09-12T17:40:16.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5c6e7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:16.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5dc2813800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:16.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5dc2813800 20 Filter name: none 2024-09-12T17:40:16.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5bdffff640 20 reqs_thread_entry: start 2024-09-12T17:40:16.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.367+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.368+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:16.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.368+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.369+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:16.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.369+0000 7f5dc2813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:16.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.369+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.370+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:16.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.370+0000 7f5dc2813800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.370+0000 7f5dc2813800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:16.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.370+0000 7f5dc2813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:16.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.372+0000 7f5c6f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:16.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.374+0000 7f5dc2813800 20 remove_watcher() i=0 2024-09-12T17:40:16.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.374+0000 7f5dc2813800 2 removed watcher, disabling cache 2024-09-12T17:40:16.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.375+0000 7f5dc2813800 20 remove_watcher() i=1 2024-09-12T17:40:16.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.376+0000 7f5dc2813800 20 remove_watcher() i=2 2024-09-12T17:40:16.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.377+0000 7f5dc2813800 20 remove_watcher() i=3 2024-09-12T17:40:16.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.378+0000 7f5dc2813800 20 remove_watcher() i=4 2024-09-12T17:40:16.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.379+0000 7f5dc2813800 20 remove_watcher() i=5 2024-09-12T17:40:16.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.380+0000 7f5dc2813800 20 remove_watcher() i=6 2024-09-12T17:40:16.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.380+0000 7f5dc2813800 20 remove_watcher() i=7 2024-09-12T17:40:16.392 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.392 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:16.392 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-init-indext id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:16.392 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.394 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:40:16.428 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:16.428 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:16.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.467+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 20 realm 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:16.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.469+0000 7f1a84726800 20 searching for the correct realm 2024-09-12T17:40:16.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.472+0000 7f1a7fbd8640 0 -- 172.21.15.63:0/970416884 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1a7407d950 msgr2=0x7f1a740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:16.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.678+0000 7f1a80bda640 0 -- 172.21.15.63:0/970416884 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5602cd97f3a0 msgr2=0x5602cd981820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:16.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:16.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:16.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:16.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 zone default found 2024-09-12T17:40:16.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 4 Realm: () 2024-09-12T17:40:16.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 zonegroup default 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.684+0000 7f1a84726800 20 started sync module instance, tier type = 2024-09-12T17:40:16.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.684+0000 7f1a84726800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:16.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=0 2024-09-12T17:40:16.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=1 2024-09-12T17:40:16.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=2 2024-09-12T17:40:16.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=3 2024-09-12T17:40:16.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=4 2024-09-12T17:40:16.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=5 2024-09-12T17:40:16.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=6 2024-09-12T17:40:16.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.693+0000 7f1a84726800 20 add_watcher() i=7 2024-09-12T17:40:16.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.693+0000 7f1a84726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:16.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.695+0000 7f19367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f1a84726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f1a84726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f1a84726800 5 note: GC not initialized 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f19357e2640 20 reqs_thread_entry: start 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f1a84726800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f1a84726800 20 Filter name: none 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f18a6ffd640 20 reqs_thread_entry: start 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f1a84726800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.696+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 : miss 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.697+0000 7f1a84726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 2024-09-12T17:40:16.700 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a84726800 time 2024-09-12T17:40:16.699404+0000 2024-09-12T17:40:16.700 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:16.700 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.700 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a85d8c71a] 2024-09-12T17:40:16.700 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.700 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1a84726800 thread_name:radosgw-admin 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.699+0000 7f1a84726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a84726800 time 2024-09-12T17:40:16.699404+0000 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.701 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a85d8c71a] 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:16.702 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.720 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a84a3e6f0] 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a84a8b99c] 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a85d8c774] 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:16.721 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.700+0000 7f1a84726800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1a84726800 thread_name:radosgw-admin 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a84a3e6f0] 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a84a8b99c] 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a85d8c774] 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.722 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:40:16.723 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: dump: 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.724 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:40:16.449+0000 7f1a84726800 5 monclient: authenticate success, global_id 6077 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:40:16.449+0000 7f1a84726800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:40:16.449+0000 7f1a84726800 4 set_mon_vals no callback set 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: shutdown 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 asok(0x5602cd672730) unregister_commands rotate-key 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.725 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding auth protocol: cephx 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding auth protocol: cephx 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding auth protocol: cephx 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.726 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:40:16.450+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: starting msgr at 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: starting objecter 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 asok(0x5602cd672730) register_command objecter_requests hook 0x5602cd899e10 2024-09-12T17:40:16.727 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: setting wanted keys 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: calling monclient init 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding auth protocol: cephx 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding auth protocol: cephx 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding auth protocol: cephx 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.728 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:40:16.451+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:40:16.451+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:40:16.451+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key hook 0x5602cd894ae8 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.729 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd7495a0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd74c640 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd89b7c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.966464s 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd7495a0 auth_method 0 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.730 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd89b7c0 auth_method 0 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd74c640 auth_method 0 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.731 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_done global_id 6080 payload 824 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:40:16.451+0000 7f1a803d9640 1 monclient: found mon.noname-c 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: dump: 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.732 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:16.733 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: dump: 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:40:16.452+0000 7f1a84726800 5 monclient: authenticate success, global_id 6080 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.734 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:40:16.452+0000 7f196e60c640 4 set_mon_vals no callback set 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:40:16.452+0000 7f1a84726800 1 librados: init done 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:40:16.453+0000 7f196ce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:40:16.453+0000 7f196ce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:40:16.453+0000 7f196ce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:40:16.454+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1968076470 auth_method 0 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:40:16.454+0000 7f1a80bda640 10 monclient: get_auth_request con 0x5602cd8d3130 auth_method 0 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:40:16.455+0000 7f1a803d9640 10 monclient: get_auth_request con 0x5602cd8e01c0 auth_method 0 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:40:16.456+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x5602cd8e5330 auth_method 0 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:40:16.457+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:40:16.457+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.735 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:40:16.457+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding auth protocol: cephx 2024-09-12T17:40:16.736 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding auth protocol: cephx 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding auth protocol: cephx 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.737 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:40:16.457+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 asok(0x5602cd672730) register_command objecter_requests cmddesc objecter_requests hook 0x5602cd8ecd70 EEXIST 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:40:16.457+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding auth protocol: cephx 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding auth protocol: cephx 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding auth protocol: cephx 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.738 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:40:16.457+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:40:16.458+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:40:16.458+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key cmddesc rotate-key hook 0x5602cd8e8480 EEXIST 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd910a60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd912d30 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.739 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd90f230 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.973215s 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd910a60 auth_method 0 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd90f230 auth_method 0 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.740 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd912d30 auth_method 0 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.741 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_done global_id 6083 payload 824 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:40:16.458+0000 7f1a803d9640 1 monclient: found mon.noname-c 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: dump: 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.742 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: dump: 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.743 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:40:16.458+0000 7f1a84726800 5 monclient: authenticate success, global_id 6083 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:40:16.458+0000 7f1a813db640 4 set_mon_vals no callback set 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:40:16.459+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.744 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:40:16.459+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:40:16.460+0000 7f1965ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:40:16.460+0000 7f1965ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:40:16.460+0000 7f1965ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:40:16.460+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1958076380 auth_method 0 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:40:16.460+0000 7f1a84726800 10 monclient: get_monmap_and_config 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:40:16.460+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:40:16.460+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:40:16.460+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.745 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding auth protocol: cephx 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding auth protocol: cephx 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding auth protocol: cephx 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.746 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:40:16.461+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding auth protocol: cephx 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding auth protocol: cephx 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding auth protocol: cephx 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.747 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:40:16.461+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:40:16.461+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.748 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key cmddesc rotate-key hook 0x7ffc39f2b438 EEXIST 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd964900 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd964ce0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd96a430 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.976884s 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd964ce0 auth_method 0 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.749 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd96a430 auth_method 0 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd964900 auth_method 0 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.750 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_done global_id 6447 payload 274 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 1 monclient: found mon.noname-a 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: dump: 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.751 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.752 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: dump: 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:40:16.462+0000 7f1a84726800 5 monclient: authenticate success, global_id 6447 2024-09-12T17:40:16.753 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:40:16.462+0000 7f1a84726800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:40:16.462+0000 7f1a84726800 4 set_mon_vals no callback set 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: shutdown 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.754 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding auth protocol: cephx 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding auth protocol: cephx 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding auth protocol: cephx 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.755 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:40:16.463+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: starting msgr at 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: starting objecter 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 asok(0x5602cd672730) register_command objecter_requests cmddesc objecter_requests hook 0x5602cd9358a0 EEXIST 2024-09-12T17:40:16.756 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: setting wanted keys 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: calling monclient init 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding auth protocol: cephx 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding auth protocol: cephx 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding auth protocol: cephx 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.757 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:40:16.463+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:40:16.464+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:40:16.464+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key cmddesc rotate-key hook 0x5602cd928958 EEXIST 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd964900 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd96a430 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.758 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd9720a0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.979305s 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd96a430 auth_method 0 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd964900 auth_method 0 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.759 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd9720a0 auth_method 0 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.760 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_done global_id 6450 payload 824 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 1 monclient: found mon.noname-a 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: dump: 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.761 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:40:16.464+0000 7f1a84726800 5 monclient: authenticate success, global_id 6450 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.762 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: dump: 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.763 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:40:16.464+0000 7f19577fe640 4 set_mon_vals no callback set 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:40:16.465+0000 7f1a84726800 1 librados: init done 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:40:16.465+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cr dump hook 0x5602cd968168 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:40:16.466+0000 7f1955ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:40:16.466+0000 7f1955ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:40:16.466+0000 7f1955ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:40:16.467+0000 7f1a803d9640 10 monclient: get_auth_request con 0x7f1948076470 auth_method 0 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:40:16.467+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:40:16.467+0000 7f1a80bda640 10 monclient: get_auth_request con 0x5602cd97f3a0 auth_method 0 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.764 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 realm 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:40:16.468+0000 7f1a84726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:40:16.468+0000 7f1a803d9640 10 monclient: get_auth_request con 0x5602cd983610 auth_method 0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 searching for the correct realm 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:40:16.469+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x5602cd9888f0 auth_method 0 2024-09-12T17:40:16.765 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:40:16.470+0000 7f1a80bda640 10 monclient: get_auth_request con 0x7f1a74097020 auth_method 0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:40:16.471+0000 7f1a803d9640 10 monclient: get_auth_request con 0x7f1a7008cab0 auth_method 0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:40:16.472+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1a7407d950 auth_method 0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:40:16.472+0000 7f1a7fbd8640 0 -- 172.21.15.63:0/970416884 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1a7407d950 msgr2=0x7f1a740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:40:16.674+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1a7407d950 auth_method 0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:40:16.676+0000 7f1a80bda640 10 monclient: get_auth_request con 0x7f1a70083f40 auth_method 0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:40:16.677+0000 7f1a803d9640 10 monclient: get_auth_request con 0x7f1a78024900 auth_method 0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:40:16.678+0000 7f1a80bda640 0 -- 172.21.15.63:0/970416884 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5602cd97f3a0 msgr2=0x5602cd981820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:40:16.678+0000 7f1955ffb640 1 client.6450.objecter ms_handle_reset 0x5602cd97f3a0 session 0x5602cd97ec90 osd.6 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:40:16.678+0000 7f1955ffb640 10 monclient: _renew_subs 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:40:16.678+0000 7f1955ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:40:16.678+0000 7f1a80bda640 10 monclient: get_auth_request con 0x7f1948086790 auth_method 0 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:16.766 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 zone default found 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:40:16.683+0000 7f1a84726800 4 Realm: () 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:40:16.683+0000 7f1a84726800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:16.767 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:40:16.683+0000 7f1a84726800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:40:16.683+0000 7f1a84726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 zonegroup default 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 started sync module instance, tier type = 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=0 2024-09-12T17:40:16.768 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=1 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=2 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=3 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=4 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=5 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=6 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:40:16.693+0000 7f1a84726800 20 add_watcher() i=7 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:40:16.693+0000 7f1a84726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding auth protocol: cephx 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding auth protocol: cephx 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding auth protocol: cephx 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.769 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:40:16.695+0000 7f19367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:40:16.696+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.770 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache list hook 0x5602cd9320a0 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache inspect hook 0x5602cd9320a0 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache erase hook 0x5602cd9320a0 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache zap hook 0x5602cd9320a0 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 note: GC not initialized 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:40:16.696+0000 7f19357e2640 20 reqs_thread_entry: start 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace show hook 0x7f1a74066970 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace history hook 0x7f1a74066970 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace active hook 0x7f1a74066970 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace active_short hook 0x7f1a74066970 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:16.771 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 Filter name: none 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:40:16.696+0000 7f18a6ffd640 20 reqs_thread_entry: start 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:40:16.696+0000 7f1a84726800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 : miss 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:16.772 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:40:16.699+0000 7f1a84726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a84726800 time 2024-09-12T17:40:16.699404+0000 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a85d8c71a] 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.773 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:40:16.700+0000 7f1a84726800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1a84726800 thread_name:radosgw-admin 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a84a3e6f0] 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a84a8b99c] 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:16.774 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a85d8c774] 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:40:16.775 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:40:16.776 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:40:16.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:40:16.778 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:40:16.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:16.780 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:40:16.781 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 7f18a6ffd640 / http_manager 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 7f19357e2640 / http_manager 2024-09-12T17:40:16.782 INFO:tasks.workunit.client.0.smithi063.stderr: 7f19367e4640 / rgw_dt_lg_renew 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1955ffb640 / ms_dispatch 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f19577fe640 / io_context_pool 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1965ffb640 / ms_dispatch 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f196ce09640 / ms_dispatch 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f196e60c640 / io_context_pool 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a7fbd8640 / msgr-worker-2 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a803d9640 / msgr-worker-1 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a80bda640 / msgr-worker-0 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a813db640 / io_context_pool 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a84726800 / radosgw-admin 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:40:16.783 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.92255.log 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:40:16.449+0000 7f196e60c640 10 monclient: dump: 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.784 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:40:16.449+0000 7f1a84726800 5 monclient: authenticate success, global_id 6077 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:40:16.449+0000 7f1a84726800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:40:16.449+0000 7f1a84726800 4 set_mon_vals no callback set 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: shutdown 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 asok(0x5602cd672730) unregister_commands rotate-key 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.785 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding auth protocol: cephx 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding auth protocol: cephx 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding auth protocol: cephx 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.786 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: crc 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd89a180) adding con mode: secure 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:40:16.450+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: starting msgr at 2024-09-12T17:40:16.787 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: starting objecter 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 asok(0x5602cd672730) register_command objecter_requests hook 0x5602cd899e10 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: setting wanted keys 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:40:16.450+0000 7f1a84726800 1 librados: calling monclient init 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:40:16.450+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding auth protocol: cephx 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding auth protocol: cephx 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding auth protocol: cephx 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.788 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: crc 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:40:16.450+0000 7f1a84726800 5 AuthRegistry(0x5602cd8949a0) adding con mode: secure 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:40:16.451+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:40:16.451+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:40:16.451+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key hook 0x5602cd894ae8 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd7495a0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.789 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd74c640 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd89b7c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:40:16.451+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.966464s 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd7495a0 auth_method 0 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd89b7c0 auth_method 0 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.790 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:40:16.451+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd74c640 auth_method 0 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.791 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:40:16.451+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient(hunting): handle_auth_done global_id 6080 payload 824 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:40:16.451+0000 7f1a803d9640 1 monclient: found mon.noname-c 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:40:16.451+0000 7f1a803d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:16.792 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: dump: 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.793 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:40:16.452+0000 7f196ce09640 10 monclient: dump: 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.794 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:40:16.452+0000 7f1a84726800 5 monclient: authenticate success, global_id 6080 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:40:16.452+0000 7f196e60c640 4 set_mon_vals no callback set 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:40:16.452+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:40:16.452+0000 7f1a84726800 1 librados: init done 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:40:16.453+0000 7f196ce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:40:16.453+0000 7f196ce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:40:16.453+0000 7f196ce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:40:16.454+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1968076470 auth_method 0 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:40:16.454+0000 7f1a80bda640 10 monclient: get_auth_request con 0x5602cd8d3130 auth_method 0 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:40:16.455+0000 7f1a803d9640 10 monclient: get_auth_request con 0x5602cd8e01c0 auth_method 0 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:40:16.456+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x5602cd8e5330 auth_method 0 2024-09-12T17:40:16.795 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:40:16.457+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:40:16.457+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:40:16.457+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.796 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding auth protocol: cephx 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding auth protocol: cephx 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding auth protocol: cephx 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.797 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: crc 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e93f0) adding con mode: secure 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:40:16.457+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 asok(0x5602cd672730) register_command objecter_requests cmddesc objecter_requests hook 0x5602cd8ecd70 EEXIST 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:40:16.457+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding auth protocol: cephx 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding auth protocol: cephx 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding auth protocol: cephx 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.798 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: crc 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:40:16.457+0000 7f1a84726800 5 AuthRegistry(0x5602cd8e8338) adding con mode: secure 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:40:16.457+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:40:16.458+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:40:16.458+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key cmddesc rotate-key hook 0x5602cd8e8480 EEXIST 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd910a60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.799 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd912d30 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd90f230 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.973215s 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd910a60 auth_method 0 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd90f230 auth_method 0 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.800 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd912d30 auth_method 0 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:40:16.458+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.801 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:40:16.458+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient(hunting): handle_auth_done global_id 6083 payload 824 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:40:16.458+0000 7f1a803d9640 1 monclient: found mon.noname-c 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:40:16.458+0000 7f1a803d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: dump: 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.802 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:40:16.458+0000 7f1965ffb640 10 monclient: dump: 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.803 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:40:16.458+0000 7f1a84726800 5 monclient: authenticate success, global_id 6083 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:40:16.458+0000 7f1a813db640 4 set_mon_vals no callback set 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:40:16.458+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:40:16.459+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:40:16.459+0000 7f1a84726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:16.804 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:40:16.460+0000 7f1965ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:40:16.460+0000 7f1965ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:40:16.460+0000 7f1965ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:40:16.460+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1958076380 auth_method 0 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:40:16.460+0000 7f1a84726800 10 monclient: get_monmap_and_config 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:40:16.460+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:40:16.460+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:40:16.460+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.805 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding auth protocol: cephx 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding auth protocol: cephx 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding auth protocol: cephx 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.806 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: crc 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:40:16.460+0000 7f1a84726800 5 AuthRegistry(0x5602cd930660) adding con mode: secure 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:40:16.461+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.808 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding auth protocol: cephx 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding auth protocol: cephx 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding auth protocol: cephx 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.809 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: crc 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b2f0) adding con mode: secure 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:40:16.461+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:40:16.461+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:40:16.461+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key cmddesc rotate-key hook 0x7ffc39f2b438 EEXIST 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd964900 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd964ce0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd96a430 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.810 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:40:16.461+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.976884s 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd964ce0 auth_method 0 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd96a430 auth_method 0 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd964900 auth_method 0 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.811 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:40:16.462+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:40:16.462+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_done global_id 6447 payload 274 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.812 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 1 monclient: found mon.noname-a 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:40:16.462+0000 7f1a7fbd8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: dump: 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.813 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:40:16.462+0000 7f19577fe640 10 monclient: dump: 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.814 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:40:16.462+0000 7f1a84726800 5 monclient: authenticate success, global_id 6447 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:40:16.462+0000 7f1a84726800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:40:16.462+0000 7f1a84726800 4 set_mon_vals no callback set 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: shutdown 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: build_initial_monmap 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 build_initial for_mkfs: 0 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: monmap: 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:16.815 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding auth protocol: cephx 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding auth protocol: cephx 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding auth protocol: cephx 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.816 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: crc 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd9345d0) adding con mode: secure 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:40:16.463+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: starting msgr at 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: starting objecter 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 asok(0x5602cd672730) register_command objecter_requests cmddesc objecter_requests hook 0x5602cd9358a0 EEXIST 2024-09-12T17:40:16.817 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: setting wanted keys 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:40:16.463+0000 7f1a84726800 1 librados: calling monclient init 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:40:16.463+0000 7f1a84726800 10 monclient: init 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding auth protocol: cephx 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding auth protocol: cephx 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding auth protocol: cephx 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.818 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: crc 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:40:16.463+0000 7f1a84726800 5 AuthRegistry(0x5602cd928810) adding con mode: secure 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:40:16.463+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:40:16.464+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:40:16.464+0000 7f1a84726800 5 asok(0x5602cd672730) register_command rotate-key cmddesc rotate-key hook 0x5602cd928958 EEXIST 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-b con 0x5602cd964900 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-a con 0x5602cd96a430 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): picked mon.noname-c con 0x5602cd9720a0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.819 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient(hunting): authenticate will time out at 1908.979305s 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request con 0x5602cd96a430 auth_method 0 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): get_auth_request con 0x5602cd964900 auth_method 0 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.820 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): get_auth_request con 0x5602cd9720a0 auth_method 0 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:40:16.464+0000 7f1a803d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:40:16.464+0000 7f1a80bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient(hunting): handle_auth_done global_id 6450 payload 824 2024-09-12T17:40:16.821 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient: _finish_hunting 0 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 1 monclient: found mon.noname-a 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:40:16.464+0000 7f1a7fbd8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: dump: 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.822 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: _finish_auth 0 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:40:16.464+0000 7f1a84726800 5 monclient: authenticate success, global_id 6450 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:40:16.464+0000 7f1955ffb640 10 monclient: dump: 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:16.823 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:40:16.464+0000 7f19577fe640 4 set_mon_vals no callback set 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _renew_subs 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:40:16.464+0000 7f1a84726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:40:16.465+0000 7f1a84726800 1 librados: init done 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:40:16.465+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cr dump hook 0x5602cd968168 2024-09-12T17:40:16.824 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:40:16.466+0000 7f1955ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:40:16.466+0000 7f1955ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:40:16.466+0000 7f1955ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:40:16.467+0000 7f1a803d9640 10 monclient: get_auth_request con 0x7f1948076470 auth_method 0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:40:16.467+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:40:16.467+0000 7f1a80bda640 10 monclient: get_auth_request con 0x5602cd97f3a0 auth_method 0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 realm 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:40:16.468+0000 7f1a84726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.825 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:40:16.468+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:40:16.468+0000 7f1a803d9640 10 monclient: get_auth_request con 0x5602cd983610 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:40:16.469+0000 7f1a84726800 20 searching for the correct realm 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:40:16.469+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x5602cd9888f0 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:40:16.470+0000 7f1a80bda640 10 monclient: get_auth_request con 0x7f1a74097020 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:40:16.471+0000 7f1a803d9640 10 monclient: get_auth_request con 0x7f1a7008cab0 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:40:16.472+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1a7407d950 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:40:16.472+0000 7f1a7fbd8640 0 -- 172.21.15.63:0/970416884 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1a7407d950 msgr2=0x7f1a740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:40:16.674+0000 7f1a7fbd8640 10 monclient: get_auth_request con 0x7f1a7407d950 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:40:16.676+0000 7f1a80bda640 10 monclient: get_auth_request con 0x7f1a70083f40 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:40:16.677+0000 7f1a803d9640 10 monclient: get_auth_request con 0x7f1a78024900 auth_method 0 2024-09-12T17:40:16.826 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:40:16.678+0000 7f1a80bda640 0 -- 172.21.15.63:0/970416884 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5602cd97f3a0 msgr2=0x5602cd981820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:40:16.678+0000 7f1955ffb640 1 client.6450.objecter ms_handle_reset 0x5602cd97f3a0 session 0x5602cd97ec90 osd.6 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:40:16.678+0000 7f1955ffb640 10 monclient: _renew_subs 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:40:16.678+0000 7f1955ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:40:16.678+0000 7f1a80bda640 10 monclient: get_auth_request con 0x7f1948086790 auth_method 0 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.827 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:40:16.682+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 zone default found 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:40:16.683+0000 7f1a84726800 4 Realm: () 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:40:16.683+0000 7f1a84726800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:40:16.683+0000 7f1a84726800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:40:16.683+0000 7f1a84726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 zonegroup default 2024-09-12T17:40:16.828 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:40:16.683+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 started sync module instance, tier type = 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:40:16.684+0000 7f1a84726800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=0 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=1 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=2 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=3 2024-09-12T17:40:16.829 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=4 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=5 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:40:16.692+0000 7f1a84726800 20 add_watcher() i=6 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:40:16.693+0000 7f1a84726800 20 add_watcher() i=7 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:40:16.693+0000 7f1a84726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding auth protocol: cephx 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding auth protocol: cephx 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding auth protocol: cephx 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.830 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: crc 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:40:16.695+0000 7f1a84726800 5 AuthRegistry(0x7ffc39f2b7c0) adding con mode: secure 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:40:16.695+0000 7f19367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:40:16.696+0000 7f1a84726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache list hook 0x5602cd9320a0 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache inspect hook 0x5602cd9320a0 2024-09-12T17:40:16.831 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache erase hook 0x5602cd9320a0 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command cache zap hook 0x5602cd9320a0 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 note: GC not initialized 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:40:16.696+0000 7f19357e2640 20 reqs_thread_entry: start 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace show hook 0x7f1a74066970 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace history hook 0x7f1a74066970 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace active hook 0x7f1a74066970 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:40:16.696+0000 7f1a84726800 5 asok(0x5602cd672730) register_command sync trace active_short hook 0x7f1a74066970 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 Filter name: none 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:40:16.696+0000 7f18a6ffd640 20 reqs_thread_entry: start 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:40:16.696+0000 7f1a84726800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:40:16.696+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.832 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 : miss 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:40:16.697+0000 7f1a84726800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:40:16.697+0000 7f1a84726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:40:16.699+0000 7f1a84726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a84726800 time 2024-09-12T17:40:16.699404+0000 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:16.833 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a85d8c71a] 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:40:16.700+0000 7f1a84726800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:16.834 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1a84726800 thread_name:radosgw-admin 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a84a3e6f0] 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a84a8b99c] 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a85d8c774] 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a85d8c8d8] 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602cbba8841] 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73b64) [0x5602cc0b5b64] 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5602cbbb850d] 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:16.835 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a84a29590] 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:40:16.836 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:16.837 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:40:16.838 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:40:16.839 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:40:16.840 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:16.841 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:16.842 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f18a6ffd640 / http_manager 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f19357e2640 / http_manager 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f19367e4640 / rgw_dt_lg_renew 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1955ffb640 / ms_dispatch 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f19577fe640 / io_context_pool 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1965ffb640 / ms_dispatch 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f196ce09640 / ms_dispatch 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f196e60c640 / io_context_pool 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a7fbd8640 / msgr-worker-2 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a803d9640 / msgr-worker-1 2024-09-12T17:40:16.843 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a80bda640 / msgr-worker-0 2024-09-12T17:40:16.844 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a813db640 / io_context_pool 2024-09-12T17:40:16.844 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1a84726800 / radosgw-admin 2024-09-12T17:40:16.844 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:40:16.844 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:40:16.844 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:40:16.701071Z_207b33cc-e12a-4c04-ad06-4e0f89b44d70/log 2024-09-12T17:40:16.844 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:40:16.844 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:40:16.845 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.780+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.781+0000 7fb1d633d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.781+0000 7fb1d633d800 20 realm 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.781+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.781+0000 7fb1d633d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.781+0000 7fb1d633d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.781+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.782+0000 7fb1d633d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.782+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.782+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.782+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.782+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:16.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.782+0000 7fb1d633d800 20 searching for the correct realm 2024-09-12T17:40:16.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.786+0000 7fb1d1829640 0 -- 172.21.15.63:0/389547886 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb1c8037910 msgr2=0x7fb1c80423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:16.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.991+0000 7fb1d282b640 0 -- 172.21.15.63:0/389547886 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e9fd6f2cb0 msgr2=0x55e9fd6f50a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:16.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:16.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 zone default found 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 4 Realm: () 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 zonegroup default 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.996+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.997+0000 7fb1d633d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.997+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.997+0000 7fb1d633d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.997+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:16.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.997+0000 7fb1d633d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.997+0000 7fb1d633d800 20 started sync module instance, tier type = 2024-09-12T17:40:17.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:16.997+0000 7fb1d633d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.006+0000 7fb1d633d800 20 add_watcher() i=0 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.006+0000 7fb1d633d800 20 add_watcher() i=1 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.006+0000 7fb1d633d800 20 add_watcher() i=2 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.006+0000 7fb1d633d800 20 add_watcher() i=3 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.006+0000 7fb1d633d800 20 add_watcher() i=4 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.006+0000 7fb1d633d800 20 add_watcher() i=5 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.006+0000 7fb1d633d800 20 add_watcher() i=6 2024-09-12T17:40:17.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.007+0000 7fb1d633d800 20 add_watcher() i=7 2024-09-12T17:40:17.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.007+0000 7fb1d633d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:17.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.008+0000 7fb088fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:17.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb1d633d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:17.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb1d633d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:17.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb1d633d800 5 note: GC not initialized 2024-09-12T17:40:17.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb0037fe640 20 reqs_thread_entry: start 2024-09-12T17:40:17.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb1d633d800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:17.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb1d633d800 20 Filter name: none 2024-09-12T17:40:17.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb0017fa640 20 reqs_thread_entry: start 2024-09-12T17:40:17.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.009+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.010+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:17.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.010+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.010+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:17.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.010+0000 7fb1d633d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:17.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.010+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.011+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:17.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.011+0000 7fb1d633d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.011+0000 7fb1d633d800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:17.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.011+0000 7fb1d633d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:17.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.013+0000 7fb088fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:17.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.015+0000 7fb1d633d800 20 remove_watcher() i=0 2024-09-12T17:40:17.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.015+0000 7fb1d633d800 2 removed watcher, disabling cache 2024-09-12T17:40:17.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.016+0000 7fb1d633d800 20 remove_watcher() i=1 2024-09-12T17:40:17.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.017+0000 7fb1d633d800 20 remove_watcher() i=2 2024-09-12T17:40:17.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.018+0000 7fb1d633d800 20 remove_watcher() i=3 2024-09-12T17:40:17.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.019+0000 7fb1d633d800 20 remove_watcher() i=4 2024-09-12T17:40:17.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.020+0000 7fb1d633d800 20 remove_watcher() i=5 2024-09-12T17:40:17.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.021+0000 7fb1d633d800 20 remove_watcher() i=6 2024-09-12T17:40:17.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.022+0000 7fb1d633d800 20 remove_watcher() i=7 2024-09-12T17:40:17.034 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:17.034 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:17.035 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-init-indext id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:17.035 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:17.087 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:40:17.119 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:17.119 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:17.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.158+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.159+0000 7f74bde40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.159+0000 7f74bde40800 20 realm 2024-09-12T17:40:17.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.159+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.160+0000 7f74bde40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.160+0000 7f74bde40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:17.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.160+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.160+0000 7f74bde40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.160+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.160+0000 7f74bde40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:17.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.160+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.161+0000 7f74bde40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:17.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.161+0000 7f74bde40800 20 searching for the correct realm 2024-09-12T17:40:17.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.164+0000 7f74bb129640 0 -- 172.21.15.63:0/741906399 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f74b00515a0 msgr2=0x7f74b007d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:17.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.369+0000 7f74bc12b640 0 -- 172.21.15.63:0/741906399 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5575ac70c940 msgr2=0x5575ac70edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:17.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:17.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:17.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:17.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:17.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:17.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:17.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.373+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:17.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 zone default found 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 4 Realm: () 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 zonegroup default 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.374+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.375+0000 7f74bde40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.375+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.375+0000 7f74bde40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:17.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.375+0000 7f74bde40800 20 started sync module instance, tier type = 2024-09-12T17:40:17.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.375+0000 7f74bde40800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:17.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.383+0000 7f74bde40800 20 add_watcher() i=0 2024-09-12T17:40:17.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.383+0000 7f74bde40800 20 add_watcher() i=1 2024-09-12T17:40:17.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.383+0000 7f74bde40800 20 add_watcher() i=2 2024-09-12T17:40:17.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.383+0000 7f74bde40800 20 add_watcher() i=3 2024-09-12T17:40:17.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.383+0000 7f74bde40800 20 add_watcher() i=4 2024-09-12T17:40:17.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.383+0000 7f74bde40800 20 add_watcher() i=5 2024-09-12T17:40:17.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.383+0000 7f74bde40800 20 add_watcher() i=6 2024-09-12T17:40:17.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.384+0000 7f74bde40800 20 add_watcher() i=7 2024-09-12T17:40:17.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.384+0000 7f74bde40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:17.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.386+0000 7f7371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:17.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.386+0000 7f74bde40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:17.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.386+0000 7f74bde40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:17.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.386+0000 7f74bde40800 5 note: GC not initialized 2024-09-12T17:40:17.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.386+0000 7f7370fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:17.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.386+0000 7f74bde40800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:17.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.386+0000 7f74bde40800 20 Filter name: none 2024-09-12T17:40:17.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f72ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:17.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f74bde40800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:40:17.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f74bde40800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:17.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f74bde40800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:40:17.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f74bde40800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:40:17.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f74bde40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 : miss 2024-09-12T17:40:17.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.387+0000 7f74bde40800 20 rados->read ofs=0 len=0 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.388+0000 7f74bde40800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.388+0000 7f74bde40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.388+0000 7f74bde40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.388+0000 7f74bde40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.388+0000 7f74bde40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.388+0000 7f74bde40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.389+0000 7f74bde40800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to be held by another RGW process; skipping for now 2024-09-12T17:40:17.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.390+0000 7f7371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:17.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.392+0000 7f74bde40800 20 remove_watcher() i=0 2024-09-12T17:40:17.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.392+0000 7f74bde40800 2 removed watcher, disabling cache 2024-09-12T17:40:17.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.393+0000 7f74bde40800 20 remove_watcher() i=1 2024-09-12T17:40:17.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.394+0000 7f74bde40800 20 remove_watcher() i=2 2024-09-12T17:40:17.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.395+0000 7f74bde40800 20 remove_watcher() i=3 2024-09-12T17:40:17.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.396+0000 7f74bde40800 20 remove_watcher() i=4 2024-09-12T17:40:17.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.397+0000 7f74bde40800 20 remove_watcher() i=5 2024-09-12T17:40:17.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.398+0000 7f74bde40800 20 remove_watcher() i=6 2024-09-12T17:40:17.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:17.399+0000 7f74bde40800 20 remove_watcher() i=7 2024-09-12T17:40:17.410 INFO:tasks.workunit.client.0.smithi063.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:40:47.420 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:40:47.458 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:47.458 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:47.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.502+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.503+0000 7f6061613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.503+0000 7f6061613800 20 realm 2024-09-12T17:40:47.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.503+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.503+0000 7f6061613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.503+0000 7f6061613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:47.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.503+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.504+0000 7f6061613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.504+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.504+0000 7f6061613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:47.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.504+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.505+0000 7f6061613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:47.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.505+0000 7f6061613800 20 searching for the correct realm 2024-09-12T17:40:47.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.509+0000 7f6057fff640 0 -- 172.21.15.63:0/1423755588 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f6048096290 msgr2=0x7f60480860c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:47.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.715+0000 7f605d549640 0 -- 172.21.15.63:0/1423755588 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56379ac28060 msgr2=0x56379ac2a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:47.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.720+0000 7f6061613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:47.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.720+0000 7f6061613800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:47.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.720+0000 7f6061613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:47.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.720+0000 7f6061613800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:47.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.720+0000 7f6061613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:47.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.720+0000 7f6061613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:47.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.720+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:47.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:47.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 zone default found 2024-09-12T17:40:47.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 4 Realm: () 2024-09-12T17:40:47.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 zonegroup default 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.721+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.722+0000 7f6061613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.722+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.722+0000 7f6061613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.722+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.722+0000 7f6061613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.722+0000 7f6061613800 20 started sync module instance, tier type = 2024-09-12T17:40:47.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.722+0000 7f6061613800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:47.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.733+0000 7f6061613800 20 add_watcher() i=0 2024-09-12T17:40:47.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.733+0000 7f6061613800 20 add_watcher() i=1 2024-09-12T17:40:47.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.733+0000 7f6061613800 20 add_watcher() i=2 2024-09-12T17:40:47.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.733+0000 7f6061613800 20 add_watcher() i=3 2024-09-12T17:40:47.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.733+0000 7f6061613800 20 add_watcher() i=4 2024-09-12T17:40:47.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.733+0000 7f6061613800 20 add_watcher() i=5 2024-09-12T17:40:47.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.733+0000 7f6061613800 20 add_watcher() i=6 2024-09-12T17:40:47.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.734+0000 7f6061613800 20 add_watcher() i=7 2024-09-12T17:40:47.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.734+0000 7f6061613800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:47.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.735+0000 7f5f137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:47.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f6061613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:47.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f6061613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:47.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f6061613800 5 note: GC not initialized 2024-09-12T17:40:47.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f5f127e4640 20 reqs_thread_entry: start 2024-09-12T17:40:47.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f6061613800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:47.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f6061613800 20 Filter name: none 2024-09-12T17:40:47.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f5f0b7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:47.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f6061613800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:40:47.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.736+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.737+0000 7f6061613800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.737+0000 7f6061613800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.737+0000 7f6061613800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.737+0000 7f6061613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 : miss 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.737+0000 7f6061613800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.738+0000 7f6061613800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.738+0000 7f6061613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.738+0000 7f6061613800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:47.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.738+0000 7f6061613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:47.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.738+0000 7f6061613800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:47.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.738+0000 7f6061613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 2024-09-12T17:40:47.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.745+0000 7f6061613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:47.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.745+0000 7f6061613800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:47.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.745+0000 7f6061613800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:47.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.745+0000 7f6061613800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22, ofs0, ns] 2024-09-12T17:40:47.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f5f337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94796819679568 notifier 6140 bl.length()=997 2024-09-12T17:40:47.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f5f337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:47.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f5f337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:47.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f5f337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:47.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): orig_sources= new_sources= 2024-09-12T17:40:47.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): potential sources added=[] removed=[] 2024-09-12T17:40:47.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): orig_dests= new_dests= 2024-09-12T17:40:47.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.746+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): potential dests added=[] removed=[] 2024-09-12T17:40:47.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.0 2024-09-12T17:40:47.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.0 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.1 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.1 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.2 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.2 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.3 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.3 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.4 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.4 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.5 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.5 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.6 2024-09-12T17:40:47.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.6 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.7 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.7 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.8 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.8 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.9 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.9 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.10 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.10 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.11 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1.11 2024-09-12T17:40:47.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.751+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.0 2024-09-12T17:40:47.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.752+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1 2024-09-12T17:40:47.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.752+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.2 2024-09-12T17:40:47.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.753+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.3 2024-09-12T17:40:47.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.753+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.4 2024-09-12T17:40:47.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.754+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.5 2024-09-12T17:40:47.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.754+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.6 2024-09-12T17:40:47.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.755+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.7 2024-09-12T17:40:47.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.755+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.8 2024-09-12T17:40:47.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.756+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.9 2024-09-12T17:40:47.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.756+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.10 2024-09-12T17:40:47.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.761+0000 7f6061613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:47.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.761+0000 7f6061613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 2024-09-12T17:40:47.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f6061613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:47.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f6061613800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:47.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f6061613800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:47.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f6061613800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22, ofs0, ns] 2024-09-12T17:40:47.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f5f33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94796819679568 notifier 6140 bl.length()=997 2024-09-12T17:40:47.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f5f33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:47.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f5f33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:47.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.763+0000 7f5f33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:47.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.764+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): orig_sources= new_sources= 2024-09-12T17:40:47.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.764+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): potential sources added=[] removed=[] 2024-09-12T17:40:47.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.764+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): orig_dests= new_dests= 2024-09-12T17:40:47.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.764+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): potential dests added=[] removed=[] 2024-09-12T17:40:47.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.766+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.0 2024-09-12T17:40:47.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.767+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.1 2024-09-12T17:40:47.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.767+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.2 2024-09-12T17:40:47.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.767+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.3 2024-09-12T17:40:47.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.768+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.4 2024-09-12T17:40:47.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.768+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.5 2024-09-12T17:40:47.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.768+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.6 2024-09-12T17:40:47.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.769+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.7 2024-09-12T17:40:47.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.769+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.8 2024-09-12T17:40:47.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.769+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.9 2024-09-12T17:40:47.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.770+0000 7f6061613800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22.10 2024-09-12T17:40:47.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.770+0000 7f6061613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:47.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.770+0000 7f6061613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 2024-09-12T17:40:47.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.771+0000 7f6061613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:47.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.771+0000 7f6061613800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:47.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.771+0000 7f6061613800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:47.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.771+0000 7f6061613800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22, ofs0, ns] 2024-09-12T17:40:47.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f5f33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94796819679568 notifier 6140 bl.length()=965 2024-09-12T17:40:47.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f5f33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 info.flags=0x17 2024-09-12T17:40:47.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f5f33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 to cache LRU end 2024-09-12T17:40:47.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f5f33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:47.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): orig_sources= new_sources= 2024-09-12T17:40:47.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): potential sources added=[] removed=[] 2024-09-12T17:40:47.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): orig_dests= new_dests= 2024-09-12T17:40:47.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.772+0000 7f6061613800 20 handle_bi_update(): bucket=:abort-at-init-indext[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22]): potential dests added=[] removed=[] 2024-09-12T17:40:47.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.776+0000 7f6061613800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T17:40:47.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.778+0000 7f5f137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:47.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.780+0000 7f6061613800 20 remove_watcher() i=0 2024-09-12T17:40:47.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.780+0000 7f6061613800 2 removed watcher, disabling cache 2024-09-12T17:40:47.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.782+0000 7f6061613800 20 remove_watcher() i=1 2024-09-12T17:40:47.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.783+0000 7f6061613800 20 remove_watcher() i=2 2024-09-12T17:40:47.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.784+0000 7f6061613800 20 remove_watcher() i=3 2024-09-12T17:40:47.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.785+0000 7f6061613800 20 remove_watcher() i=4 2024-09-12T17:40:47.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.786+0000 7f6061613800 20 remove_watcher() i=5 2024-09-12T17:40:47.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.787+0000 7f6061613800 20 remove_watcher() i=6 2024-09-12T17:40:47.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.788+0000 7f6061613800 20 remove_watcher() i=7 2024-09-12T17:40:47.802 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:40:47.832 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:47.832 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:47.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.871+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 20 realm 2024-09-12T17:40:47.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:47.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.873+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.874+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:47.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.874+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.874+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:47.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.874+0000 7f41612bb800 20 searching for the correct realm 2024-09-12T17:40:47.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.878+0000 7f415e5a4640 0 -- 172.21.15.63:0/719659694 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f4154002550 msgr2=0x7f415402c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:47.882 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.881+0000 7f415eda5640 0 -- 172.21.15.63:0/719659694 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f4158061040 msgr2=0x7f41580029e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:47.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.885+0000 7f41612bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:47.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.885+0000 7f41612bb800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:47.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.885+0000 7f41612bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:47.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.885+0000 7f41612bb800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:47.886 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.885+0000 7f41612bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:47.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.885+0000 7f41612bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:47.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.885+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:47.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:47.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 zone default found 2024-09-12T17:40:47.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 4 Realm: () 2024-09-12T17:40:47.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:47.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 zonegroup default 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.886+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.887+0000 7f41612bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.887+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.887+0000 7f41612bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.887+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.887+0000 7f41612bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.887+0000 7f41612bb800 20 started sync module instance, tier type = 2024-09-12T17:40:47.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.887+0000 7f41612bb800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:47.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.896+0000 7f41612bb800 20 add_watcher() i=0 2024-09-12T17:40:47.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.896+0000 7f41612bb800 20 add_watcher() i=1 2024-09-12T17:40:47.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.896+0000 7f41612bb800 20 add_watcher() i=2 2024-09-12T17:40:47.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.896+0000 7f41612bb800 20 add_watcher() i=3 2024-09-12T17:40:47.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.896+0000 7f41612bb800 20 add_watcher() i=4 2024-09-12T17:40:47.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.896+0000 7f41612bb800 20 add_watcher() i=5 2024-09-12T17:40:47.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.896+0000 7f41612bb800 20 add_watcher() i=6 2024-09-12T17:40:47.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.897+0000 7f41612bb800 20 add_watcher() i=7 2024-09-12T17:40:47.897 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.897+0000 7f41612bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:47.899 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.898+0000 7f40157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:47.900 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f41612bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:47.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f41612bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:47.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f41612bb800 5 note: GC not initialized 2024-09-12T17:40:47.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f3f8ffff640 20 reqs_thread_entry: start 2024-09-12T17:40:47.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f41612bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:47.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f41612bb800 20 Filter name: none 2024-09-12T17:40:47.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f3f8dffb640 20 reqs_thread_entry: start 2024-09-12T17:40:47.901 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.899+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.900+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:47.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.900+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.900+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:47.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.900+0000 7f41612bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:47.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.900+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.901+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:40:47.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.901+0000 7f41612bb800 20 rados->read ofs=0 len=0 2024-09-12T17:40:47.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.901+0000 7f41612bb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:40:47.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.901+0000 7f41612bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:47.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.903+0000 7f40157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:47.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.905+0000 7f41612bb800 20 remove_watcher() i=0 2024-09-12T17:40:47.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.905+0000 7f41612bb800 2 removed watcher, disabling cache 2024-09-12T17:40:47.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.906+0000 7f41612bb800 20 remove_watcher() i=1 2024-09-12T17:40:47.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.907+0000 7f41612bb800 20 remove_watcher() i=2 2024-09-12T17:40:47.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.908+0000 7f41612bb800 20 remove_watcher() i=3 2024-09-12T17:40:47.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.908+0000 7f41612bb800 20 remove_watcher() i=4 2024-09-12T17:40:47.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.909+0000 7f41612bb800 20 remove_watcher() i=5 2024-09-12T17:40:47.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.911+0000 7f41612bb800 20 remove_watcher() i=6 2024-09-12T17:40:47.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:47.912+0000 7f41612bb800 20 remove_watcher() i=7 2024-09-12T17:40:47.923 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:47.924 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:47.924 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-init-indext id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:40:47.924 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:47.999 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:40:47.999 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:48.215 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:40:48.244 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:48.244 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:48.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.281+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.283+0000 7fa869f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.283+0000 7fa869f3d800 20 realm 2024-09-12T17:40:48.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.283+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.283+0000 7fa869f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.283+0000 7fa869f3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:48.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.283+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.284+0000 7fa869f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.284+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.284+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:48.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.284+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.284+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:48.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.285+0000 7fa869f3d800 20 searching for the correct realm 2024-09-12T17:40:48.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.288+0000 7fa85ffff640 0 -- 172.21.15.63:0/3209422910 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa85004c170 msgr2=0x7fa850048a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:48.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.493+0000 7fa86642b640 0 -- 172.21.15.63:0/3209422910 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x563a7b961190 msgr2=0x563a7b963600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.497+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:48.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 zone default found 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 4 Realm: () 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 zonegroup default 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.498+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.499+0000 7fa869f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.499+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.499+0000 7fa869f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.499+0000 7fa869f3d800 20 started sync module instance, tier type = 2024-09-12T17:40:48.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.499+0000 7fa869f3d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:48.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.508+0000 7fa869f3d800 20 add_watcher() i=0 2024-09-12T17:40:48.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.508+0000 7fa869f3d800 20 add_watcher() i=1 2024-09-12T17:40:48.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.508+0000 7fa869f3d800 20 add_watcher() i=2 2024-09-12T17:40:48.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.508+0000 7fa869f3d800 20 add_watcher() i=3 2024-09-12T17:40:48.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.508+0000 7fa869f3d800 20 add_watcher() i=4 2024-09-12T17:40:48.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.508+0000 7fa869f3d800 20 add_watcher() i=5 2024-09-12T17:40:48.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.508+0000 7fa869f3d800 20 add_watcher() i=6 2024-09-12T17:40:48.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.509+0000 7fa869f3d800 20 add_watcher() i=7 2024-09-12T17:40:48.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.509+0000 7fa869f3d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:48.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa7177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:48.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa869f3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:48.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa869f3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:48.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa869f3d800 5 note: GC not initialized 2024-09-12T17:40:48.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa7167fc640 20 reqs_thread_entry: start 2024-09-12T17:40:48.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa869f3d800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:48.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa869f3d800 20 Filter name: none 2024-09-12T17:40:48.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.511+0000 7fa687fff640 20 reqs_thread_entry: start 2024-09-12T17:40:48.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.512+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.512+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:48.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.512+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.513+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:48.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.513+0000 7fa869f3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:48.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.513+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.514+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:48.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.514+0000 7fa869f3d800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.514+0000 7fa869f3d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:48.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.514+0000 7fa869f3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:48.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.516+0000 7fa7177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:48.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.518+0000 7fa869f3d800 20 remove_watcher() i=0 2024-09-12T17:40:48.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.518+0000 7fa869f3d800 2 removed watcher, disabling cache 2024-09-12T17:40:48.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.518+0000 7fa869f3d800 20 remove_watcher() i=1 2024-09-12T17:40:48.521 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.520+0000 7fa869f3d800 20 remove_watcher() i=2 2024-09-12T17:40:48.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.521+0000 7fa869f3d800 20 remove_watcher() i=3 2024-09-12T17:40:48.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.522+0000 7fa869f3d800 20 remove_watcher() i=4 2024-09-12T17:40:48.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.523+0000 7fa869f3d800 20 remove_watcher() i=5 2024-09-12T17:40:48.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.524+0000 7fa869f3d800 20 remove_watcher() i=6 2024-09-12T17:40:48.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.525+0000 7fa869f3d800 20 remove_watcher() i=7 2024-09-12T17:40:48.537 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:48.537 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:48.538 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:48.538 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:48.539 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:40:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:48.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.611+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.612+0000 7f1d0042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.612+0000 7f1d0042f800 20 realm 2024-09-12T17:40:48.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.612+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.613+0000 7f1d0042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.613+0000 7f1d0042f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:48.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.613+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.613+0000 7f1d0042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.613+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.614+0000 7f1d0042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:48.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.614+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.614+0000 7f1d0042f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:48.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.614+0000 7f1d0042f800 20 searching for the correct realm 2024-09-12T17:40:48.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.617+0000 7f1cfd71f640 0 -- 172.21.15.63:0/3211988814 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1cf407d070 msgr2=0x7f1cf40093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:48.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.620+0000 7f1cfdf20640 0 -- 172.21.15.63:0/3211988814 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f1cf800f430 msgr2=0x7f1cf800f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.624+0000 7f1d0042f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.624+0000 7f1d0042f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.624+0000 7f1d0042f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.624+0000 7f1d0042f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.624+0000 7f1d0042f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.624+0000 7f1d0042f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.624+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 zone default found 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 4 Realm: () 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 zonegroup default 2024-09-12T17:40:48.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.625+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.626+0000 7f1d0042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.626+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.626+0000 7f1d0042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.626+0000 7f1d0042f800 20 started sync module instance, tier type = 2024-09-12T17:40:48.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.626+0000 7f1d0042f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:48.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.635+0000 7f1d0042f800 20 add_watcher() i=0 2024-09-12T17:40:48.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.635+0000 7f1d0042f800 20 add_watcher() i=1 2024-09-12T17:40:48.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.635+0000 7f1d0042f800 20 add_watcher() i=2 2024-09-12T17:40:48.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.635+0000 7f1d0042f800 20 add_watcher() i=3 2024-09-12T17:40:48.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.635+0000 7f1d0042f800 20 add_watcher() i=4 2024-09-12T17:40:48.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.635+0000 7f1d0042f800 20 add_watcher() i=5 2024-09-12T17:40:48.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.635+0000 7f1d0042f800 20 add_watcher() i=6 2024-09-12T17:40:48.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.636+0000 7f1d0042f800 20 add_watcher() i=7 2024-09-12T17:40:48.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.636+0000 7f1d0042f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:48.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.637+0000 7f1baf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:48.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1d0042f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:48.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1d0042f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:48.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1d0042f800 5 note: GC not initialized 2024-09-12T17:40:48.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1bae7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:48.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1d0042f800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:48.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1d0042f800 20 Filter name: none 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1b1ffff640 20 reqs_thread_entry: start 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1d0042f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.638+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 : miss 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:48.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:48.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.639+0000 7f1d0042f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 2024-09-12T17:40:48.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.643+0000 7f1d0042f800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:40:48.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.643+0000 7f1d0042f800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:40:48.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.647+0000 7f1baf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:48.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.649+0000 7f1d0042f800 20 remove_watcher() i=0 2024-09-12T17:40:48.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.649+0000 7f1d0042f800 2 removed watcher, disabling cache 2024-09-12T17:40:48.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.650+0000 7f1d0042f800 20 remove_watcher() i=1 2024-09-12T17:40:48.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.651+0000 7f1d0042f800 20 remove_watcher() i=2 2024-09-12T17:40:48.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.652+0000 7f1d0042f800 20 remove_watcher() i=3 2024-09-12T17:40:48.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.653+0000 7f1d0042f800 20 remove_watcher() i=4 2024-09-12T17:40:48.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.654+0000 7f1d0042f800 20 remove_watcher() i=5 2024-09-12T17:40:48.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.655+0000 7f1d0042f800 20 remove_watcher() i=6 2024-09-12T17:40:48.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.656+0000 7f1d0042f800 20 remove_watcher() i=7 2024-09-12T17:40:48.670 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:40:48.699 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:48.699 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:48.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.737+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 20 realm 2024-09-12T17:40:48.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:48.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.739+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.740+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:48.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.740+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.740+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:48.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.740+0000 7fc3f4726800 20 searching for the correct realm 2024-09-12T17:40:48.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.744+0000 7fc3e7bb4640 0 -- 172.21.15.63:0/3812102177 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fc3d8069980 msgr2=0x7fc3d80670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:48.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.949+0000 7fc3f0bb6640 0 -- 172.21.15.63:0/3812102177 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5635612bd8f0 msgr2=0x5635612bfd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:48.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:48.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:48.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:48.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.953+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:48.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:48.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 zone default found 2024-09-12T17:40:48.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 4 Realm: () 2024-09-12T17:40:48.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:48.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:48.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 zonegroup default 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.954+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.955+0000 7fc3f4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.955+0000 7fc3f4726800 20 started sync module instance, tier type = 2024-09-12T17:40:48.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.955+0000 7fc3f4726800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.963+0000 7fc3f4726800 20 add_watcher() i=0 2024-09-12T17:40:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.963+0000 7fc3f4726800 20 add_watcher() i=1 2024-09-12T17:40:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.963+0000 7fc3f4726800 20 add_watcher() i=2 2024-09-12T17:40:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.963+0000 7fc3f4726800 20 add_watcher() i=3 2024-09-12T17:40:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.963+0000 7fc3f4726800 20 add_watcher() i=4 2024-09-12T17:40:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.963+0000 7fc3f4726800 20 add_watcher() i=5 2024-09-12T17:40:48.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.963+0000 7fc3f4726800 20 add_watcher() i=6 2024-09-12T17:40:48.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.964+0000 7fc3f4726800 20 add_watcher() i=7 2024-09-12T17:40:48.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.964+0000 7fc3f4726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:48.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.966+0000 7fc2a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:48.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.966+0000 7fc3f4726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:48.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.966+0000 7fc3f4726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:48.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.966+0000 7fc3f4726800 5 note: GC not initialized 2024-09-12T17:40:48.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.966+0000 7fc2a5fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:48.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.966+0000 7fc3f4726800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:48.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.966+0000 7fc3f4726800 20 Filter name: none 2024-09-12T17:40:48.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.967+0000 7fc2177fe640 20 reqs_thread_entry: start 2024-09-12T17:40:48.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.967+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.967+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.967+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.967+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.967+0000 7fc3f4726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.967+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.968+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.968+0000 7fc3f4726800 20 rados->read ofs=0 len=0 2024-09-12T17:40:48.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.968+0000 7fc3f4726800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:48.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.968+0000 7fc3f4726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:48.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.970+0000 7fc2a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:48.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.972+0000 7fc3f4726800 20 remove_watcher() i=0 2024-09-12T17:40:48.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.972+0000 7fc3f4726800 2 removed watcher, disabling cache 2024-09-12T17:40:48.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.973+0000 7fc3f4726800 20 remove_watcher() i=1 2024-09-12T17:40:48.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.974+0000 7fc3f4726800 20 remove_watcher() i=2 2024-09-12T17:40:48.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.975+0000 7fc3f4726800 20 remove_watcher() i=3 2024-09-12T17:40:48.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.976+0000 7fc3f4726800 20 remove_watcher() i=4 2024-09-12T17:40:48.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.977+0000 7fc3f4726800 20 remove_watcher() i=5 2024-09-12T17:40:48.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.978+0000 7fc3f4726800 20 remove_watcher() i=6 2024-09-12T17:40:48.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:48.979+0000 7fc3f4726800 20 remove_watcher() i=7 2024-09-12T17:40:48.990 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:48.991 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:48.991 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:48.991 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:49.044 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:40:49.076 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:49.076 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:49.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.115+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.116+0000 7fd74f33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.116+0000 7fd74f33a800 20 realm 2024-09-12T17:40:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.117+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.117+0000 7fd74f33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.117+0000 7fd74f33a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.117+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.117+0000 7fd74f33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.117+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.118+0000 7fd74f33a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:49.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.118+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.118+0000 7fd74f33a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:49.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.118+0000 7fd74f33a800 20 searching for the correct realm 2024-09-12T17:40:49.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.121+0000 7fd74a880640 0 -- 172.21.15.63:0/2949127660 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fd7400729e0 msgr2=0x7fd74000c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:49.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.326+0000 7fd74b882640 0 -- 172.21.15.63:0/2949127660 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5587a4889e40 msgr2=0x5587a488c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:49.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:49.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:49.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:49.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:49.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:49.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:49.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.330+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:49.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:49.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 zone default found 2024-09-12T17:40:49.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 4 Realm: () 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 zonegroup default 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.331+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.332+0000 7fd74f33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.332+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.332+0000 7fd74f33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.332+0000 7fd74f33a800 20 started sync module instance, tier type = 2024-09-12T17:40:49.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.332+0000 7fd74f33a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:49.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.340+0000 7fd74f33a800 20 add_watcher() i=0 2024-09-12T17:40:49.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.340+0000 7fd74f33a800 20 add_watcher() i=1 2024-09-12T17:40:49.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.340+0000 7fd74f33a800 20 add_watcher() i=2 2024-09-12T17:40:49.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.340+0000 7fd74f33a800 20 add_watcher() i=3 2024-09-12T17:40:49.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.340+0000 7fd74f33a800 20 add_watcher() i=4 2024-09-12T17:40:49.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.340+0000 7fd74f33a800 20 add_watcher() i=5 2024-09-12T17:40:49.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.340+0000 7fd74f33a800 20 add_watcher() i=6 2024-09-12T17:40:49.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.341+0000 7fd74f33a800 20 add_watcher() i=7 2024-09-12T17:40:49.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.341+0000 7fd74f33a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:49.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.343+0000 7fd601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:49.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd74f33a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:49.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd74f33a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd74f33a800 5 note: GC not initialized 2024-09-12T17:40:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd600fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd74f33a800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd74f33a800 20 Filter name: none 2024-09-12T17:40:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd57a7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd74f33a800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:40:49.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.344+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 : miss 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:49.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.345+0000 7fd74f33a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 2024-09-12T17:40:49.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd74f33a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:49.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd74f33a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:49.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd74f33a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:49.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd74f33a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23, ofs0, ns] 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd62e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431575 cookie 94041069370368 notifier 6227 bl.length()=1009 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd62e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd62e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.350+0000 7fd62e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.351+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): orig_sources= new_sources= 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.351+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): potential sources added=[] removed=[] 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.351+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): orig_dests= new_dests= 2024-09-12T17:40:49.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.351+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): potential dests added=[] removed=[] 2024-09-12T17:40:49.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.0 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.0 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.1 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.1 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.2 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.2 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.3 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.3 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.4 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.4 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.5 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.5 2024-09-12T17:40:49.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.6 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.6 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.7 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.7 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.8 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.8 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.9 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.9 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.10 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.10 2024-09-12T17:40:49.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.11 2024-09-12T17:40:49.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1.11 2024-09-12T17:40:49.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.355+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.0 2024-09-12T17:40:49.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.356+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.356+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.2 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.357+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.3 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.357+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.4 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.357+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.5 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.358+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.6 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.358+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.7 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.359+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.8 2024-09-12T17:40:49.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.360+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.9 2024-09-12T17:40:49.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.360+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.10 2024-09-12T17:40:49.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.363+0000 7fd74f33a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:49.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.363+0000 7fd74f33a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd74f33a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd74f33a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd74f33a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd74f33a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23, ofs0, ns] 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd62effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94041069370368 notifier 6227 bl.length()=1009 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd62effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd62effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:49.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.365+0000 7fd62effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:49.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.366+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): orig_sources= new_sources= 2024-09-12T17:40:49.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.366+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): potential sources added=[] removed=[] 2024-09-12T17:40:49.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.366+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): orig_dests= new_dests= 2024-09-12T17:40:49.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.366+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): potential dests added=[] removed=[] 2024-09-12T17:40:49.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.368+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.0 2024-09-12T17:40:49.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.368+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.1 2024-09-12T17:40:49.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.368+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.2 2024-09-12T17:40:49.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.369+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.3 2024-09-12T17:40:49.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.369+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.4 2024-09-12T17:40:49.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.369+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.5 2024-09-12T17:40:49.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.369+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.6 2024-09-12T17:40:49.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.370+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.7 2024-09-12T17:40:49.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.370+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.8 2024-09-12T17:40:49.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.370+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.9 2024-09-12T17:40:49.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.371+0000 7fd74f33a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23.10 2024-09-12T17:40:49.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.371+0000 7fd74f33a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:49.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.371+0000 7fd74f33a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 2024-09-12T17:40:49.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd74f33a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:49.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd74f33a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:49.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd74f33a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:49.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd74f33a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23, ofs0, ns] 2024-09-12T17:40:49.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd62e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94041069370368 notifier 6227 bl.length()=977 2024-09-12T17:40:49.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd62e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 info.flags=0x17 2024-09-12T17:40:49.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd62e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 to cache LRU end 2024-09-12T17:40:49.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.372+0000 7fd62e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:49.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.373+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): orig_sources= new_sources= 2024-09-12T17:40:49.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.373+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): potential sources added=[] removed=[] 2024-09-12T17:40:49.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.373+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): orig_dests= new_dests= 2024-09-12T17:40:49.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.373+0000 7fd74f33a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23]): potential dests added=[] removed=[] 2024-09-12T17:40:49.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.375+0000 7fd74f33a800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:40:49.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.378+0000 7fd601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:49.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.380+0000 7fd74f33a800 20 remove_watcher() i=0 2024-09-12T17:40:49.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.380+0000 7fd74f33a800 2 removed watcher, disabling cache 2024-09-12T17:40:49.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.381+0000 7fd74f33a800 20 remove_watcher() i=1 2024-09-12T17:40:49.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.382+0000 7fd74f33a800 20 remove_watcher() i=2 2024-09-12T17:40:49.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.383+0000 7fd74f33a800 20 remove_watcher() i=3 2024-09-12T17:40:49.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.384+0000 7fd74f33a800 20 remove_watcher() i=4 2024-09-12T17:40:49.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.385+0000 7fd74f33a800 20 remove_watcher() i=5 2024-09-12T17:40:49.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.386+0000 7fd74f33a800 20 remove_watcher() i=6 2024-09-12T17:40:49.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.387+0000 7fd74f33a800 20 remove_watcher() i=7 2024-09-12T17:40:49.401 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:40:49.430 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:49.430 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:49.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.468+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.470+0000 7faab9232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.470+0000 7faab9232800 20 realm 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.470+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.470+0000 7faab9232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.470+0000 7faab9232800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.471+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.471+0000 7faab9232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.471+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.471+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:49.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.471+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.472+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:49.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.472+0000 7faab9232800 20 searching for the correct realm 2024-09-12T17:40:49.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.475+0000 7faab3d52640 0 -- 172.21.15.63:0/1922479228 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7faaa80ab390 msgr2=0x7faaa8007cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:49.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.680+0000 7faab4d54640 0 -- 172.21.15.63:0/1922479228 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e4d55a94c0 msgr2=0x55e4d55ab8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:49.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:49.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:49.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:49.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:49.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:49.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:49.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:49.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.685+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:49.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 zone default found 2024-09-12T17:40:49.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 4 Realm: () 2024-09-12T17:40:49.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:49.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:49.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:49.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 zonegroup default 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 started sync module instance, tier type = 2024-09-12T17:40:49.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.686+0000 7faab9232800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:49.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.699+0000 7faab9232800 20 add_watcher() i=0 2024-09-12T17:40:49.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.699+0000 7faab9232800 20 add_watcher() i=1 2024-09-12T17:40:49.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.699+0000 7faab9232800 20 add_watcher() i=2 2024-09-12T17:40:49.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.699+0000 7faab9232800 20 add_watcher() i=3 2024-09-12T17:40:49.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.699+0000 7faab9232800 20 add_watcher() i=4 2024-09-12T17:40:49.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.699+0000 7faab9232800 20 add_watcher() i=5 2024-09-12T17:40:49.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.699+0000 7faab9232800 20 add_watcher() i=6 2024-09-12T17:40:49.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.700+0000 7faab9232800 20 add_watcher() i=7 2024-09-12T17:40:49.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.700+0000 7faab9232800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:49.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.701+0000 7fa96afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:49.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7faab9232800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:49.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7faab9232800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:49.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7faab9232800 5 note: GC not initialized 2024-09-12T17:40:49.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7fa969fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:49.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7faab9232800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:49.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7faab9232800 20 Filter name: none 2024-09-12T17:40:49.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7fa8db7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:49.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.702+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.703+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:49.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.703+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.703+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:49.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.703+0000 7faab9232800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:49.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.703+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.704+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:49.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.704+0000 7faab9232800 20 rados->read ofs=0 len=0 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.704+0000 7faab9232800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.704+0000 7faab9232800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.706+0000 7fa96afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.708+0000 7faab9232800 20 remove_watcher() i=0 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.708+0000 7faab9232800 2 removed watcher, disabling cache 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.709+0000 7faab9232800 20 remove_watcher() i=1 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.710+0000 7faab9232800 20 remove_watcher() i=2 2024-09-12T17:40:49.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.711+0000 7faab9232800 20 remove_watcher() i=3 2024-09-12T17:40:49.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.712+0000 7faab9232800 20 remove_watcher() i=4 2024-09-12T17:40:49.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.713+0000 7faab9232800 20 remove_watcher() i=5 2024-09-12T17:40:49.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.714+0000 7faab9232800 20 remove_watcher() i=6 2024-09-12T17:40:49.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:49.715+0000 7faab9232800 20 remove_watcher() i=7 2024-09-12T17:40:49.727 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:49.727 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:49.727 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:40:49.727 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:49.802 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:40:49.802 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:50.010 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:40:50.039 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:50.040 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:50.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.077+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 20 realm 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.079+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.080+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:50.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.080+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.080+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:50.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.080+0000 7f2b2912c800 20 searching for the correct realm 2024-09-12T17:40:50.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.083+0000 7f2b1ffff640 0 -- 172.21.15.63:0/46098042 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f2b1007a990 msgr2=0x7f2b100688d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:50.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.288+0000 7f2b1ffff640 0 -- 172.21.15.63:0/46098042 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55743b74c130 msgr2=0x55743b74e5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:50.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:50.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:50.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:50.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:50.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:50.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:50.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.292+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:50.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 zone default found 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 4 Realm: () 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 zonegroup default 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.293+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.294+0000 7f2b2912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.294+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.294+0000 7f2b2912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.294+0000 7f2b2912c800 20 started sync module instance, tier type = 2024-09-12T17:40:50.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.294+0000 7f2b2912c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:50.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.303+0000 7f2b2912c800 20 add_watcher() i=0 2024-09-12T17:40:50.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.303+0000 7f2b2912c800 20 add_watcher() i=1 2024-09-12T17:40:50.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.303+0000 7f2b2912c800 20 add_watcher() i=2 2024-09-12T17:40:50.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.303+0000 7f2b2912c800 20 add_watcher() i=3 2024-09-12T17:40:50.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.303+0000 7f2b2912c800 20 add_watcher() i=4 2024-09-12T17:40:50.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.303+0000 7f2b2912c800 20 add_watcher() i=5 2024-09-12T17:40:50.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.303+0000 7f2b2912c800 20 add_watcher() i=6 2024-09-12T17:40:50.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.304+0000 7f2b2912c800 20 add_watcher() i=7 2024-09-12T17:40:50.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.304+0000 7f2b2912c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:50.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.305+0000 7f29dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:50.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f2b2912c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:50.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f2b2912c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:50.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f2b2912c800 5 note: GC not initialized 2024-09-12T17:40:50.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f29d9fe3640 20 reqs_thread_entry: start 2024-09-12T17:40:50.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f2b2912c800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:50.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f2b2912c800 20 Filter name: none 2024-09-12T17:40:50.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f294b7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:50.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.306+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.307+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:50.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.307+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.308+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.308+0000 7f2b2912c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.308+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.308+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.308+0000 7f2b2912c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.308+0000 7f2b2912c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:50.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.308+0000 7f2b2912c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:50.311 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.310+0000 7f29dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:50.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.312+0000 7f2b2912c800 20 remove_watcher() i=0 2024-09-12T17:40:50.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.312+0000 7f2b2912c800 2 removed watcher, disabling cache 2024-09-12T17:40:50.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.313+0000 7f2b2912c800 20 remove_watcher() i=1 2024-09-12T17:40:50.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.314+0000 7f2b2912c800 20 remove_watcher() i=2 2024-09-12T17:40:50.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.315+0000 7f2b2912c800 20 remove_watcher() i=3 2024-09-12T17:40:50.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.316+0000 7f2b2912c800 20 remove_watcher() i=4 2024-09-12T17:40:50.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.317+0000 7f2b2912c800 20 remove_watcher() i=5 2024-09-12T17:40:50.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.318+0000 7f2b2912c800 20 remove_watcher() i=6 2024-09-12T17:40:50.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.319+0000 7f2b2912c800 20 remove_watcher() i=7 2024-09-12T17:40:50.331 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:50.332 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:50.332 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:50.332 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:50.333 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:40:50.370 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:50.370 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:50.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.407+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 20 realm 2024-09-12T17:40:50.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:50.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.409+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.410+0000 7fa4a832a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:50.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.410+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.412 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.410+0000 7fa4a832a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:50.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.410+0000 7fa4a832a800 20 searching for the correct realm 2024-09-12T17:40:50.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.413+0000 7fa49bfff640 0 -- 172.21.15.63:0/1223199452 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa48c026040 msgr2=0x7fa48c04c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:50.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.618+0000 7fa4a48db640 0 -- 172.21.15.63:0/1223199452 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b46574c590 msgr2=0x55b46574e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:50.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.622+0000 7fa4a832a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:50.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.622+0000 7fa4a832a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:50.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.622+0000 7fa4a832a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:50.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.622+0000 7fa4a832a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:50.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.622+0000 7fa4a832a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:50.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.622+0000 7fa4a832a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:50.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.622+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 zone default found 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 4 Realm: () 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:50.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 zonegroup default 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.623+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.624+0000 7fa4a832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.624+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.624+0000 7fa4a832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.624+0000 7fa4a832a800 20 started sync module instance, tier type = 2024-09-12T17:40:50.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.624+0000 7fa4a832a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:50.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.632+0000 7fa4a832a800 20 add_watcher() i=0 2024-09-12T17:40:50.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.632+0000 7fa4a832a800 20 add_watcher() i=1 2024-09-12T17:40:50.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.632+0000 7fa4a832a800 20 add_watcher() i=2 2024-09-12T17:40:50.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.632+0000 7fa4a832a800 20 add_watcher() i=3 2024-09-12T17:40:50.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.632+0000 7fa4a832a800 20 add_watcher() i=4 2024-09-12T17:40:50.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.632+0000 7fa4a832a800 20 add_watcher() i=5 2024-09-12T17:40:50.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.632+0000 7fa4a832a800 20 add_watcher() i=6 2024-09-12T17:40:50.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.633+0000 7fa4a832a800 20 add_watcher() i=7 2024-09-12T17:40:50.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.633+0000 7fa4a832a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:50.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.635+0000 7fa35afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:50.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.635+0000 7fa4a832a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:50.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.635+0000 7fa4a832a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:50.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.635+0000 7fa4a832a800 5 note: GC not initialized 2024-09-12T17:40:50.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa359fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:50.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:50.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 20 Filter name: none 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa2cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 : miss 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.636+0000 7fa4a832a800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.637+0000 7fa4a832a800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.637+0000 7fa4a832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 info.flags=0x17 2024-09-12T17:40:50.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.637+0000 7fa4a832a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 to cache LRU end 2024-09-12T17:40:50.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.637+0000 7fa4a832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:50.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.637+0000 7fa4a832a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:50.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.637+0000 7fa4a832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 2024-09-12T17:40:50.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.642+0000 7fa4a832a800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:40:50.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa4a832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 info.flags=0x17 2024-09-12T17:40:50.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa4a832a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 to cache LRU end 2024-09-12T17:40:50.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa4a832a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:50.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa4a832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24, ofs0, ns] 2024-09-12T17:40:50.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa37b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94233284634192 notifier 6281 bl.length()=1009 2024-09-12T17:40:50.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa37b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 info.flags=0x17 2024-09-12T17:40:50.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa37b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 to cache LRU end 2024-09-12T17:40:50.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.644+0000 7fa37b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:50.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.645+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): orig_sources= new_sources= 2024-09-12T17:40:50.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.645+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): potential sources added=[] removed=[] 2024-09-12T17:40:50.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.645+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): orig_dests= new_dests= 2024-09-12T17:40:50.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.645+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): potential dests added=[] removed=[] 2024-09-12T17:40:50.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.0 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.0 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.1 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.1 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.2 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.2 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.3 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.3 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.4 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.4 2024-09-12T17:40:50.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.5 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.5 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.6 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.6 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.7 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.7 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.8 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.8 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.9 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.9 2024-09-12T17:40:50.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.10 2024-09-12T17:40:50.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.10 2024-09-12T17:40:50.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.11 2024-09-12T17:40:50.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1.11 2024-09-12T17:40:50.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.0 2024-09-12T17:40:50.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.650+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1 2024-09-12T17:40:50.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.651+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.2 2024-09-12T17:40:50.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.652+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.3 2024-09-12T17:40:50.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.652+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.4 2024-09-12T17:40:50.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.652+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.5 2024-09-12T17:40:50.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.653+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.6 2024-09-12T17:40:50.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.654+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.7 2024-09-12T17:40:50.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.654+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.8 2024-09-12T17:40:50.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.654+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.9 2024-09-12T17:40:50.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.655+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.10 2024-09-12T17:40:50.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.658+0000 7fa4a832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:50.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.658+0000 7fa4a832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 2024-09-12T17:40:50.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 info.flags=0x17 2024-09-12T17:40:50.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 to cache LRU end 2024-09-12T17:40:50.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24, ofs0, ns] 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa37affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94233284634192 notifier 6281 bl.length()=1009 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa37affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 info.flags=0x17 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa37affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 to cache LRU end 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa37affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): orig_sources= new_sources= 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): potential sources added=[] removed=[] 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): orig_dests= new_dests= 2024-09-12T17:40:50.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.659+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): potential dests added=[] removed=[] 2024-09-12T17:40:50.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.662+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.0 2024-09-12T17:40:50.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.662+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.1 2024-09-12T17:40:50.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.662+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.2 2024-09-12T17:40:50.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.663+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.3 2024-09-12T17:40:50.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.663+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.4 2024-09-12T17:40:50.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.663+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.5 2024-09-12T17:40:50.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.663+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.6 2024-09-12T17:40:50.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.664+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.7 2024-09-12T17:40:50.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.664+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.8 2024-09-12T17:40:50.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.664+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.9 2024-09-12T17:40:50.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.665+0000 7fa4a832a800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24.10 2024-09-12T17:40:50.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.665+0000 7fa4a832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:40:50.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.665+0000 7fa4a832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa4a832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 info.flags=0x17 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa4a832a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 to cache LRU end 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa4a832a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa4a832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24, ofs0, ns] 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa37affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94233284634192 notifier 6281 bl.length()=977 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa37affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 info.flags=0x17 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa37affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 to cache LRU end 2024-09-12T17:40:50.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.666+0000 7fa37affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:50.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.667+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): orig_sources= new_sources= 2024-09-12T17:40:50.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.667+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): potential sources added=[] removed=[] 2024-09-12T17:40:50.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.667+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): orig_dests= new_dests= 2024-09-12T17:40:50.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.667+0000 7fa4a832a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24]): potential dests added=[] removed=[] 2024-09-12T17:40:50.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.669+0000 7fa4a832a800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:40:50.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.671+0000 7fa35afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:50.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.673+0000 7fa4a832a800 20 remove_watcher() i=0 2024-09-12T17:40:50.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.673+0000 7fa4a832a800 2 removed watcher, disabling cache 2024-09-12T17:40:50.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.674+0000 7fa4a832a800 20 remove_watcher() i=1 2024-09-12T17:40:50.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.675+0000 7fa4a832a800 20 remove_watcher() i=2 2024-09-12T17:40:50.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.676+0000 7fa4a832a800 20 remove_watcher() i=3 2024-09-12T17:40:50.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.677+0000 7fa4a832a800 20 remove_watcher() i=4 2024-09-12T17:40:50.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.678+0000 7fa4a832a800 20 remove_watcher() i=5 2024-09-12T17:40:50.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.679+0000 7fa4a832a800 20 remove_watcher() i=6 2024-09-12T17:40:50.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.680+0000 7fa4a832a800 20 remove_watcher() i=7 2024-09-12T17:40:50.694 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:40:50.724 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:50.724 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:50.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.762+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 20 realm 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.764+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.765+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:50.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.765+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.765+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:50.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.765+0000 7f8acc940800 20 searching for the correct realm 2024-09-12T17:40:50.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.768+0000 7f8ac7ebf640 0 -- 172.21.15.63:0/168760624 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f8ab00b5e50 msgr2=0x7f8ab00ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:50.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.972+0000 7f8ac8ec1640 0 -- 172.21.15.63:0/168760624 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55ad58695e10 msgr2=0x55ad58698240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:50.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.976+0000 7f8acc940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:50.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.976+0000 7f8acc940800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:50.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.976+0000 7f8acc940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:50.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.976+0000 7f8acc940800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:50.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.976+0000 7f8acc940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:50.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.976+0000 7f8acc940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:50.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.976+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:50.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:50.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 zone default found 2024-09-12T17:40:50.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 4 Realm: () 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 zonegroup default 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.977+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.978+0000 7f8acc940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.978+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.978+0000 7f8acc940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.978+0000 7f8acc940800 20 started sync module instance, tier type = 2024-09-12T17:40:50.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.978+0000 7f8acc940800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:50.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.986+0000 7f8acc940800 20 add_watcher() i=0 2024-09-12T17:40:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.986+0000 7f8acc940800 20 add_watcher() i=1 2024-09-12T17:40:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.986+0000 7f8acc940800 20 add_watcher() i=2 2024-09-12T17:40:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.986+0000 7f8acc940800 20 add_watcher() i=3 2024-09-12T17:40:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.986+0000 7f8acc940800 20 add_watcher() i=4 2024-09-12T17:40:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.986+0000 7f8acc940800 20 add_watcher() i=5 2024-09-12T17:40:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.987+0000 7f8acc940800 20 add_watcher() i=6 2024-09-12T17:40:50.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.987+0000 7f8acc940800 20 add_watcher() i=7 2024-09-12T17:40:50.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.987+0000 7f8acc940800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:50.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.989+0000 7f897efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.989+0000 7f8acc940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.989+0000 7f8acc940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.989+0000 7f8acc940800 5 note: GC not initialized 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.990+0000 7f897dfdb640 20 reqs_thread_entry: start 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.990+0000 7f8acc940800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.990+0000 7f8acc940800 20 Filter name: none 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.990+0000 7f88ef7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:50.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.990+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.990+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:50.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.990+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.991+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:50.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.991+0000 7f8acc940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:50.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.991+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.991+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:50.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.991+0000 7f8acc940800 20 rados->read ofs=0 len=0 2024-09-12T17:40:50.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.991+0000 7f8acc940800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:50.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.991+0000 7f8acc940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:50.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.993+0000 7f897efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:50.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.995+0000 7f8acc940800 20 remove_watcher() i=0 2024-09-12T17:40:50.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.995+0000 7f8acc940800 2 removed watcher, disabling cache 2024-09-12T17:40:50.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.996+0000 7f8acc940800 20 remove_watcher() i=1 2024-09-12T17:40:50.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.997+0000 7f8acc940800 20 remove_watcher() i=2 2024-09-12T17:40:50.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.998+0000 7f8acc940800 20 remove_watcher() i=3 2024-09-12T17:40:51.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:50.999+0000 7f8acc940800 20 remove_watcher() i=4 2024-09-12T17:40:51.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.000+0000 7f8acc940800 20 remove_watcher() i=5 2024-09-12T17:40:51.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.001+0000 7f8acc940800 20 remove_watcher() i=6 2024-09-12T17:40:51.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.002+0000 7f8acc940800 20 remove_watcher() i=7 2024-09-12T17:40:51.014 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:51.014 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:51.014 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:40:51.014 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:51.087 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:40:51.088 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:51.302 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:40:51.331 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:51.331 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:51.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.369+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 20 realm 2024-09-12T17:40:51.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.371+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.372+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.372+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.372+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.372+0000 7f983f420800 20 searching for the correct realm 2024-09-12T17:40:51.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.375+0000 7f9837fff640 0 -- 172.21.15.63:0/1039600187 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f982806bb70 msgr2=0x7f98280b4ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.579+0000 7f983d70b640 0 -- 172.21.15.63:0/1039600187 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x565472424110 msgr2=0x565472426500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 zone default found 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 4 Realm: () 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 zonegroup default 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.584+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.585+0000 7f983f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.585+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.585+0000 7f983f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.585+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.585+0000 7f983f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.585+0000 7f983f420800 20 started sync module instance, tier type = 2024-09-12T17:40:51.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.585+0000 7f983f420800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.594+0000 7f983f420800 20 add_watcher() i=0 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.594+0000 7f983f420800 20 add_watcher() i=1 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.594+0000 7f983f420800 20 add_watcher() i=2 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.594+0000 7f983f420800 20 add_watcher() i=3 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.594+0000 7f983f420800 20 add_watcher() i=4 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.594+0000 7f983f420800 20 add_watcher() i=5 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.594+0000 7f983f420800 20 add_watcher() i=6 2024-09-12T17:40:51.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.595+0000 7f983f420800 20 add_watcher() i=7 2024-09-12T17:40:51.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.595+0000 7f983f420800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:51.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.597+0000 7f96f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.597+0000 7f983f420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.597+0000 7f983f420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.597+0000 7f983f420800 5 note: GC not initialized 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.598+0000 7f96f27e4640 20 reqs_thread_entry: start 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.598+0000 7f983f420800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.598+0000 7f983f420800 20 Filter name: none 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.598+0000 7f96ebfff640 20 reqs_thread_entry: start 2024-09-12T17:40:51.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.598+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.598+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:51.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.598+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.599+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:51.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.599+0000 7f983f420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:51.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.599+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.600 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.599+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:51.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.599+0000 7f983f420800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.600+0000 7f983f420800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:51.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.600+0000 7f983f420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:51.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.601+0000 7f96f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:51.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.604+0000 7f983f420800 20 remove_watcher() i=0 2024-09-12T17:40:51.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.604+0000 7f983f420800 2 removed watcher, disabling cache 2024-09-12T17:40:51.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.605+0000 7f983f420800 20 remove_watcher() i=1 2024-09-12T17:40:51.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.605+0000 7f983f420800 20 remove_watcher() i=2 2024-09-12T17:40:51.607 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.606+0000 7f983f420800 20 remove_watcher() i=3 2024-09-12T17:40:51.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.607+0000 7f983f420800 20 remove_watcher() i=4 2024-09-12T17:40:51.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.608+0000 7f983f420800 20 remove_watcher() i=5 2024-09-12T17:40:51.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.610+0000 7f983f420800 20 remove_watcher() i=6 2024-09-12T17:40:51.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.611+0000 7f983f420800 20 remove_watcher() i=7 2024-09-12T17:40:51.622 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:51.623 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:51.623 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:51.623 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:51.624 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:40:51.659 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:51.660 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:51.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.700+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.701+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.701+0000 7f74be526800 20 realm 2024-09-12T17:40:51.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.701+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.702+0000 7f74be526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.703+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:51.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.703+0000 7f74be526800 20 searching for the correct realm 2024-09-12T17:40:51.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.706+0000 7f74ba109640 0 -- 172.21.15.63:0/4130894885 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f74ac07c070 msgr2=0x7f74ac069980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:51.911+0000 7f74ba109640 0 -- 172.21.15.63:0/4130894885 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f74b404c040 msgr2=0x7f74b40605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.118+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 20 zone default found 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 4 Realm: () 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.119+0000 7f74be526800 20 zonegroup default 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.120+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.120+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.121+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.121+0000 7f74be526800 20 started sync module instance, tier type = 2024-09-12T17:40:52.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.121+0000 7f74be526800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:52.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=0 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=1 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=2 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=3 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=4 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=5 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=6 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.132+0000 7f74be526800 20 add_watcher() i=7 2024-09-12T17:40:52.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.132+0000 7f74be526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:52.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.133+0000 7f7370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f74be526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:52.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f74be526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:52.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f74be526800 5 note: GC not initialized 2024-09-12T17:40:52.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f72eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f74be526800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f74be526800 20 Filter name: none 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f72e97fa640 20 reqs_thread_entry: start 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f74be526800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.134+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 : miss 2024-09-12T17:40:52.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:52.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:40:52.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:40:52.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:52.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:52.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.135+0000 7f74be526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 2024-09-12T17:40:52.140 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f74be526800 time 2024-09-12T17:40:52.140725+0000 2024-09-12T17:40:52.140 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:52.141 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.141 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f74bfb8c71a] 2024-09-12T17:40:52.141 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.141 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.141 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.141 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.141 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f74be526800 thread_name:radosgw-admin 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.140+0000 7f74be526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f74be526800 time 2024-09-12T17:40:52.140725+0000 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f74bfb8c71a] 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.142 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.143 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.143 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:52.143 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.143 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:52.143 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:52.143 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.165 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f74be83e6f0] 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f74be88b99c] 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f74bfb8c774] 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.141+0000 7f74be526800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f74be526800 thread_name:radosgw-admin 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f74be83e6f0] 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f74be88b99c] 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f74bfb8c774] 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: dump: 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.169 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: dump: 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:40:51.680+0000 7f74be526800 5 monclient: authenticate success, global_id 6678 2024-09-12T17:40:52.170 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:40:51.680+0000 7f74be526800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:40:51.680+0000 7f74be526800 4 set_mon_vals no callback set 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: shutdown 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:40:51.681+0000 7f74be526800 5 asok(0x557a291cf730) unregister_commands rotate-key 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:40:51.681+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.171 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding auth protocol: cephx 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding auth protocol: cephx 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding auth protocol: cephx 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.172 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:40:51.681+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: starting msgr at 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: starting objecter 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:40:51.681+0000 7f74be526800 5 asok(0x557a291cf730) register_command objecter_requests hook 0x557a293f52a0 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: setting wanted keys 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: calling monclient init 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding auth protocol: cephx 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding auth protocol: cephx 2024-09-12T17:40:52.173 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding auth protocol: cephx 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:40:51.682+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.174 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:40:51.682+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:40:51.682+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key hook 0x557a293f19c8 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a29267cf0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a292a6b40 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a2933a740 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.197424s 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a2933a740 auth_method 0 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.175 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a29267cf0 auth_method 0 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a292a6b40 auth_method 0 2024-09-12T17:40:52.176 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_done global_id 6681 payload 824 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:40:51.682+0000 7f74ba90a640 1 monclient: found mon.noname-a 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: dump: 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.177 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: dump: 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.178 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:40:51.683+0000 7f74be526800 5 monclient: authenticate success, global_id 6681 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:40:51.683+0000 7f73a8608640 4 set_mon_vals no callback set 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.179 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:40:51.683+0000 7f74be526800 1 librados: init done 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:40:51.685+0000 7f73a6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:40:51.685+0000 7f73a6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:40:51.685+0000 7f73a6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:40:51.685+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f73a0076470 auth_method 0 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:40:51.685+0000 7f74b9908640 10 monclient: get_auth_request con 0x557a29439a60 auth_method 0 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:40:51.686+0000 7f74ba109640 10 monclient: get_auth_request con 0x557a2943cc40 auth_method 0 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:40:51.687+0000 7f74b9908640 10 monclient: get_auth_request con 0x557a29441cd0 auth_method 0 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:40:51.688+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:40:51.688+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:40:51.688+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.180 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding auth protocol: cephx 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding auth protocol: cephx 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding auth protocol: cephx 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.181 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:40:51.688+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:40:51.688+0000 7f74be526800 5 asok(0x557a291cf730) register_command objecter_requests cmddesc objecter_requests hook 0x557a29449510 EEXIST 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:40:51.688+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding auth protocol: cephx 2024-09-12T17:40:52.182 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding auth protocol: cephx 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding auth protocol: cephx 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.183 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:40:51.689+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:40:51.689+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:40:51.689+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key cmddesc rotate-key hook 0x557a29444ca0 EEXIST 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a2946d200 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a2946f4d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a2946b9d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.204462s 2024-09-12T17:40:52.184 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a2946f4d0 auth_method 0 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a2946d200 auth_method 0 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a2946b9d0 auth_method 0 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.185 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_done global_id 6684 payload 824 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:40:51.689+0000 7f74b9908640 1 monclient: found mon.noname-a 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: dump: 2024-09-12T17:40:52.186 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.187 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: dump: 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.188 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:40:51.690+0000 7f74be526800 5 monclient: authenticate success, global_id 6684 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:40:51.690+0000 7f74bb10b640 4 set_mon_vals no callback set 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:40:51.692+0000 7f739ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:40:51.692+0000 7f739ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:40:51.692+0000 7f739ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:40:51.692+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f7394076380 auth_method 0 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:40:51.692+0000 7f74be526800 10 monclient: get_monmap_and_config 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:40:51.692+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:40:51.692+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:40:51.692+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding auth protocol: cephx 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding auth protocol: cephx 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding auth protocol: cephx 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:40:51.692+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding auth protocol: cephx 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding auth protocol: cephx 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding auth protocol: cephx 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.192 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:40:51.693+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:40:51.693+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:40:51.693+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key cmddesc rotate-key hook 0x7ffd3cd07788 EEXIST 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a294c17c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a294bbb00 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a294bcbf0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.193 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.208749s 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a294c17c0 auth_method 0 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a294bbb00 auth_method 0 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a294bcbf0 auth_method 0 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:40:51.694+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:40:51.694+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:40:51.694+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:40:51.694+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:40:51.694+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:40:51.694+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient(hunting): handle_auth_done global_id 6687 payload 274 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:40:51.694+0000 7f74ba109640 1 monclient: found mon.noname-a 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:40:51.695+0000 7f739dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: dump: 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: dump: 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:40:51.696+0000 7f74be526800 5 monclient: authenticate success, global_id 6687 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:40:51.696+0000 7f74be526800 4 set_mon_vals no callback set 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: shutdown 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:40:51.696+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding auth protocol: cephx 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding auth protocol: cephx 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding auth protocol: cephx 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:40:51.697+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: starting msgr at 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: starting objecter 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:40:51.697+0000 7f74be526800 5 asok(0x557a291cf730) register_command objecter_requests cmddesc objecter_requests hook 0x557a294c1f40 EEXIST 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: setting wanted keys 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: calling monclient init 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:40:51.697+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding auth protocol: cephx 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding auth protocol: cephx 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding auth protocol: cephx 2024-09-12T17:40:52.200 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:40:51.697+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.201 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:40:51.697+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:40:51.697+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key cmddesc rotate-key hook 0x557a294850f8 EEXIST 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:40:51.697+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:40:51.697+0000 7f74be526800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a294bbb00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a294bcbf0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a294c17c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.213046s 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a294bbb00 auth_method 0 2024-09-12T17:40:52.202 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a294c17c0 auth_method 0 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a294bcbf0 auth_method 0 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_done global_id 6329 payload 824 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:40:51.698+0000 7f74ba109640 1 monclient: found mon.noname-c 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:52.204 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: dump: 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.205 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: dump: 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.206 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:40:51.698+0000 7f74be526800 5 monclient: authenticate success, global_id 6329 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:40:51.698+0000 7f739dffb640 4 set_mon_vals no callback set 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:40:51.698+0000 7f74be526800 1 librados: init done 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:40:51.698+0000 7f74be526800 5 asok(0x557a291cf730) register_command cr dump hook 0x557a294cba48 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:40:51.700+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:40:51.700+0000 7f738bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:40:51.700+0000 7f738bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:40:51.700+0000 7f738bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:40:51.701+0000 7f74b9908640 10 monclient: get_auth_request con 0x7f7384076470 auth_method 0 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:40:51.701+0000 7f74ba90a640 10 monclient: get_auth_request con 0x557a294dbb80 auth_method 0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:40:51.701+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:40:51.701+0000 7f74be526800 20 realm 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:40:51.701+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:40:51.702+0000 7f74be526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:40:51.702+0000 7f74ba109640 10 monclient: get_auth_request con 0x557a294dfe20 auth_method 0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:40:51.703+0000 7f738bfff640 1 client.6329.objecter ms_handle_reset 0x557a294dfe20 session 0x557a294df7a0 osd.1 2024-09-12T17:40:52.208 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:40:51.703+0000 7f738bfff640 10 monclient: _renew_subs 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:40:51.703+0000 7f738bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:40:51.703+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f7384086690 auth_method 0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:40:51.703+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:40:51.703+0000 7f74be526800 20 searching for the correct realm 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:40:51.704+0000 7f74b9908640 10 monclient: get_auth_request con 0x557a294e1dd0 auth_method 0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:40:51.704+0000 7f74ba90a640 10 monclient: get_auth_request con 0x7f74b001a040 auth_method 0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:40:51.706+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f74ac07c070 auth_method 0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:40:51.706+0000 7f74ba109640 0 -- 172.21.15.63:0/4130894885 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f74ac07c070 msgr2=0x7f74ac069980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:40:51.907+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f74ac07c070 auth_method 0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:40:51.908+0000 7f74b9908640 10 monclient: get_auth_request con 0x7f74b007ebd0 auth_method 0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:40:51.910+0000 7f74ba90a640 10 monclient: get_auth_request con 0x7f74ac0694e0 auth_method 0 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:40:51.911+0000 7f74ba109640 0 -- 172.21.15.63:0/4130894885 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f74b404c040 msgr2=0x7f74b40605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:40:52.113+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f74b404c040 auth_method 0 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:40:52.118+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:52.210 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:40:52.119+0000 7f74be526800 20 zone default found 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:40:52.119+0000 7f74be526800 4 Realm: () 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:40:52.119+0000 7f74be526800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:40:52.119+0000 7f74be526800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:40:52.119+0000 7f74be526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:40:52.119+0000 7f74be526800 20 zonegroup default 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:40:52.121+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:40:52.121+0000 7f74be526800 20 started sync module instance, tier type = 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:40:52.121+0000 7f74be526800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:52.211 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=0 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=1 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=2 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=3 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=4 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=5 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=6 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:40:52.132+0000 7f74be526800 20 add_watcher() i=7 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:40:52.132+0000 7f74be526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding auth protocol: cephx 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding auth protocol: cephx 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding auth protocol: cephx 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:40:52.133+0000 7f7370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:40:52.134+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:40:52.134+0000 7f74be526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:52.213 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:40:52.134+0000 7f74be526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache list hook 0x557a294ba950 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache inspect hook 0x557a294ba950 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache erase hook 0x557a294ba950 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache zap hook 0x557a294ba950 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:40:52.134+0000 7f74be526800 5 note: GC not initialized 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:40:52.134+0000 7f72eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace show hook 0x7f74ac072050 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace history hook 0x7f74ac072050 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace active hook 0x7f74ac072050 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace active_short hook 0x7f74ac072050 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:40:52.134+0000 7f74be526800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:40:52.134+0000 7f74be526800 20 Filter name: none 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:40:52.134+0000 7f72e97fa640 20 reqs_thread_entry: start 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:40:52.134+0000 7f74be526800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:40:52.134+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:40:52.135+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:40:52.135+0000 7f74be526800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:40:52.135+0000 7f74be526800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:40:52.135+0000 7f74be526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 : miss 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:40:52.135+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:40:52.135+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:40:52.135+0000 7f74be526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:40:52.135+0000 7f74be526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:40:52.135+0000 7f74be526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:40:52.135+0000 7f74be526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:40:52.135+0000 7f74be526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 2024-09-12T17:40:52.215 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:40:52.140+0000 7f74be526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f74be526800 time 2024-09-12T17:40:52.140725+0000 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f74bfb8c71a] 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:40:52.141+0000 7f74be526800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f74be526800 thread_name:radosgw-admin 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f74be83e6f0] 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f74be88b99c] 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f74bfb8c774] 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:52.218 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:52.221 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:40:52.222 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:52.223 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:52.224 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f72e97fa640 / http_manager 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f72eb7fe640 / http_manager 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7370fe1640 / rgw_dt_lg_renew 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f738bfff640 / ms_dispatch 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f739dffb640 / io_context_pool 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f739ffff640 / ms_dispatch 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f73a6e05640 / ms_dispatch 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f73a8608640 / io_context_pool 2024-09-12T17:40:52.225 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74b9908640 / msgr-worker-2 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74ba109640 / msgr-worker-1 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74ba90a640 / msgr-worker-0 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74bb10b640 / io_context_pool 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74be526800 / radosgw-admin 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.100501.log 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: dump: 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.226 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:40:51.680+0000 7f73a8608640 10 monclient: dump: 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.227 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:40:51.680+0000 7f74be526800 5 monclient: authenticate success, global_id 6678 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:40:51.680+0000 7f74be526800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:40:51.680+0000 7f74be526800 4 set_mon_vals no callback set 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: shutdown 2024-09-12T17:40:52.228 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:40:51.681+0000 7f74be526800 5 asok(0x557a291cf730) unregister_commands rotate-key 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:40:51.681+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.229 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding auth protocol: cephx 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding auth protocol: cephx 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding auth protocol: cephx 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: crc 2024-09-12T17:40:52.230 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f6de0) adding con mode: secure 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:40:51.681+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: starting msgr at 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: starting objecter 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:40:51.681+0000 7f74be526800 5 asok(0x557a291cf730) register_command objecter_requests hook 0x557a293f52a0 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: setting wanted keys 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:40:51.681+0000 7f74be526800 1 librados: calling monclient init 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:40:51.681+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding auth protocol: cephx 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding auth protocol: cephx 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding auth protocol: cephx 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.231 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: crc 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:40:51.681+0000 7f74be526800 5 AuthRegistry(0x557a293f1880) adding con mode: secure 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:40:51.682+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:40:51.682+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:40:51.682+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key hook 0x557a293f19c8 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:52.232 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a29267cf0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a292a6b40 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a2933a740 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:40:51.682+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.197424s 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a2933a740 auth_method 0 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a29267cf0 auth_method 0 2024-09-12T17:40:52.233 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:40:51.682+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a292a6b40 auth_method 0 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:40:51.682+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.234 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient(hunting): handle_auth_done global_id 6681 payload 824 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:40:51.682+0000 7f74ba90a640 1 monclient: found mon.noname-a 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:40:51.682+0000 7f74ba90a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: dump: 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.235 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:40:51.683+0000 7f73a6e05640 10 monclient: dump: 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.236 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:40:51.683+0000 7f74be526800 5 monclient: authenticate success, global_id 6681 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:40:51.683+0000 7f73a8608640 4 set_mon_vals no callback set 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:40:51.683+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:40:51.683+0000 7f74be526800 1 librados: init done 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:40:51.685+0000 7f73a6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:52.237 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:40:51.685+0000 7f73a6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:40:51.685+0000 7f73a6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:40:51.685+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f73a0076470 auth_method 0 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:40:51.685+0000 7f74b9908640 10 monclient: get_auth_request con 0x557a29439a60 auth_method 0 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:40:51.686+0000 7f74ba109640 10 monclient: get_auth_request con 0x557a2943cc40 auth_method 0 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:40:51.687+0000 7f74b9908640 10 monclient: get_auth_request con 0x557a29441cd0 auth_method 0 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:40:51.688+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:40:51.688+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:40:51.688+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.238 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding auth protocol: cephx 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding auth protocol: cephx 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding auth protocol: cephx 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.239 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: crc 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29445ba0) adding con mode: secure 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:40:51.688+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:40:51.688+0000 7f74be526800 5 asok(0x557a291cf730) register_command objecter_requests cmddesc objecter_requests hook 0x557a29449510 EEXIST 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:40:51.688+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding auth protocol: cephx 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding auth protocol: cephx 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding auth protocol: cephx 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.240 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: crc 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:40:51.688+0000 7f74be526800 5 AuthRegistry(0x557a29444b58) adding con mode: secure 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:40:51.689+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:40:51.689+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:40:51.689+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key cmddesc rotate-key hook 0x557a29444ca0 EEXIST 2024-09-12T17:40:52.241 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a2946d200 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a2946f4d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a2946b9d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:40:51.689+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.204462s 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a2946f4d0 auth_method 0 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.242 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a2946d200 auth_method 0 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a2946b9d0 auth_method 0 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:40:51.689+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.243 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:40:51.689+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient(hunting): handle_auth_done global_id 6684 payload 824 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:40:51.689+0000 7f74b9908640 1 monclient: found mon.noname-a 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:40:51.689+0000 7f74b9908640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: dump: 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.244 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:40:51.690+0000 7f739ffff640 10 monclient: dump: 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.245 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:40:51.690+0000 7f74be526800 5 monclient: authenticate success, global_id 6684 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:40:51.690+0000 7f74bb10b640 4 set_mon_vals no callback set 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.246 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:40:51.690+0000 7f74be526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:40:51.692+0000 7f739ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:40:51.692+0000 7f739ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:40:51.692+0000 7f739ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:40:51.692+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f7394076380 auth_method 0 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:40:51.692+0000 7f74be526800 10 monclient: get_monmap_and_config 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:40:51.692+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:40:51.692+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:40:51.692+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.247 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding auth protocol: cephx 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding auth protocol: cephx 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding auth protocol: cephx 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.248 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: crc 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:40:51.692+0000 7f74be526800 5 AuthRegistry(0x557a2948d170) adding con mode: secure 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:40:51.692+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding auth protocol: cephx 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding auth protocol: cephx 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding auth protocol: cephx 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.249 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: crc 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:40:51.693+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07640) adding con mode: secure 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:40:51.693+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:40:51.693+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:40:51.693+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key cmddesc rotate-key hook 0x7ffd3cd07788 EEXIST 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.250 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a294c17c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a294bbb00 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a294bcbf0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:40:51.693+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.208749s 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a294c17c0 auth_method 0 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.251 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a294bbb00 auth_method 0 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:40:51.693+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a294bcbf0 auth_method 0 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:40:51.693+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:40:51.693+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:40:51.694+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:40:51.694+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.252 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:40:51.694+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:40:51.694+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:40:51.694+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:40:51.694+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient(hunting): handle_auth_done global_id 6687 payload 274 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:40:51.694+0000 7f74ba109640 1 monclient: found mon.noname-a 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:40:51.694+0000 7f74ba109640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:40:51.695+0000 7f739dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: dump: 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.253 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:40:51.696+0000 7f739dffb640 10 monclient: dump: 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.254 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:40:51.696+0000 7f74be526800 5 monclient: authenticate success, global_id 6687 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: get_monmap_and_config success 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:40:51.696+0000 7f74be526800 4 set_mon_vals no callback set 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: shutdown 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: build_initial_monmap 2024-09-12T17:40:52.255 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:40:51.696+0000 7f74be526800 1 build_initial for_mkfs: 0 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:40:51.696+0000 7f74be526800 10 monclient: monmap: 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding auth protocol: cephx 2024-09-12T17:40:52.256 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding auth protocol: cephx 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding auth protocol: cephx 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:40:51.696+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: crc 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a294b1fa0) adding con mode: secure 2024-09-12T17:40:52.257 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:40:51.697+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: starting msgr at 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: starting objecter 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:40:51.697+0000 7f74be526800 5 asok(0x557a291cf730) register_command objecter_requests cmddesc objecter_requests hook 0x557a294c1f40 EEXIST 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: setting wanted keys 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:40:51.697+0000 7f74be526800 1 librados: calling monclient init 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:40:51.697+0000 7f74be526800 10 monclient: init 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding auth protocol: cephx 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding auth protocol: cephx 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding auth protocol: cephx 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.258 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: crc 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:40:51.697+0000 7f74be526800 5 AuthRegistry(0x557a29484fb0) adding con mode: secure 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:40:51.697+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:40:51.697+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:40:51.697+0000 7f74be526800 5 asok(0x557a291cf730) register_command rotate-key cmddesc rotate-key hook 0x557a294850f8 EEXIST 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:40:51.697+0000 7f74be526800 10 monclient: _reopen_session rank -1 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:40:51.697+0000 7f74be526800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): picked mon.noname-c con 0x557a294bbb00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:40:52.259 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): picked mon.noname-b con 0x557a294bcbf0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): picked mon.noname-a con 0x557a294c17c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): _renew_subs 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient(hunting): authenticate will time out at 1944.213046s 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): get_auth_request con 0x557a294bbb00 auth_method 0 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): get_auth_request con 0x557a294c17c0 auth_method 0 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.260 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): get_auth_request con 0x557a294bcbf0 auth_method 0 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:40:51.698+0000 7f74ba90a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:52.261 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:40:51.698+0000 7f74b9908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient(hunting): handle_auth_done global_id 6329 payload 824 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient: _finish_hunting 0 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:40:51.698+0000 7f74ba109640 1 monclient: found mon.noname-c 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:40:51.698+0000 7f74ba109640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: dump: 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.262 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: _finish_auth 0 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:40:51.698+0000 7f738bfff640 10 monclient: dump: 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:40:52.263 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:40:51.698+0000 7f74be526800 5 monclient: authenticate success, global_id 6329 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:40:51.698+0000 7f739dffb640 4 set_mon_vals no callback set 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _renew_subs 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:40:51.698+0000 7f74be526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.264 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:40:51.698+0000 7f74be526800 1 librados: init done 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:40:51.698+0000 7f74be526800 5 asok(0x557a291cf730) register_command cr dump hook 0x557a294cba48 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:40:51.700+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:40:51.700+0000 7f738bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:40:51.700+0000 7f738bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:40:51.700+0000 7f738bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:40:51.701+0000 7f74b9908640 10 monclient: get_auth_request con 0x7f7384076470 auth_method 0 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:40:51.701+0000 7f74ba90a640 10 monclient: get_auth_request con 0x557a294dbb80 auth_method 0 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:40:51.701+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:40:51.701+0000 7f74be526800 20 realm 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:40:51.701+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:40:51.702+0000 7f74be526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.265 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:40:51.702+0000 7f74ba109640 10 monclient: get_auth_request con 0x557a294dfe20 auth_method 0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:40:51.702+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:40:51.703+0000 7f738bfff640 1 client.6329.objecter ms_handle_reset 0x557a294dfe20 session 0x557a294df7a0 osd.1 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:40:51.703+0000 7f738bfff640 10 monclient: _renew_subs 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:40:51.703+0000 7f738bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:40:51.703+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f7384086690 auth_method 0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:40:51.703+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:40:51.703+0000 7f74be526800 20 searching for the correct realm 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:40:51.704+0000 7f74b9908640 10 monclient: get_auth_request con 0x557a294e1dd0 auth_method 0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:40:51.704+0000 7f74ba90a640 10 monclient: get_auth_request con 0x7f74b001a040 auth_method 0 2024-09-12T17:40:52.266 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:40:51.706+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f74ac07c070 auth_method 0 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:40:51.706+0000 7f74ba109640 0 -- 172.21.15.63:0/4130894885 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f74ac07c070 msgr2=0x7f74ac069980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:40:51.907+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f74ac07c070 auth_method 0 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:40:51.908+0000 7f74b9908640 10 monclient: get_auth_request con 0x7f74b007ebd0 auth_method 0 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:40:51.910+0000 7f74ba90a640 10 monclient: get_auth_request con 0x7f74ac0694e0 auth_method 0 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:40:51.911+0000 7f74ba109640 0 -- 172.21.15.63:0/4130894885 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f74b404c040 msgr2=0x7f74b40605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:40:52.113+0000 7f74ba109640 10 monclient: get_auth_request con 0x7f74b404c040 auth_method 0 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:40:52.118+0000 7f74be526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:52.267 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:40:52.118+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:40:52.119+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:40:52.119+0000 7f74be526800 20 zone default found 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:40:52.119+0000 7f74be526800 4 Realm: () 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:40:52.119+0000 7f74be526800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:40:52.119+0000 7f74be526800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:40:52.119+0000 7f74be526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:40:52.119+0000 7f74be526800 20 zonegroup default 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.268 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:40:52.120+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:40:52.121+0000 7f74be526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:40:52.121+0000 7f74be526800 20 started sync module instance, tier type = 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:40:52.121+0000 7f74be526800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=0 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=1 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=2 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=3 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=4 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=5 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:40:52.131+0000 7f74be526800 20 add_watcher() i=6 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:40:52.132+0000 7f74be526800 20 add_watcher() i=7 2024-09-12T17:40:52.269 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:40:52.132+0000 7f74be526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding auth protocol: cephx 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding auth protocol: cephx 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding auth protocol: cephx 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.270 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:40:52.133+0000 7f7370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: crc 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:40:52.133+0000 7f74be526800 5 AuthRegistry(0x7ffd3cd07b10) adding con mode: secure 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:40:52.134+0000 7f74be526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:40:52.134+0000 7f74be526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:40:52.134+0000 7f74be526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache list hook 0x557a294ba950 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache inspect hook 0x557a294ba950 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache erase hook 0x557a294ba950 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command cache zap hook 0x557a294ba950 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:40:52.134+0000 7f74be526800 5 note: GC not initialized 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:40:52.134+0000 7f72eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace show hook 0x7f74ac072050 2024-09-12T17:40:52.271 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace history hook 0x7f74ac072050 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace active hook 0x7f74ac072050 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:40:52.134+0000 7f74be526800 5 asok(0x557a291cf730) register_command sync trace active_short hook 0x7f74ac072050 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:40:52.134+0000 7f74be526800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:40:52.134+0000 7f74be526800 20 Filter name: none 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:40:52.134+0000 7f72e97fa640 20 reqs_thread_entry: start 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:40:52.134+0000 7f74be526800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:40:52.134+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:40:52.135+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:40:52.135+0000 7f74be526800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:40:52.135+0000 7f74be526800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:40:52.135+0000 7f74be526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 : miss 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:40:52.135+0000 7f74be526800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.272 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:40:52.135+0000 7f74be526800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:40:52.135+0000 7f74be526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:40:52.135+0000 7f74be526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:40:52.135+0000 7f74be526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:40:52.135+0000 7f74be526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:40:52.135+0000 7f74be526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:40:52.140+0000 7f74be526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f74be526800 time 2024-09-12T17:40:52.140725+0000 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f74bfb8c71a] 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.273 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:40:52.141+0000 7f74be526800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f74be526800 thread_name:radosgw-admin 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f74be83e6f0] 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f74be88b99c] 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:40:52.274 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f74bfb8c774] 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f74bfb8c8d8] 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557a26c66841] 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd73ca8) [0x557a27173ca8] 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557a26c7650d] 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f74be829590] 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:40:52.275 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:40:52.276 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:40:52.277 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:40:52.278 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:40:52.279 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:40:52.280 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:40:52.281 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 7f72e97fa640 / http_manager 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 7f72eb7fe640 / http_manager 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7370fe1640 / rgw_dt_lg_renew 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 7f738bfff640 / ms_dispatch 2024-09-12T17:40:52.282 INFO:tasks.workunit.client.0.smithi063.stderr: 7f739dffb640 / io_context_pool 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f739ffff640 / ms_dispatch 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f73a6e05640 / ms_dispatch 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f73a8608640 / io_context_pool 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74b9908640 / msgr-worker-2 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74ba109640 / msgr-worker-1 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74ba90a640 / msgr-worker-0 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74bb10b640 / io_context_pool 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: 7f74be526800 / radosgw-admin 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:40:52.142423Z_e4e44e73-71b0-40ce-bf33-7200c9f17127/log 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:40:52.283 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:40:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.224+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 20 realm 2024-09-12T17:40:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.226+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.227+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.227+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.227+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.227+0000 7f908832c800 20 searching for the correct realm 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.230+0000 7f90838d9640 0 -- 172.21.15.63:0/1806264003 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f906c063930 msgr2=0x7f906c099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:52.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.435+0000 7f90848db640 0 -- 172.21.15.63:0/1806264003 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x556bb3f255e0 msgr2=0x556bb3f279d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:52.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:52.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:52.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:52.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:52.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:52.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:52.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.441 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.439+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:52.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 zone default found 2024-09-12T17:40:52.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 4 Realm: () 2024-09-12T17:40:52.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 zonegroup default 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.440+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.441+0000 7f908832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.441+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.441+0000 7f908832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.441+0000 7f908832c800 20 started sync module instance, tier type = 2024-09-12T17:40:52.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.441+0000 7f908832c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.450+0000 7f908832c800 20 add_watcher() i=0 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.450+0000 7f908832c800 20 add_watcher() i=1 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.450+0000 7f908832c800 20 add_watcher() i=2 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.450+0000 7f908832c800 20 add_watcher() i=3 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.450+0000 7f908832c800 20 add_watcher() i=4 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.450+0000 7f908832c800 20 add_watcher() i=5 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.450+0000 7f908832c800 20 add_watcher() i=6 2024-09-12T17:40:52.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.451+0000 7f908832c800 20 add_watcher() i=7 2024-09-12T17:40:52.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.451+0000 7f908832c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:52.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.452+0000 7f8f3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f908832c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f908832c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f908832c800 5 note: GC not initialized 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f8f39fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f908832c800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f908832c800 20 Filter name: none 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f8eab7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:52.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.453+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.454+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.454+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.454+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.454+0000 7f908832c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.454+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.454+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.454+0000 7f908832c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.455+0000 7f908832c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:52.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.455+0000 7f908832c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:52.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.456+0000 7f8f3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.459+0000 7f908832c800 20 remove_watcher() i=0 2024-09-12T17:40:52.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.459+0000 7f908832c800 2 removed watcher, disabling cache 2024-09-12T17:40:52.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.459+0000 7f908832c800 20 remove_watcher() i=1 2024-09-12T17:40:52.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.460+0000 7f908832c800 20 remove_watcher() i=2 2024-09-12T17:40:52.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.461+0000 7f908832c800 20 remove_watcher() i=3 2024-09-12T17:40:52.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.463+0000 7f908832c800 20 remove_watcher() i=4 2024-09-12T17:40:52.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.464+0000 7f908832c800 20 remove_watcher() i=5 2024-09-12T17:40:52.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.465+0000 7f908832c800 20 remove_watcher() i=6 2024-09-12T17:40:52.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.466+0000 7f908832c800 20 remove_watcher() i=7 2024-09-12T17:40:52.477 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.478 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:40:52.478 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:40:52.478 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:40:52.532 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:40:52.564 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:52.564 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:52.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.602+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 20 realm 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.604+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.605+0000 7f4a2220f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.605+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.605+0000 7f4a2220f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:52.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.605+0000 7f4a2220f800 20 searching for the correct realm 2024-09-12T17:40:52.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.608+0000 7f4a1f4ff640 0 -- 172.21.15.63:0/1247726652 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f4a14046400 msgr2=0x7f4a14046880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:52.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.814+0000 7f4a1f4ff640 0 -- 172.21.15.63:0/1247726652 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56397d4ef5e0 msgr2=0x56397d4f19f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.818+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 zone default found 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 4 Realm: () 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 zonegroup default 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.819+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.820+0000 7f4a2220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.820+0000 7f4a2220f800 20 started sync module instance, tier type = 2024-09-12T17:40:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.820+0000 7f4a2220f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:40:52.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.828+0000 7f4a2220f800 20 add_watcher() i=0 2024-09-12T17:40:52.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.828+0000 7f4a2220f800 20 add_watcher() i=1 2024-09-12T17:40:52.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.828+0000 7f4a2220f800 20 add_watcher() i=2 2024-09-12T17:40:52.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.828+0000 7f4a2220f800 20 add_watcher() i=3 2024-09-12T17:40:52.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.828+0000 7f4a2220f800 20 add_watcher() i=4 2024-09-12T17:40:52.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.828+0000 7f4a2220f800 20 add_watcher() i=5 2024-09-12T17:40:52.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.828+0000 7f4a2220f800 20 add_watcher() i=6 2024-09-12T17:40:52.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.829+0000 7f4a2220f800 20 add_watcher() i=7 2024-09-12T17:40:52.831 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.829+0000 7f4a2220f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:52.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.831+0000 7f48d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f4a2220f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:52.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f4a2220f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:52.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f4a2220f800 5 note: GC not initialized 2024-09-12T17:40:52.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f48d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f4a2220f800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f4a2220f800 20 Filter name: none 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f484e7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f4a2220f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.832+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 : miss 2024-09-12T17:40:52.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:40:52.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:40:52.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:40:52.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:52.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:40:52.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.833+0000 7f4a2220f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 2024-09-12T17:40:52.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.834+0000 7f4a2220f800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to be held by another RGW process; skipping for now 2024-09-12T17:40:52.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.835+0000 7f48d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.837+0000 7f4a2220f800 20 remove_watcher() i=0 2024-09-12T17:40:52.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.837+0000 7f4a2220f800 2 removed watcher, disabling cache 2024-09-12T17:40:52.839 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.838+0000 7f4a2220f800 20 remove_watcher() i=1 2024-09-12T17:40:52.840 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.839+0000 7f4a2220f800 20 remove_watcher() i=2 2024-09-12T17:40:52.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.840+0000 7f4a2220f800 20 remove_watcher() i=3 2024-09-12T17:40:52.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.841+0000 7f4a2220f800 20 remove_watcher() i=4 2024-09-12T17:40:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.842+0000 7f4a2220f800 20 remove_watcher() i=5 2024-09-12T17:40:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.843+0000 7f4a2220f800 20 remove_watcher() i=6 2024-09-12T17:40:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:40:52.844+0000 7f4a2220f800 20 remove_watcher() i=7 2024-09-12T17:40:52.855 INFO:tasks.workunit.client.0.smithi063.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:41:22.889 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:41:22.925 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:22.926 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:22.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.969+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.970+0000 7fcb7e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:22.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.970+0000 7fcb7e0bb800 20 realm 2024-09-12T17:41:22.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.970+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.971+0000 7fcb7e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:22.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.971+0000 7fcb7e0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:22.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.971+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.971+0000 7fcb7e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:22.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.971+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.972+0000 7fcb7e0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:22.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.972+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.972+0000 7fcb7e0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:22.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.972+0000 7fcb7e0bb800 20 searching for the correct realm 2024-09-12T17:41:22.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:22.975+0000 7fcb7b3a4640 0 -- 172.21.15.63:0/496830828 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fcb7006dbf0 msgr2=0x7fcb700639b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.180+0000 7fcb7c3a6640 0 -- 172.21.15.63:0/496830828 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55ca4a94abb0 msgr2=0x55ca4a94d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:23.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:23.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.185+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:23.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 zone default found 2024-09-12T17:41:23.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 4 Realm: () 2024-09-12T17:41:23.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 zonegroup default 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.186+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.187+0000 7fcb7e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.187+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.187+0000 7fcb7e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.187+0000 7fcb7e0bb800 20 started sync module instance, tier type = 2024-09-12T17:41:23.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.187+0000 7fcb7e0bb800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:23.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.197+0000 7fcb7e0bb800 20 add_watcher() i=0 2024-09-12T17:41:23.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.197+0000 7fcb7e0bb800 20 add_watcher() i=1 2024-09-12T17:41:23.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.197+0000 7fcb7e0bb800 20 add_watcher() i=2 2024-09-12T17:41:23.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.197+0000 7fcb7e0bb800 20 add_watcher() i=3 2024-09-12T17:41:23.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.197+0000 7fcb7e0bb800 20 add_watcher() i=4 2024-09-12T17:41:23.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.197+0000 7fcb7e0bb800 20 add_watcher() i=5 2024-09-12T17:41:23.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.197+0000 7fcb7e0bb800 20 add_watcher() i=6 2024-09-12T17:41:23.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.198+0000 7fcb7e0bb800 20 add_watcher() i=7 2024-09-12T17:41:23.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.198+0000 7fcb7e0bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:23.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.200+0000 7fca31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.200+0000 7fcb7e0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.200+0000 7fcb7e0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.200+0000 7fcb7e0bb800 5 note: GC not initialized 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fca30fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 20 Filter name: none 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fc9aa7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:41:23.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 : miss 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.201+0000 7fcb7e0bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.202+0000 7fcb7e0bb800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.202+0000 7fcb7e0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:41:23.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.202+0000 7fcb7e0bb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:41:23.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.202+0000 7fcb7e0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:23.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.202+0000 7fcb7e0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:23.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.202+0000 7fcb7e0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 2024-09-12T17:41:23.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fcb7e0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:41:23.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fcb7e0bb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:41:23.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fcb7e0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:23.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fcb7e0bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25, ofs0, ns] 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fca5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 94327323075728 notifier 6380 bl.length()=1009 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fca5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fca5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.207+0000 7fca5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.208+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): orig_sources= new_sources= 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.208+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): potential sources added=[] removed=[] 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.208+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): orig_dests= new_dests= 2024-09-12T17:41:23.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.208+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): potential dests added=[] removed=[] 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.0 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.0 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.1 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.1 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.2 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.2 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.3 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.3 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.4 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.4 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.5 2024-09-12T17:41:23.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.5 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.6 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.6 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.7 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.7 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.8 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.8 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.9 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.9 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.10 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.10 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.11 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1.11 2024-09-12T17:41:23.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.212+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.0 2024-09-12T17:41:23.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.213+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1 2024-09-12T17:41:23.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.213+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.2 2024-09-12T17:41:23.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.214+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.3 2024-09-12T17:41:23.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.214+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.4 2024-09-12T17:41:23.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.215+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.5 2024-09-12T17:41:23.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.216+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.6 2024-09-12T17:41:23.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.216+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.7 2024-09-12T17:41:23.218 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.217+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.8 2024-09-12T17:41:23.219 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.218+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.9 2024-09-12T17:41:23.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.219+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.10 2024-09-12T17:41:23.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.222+0000 7fcb7e0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:23.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.222+0000 7fcb7e0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 2024-09-12T17:41:23.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:41:23.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:41:23.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:23.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25, ofs0, ns] 2024-09-12T17:41:23.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fca5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 94327323075728 notifier 6380 bl.length()=1009 2024-09-12T17:41:23.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fca5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:41:23.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fca5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:41:23.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fca5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:23.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): orig_sources= new_sources= 2024-09-12T17:41:23.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): potential sources added=[] removed=[] 2024-09-12T17:41:23.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): orig_dests= new_dests= 2024-09-12T17:41:23.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.224+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): potential dests added=[] removed=[] 2024-09-12T17:41:23.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.227+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.0 2024-09-12T17:41:23.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.227+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.1 2024-09-12T17:41:23.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.228+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.2 2024-09-12T17:41:23.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.228+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.3 2024-09-12T17:41:23.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.228+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.4 2024-09-12T17:41:23.229 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.229+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.5 2024-09-12T17:41:23.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.229+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.6 2024-09-12T17:41:23.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.229+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.7 2024-09-12T17:41:23.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.230+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.8 2024-09-12T17:41:23.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.230+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.9 2024-09-12T17:41:23.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.230+0000 7fcb7e0bb800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25.10 2024-09-12T17:41:23.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.231+0000 7fcb7e0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:23.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.231+0000 7fcb7e0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 2024-09-12T17:41:23.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fcb7e0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:41:23.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fcb7e0bb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:41:23.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fcb7e0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:23.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fcb7e0bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25, ofs0, ns] 2024-09-12T17:41:23.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fca5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94327323075728 notifier 6380 bl.length()=977 2024-09-12T17:41:23.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fca5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 info.flags=0x17 2024-09-12T17:41:23.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fca5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 to cache LRU end 2024-09-12T17:41:23.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.232+0000 7fca5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:23.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.233+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): orig_sources= new_sources= 2024-09-12T17:41:23.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.233+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): potential sources added=[] removed=[] 2024-09-12T17:41:23.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.233+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): orig_dests= new_dests= 2024-09-12T17:41:23.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.233+0000 7fcb7e0bb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25]): potential dests added=[] removed=[] 2024-09-12T17:41:23.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.235+0000 7fcb7e0bb800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:23.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.238+0000 7fca31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.240+0000 7fcb7e0bb800 20 remove_watcher() i=0 2024-09-12T17:41:23.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.240+0000 7fcb7e0bb800 2 removed watcher, disabling cache 2024-09-12T17:41:23.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.241+0000 7fcb7e0bb800 20 remove_watcher() i=1 2024-09-12T17:41:23.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.242+0000 7fcb7e0bb800 20 remove_watcher() i=2 2024-09-12T17:41:23.244 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.243+0000 7fcb7e0bb800 20 remove_watcher() i=3 2024-09-12T17:41:23.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.244+0000 7fcb7e0bb800 20 remove_watcher() i=4 2024-09-12T17:41:23.246 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.245+0000 7fcb7e0bb800 20 remove_watcher() i=5 2024-09-12T17:41:23.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.246+0000 7fcb7e0bb800 20 remove_watcher() i=6 2024-09-12T17:41:23.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.248+0000 7fcb7e0bb800 20 remove_watcher() i=7 2024-09-12T17:41:23.262 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:41:23.292 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:23.292 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:23.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.330+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.332+0000 7f10df93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.332+0000 7f10df93c800 20 realm 2024-09-12T17:41:23.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.332+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.333+0000 7f10df93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.333+0000 7f10df93c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:23.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.333+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.333+0000 7f10df93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.333+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.333+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.333+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.334+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:23.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.334+0000 7f10df93c800 20 searching for the correct realm 2024-09-12T17:41:23.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.336+0000 7f10dae80640 0 -- 172.21.15.63:0/1869253332 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x55f9009fbc70 msgr2=0x55f9009fe060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.339+0000 7f10db681640 0 -- 172.21.15.63:0/1869253332 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f10d40aa8a0 msgr2=0x7f10d40557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.545+0000 7f10df93c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:23.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.545+0000 7f10df93c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:23.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.545+0000 7f10df93c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:23.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.545+0000 7f10df93c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:23.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.545+0000 7f10df93c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:23.547 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.545+0000 7f10df93c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:23.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.545+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.549 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.550 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 zone default found 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 4 Realm: () 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 zonegroup default 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.546+0000 7f10df93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.547+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.547+0000 7f10df93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.547+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.547+0000 7f10df93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.547+0000 7f10df93c800 20 started sync module instance, tier type = 2024-09-12T17:41:23.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.547+0000 7f10df93c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:23.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.557+0000 7f10df93c800 20 add_watcher() i=0 2024-09-12T17:41:23.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.557+0000 7f10df93c800 20 add_watcher() i=1 2024-09-12T17:41:23.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.557+0000 7f10df93c800 20 add_watcher() i=2 2024-09-12T17:41:23.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.557+0000 7f10df93c800 20 add_watcher() i=3 2024-09-12T17:41:23.558 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.557+0000 7f10df93c800 20 add_watcher() i=4 2024-09-12T17:41:23.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.557+0000 7f10df93c800 20 add_watcher() i=5 2024-09-12T17:41:23.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.557+0000 7f10df93c800 20 add_watcher() i=6 2024-09-12T17:41:23.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.558+0000 7f10df93c800 20 add_watcher() i=7 2024-09-12T17:41:23.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.558+0000 7f10df93c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:23.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.559+0000 7f0f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f10df93c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:23.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f10df93c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:23.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f10df93c800 5 note: GC not initialized 2024-09-12T17:41:23.561 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f0f90fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:23.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f10df93c800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:23.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f10df93c800 20 Filter name: none 2024-09-12T17:41:23.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f0f0a7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:23.562 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.560+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.561+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.561+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.561+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.561+0000 7f10df93c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.561+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.562+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.562+0000 7f10df93c800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.562+0000 7f10df93c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:41:23.563 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.562+0000 7f10df93c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:23.565 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.564+0000 7f0f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.566+0000 7f10df93c800 20 remove_watcher() i=0 2024-09-12T17:41:23.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.566+0000 7f10df93c800 2 removed watcher, disabling cache 2024-09-12T17:41:23.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.567+0000 7f10df93c800 20 remove_watcher() i=1 2024-09-12T17:41:23.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.568+0000 7f10df93c800 20 remove_watcher() i=2 2024-09-12T17:41:23.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.569+0000 7f10df93c800 20 remove_watcher() i=3 2024-09-12T17:41:23.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.570+0000 7f10df93c800 20 remove_watcher() i=4 2024-09-12T17:41:23.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.571+0000 7f10df93c800 20 remove_watcher() i=5 2024-09-12T17:41:23.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.572+0000 7f10df93c800 20 remove_watcher() i=6 2024-09-12T17:41:23.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.573+0000 7f10df93c800 20 remove_watcher() i=7 2024-09-12T17:41:23.586 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:23.586 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:23.586 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-set-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:41:23.586 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:23.883 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:41:23.912 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:23.913 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:23.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.950+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 20 realm 2024-09-12T17:41:23.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:23.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.952+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.953+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.953+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.953+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:23.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.953+0000 7f2e2862f800 20 searching for the correct realm 2024-09-12T17:41:23.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.957+0000 7f2e26120640 0 -- 172.21.15.63:0/268628668 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f2e1801e060 msgr2=0x7f2e180616c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.960+0000 7f2e26120640 0 -- 172.21.15.63:0/268628668 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f2e20078070 msgr2=0x7f2e200b1420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:23.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.963+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:23.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 zone default found 2024-09-12T17:41:23.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 4 Realm: () 2024-09-12T17:41:23.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 zonegroup default 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.964+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.965+0000 7f2e2862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.965+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.965+0000 7f2e2862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.965+0000 7f2e2862f800 20 started sync module instance, tier type = 2024-09-12T17:41:23.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.965+0000 7f2e2862f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:23.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.973+0000 7f2e2862f800 20 add_watcher() i=0 2024-09-12T17:41:23.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.973+0000 7f2e2862f800 20 add_watcher() i=1 2024-09-12T17:41:23.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.973+0000 7f2e2862f800 20 add_watcher() i=2 2024-09-12T17:41:23.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.973+0000 7f2e2862f800 20 add_watcher() i=3 2024-09-12T17:41:23.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.973+0000 7f2e2862f800 20 add_watcher() i=4 2024-09-12T17:41:23.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.973+0000 7f2e2862f800 20 add_watcher() i=5 2024-09-12T17:41:23.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.973+0000 7f2e2862f800 20 add_watcher() i=6 2024-09-12T17:41:23.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.974+0000 7f2e2862f800 20 add_watcher() i=7 2024-09-12T17:41:23.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.974+0000 7f2e2862f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:23.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.976+0000 7f2cdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.976+0000 7f2e2862f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:23.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.976+0000 7f2e2862f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:23.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.976+0000 7f2e2862f800 5 note: GC not initialized 2024-09-12T17:41:23.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.976+0000 7f2c577fe640 20 reqs_thread_entry: start 2024-09-12T17:41:23.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.976+0000 7f2e2862f800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:23.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.977+0000 7f2e2862f800 20 Filter name: none 2024-09-12T17:41:23.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.977+0000 7f2c557fa640 20 reqs_thread_entry: start 2024-09-12T17:41:23.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.977+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.977+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:23.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.977+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.978+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:23.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.978+0000 7f2e2862f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:23.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.978+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.978+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:23.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.978+0000 7f2e2862f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.979+0000 7f2e2862f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:23.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.979+0000 7f2e2862f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:23.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.981+0000 7f2cdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.982+0000 7f2e2862f800 20 remove_watcher() i=0 2024-09-12T17:41:23.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.982+0000 7f2e2862f800 2 removed watcher, disabling cache 2024-09-12T17:41:23.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.984+0000 7f2e2862f800 20 remove_watcher() i=1 2024-09-12T17:41:23.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.985+0000 7f2e2862f800 20 remove_watcher() i=2 2024-09-12T17:41:23.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.986+0000 7f2e2862f800 20 remove_watcher() i=3 2024-09-12T17:41:23.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.987+0000 7f2e2862f800 20 remove_watcher() i=4 2024-09-12T17:41:23.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.987+0000 7f2e2862f800 20 remove_watcher() i=5 2024-09-12T17:41:23.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.988+0000 7f2e2862f800 20 remove_watcher() i=6 2024-09-12T17:41:23.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:23.989+0000 7f2e2862f800 20 remove_watcher() i=7 2024-09-12T17:41:24.002 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:24.003 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:24.003 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:24.003 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:24.005 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:41:24.041 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:24.041 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:24.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.077+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 20 realm 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.080 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.079+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.080+0000 7fabdcb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.080+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.080+0000 7fabdcb22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:24.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.080+0000 7fabdcb22800 20 searching for the correct realm 2024-09-12T17:41:24.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.083+0000 7fabd7f01640 0 -- 172.21.15.63:0/3737821592 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fabcc08dc20 msgr2=0x7fabcc07b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:24.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.289+0000 7fabd8f03640 0 -- 172.21.15.63:0/3737821592 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55716d957100 msgr2=0x55716d9595c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.293+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:24.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 zone default found 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 4 Realm: () 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 zonegroup default 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.294+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.295+0000 7fabdcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.295+0000 7fabdcb22800 20 started sync module instance, tier type = 2024-09-12T17:41:24.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.295+0000 7fabdcb22800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:24.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.303+0000 7fabdcb22800 20 add_watcher() i=0 2024-09-12T17:41:24.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.303+0000 7fabdcb22800 20 add_watcher() i=1 2024-09-12T17:41:24.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.303+0000 7fabdcb22800 20 add_watcher() i=2 2024-09-12T17:41:24.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.303+0000 7fabdcb22800 20 add_watcher() i=3 2024-09-12T17:41:24.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.303+0000 7fabdcb22800 20 add_watcher() i=4 2024-09-12T17:41:24.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.303+0000 7fabdcb22800 20 add_watcher() i=5 2024-09-12T17:41:24.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.303+0000 7fabdcb22800 20 add_watcher() i=6 2024-09-12T17:41:24.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.304+0000 7fabdcb22800 20 add_watcher() i=7 2024-09-12T17:41:24.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.304+0000 7fabdcb22800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:24.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.306+0000 7faa8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.306+0000 7fabdcb22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:24.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.306+0000 7fabdcb22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:24.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.306+0000 7fabdcb22800 5 note: GC not initialized 2024-09-12T17:41:24.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.306+0000 7faa8d7e2640 20 reqs_thread_entry: start 2024-09-12T17:41:24.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.306+0000 7fabdcb22800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:24.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.306+0000 7fabdcb22800 20 Filter name: none 2024-09-12T17:41:24.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fa9feffd640 20 reqs_thread_entry: start 2024-09-12T17:41:24.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:41:24.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 : miss 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:24.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.307+0000 7fabdcb22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 2024-09-12T17:41:24.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.312+0000 7fabdcb22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.312+0000 7fabdcb22800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.312+0000 7fabdcb22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.312+0000 7fabdcb22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26, ofs0, ns] 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.312+0000 7faaaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 93945658227136 notifier 6431 bl.length()=1023 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7faaaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7faaaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7faaaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7fabdcb22800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_sources= new_sources= 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7fabdcb22800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential sources added=[] removed=[] 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7fabdcb22800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_dests= new_dests= 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7fabdcb22800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential dests added=[] removed=[] 2024-09-12T17:41:24.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7fabdcb22800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:41:24.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.313+0000 7fabdcb22800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:41:24.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.315+0000 7faa8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.317+0000 7fabdcb22800 20 remove_watcher() i=0 2024-09-12T17:41:24.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.317+0000 7fabdcb22800 2 removed watcher, disabling cache 2024-09-12T17:41:24.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.318+0000 7fabdcb22800 20 remove_watcher() i=1 2024-09-12T17:41:24.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.319+0000 7fabdcb22800 20 remove_watcher() i=2 2024-09-12T17:41:24.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.320+0000 7fabdcb22800 20 remove_watcher() i=3 2024-09-12T17:41:24.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.321+0000 7fabdcb22800 20 remove_watcher() i=4 2024-09-12T17:41:24.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.322+0000 7fabdcb22800 20 remove_watcher() i=5 2024-09-12T17:41:24.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.323+0000 7fabdcb22800 20 remove_watcher() i=6 2024-09-12T17:41:24.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.324+0000 7fabdcb22800 20 remove_watcher() i=7 2024-09-12T17:41:24.337 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:41:24.366 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:24.366 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:24.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.404+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 20 realm 2024-09-12T17:41:24.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:24.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.406+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.407+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.407+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.407+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:24.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.407+0000 7f389e539800 20 searching for the correct realm 2024-09-12T17:41:24.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.410+0000 7f38999cd640 0 -- 172.21.15.63:0/1956119648 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f3884077400 msgr2=0x7f3884077880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.615+0000 7f38999cd640 0 -- 172.21.15.63:0/1956119648 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55d99aa309c0 msgr2=0x55d99aa32e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:24.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:24.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:24.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:24.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:24.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:24.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.619+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 20 zone default found 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 4 Realm: () 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:24.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 20 zonegroup default 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.620+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.621+0000 7f389e539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.621+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.621+0000 7f389e539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.621+0000 7f389e539800 20 started sync module instance, tier type = 2024-09-12T17:41:24.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.621+0000 7f389e539800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:24.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.629+0000 7f389e539800 20 add_watcher() i=0 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.629+0000 7f389e539800 20 add_watcher() i=1 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.629+0000 7f389e539800 20 add_watcher() i=2 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.629+0000 7f389e539800 20 add_watcher() i=3 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.629+0000 7f389e539800 20 add_watcher() i=4 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.629+0000 7f389e539800 20 add_watcher() i=5 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.629+0000 7f389e539800 20 add_watcher() i=6 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.630+0000 7f389e539800 20 add_watcher() i=7 2024-09-12T17:41:24.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.630+0000 7f389e539800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:24.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.632+0000 7f3750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f389e539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:24.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f389e539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:24.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f389e539800 5 note: GC not initialized 2024-09-12T17:41:24.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f36cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:24.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f389e539800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:24.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f389e539800 20 Filter name: none 2024-09-12T17:41:24.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f36c97fa640 20 reqs_thread_entry: start 2024-09-12T17:41:24.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.633+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.634+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:24.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.634+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.634+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:41:24.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.634+0000 7f389e539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:24.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.634+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.635+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:24.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.635+0000 7f389e539800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.635+0000 7f389e539800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:41:24.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.635+0000 7f389e539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:24.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.637+0000 7f3750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.639+0000 7f389e539800 20 remove_watcher() i=0 2024-09-12T17:41:24.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.639+0000 7f389e539800 2 removed watcher, disabling cache 2024-09-12T17:41:24.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.640+0000 7f389e539800 20 remove_watcher() i=1 2024-09-12T17:41:24.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.641+0000 7f389e539800 20 remove_watcher() i=2 2024-09-12T17:41:24.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.642+0000 7f389e539800 20 remove_watcher() i=3 2024-09-12T17:41:24.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.643+0000 7f389e539800 20 remove_watcher() i=4 2024-09-12T17:41:24.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.644+0000 7f389e539800 20 remove_watcher() i=5 2024-09-12T17:41:24.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.645+0000 7f389e539800 20 remove_watcher() i=6 2024-09-12T17:41:24.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.646+0000 7f389e539800 20 remove_watcher() i=7 2024-09-12T17:41:24.658 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:24.658 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:24.658 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:24.658 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:24.711 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:41:24.743 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:24.743 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:24.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.781+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.782+0000 7fe350f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.782+0000 7fe350f24800 20 realm 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.782+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.783+0000 7fe350f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.783+0000 7fe350f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.783+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.783+0000 7fe350f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.783+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.784+0000 7fe350f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.784+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.784+0000 7fe350f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:24.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.784+0000 7fe350f24800 20 searching for the correct realm 2024-09-12T17:41:24.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.787+0000 7fe347fff640 0 -- 172.21.15.63:0/513043604 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x55925a71b4d0 msgr2=0x55925a71d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.790+0000 7fe34cb56640 0 -- 172.21.15.63:0/513043604 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fe3480d3c20 msgr2=0x7fe3480e1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.996+0000 7fe350f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.996+0000 7fe350f24800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.996+0000 7fe350f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.996+0000 7fe350f24800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.996+0000 7fe350f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.996+0000 7fe350f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.996+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:25.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:25.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 zone default found 2024-09-12T17:41:25.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 4 Realm: () 2024-09-12T17:41:25.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:25.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:25.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:25.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 zonegroup default 2024-09-12T17:41:25.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.997+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.998+0000 7fe350f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.998+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.998+0000 7fe350f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.998+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.998+0000 7fe350f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.998+0000 7fe350f24800 20 started sync module instance, tier type = 2024-09-12T17:41:25.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:24.998+0000 7fe350f24800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:25.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.008+0000 7fe350f24800 20 add_watcher() i=0 2024-09-12T17:41:25.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.008+0000 7fe350f24800 20 add_watcher() i=1 2024-09-12T17:41:25.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.008+0000 7fe350f24800 20 add_watcher() i=2 2024-09-12T17:41:25.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.008+0000 7fe350f24800 20 add_watcher() i=3 2024-09-12T17:41:25.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.008+0000 7fe350f24800 20 add_watcher() i=4 2024-09-12T17:41:25.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.008+0000 7fe350f24800 20 add_watcher() i=5 2024-09-12T17:41:25.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.008+0000 7fe350f24800 20 add_watcher() i=6 2024-09-12T17:41:25.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.009+0000 7fe350f24800 20 add_watcher() i=7 2024-09-12T17:41:25.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.009+0000 7fe350f24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:25.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.010+0000 7fe202fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:25.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.011+0000 7fe350f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:25.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.011+0000 7fe350f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:25.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.011+0000 7fe350f24800 5 note: GC not initialized 2024-09-12T17:41:25.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.011+0000 7fe201fe3640 20 reqs_thread_entry: start 2024-09-12T17:41:25.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.011+0000 7fe350f24800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.011+0000 7fe350f24800 20 Filter name: none 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.011+0000 7fe1737fe640 20 reqs_thread_entry: start 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 : miss 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:25.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:25.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:25.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:25.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.012+0000 7fe350f24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 2024-09-12T17:41:25.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.013+0000 7fe350f24800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:41:25.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe350f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:25.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe350f24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:25.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe350f24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:25.020 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe350f24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26, ofs0, ns] 2024-09-12T17:41:25.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe223fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431607 cookie 94087071010896 notifier 6430 bl.length()=1023 2024-09-12T17:41:25.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe223fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:25.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe223fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:25.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.019+0000 7fe223fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:25.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.020+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_sources= new_sources= 2024-09-12T17:41:25.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.020+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential sources added=[] removed=[] 2024-09-12T17:41:25.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.020+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_dests= new_dests= 2024-09-12T17:41:25.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.020+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential dests added=[] removed=[] 2024-09-12T17:41:25.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.0 2024-09-12T17:41:25.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.0 2024-09-12T17:41:25.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.1 2024-09-12T17:41:25.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.1 2024-09-12T17:41:25.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.2 2024-09-12T17:41:25.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.2 2024-09-12T17:41:25.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.3 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.3 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.4 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.4 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.5 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.5 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.6 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.6 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.7 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.7 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.8 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.8 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.9 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.9 2024-09-12T17:41:25.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.10 2024-09-12T17:41:25.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.10 2024-09-12T17:41:25.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.11 2024-09-12T17:41:25.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2.11 2024-09-12T17:41:25.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.0 2024-09-12T17:41:25.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.025+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.1 2024-09-12T17:41:25.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.026+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2 2024-09-12T17:41:25.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.026+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.3 2024-09-12T17:41:25.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.026+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.4 2024-09-12T17:41:25.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.027+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.5 2024-09-12T17:41:25.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.028+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.6 2024-09-12T17:41:25.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.028+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.7 2024-09-12T17:41:25.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.029+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.8 2024-09-12T17:41:25.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.029+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.9 2024-09-12T17:41:25.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.030+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.10 2024-09-12T17:41:25.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.033+0000 7fe350f24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:25.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.033+0000 7fe350f24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 2024-09-12T17:41:25.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe350f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:25.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe350f24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:25.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe350f24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:25.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe350f24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26, ofs0, ns] 2024-09-12T17:41:25.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe223fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431608 cookie 94087071010896 notifier 6430 bl.length()=1023 2024-09-12T17:41:25.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe223fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:25.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe223fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:25.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.034+0000 7fe223fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:25.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.035+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_sources= new_sources= 2024-09-12T17:41:25.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.035+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential sources added=[] removed=[] 2024-09-12T17:41:25.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.035+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_dests= new_dests= 2024-09-12T17:41:25.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.035+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential dests added=[] removed=[] 2024-09-12T17:41:25.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.037+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.0 2024-09-12T17:41:25.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.037+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.1 2024-09-12T17:41:25.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.038+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.2 2024-09-12T17:41:25.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.038+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.3 2024-09-12T17:41:25.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.038+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.4 2024-09-12T17:41:25.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.039+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.5 2024-09-12T17:41:25.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.039+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.6 2024-09-12T17:41:25.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.040+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.7 2024-09-12T17:41:25.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.040+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.8 2024-09-12T17:41:25.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.040+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.9 2024-09-12T17:41:25.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.041+0000 7fe350f24800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26.10 2024-09-12T17:41:25.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.041+0000 7fe350f24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:25.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.041+0000 7fe350f24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 2024-09-12T17:41:25.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe350f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:25.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe350f24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:25.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe350f24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:25.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe350f24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26, ofs0, ns] 2024-09-12T17:41:25.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe2237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94087071010896 notifier 6430 bl.length()=991 2024-09-12T17:41:25.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe2237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 info.flags=0x17 2024-09-12T17:41:25.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe2237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 to cache LRU end 2024-09-12T17:41:25.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.042+0000 7fe2237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:25.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.043+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_sources= new_sources= 2024-09-12T17:41:25.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.043+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential sources added=[] removed=[] 2024-09-12T17:41:25.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.043+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): orig_dests= new_dests= 2024-09-12T17:41:25.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.043+0000 7fe350f24800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26]): potential dests added=[] removed=[] 2024-09-12T17:41:25.046 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.045+0000 7fe350f24800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:25.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.047+0000 7fe202fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:25.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.049+0000 7fe350f24800 20 remove_watcher() i=0 2024-09-12T17:41:25.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.049+0000 7fe350f24800 2 removed watcher, disabling cache 2024-09-12T17:41:25.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.050+0000 7fe350f24800 20 remove_watcher() i=1 2024-09-12T17:41:25.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.051+0000 7fe350f24800 20 remove_watcher() i=2 2024-09-12T17:41:25.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.052+0000 7fe350f24800 20 remove_watcher() i=3 2024-09-12T17:41:25.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.053+0000 7fe350f24800 20 remove_watcher() i=4 2024-09-12T17:41:25.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.054+0000 7fe350f24800 20 remove_watcher() i=5 2024-09-12T17:41:25.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.055+0000 7fe350f24800 20 remove_watcher() i=6 2024-09-12T17:41:25.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.056+0000 7fe350f24800 20 remove_watcher() i=7 2024-09-12T17:41:25.069 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:41:25.098 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:25.098 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:25.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.135+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 20 realm 2024-09-12T17:41:25.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:25.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.137+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.138+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:25.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.138+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.138+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:25.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.138+0000 7fc011410800 20 searching for the correct realm 2024-09-12T17:41:25.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.142+0000 7fc00c379640 0 -- 172.21.15.63:0/2715612069 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fc000072120 msgr2=0x7fc0000676f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:25.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.346+0000 7fc00d37b640 0 -- 172.21.15.63:0/2715612069 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5623f9738470 msgr2=0x5623f973a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.350+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 zone default found 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 4 Realm: () 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 zonegroup default 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.351+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.352+0000 7fc011410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.352+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.352+0000 7fc011410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.352+0000 7fc011410800 20 started sync module instance, tier type = 2024-09-12T17:41:25.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.352+0000 7fc011410800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:25.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.361+0000 7fc011410800 20 add_watcher() i=0 2024-09-12T17:41:25.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.361+0000 7fc011410800 20 add_watcher() i=1 2024-09-12T17:41:25.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.361+0000 7fc011410800 20 add_watcher() i=2 2024-09-12T17:41:25.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.361+0000 7fc011410800 20 add_watcher() i=3 2024-09-12T17:41:25.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.361+0000 7fc011410800 20 add_watcher() i=4 2024-09-12T17:41:25.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.361+0000 7fc011410800 20 add_watcher() i=5 2024-09-12T17:41:25.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.361+0000 7fc011410800 20 add_watcher() i=6 2024-09-12T17:41:25.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.362+0000 7fc011410800 20 add_watcher() i=7 2024-09-12T17:41:25.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.362+0000 7fc011410800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:25.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.365+0000 7fbec2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:25.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.365+0000 7fc011410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:25.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.365+0000 7fc011410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:25.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.365+0000 7fc011410800 5 note: GC not initialized 2024-09-12T17:41:25.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.365+0000 7fbec1fe3640 20 reqs_thread_entry: start 2024-09-12T17:41:25.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.366+0000 7fc011410800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:25.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.366+0000 7fc011410800 20 Filter name: none 2024-09-12T17:41:25.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.366+0000 7fbe337fe640 20 reqs_thread_entry: start 2024-09-12T17:41:25.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.366+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.366+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:25.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.366+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.367+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:25.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.367+0000 7fc011410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:25.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.367+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.367+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:25.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.367+0000 7fc011410800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.367+0000 7fc011410800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:25.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.367+0000 7fc011410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:25.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.369+0000 7fbec2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:25.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.372+0000 7fc011410800 20 remove_watcher() i=0 2024-09-12T17:41:25.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.372+0000 7fc011410800 2 removed watcher, disabling cache 2024-09-12T17:41:25.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.373+0000 7fc011410800 20 remove_watcher() i=1 2024-09-12T17:41:25.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.374+0000 7fc011410800 20 remove_watcher() i=2 2024-09-12T17:41:25.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.375+0000 7fc011410800 20 remove_watcher() i=3 2024-09-12T17:41:25.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.376+0000 7fc011410800 20 remove_watcher() i=4 2024-09-12T17:41:25.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.377+0000 7fc011410800 20 remove_watcher() i=5 2024-09-12T17:41:25.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.377+0000 7fc011410800 20 remove_watcher() i=6 2024-09-12T17:41:25.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.378+0000 7fc011410800 20 remove_watcher() i=7 2024-09-12T17:41:25.390 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:25.390 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:25.391 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:41:25.391 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:25.465 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:41:25.465 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:25.704 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:41:25.733 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:25.733 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:25.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.771+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.772+0000 7fd03cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.772+0000 7fd03cb39800 20 realm 2024-09-12T17:41:25.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.772+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.773+0000 7fd03cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.773+0000 7fd03cb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:25.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.773+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.773+0000 7fd03cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.773+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.774+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:25.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.774+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.774+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:25.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.774+0000 7fd03cb39800 20 searching for the correct realm 2024-09-12T17:41:25.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.777+0000 7fd037fc6640 0 -- 172.21.15.63:0/1580033414 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fd02c06b070 msgr2=0x7fd02c0d4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:25.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.983+0000 7fd037fc6640 0 -- 172.21.15.63:0/1580033414 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56466034fa10 msgr2=0x564660351e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.987+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 zone default found 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 4 Realm: () 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 zonegroup default 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.988+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.989+0000 7fd03cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.989+0000 7fd03cb39800 20 started sync module instance, tier type = 2024-09-12T17:41:25.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.989+0000 7fd03cb39800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:25.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.997+0000 7fd03cb39800 20 add_watcher() i=0 2024-09-12T17:41:25.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.997+0000 7fd03cb39800 20 add_watcher() i=1 2024-09-12T17:41:25.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.997+0000 7fd03cb39800 20 add_watcher() i=2 2024-09-12T17:41:25.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.997+0000 7fd03cb39800 20 add_watcher() i=3 2024-09-12T17:41:25.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.997+0000 7fd03cb39800 20 add_watcher() i=4 2024-09-12T17:41:25.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.997+0000 7fd03cb39800 20 add_watcher() i=5 2024-09-12T17:41:25.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.997+0000 7fd03cb39800 20 add_watcher() i=6 2024-09-12T17:41:25.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.999+0000 7fd03cb39800 20 add_watcher() i=7 2024-09-12T17:41:25.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:25.999+0000 7fd03cb39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:26.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fceeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fd03cb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fd03cb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fd03cb39800 5 note: GC not initialized 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fceedfe3640 20 reqs_thread_entry: start 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fd03cb39800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fd03cb39800 20 Filter name: none 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fcee77fe640 20 reqs_thread_entry: start 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.001+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.002+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:26.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.002+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.003+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:26.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.003+0000 7fd03cb39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:26.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.003+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.003+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:26.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.003+0000 7fd03cb39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.003+0000 7fd03cb39800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:26.005 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.003+0000 7fd03cb39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:26.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.005+0000 7fceeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.007+0000 7fd03cb39800 20 remove_watcher() i=0 2024-09-12T17:41:26.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.007+0000 7fd03cb39800 2 removed watcher, disabling cache 2024-09-12T17:41:26.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.008+0000 7fd03cb39800 20 remove_watcher() i=1 2024-09-12T17:41:26.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.009+0000 7fd03cb39800 20 remove_watcher() i=2 2024-09-12T17:41:26.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.010+0000 7fd03cb39800 20 remove_watcher() i=3 2024-09-12T17:41:26.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.011+0000 7fd03cb39800 20 remove_watcher() i=4 2024-09-12T17:41:26.013 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.012+0000 7fd03cb39800 20 remove_watcher() i=5 2024-09-12T17:41:26.014 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.013+0000 7fd03cb39800 20 remove_watcher() i=6 2024-09-12T17:41:26.015 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.014+0000 7fd03cb39800 20 remove_watcher() i=7 2024-09-12T17:41:26.026 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:26.026 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:26.026 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:26.026 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:26.027 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:41:26.064 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:26.065 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:26.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.102+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 20 realm 2024-09-12T17:41:26.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:26.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.104+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.105+0000 7f9fc7935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:26.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.105+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.105+0000 7f9fc7935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:26.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.105+0000 7f9fc7935800 20 searching for the correct realm 2024-09-12T17:41:26.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.108+0000 7f9fc2ee3640 0 -- 172.21.15.63:0/950439560 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x560fddb2f2b0 msgr2=0x560fddb31770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:26.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.110+0000 7f9fc36e4640 0 -- 172.21.15.63:0/950439560 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f9fbc0645b0 msgr2=0x7f9fbc063020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:26.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.317+0000 7f9fc7935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:26.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.317+0000 7f9fc7935800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:26.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.317+0000 7f9fc7935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:26.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.317+0000 7f9fc7935800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:26.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.317+0000 7f9fc7935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:26.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.317+0000 7f9fc7935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:26.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.317+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.318+0000 7f9fc7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.318+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.318+0000 7f9fc7935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:26.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.318+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:26.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 zone default found 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 4 Realm: () 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 zonegroup default 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.319+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.320+0000 7f9fc7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.320+0000 7f9fc7935800 20 started sync module instance, tier type = 2024-09-12T17:41:26.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.320+0000 7f9fc7935800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:26.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.329+0000 7f9fc7935800 20 add_watcher() i=0 2024-09-12T17:41:26.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.329+0000 7f9fc7935800 20 add_watcher() i=1 2024-09-12T17:41:26.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.329+0000 7f9fc7935800 20 add_watcher() i=2 2024-09-12T17:41:26.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.329+0000 7f9fc7935800 20 add_watcher() i=3 2024-09-12T17:41:26.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.329+0000 7f9fc7935800 20 add_watcher() i=4 2024-09-12T17:41:26.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.329+0000 7f9fc7935800 20 add_watcher() i=5 2024-09-12T17:41:26.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.329+0000 7f9fc7935800 20 add_watcher() i=6 2024-09-12T17:41:26.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.330+0000 7f9fc7935800 20 add_watcher() i=7 2024-09-12T17:41:26.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.330+0000 7f9fc7935800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:26.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.331+0000 7f9e79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9fc7935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9fc7935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:26.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9fc7935800 5 note: GC not initialized 2024-09-12T17:41:26.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9e78fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:26.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9fc7935800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:26.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9fc7935800 20 Filter name: none 2024-09-12T17:41:26.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9df27fc640 20 reqs_thread_entry: start 2024-09-12T17:41:26.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9fc7935800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:41:26.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.332+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:26.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:26.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 : miss 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 info.flags=0x17 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 to cache LRU end 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:26.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.333+0000 7f9fc7935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 info.flags=0x17 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 to cache LRU end 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27, ofs0, ns] 2024-09-12T17:41:26.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9ea67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94626144015072 notifier 6515 bl.length()=1023 2024-09-12T17:41:26.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9ea67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 info.flags=0x17 2024-09-12T17:41:26.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9ea67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 to cache LRU end 2024-09-12T17:41:26.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9ea67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:26.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): orig_sources= new_sources= 2024-09-12T17:41:26.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): potential sources added=[] removed=[] 2024-09-12T17:41:26.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): orig_dests= new_dests= 2024-09-12T17:41:26.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): potential dests added=[] removed=[] 2024-09-12T17:41:26.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:41:26.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.339+0000 7f9fc7935800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:41:26.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.0 2024-09-12T17:41:26.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.0 2024-09-12T17:41:26.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.1 2024-09-12T17:41:26.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.1 2024-09-12T17:41:26.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.2 2024-09-12T17:41:26.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.2 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.3 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.3 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.4 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.4 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.5 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.5 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.6 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.6 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.7 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.7 2024-09-12T17:41:26.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.8 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.8 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.9 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.9 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.10 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.10 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.11 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1.11 2024-09-12T17:41:26.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.0 2024-09-12T17:41:26.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.342+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.1 2024-09-12T17:41:26.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.343+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.2 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.343+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.3 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.343+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.4 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.344+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.5 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.345+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.6 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.345+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.7 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.346+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.8 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.346+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.9 2024-09-12T17:41:26.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.346+0000 7f9fc7935800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27.10 2024-09-12T17:41:26.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.350+0000 7f9fc7935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:26.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.350+0000 7f9fc7935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 2024-09-12T17:41:26.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9fc7935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 info.flags=0x17 2024-09-12T17:41:26.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9fc7935800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 to cache LRU end 2024-09-12T17:41:26.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9fc7935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:26.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9fc7935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27, ofs0, ns] 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9ea6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94626144015072 notifier 6515 bl.length()=991 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9ea6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 info.flags=0x17 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9ea6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 to cache LRU end 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.351+0000 7f9ea6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.352+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): orig_sources= new_sources= 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.352+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): potential sources added=[] removed=[] 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.352+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): orig_dests= new_dests= 2024-09-12T17:41:26.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.352+0000 7f9fc7935800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27]): potential dests added=[] removed=[] 2024-09-12T17:41:26.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.354+0000 7f9fc7935800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:26.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.356+0000 7f9e79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.358+0000 7f9fc7935800 20 remove_watcher() i=0 2024-09-12T17:41:26.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.358+0000 7f9fc7935800 2 removed watcher, disabling cache 2024-09-12T17:41:26.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.359+0000 7f9fc7935800 20 remove_watcher() i=1 2024-09-12T17:41:26.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.361+0000 7f9fc7935800 20 remove_watcher() i=2 2024-09-12T17:41:26.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.362+0000 7f9fc7935800 20 remove_watcher() i=3 2024-09-12T17:41:26.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.363+0000 7f9fc7935800 20 remove_watcher() i=4 2024-09-12T17:41:26.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.364+0000 7f9fc7935800 20 remove_watcher() i=5 2024-09-12T17:41:26.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.365+0000 7f9fc7935800 20 remove_watcher() i=6 2024-09-12T17:41:26.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.365+0000 7f9fc7935800 20 remove_watcher() i=7 2024-09-12T17:41:26.379 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:41:26.409 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:26.409 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:26.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.447+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.449+0000 7fbd15611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.449+0000 7fbd15611800 20 realm 2024-09-12T17:41:26.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.449+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.449+0000 7fbd15611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.449+0000 7fbd15611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:26.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.449+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.450+0000 7fbd15611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.450+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.450+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:26.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.450+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.450+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:26.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.450+0000 7fbd15611800 20 searching for the correct realm 2024-09-12T17:41:26.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.453+0000 7fbd10591640 0 -- 172.21.15.63:0/3595361637 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fbd04065040 msgr2=0x7fbd0408d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:26.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.658+0000 7fbd11593640 0 -- 172.21.15.63:0/3595361637 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x560dedb37370 msgr2=0x560dedb39780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.662+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 zone default found 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 4 Realm: () 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 zonegroup default 2024-09-12T17:41:26.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.663+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.664+0000 7fbd15611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.664+0000 7fbd15611800 20 started sync module instance, tier type = 2024-09-12T17:41:26.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.664+0000 7fbd15611800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.672+0000 7fbd15611800 20 add_watcher() i=0 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.672+0000 7fbd15611800 20 add_watcher() i=1 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.672+0000 7fbd15611800 20 add_watcher() i=2 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.672+0000 7fbd15611800 20 add_watcher() i=3 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.672+0000 7fbd15611800 20 add_watcher() i=4 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.672+0000 7fbd15611800 20 add_watcher() i=5 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.673+0000 7fbd15611800 20 add_watcher() i=6 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.673+0000 7fbd15611800 20 add_watcher() i=7 2024-09-12T17:41:26.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.673+0000 7fbd15611800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:26.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.675+0000 7fbbc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.675+0000 7fbd15611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.675+0000 7fbd15611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.675+0000 7fbd15611800 5 note: GC not initialized 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.676+0000 7fbbc67e4640 20 reqs_thread_entry: start 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.676+0000 7fbd15611800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.676+0000 7fbd15611800 20 Filter name: none 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.676+0000 7fbbbf7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:26.677 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.676+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.676+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:26.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.676+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.677+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:26.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.677+0000 7fbd15611800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:26.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.677+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.678+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.678+0000 7fbd15611800 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.679+0000 7fbd15611800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.679+0000 7fbd15611800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:26.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.680+0000 7fbbc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.682+0000 7fbd15611800 20 remove_watcher() i=0 2024-09-12T17:41:26.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.682+0000 7fbd15611800 2 removed watcher, disabling cache 2024-09-12T17:41:26.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.683+0000 7fbd15611800 20 remove_watcher() i=1 2024-09-12T17:41:26.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.684+0000 7fbd15611800 20 remove_watcher() i=2 2024-09-12T17:41:26.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.685+0000 7fbd15611800 20 remove_watcher() i=3 2024-09-12T17:41:26.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.687+0000 7fbd15611800 20 remove_watcher() i=4 2024-09-12T17:41:26.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.687+0000 7fbd15611800 20 remove_watcher() i=5 2024-09-12T17:41:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.688+0000 7fbd15611800 20 remove_watcher() i=6 2024-09-12T17:41:26.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:26.689+0000 7fbd15611800 20 remove_watcher() i=7 2024-09-12T17:41:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:26.701 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:26.701 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:41:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:26.776 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:41:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:26.997 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:41:27.027 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:27.027 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:27.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.066+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.067+0000 7f49820bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.067+0000 7f49820bb800 20 realm 2024-09-12T17:41:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.067+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.068+0000 7f49820bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.068+0000 7f49820bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.068+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.068+0000 7f49820bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.068+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.069+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.069+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.069+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.069+0000 7f49820bb800 20 searching for the correct realm 2024-09-12T17:41:27.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.072+0000 7f497f3a4640 0 -- 172.21.15.63:0/1950138562 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f497401cbe0 msgr2=0x7f4974067ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.276+0000 7f49803a6640 0 -- 172.21.15.63:0/1950138562 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559ee51be100 msgr2=0x559ee51c0520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.280+0000 7f49820bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:27.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.280+0000 7f49820bb800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:27.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.280+0000 7f49820bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:27.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.280+0000 7f49820bb800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:27.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.280+0000 7f49820bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:27.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.280+0000 7f49820bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:27.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.280+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:27.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 zone default found 2024-09-12T17:41:27.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 4 Realm: () 2024-09-12T17:41:27.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:27.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:27.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:27.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 zonegroup default 2024-09-12T17:41:27.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.281+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.282+0000 7f49820bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.282+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.282+0000 7f49820bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.282+0000 7f49820bb800 20 started sync module instance, tier type = 2024-09-12T17:41:27.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.282+0000 7f49820bb800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:27.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.291+0000 7f49820bb800 20 add_watcher() i=0 2024-09-12T17:41:27.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.291+0000 7f49820bb800 20 add_watcher() i=1 2024-09-12T17:41:27.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.291+0000 7f49820bb800 20 add_watcher() i=2 2024-09-12T17:41:27.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.291+0000 7f49820bb800 20 add_watcher() i=3 2024-09-12T17:41:27.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.291+0000 7f49820bb800 20 add_watcher() i=4 2024-09-12T17:41:27.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.291+0000 7f49820bb800 20 add_watcher() i=5 2024-09-12T17:41:27.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.292+0000 7f49820bb800 20 add_watcher() i=6 2024-09-12T17:41:27.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.292+0000 7f49820bb800 20 add_watcher() i=7 2024-09-12T17:41:27.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.292+0000 7f49820bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.294+0000 7f4835fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.294+0000 7f49820bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.294+0000 7f49820bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.295+0000 7f49820bb800 5 note: GC not initialized 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.295+0000 7f4834fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.295+0000 7f49820bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.295+0000 7f49820bb800 20 Filter name: none 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.295+0000 7f47ae7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:27.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.295+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.296+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:27.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.296+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.296+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:27.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.296+0000 7f49820bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:27.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.296+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.296+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:27.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.296+0000 7f49820bb800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.297+0000 7f49820bb800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:27.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.297+0000 7f49820bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:27.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.298+0000 7f4835fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.300+0000 7f49820bb800 20 remove_watcher() i=0 2024-09-12T17:41:27.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.300+0000 7f49820bb800 2 removed watcher, disabling cache 2024-09-12T17:41:27.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.302+0000 7f49820bb800 20 remove_watcher() i=1 2024-09-12T17:41:27.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.303+0000 7f49820bb800 20 remove_watcher() i=2 2024-09-12T17:41:27.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.304+0000 7f49820bb800 20 remove_watcher() i=3 2024-09-12T17:41:27.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.306+0000 7f49820bb800 20 remove_watcher() i=4 2024-09-12T17:41:27.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.307+0000 7f49820bb800 20 remove_watcher() i=5 2024-09-12T17:41:27.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.307+0000 7f49820bb800 20 remove_watcher() i=6 2024-09-12T17:41:27.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.308+0000 7f49820bb800 20 remove_watcher() i=7 2024-09-12T17:41:27.321 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.321 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:27.321 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:27.322 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.322 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:41:27.357 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:27.357 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:27.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.395+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 20 realm 2024-09-12T17:41:27.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:27.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.397+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.397+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.397+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.397+0000 7f784232a800 20 searching for the correct realm 2024-09-12T17:41:27.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.401+0000 7f7837fff640 0 -- 172.21.15.63:0/3633968154 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f78280ac140 msgr2=0x7f78280c69a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.605+0000 7f783e8db640 0 -- 172.21.15.63:0/3633968154 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55685b7aa460 msgr2=0x55685b7ac920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:27.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:27.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:27.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:27.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:27.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:27.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.609+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 20 zone default found 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 4 Realm: () 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 20 zonegroup default 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.610+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.611+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.611+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.611+0000 7f784232a800 20 started sync module instance, tier type = 2024-09-12T17:41:27.613 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.611+0000 7f784232a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=0 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=1 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=2 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=3 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=4 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=5 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=6 2024-09-12T17:41:27.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.621+0000 7f784232a800 20 add_watcher() i=7 2024-09-12T17:41:27.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.621+0000 7f784232a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:27.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.622+0000 7f76f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f784232a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:27.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f784232a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:27.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f784232a800 5 note: GC not initialized 2024-09-12T17:41:27.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f766f7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:27.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f784232a800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:27.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f784232a800 20 Filter name: none 2024-09-12T17:41:27.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f766d7fa640 20 reqs_thread_entry: start 2024-09-12T17:41:27.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f784232a800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:41:27.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.623+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 : miss 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:27.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.624+0000 7f784232a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 2024-09-12T17:41:27.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.629+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.629+0000 7f784232a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.629+0000 7f784232a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.629+0000 7f784232a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28, ofs0, ns] 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 93906699781616 notifier 6566 bl.length()=1023 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_sources= new_sources= 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential sources added=[] removed=[] 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_dests= new_dests= 2024-09-12T17:41:27.631 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f784232a800 time 2024-09-12T17:41:27.631585+0000 2024-09-12T17:41:27.632 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:27.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential dests added=[] removed=[] 2024-09-12T17:41:27.632 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.632 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7843b8c71a] 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f784232a800 thread_name:radosgw-admin 2024-09-12T17:41:27.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.631+0000 7f784232a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f784232a800 time 2024-09-12T17:41:27.631585+0000 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7843b8c71a] 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.634 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:41:27.635 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:41:27.635 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f784283e6f0] 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f784288b99c] 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7843b8c774] 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.655 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.632+0000 7f784232a800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f784232a800 thread_name:radosgw-admin 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.656 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f784283e6f0] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f784288b99c] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7843b8c774] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:41:27.657 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:41:27.377+0000 7f784232a800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:41:27.377+0000 7f784232a800 4 set_mon_vals no callback set 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:41:27.377+0000 7f772c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:41:27.377+0000 7f772c608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:41:27.377+0000 7f772c608640 10 monclient: dump: 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.658 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: shutdown 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:41:27.378+0000 7f784232a800 5 asok(0x55685b49d730) unregister_commands rotate-key 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:41:27.378+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.659 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.660 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding auth protocol: cephx 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding auth protocol: cephx 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding auth protocol: cephx 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.661 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:41:27.378+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: starting msgr at 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: starting objecter 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:41:27.378+0000 7f784232a800 5 asok(0x55685b49d730) register_command objecter_requests hook 0x55685b6f0bd0 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: setting wanted keys 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: calling monclient init 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding auth protocol: cephx 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding auth protocol: cephx 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding auth protocol: cephx 2024-09-12T17:41:27.662 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:41:27.379+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.663 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:41:27.379+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:41:27.379+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key hook 0x55685b6bfd48 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b577640 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b608db0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b6c6b00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.664 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.894477s 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b577640 auth_method 0 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b6c6b00 auth_method 0 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.665 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_done global_id 6927 payload 824 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:41:27.379+0000 7f783e0da640 1 monclient: found mon.noname-a 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:41:27.379+0000 7f7837fff640 10 monclient: get_auth_request con 0x55685b608db0 auth_method 0 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: dump: 2024-09-12T17:41:27.666 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.667 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: dump: 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.668 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:41:27.380+0000 7f784232a800 5 monclient: authenticate success, global_id 6927 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:41:27.380+0000 7f772c608640 4 set_mon_vals no callback set 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:41:27.380+0000 7f784232a800 1 librados: init done 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:41:27.382+0000 7f772ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:41:27.382+0000 7f772ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:41:27.382+0000 7f772ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:41:27.382+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f7724076470 auth_method 0 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:41:27.382+0000 7f783e8db640 10 monclient: get_auth_request con 0x55685b6e87e0 auth_method 0 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:41:27.383+0000 7f783e0da640 10 monclient: get_auth_request con 0x55685b70afa0 auth_method 0 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:41:27.384+0000 7f7837fff640 10 monclient: get_auth_request con 0x55685b70e850 auth_method 0 2024-09-12T17:41:27.669 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:41:27.385+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:41:27.385+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:41:27.385+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.670 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding auth protocol: cephx 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding auth protocol: cephx 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding auth protocol: cephx 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.671 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:41:27.385+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:41:27.385+0000 7f784232a800 5 asok(0x55685b49d730) register_command objecter_requests cmddesc objecter_requests hook 0x55685b7177a0 EEXIST 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:41:27.385+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding auth protocol: cephx 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding auth protocol: cephx 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding auth protocol: cephx 2024-09-12T17:41:27.672 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.673 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:41:27.386+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:41:27.386+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:41:27.386+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key cmddesc rotate-key hook 0x55685b7133f0 EEXIST 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b73bac0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b73bea0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b73a7d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.674 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.901328s 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): get_auth_request con 0x55685b73bea0 auth_method 0 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b73bac0 auth_method 0 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b73a7d0 auth_method 0 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.675 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:41:27.386+0000 7f7837fff640 1 monclient: found mon.noname-c 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.676 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: dump: 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.677 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:41:27.387+0000 7f784232a800 5 monclient: authenticate success, global_id 6560 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: dump: 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.678 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:41:27.387+0000 7f783f0dc640 4 set_mon_vals no callback set 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:41:27.389+0000 7f7723fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:41:27.389+0000 7f7723fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:41:27.389+0000 7f7723fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:41:27.389+0000 7f783e0da640 10 monclient: get_auth_request con 0x7f7718076380 auth_method 0 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: get_monmap_and_config 2024-09-12T17:41:27.679 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:41:27.389+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.680 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding auth protocol: cephx 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding auth protocol: cephx 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding auth protocol: cephx 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.681 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:41:27.389+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding auth protocol: cephx 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding auth protocol: cephx 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding auth protocol: cephx 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.682 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:41:27.390+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:41:27.390+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:41:27.390+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key cmddesc rotate-key hook 0x7ffea31ebc18 EEXIST 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b78fd50 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b760c20 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.683 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b78b700 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.905492s 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): get_auth_request con 0x55685b760c20 auth_method 0 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b78b700 auth_method 0 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.684 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b78fd50 auth_method 0 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.685 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:41:27.390+0000 7f7837fff640 1 monclient: found mon.noname-a 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: dump: 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.686 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:41:27.391+0000 7f784232a800 5 monclient: authenticate success, global_id 6933 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:41:27.391+0000 7f784232a800 4 set_mon_vals no callback set 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:27.687 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: dump: 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: shutdown 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:41:27.391+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.688 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding auth protocol: cephx 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding auth protocol: cephx 2024-09-12T17:41:27.689 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding auth protocol: cephx 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:41:27.391+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.690 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:41:27.391+0000 7f784232a800 1 librados: starting msgr at 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:41:27.392+0000 7f784232a800 1 librados: starting objecter 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:41:27.392+0000 7f784232a800 5 asok(0x55685b49d730) register_command objecter_requests cmddesc objecter_requests hook 0x55685b73dbc0 EEXIST 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:41:27.392+0000 7f784232a800 1 librados: setting wanted keys 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:41:27.392+0000 7f784232a800 1 librados: calling monclient init 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding auth protocol: cephx 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding auth protocol: cephx 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding auth protocol: cephx 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.691 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:41:27.392+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:41:27.392+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:41:27.392+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key cmddesc rotate-key hook 0x55685b7504c8 EEXIST 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.692 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b760c20 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b78b700 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b78fd50 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.907700s 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b760c20 auth_method 0 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.693 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): get_auth_request con 0x55685b78b700 auth_method 0 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b78fd50 auth_method 0 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.694 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:41:27.393+0000 7f783e0da640 10 monclient(hunting): handle_auth_done global_id 6566 payload 824 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:41:27.393+0000 7f783e0da640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:41:27.393+0000 7f783e0da640 1 monclient: found mon.noname-c 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:41:27.393+0000 7f783e0da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: dump: 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.695 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:41:27.393+0000 7f784232a800 5 monclient: authenticate success, global_id 6566 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.696 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: dump: 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:41:27.393+0000 7f7721ffb640 4 set_mon_vals no callback set 2024-09-12T17:41:27.697 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:41:27.393+0000 7f784232a800 1 librados: init done 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:41:27.393+0000 7f784232a800 5 asok(0x55685b49d730) register_command cr dump hook 0x55685b787f78 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:41:27.395+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:41:27.395+0000 7f770ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:41:27.395+0000 7f770ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:41:27.395+0000 7f770ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:41:27.395+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f77080764a0 auth_method 0 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:41:27.395+0000 7f783e8db640 10 monclient: get_auth_request con 0x55685b7aa460 auth_method 0 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:41:27.396+0000 7f784232a800 20 realm 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.698 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:41:27.396+0000 7f784232a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:41:27.396+0000 7f783e0da640 10 monclient: get_auth_request con 0x55685b7ae6f0 auth_method 0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:41:27.397+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:41:27.397+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:41:27.397+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:41:27.397+0000 7f784232a800 20 searching for the correct realm 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:41:27.398+0000 7f7837fff640 10 monclient: get_auth_request con 0x55685b7b39b0 auth_method 0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:41:27.398+0000 7f783e8db640 10 monclient: get_auth_request con 0x7f7828063070 auth_method 0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:41:27.399+0000 7f783e0da640 10 monclient: get_auth_request con 0x7f783006e8d0 auth_method 0 2024-09-12T17:41:27.699 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:41:27.400+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f78280ac140 auth_method 0 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:41:27.401+0000 7f7837fff640 0 -- 172.21.15.63:0/3633968154 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f78280ac140 msgr2=0x7f78280c69a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:41:27.602+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f78280ac140 auth_method 0 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:41:27.603+0000 7f783e8db640 10 monclient: get_auth_request con 0x7f78300750b0 auth_method 0 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:41:27.604+0000 7f783e0da640 10 monclient: get_auth_request con 0x7f7838035040 auth_method 0 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:41:27.605+0000 7f783e8db640 0 -- 172.21.15.63:0/3633968154 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55685b7aa460 msgr2=0x55685b7ac920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:41:27.605+0000 7f770ffff640 1 client.6566.objecter ms_handle_reset 0x55685b7aa460 session 0x55685b75de40 osd.6 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:41:27.605+0000 7f770ffff640 10 monclient: _renew_subs 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:41:27.605+0000 7f770ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:41:27.605+0000 7f783e8db640 10 monclient: get_auth_request con 0x7f7708086740 auth_method 0 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:27.700 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:41:27.609+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:41:27.609+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:41:27.609+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:41:27.610+0000 7f784232a800 20 zone default found 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:41:27.610+0000 7f784232a800 4 Realm: () 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:41:27.610+0000 7f784232a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:41:27.610+0000 7f784232a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:27.701 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:41:27.610+0000 7f784232a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:41:27.610+0000 7f784232a800 20 zonegroup default 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:41:27.611+0000 7f784232a800 20 started sync module instance, tier type = 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:41:27.611+0000 7f784232a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=0 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=1 2024-09-12T17:41:27.702 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=2 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=3 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=4 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=5 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=6 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:41:27.621+0000 7f784232a800 20 add_watcher() i=7 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:41:27.621+0000 7f784232a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding auth protocol: cephx 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding auth protocol: cephx 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding auth protocol: cephx 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.703 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:41:27.622+0000 7f76f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:41:27.623+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:41:27.623+0000 7f784232a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:41:27.623+0000 7f784232a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:27.704 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache list hook 0x55685b787290 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache inspect hook 0x55685b787290 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache erase hook 0x55685b787290 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache zap hook 0x55685b787290 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:41:27.623+0000 7f784232a800 5 note: GC not initialized 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:41:27.623+0000 7f766f7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace show hook 0x7f7830010050 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace history hook 0x7f7830010050 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace active hook 0x7f7830010050 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace active_short hook 0x7f7830010050 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:41:27.623+0000 7f784232a800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:41:27.623+0000 7f784232a800 20 Filter name: none 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:41:27.623+0000 7f766d7fa640 20 reqs_thread_entry: start 2024-09-12T17:41:27.705 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:41:27.623+0000 7f784232a800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:41:27.623+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:41:27.624+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:41:27.624+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:41:27.624+0000 7f784232a800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:41:27.624+0000 7f784232a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 : miss 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:41:27.624+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:41:27.624+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:41:27.624+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:41:27.624+0000 7f784232a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:41:27.624+0000 7f784232a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:41:27.624+0000 7f784232a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:41:27.624+0000 7f784232a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 2024-09-12T17:41:27.706 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:41:27.629+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:41:27.629+0000 7f784232a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:41:27.629+0000 7f784232a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:41:27.629+0000 7f784232a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28, ofs0, ns] 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 93906699781616 notifier 6566 bl.length()=1023 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_sources= new_sources= 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential sources added=[] removed=[] 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_dests= new_dests= 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential dests added=[] removed=[] 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:41:27.631+0000 7f784232a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f784232a800 time 2024-09-12T17:41:27.631585+0000 2024-09-12T17:41:27.707 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7843b8c71a] 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.708 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:41:27.632+0000 7f784232a800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f784232a800 thread_name:radosgw-admin 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f784283e6f0] 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f784288b99c] 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7843b8c774] 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.709 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:41:27.710 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:41:27.711 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:41:27.712 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:41:27.713 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:41:27.714 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:41:27.715 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:41:27.716 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:41:27.716 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:41:27.716 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:41:27.716 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:41:27.716 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:41:27.716 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:41:27.716 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:41:27.717 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f766d7fa640 / http_manager 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f766f7fe640 / http_manager 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f76f4fe1640 / rgw_dt_lg_renew 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f770ffff640 / ms_dispatch 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f77217fa640 / io_context_pool 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7721ffb640 / io_context_pool 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7723fff640 / ms_dispatch 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f772ae05640 / ms_dispatch 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f772c608640 / io_context_pool 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7837fff640 / msgr-worker-2 2024-09-12T17:41:27.719 INFO:tasks.workunit.client.0.smithi063.stderr: 7f783e0da640 / msgr-worker-1 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: 7f783e8db640 / msgr-worker-0 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: 7f783f0dc640 / io_context_pool 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: 7f784232a800 / radosgw-admin 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.108747.log 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:41:27.377+0000 7f784232a800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:41:27.377+0000 7f784232a800 4 set_mon_vals no callback set 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:41:27.377+0000 7f772c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:41:27.377+0000 7f772c608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:27.720 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:41:27.377+0000 7f772c608640 10 monclient: dump: 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: shutdown 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:41:27.378+0000 7f784232a800 5 asok(0x55685b49d730) unregister_commands rotate-key 2024-09-12T17:41:27.721 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:41:27.378+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding auth protocol: cephx 2024-09-12T17:41:27.722 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding auth protocol: cephx 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding auth protocol: cephx 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: crc 2024-09-12T17:41:27.723 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6c6150) adding con mode: secure 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:41:27.378+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: starting msgr at 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: starting objecter 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:41:27.378+0000 7f784232a800 5 asok(0x55685b49d730) register_command objecter_requests hook 0x55685b6f0bd0 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: setting wanted keys 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:41:27.378+0000 7f784232a800 1 librados: calling monclient init 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:41:27.378+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding auth protocol: cephx 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding auth protocol: cephx 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding auth protocol: cephx 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.724 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: crc 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:41:27.378+0000 7f784232a800 5 AuthRegistry(0x55685b6bfc00) adding con mode: secure 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:41:27.379+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:41:27.379+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:41:27.379+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key hook 0x55685b6bfd48 2024-09-12T17:41:27.725 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b577640 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b608db0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b6c6b00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.726 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:41:27.379+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.894477s 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b577640 auth_method 0 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b6c6b00 auth_method 0 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.727 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:41:27.379+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient(hunting): handle_auth_done global_id 6927 payload 824 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:41:27.379+0000 7f783e0da640 1 monclient: found mon.noname-a 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:41:27.379+0000 7f783e0da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:41:27.379+0000 7f7837fff640 10 monclient: get_auth_request con 0x55685b608db0 auth_method 0 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: dump: 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.728 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:27.729 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:41:27.380+0000 7f772ae05640 10 monclient: dump: 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:41:27.380+0000 7f784232a800 5 monclient: authenticate success, global_id 6927 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.730 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:41:27.380+0000 7f772c608640 4 set_mon_vals no callback set 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:41:27.380+0000 7f784232a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:41:27.380+0000 7f784232a800 1 librados: init done 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:41:27.382+0000 7f772ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:41:27.382+0000 7f772ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:41:27.382+0000 7f772ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:41:27.382+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f7724076470 auth_method 0 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:41:27.382+0000 7f783e8db640 10 monclient: get_auth_request con 0x55685b6e87e0 auth_method 0 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:41:27.383+0000 7f783e0da640 10 monclient: get_auth_request con 0x55685b70afa0 auth_method 0 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:41:27.384+0000 7f7837fff640 10 monclient: get_auth_request con 0x55685b70e850 auth_method 0 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:41:27.385+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.731 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:41:27.385+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.732 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:41:27.385+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding auth protocol: cephx 2024-09-12T17:41:27.733 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding auth protocol: cephx 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding auth protocol: cephx 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: crc 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7142f0) adding con mode: secure 2024-09-12T17:41:27.734 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:41:27.385+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:41:27.385+0000 7f784232a800 5 asok(0x55685b49d730) register_command objecter_requests cmddesc objecter_requests hook 0x55685b7177a0 EEXIST 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:41:27.385+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding auth protocol: cephx 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding auth protocol: cephx 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding auth protocol: cephx 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.735 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: crc 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:41:27.385+0000 7f784232a800 5 AuthRegistry(0x55685b7132a8) adding con mode: secure 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:41:27.386+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:41:27.386+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:41:27.386+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key cmddesc rotate-key hook 0x55685b7133f0 EEXIST 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b73bac0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b73bea0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b73a7d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.736 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:41:27.386+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.901328s 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): get_auth_request con 0x55685b73bea0 auth_method 0 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b73bac0 auth_method 0 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.737 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b73a7d0 auth_method 0 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:41:27.386+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:41:27.386+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-09-12T17:41:27.738 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:41:27.386+0000 7f7837fff640 1 monclient: found mon.noname-c 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:41:27.386+0000 7f7837fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: dump: 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.739 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:41:27.387+0000 7f784232a800 5 monclient: authenticate success, global_id 6560 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:41:27.387+0000 7f7723fff640 10 monclient: dump: 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.740 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:41:27.387+0000 7f783f0dc640 4 set_mon_vals no callback set 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:41:27.387+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:41:27.389+0000 7f7723fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:41:27.389+0000 7f7723fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.741 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:41:27.389+0000 7f7723fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:41:27.389+0000 7f783e0da640 10 monclient: get_auth_request con 0x7f7718076380 auth_method 0 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: get_monmap_and_config 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:41:27.389+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding auth protocol: cephx 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding auth protocol: cephx 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding auth protocol: cephx 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.743 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: crc 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x55685b75b740) adding con mode: secure 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:41:27.389+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:41:27.389+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding auth protocol: cephx 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding auth protocol: cephx 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding auth protocol: cephx 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.744 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: crc 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:41:27.389+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebad0) adding con mode: secure 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:41:27.390+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:41:27.390+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:41:27.390+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key cmddesc rotate-key hook 0x7ffea31ebc18 EEXIST 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b78fd50 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.745 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b760c20 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b78b700 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:41:27.390+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.905492s 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): get_auth_request con 0x55685b760c20 auth_method 0 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b78b700 auth_method 0 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.746 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b78fd50 auth_method 0 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:41:27.390+0000 7f783e8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.747 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:41:27.390+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:41:27.390+0000 7f7837fff640 1 monclient: found mon.noname-a 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:41:27.390+0000 7f7837fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: dump: 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.748 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:41:27.391+0000 7f784232a800 5 monclient: authenticate success, global_id 6933 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:41:27.391+0000 7f784232a800 4 set_mon_vals no callback set 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:27.749 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:41:27.391+0000 7f7721ffb640 10 monclient: dump: 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: shutdown 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: build_initial_monmap 2024-09-12T17:41:27.750 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:41:27.391+0000 7f784232a800 1 build_initial for_mkfs: 0 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:41:27.391+0000 7f784232a800 10 monclient: monmap: 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:41:27.751 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding auth protocol: cephx 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding auth protocol: cephx 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding auth protocol: cephx 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.752 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: crc 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:41:27.391+0000 7f784232a800 5 AuthRegistry(0x55685b781fd0) adding con mode: secure 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:41:27.391+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:41:27.391+0000 7f784232a800 1 librados: starting msgr at 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:41:27.392+0000 7f784232a800 1 librados: starting objecter 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:41:27.392+0000 7f784232a800 5 asok(0x55685b49d730) register_command objecter_requests cmddesc objecter_requests hook 0x55685b73dbc0 EEXIST 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:41:27.392+0000 7f784232a800 1 librados: setting wanted keys 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:41:27.392+0000 7f784232a800 1 librados: calling monclient init 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient: init 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding auth protocol: cephx 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding auth protocol: cephx 2024-09-12T17:41:27.753 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding auth protocol: cephx 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: crc 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:41:27.392+0000 7f784232a800 5 AuthRegistry(0x55685b750380) adding con mode: secure 2024-09-12T17:41:27.754 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:41:27.392+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:41:27.392+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:41:27.392+0000 7f784232a800 5 asok(0x55685b49d730) register_command rotate-key cmddesc rotate-key hook 0x55685b7504c8 EEXIST 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): picked mon.noname-c con 0x55685b760c20 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): picked mon.noname-a con 0x55685b78b700 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): picked mon.noname-b con 0x55685b78fd50 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:41:27.392+0000 7f784232a800 10 monclient(hunting): authenticate will time out at 1979.907700s 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): get_auth_request con 0x55685b760c20 auth_method 0 2024-09-12T17:41:27.755 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): get_auth_request con 0x55685b78b700 auth_method 0 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:41:27.392+0000 7f783e0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:41:27.392+0000 7f7837fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:27.756 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): get_auth_request con 0x55685b78fd50 auth_method 0 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:41:27.393+0000 7f783e8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:41:27.393+0000 7f783e0da640 10 monclient(hunting): handle_auth_done global_id 6566 payload 824 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:41:27.393+0000 7f783e0da640 10 monclient: _finish_hunting 0 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:41:27.393+0000 7f783e0da640 1 monclient: found mon.noname-c 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:41:27.393+0000 7f783e0da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: dump: 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.757 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: _finish_auth 0 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:41:27.393+0000 7f784232a800 5 monclient: authenticate success, global_id 6566 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:27.758 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:41:27.393+0000 7f770ffff640 10 monclient: dump: 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:41:27.393+0000 7f7721ffb640 4 set_mon_vals no callback set 2024-09-12T17:41:27.759 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _renew_subs 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:41:27.393+0000 7f784232a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:41:27.393+0000 7f784232a800 1 librados: init done 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:41:27.393+0000 7f784232a800 5 asok(0x55685b49d730) register_command cr dump hook 0x55685b787f78 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:41:27.395+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:41:27.395+0000 7f770ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:41:27.395+0000 7f770ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:41:27.395+0000 7f770ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:41:27.395+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f77080764a0 auth_method 0 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:41:27.395+0000 7f783e8db640 10 monclient: get_auth_request con 0x55685b7aa460 auth_method 0 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:41:27.396+0000 7f784232a800 20 realm 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.760 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:41:27.396+0000 7f784232a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:41:27.396+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:41:27.396+0000 7f783e0da640 10 monclient: get_auth_request con 0x55685b7ae6f0 auth_method 0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:41:27.397+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:41:27.397+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:41:27.397+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:41:27.397+0000 7f784232a800 20 searching for the correct realm 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:41:27.398+0000 7f7837fff640 10 monclient: get_auth_request con 0x55685b7b39b0 auth_method 0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:41:27.398+0000 7f783e8db640 10 monclient: get_auth_request con 0x7f7828063070 auth_method 0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:41:27.399+0000 7f783e0da640 10 monclient: get_auth_request con 0x7f783006e8d0 auth_method 0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:41:27.400+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f78280ac140 auth_method 0 2024-09-12T17:41:27.761 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:41:27.401+0000 7f7837fff640 0 -- 172.21.15.63:0/3633968154 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f78280ac140 msgr2=0x7f78280c69a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:41:27.602+0000 7f7837fff640 10 monclient: get_auth_request con 0x7f78280ac140 auth_method 0 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:41:27.603+0000 7f783e8db640 10 monclient: get_auth_request con 0x7f78300750b0 auth_method 0 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:41:27.604+0000 7f783e0da640 10 monclient: get_auth_request con 0x7f7838035040 auth_method 0 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:41:27.605+0000 7f783e8db640 0 -- 172.21.15.63:0/3633968154 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55685b7aa460 msgr2=0x55685b7ac920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:41:27.605+0000 7f770ffff640 1 client.6566.objecter ms_handle_reset 0x55685b7aa460 session 0x55685b75de40 osd.6 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:41:27.605+0000 7f770ffff640 10 monclient: _renew_subs 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:41:27.605+0000 7f770ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:41:27.605+0000 7f783e8db640 10 monclient: get_auth_request con 0x7f7708086740 auth_method 0 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:27.762 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:41:27.609+0000 7f784232a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:41:27.609+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:41:27.609+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:41:27.609+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:41:27.610+0000 7f784232a800 20 zone default found 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:41:27.610+0000 7f784232a800 4 Realm: () 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:41:27.610+0000 7f784232a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:41:27.610+0000 7f784232a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:41:27.610+0000 7f784232a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:27.763 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:41:27.610+0000 7f784232a800 20 zonegroup default 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:41:27.610+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:41:27.611+0000 7f784232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:41:27.611+0000 7f784232a800 20 started sync module instance, tier type = 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:41:27.611+0000 7f784232a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=0 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=1 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=2 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=3 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=4 2024-09-12T17:41:27.764 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=5 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:41:27.620+0000 7f784232a800 20 add_watcher() i=6 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:41:27.621+0000 7f784232a800 20 add_watcher() i=7 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:41:27.621+0000 7f784232a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding auth protocol: cephx 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding auth protocol: cephx 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding auth protocol: cephx 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.765 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:41:27.622+0000 7f76f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: crc 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:41:27.622+0000 7f784232a800 5 AuthRegistry(0x7ffea31ebfa0) adding con mode: secure 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:41:27.623+0000 7f784232a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:41:27.623+0000 7f784232a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:41:27.623+0000 7f784232a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache list hook 0x55685b787290 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache inspect hook 0x55685b787290 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache erase hook 0x55685b787290 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command cache zap hook 0x55685b787290 2024-09-12T17:41:27.766 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:41:27.623+0000 7f784232a800 5 note: GC not initialized 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:41:27.623+0000 7f766f7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace show hook 0x7f7830010050 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace history hook 0x7f7830010050 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace active hook 0x7f7830010050 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:41:27.623+0000 7f784232a800 5 asok(0x55685b49d730) register_command sync trace active_short hook 0x7f7830010050 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:41:27.623+0000 7f784232a800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:41:27.623+0000 7f784232a800 20 Filter name: none 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:41:27.623+0000 7f766d7fa640 20 reqs_thread_entry: start 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:41:27.623+0000 7f784232a800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:41:27.623+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:41:27.624+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:41:27.624+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:41:27.624+0000 7f784232a800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:27.767 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:41:27.624+0000 7f784232a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 : miss 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:41:27.624+0000 7f784232a800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:41:27.624+0000 7f784232a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:41:27.624+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:41:27.624+0000 7f784232a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:41:27.624+0000 7f784232a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:41:27.624+0000 7f784232a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:41:27.624+0000 7f784232a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:41:27.629+0000 7f784232a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:41:27.629+0000 7f784232a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:41:27.629+0000 7f784232a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:41:27.629+0000 7f784232a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28, ofs0, ns] 2024-09-12T17:41:27.768 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 93906699781616 notifier 6566 bl.length()=1023 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:41:27.630+0000 7f77217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_sources= new_sources= 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential sources added=[] removed=[] 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_dests= new_dests= 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:41:27.630+0000 7f784232a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential dests added=[] removed=[] 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:41:27.631+0000 7f784232a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f784232a800 time 2024-09-12T17:41:27.631585+0000 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7843b8c71a] 2024-09-12T17:41:27.769 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:41:27.632+0000 7f784232a800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f784232a800 thread_name:radosgw-admin 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f784283e6f0] 2024-09-12T17:41:27.770 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f784288b99c] 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7843b8c774] 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7843b8c8d8] 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55685a5f2841] 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7489e) [0x55685ab0089e] 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55685a60250d] 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7842829590] 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:41:27.771 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:41:27.772 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:41:27.773 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:41:27.774 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:41:27.775 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:41:27.776 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:41:27.777 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 7f766d7fa640 / http_manager 2024-09-12T17:41:27.778 INFO:tasks.workunit.client.0.smithi063.stderr: 7f766f7fe640 / http_manager 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f76f4fe1640 / rgw_dt_lg_renew 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f770ffff640 / ms_dispatch 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f77217fa640 / io_context_pool 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7721ffb640 / io_context_pool 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7723fff640 / ms_dispatch 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f772ae05640 / ms_dispatch 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f772c608640 / io_context_pool 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f7837fff640 / msgr-worker-2 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f783e0da640 / msgr-worker-1 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f783e8db640 / msgr-worker-0 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f783f0dc640 / io_context_pool 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7f784232a800 / radosgw-admin 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:41:27.779 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:41:27.633256Z_ef45016d-e5aa-427b-807c-d81b8e228a0d/log 2024-09-12T17:41:27.780 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:41:27.780 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:41:27.781 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:27.781 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.710+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 20 realm 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.712+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.713+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.713+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.713+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.713+0000 7f6a0ba20800 20 searching for the correct realm 2024-09-12T17:41:27.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.716+0000 7f6a08d09640 0 -- 172.21.15.63:0/389813664 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f6a00020930 msgr2=0x7f6a0000d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:27.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.921+0000 7f6a08d09640 0 -- 172.21.15.63:0/389813664 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55fbab01eaf0 msgr2=0x55fbab020f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.925+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 zone default found 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 4 Realm: () 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 zonegroup default 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.926+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.927+0000 7f6a0ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.927+0000 7f6a0ba20800 20 started sync module instance, tier type = 2024-09-12T17:41:27.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.927+0000 7f6a0ba20800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:27.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.935+0000 7f6a0ba20800 20 add_watcher() i=0 2024-09-12T17:41:27.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.935+0000 7f6a0ba20800 20 add_watcher() i=1 2024-09-12T17:41:27.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.935+0000 7f6a0ba20800 20 add_watcher() i=2 2024-09-12T17:41:27.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.935+0000 7f6a0ba20800 20 add_watcher() i=3 2024-09-12T17:41:27.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.935+0000 7f6a0ba20800 20 add_watcher() i=4 2024-09-12T17:41:27.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.935+0000 7f6a0ba20800 20 add_watcher() i=5 2024-09-12T17:41:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.935+0000 7f6a0ba20800 20 add_watcher() i=6 2024-09-12T17:41:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.936+0000 7f6a0ba20800 20 add_watcher() i=7 2024-09-12T17:41:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.936+0000 7f6a0ba20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:27.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.937+0000 7f68bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f6a0ba20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f6a0ba20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f6a0ba20800 5 note: GC not initialized 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f68befe5640 20 reqs_thread_entry: start 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f6a0ba20800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f6a0ba20800 20 Filter name: none 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f68bcfe1640 20 reqs_thread_entry: start 2024-09-12T17:41:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.938+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.939+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:27.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.939+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.939+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:41:27.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.939+0000 7f6a0ba20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:27.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.939+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.940+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:27.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.940+0000 7f6a0ba20800 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.940+0000 7f6a0ba20800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:41:27.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.940+0000 7f6a0ba20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:27.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.942+0000 7f68bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.944+0000 7f6a0ba20800 20 remove_watcher() i=0 2024-09-12T17:41:27.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.944+0000 7f6a0ba20800 2 removed watcher, disabling cache 2024-09-12T17:41:27.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.945+0000 7f6a0ba20800 20 remove_watcher() i=1 2024-09-12T17:41:27.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.946+0000 7f6a0ba20800 20 remove_watcher() i=2 2024-09-12T17:41:27.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.947+0000 7f6a0ba20800 20 remove_watcher() i=3 2024-09-12T17:41:27.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.948+0000 7f6a0ba20800 20 remove_watcher() i=4 2024-09-12T17:41:27.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.949+0000 7f6a0ba20800 20 remove_watcher() i=5 2024-09-12T17:41:27.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.950+0000 7f6a0ba20800 20 remove_watcher() i=6 2024-09-12T17:41:27.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:27.951+0000 7f6a0ba20800 20 remove_watcher() i=7 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:28.016 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:41:28.049 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:28.049 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:28.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.087+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.088+0000 7f0da3d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.088+0000 7f0da3d2e800 20 realm 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.088+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.088+0000 7f0da3d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.088+0000 7f0da3d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.088+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.089+0000 7f0da3d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.089+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.089+0000 7f0da3d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:28.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.089+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.090+0000 7f0da3d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:28.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.090+0000 7f0da3d2e800 20 searching for the correct realm 2024-09-12T17:41:28.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.093+0000 7f0d9f163640 0 -- 172.21.15.63:0/2133280843 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f0d940c6310 msgr2=0x7f0d940569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:28.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.297+0000 7f0da0165640 0 -- 172.21.15.63:0/2133280843 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559acbfbe390 msgr2=0x559acbfc0800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.301+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 zone default found 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 4 Realm: () 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:28.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 zonegroup default 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.302+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.303+0000 7f0da3d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.303+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.303+0000 7f0da3d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.303+0000 7f0da3d2e800 20 started sync module instance, tier type = 2024-09-12T17:41:28.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.303+0000 7f0da3d2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:28.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.312+0000 7f0da3d2e800 20 add_watcher() i=0 2024-09-12T17:41:28.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.312+0000 7f0da3d2e800 20 add_watcher() i=1 2024-09-12T17:41:28.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.312+0000 7f0da3d2e800 20 add_watcher() i=2 2024-09-12T17:41:28.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.312+0000 7f0da3d2e800 20 add_watcher() i=3 2024-09-12T17:41:28.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.312+0000 7f0da3d2e800 20 add_watcher() i=4 2024-09-12T17:41:28.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.312+0000 7f0da3d2e800 20 add_watcher() i=5 2024-09-12T17:41:28.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.312+0000 7f0da3d2e800 20 add_watcher() i=6 2024-09-12T17:41:28.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.313+0000 7f0da3d2e800 20 add_watcher() i=7 2024-09-12T17:41:28.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.313+0000 7f0da3d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:28.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.315+0000 7f0c55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.315+0000 7f0da3d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.315+0000 7f0da3d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.315+0000 7f0da3d2e800 5 note: GC not initialized 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.315+0000 7f0c54fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 20 Filter name: none 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0bce7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:41:28.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 : miss 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.316+0000 7f0da3d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.317+0000 7f0da3d2e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.317+0000 7f0da3d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.317+0000 7f0da3d2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.317+0000 7f0da3d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.317+0000 7f0da3d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:28.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.317+0000 7f0da3d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 2024-09-12T17:41:28.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.318+0000 7f0da3d2e800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to be held by another RGW process; skipping for now 2024-09-12T17:41:28.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.319+0000 7f0c55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:28.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.321+0000 7f0da3d2e800 20 remove_watcher() i=0 2024-09-12T17:41:28.322 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.321+0000 7f0da3d2e800 2 removed watcher, disabling cache 2024-09-12T17:41:28.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.322+0000 7f0da3d2e800 20 remove_watcher() i=1 2024-09-12T17:41:28.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.323+0000 7f0da3d2e800 20 remove_watcher() i=2 2024-09-12T17:41:28.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.324+0000 7f0da3d2e800 20 remove_watcher() i=3 2024-09-12T17:41:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.325+0000 7f0da3d2e800 20 remove_watcher() i=4 2024-09-12T17:41:28.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.326+0000 7f0da3d2e800 20 remove_watcher() i=5 2024-09-12T17:41:28.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.327+0000 7f0da3d2e800 20 remove_watcher() i=6 2024-09-12T17:41:28.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:28.328+0000 7f0da3d2e800 20 remove_watcher() i=7 2024-09-12T17:41:28.339 INFO:tasks.workunit.client.0.smithi063.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:41:58.368 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:41:58.405 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:58.405 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:58.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.449+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 20 realm 2024-09-12T17:41:58.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:58.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.451+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.452+0000 7f811433d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.452+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.452+0000 7f811433d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:58.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.452+0000 7f811433d800 20 searching for the correct realm 2024-09-12T17:41:58.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.456+0000 7f8107829640 0 -- 172.21.15.63:0/2715566754 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f80f8017070 msgr2=0x7f80f804b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:58.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.663+0000 7f811082b640 0 -- 172.21.15.63:0/2715566754 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55ce36c89670 msgr2=0x55ce36c8ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.668+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 zone default found 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 4 Realm: () 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 zonegroup default 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.669+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.670+0000 7f811433d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.670+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.670+0000 7f811433d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.670+0000 7f811433d800 20 started sync module instance, tier type = 2024-09-12T17:41:58.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.670+0000 7f811433d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:58.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.680+0000 7f811433d800 20 add_watcher() i=0 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.680+0000 7f811433d800 20 add_watcher() i=1 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.680+0000 7f811433d800 20 add_watcher() i=2 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.680+0000 7f811433d800 20 add_watcher() i=3 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.680+0000 7f811433d800 20 add_watcher() i=4 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.680+0000 7f811433d800 20 add_watcher() i=5 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.680+0000 7f811433d800 20 add_watcher() i=6 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.682+0000 7f811433d800 20 add_watcher() i=7 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.682+0000 7f811433d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:58.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.683+0000 7f7fc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.684+0000 7f811433d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:58.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.684+0000 7f811433d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:58.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.684+0000 7f811433d800 5 note: GC not initialized 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.684+0000 7f7fc57e2640 20 reqs_thread_entry: start 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.684+0000 7f811433d800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.684+0000 7f811433d800 20 Filter name: none 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f7f36ffd640 20 reqs_thread_entry: start 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f811433d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f811433d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f811433d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f811433d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f811433d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 : miss 2024-09-12T17:41:58.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.685+0000 7f811433d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.686+0000 7f811433d800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:41:58.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.686+0000 7f811433d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:58.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.686+0000 7f811433d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:58.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.686+0000 7f811433d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:58.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.686+0000 7f811433d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.686+0000 7f811433d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 2024-09-12T17:41:58.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.687+0000 7f811433d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:41:58.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.695+0000 7f811433d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:58.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.695+0000 7f811433d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:58.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.695+0000 7f811433d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.695+0000 7f811433d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28, ofs0, ns] 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f7fef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94344170802352 notifier 6620 bl.length()=1023 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f7fef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f7fef7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f7fef7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_sources= new_sources= 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential sources added=[] removed=[] 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_dests= new_dests= 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.696+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential dests added=[] removed=[] 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.0 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.0 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.1 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.1 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.2 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.2 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.3 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.3 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.4 2024-09-12T17:41:58.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.4 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.5 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.5 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.6 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.6 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.7 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.7 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.8 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.8 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.9 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.9 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.10 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.10 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.11 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2.11 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.701+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.0 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.702+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.1 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.703+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.703+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.3 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.704+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.4 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.704+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.5 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.705+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.6 2024-09-12T17:41:58.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.705+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.7 2024-09-12T17:41:58.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.706+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.8 2024-09-12T17:41:58.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.707+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.9 2024-09-12T17:41:58.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.707+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.10 2024-09-12T17:41:58.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.711+0000 7f811433d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:58.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.711+0000 7f811433d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 2024-09-12T17:41:58.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f811433d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:58.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f811433d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:58.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f811433d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f811433d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28, ofs0, ns] 2024-09-12T17:41:58.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f7fef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94344170802352 notifier 6620 bl.length()=1023 2024-09-12T17:41:58.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f7fef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:58.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f7fef7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:58.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.712+0000 7f7fef7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.713+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_sources= new_sources= 2024-09-12T17:41:58.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.713+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential sources added=[] removed=[] 2024-09-12T17:41:58.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.713+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_dests= new_dests= 2024-09-12T17:41:58.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.713+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential dests added=[] removed=[] 2024-09-12T17:41:58.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.715+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.0 2024-09-12T17:41:58.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.715+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.1 2024-09-12T17:41:58.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.716+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.2 2024-09-12T17:41:58.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.716+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.3 2024-09-12T17:41:58.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.717+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.4 2024-09-12T17:41:58.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.717+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.5 2024-09-12T17:41:58.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.717+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.6 2024-09-12T17:41:58.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.718+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.7 2024-09-12T17:41:58.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.718+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.8 2024-09-12T17:41:58.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.719+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.9 2024-09-12T17:41:58.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.719+0000 7f811433d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28.10 2024-09-12T17:41:58.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.720+0000 7f811433d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:58.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.720+0000 7f811433d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 2024-09-12T17:41:58.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f811433d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:58.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f811433d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:58.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f811433d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f811433d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28, ofs0, ns] 2024-09-12T17:41:58.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f7feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94344170802352 notifier 6620 bl.length()=991 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f7feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 info.flags=0x17 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f7feeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 to cache LRU end 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.721+0000 7f7feeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.722+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_sources= new_sources= 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.722+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential sources added=[] removed=[] 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.722+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): orig_dests= new_dests= 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.722+0000 7f811433d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28]): potential dests added=[] removed=[] 2024-09-12T17:41:58.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.724+0000 7f811433d800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:58.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.726+0000 7f7fc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.728+0000 7f811433d800 20 remove_watcher() i=0 2024-09-12T17:41:58.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.728+0000 7f811433d800 2 removed watcher, disabling cache 2024-09-12T17:41:58.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.730+0000 7f811433d800 20 remove_watcher() i=1 2024-09-12T17:41:58.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.731+0000 7f811433d800 20 remove_watcher() i=2 2024-09-12T17:41:58.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.732+0000 7f811433d800 20 remove_watcher() i=3 2024-09-12T17:41:58.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.733+0000 7f811433d800 20 remove_watcher() i=4 2024-09-12T17:41:58.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.734+0000 7f811433d800 20 remove_watcher() i=5 2024-09-12T17:41:58.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.735+0000 7f811433d800 20 remove_watcher() i=6 2024-09-12T17:41:58.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.736+0000 7f811433d800 20 remove_watcher() i=7 2024-09-12T17:41:58.751 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:41:58.781 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:58.781 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:58.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.825+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 20 realm 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.827+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.828+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.828+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.828+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:58.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.828+0000 7fbb7b812800 20 searching for the correct realm 2024-09-12T17:41:58.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.832+0000 7fbb767df640 0 -- 172.21.15.63:0/4130166891 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fbb6c04e3e0 msgr2=0x7fbb6c04e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:58.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.836+0000 7fbb777e1640 0 -- 172.21.15.63:0/4130166891 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e6a6bdb170 msgr2=0x55e6a6bdd5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:58.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:58.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:58.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:58.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:58.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:58.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:58.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.840+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 zone default found 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 4 Realm: () 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 zonegroup default 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.841+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.842+0000 7fbb7b812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.842+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.842+0000 7fbb7b812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.842+0000 7fbb7b812800 20 started sync module instance, tier type = 2024-09-12T17:41:58.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.842+0000 7fbb7b812800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:58.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.850+0000 7fbb7b812800 20 add_watcher() i=0 2024-09-12T17:41:58.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.850+0000 7fbb7b812800 20 add_watcher() i=1 2024-09-12T17:41:58.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.850+0000 7fbb7b812800 20 add_watcher() i=2 2024-09-12T17:41:58.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.851+0000 7fbb7b812800 20 add_watcher() i=3 2024-09-12T17:41:58.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.851+0000 7fbb7b812800 20 add_watcher() i=4 2024-09-12T17:41:58.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.851+0000 7fbb7b812800 20 add_watcher() i=5 2024-09-12T17:41:58.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.851+0000 7fbb7b812800 20 add_watcher() i=6 2024-09-12T17:41:58.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.851+0000 7fbb7b812800 20 add_watcher() i=7 2024-09-12T17:41:58.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.851+0000 7fbb7b812800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:58.854 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.853+0000 7fba2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fbb7b812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fbb7b812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fbb7b812800 5 note: GC not initialized 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fb9a7fff640 20 reqs_thread_entry: start 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fbb7b812800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fbb7b812800 20 Filter name: none 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fb9a5ffb640 20 reqs_thread_entry: start 2024-09-12T17:41:58.855 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.854+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.855+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:58.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.855+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.855+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:58.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.855+0000 7fbb7b812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:58.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.855+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.855+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:41:58.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.855+0000 7fbb7b812800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.856+0000 7fbb7b812800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:41:58.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.856+0000 7fbb7b812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:58.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.858+0000 7fba2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.860+0000 7fbb7b812800 20 remove_watcher() i=0 2024-09-12T17:41:58.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.860+0000 7fbb7b812800 2 removed watcher, disabling cache 2024-09-12T17:41:58.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.861+0000 7fbb7b812800 20 remove_watcher() i=1 2024-09-12T17:41:58.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.862+0000 7fbb7b812800 20 remove_watcher() i=2 2024-09-12T17:41:58.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.863+0000 7fbb7b812800 20 remove_watcher() i=3 2024-09-12T17:41:58.864 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.864+0000 7fbb7b812800 20 remove_watcher() i=4 2024-09-12T17:41:58.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.865+0000 7fbb7b812800 20 remove_watcher() i=5 2024-09-12T17:41:58.866 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.865+0000 7fbb7b812800 20 remove_watcher() i=6 2024-09-12T17:41:58.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:58.866+0000 7fbb7b812800 20 remove_watcher() i=7 2024-09-12T17:41:58.879 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:58.879 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:58.879 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-trim-reshard-log-entries id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:41:58.879 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:58.953 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:41:58.953 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:59.171 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:41:59.200 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:59.200 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:59.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.238+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 20 realm 2024-09-12T17:41:59.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.240+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.241+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.241+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.241+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.243 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.241+0000 7fb2e5c2f800 20 searching for the correct realm 2024-09-12T17:41:59.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.244+0000 7fb2e2f18640 0 -- 172.21.15.63:0/3809505044 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb2d802d420 msgr2=0x7fb2d802d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.248+0000 7fb2e2f18640 0 -- 172.21.15.63:0/3809505044 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55cd1defa2d0 msgr2=0x55cd1defc770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.252+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 zone default found 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 4 Realm: () 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 zonegroup default 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.253+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.254+0000 7fb2e5c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.254+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.254+0000 7fb2e5c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.254+0000 7fb2e5c2f800 20 started sync module instance, tier type = 2024-09-12T17:41:59.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.254+0000 7fb2e5c2f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:59.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.262+0000 7fb2e5c2f800 20 add_watcher() i=0 2024-09-12T17:41:59.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.262+0000 7fb2e5c2f800 20 add_watcher() i=1 2024-09-12T17:41:59.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.262+0000 7fb2e5c2f800 20 add_watcher() i=2 2024-09-12T17:41:59.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.262+0000 7fb2e5c2f800 20 add_watcher() i=3 2024-09-12T17:41:59.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.262+0000 7fb2e5c2f800 20 add_watcher() i=4 2024-09-12T17:41:59.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.262+0000 7fb2e5c2f800 20 add_watcher() i=5 2024-09-12T17:41:59.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.262+0000 7fb2e5c2f800 20 add_watcher() i=6 2024-09-12T17:41:59.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.263+0000 7fb2e5c2f800 20 add_watcher() i=7 2024-09-12T17:41:59.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.263+0000 7fb2e5c2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.265+0000 7fb199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb2e5c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb2e5c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb2e5c2f800 5 note: GC not initialized 2024-09-12T17:41:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb198fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb2e5c2f800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb2e5c2f800 20 Filter name: none 2024-09-12T17:41:59.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb1127fc640 20 reqs_thread_entry: start 2024-09-12T17:41:59.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.266+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.267+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.267+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.267+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.267+0000 7fb2e5c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.267+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.268+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.268+0000 7fb2e5c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.268+0000 7fb2e5c2f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.268+0000 7fb2e5c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.270+0000 7fb199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.272+0000 7fb2e5c2f800 20 remove_watcher() i=0 2024-09-12T17:41:59.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.272+0000 7fb2e5c2f800 2 removed watcher, disabling cache 2024-09-12T17:41:59.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.273+0000 7fb2e5c2f800 20 remove_watcher() i=1 2024-09-12T17:41:59.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.274+0000 7fb2e5c2f800 20 remove_watcher() i=2 2024-09-12T17:41:59.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.275+0000 7fb2e5c2f800 20 remove_watcher() i=3 2024-09-12T17:41:59.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.276+0000 7fb2e5c2f800 20 remove_watcher() i=4 2024-09-12T17:41:59.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.277+0000 7fb2e5c2f800 20 remove_watcher() i=5 2024-09-12T17:41:59.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.278+0000 7fb2e5c2f800 20 remove_watcher() i=6 2024-09-12T17:41:59.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.279+0000 7fb2e5c2f800 20 remove_watcher() i=7 2024-09-12T17:41:59.291 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:59.291 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:59.291 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-block-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:59.291 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:59.292 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:41:59.327 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:59.327 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:59.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.365+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.366+0000 7f629e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.366+0000 7f629e925800 20 realm 2024-09-12T17:41:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.366+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.366+0000 7f629e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.366+0000 7f629e925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.366+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.367+0000 7f629e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.367+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.367+0000 7f629e925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.367+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.368+0000 7f629e925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.368+0000 7f629e925800 20 searching for the correct realm 2024-09-12T17:41:59.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.371+0000 7f6299d32640 0 -- 172.21.15.63:0/3274718052 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f62900765a0 msgr2=0x7f6290091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.577+0000 7f629ad34640 0 -- 172.21.15.63:0/3274718052 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e5f536b200 msgr2=0x55e5f536d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.581+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 zone default found 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 4 Realm: () 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 zonegroup default 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.582+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.583+0000 7f629e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.583+0000 7f629e925800 20 started sync module instance, tier type = 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.583+0000 7f629e925800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.592+0000 7f629e925800 20 add_watcher() i=0 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.592+0000 7f629e925800 20 add_watcher() i=1 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.592+0000 7f629e925800 20 add_watcher() i=2 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.592+0000 7f629e925800 20 add_watcher() i=3 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.592+0000 7f629e925800 20 add_watcher() i=4 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.592+0000 7f629e925800 20 add_watcher() i=5 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.592+0000 7f629e925800 20 add_watcher() i=6 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.593+0000 7f629e925800 20 add_watcher() i=7 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.593+0000 7f629e925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.595+0000 7f6150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.595+0000 7f629e925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.595+0000 7f629e925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.595+0000 7f629e925800 5 note: GC not initialized 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.595+0000 7f60cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.595+0000 7f629e925800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 20 Filter name: none 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f60c97fa640 20 reqs_thread_entry: start 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 : miss 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.596+0000 7f629e925800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.597+0000 7f629e925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.597+0000 7f629e925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.597+0000 7f629e925800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.597+0000 7f629e925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.597+0000 7f629e925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.597+0000 7f629e925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.601+0000 7f629e925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.601+0000 7f629e925800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.601+0000 7f629e925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.601+0000 7f629e925800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29, ofs0, ns] 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f617dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94446149928544 notifier 6668 bl.length()=999 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f617dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f617dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f617dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_sources= new_sources= 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential sources added=[] removed=[] 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_dests= new_dests= 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.602+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential dests added=[] removed=[] 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.0 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.0 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.1 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.1 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.2 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.2 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.3 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.3 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.4 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.4 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.5 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.5 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.6 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.6 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.7 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.7 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.8 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.8 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.9 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.9 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.10 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.10 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.11 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.11 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.606+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.0 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.607+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.607+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.2 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.608+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.3 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.608+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.4 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.609+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.5 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.609+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.6 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.610+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.7 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.610+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.8 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.611+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.9 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.611+0000 7f629e925800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.10 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.614+0000 7f629e925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.614+0000 7f629e925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f629e925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f629e925800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f629e925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f629e925800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29, ofs0, ns] 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f617dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94446149928544 notifier 6668 bl.length()=999 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f617dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f617dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.615+0000 7f617dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.616+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_sources= new_sources= 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.616+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential sources added=[] removed=[] 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.616+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_dests= new_dests= 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.616+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential dests added=[] removed=[] 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.616+0000 7f629e925800 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.616+0000 7f629e925800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.621+0000 7f629e925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.621+0000 7f629e925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.622+0000 7f629e925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.622+0000 7f629e925800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.622+0000 7f629e925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.622+0000 7f629e925800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29, ofs0, ns] 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f617d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94446149928544 notifier 6668 bl.length()=967 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f617d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f617d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f617d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_sources= new_sources= 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential sources added=[] removed=[] 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_dests= new_dests= 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.623+0000 7f629e925800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential dests added=[] removed=[] 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.625+0000 7f629e925800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.627+0000 7f6150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.629+0000 7f629e925800 20 remove_watcher() i=0 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.629+0000 7f629e925800 2 removed watcher, disabling cache 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.630+0000 7f629e925800 20 remove_watcher() i=1 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.631+0000 7f629e925800 20 remove_watcher() i=2 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.632+0000 7f629e925800 20 remove_watcher() i=3 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.633+0000 7f629e925800 20 remove_watcher() i=4 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.634+0000 7f629e925800 20 remove_watcher() i=5 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.635+0000 7f629e925800 20 remove_watcher() i=6 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.636+0000 7f629e925800 20 remove_watcher() i=7 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:59.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.717+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.718+0000 7f39f9415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.718+0000 7f39f9415800 20 realm 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.718+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.718+0000 7f39f9415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.718+0000 7f39f9415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.718+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.719+0000 7f39f9415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.719+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.719+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.719+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.720+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.720+0000 7f39f9415800 20 searching for the correct realm 2024-09-12T17:41:59.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.723+0000 7f39effff640 0 -- 172.21.15.63:0/1295981677 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f39e0088040 msgr2=0x7f39e0094930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.929+0000 7f39f5393640 0 -- 172.21.15.63:0/1295981677 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55adb50a04a0 msgr2=0x55adb50a28f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.933+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 zone default found 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 4 Realm: () 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 zonegroup default 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 started sync module instance, tier type = 2024-09-12T17:41:59.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.934+0000 7f39f9415800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.943+0000 7f39f9415800 20 add_watcher() i=0 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.943+0000 7f39f9415800 20 add_watcher() i=1 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.943+0000 7f39f9415800 20 add_watcher() i=2 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.943+0000 7f39f9415800 20 add_watcher() i=3 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.943+0000 7f39f9415800 20 add_watcher() i=4 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.943+0000 7f39f9415800 20 add_watcher() i=5 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.943+0000 7f39f9415800 20 add_watcher() i=6 2024-09-12T17:41:59.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.944+0000 7f39f9415800 20 add_watcher() i=7 2024-09-12T17:41:59.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.944+0000 7f39f9415800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f38ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f39f9415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f39f9415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f39f9415800 5 note: GC not initialized 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f38aa7e4640 20 reqs_thread_entry: start 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f39f9415800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f39f9415800 20 Filter name: none 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.946+0000 7f38a37fe640 20 reqs_thread_entry: start 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.947+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.947+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.947+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.948+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:41:59.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.948+0000 7f39f9415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.948+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.948+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:41:59.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.948+0000 7f39f9415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.948+0000 7f39f9415800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:41:59.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.948+0000 7f39f9415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.950+0000 7f38ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.952+0000 7f39f9415800 20 remove_watcher() i=0 2024-09-12T17:41:59.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.952+0000 7f39f9415800 2 removed watcher, disabling cache 2024-09-12T17:41:59.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.955+0000 7f39f9415800 20 remove_watcher() i=1 2024-09-12T17:41:59.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.956+0000 7f39f9415800 20 remove_watcher() i=2 2024-09-12T17:41:59.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.957+0000 7f39f9415800 20 remove_watcher() i=3 2024-09-12T17:41:59.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.958+0000 7f39f9415800 20 remove_watcher() i=4 2024-09-12T17:41:59.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.959+0000 7f39f9415800 20 remove_watcher() i=5 2024-09-12T17:41:59.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.960+0000 7f39f9415800 20 remove_watcher() i=6 2024-09-12T17:41:59.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:41:59.961+0000 7f39f9415800 20 remove_watcher() i=7 2024-09-12T17:41:59.973 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:41:59.973 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:41:59.973 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-block-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:59.973 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:00.025 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:42:00.058 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:00.058 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:00.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.295+0000 7fc352e86640 0 --2- 172.21.15.63:0/2012421793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5652f5538f60 0x5652f555f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:42:00.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.298+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 20 realm 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.300+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.301+0000 7fc357142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:00.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.301+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.301+0000 7fc357142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:00.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.301+0000 7fc357142800 20 searching for the correct realm 2024-09-12T17:42:00.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.303+0000 7fc352e86640 0 -- 172.21.15.63:0/2012421793 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x5652f557f4f0 msgr2=0x5652f5581920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:00.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.306+0000 7fc353687640 0 -- 172.21.15.63:0/2012421793 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x5652f557f4f0 msgr2=0x7fc3440b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:00.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.916+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 20 zone default found 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 4 Realm: () 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 20 zonegroup default 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.917+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.918+0000 7fc357142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.918+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.918+0000 7fc357142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.918+0000 7fc357142800 20 started sync module instance, tier type = 2024-09-12T17:42:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.918+0000 7fc357142800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.929+0000 7fc357142800 20 add_watcher() i=0 2024-09-12T17:42:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.929+0000 7fc357142800 20 add_watcher() i=1 2024-09-12T17:42:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.929+0000 7fc357142800 20 add_watcher() i=2 2024-09-12T17:42:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.929+0000 7fc357142800 20 add_watcher() i=3 2024-09-12T17:42:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.929+0000 7fc357142800 20 add_watcher() i=4 2024-09-12T17:42:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.929+0000 7fc357142800 20 add_watcher() i=5 2024-09-12T17:42:00.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.929+0000 7fc357142800 20 add_watcher() i=6 2024-09-12T17:42:00.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.930+0000 7fc357142800 20 add_watcher() i=7 2024-09-12T17:42:00.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.930+0000 7fc357142800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:00.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.932+0000 7fc209fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:00.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc357142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:00.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc357142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:00.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc357142800 5 note: GC not initialized 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc208fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc357142800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc357142800 20 Filter name: none 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc201ffb640 20 reqs_thread_entry: start 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc357142800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.933+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.934+0000 7fc357142800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.934+0000 7fc357142800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.934+0000 7fc357142800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.934+0000 7fc357142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 : miss 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.934+0000 7fc357142800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.935+0000 7fc357142800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:00.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.935+0000 7fc357142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:42:00.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.935+0000 7fc357142800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:42:00.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.935+0000 7fc357142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:00.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.935+0000 7fc357142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.935+0000 7fc357142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 2024-09-12T17:42:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc357142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:42:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc357142800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:42:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc357142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc357142800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29, ofs0, ns] 2024-09-12T17:42:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc235ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94914303523648 notifier 7089 bl.length()=999 2024-09-12T17:42:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc235ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:42:00.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc235ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:42:00.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.940+0000 7fc235ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.941+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_sources= new_sources= 2024-09-12T17:42:00.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.941+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential sources added=[] removed=[] 2024-09-12T17:42:00.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.941+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_dests= new_dests= 2024-09-12T17:42:00.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.941+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential dests added=[] removed=[] 2024-09-12T17:42:00.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.0 2024-09-12T17:42:00.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.0 2024-09-12T17:42:00.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.1 2024-09-12T17:42:00.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.1 2024-09-12T17:42:00.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.2 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.2 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.3 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.3 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.4 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.4 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.5 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.5 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.6 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.6 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.7 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.7 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.8 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.8 2024-09-12T17:42:00.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.9 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.9 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.10 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.10 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.11 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1.11 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.0 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.946+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1 2024-09-12T17:42:00.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.947+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.2 2024-09-12T17:42:00.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.947+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.3 2024-09-12T17:42:00.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.948+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.4 2024-09-12T17:42:00.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.948+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.5 2024-09-12T17:42:00.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.949+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.6 2024-09-12T17:42:00.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.949+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.7 2024-09-12T17:42:00.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.950+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.8 2024-09-12T17:42:00.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.950+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.9 2024-09-12T17:42:00.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.951+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.10 2024-09-12T17:42:00.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.959+0000 7fc357142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:00.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.959+0000 7fc357142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 2024-09-12T17:42:00.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.960+0000 7fc357142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:42:00.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.960+0000 7fc357142800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:42:00.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.960+0000 7fc357142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.960+0000 7fc357142800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29, ofs0, ns] 2024-09-12T17:42:00.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc235ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94914303523648 notifier 7089 bl.length()=999 2024-09-12T17:42:00.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc235ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:42:00.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc235ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:42:00.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc235ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_sources= new_sources= 2024-09-12T17:42:00.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential sources added=[] removed=[] 2024-09-12T17:42:00.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_dests= new_dests= 2024-09-12T17:42:00.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.961+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential dests added=[] removed=[] 2024-09-12T17:42:00.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.964+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.0 2024-09-12T17:42:00.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.964+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.1 2024-09-12T17:42:00.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.965+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.2 2024-09-12T17:42:00.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.965+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.3 2024-09-12T17:42:00.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.965+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.4 2024-09-12T17:42:00.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.966+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.5 2024-09-12T17:42:00.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.966+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.6 2024-09-12T17:42:00.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.966+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.7 2024-09-12T17:42:00.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.967+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.8 2024-09-12T17:42:00.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.967+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.9 2024-09-12T17:42:00.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.968+0000 7fc357142800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29.10 2024-09-12T17:42:00.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.968+0000 7fc357142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:00.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.968+0000 7fc357142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 2024-09-12T17:42:00.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc357142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:42:00.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc357142800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:42:00.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc357142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc357142800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29, ofs0, ns] 2024-09-12T17:42:00.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc235ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94914303523648 notifier 7089 bl.length()=967 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc235ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 info.flags=0x17 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc235ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 to cache LRU end 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.970+0000 7fc235ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.971+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_sources= new_sources= 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.971+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential sources added=[] removed=[] 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.971+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): orig_dests= new_dests= 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.971+0000 7fc357142800 20 handle_bi_update(): bucket=:error-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29]): potential dests added=[] removed=[] 2024-09-12T17:42:00.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.973+0000 7fc357142800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:42:00.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.975+0000 7fc209fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:00.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.977+0000 7fc357142800 20 remove_watcher() i=0 2024-09-12T17:42:00.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.977+0000 7fc357142800 2 removed watcher, disabling cache 2024-09-12T17:42:00.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.978+0000 7fc357142800 20 remove_watcher() i=1 2024-09-12T17:42:00.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.980+0000 7fc357142800 20 remove_watcher() i=2 2024-09-12T17:42:00.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.981+0000 7fc357142800 20 remove_watcher() i=3 2024-09-12T17:42:00.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.982+0000 7fc357142800 20 remove_watcher() i=4 2024-09-12T17:42:00.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.983+0000 7fc357142800 20 remove_watcher() i=5 2024-09-12T17:42:00.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.984+0000 7fc357142800 20 remove_watcher() i=6 2024-09-12T17:42:00.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:00.985+0000 7fc357142800 20 remove_watcher() i=7 2024-09-12T17:42:00.999 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:42:01.029 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:01.030 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:01.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.068+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 20 realm 2024-09-12T17:42:01.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:01.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.070+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.071+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:01.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.071+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.071+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:01.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.071+0000 7f5134a98800 20 searching for the correct realm 2024-09-12T17:42:01.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.075+0000 7f5131d81640 0 -- 172.21.15.63:0/3315672986 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5128085910 msgr2=0x7f512807a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:01.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.281+0000 7f5132d83640 0 -- 172.21.15.63:0/3315672986 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b33bffbec0 msgr2=0x55b33bffe2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:01.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:01.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:01.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:01.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:01.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:01.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:01.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.285+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 zone default found 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 4 Realm: () 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 zonegroup default 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.286+0000 7f5134a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.287+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.287+0000 7f5134a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.287+0000 7f5134a98800 20 started sync module instance, tier type = 2024-09-12T17:42:01.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.287+0000 7f5134a98800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.296+0000 7f5134a98800 20 add_watcher() i=0 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.296+0000 7f5134a98800 20 add_watcher() i=1 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.296+0000 7f5134a98800 20 add_watcher() i=2 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.296+0000 7f5134a98800 20 add_watcher() i=3 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.296+0000 7f5134a98800 20 add_watcher() i=4 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.296+0000 7f5134a98800 20 add_watcher() i=5 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.296+0000 7f5134a98800 20 add_watcher() i=6 2024-09-12T17:42:01.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.297+0000 7f5134a98800 20 add_watcher() i=7 2024-09-12T17:42:01.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.297+0000 7f5134a98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:01.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.299+0000 7f4fe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:01.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.299+0000 7f5134a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:01.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.299+0000 7f5134a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:01.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.299+0000 7f5134a98800 5 note: GC not initialized 2024-09-12T17:42:01.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.299+0000 7f4f637fe640 20 reqs_thread_entry: start 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.300+0000 7f5134a98800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.300+0000 7f5134a98800 20 Filter name: none 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.300+0000 7f4f617fa640 20 reqs_thread_entry: start 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.300+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.300+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.300+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.301+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.301+0000 7f5134a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.301+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.301+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.301+0000 7f5134a98800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.301+0000 7f5134a98800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.301+0000 7f5134a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:01.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.303+0000 7f4fe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:01.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.306+0000 7f5134a98800 20 remove_watcher() i=0 2024-09-12T17:42:01.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.306+0000 7f5134a98800 2 removed watcher, disabling cache 2024-09-12T17:42:01.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.307+0000 7f5134a98800 20 remove_watcher() i=1 2024-09-12T17:42:01.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.308+0000 7f5134a98800 20 remove_watcher() i=2 2024-09-12T17:42:01.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.309+0000 7f5134a98800 20 remove_watcher() i=3 2024-09-12T17:42:01.311 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.310+0000 7f5134a98800 20 remove_watcher() i=4 2024-09-12T17:42:01.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.311+0000 7f5134a98800 20 remove_watcher() i=5 2024-09-12T17:42:01.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.312+0000 7f5134a98800 20 remove_watcher() i=6 2024-09-12T17:42:01.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.313+0000 7f5134a98800 20 remove_watcher() i=7 2024-09-12T17:42:01.325 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:01.326 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:01.326 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-block-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:42:01.326 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:01.401 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:42:01.401 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:01.619 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:42:01.649 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:01.649 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:01.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.686+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.688+0000 7f02f4e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.688+0000 7f02f4e1b800 20 realm 2024-09-12T17:42:01.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.688+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.688+0000 7f02f4e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.688+0000 7f02f4e1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:01.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.688+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.689+0000 7f02f4e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.689+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.689+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:01.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.689+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.690+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:01.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.690+0000 7f02f4e1b800 20 searching for the correct realm 2024-09-12T17:42:01.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.693+0000 7f02efdea640 0 -- 172.21.15.63:0/359494051 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f02e4017040 msgr2=0x7f02e409e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:01.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.696+0000 7f02f0dec640 0 -- 172.21.15.63:0/359494051 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55ca6f161cf0 msgr2=0x55ca6f164180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:01.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:01.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:01.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:01.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:01.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:01.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:01.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:01.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.700+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:01.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 zone default found 2024-09-12T17:42:01.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 4 Realm: () 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 zonegroup default 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 started sync module instance, tier type = 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.701+0000 7f02f4e1b800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:01.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.710+0000 7f02f4e1b800 20 add_watcher() i=0 2024-09-12T17:42:01.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.710+0000 7f02f4e1b800 20 add_watcher() i=1 2024-09-12T17:42:01.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.710+0000 7f02f4e1b800 20 add_watcher() i=2 2024-09-12T17:42:01.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.710+0000 7f02f4e1b800 20 add_watcher() i=3 2024-09-12T17:42:01.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.710+0000 7f02f4e1b800 20 add_watcher() i=4 2024-09-12T17:42:01.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.710+0000 7f02f4e1b800 20 add_watcher() i=5 2024-09-12T17:42:01.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.710+0000 7f02f4e1b800 20 add_watcher() i=6 2024-09-12T17:42:01.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.711+0000 7f02f4e1b800 20 add_watcher() i=7 2024-09-12T17:42:01.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.711+0000 7f02f4e1b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:01.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.712+0000 7f01a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:01.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f02f4e1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:01.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f02f4e1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:01.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f02f4e1b800 5 note: GC not initialized 2024-09-12T17:42:01.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f01a57e2640 20 reqs_thread_entry: start 2024-09-12T17:42:01.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f02f4e1b800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:01.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f02f4e1b800 20 Filter name: none 2024-09-12T17:42:01.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f0116ffd640 20 reqs_thread_entry: start 2024-09-12T17:42:01.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.713+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.714+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:01.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.714+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.715+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.715+0000 7f02f4e1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.715+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.715+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.715+0000 7f02f4e1b800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.715+0000 7f02f4e1b800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.715+0000 7f02f4e1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:01.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.717+0000 7f01a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:01.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.719+0000 7f02f4e1b800 20 remove_watcher() i=0 2024-09-12T17:42:01.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.719+0000 7f02f4e1b800 2 removed watcher, disabling cache 2024-09-12T17:42:01.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.720+0000 7f02f4e1b800 20 remove_watcher() i=1 2024-09-12T17:42:01.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.721+0000 7f02f4e1b800 20 remove_watcher() i=2 2024-09-12T17:42:01.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.722+0000 7f02f4e1b800 20 remove_watcher() i=3 2024-09-12T17:42:01.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.723+0000 7f02f4e1b800 20 remove_watcher() i=4 2024-09-12T17:42:01.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.724+0000 7f02f4e1b800 20 remove_watcher() i=5 2024-09-12T17:42:01.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.725+0000 7f02f4e1b800 20 remove_watcher() i=6 2024-09-12T17:42:01.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.726+0000 7f02f4e1b800 20 remove_watcher() i=7 2024-09-12T17:42:01.737 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:01.737 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:01.737 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-block-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:01.738 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:01.739 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:42:01.773 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:01.774 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:01.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.811+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 20 realm 2024-09-12T17:42:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.814+0000 7fe354f2e800 20 searching for the correct realm 2024-09-12T17:42:01.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:01.817+0000 7fe3504dc640 0 -- 172.21.15.63:0/2300938996 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fe344021440 msgr2=0x7fe3440218c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:02.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.022+0000 7fe3514de640 0 -- 172.21.15.63:0/2300938996 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56141e2afbc0 msgr2=0x56141e2b2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:02.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:02.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:02.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 zone default found 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 4 Realm: () 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 zonegroup default 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.028+0000 7fe354f2e800 20 started sync module instance, tier type = 2024-09-12T17:42:02.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.028+0000 7fe354f2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=0 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=1 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=2 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=3 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=4 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=5 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=6 2024-09-12T17:42:02.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.038+0000 7fe354f2e800 20 add_watcher() i=7 2024-09-12T17:42:02.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.038+0000 7fe354f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:02.040 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe206fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:02.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe354f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:02.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe354f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:02.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe354f2e800 5 note: GC not initialized 2024-09-12T17:42:02.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe205fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:02.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe354f2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:02.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe354f2e800 20 Filter name: none 2024-09-12T17:42:02.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.040+0000 7fe1777fe640 20 reqs_thread_entry: start 2024-09-12T17:42:02.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:42:02.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:02.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:42:02.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:42:02.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : miss 2024-09-12T17:42:02.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:02.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:02.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.041+0000 7fe354f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe354f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe354f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94644405533152 notifier 7149 bl.length()=999 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:02.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:02.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:02.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.0 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.0 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.1 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.1 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.2 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.2 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.3 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.3 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.4 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.4 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.5 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.5 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.6 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.6 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.7 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.7 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.8 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.8 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.9 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.9 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.10 2024-09-12T17:42:02.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.10 2024-09-12T17:42:02.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.11 2024-09-12T17:42:02.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.11 2024-09-12T17:42:02.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.0 2024-09-12T17:42:02.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.055+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1 2024-09-12T17:42:02.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.055+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2 2024-09-12T17:42:02.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.056+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.3 2024-09-12T17:42:02.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.056+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.4 2024-09-12T17:42:02.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.057+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.5 2024-09-12T17:42:02.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.057+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.6 2024-09-12T17:42:02.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.058+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.7 2024-09-12T17:42:02.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.059+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.8 2024-09-12T17:42:02.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.059+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.9 2024-09-12T17:42:02.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.060+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.10 2024-09-12T17:42:02.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.063+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:02.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.063+0000 7fe354f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:02.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.064+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.064+0000 7fe354f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.064+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.064+0000 7fe354f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 94644405533152 notifier 7149 bl.length()=999 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe354f2e800 time 2024-09-12T17:42:02.066567+0000 2024-09-12T17:42:02.068 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:02.085 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.085 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe35678c71a] 2024-09-12T17:42:02.085 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.085 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fe354f2e800 thread_name:radosgw-admin 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.066+0000 7fe354f2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe354f2e800 time 2024-09-12T17:42:02.066567+0000 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.086 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe35678c71a] 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.087 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe35543e6f0] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe35548b99c] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe35678c774] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.067+0000 7fe354f2e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fe354f2e800 thread_name:radosgw-admin 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe35543e6f0] 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe35548b99c] 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe35678c774] 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:42:01.795+0000 7fe354f2e800 5 AuthRegistry(0x56141e1c58b0) adding con mode: secure 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:42:01.795+0000 7fe354f2e800 5 AuthRegistry(0x56141e1c58b0) adding con mode: crc 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:42:01.795+0000 7fe354f2e800 5 AuthRegistry(0x56141e1c58b0) adding con mode: secure 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:42:01.796+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:42:01.796+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:42:01.796+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key hook 0x56141e1c59f8 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e07d6b0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e108990 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e1cb9d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.311405s 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): get_auth_request con 0x56141e1cb9d0 auth_method 0 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): get_auth_request con 0x56141e108990 auth_method 0 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e07d6b0 auth_method 0 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.092 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_done global_id 7140 payload 824 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:42:01.796+0000 7fe3514de640 1 monclient: found mon.noname-a 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: dump: 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: dump: 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:42:01.797+0000 7fe354f2e800 5 monclient: authenticate success, global_id 7140 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:42:01.797+0000 7fe23ee0d640 4 set_mon_vals no callback set 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:42:01.797+0000 7fe354f2e800 1 librados: init done 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:42:01.799+0000 7fe23d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:42:01.799+0000 7fe23d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:42:01.799+0000 7fe23d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:42:01.799+0000 7fe350cdd640 10 monclient: get_auth_request con 0x7fe2380764a0 auth_method 0 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:42:01.799+0000 7fe3504dc640 10 monclient: get_auth_request con 0x56141e1ee1a0 auth_method 0 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:42:01.800+0000 7fe350cdd640 10 monclient: get_auth_request con 0x56141e211130 auth_method 0 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:42:01.801+0000 7fe3504dc640 10 monclient: get_auth_request con 0x56141e216390 auth_method 0 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:42:01.802+0000 7fe354f2e800 10 monclient: build_initial_monmap 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:42:01.802+0000 7fe354f2e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:42:01.802+0000 7fe354f2e800 10 monclient: monmap: 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding auth protocol: cephx 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding auth protocol: cephx 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding auth protocol: cephx 2024-09-12T17:42:02.100 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:42:01.802+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.101 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command objecter_requests cmddesc objecter_requests hook 0x56141e21dd90 EEXIST 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:42:01.802+0000 7fe354f2e800 10 monclient: init 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding auth protocol: cephx 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding auth protocol: cephx 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding auth protocol: cephx 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:42:01.802+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:42:01.803+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:42:01.803+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key cmddesc rotate-key hook 0x56141e2194e0 EEXIST 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e241a80 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e243d50 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e240250 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.318229s 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e241a80 auth_method 0 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): get_auth_request con 0x56141e240250 auth_method 0 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): get_auth_request con 0x56141e243d50 auth_method 0 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_done global_id 6737 payload 824 2024-09-12T17:42:02.105 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:42:01.803+0000 7fe350cdd640 1 monclient: found mon.noname-c 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: dump: 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:42:01.804+0000 7fe2367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:42:01.804+0000 7fe2367fc640 10 monclient: dump: 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.107 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:42:01.804+0000 7fe354f2e800 5 monclient: authenticate success, global_id 6737 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:42:01.803+0000 7fe351cdf640 4 set_mon_vals no callback set 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:42:01.805+0000 7fe2367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:42:01.805+0000 7fe2367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:42:01.805+0000 7fe2367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:42:01.806+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe228076380 auth_method 0 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: get_monmap_and_config 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: build_initial_monmap 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:42:01.806+0000 7fe354f2e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: monmap: 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding auth protocol: cephx 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding auth protocol: cephx 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding auth protocol: cephx 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:42:01.806+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: init 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding auth protocol: cephx 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding auth protocol: cephx 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding auth protocol: cephx 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:42:01.807+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:42:01.807+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:42:01.807+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key cmddesc rotate-key hook 0x7ffcff989b48 EEXIST 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:42:02.112 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e295cb0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e265ac0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e291070 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.322379s 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e295cb0 auth_method 0 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.113 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): get_auth_request con 0x56141e291070 auth_method 0 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_done global_id 6740 payload 274 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:42:01.807+0000 7fe3514de640 1 monclient: found mon.noname-c 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: dump: 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:42:01.807+0000 7fe354f2e800 5 monclient: authenticate success, global_id 6740 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:42:01.807+0000 7fe354f2e800 4 set_mon_vals no callback set 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:02.116 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: dump: 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:42:01.808+0000 7fe354f2e800 10 monclient: shutdown 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:42:01.808+0000 7fe354f2e800 10 monclient: build_initial_monmap 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:42:01.808+0000 7fe354f2e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:42:01.808+0000 7fe354f2e800 10 monclient: monmap: 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding auth protocol: cephx 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding auth protocol: cephx 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding auth protocol: cephx 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:42:01.808+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:42:01.808+0000 7fe354f2e800 1 librados: starting msgr at 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:42:01.808+0000 7fe354f2e800 1 librados: starting objecter 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command objecter_requests cmddesc objecter_requests hook 0x56141e267450 EEXIST 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:42:01.809+0000 7fe354f2e800 1 librados: setting wanted keys 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:42:01.809+0000 7fe354f2e800 1 librados: calling monclient init 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient: init 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding auth protocol: cephx 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding auth protocol: cephx 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding auth protocol: cephx 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.120 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:42:01.809+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:42:01.809+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key cmddesc rotate-key hook 0x56141e259978 EEXIST 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.121 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e265ac0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e291070 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e295cb0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.324614s 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e265ac0 auth_method 0 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): get_auth_request con 0x56141e291070 auth_method 0 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_done global_id 7149 payload 824 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:42:01.809+0000 7fe350cdd640 1 monclient: found mon.noname-a 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: dump: 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.124 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: dump: 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:42:01.810+0000 7fe354f2e800 5 monclient: authenticate success, global_id 7149 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:42:01.810+0000 7fe227fff640 4 set_mon_vals no callback set 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:42:01.810+0000 7fe354f2e800 1 librados: init done 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:42:01.810+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cr dump hook 0x7fe3480ac068 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:42:01.811+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:42:01.812+0000 7fe2267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:42:01.812+0000 7fe2267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:42:01.812+0000 7fe2267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:42:01.812+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe21c076470 auth_method 0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:42:01.812+0000 7fe3514de640 10 monclient: get_auth_request con 0x56141e2afbc0 auth_method 0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 realm 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:42:01.813+0000 7fe354f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:42:01.813+0000 7fe350cdd640 10 monclient: get_auth_request con 0x56141e2b3de0 auth_method 0 2024-09-12T17:42:02.127 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 searching for the correct realm 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:42:01.815+0000 7fe3504dc640 10 monclient: get_auth_request con 0x56141e2b9090 auth_method 0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:42:01.815+0000 7fe3514de640 10 monclient: get_auth_request con 0x7fe344039970 auth_method 0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:42:01.816+0000 7fe350cdd640 10 monclient: get_auth_request con 0x7fe34002f4d0 auth_method 0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:42:01.817+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe344021440 auth_method 0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:42:01.817+0000 7fe3504dc640 0 -- 172.21.15.63:0/2300938996 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fe344021440 msgr2=0x7fe3440218c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:42:02.018+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe344021440 auth_method 0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:42:02.020+0000 7fe3514de640 10 monclient: get_auth_request con 0x7fe34009a0c0 auth_method 0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:42:02.021+0000 7fe350cdd640 10 monclient: get_auth_request con 0x7fe348069020 auth_method 0 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:42:02.022+0000 7fe3514de640 0 -- 172.21.15.63:0/2300938996 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56141e2afbc0 msgr2=0x56141e2b2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:42:02.022+0000 7fe2267fc640 1 client.7149.objecter ms_handle_reset 0x56141e2afbc0 session 0x56141e2af4b0 osd.6 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:42:02.022+0000 7fe2267fc640 10 monclient: _renew_subs 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:42:02.022+0000 7fe2267fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:42:02.022+0000 7fe3514de640 10 monclient: get_auth_request con 0x7fe21c086790 auth_method 0 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.129 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 zone default found 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:42:02.027+0000 7fe354f2e800 4 Realm: () 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:42:02.027+0000 7fe354f2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:42:02.027+0000 7fe354f2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:42:02.027+0000 7fe354f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 zonegroup default 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.130 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 started sync module instance, tier type = 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=0 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=1 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=2 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=3 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=4 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=5 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=6 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:42:02.038+0000 7fe354f2e800 20 add_watcher() i=7 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:42:02.038+0000 7fe354f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding auth protocol: cephx 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding auth protocol: cephx 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding auth protocol: cephx 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:42:02.040+0000 7fe206fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.132 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:42:02.040+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache list hook 0x56141e28c3b0 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache inspect hook 0x56141e28c3b0 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache erase hook 0x56141e28c3b0 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache zap hook 0x56141e28c3b0 2024-09-12T17:42:02.133 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 note: GC not initialized 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:42:02.040+0000 7fe205fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace show hook 0x7fe3440014a0 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace history hook 0x7fe3440014a0 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace active hook 0x7fe3440014a0 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace active_short hook 0x7fe3440014a0 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 Filter name: none 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:42:02.040+0000 7fe1777fe640 20 reqs_thread_entry: start 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : miss 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94644405533152 notifier 7149 bl.length()=999 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.0 2024-09-12T17:42:02.136 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.0 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.1 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.1 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.2 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.2 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.3 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.3 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.4 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.4 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.5 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.5 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.6 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.6 2024-09-12T17:42:02.137 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.7 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.7 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.8 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.8 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.9 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.9 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.10 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.10 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.11 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.11 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.0 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:42:02.055+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:42:02.055+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:42:02.056+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.3 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:42:02.056+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.4 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:42:02.057+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.5 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:42:02.057+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.6 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:42:02.058+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.7 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:42:02.059+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.8 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:42:02.059+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.9 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:42:02.060+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.10 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:42:02.063+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:42:02.063+0000 7fe354f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 94644405533152 notifier 7149 bl.length()=999 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:42:02.066+0000 7fe354f2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe354f2e800 time 2024-09-12T17:42:02.066567+0000 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.140 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe35678c71a] 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:42:02.067+0000 7fe354f2e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fe354f2e800 thread_name:radosgw-admin 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe35543e6f0] 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe35548b99c] 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe35678c774] 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:42:02.143 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:42:02.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:42:02.149 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:42:02.149 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:42:02.149 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:42:02.149 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:42:02.149 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:42:02.149 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe1777fe640 / http_manager 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe205fe3640 / http_manager 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe206fe5640 / rgw_dt_lg_renew 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe2267fc640 / ms_dispatch 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe2277fe640 / io_context_pool 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe227fff640 / io_context_pool 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe2367fc640 / ms_dispatch 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe23d60a640 / ms_dispatch 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe23ee0d640 / io_context_pool 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe3504dc640 / msgr-worker-2 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe350cdd640 / msgr-worker-1 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe3514de640 / msgr-worker-0 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe351cdf640 / io_context_pool 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe354f2e800 / radosgw-admin 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.115226.log 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:42:01.795+0000 7fe354f2e800 5 AuthRegistry(0x56141e1c58b0) adding con mode: secure 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:42:01.795+0000 7fe354f2e800 5 AuthRegistry(0x56141e1c58b0) adding con mode: crc 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:42:01.795+0000 7fe354f2e800 5 AuthRegistry(0x56141e1c58b0) adding con mode: secure 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:42:01.796+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:42:01.796+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:42:01.796+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key hook 0x56141e1c59f8 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e07d6b0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e108990 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e1cb9d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:42:01.796+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.311405s 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): get_auth_request con 0x56141e1cb9d0 auth_method 0 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): get_auth_request con 0x56141e108990 auth_method 0 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e07d6b0 auth_method 0 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:42:01.796+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:42:01.796+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient(hunting): handle_auth_done global_id 7140 payload 824 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:42:01.796+0000 7fe3514de640 1 monclient: found mon.noname-a 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:42:01.796+0000 7fe3514de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.156 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: dump: 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:42:01.797+0000 7fe23d60a640 10 monclient: dump: 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:42:01.797+0000 7fe354f2e800 5 monclient: authenticate success, global_id 7140 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:42:01.797+0000 7fe23ee0d640 4 set_mon_vals no callback set 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:42:01.797+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:42:01.797+0000 7fe354f2e800 1 librados: init done 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:42:01.799+0000 7fe23d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:42:01.799+0000 7fe23d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:42:01.799+0000 7fe23d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:42:01.799+0000 7fe350cdd640 10 monclient: get_auth_request con 0x7fe2380764a0 auth_method 0 2024-09-12T17:42:02.159 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:42:01.799+0000 7fe3504dc640 10 monclient: get_auth_request con 0x56141e1ee1a0 auth_method 0 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:42:01.800+0000 7fe350cdd640 10 monclient: get_auth_request con 0x56141e211130 auth_method 0 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:42:01.801+0000 7fe3504dc640 10 monclient: get_auth_request con 0x56141e216390 auth_method 0 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:42:01.802+0000 7fe354f2e800 10 monclient: build_initial_monmap 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:42:01.802+0000 7fe354f2e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:42:01.802+0000 7fe354f2e800 10 monclient: monmap: 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding auth protocol: cephx 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding auth protocol: cephx 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding auth protocol: cephx 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: crc 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e21a3e0) adding con mode: secure 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:42:01.802+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command objecter_requests cmddesc objecter_requests hook 0x56141e21dd90 EEXIST 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:42:01.802+0000 7fe354f2e800 10 monclient: init 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding auth protocol: cephx 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding auth protocol: cephx 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding auth protocol: cephx 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: crc 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:42:01.802+0000 7fe354f2e800 5 AuthRegistry(0x56141e219398) adding con mode: secure 2024-09-12T17:42:02.163 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:42:01.802+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:42:01.803+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:42:01.803+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key cmddesc rotate-key hook 0x56141e2194e0 EEXIST 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e241a80 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e243d50 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e240250 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:42:01.803+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.318229s 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e241a80 auth_method 0 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): get_auth_request con 0x56141e240250 auth_method 0 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): get_auth_request con 0x56141e243d50 auth_method 0 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:42:01.803+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:42:01.803+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient(hunting): handle_auth_done global_id 6737 payload 824 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:42:01.803+0000 7fe350cdd640 1 monclient: found mon.noname-c 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:42:01.803+0000 7fe350cdd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: dump: 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:42:01.803+0000 7fe2367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:42:01.804+0000 7fe2367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:42:01.804+0000 7fe2367fc640 10 monclient: dump: 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:42:01.804+0000 7fe354f2e800 5 monclient: authenticate success, global_id 6737 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:42:01.803+0000 7fe351cdf640 4 set_mon_vals no callback set 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:42:01.804+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:42:01.805+0000 7fe2367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:42:01.805+0000 7fe2367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:42:01.805+0000 7fe2367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:42:01.806+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe228076380 auth_method 0 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: get_monmap_and_config 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: build_initial_monmap 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:42:01.806+0000 7fe354f2e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: monmap: 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding auth protocol: cephx 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding auth protocol: cephx 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding auth protocol: cephx 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.171 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: crc 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x56141e261630) adding con mode: secure 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:42:01.806+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:42:01.806+0000 7fe354f2e800 10 monclient: init 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding auth protocol: cephx 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding auth protocol: cephx 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding auth protocol: cephx 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: crc 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:42:01.806+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989a00) adding con mode: secure 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:42:01.807+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:42:01.807+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:42:01.807+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key cmddesc rotate-key hook 0x7ffcff989b48 EEXIST 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e295cb0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e265ac0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e291070 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.322379s 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e295cb0 auth_method 0 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): get_auth_request con 0x56141e291070 auth_method 0 2024-09-12T17:42:02.174 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:42:01.807+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient(hunting): handle_auth_done global_id 6740 payload 274 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:42:01.807+0000 7fe3514de640 1 monclient: found mon.noname-c 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:42:01.807+0000 7fe3514de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: dump: 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:42:01.807+0000 7fe354f2e800 5 monclient: authenticate success, global_id 6740 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:42:01.807+0000 7fe354f2e800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:42:01.807+0000 7fe354f2e800 4 set_mon_vals no callback set 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:42:01.807+0000 7fe227fff640 10 monclient: dump: 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:42:01.808+0000 7fe354f2e800 10 monclient: shutdown 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:42:01.808+0000 7fe354f2e800 10 monclient: build_initial_monmap 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:42:01.808+0000 7fe354f2e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:42:01.808+0000 7fe354f2e800 10 monclient: monmap: 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding auth protocol: cephx 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding auth protocol: cephx 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding auth protocol: cephx 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: crc 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 AuthRegistry(0x56141e291520) adding con mode: secure 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:42:01.808+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:42:01.808+0000 7fe354f2e800 1 librados: starting msgr at 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:42:01.808+0000 7fe354f2e800 1 librados: starting objecter 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:42:01.808+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command objecter_requests cmddesc objecter_requests hook 0x56141e267450 EEXIST 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:42:01.809+0000 7fe354f2e800 1 librados: setting wanted keys 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:42:01.809+0000 7fe354f2e800 1 librados: calling monclient init 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient: init 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding auth protocol: cephx 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding auth protocol: cephx 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding auth protocol: cephx 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: crc 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 AuthRegistry(0x56141e259830) adding con mode: secure 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:42:01.809+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:42:01.809+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:42:01.809+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command rotate-key cmddesc rotate-key hook 0x56141e259978 EEXIST 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-a con 0x56141e265ac0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-c con 0x56141e291070 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): picked mon.noname-b con 0x56141e295cb0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:42:01.809+0000 7fe354f2e800 10 monclient(hunting): authenticate will time out at 2014.324614s 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): get_auth_request con 0x56141e265ac0 auth_method 0 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): get_auth_request con 0x56141e291070 auth_method 0 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:42:01.809+0000 7fe3504dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient(hunting): handle_auth_done global_id 7149 payload 824 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient: _finish_hunting 0 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:42:01.809+0000 7fe350cdd640 1 monclient: found mon.noname-a 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:42:01.809+0000 7fe350cdd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: dump: 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: _finish_auth 0 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: _check_auth_tickets 2024-09-12T17:42:02.185 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:42:01.810+0000 7fe2267fc640 10 monclient: dump: 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:42:01.810+0000 7fe354f2e800 5 monclient: authenticate success, global_id 7149 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:42:01.810+0000 7fe227fff640 4 set_mon_vals no callback set 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _renew_subs 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:42:01.810+0000 7fe354f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:42:01.810+0000 7fe354f2e800 1 librados: init done 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:42:01.810+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cr dump hook 0x7fe3480ac068 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:42:01.811+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:42:01.812+0000 7fe2267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:42:01.812+0000 7fe2267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:42:01.812+0000 7fe2267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:42:01.812+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe21c076470 auth_method 0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:42:01.812+0000 7fe3514de640 10 monclient: get_auth_request con 0x56141e2afbc0 auth_method 0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 realm 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:42:01.813+0000 7fe354f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:42:01.813+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:42:01.813+0000 7fe350cdd640 10 monclient: get_auth_request con 0x56141e2b3de0 auth_method 0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.188 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:42:01.814+0000 7fe354f2e800 20 searching for the correct realm 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:42:01.815+0000 7fe3504dc640 10 monclient: get_auth_request con 0x56141e2b9090 auth_method 0 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:42:01.815+0000 7fe3514de640 10 monclient: get_auth_request con 0x7fe344039970 auth_method 0 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:42:01.816+0000 7fe350cdd640 10 monclient: get_auth_request con 0x7fe34002f4d0 auth_method 0 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:42:01.817+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe344021440 auth_method 0 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:42:01.817+0000 7fe3504dc640 0 -- 172.21.15.63:0/2300938996 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fe344021440 msgr2=0x7fe3440218c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:42:02.018+0000 7fe3504dc640 10 monclient: get_auth_request con 0x7fe344021440 auth_method 0 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:42:02.020+0000 7fe3514de640 10 monclient: get_auth_request con 0x7fe34009a0c0 auth_method 0 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:42:02.021+0000 7fe350cdd640 10 monclient: get_auth_request con 0x7fe348069020 auth_method 0 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:42:02.022+0000 7fe3514de640 0 -- 172.21.15.63:0/2300938996 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56141e2afbc0 msgr2=0x56141e2b2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:42:02.022+0000 7fe2267fc640 1 client.7149.objecter ms_handle_reset 0x56141e2afbc0 session 0x56141e2af4b0 osd.6 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:42:02.022+0000 7fe2267fc640 10 monclient: _renew_subs 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:42:02.022+0000 7fe2267fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:42:02.022+0000 7fe3514de640 10 monclient: get_auth_request con 0x7fe21c086790 auth_method 0 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:42:02.026+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 zone default found 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:42:02.027+0000 7fe354f2e800 4 Realm: () 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:42:02.027+0000 7fe354f2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:42:02.027+0000 7fe354f2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:42:02.027+0000 7fe354f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 zonegroup default 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:42:02.027+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 started sync module instance, tier type = 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:42:02.028+0000 7fe354f2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=0 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=1 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=2 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=3 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=4 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=5 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:42:02.037+0000 7fe354f2e800 20 add_watcher() i=6 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:42:02.038+0000 7fe354f2e800 20 add_watcher() i=7 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:42:02.038+0000 7fe354f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding auth protocol: cephx 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding auth protocol: cephx 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding auth protocol: cephx 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:42:02.040+0000 7fe206fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: crc 2024-09-12T17:42:02.193 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 AuthRegistry(0x7ffcff989ed0) adding con mode: secure 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:42:02.040+0000 7fe354f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache list hook 0x56141e28c3b0 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache inspect hook 0x56141e28c3b0 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache erase hook 0x56141e28c3b0 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command cache zap hook 0x56141e28c3b0 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 note: GC not initialized 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:42:02.040+0000 7fe205fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace show hook 0x7fe3440014a0 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace history hook 0x7fe3440014a0 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace active hook 0x7fe3440014a0 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:42:02.040+0000 7fe354f2e800 5 asok(0x56141dfa3730) register_command sync trace active_short hook 0x7fe3440014a0 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:42:02.040+0000 7fe354f2e800 20 Filter name: none 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:42:02.040+0000 7fe1777fe640 20 reqs_thread_entry: start 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : miss 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:42:02.041+0000 7fe354f2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.195 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:42:02.041+0000 7fe354f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:42:02.049+0000 7fe354f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94644405533152 notifier 7149 bl.length()=999 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:42:02.049+0000 7fe2277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:42:02.050+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.0 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.0 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.1 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.1 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.2 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.2 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.3 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.3 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.4 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.4 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.5 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.5 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.6 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.6 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.7 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.7 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.8 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.8 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.9 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.9 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.10 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.10 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:42:02.054+0000 7fe354f2e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.11 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1.11 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:42:02.054+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.0 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:42:02.055+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:42:02.055+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:42:02.056+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.3 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:42:02.056+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.4 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:42:02.057+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.5 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:42:02.057+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.6 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:42:02.058+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.7 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:42:02.059+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.8 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:42:02.059+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.9 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:42:02.060+0000 7fe354f2e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.10 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:42:02.063+0000 7fe354f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:42:02.063+0000 7fe354f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:42:02.064+0000 7fe354f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 94644405533152 notifier 7149 bl.length()=999 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:42:02.065+0000 7fe227fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:42:02.065+0000 7fe354f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:42:02.066+0000 7fe354f2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe354f2e800 time 2024-09-12T17:42:02.066567+0000 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe35678c71a] 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:42:02.067+0000 7fe354f2e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fe354f2e800 thread_name:radosgw-admin 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe35543e6f0] 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe35548b99c] 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe35678c774] 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe35678c8d8] 2024-09-12T17:42:02.202 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56141d38d841] 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56141d39c79e] 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56141d39d5d4] 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe355429590] 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:42:02.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:42:02.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe1777fe640 / http_manager 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe205fe3640 / http_manager 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe206fe5640 / rgw_dt_lg_renew 2024-09-12T17:42:02.210 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe2267fc640 / ms_dispatch 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe2277fe640 / io_context_pool 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe227fff640 / io_context_pool 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe2367fc640 / ms_dispatch 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe23d60a640 / ms_dispatch 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe23ee0d640 / io_context_pool 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe3504dc640 / msgr-worker-2 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe350cdd640 / msgr-worker-1 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe3514de640 / msgr-worker-0 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe351cdf640 / io_context_pool 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: 7fe354f2e800 / radosgw-admin 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:42:02.068211Z_8d13b951-66eb-4e68-a5ab-fab9414c0e3e/log 2024-09-12T17:42:02.212 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:42:02.212 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:42:02.213 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:02.213 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:02.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.145+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 20 realm 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.147+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.148+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.148+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.148+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.148+0000 7f038b087800 20 searching for the correct realm 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.151+0000 7f0388370640 0 -- 172.21.15.63:0/204167957 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f037c019410 msgr2=0x7f037c019870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:02.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.357+0000 7f0388370640 0 -- 172.21.15.63:0/204167957 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55d40d3c7480 msgr2=0x55d40d3c9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:02.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.360+0000 7f038b087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:02.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.360+0000 7f038b087800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.360+0000 7f038b087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.360+0000 7f038b087800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.360+0000 7f038b087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.360+0000 7f038b087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.360+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 zone default found 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 4 Realm: () 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 zonegroup default 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.361+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.362+0000 7f038b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.362+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.362+0000 7f038b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.362+0000 7f038b087800 20 started sync module instance, tier type = 2024-09-12T17:42:02.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.362+0000 7f038b087800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.371+0000 7f038b087800 20 add_watcher() i=0 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.371+0000 7f038b087800 20 add_watcher() i=1 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.371+0000 7f038b087800 20 add_watcher() i=2 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.371+0000 7f038b087800 20 add_watcher() i=3 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.371+0000 7f038b087800 20 add_watcher() i=4 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.371+0000 7f038b087800 20 add_watcher() i=5 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.371+0000 7f038b087800 20 add_watcher() i=6 2024-09-12T17:42:02.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.372+0000 7f038b087800 20 add_watcher() i=7 2024-09-12T17:42:02.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.372+0000 7f038b087800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:02.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f023f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:02.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f038b087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:02.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f038b087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:02.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f038b087800 5 note: GC not initialized 2024-09-12T17:42:02.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f023e7e4640 20 reqs_thread_entry: start 2024-09-12T17:42:02.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f038b087800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:02.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f038b087800 20 Filter name: none 2024-09-12T17:42:02.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f02377fe640 20 reqs_thread_entry: start 2024-09-12T17:42:02.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.374+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.375+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.375+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.375+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.375+0000 7f038b087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.375+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.376+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.376+0000 7f038b087800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.376+0000 7f038b087800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.376+0000 7f038b087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:02.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.378+0000 7f023f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:02.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.380+0000 7f038b087800 20 remove_watcher() i=0 2024-09-12T17:42:02.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.380+0000 7f038b087800 2 removed watcher, disabling cache 2024-09-12T17:42:02.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.381+0000 7f038b087800 20 remove_watcher() i=1 2024-09-12T17:42:02.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.382+0000 7f038b087800 20 remove_watcher() i=2 2024-09-12T17:42:02.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.383+0000 7f038b087800 20 remove_watcher() i=3 2024-09-12T17:42:02.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.384+0000 7f038b087800 20 remove_watcher() i=4 2024-09-12T17:42:02.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.385+0000 7f038b087800 20 remove_watcher() i=5 2024-09-12T17:42:02.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.386+0000 7f038b087800 20 remove_watcher() i=6 2024-09-12T17:42:02.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.387+0000 7f038b087800 20 remove_watcher() i=7 2024-09-12T17:42:02.399 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.399 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:02.399 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-block-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:02.399 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:02.450 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:42:02.485 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:02.485 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:02.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.523+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 20 realm 2024-09-12T17:42:02.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:02.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.524+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.525+0000 7fb53892c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.525+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.525+0000 7fb53892c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:02.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.525+0000 7fb53892c800 20 searching for the correct realm 2024-09-12T17:42:02.529 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.529+0000 7fb533d3d640 0 -- 172.21.15.63:0/3744276505 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb528032920 msgr2=0x7fb528018410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:02.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.734+0000 7fb534d3f640 0 -- 172.21.15.63:0/3744276505 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5644687ef5d0 msgr2=0x5644687f1a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.739+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 zone default found 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 4 Realm: () 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 zonegroup default 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.740+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.741+0000 7fb53892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:02.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.741+0000 7fb53892c800 20 started sync module instance, tier type = 2024-09-12T17:42:02.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.741+0000 7fb53892c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.749+0000 7fb53892c800 20 add_watcher() i=0 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.749+0000 7fb53892c800 20 add_watcher() i=1 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.749+0000 7fb53892c800 20 add_watcher() i=2 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.749+0000 7fb53892c800 20 add_watcher() i=3 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.749+0000 7fb53892c800 20 add_watcher() i=4 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.749+0000 7fb53892c800 20 add_watcher() i=5 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.749+0000 7fb53892c800 20 add_watcher() i=6 2024-09-12T17:42:02.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.750+0000 7fb53892c800 20 add_watcher() i=7 2024-09-12T17:42:02.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.750+0000 7fb53892c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:02.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.752+0000 7fb3eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.752+0000 7fb53892c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.752+0000 7fb53892c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.752+0000 7fb53892c800 5 note: GC not initialized 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.752+0000 7fb3e9fdb640 20 reqs_thread_entry: start 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 20 Filter name: none 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb35b7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:02.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:42:02.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:42:02.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : miss 2024-09-12T17:42:02.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.753+0000 7fb53892c800 20 rados->read ofs=0 len=0 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.754+0000 7fb53892c800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.754+0000 7fb53892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.754+0000 7fb53892c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.754+0000 7fb53892c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.754+0000 7fb53892c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.754+0000 7fb53892c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.755+0000 7fb53892c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to be held by another RGW process; skipping for now 2024-09-12T17:42:02.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.756+0000 7fb3eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:02.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.758+0000 7fb53892c800 20 remove_watcher() i=0 2024-09-12T17:42:02.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.758+0000 7fb53892c800 2 removed watcher, disabling cache 2024-09-12T17:42:02.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.759+0000 7fb53892c800 20 remove_watcher() i=1 2024-09-12T17:42:02.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.760+0000 7fb53892c800 20 remove_watcher() i=2 2024-09-12T17:42:02.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.761+0000 7fb53892c800 20 remove_watcher() i=3 2024-09-12T17:42:02.763 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.762+0000 7fb53892c800 20 remove_watcher() i=4 2024-09-12T17:42:02.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.763+0000 7fb53892c800 20 remove_watcher() i=5 2024-09-12T17:42:02.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.764+0000 7fb53892c800 20 remove_watcher() i=6 2024-09-12T17:42:02.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:02.765+0000 7fb53892c800 20 remove_watcher() i=7 2024-09-12T17:42:02.777 INFO:tasks.workunit.client.0.smithi063.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:42:32.803 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:42:32.840 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.840 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.884+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.885+0000 7f6c30d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.885+0000 7f6c30d40800 20 realm 2024-09-12T17:42:32.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.885+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.886+0000 7f6c30d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.886+0000 7f6c30d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.886+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.886+0000 7f6c30d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.888 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.886+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.887+0000 7f6c30d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.887+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.887+0000 7f6c30d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.887+0000 7f6c30d40800 20 searching for the correct realm 2024-09-12T17:42:32.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:32.891+0000 7f6c27fff640 0 -- 172.21.15.63:0/2967577810 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f6c1807a900 msgr2=0x7f6c18088410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.097+0000 7f6c27fff640 0 -- 172.21.15.63:0/2967577810 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55dd19bc2b20 msgr2=0x55dd19bc4f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.103+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 20 zone default found 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 4 Realm: () 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 20 zonegroup default 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.104+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.105+0000 7f6c30d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.105+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.105+0000 7f6c30d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.105+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.105+0000 7f6c30d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.105+0000 7f6c30d40800 20 started sync module instance, tier type = 2024-09-12T17:42:33.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.105+0000 7f6c30d40800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:33.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.116+0000 7f6c30d40800 20 add_watcher() i=0 2024-09-12T17:42:33.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.116+0000 7f6c30d40800 20 add_watcher() i=1 2024-09-12T17:42:33.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.116+0000 7f6c30d40800 20 add_watcher() i=2 2024-09-12T17:42:33.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.116+0000 7f6c30d40800 20 add_watcher() i=3 2024-09-12T17:42:33.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.116+0000 7f6c30d40800 20 add_watcher() i=4 2024-09-12T17:42:33.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.116+0000 7f6c30d40800 20 add_watcher() i=5 2024-09-12T17:42:33.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.116+0000 7f6c30d40800 20 add_watcher() i=6 2024-09-12T17:42:33.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.117+0000 7f6c30d40800 20 add_watcher() i=7 2024-09-12T17:42:33.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.117+0000 7f6c30d40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:33.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.119+0000 7f6ae27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.119+0000 7f6c30d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:33.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.119+0000 7f6c30d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:33.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.119+0000 7f6c30d40800 5 note: GC not initialized 2024-09-12T17:42:33.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.119+0000 7f6ae17e2640 20 reqs_thread_entry: start 2024-09-12T17:42:33.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.120+0000 7f6c30d40800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.120+0000 7f6c30d40800 20 Filter name: none 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.120+0000 7f6ada7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.120+0000 7f6c30d40800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.120+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : miss 2024-09-12T17:42:33.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:42:33.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:33.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:33.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:33.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.121+0000 7f6c30d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:33.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.122+0000 7f6c30d40800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:42:33.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.129+0000 7f6c30d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:33.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.129+0000 7f6c30d40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:33.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.129+0000 7f6c30d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.129+0000 7f6c30d40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:33.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6b0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 94408107958816 notifier 7203 bl.length()=999 2024-09-12T17:42:33.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6b0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:33.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6b0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:33.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6b0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:33.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:33.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:33.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.130+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:33.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.0 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.0 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.1 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.1 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.2 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.2 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.3 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.3 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.4 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.4 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.5 2024-09-12T17:42:33.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.5 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.6 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.6 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.7 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.7 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.8 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.8 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.9 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.9 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.10 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.10 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.11 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2.11 2024-09-12T17:42:33.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.137+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.0 2024-09-12T17:42:33.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.138+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1 2024-09-12T17:42:33.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.138+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2 2024-09-12T17:42:33.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.139+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.3 2024-09-12T17:42:33.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.139+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.4 2024-09-12T17:42:33.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.140+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.5 2024-09-12T17:42:33.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.140+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.6 2024-09-12T17:42:33.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.141+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.7 2024-09-12T17:42:33.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.142+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.8 2024-09-12T17:42:33.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.142+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.9 2024-09-12T17:42:33.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.143+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.10 2024-09-12T17:42:33.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.147+0000 7f6c30d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:33.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.147+0000 7f6c30d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:33.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.148+0000 7f6c30d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:33.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.148+0000 7f6c30d40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:33.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.148+0000 7f6c30d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.148+0000 7f6c30d40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6b0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94408107958816 notifier 7203 bl.length()=999 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6b0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6b0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6b0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:33.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.149+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:33.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.152+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.0 2024-09-12T17:42:33.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.152+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.1 2024-09-12T17:42:33.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.153+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.2 2024-09-12T17:42:33.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.153+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.3 2024-09-12T17:42:33.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.153+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.4 2024-09-12T17:42:33.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.154+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.5 2024-09-12T17:42:33.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.154+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.6 2024-09-12T17:42:33.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.154+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.7 2024-09-12T17:42:33.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.155+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.8 2024-09-12T17:42:33.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.155+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.9 2024-09-12T17:42:33.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.155+0000 7f6c30d40800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30.10 2024-09-12T17:42:33.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.156+0000 7f6c30d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:33.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.156+0000 7f6c30d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 2024-09-12T17:42:33.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.157+0000 7f6c30d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:33.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.157+0000 7f6c30d40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:33.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.157+0000 7f6c30d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.157+0000 7f6c30d40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30, ofs0, ns] 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6b0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94408107958816 notifier 7203 bl.length()=967 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6b0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 info.flags=0x17 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6b0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 to cache LRU end 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6b0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_sources= new_sources= 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential sources added=[] removed=[] 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): orig_dests= new_dests= 2024-09-12T17:42:33.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.158+0000 7f6c30d40800 20 handle_bi_update(): bucket=:abort-at-block-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30]): potential dests added=[] removed=[] 2024-09-12T17:42:33.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.160+0000 7f6c30d40800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:42:33.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.162+0000 7f6ae27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.165+0000 7f6c30d40800 20 remove_watcher() i=0 2024-09-12T17:42:33.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.165+0000 7f6c30d40800 2 removed watcher, disabling cache 2024-09-12T17:42:33.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.166+0000 7f6c30d40800 20 remove_watcher() i=1 2024-09-12T17:42:33.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.167+0000 7f6c30d40800 20 remove_watcher() i=2 2024-09-12T17:42:33.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.168+0000 7f6c30d40800 20 remove_watcher() i=3 2024-09-12T17:42:33.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.169+0000 7f6c30d40800 20 remove_watcher() i=4 2024-09-12T17:42:33.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.170+0000 7f6c30d40800 20 remove_watcher() i=5 2024-09-12T17:42:33.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.171+0000 7f6c30d40800 20 remove_watcher() i=6 2024-09-12T17:42:33.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.172+0000 7f6c30d40800 20 remove_watcher() i=7 2024-09-12T17:42:33.187 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:42:33.217 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:33.218 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.257+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.258+0000 7f7d2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.258+0000 7f7d2d51f800 20 realm 2024-09-12T17:42:33.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.258+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.258+0000 7f7d2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.258+0000 7f7d2d51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:33.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.258+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.259+0000 7f7d2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.259+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.259+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.259+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.260+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:33.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.260+0000 7f7d2d51f800 20 searching for the correct realm 2024-09-12T17:42:33.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.261+0000 7f7d29aa3640 0 -- 172.21.15.63:0/1608406105 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7f7d20072020 msgr2=0x7f7d2000a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.265+0000 7f7d292a2640 0 -- 172.21.15.63:0/1608406105 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x56309988c9e0 msgr2=0x56309988edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.270+0000 7f7d2d51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.270+0000 7f7d2d51f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.270+0000 7f7d2d51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.270+0000 7f7d2d51f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.270+0000 7f7d2d51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.270+0000 7f7d2d51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.270+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 zone default found 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 4 Realm: () 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 zonegroup default 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.271+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.272+0000 7f7d2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.272+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.272+0000 7f7d2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.272+0000 7f7d2d51f800 20 started sync module instance, tier type = 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.272+0000 7f7d2d51f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:33.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.280+0000 7f7d2d51f800 20 add_watcher() i=0 2024-09-12T17:42:33.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.280+0000 7f7d2d51f800 20 add_watcher() i=1 2024-09-12T17:42:33.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.280+0000 7f7d2d51f800 20 add_watcher() i=2 2024-09-12T17:42:33.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.280+0000 7f7d2d51f800 20 add_watcher() i=3 2024-09-12T17:42:33.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.280+0000 7f7d2d51f800 20 add_watcher() i=4 2024-09-12T17:42:33.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.280+0000 7f7d2d51f800 20 add_watcher() i=5 2024-09-12T17:42:33.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.280+0000 7f7d2d51f800 20 add_watcher() i=6 2024-09-12T17:42:33.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.281+0000 7f7d2d51f800 20 add_watcher() i=7 2024-09-12T17:42:33.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.281+0000 7f7d2d51f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.283+0000 7f7bdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.283+0000 7f7d2d51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.283+0000 7f7d2d51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.283+0000 7f7d2d51f800 5 note: GC not initialized 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.284+0000 7f7bde7e4640 20 reqs_thread_entry: start 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.284+0000 7f7d2d51f800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.284+0000 7f7d2d51f800 20 Filter name: none 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.284+0000 7f7b4ffff640 20 reqs_thread_entry: start 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.284+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.285+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.285+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.285+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.285+0000 7f7d2d51f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.285+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.286+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.286+0000 7f7d2d51f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.286+0000 7f7d2d51f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:42:33.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.286+0000 7f7d2d51f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.288+0000 7f7bdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.290+0000 7f7d2d51f800 20 remove_watcher() i=0 2024-09-12T17:42:33.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.290+0000 7f7d2d51f800 2 removed watcher, disabling cache 2024-09-12T17:42:33.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.291+0000 7f7d2d51f800 20 remove_watcher() i=1 2024-09-12T17:42:33.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.292+0000 7f7d2d51f800 20 remove_watcher() i=2 2024-09-12T17:42:33.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.293+0000 7f7d2d51f800 20 remove_watcher() i=3 2024-09-12T17:42:33.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.294+0000 7f7d2d51f800 20 remove_watcher() i=4 2024-09-12T17:42:33.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.295+0000 7f7d2d51f800 20 remove_watcher() i=5 2024-09-12T17:42:33.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.296+0000 7f7d2d51f800 20 remove_watcher() i=6 2024-09-12T17:42:33.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.297+0000 7f7d2d51f800 20 remove_watcher() i=7 2024-09-12T17:42:33.309 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:33.309 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:33.309 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-block-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:42:33.309 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:33.384 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:42:33.384 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:33.605 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:42:33.634 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:33.634 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:33.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.672+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 20 realm 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.674+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.675+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.675+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.675+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:33.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.675+0000 7fa12f1af800 20 searching for the correct realm 2024-09-12T17:42:33.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.678+0000 7fa12c498640 0 -- 172.21.15.63:0/1198841418 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa1200b9120 msgr2=0x7fa1200e8050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.682+0000 7fa12d49a640 0 -- 172.21.15.63:0/1198841418 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55af7a8507e0 msgr2=0x55af7a852ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:33.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:33.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.686+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 20 zone default found 2024-09-12T17:42:33.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 4 Realm: () 2024-09-12T17:42:33.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:33.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:33.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 20 zonegroup default 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.687+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.688+0000 7fa12f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.688+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.688+0000 7fa12f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.688+0000 7fa12f1af800 20 started sync module instance, tier type = 2024-09-12T17:42:33.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.688+0000 7fa12f1af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:33.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.696+0000 7fa12f1af800 20 add_watcher() i=0 2024-09-12T17:42:33.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.696+0000 7fa12f1af800 20 add_watcher() i=1 2024-09-12T17:42:33.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.696+0000 7fa12f1af800 20 add_watcher() i=2 2024-09-12T17:42:33.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.696+0000 7fa12f1af800 20 add_watcher() i=3 2024-09-12T17:42:33.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.696+0000 7fa12f1af800 20 add_watcher() i=4 2024-09-12T17:42:33.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.696+0000 7fa12f1af800 20 add_watcher() i=5 2024-09-12T17:42:33.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.696+0000 7fa12f1af800 20 add_watcher() i=6 2024-09-12T17:42:33.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.697+0000 7fa12f1af800 20 add_watcher() i=7 2024-09-12T17:42:33.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.697+0000 7fa12f1af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:33.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.699+0000 7f9fe2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.699+0000 7fa12f1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:33.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.699+0000 7fa12f1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:33.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.699+0000 7fa12f1af800 5 note: GC not initialized 2024-09-12T17:42:33.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.700+0000 7f9fe1fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:33.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.700+0000 7fa12f1af800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:33.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.700+0000 7fa12f1af800 20 Filter name: none 2024-09-12T17:42:33.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.700+0000 7f9f537fe640 20 reqs_thread_entry: start 2024-09-12T17:42:33.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.700+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.700+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:33.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.700+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.701+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:33.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.701+0000 7fa12f1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:33.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.701+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.701+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:33.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.701+0000 7fa12f1af800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.702+0000 7fa12f1af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:33.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.702+0000 7fa12f1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:33.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.703+0000 7f9fe2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.706+0000 7fa12f1af800 20 remove_watcher() i=0 2024-09-12T17:42:33.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.706+0000 7fa12f1af800 2 removed watcher, disabling cache 2024-09-12T17:42:33.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.707+0000 7fa12f1af800 20 remove_watcher() i=1 2024-09-12T17:42:33.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.707+0000 7fa12f1af800 20 remove_watcher() i=2 2024-09-12T17:42:33.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.709+0000 7fa12f1af800 20 remove_watcher() i=3 2024-09-12T17:42:33.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.709+0000 7fa12f1af800 20 remove_watcher() i=4 2024-09-12T17:42:33.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.710+0000 7fa12f1af800 20 remove_watcher() i=5 2024-09-12T17:42:33.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.711+0000 7fa12f1af800 20 remove_watcher() i=6 2024-09-12T17:42:33.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.712+0000 7fa12f1af800 20 remove_watcher() i=7 2024-09-12T17:42:33.724 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:33.724 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:33.724 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:33.724 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:33.726 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:42:33.761 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:33.761 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:33.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.799+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 20 realm 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.801+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.802+0000 7f2185815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.802+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.802+0000 7f2185815800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:33.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.802+0000 7f2185815800 20 searching for the correct realm 2024-09-12T17:42:33.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:33.805+0000 7f217bfff640 0 -- 172.21.15.63:0/2430434353 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f216c07b3f0 msgr2=0x7f216c07b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.012 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.011+0000 7f217bfff640 0 -- 172.21.15.63:0/2430434353 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x558a42771660 msgr2=0x558a42773ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.015+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 zone default found 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 4 Realm: () 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 zonegroup default 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 started sync module instance, tier type = 2024-09-12T17:42:34.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.016+0000 7f2185815800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:34.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.025+0000 7f2185815800 20 add_watcher() i=0 2024-09-12T17:42:34.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.025+0000 7f2185815800 20 add_watcher() i=1 2024-09-12T17:42:34.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.025+0000 7f2185815800 20 add_watcher() i=2 2024-09-12T17:42:34.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.025+0000 7f2185815800 20 add_watcher() i=3 2024-09-12T17:42:34.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.025+0000 7f2185815800 20 add_watcher() i=4 2024-09-12T17:42:34.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.025+0000 7f2185815800 20 add_watcher() i=5 2024-09-12T17:42:34.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.025+0000 7f2185815800 20 add_watcher() i=6 2024-09-12T17:42:34.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.026+0000 7f2185815800 20 add_watcher() i=7 2024-09-12T17:42:34.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.026+0000 7f2185815800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.027+0000 7f20377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 5 note: GC not initialized 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f20367e4640 20 reqs_thread_entry: start 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 20 Filter name: none 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f202f7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:42:34.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:34.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:42:34.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.028+0000 7f2185815800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 : miss 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.029+0000 7f2185815800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 2024-09-12T17:42:34.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.034+0000 7f2185815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.034+0000 7f2185815800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.034+0000 7f2185815800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.034+0000 7f2185815800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31, ofs0, ns] 2024-09-12T17:42:34.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2057fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94052308953280 notifier 6842 bl.length()=1015 2024-09-12T17:42:34.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2057fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2057fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2057fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_sources= new_sources= 2024-09-12T17:42:34.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential sources added=[] removed=[] 2024-09-12T17:42:34.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_dests= new_dests= 2024-09-12T17:42:34.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.035+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential dests added=[] removed=[] 2024-09-12T17:42:34.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.0 2024-09-12T17:42:34.041 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.0 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.1 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.1 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.2 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.2 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.3 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.3 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.4 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.4 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.5 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.5 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.6 2024-09-12T17:42:34.042 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.6 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.7 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.7 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.8 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.8 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.9 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.9 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.10 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.10 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.11 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1.11 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.040+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.0 2024-09-12T17:42:34.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.041+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1 2024-09-12T17:42:34.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.041+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2 2024-09-12T17:42:34.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.042+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.3 2024-09-12T17:42:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.042+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.4 2024-09-12T17:42:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.042+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.5 2024-09-12T17:42:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.043+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.6 2024-09-12T17:42:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.043+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.7 2024-09-12T17:42:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.044+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.8 2024-09-12T17:42:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.044+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.9 2024-09-12T17:42:34.045 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.045+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.10 2024-09-12T17:42:34.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.047+0000 7f2185815800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:34.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.047+0000 7f2185815800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31, ofs0, ns] 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2057fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 94052308953280 notifier 6842 bl.length()=1015 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2057fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2057fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2057fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_sources= new_sources= 2024-09-12T17:42:34.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential sources added=[] removed=[] 2024-09-12T17:42:34.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_dests= new_dests= 2024-09-12T17:42:34.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.049+0000 7f2185815800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential dests added=[] removed=[] 2024-09-12T17:42:34.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.052+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.0 2024-09-12T17:42:34.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.052+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1 2024-09-12T17:42:34.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.052+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2 2024-09-12T17:42:34.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.053+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.3 2024-09-12T17:42:34.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.053+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.4 2024-09-12T17:42:34.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.053+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.5 2024-09-12T17:42:34.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.054+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.6 2024-09-12T17:42:34.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.054+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.7 2024-09-12T17:42:34.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.054+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.8 2024-09-12T17:42:34.055 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.055+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.9 2024-09-12T17:42:34.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.055+0000 7f2185815800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.10 2024-09-12T17:42:34.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.055+0000 7f2185815800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:42:34.056 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.055+0000 7f2185815800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:42:34.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.059+0000 7f20377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.061+0000 7f2185815800 20 remove_watcher() i=0 2024-09-12T17:42:34.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.061+0000 7f2185815800 2 removed watcher, disabling cache 2024-09-12T17:42:34.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.062+0000 7f2185815800 20 remove_watcher() i=1 2024-09-12T17:42:34.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.063+0000 7f2185815800 20 remove_watcher() i=2 2024-09-12T17:42:34.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.064+0000 7f2185815800 20 remove_watcher() i=3 2024-09-12T17:42:34.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.065+0000 7f2185815800 20 remove_watcher() i=4 2024-09-12T17:42:34.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.066+0000 7f2185815800 20 remove_watcher() i=5 2024-09-12T17:42:34.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.067+0000 7f2185815800 20 remove_watcher() i=6 2024-09-12T17:42:34.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.068+0000 7f2185815800 20 remove_watcher() i=7 2024-09-12T17:42:34.081 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:42:34.111 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:34.111 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:34.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.148+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 20 realm 2024-09-12T17:42:34.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:34.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.150+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.151+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.151+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.151+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:34.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.151+0000 7f94c1575800 20 searching for the correct realm 2024-09-12T17:42:34.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.154+0000 7f94bf05f640 0 -- 172.21.15.63:0/3876276646 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f94b00d9070 msgr2=0x7f94b00c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.358+0000 7f94bf05f640 0 -- 172.21.15.63:0/3876276646 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f94b8018040 msgr2=0x7f94b8018420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.565+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 zone default found 2024-09-12T17:42:34.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 4 Realm: () 2024-09-12T17:42:34.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:34.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:34.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 zonegroup default 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.566+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.567+0000 7f94c1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.567+0000 7f94c1575800 20 started sync module instance, tier type = 2024-09-12T17:42:34.569 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.567+0000 7f94c1575800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:34.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.575+0000 7f94c1575800 20 add_watcher() i=0 2024-09-12T17:42:34.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.575+0000 7f94c1575800 20 add_watcher() i=1 2024-09-12T17:42:34.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.575+0000 7f94c1575800 20 add_watcher() i=2 2024-09-12T17:42:34.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.575+0000 7f94c1575800 20 add_watcher() i=3 2024-09-12T17:42:34.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.575+0000 7f94c1575800 20 add_watcher() i=4 2024-09-12T17:42:34.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.575+0000 7f94c1575800 20 add_watcher() i=5 2024-09-12T17:42:34.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.575+0000 7f94c1575800 20 add_watcher() i=6 2024-09-12T17:42:34.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.576+0000 7f94c1575800 20 add_watcher() i=7 2024-09-12T17:42:34.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.576+0000 7f94c1575800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.578+0000 7f9375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.578+0000 7f94c1575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.578+0000 7f94c1575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.578+0000 7f94c1575800 5 note: GC not initialized 2024-09-12T17:42:34.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.579+0000 7f9374fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:34.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.579+0000 7f94c1575800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.579+0000 7f94c1575800 20 Filter name: none 2024-09-12T17:42:34.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.579+0000 7f92ee7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:34.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.579+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.579+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.579+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.580+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.580+0000 7f94c1575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.580+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.581+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.581+0000 7f94c1575800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.582 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.581+0000 7f94c1575800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:42:34.583 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.581+0000 7f94c1575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:34.584 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.583+0000 7f9375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.586 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.586+0000 7f94c1575800 20 remove_watcher() i=0 2024-09-12T17:42:34.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.586+0000 7f94c1575800 2 removed watcher, disabling cache 2024-09-12T17:42:34.587 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.587+0000 7f94c1575800 20 remove_watcher() i=1 2024-09-12T17:42:34.588 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.588+0000 7f94c1575800 20 remove_watcher() i=2 2024-09-12T17:42:34.589 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.588+0000 7f94c1575800 20 remove_watcher() i=3 2024-09-12T17:42:34.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.590+0000 7f94c1575800 20 remove_watcher() i=4 2024-09-12T17:42:34.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.591+0000 7f94c1575800 20 remove_watcher() i=5 2024-09-12T17:42:34.592 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.592+0000 7f94c1575800 20 remove_watcher() i=6 2024-09-12T17:42:34.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.593+0000 7f94c1575800 20 remove_watcher() i=7 2024-09-12T17:42:34.605 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:34.605 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:34.605 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:34.605 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:34.658 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:42:34.690 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:34.691 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:34.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.729+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.730+0000 7f9f3b240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.730+0000 7f9f3b240800 20 realm 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.730+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.731+0000 7f9f3b240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.731+0000 7f9f3b240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.731+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.731+0000 7f9f3b240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.731+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.732+0000 7f9f3b240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.732+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.732+0000 7f9f3b240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:34.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.732+0000 7f9f3b240800 20 searching for the correct realm 2024-09-12T17:42:34.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.735+0000 7f9f38529640 0 -- 172.21.15.63:0/3745095446 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f9f2c06f8e0 msgr2=0x7f9f2c07d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:34.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.940+0000 7f9f3952b640 0 -- 172.21.15.63:0/3745095446 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55f0da7dc350 msgr2=0x55f0da7de810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.944+0000 7f9f3b240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.944+0000 7f9f3b240800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.944+0000 7f9f3b240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.944+0000 7f9f3b240800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.944+0000 7f9f3b240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.944+0000 7f9f3b240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.944+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 zone default found 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 4 Realm: () 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 zonegroup default 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.945+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.946+0000 7f9f3b240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.946+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.946+0000 7f9f3b240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.946+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.946+0000 7f9f3b240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.946+0000 7f9f3b240800 20 started sync module instance, tier type = 2024-09-12T17:42:34.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.946+0000 7f9f3b240800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.954+0000 7f9f3b240800 20 add_watcher() i=0 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.954+0000 7f9f3b240800 20 add_watcher() i=1 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.954+0000 7f9f3b240800 20 add_watcher() i=2 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.954+0000 7f9f3b240800 20 add_watcher() i=3 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.954+0000 7f9f3b240800 20 add_watcher() i=4 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.954+0000 7f9f3b240800 20 add_watcher() i=5 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.955+0000 7f9f3b240800 20 add_watcher() i=6 2024-09-12T17:42:34.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.955+0000 7f9f3b240800 20 add_watcher() i=7 2024-09-12T17:42:34.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.955+0000 7f9f3b240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.957+0000 7f9deefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.957+0000 7f9f3b240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.957+0000 7f9f3b240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.957+0000 7f9f3b240800 5 note: GC not initialized 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9dedfe3640 20 reqs_thread_entry: start 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 20 Filter name: none 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9d5f7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:42:34.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:34.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 : miss 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.958+0000 7f9f3b240800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.959+0000 7f9f3b240800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.959+0000 7f9f3b240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.959+0000 7f9f3b240800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.959+0000 7f9f3b240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.959+0000 7f9f3b240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.959+0000 7f9f3b240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 2024-09-12T17:42:34.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.960+0000 7f9f3b240800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:42:34.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9f3b240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9f3b240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9f3b240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9f3b240800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31, ofs0, ns] 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9e0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 94492946237488 notifier 6875 bl.length()=1015 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9e0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9e0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.967+0000 7f9e0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.968+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_sources= new_sources= 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.968+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential sources added=[] removed=[] 2024-09-12T17:42:34.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.968+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_dests= new_dests= 2024-09-12T17:42:34.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.968+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential dests added=[] removed=[] 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.0 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.0 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.1 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.1 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.2 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.2 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.3 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.3 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.4 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.4 2024-09-12T17:42:34.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.5 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.5 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.6 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.6 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.7 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.7 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.8 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.8 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.9 2024-09-12T17:42:34.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.9 2024-09-12T17:42:34.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.10 2024-09-12T17:42:34.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.10 2024-09-12T17:42:34.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.11 2024-09-12T17:42:34.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2.11 2024-09-12T17:42:34.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.0 2024-09-12T17:42:34.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.973+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1 2024-09-12T17:42:34.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.974+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2 2024-09-12T17:42:34.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.974+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.3 2024-09-12T17:42:34.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.975+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.4 2024-09-12T17:42:34.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.975+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.5 2024-09-12T17:42:34.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.975+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.6 2024-09-12T17:42:34.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.976+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.7 2024-09-12T17:42:34.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.976+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.8 2024-09-12T17:42:34.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.977+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.9 2024-09-12T17:42:34.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.978+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.10 2024-09-12T17:42:34.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.980+0000 7f9f3b240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:34.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.980+0000 7f9f3b240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 2024-09-12T17:42:34.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31, ofs0, ns] 2024-09-12T17:42:34.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9e0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94492946237488 notifier 6875 bl.length()=1015 2024-09-12T17:42:34.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9e0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9e0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9e0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_sources= new_sources= 2024-09-12T17:42:34.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential sources added=[] removed=[] 2024-09-12T17:42:34.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_dests= new_dests= 2024-09-12T17:42:34.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.982+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential dests added=[] removed=[] 2024-09-12T17:42:34.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.986+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.0 2024-09-12T17:42:34.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.987+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.1 2024-09-12T17:42:34.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.987+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.2 2024-09-12T17:42:34.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.987+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.3 2024-09-12T17:42:34.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.988+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.4 2024-09-12T17:42:34.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.988+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.5 2024-09-12T17:42:34.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.988+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.6 2024-09-12T17:42:34.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.988+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.7 2024-09-12T17:42:34.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.989+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.8 2024-09-12T17:42:34.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.989+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.9 2024-09-12T17:42:34.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.990+0000 7f9f3b240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31.10 2024-09-12T17:42:34.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.990+0000 7f9f3b240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:34.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.990+0000 7f9f3b240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 2024-09-12T17:42:34.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.991+0000 7f9f3b240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.991+0000 7f9f3b240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.991+0000 7f9f3b240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.991+0000 7f9f3b240800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31, ofs0, ns] 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9e0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 94492946237488 notifier 6875 bl.length()=983 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9e0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 info.flags=0x17 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9e0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 to cache LRU end 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9e0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_sources= new_sources= 2024-09-12T17:42:34.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential sources added=[] removed=[] 2024-09-12T17:42:34.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): orig_dests= new_dests= 2024-09-12T17:42:34.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.992+0000 7f9f3b240800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31]): potential dests added=[] removed=[] 2024-09-12T17:42:34.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.995+0000 7f9f3b240800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:42:34.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.996+0000 7f9deefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.998+0000 7f9f3b240800 20 remove_watcher() i=0 2024-09-12T17:42:34.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.998+0000 7f9f3b240800 2 removed watcher, disabling cache 2024-09-12T17:42:35.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:34.999+0000 7f9f3b240800 20 remove_watcher() i=1 2024-09-12T17:42:35.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.000+0000 7f9f3b240800 20 remove_watcher() i=2 2024-09-12T17:42:35.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.001+0000 7f9f3b240800 20 remove_watcher() i=3 2024-09-12T17:42:35.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.002+0000 7f9f3b240800 20 remove_watcher() i=4 2024-09-12T17:42:35.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.003+0000 7f9f3b240800 20 remove_watcher() i=5 2024-09-12T17:42:35.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.006+0000 7f9f3b240800 20 remove_watcher() i=6 2024-09-12T17:42:35.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.007+0000 7f9f3b240800 20 remove_watcher() i=7 2024-09-12T17:42:35.021 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:42:35.050 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:35.050 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:35.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.088+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.089+0000 7f5ac3d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.089+0000 7f5ac3d42800 20 realm 2024-09-12T17:42:35.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.089+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.090+0000 7f5ac3d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.090+0000 7f5ac3d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:35.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.090+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.090+0000 7f5ac3d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.090+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.091+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:35.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.091+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.091+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:35.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.091+0000 7f5ac3d42800 20 searching for the correct realm 2024-09-12T17:42:35.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.094+0000 7f5abf2ec640 0 -- 172.21.15.63:0/1331358903 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5ab408f040 msgr2=0x7f5ab408f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:35.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.299+0000 7f5abf2ec640 0 -- 172.21.15.63:0/1331358903 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5579e434fed0 msgr2=0x5579e4352300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.304 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.303+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 20 zone default found 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 4 Realm: () 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 20 zonegroup default 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.304+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.305+0000 7f5ac3d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.305+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.305+0000 7f5ac3d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.305+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.305+0000 7f5ac3d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.305+0000 7f5ac3d42800 20 started sync module instance, tier type = 2024-09-12T17:42:35.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.305+0000 7f5ac3d42800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:35.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.314+0000 7f5ac3d42800 20 add_watcher() i=0 2024-09-12T17:42:35.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.314+0000 7f5ac3d42800 20 add_watcher() i=1 2024-09-12T17:42:35.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.314+0000 7f5ac3d42800 20 add_watcher() i=2 2024-09-12T17:42:35.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.314+0000 7f5ac3d42800 20 add_watcher() i=3 2024-09-12T17:42:35.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.314+0000 7f5ac3d42800 20 add_watcher() i=4 2024-09-12T17:42:35.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.314+0000 7f5ac3d42800 20 add_watcher() i=5 2024-09-12T17:42:35.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.314+0000 7f5ac3d42800 20 add_watcher() i=6 2024-09-12T17:42:35.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.315+0000 7f5ac3d42800 20 add_watcher() i=7 2024-09-12T17:42:35.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.315+0000 7f5ac3d42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:35.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:35.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5ac3d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:35.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5ac3d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:35.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5ac3d42800 5 note: GC not initialized 2024-09-12T17:42:35.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5974fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:35.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5ac3d42800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:35.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5ac3d42800 20 Filter name: none 2024-09-12T17:42:35.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f58ee7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:35.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.317+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.318+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:35.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.318+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.318+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:35.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.318+0000 7f5ac3d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:35.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.318+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.319+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:35.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.319+0000 7f5ac3d42800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.319+0000 7f5ac3d42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:35.320 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.319+0000 7f5ac3d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:35.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.321+0000 7f5975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:35.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.323+0000 7f5ac3d42800 20 remove_watcher() i=0 2024-09-12T17:42:35.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.323+0000 7f5ac3d42800 2 removed watcher, disabling cache 2024-09-12T17:42:35.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.324+0000 7f5ac3d42800 20 remove_watcher() i=1 2024-09-12T17:42:35.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.325+0000 7f5ac3d42800 20 remove_watcher() i=2 2024-09-12T17:42:35.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.326+0000 7f5ac3d42800 20 remove_watcher() i=3 2024-09-12T17:42:35.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.327+0000 7f5ac3d42800 20 remove_watcher() i=4 2024-09-12T17:42:35.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.328+0000 7f5ac3d42800 20 remove_watcher() i=5 2024-09-12T17:42:35.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.329+0000 7f5ac3d42800 20 remove_watcher() i=6 2024-09-12T17:42:35.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.329+0000 7f5ac3d42800 20 remove_watcher() i=7 2024-09-12T17:42:35.341 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:35.342 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:35.342 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:42:35.342 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:35.416 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:42:35.416 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:35.627 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:42:35.656 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:35.657 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:35.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.694+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 20 realm 2024-09-12T17:42:35.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:35.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.696+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.697+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:35.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.697+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.697+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:35.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.697+0000 7f99b8e87800 20 searching for the correct realm 2024-09-12T17:42:35.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.700+0000 7f99b6170640 0 -- 172.21.15.63:0/2553033810 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f99ac082380 msgr2=0x7f99ac07a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:35.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.906+0000 7f99b7172640 0 -- 172.21.15.63:0/2553033810 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x558a510b78c0 msgr2=0x558a510b9cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:35.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:35.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:35.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:35.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:35.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:35.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:35.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.910+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 zone default found 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 4 Realm: () 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 zonegroup default 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.911+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.912+0000 7f99b8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:35.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.912+0000 7f99b8e87800 20 started sync module instance, tier type = 2024-09-12T17:42:35.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.912+0000 7f99b8e87800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:35.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.920+0000 7f99b8e87800 20 add_watcher() i=0 2024-09-12T17:42:35.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.920+0000 7f99b8e87800 20 add_watcher() i=1 2024-09-12T17:42:35.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.920+0000 7f99b8e87800 20 add_watcher() i=2 2024-09-12T17:42:35.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.920+0000 7f99b8e87800 20 add_watcher() i=3 2024-09-12T17:42:35.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.920+0000 7f99b8e87800 20 add_watcher() i=4 2024-09-12T17:42:35.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.920+0000 7f99b8e87800 20 add_watcher() i=5 2024-09-12T17:42:35.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.920+0000 7f99b8e87800 20 add_watcher() i=6 2024-09-12T17:42:35.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.921+0000 7f99b8e87800 20 add_watcher() i=7 2024-09-12T17:42:35.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.921+0000 7f99b8e87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:35.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.922+0000 7f986d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:35.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f99b8e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:35.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f99b8e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:35.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f99b8e87800 5 note: GC not initialized 2024-09-12T17:42:35.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f97e7fff640 20 reqs_thread_entry: start 2024-09-12T17:42:35.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f99b8e87800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:35.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f99b8e87800 20 Filter name: none 2024-09-12T17:42:35.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f97e5ffb640 20 reqs_thread_entry: start 2024-09-12T17:42:35.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.923+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.924+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:35.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.924+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.925+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:35.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.925+0000 7f99b8e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:35.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.925+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.925+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:35.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.925+0000 7f99b8e87800 20 rados->read ofs=0 len=0 2024-09-12T17:42:35.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.926+0000 7f99b8e87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:35.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.926+0000 7f99b8e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:35.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.927+0000 7f986d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:35.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.930+0000 7f99b8e87800 20 remove_watcher() i=0 2024-09-12T17:42:35.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.930+0000 7f99b8e87800 2 removed watcher, disabling cache 2024-09-12T17:42:35.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.931+0000 7f99b8e87800 20 remove_watcher() i=1 2024-09-12T17:42:35.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.932+0000 7f99b8e87800 20 remove_watcher() i=2 2024-09-12T17:42:35.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.933+0000 7f99b8e87800 20 remove_watcher() i=3 2024-09-12T17:42:35.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.934+0000 7f99b8e87800 20 remove_watcher() i=4 2024-09-12T17:42:35.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.935+0000 7f99b8e87800 20 remove_watcher() i=5 2024-09-12T17:42:35.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.936+0000 7f99b8e87800 20 remove_watcher() i=6 2024-09-12T17:42:35.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:35.937+0000 7f99b8e87800 20 remove_watcher() i=7 2024-09-12T17:42:35.948 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:35.948 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:35.949 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:35.949 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:35.950 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:42:35.987 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:35.987 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:36.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.028+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 20 realm 2024-09-12T17:42:36.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:36.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.030+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.031+0000 7fbbf6c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:36.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.031+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.031+0000 7fbbf6c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:36.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.031+0000 7fbbf6c0e800 20 searching for the correct realm 2024-09-12T17:42:36.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.035+0000 7fbbf1aca640 0 -- 172.21.15.63:0/766390651 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fbbdc090740 msgr2=0x7fbbdc0835b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:36.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.240+0000 7fbbf2acc640 0 -- 172.21.15.63:0/766390651 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x556aeb24fbb0 msgr2=0x556aeb252050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:36.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:36.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:36.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:36.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:36.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:36.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:36.245 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.244+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 zone default found 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 4 Realm: () 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:36.247 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 zonegroup default 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.245+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.246+0000 7fbbf6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.246+0000 7fbbf6c0e800 20 started sync module instance, tier type = 2024-09-12T17:42:36.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.246+0000 7fbbf6c0e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.254+0000 7fbbf6c0e800 20 add_watcher() i=0 2024-09-12T17:42:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.254+0000 7fbbf6c0e800 20 add_watcher() i=1 2024-09-12T17:42:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.254+0000 7fbbf6c0e800 20 add_watcher() i=2 2024-09-12T17:42:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.254+0000 7fbbf6c0e800 20 add_watcher() i=3 2024-09-12T17:42:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.254+0000 7fbbf6c0e800 20 add_watcher() i=4 2024-09-12T17:42:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.254+0000 7fbbf6c0e800 20 add_watcher() i=5 2024-09-12T17:42:36.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.254+0000 7fbbf6c0e800 20 add_watcher() i=6 2024-09-12T17:42:36.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.255+0000 7fbbf6c0e800 20 add_watcher() i=7 2024-09-12T17:42:36.256 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.255+0000 7fbbf6c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:36.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.257+0000 7fbaa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:36.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.257+0000 7fbbf6c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.257+0000 7fbbf6c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.257+0000 7fbbf6c0e800 5 note: GC not initialized 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.257+0000 7fba237fe640 20 reqs_thread_entry: start 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 20 Filter name: none 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fba217fa640 20 reqs_thread_entry: start 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:42:36.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:36.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:42:36.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:42:36.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 : miss 2024-09-12T17:42:36.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.258+0000 7fbbf6c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.259+0000 7fbbf6c0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:36.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.259+0000 7fbbf6c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 info.flags=0x17 2024-09-12T17:42:36.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.259+0000 7fbbf6c0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 to cache LRU end 2024-09-12T17:42:36.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.259+0000 7fbbf6c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:36.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.259+0000 7fbbf6c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:36.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.259+0000 7fbbf6c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 2024-09-12T17:42:36.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.263+0000 7fbbf6c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 info.flags=0x17 2024-09-12T17:42:36.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.263+0000 7fbbf6c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 to cache LRU end 2024-09-12T17:42:36.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.263+0000 7fbbf6c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:36.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.263+0000 7fbbf6c0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32, ofs0, ns] 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbad57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431644 cookie 93917700015984 notifier 6923 bl.length()=1015 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbad57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 info.flags=0x17 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbad57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 to cache LRU end 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbad57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): orig_sources= new_sources= 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): potential sources added=[] removed=[] 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): orig_dests= new_dests= 2024-09-12T17:42:36.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.264+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): potential dests added=[] removed=[] 2024-09-12T17:42:36.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.0 2024-09-12T17:42:36.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.0 2024-09-12T17:42:36.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.1 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.1 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.2 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.2 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.3 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.3 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.4 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.4 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.5 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.5 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.6 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.6 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.7 2024-09-12T17:42:36.270 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.7 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.8 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.8 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.9 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.9 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.10 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.10 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.11 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1.11 2024-09-12T17:42:36.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.268+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.0 2024-09-12T17:42:36.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.269+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1 2024-09-12T17:42:36.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.269+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.2 2024-09-12T17:42:36.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.270+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.3 2024-09-12T17:42:36.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.270+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.4 2024-09-12T17:42:36.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.271+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.5 2024-09-12T17:42:36.272 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.271+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.6 2024-09-12T17:42:36.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.272+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.7 2024-09-12T17:42:36.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.272+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.8 2024-09-12T17:42:36.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.273+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.9 2024-09-12T17:42:36.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.274+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.10 2024-09-12T17:42:36.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.277+0000 7fbbf6c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:36.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.277+0000 7fbbf6c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 info.flags=0x17 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 to cache LRU end 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32, ofs0, ns] 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbad57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 93917700015984 notifier 6923 bl.length()=1015 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbad57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 info.flags=0x17 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbad57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 to cache LRU end 2024-09-12T17:42:36.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbad57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:36.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): orig_sources= new_sources= 2024-09-12T17:42:36.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): potential sources added=[] removed=[] 2024-09-12T17:42:36.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): orig_dests= new_dests= 2024-09-12T17:42:36.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.278+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): potential dests added=[] removed=[] 2024-09-12T17:42:36.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.281+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.0 2024-09-12T17:42:36.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.281+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.1 2024-09-12T17:42:36.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.281+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.2 2024-09-12T17:42:36.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.282+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.3 2024-09-12T17:42:36.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.282+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.4 2024-09-12T17:42:36.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.282+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.5 2024-09-12T17:42:36.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.283+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.6 2024-09-12T17:42:36.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.283+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.7 2024-09-12T17:42:36.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.283+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.8 2024-09-12T17:42:36.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.283+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.9 2024-09-12T17:42:36.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.284+0000 7fbbf6c0e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32.10 2024-09-12T17:42:36.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.284+0000 7fbbf6c0e800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:42:36.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.284+0000 7fbbf6c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:36.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.284+0000 7fbbf6c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 info.flags=0x17 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 to cache LRU end 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32, ofs0, ns] 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbad57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431646 cookie 93917700015984 notifier 6923 bl.length()=983 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbad57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 info.flags=0x17 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbad57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 to cache LRU end 2024-09-12T17:42:36.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbad57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:36.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): orig_sources= new_sources= 2024-09-12T17:42:36.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): potential sources added=[] removed=[] 2024-09-12T17:42:36.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): orig_dests= new_dests= 2024-09-12T17:42:36.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.286+0000 7fbbf6c0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32]): potential dests added=[] removed=[] 2024-09-12T17:42:36.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.288+0000 7fbbf6c0e800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:42:36.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.290+0000 7fbaa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:36.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.292+0000 7fbbf6c0e800 20 remove_watcher() i=0 2024-09-12T17:42:36.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.292+0000 7fbbf6c0e800 2 removed watcher, disabling cache 2024-09-12T17:42:36.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.293+0000 7fbbf6c0e800 20 remove_watcher() i=1 2024-09-12T17:42:36.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.294+0000 7fbbf6c0e800 20 remove_watcher() i=2 2024-09-12T17:42:36.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.295+0000 7fbbf6c0e800 20 remove_watcher() i=3 2024-09-12T17:42:36.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.296+0000 7fbbf6c0e800 20 remove_watcher() i=4 2024-09-12T17:42:36.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.297+0000 7fbbf6c0e800 20 remove_watcher() i=5 2024-09-12T17:42:36.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.298+0000 7fbbf6c0e800 20 remove_watcher() i=6 2024-09-12T17:42:36.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.299+0000 7fbbf6c0e800 20 remove_watcher() i=7 2024-09-12T17:42:36.312 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:42:36.341 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:36.341 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:36.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.379+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.380+0000 7f69bb125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.380+0000 7f69bb125800 20 realm 2024-09-12T17:42:36.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.380+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.381+0000 7f69bb125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.381+0000 7f69bb125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:36.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.381+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.381+0000 7f69bb125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.381+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.381+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:36.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.381+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.382+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:36.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.382+0000 7f69bb125800 20 searching for the correct realm 2024-09-12T17:42:36.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.385+0000 7f69b6532640 0 -- 172.21.15.63:0/669822745 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f69ac0860c0 msgr2=0x7f69ac08f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:36.590 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.590+0000 7f69b7534640 0 -- 172.21.15.63:0/669822745 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x555a3e177230 msgr2=0x555a3e1796a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:36.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:36.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:36.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:36.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:36.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:36.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:36.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.594+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:36.596 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:36.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 zone default found 2024-09-12T17:42:36.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 4 Realm: () 2024-09-12T17:42:36.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:36.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:36.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:36.597 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 zonegroup default 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.595+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.596+0000 7f69bb125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.596+0000 7f69bb125800 20 started sync module instance, tier type = 2024-09-12T17:42:36.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.596+0000 7f69bb125800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:36.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=0 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=1 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=2 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=3 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=4 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=5 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=6 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 20 add_watcher() i=7 2024-09-12T17:42:36.606 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.605+0000 7f69bb125800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:36.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.607+0000 7f686d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:36.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f69bb125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:36.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f69bb125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:36.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f69bb125800 5 note: GC not initialized 2024-09-12T17:42:36.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f67e7fff640 20 reqs_thread_entry: start 2024-09-12T17:42:36.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f69bb125800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:36.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f69bb125800 20 Filter name: none 2024-09-12T17:42:36.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f67e5ffb640 20 reqs_thread_entry: start 2024-09-12T17:42:36.610 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.608+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.609+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.609+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.609+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.609+0000 7f69bb125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.609+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.609+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.609+0000 7f69bb125800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.610+0000 7f69bb125800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:36.611 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.610+0000 7f69bb125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:36.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.611+0000 7f686d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:36.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.614+0000 7f69bb125800 20 remove_watcher() i=0 2024-09-12T17:42:36.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.614+0000 7f69bb125800 2 removed watcher, disabling cache 2024-09-12T17:42:36.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.615+0000 7f69bb125800 20 remove_watcher() i=1 2024-09-12T17:42:36.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.616+0000 7f69bb125800 20 remove_watcher() i=2 2024-09-12T17:42:36.618 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.617+0000 7f69bb125800 20 remove_watcher() i=3 2024-09-12T17:42:36.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.618+0000 7f69bb125800 20 remove_watcher() i=4 2024-09-12T17:42:36.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.619+0000 7f69bb125800 20 remove_watcher() i=5 2024-09-12T17:42:36.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.620+0000 7f69bb125800 20 remove_watcher() i=6 2024-09-12T17:42:36.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.621+0000 7f69bb125800 20 remove_watcher() i=7 2024-09-12T17:42:36.633 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:36.633 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:36.633 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:42:36.633 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:36.709 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:42:36.709 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:36.928 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:42:36.957 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:36.957 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:36.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.994+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.996+0000 7f2f37540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.996+0000 7f2f37540800 20 realm 2024-09-12T17:42:36.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.996+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.996+0000 7f2f37540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.996+0000 7f2f37540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:36.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.996+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.997+0000 7f2f37540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:36.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.997+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.997+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:36.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.997+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:36.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.998+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:36.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:36.998+0000 7f2f37540800 20 searching for the correct realm 2024-09-12T17:42:37.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.001+0000 7f2f32abf640 0 -- 172.21.15.63:0/1998586295 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f2f28009620 msgr2=0x7f2f2807b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.206+0000 7f2f33ac1640 0 -- 172.21.15.63:0/1998586295 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561cbf27e600 msgr2=0x561cbf280a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:37.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:37.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:37.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:37.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:37.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:37.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.210+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 zone default found 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 4 Realm: () 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:37.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 zonegroup default 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.211+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.212+0000 7f2f37540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.212+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.212+0000 7f2f37540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.212+0000 7f2f37540800 20 started sync module instance, tier type = 2024-09-12T17:42:37.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.212+0000 7f2f37540800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:37.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.220+0000 7f2f37540800 20 add_watcher() i=0 2024-09-12T17:42:37.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.220+0000 7f2f37540800 20 add_watcher() i=1 2024-09-12T17:42:37.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.220+0000 7f2f37540800 20 add_watcher() i=2 2024-09-12T17:42:37.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.220+0000 7f2f37540800 20 add_watcher() i=3 2024-09-12T17:42:37.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.220+0000 7f2f37540800 20 add_watcher() i=4 2024-09-12T17:42:37.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.220+0000 7f2f37540800 20 add_watcher() i=5 2024-09-12T17:42:37.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.220+0000 7f2f37540800 20 add_watcher() i=6 2024-09-12T17:42:37.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.221+0000 7f2f37540800 20 add_watcher() i=7 2024-09-12T17:42:37.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.221+0000 7f2f37540800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:37.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.223+0000 7f2de9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.223+0000 7f2f37540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.223+0000 7f2f37540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.223+0000 7f2f37540800 5 note: GC not initialized 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.223+0000 7f2de8fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.224+0000 7f2f37540800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.224+0000 7f2f37540800 20 Filter name: none 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.224+0000 7f2d627fc640 20 reqs_thread_entry: start 2024-09-12T17:42:37.225 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.224+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.225+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:37.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.225+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.225+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:37.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.225+0000 7f2f37540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:37.226 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.225+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.226+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:37.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.226+0000 7f2f37540800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.226+0000 7f2f37540800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:37.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.226+0000 7f2f37540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:37.228 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.228+0000 7f2de9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:37.230 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.230+0000 7f2f37540800 20 remove_watcher() i=0 2024-09-12T17:42:37.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.230+0000 7f2f37540800 2 removed watcher, disabling cache 2024-09-12T17:42:37.231 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.231+0000 7f2f37540800 20 remove_watcher() i=1 2024-09-12T17:42:37.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.232+0000 7f2f37540800 20 remove_watcher() i=2 2024-09-12T17:42:37.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.233+0000 7f2f37540800 20 remove_watcher() i=3 2024-09-12T17:42:37.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.234+0000 7f2f37540800 20 remove_watcher() i=4 2024-09-12T17:42:37.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.235+0000 7f2f37540800 20 remove_watcher() i=5 2024-09-12T17:42:37.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.236+0000 7f2f37540800 20 remove_watcher() i=6 2024-09-12T17:42:37.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.237+0000 7f2f37540800 20 remove_watcher() i=7 2024-09-12T17:42:37.248 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.249 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:37.249 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:37.249 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.250 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:42:37.285 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:37.285 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:37.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.323+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 20 realm 2024-09-12T17:42:37.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:37.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.325+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.325+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.326+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:37.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.326+0000 7f02ef93e800 20 searching for the correct realm 2024-09-12T17:42:37.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.329+0000 7f02eae85640 0 -- 172.21.15.63:0/543563970 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f02e0024410 msgr2=0x7f02e0024850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.332+0000 7f02eb686640 0 -- 172.21.15.63:0/543563970 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f02e4093750 msgr2=0x7f02e40921c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:37.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:37.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 zone default found 2024-09-12T17:42:37.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 4 Realm: () 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 zonegroup default 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.338+0000 7f02ef93e800 20 started sync module instance, tier type = 2024-09-12T17:42:37.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.338+0000 7f02ef93e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:37.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=0 2024-09-12T17:42:37.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=1 2024-09-12T17:42:37.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=2 2024-09-12T17:42:37.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=3 2024-09-12T17:42:37.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=4 2024-09-12T17:42:37.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=5 2024-09-12T17:42:37.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=6 2024-09-12T17:42:37.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.347+0000 7f02ef93e800 20 add_watcher() i=7 2024-09-12T17:42:37.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.347+0000 7f02ef93e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:37.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.348+0000 7f01a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:37.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:37.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:37.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f02ef93e800 5 note: GC not initialized 2024-09-12T17:42:37.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f01a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:37.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f02ef93e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:37.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f02ef93e800 20 Filter name: none 2024-09-12T17:42:37.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f011a7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:37.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:42:37.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:37.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : miss 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.350+0000 7f02ef93e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94008927042256 notifier 7398 bl.length()=1015 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:42:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:42:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:42:37.358 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:42:37.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:42:37.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:42:37.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:42:37.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:42:37.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.361+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:42:37.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.361+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:42:37.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.362+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:42:37.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:42:37.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:42:37.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:42:37.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.364+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:42:37.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.364+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:42:37.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.365+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:42:37.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.365+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:42:37.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.368+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:37.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.368+0000 7f02ef93e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:42:37.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.369+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.369+0000 7f02ef93e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.369+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.369+0000 7f02ef93e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:42:37.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94008927042256 notifier 7398 bl.length()=1015 2024-09-12T17:42:37.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:42:37.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:42:37.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:42:37.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:42:37.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.372+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:42:37.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.372+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:42:37.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:42:37.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:42:37.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:42:37.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:42:37.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:42:37.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:42:37.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:42:37.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.375+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:42:37.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.375+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:42:37.376 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef93e800 time 2024-09-12T17:42:37.376725+0000 2024-09-12T17:42:37.376 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:37.377 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.377 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02f118c71a] 2024-09-12T17:42:37.377 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.377 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.377 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.377 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.376+0000 7f02ef93e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef93e800 time 2024-09-12T17:42:37.376725+0000 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02f118c71a] 2024-09-12T17:42:37.378 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:42:37.379 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f02ef93e800 thread_name:radosgw-admin 2024-09-12T17:42:37.401 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.401 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02efe3e6f0] 2024-09-12T17:42:37.401 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02efe8b99c] 2024-09-12T17:42:37.401 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02f118c774] 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.377+0000 7f02ef93e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f02ef93e800 thread_name:radosgw-admin 2024-09-12T17:42:37.402 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02efe3e6f0] 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02efe8b99c] 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02f118c774] 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.403 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x5580288f85a0 auth_method 0 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.404 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x5580288fb640 auth_method 0 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:42:37.308+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:42:37.308+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:42:37.308+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.405 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:42:37.308+0000 7f02ebe87640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:42:37.308+0000 7f02ebe87640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:42:37.308+0000 7f02ebe87640 1 monclient: found mon.noname-c 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:42:37.308+0000 7f02ebe87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: dump: 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.406 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:42:37.308+0000 7f02ef93e800 5 monclient: authenticate success, global_id 6965 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:37.407 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: dump: 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:42:37.308+0000 7f01d960a640 4 set_mon_vals no callback set 2024-09-12T17:42:37.408 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:42:37.308+0000 7f02ef93e800 1 librados: init done 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:42:37.310+0000 7f01d7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:42:37.310+0000 7f01d7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:42:37.310+0000 7f01d7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:42:37.310+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f01d0076470 auth_method 0 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:42:37.310+0000 7f02eae85640 10 monclient: get_auth_request con 0x558028a6c3a0 auth_method 0 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:42:37.311+0000 7f02eb686640 10 monclient: get_auth_request con 0x558028a8f200 auth_method 0 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:42:37.312+0000 7f02eae85640 10 monclient: get_auth_request con 0x558028a94290 auth_method 0 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:42:37.313+0000 7f02ef93e800 10 monclient: build_initial_monmap 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:42:37.313+0000 7f02ef93e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:37.409 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:42:37.313+0000 7f02ef93e800 10 monclient: monmap: 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding auth protocol: cephx 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding auth protocol: cephx 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding auth protocol: cephx 2024-09-12T17:42:37.410 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.411 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:42:37.313+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 asok(0x558028821730) register_command objecter_requests cmddesc objecter_requests hook 0x558028a9b630 EEXIST 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:42:37.313+0000 7f02ef93e800 10 monclient: init 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding auth protocol: cephx 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding auth protocol: cephx 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding auth protocol: cephx 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.412 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:42:37.314+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:42:37.314+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:42:37.314+0000 7f02ef93e800 5 asok(0x558028821730) register_command rotate-key cmddesc rotate-key hook 0x558028a972a0 EEXIST 2024-09-12T17:42:37.413 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-a con 0x558028abf950 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-b con 0x558028abfd30 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-c con 0x558028abe660 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): authenticate will time out at 2049.829505s 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): get_auth_request con 0x558028abe660 auth_method 0 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.414 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x558028abf950 auth_method 0 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x558028abfd30 auth_method 0 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.415 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_done global_id 6968 payload 824 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:42:37.314+0000 7f02ebe87640 1 monclient: found mon.noname-c 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: dump: 2024-09-12T17:42:37.416 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:42:37.315+0000 7f02ef93e800 5 monclient: authenticate success, global_id 6968 2024-09-12T17:42:37.417 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: dump: 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.418 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:42:37.315+0000 7f02ec688640 4 set_mon_vals no callback set 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:42:37.316+0000 7f01d5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:42:37.316+0000 7f01d5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:42:37.316+0000 7f01d5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:42:37.317+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f01c4076380 auth_method 0 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: get_monmap_and_config 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: build_initial_monmap 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:42:37.317+0000 7f02ef93e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:37.419 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: monmap: 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding auth protocol: cephx 2024-09-12T17:42:37.420 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding auth protocol: cephx 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding auth protocol: cephx 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.421 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:42:37.317+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: init 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding auth protocol: cephx 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding auth protocol: cephx 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding auth protocol: cephx 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.422 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:42:37.317+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:42:37.318+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:42:37.318+0000 7f02ef93e800 5 asok(0x558028821730) register_command rotate-key cmddesc rotate-key hook 0x7ffd35fc0258 EEXIST 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-a con 0x558028b13b60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-c con 0x558028b044b0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-b con 0x558028b0ef90 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:37.423 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): authenticate will time out at 2049.833213s 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x558028b13b60 auth_method 0 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x558028b044b0 auth_method 0 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.424 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_done global_id 7395 payload 274 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:42:37.318+0000 7f02eb686640 1 monclient: found mon.noname-a 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:42:37.318+0000 7f02ebe87640 10 monclient: get_auth_request con 0x558028b0ef90 auth_method 0 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:37.425 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: dump: 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.426 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:42:37.318+0000 7f02ef93e800 5 monclient: authenticate success, global_id 7395 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:42:37.318+0000 7f02ef93e800 4 set_mon_vals no callback set 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: dump: 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.427 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:42:37.319+0000 7f02ef93e800 10 monclient: shutdown 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:42:37.319+0000 7f02ef93e800 10 monclient: build_initial_monmap 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:42:37.319+0000 7f02ef93e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:42:37.319+0000 7f02ef93e800 10 monclient: monmap: 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:37.428 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding auth protocol: cephx 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding auth protocol: cephx 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding auth protocol: cephx 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.429 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:42:37.319+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:42:37.319+0000 7f02ef93e800 1 librados: starting msgr at 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:42:37.319+0000 7f02ef93e800 1 librados: starting objecter 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 asok(0x558028821730) register_command objecter_requests cmddesc objecter_requests hook 0x558028abee10 EEXIST 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:42:37.320+0000 7f02ef93e800 1 librados: setting wanted keys 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:42:37.320+0000 7f02ef93e800 1 librados: calling monclient init 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient: init 2024-09-12T17:42:37.430 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding auth protocol: cephx 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding auth protocol: cephx 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding auth protocol: cephx 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.431 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:42:37.320+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:42:37.320+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 asok(0x558028821730) register_command rotate-key cmddesc rotate-key hook 0x558028ad4358 EEXIST 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-a con 0x558028b044b0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-b con 0x558028b0ef90 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-c con 0x558028b13b60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.432 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): authenticate will time out at 2049.835595s 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x558028b044b0 auth_method 0 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): get_auth_request con 0x558028b13b60 auth_method 0 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.433 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x558028b0ef90 auth_method 0 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:42:37.320+0000 7f02eb686640 1 monclient: found mon.noname-a 2024-09-12T17:42:37.434 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: dump: 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.435 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: dump: 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.436 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:42:37.321+0000 7f02ef93e800 5 monclient: authenticate success, global_id 7398 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:42:37.321+0000 7f01ceffd640 4 set_mon_vals no callback set 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:42:37.321+0000 7f02ef93e800 1 librados: init done 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:42:37.321+0000 7f02ef93e800 5 asok(0x558028821730) register_command cr dump hook 0x558028b1e708 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:42:37.323+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.437 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:42:37.323+0000 7f01cd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:42:37.323+0000 7f01cd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:42:37.323+0000 7f01cd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:42:37.323+0000 7f02eae85640 10 monclient: get_auth_request con 0x7f01b4076470 auth_method 0 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:42:37.324+0000 7f02ebe87640 10 monclient: get_auth_request con 0x558028b2e050 auth_method 0 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 realm 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:42:37.324+0000 7f02ef93e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.438 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:42:37.325+0000 7f02eb686640 10 monclient: get_auth_request con 0x558028b32270 auth_method 0 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:42:37.325+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:42:37.325+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:42:37.326+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:42:37.326+0000 7f02ef93e800 20 searching for the correct realm 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:42:37.326+0000 7f02eae85640 10 monclient: get_auth_request con 0x558028b37530 auth_method 0 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:42:37.326+0000 7f02ebe87640 10 monclient: get_auth_request con 0x7f02e0025b30 auth_method 0 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:42:37.327+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f02dc07d030 auth_method 0 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:42:37.328+0000 7f02eae85640 10 monclient: get_auth_request con 0x7f02e0024410 auth_method 0 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:42:37.329+0000 7f02eae85640 0 -- 172.21.15.63:0/543563970 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f02e0024410 msgr2=0x7f02e0024850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:42:37.329+0000 7f01cd7fa640 1 client.7398.objecter ms_handle_reset 0x7f02e0024410 session 0x7f02e001bde0 osd.5 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:42:37.329+0000 7f01cd7fa640 10 monclient: _renew_subs 2024-09-12T17:42:37.439 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:42:37.329+0000 7f01cd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:42:37.329+0000 7f02eae85640 10 monclient: get_auth_request con 0x7f01b4086790 auth_method 0 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:42:37.330+0000 7f02ebe87640 10 monclient: get_auth_request con 0x7f02dc0e0b80 auth_method 0 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:42:37.331+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f02e4093750 auth_method 0 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:42:37.332+0000 7f02eb686640 0 -- 172.21.15.63:0/543563970 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f02e4093750 msgr2=0x7f02e40921c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:42:37.332+0000 7f01cd7fa640 1 client.7398.objecter ms_handle_reset 0x7f02e4093750 session 0x7f02e40934f0 osd.3 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:42:37.332+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f02e0024410 auth_method 0 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:37.440 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 zone default found 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:42:37.337+0000 7f02ef93e800 4 Realm: () 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:42:37.337+0000 7f02ef93e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:42:37.337+0000 7f02ef93e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:42:37.337+0000 7f02ef93e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 zonegroup default 2024-09-12T17:42:37.441 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 started sync module instance, tier type = 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=0 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=1 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=2 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=3 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=4 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=5 2024-09-12T17:42:37.442 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=6 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:42:37.347+0000 7f02ef93e800 20 add_watcher() i=7 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:42:37.347+0000 7f02ef93e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding auth protocol: cephx 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding auth protocol: cephx 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding auth protocol: cephx 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.443 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.444 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:42:37.348+0000 7f01a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:42:37.349+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache list hook 0x558028b0bae0 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache inspect hook 0x558028b0bae0 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache erase hook 0x558028b0bae0 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache zap hook 0x558028b0bae0 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 note: GC not initialized 2024-09-12T17:42:37.445 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:42:37.349+0000 7f01a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace show hook 0x7f02dc074050 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace history hook 0x7f02dc074050 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace active hook 0x7f02dc074050 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace active_short hook 0x7f02dc074050 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 Filter name: none 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:42:37.349+0000 7f011a7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:42:37.349+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:37.446 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : miss 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.447 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94008927042256 notifier 7398 bl.length()=1015 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:42:37.448 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:42:37.449 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:42:37.361+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:42:37.361+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:42:37.362+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:42:37.450 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:42:37.364+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:42:37.364+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:42:37.365+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:42:37.365+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:42:37.368+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:42:37.368+0000 7f02ef93e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94008927042256 notifier 7398 bl.length()=1015 2024-09-12T17:42:37.451 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:42:37.372+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:42:37.372+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:42:37.452 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:42:37.375+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:42:37.375+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:42:37.376+0000 7f02ef93e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef93e800 time 2024-09-12T17:42:37.376725+0000 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02f118c71a] 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.453 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:42:37.377+0000 7f02ef93e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f02ef93e800 thread_name:radosgw-admin 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02efe3e6f0] 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02efe8b99c] 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:37.454 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02f118c774] 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:42:37.455 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:42:37.456 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:42:37.457 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:42:37.458 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:42:37.459 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:42:37.460 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:42:37.461 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:42:37.462 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f011a7fc640 / http_manager 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01a0fe1640 / http_manager 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01a1fe3640 / rgw_dt_lg_renew 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01cd7fa640 / ms_dispatch 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01ceffd640 / io_context_pool 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01d5602640 / ms_dispatch 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01d7e07640 / ms_dispatch 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01d960a640 / io_context_pool 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02eae85640 / msgr-worker-2 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02eb686640 / msgr-worker-1 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02ebe87640 / msgr-worker-0 2024-09-12T17:42:37.463 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02ec688640 / io_context_pool 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02ef93e800 / radosgw-admin 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.123474.log 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x5580288f85a0 auth_method 0 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.464 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:42:37.307+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x5580288fb640 auth_method 0 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:42:37.307+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.465 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:42:37.307+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:42:37.308+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:42:37.308+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:42:37.308+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:42:37.308+0000 7f02ebe87640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:42:37.308+0000 7f02ebe87640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:42:37.308+0000 7f02ebe87640 1 monclient: found mon.noname-c 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:42:37.308+0000 7f02ebe87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.466 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: dump: 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.467 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:42:37.308+0000 7f02ef93e800 5 monclient: authenticate success, global_id 6965 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:42:37.308+0000 7f01d7e07640 10 monclient: dump: 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.468 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:42:37.308+0000 7f01d960a640 4 set_mon_vals no callback set 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:42:37.308+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:42:37.308+0000 7f02ef93e800 1 librados: init done 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:42:37.310+0000 7f01d7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:42:37.310+0000 7f01d7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.469 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:42:37.310+0000 7f01d7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:42:37.310+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f01d0076470 auth_method 0 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:42:37.310+0000 7f02eae85640 10 monclient: get_auth_request con 0x558028a6c3a0 auth_method 0 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:42:37.311+0000 7f02eb686640 10 monclient: get_auth_request con 0x558028a8f200 auth_method 0 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:42:37.312+0000 7f02eae85640 10 monclient: get_auth_request con 0x558028a94290 auth_method 0 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:42:37.313+0000 7f02ef93e800 10 monclient: build_initial_monmap 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:42:37.313+0000 7f02ef93e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:42:37.313+0000 7f02ef93e800 10 monclient: monmap: 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:37.470 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding auth protocol: cephx 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding auth protocol: cephx 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding auth protocol: cephx 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.471 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: crc 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a981a0) adding con mode: secure 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:42:37.313+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 asok(0x558028821730) register_command objecter_requests cmddesc objecter_requests hook 0x558028a9b630 EEXIST 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:42:37.313+0000 7f02ef93e800 10 monclient: init 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding auth protocol: cephx 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding auth protocol: cephx 2024-09-12T17:42:37.472 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding auth protocol: cephx 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: crc 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:42:37.313+0000 7f02ef93e800 5 AuthRegistry(0x558028a97158) adding con mode: secure 2024-09-12T17:42:37.473 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:42:37.314+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:42:37.314+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:42:37.314+0000 7f02ef93e800 5 asok(0x558028821730) register_command rotate-key cmddesc rotate-key hook 0x558028a972a0 EEXIST 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-a con 0x558028abf950 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-b con 0x558028abfd30 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-c con 0x558028abe660 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.474 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:42:37.314+0000 7f02ef93e800 10 monclient(hunting): authenticate will time out at 2049.829505s 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): get_auth_request con 0x558028abe660 auth_method 0 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x558028abf950 auth_method 0 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x558028abfd30 auth_method 0 2024-09-12T17:42:37.475 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:42:37.314+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:42:37.314+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.476 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient(hunting): handle_auth_done global_id 6968 payload 824 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:42:37.314+0000 7f02ebe87640 1 monclient: found mon.noname-c 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:42:37.314+0000 7f02ebe87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: dump: 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.477 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:42:37.315+0000 7f02ef93e800 5 monclient: authenticate success, global_id 6968 2024-09-12T17:42:37.478 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:42:37.315+0000 7f01d5602640 10 monclient: dump: 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.479 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:42:37.315+0000 7f02ec688640 4 set_mon_vals no callback set 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:42:37.315+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:42:37.316+0000 7f01d5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:42:37.316+0000 7f01d5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:42:37.316+0000 7f01d5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.480 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:42:37.317+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f01c4076380 auth_method 0 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: get_monmap_and_config 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: build_initial_monmap 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:42:37.317+0000 7f02ef93e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: monmap: 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:37.481 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding auth protocol: cephx 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding auth protocol: cephx 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding auth protocol: cephx 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.482 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: crc 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x558028adf580) adding con mode: secure 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:42:37.317+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:42:37.317+0000 7f02ef93e800 10 monclient: init 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding auth protocol: cephx 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding auth protocol: cephx 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding auth protocol: cephx 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.483 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: crc 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:42:37.317+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc0110) adding con mode: secure 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:42:37.317+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:42:37.318+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:42:37.318+0000 7f02ef93e800 5 asok(0x558028821730) register_command rotate-key cmddesc rotate-key hook 0x7ffd35fc0258 EEXIST 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:42:37.484 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-a con 0x558028b13b60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-c con 0x558028b044b0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-b con 0x558028b0ef90 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient(hunting): authenticate will time out at 2049.833213s 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x558028b13b60 auth_method 0 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x558028b044b0 auth_method 0 2024-09-12T17:42:37.485 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:42:37.318+0000 7f02eae85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient(hunting): handle_auth_done global_id 7395 payload 274 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:42:37.318+0000 7f02eb686640 1 monclient: found mon.noname-a 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:42:37.318+0000 7f02eb686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.486 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:42:37.318+0000 7f02ebe87640 10 monclient: get_auth_request con 0x558028b0ef90 auth_method 0 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: dump: 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.487 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:42:37.318+0000 7f02ef93e800 5 monclient: authenticate success, global_id 7395 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:42:37.318+0000 7f02ef93e800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:42:37.318+0000 7f02ef93e800 4 set_mon_vals no callback set 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:42:37.318+0000 7f01ceffd640 10 monclient: dump: 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:42:37.319+0000 7f02ef93e800 10 monclient: shutdown 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:42:37.319+0000 7f02ef93e800 10 monclient: build_initial_monmap 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:42:37.319+0000 7f02ef93e800 1 build_initial for_mkfs: 0 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:42:37.319+0000 7f02ef93e800 10 monclient: monmap: 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:42:37.489 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding auth protocol: cephx 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding auth protocol: cephx 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding auth protocol: cephx 2024-09-12T17:42:37.490 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.491 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: crc 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 AuthRegistry(0x558028ae30c0) adding con mode: secure 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:42:37.319+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:42:37.319+0000 7f02ef93e800 1 librados: starting msgr at 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:42:37.319+0000 7f02ef93e800 1 librados: starting objecter 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:42:37.319+0000 7f02ef93e800 5 asok(0x558028821730) register_command objecter_requests cmddesc objecter_requests hook 0x558028abee10 EEXIST 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:42:37.320+0000 7f02ef93e800 1 librados: setting wanted keys 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:42:37.320+0000 7f02ef93e800 1 librados: calling monclient init 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient: init 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding auth protocol: cephx 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding auth protocol: cephx 2024-09-12T17:42:37.492 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding auth protocol: cephx 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: crc 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 AuthRegistry(0x558028ad4210) adding con mode: secure 2024-09-12T17:42:37.493 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:42:37.320+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:42:37.320+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:42:37.320+0000 7f02ef93e800 5 asok(0x558028821730) register_command rotate-key cmddesc rotate-key hook 0x558028ad4358 EEXIST 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-a con 0x558028b044b0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-b con 0x558028b0ef90 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): picked mon.noname-c con 0x558028b13b60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:37.494 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:42:37.320+0000 7f02ef93e800 10 monclient(hunting): authenticate will time out at 2049.835595s 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): get_auth_request con 0x558028b044b0 auth_method 0 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): get_auth_request con 0x558028b13b60 auth_method 0 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:37.495 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:42:37.320+0000 7f02ebe87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): get_auth_request con 0x558028b0ef90 auth_method 0 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:42:37.320+0000 7f02eae85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient: _finish_hunting 0 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:42:37.320+0000 7f02eb686640 1 monclient: found mon.noname-a 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:42:37.320+0000 7f02eb686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:37.496 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: dump: 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: _finish_auth 0 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:42:37.497 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:42:37.321+0000 7f01cd7fa640 10 monclient: dump: 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:42:37.498 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:42:37.321+0000 7f02ef93e800 5 monclient: authenticate success, global_id 7398 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:42:37.321+0000 7f01ceffd640 4 set_mon_vals no callback set 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _renew_subs 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:42:37.321+0000 7f02ef93e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:42:37.321+0000 7f02ef93e800 1 librados: init done 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:42:37.321+0000 7f02ef93e800 5 asok(0x558028821730) register_command cr dump hook 0x558028b1e708 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:42:37.323+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:42:37.323+0000 7f01cd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:42:37.323+0000 7f01cd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.499 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:42:37.323+0000 7f01cd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:42:37.323+0000 7f02eae85640 10 monclient: get_auth_request con 0x7f01b4076470 auth_method 0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:42:37.324+0000 7f02ebe87640 10 monclient: get_auth_request con 0x558028b2e050 auth_method 0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 realm 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:42:37.324+0000 7f02ef93e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:42:37.324+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:42:37.325+0000 7f02eb686640 10 monclient: get_auth_request con 0x558028b32270 auth_method 0 2024-09-12T17:42:37.500 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:42:37.325+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:42:37.325+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:42:37.326+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:42:37.326+0000 7f02ef93e800 20 searching for the correct realm 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:42:37.326+0000 7f02eae85640 10 monclient: get_auth_request con 0x558028b37530 auth_method 0 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:42:37.326+0000 7f02ebe87640 10 monclient: get_auth_request con 0x7f02e0025b30 auth_method 0 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:42:37.327+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f02dc07d030 auth_method 0 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:42:37.328+0000 7f02eae85640 10 monclient: get_auth_request con 0x7f02e0024410 auth_method 0 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:42:37.329+0000 7f02eae85640 0 -- 172.21.15.63:0/543563970 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f02e0024410 msgr2=0x7f02e0024850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:42:37.329+0000 7f01cd7fa640 1 client.7398.objecter ms_handle_reset 0x7f02e0024410 session 0x7f02e001bde0 osd.5 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:42:37.329+0000 7f01cd7fa640 10 monclient: _renew_subs 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:42:37.329+0000 7f01cd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:42:37.329+0000 7f02eae85640 10 monclient: get_auth_request con 0x7f01b4086790 auth_method 0 2024-09-12T17:42:37.501 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:42:37.330+0000 7f02ebe87640 10 monclient: get_auth_request con 0x7f02dc0e0b80 auth_method 0 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:42:37.331+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f02e4093750 auth_method 0 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:42:37.332+0000 7f02eb686640 0 -- 172.21.15.63:0/543563970 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f02e4093750 msgr2=0x7f02e40921c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:42:37.332+0000 7f01cd7fa640 1 client.7398.objecter ms_handle_reset 0x7f02e4093750 session 0x7f02e40934f0 osd.3 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:42:37.332+0000 7f02eb686640 10 monclient: get_auth_request con 0x7f02e0024410 auth_method 0 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.502 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:42:37.336+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 zone default found 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:42:37.337+0000 7f02ef93e800 4 Realm: () 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:42:37.337+0000 7f02ef93e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:42:37.337+0000 7f02ef93e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:42:37.337+0000 7f02ef93e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 zonegroup default 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.503 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:42:37.337+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 started sync module instance, tier type = 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:42:37.338+0000 7f02ef93e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=0 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=1 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=2 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=3 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=4 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=5 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:42:37.346+0000 7f02ef93e800 20 add_watcher() i=6 2024-09-12T17:42:37.504 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:42:37.347+0000 7f02ef93e800 20 add_watcher() i=7 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:42:37.347+0000 7f02ef93e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding auth protocol: cephx 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding auth protocol: cephx 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding auth protocol: cephx 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.505 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: crc 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:42:37.348+0000 7f02ef93e800 5 AuthRegistry(0x7ffd35fc05e0) adding con mode: secure 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:42:37.348+0000 7f01a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:42:37.349+0000 7f02ef93e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache list hook 0x558028b0bae0 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache inspect hook 0x558028b0bae0 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache erase hook 0x558028b0bae0 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command cache zap hook 0x558028b0bae0 2024-09-12T17:42:37.506 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 note: GC not initialized 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:42:37.349+0000 7f01a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace show hook 0x7f02dc074050 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace history hook 0x7f02dc074050 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace active hook 0x7f02dc074050 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:42:37.349+0000 7f02ef93e800 5 asok(0x558028821730) register_command sync trace active_short hook 0x7f02dc074050 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 Filter name: none 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:42:37.349+0000 7f011a7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:42:37.349+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:42:37.349+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:42:37.507 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : miss 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:42:37.350+0000 7f02ef93e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:42:37.350+0000 7f02ef93e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:42:37.356+0000 7f02ef93e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94008927042256 notifier 7398 bl.length()=1015 2024-09-12T17:42:37.508 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:42:37.356+0000 7f01ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:42:37.356+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:42:37.509 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:42:37.510 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:42:37.360+0000 7f02ef93e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:42:37.360+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:42:37.361+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:42:37.361+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:42:37.362+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:42:37.363+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:42:37.364+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:42:37.511 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:42:37.364+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:42:37.365+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:42:37.365+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:42:37.368+0000 7f02ef93e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:42:37.368+0000 7f02ef93e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:42:37.369+0000 7f02ef93e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94008927042256 notifier 7398 bl.length()=1015 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:42:37.370+0000 7f01ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:37.512 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:42:37.370+0000 7f02ef93e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:42:37.372+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:42:37.372+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:42:37.373+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:42:37.374+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:42:37.513 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:42:37.375+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:42:37.514 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:42:37.375+0000 7f02ef93e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:42:37.514 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:42:37.376+0000 7f02ef93e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef93e800 time 2024-09-12T17:42:37.376725+0000 2024-09-12T17:42:37.514 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:37.514 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.514 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.514 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02f118c71a] 2024-09-12T17:42:37.514 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:42:37.377+0000 7f02ef93e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f02ef93e800 thread_name:radosgw-admin 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02efe3e6f0] 2024-09-12T17:42:37.515 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02efe8b99c] 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02f118c774] 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02f118c8d8] 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580265c0841] 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5580265d0827] 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02efe29590] 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:37.516 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:42:37.517 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:42:37.518 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:42:37.519 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:42:37.520 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:42:37.521 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:42:37.522 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:42:37.523 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f011a7fc640 / http_manager 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01a0fe1640 / http_manager 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01a1fe3640 / rgw_dt_lg_renew 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01cd7fa640 / ms_dispatch 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01ceffd640 / io_context_pool 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01d5602640 / ms_dispatch 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01d7e07640 / ms_dispatch 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f01d960a640 / io_context_pool 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02eae85640 / msgr-worker-2 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02eb686640 / msgr-worker-1 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02ebe87640 / msgr-worker-0 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02ec688640 / io_context_pool 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi063.stderr: 7f02ef93e800 / radosgw-admin 2024-09-12T17:42:37.525 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:42:37.525 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:42:37.525 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:42:37.378151Z_8931454c-0524-4d46-811a-9476ba558932/log 2024-09-12T17:42:37.525 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:42:37.525 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:42:37.526 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:37.526 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:37.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.455+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 20 realm 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.457+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.458+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.458+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.458+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:37.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.458+0000 7fd64f119800 20 searching for the correct realm 2024-09-12T17:42:37.528 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.461+0000 7fd64c409640 0 -- 172.21.15.63:0/228430031 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fd64006f9c0 msgr2=0x7fd64006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.666+0000 7fd64d40b640 0 -- 172.21.15.63:0/228430031 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55c4c73aea50 msgr2=0x55c4c73b0e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.671 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.670+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 zone default found 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 4 Realm: () 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 zonegroup default 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 started sync module instance, tier type = 2024-09-12T17:42:37.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.671+0000 7fd64f119800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:42:37.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.680+0000 7fd64f119800 20 add_watcher() i=0 2024-09-12T17:42:37.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.680+0000 7fd64f119800 20 add_watcher() i=1 2024-09-12T17:42:37.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.680+0000 7fd64f119800 20 add_watcher() i=2 2024-09-12T17:42:37.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.680+0000 7fd64f119800 20 add_watcher() i=3 2024-09-12T17:42:37.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.680+0000 7fd64f119800 20 add_watcher() i=4 2024-09-12T17:42:37.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.680+0000 7fd64f119800 20 add_watcher() i=5 2024-09-12T17:42:37.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.680+0000 7fd64f119800 20 add_watcher() i=6 2024-09-12T17:42:37.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.681+0000 7fd64f119800 20 add_watcher() i=7 2024-09-12T17:42:37.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.681+0000 7fd64f119800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:37.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd502fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:37.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd64f119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:37.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd64f119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:37.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd64f119800 5 note: GC not initialized 2024-09-12T17:42:37.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd501fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:37.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd64f119800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:37.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd64f119800 20 Filter name: none 2024-09-12T17:42:37.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd4737fe640 20 reqs_thread_entry: start 2024-09-12T17:42:37.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.683+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.684+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.684+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.684+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.684+0000 7fd64f119800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.684+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.685+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.685+0000 7fd64f119800 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.685+0000 7fd64f119800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:42:37.686 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.685+0000 7fd64f119800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:37.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.687+0000 7fd502fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:37.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.689+0000 7fd64f119800 20 remove_watcher() i=0 2024-09-12T17:42:37.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.689+0000 7fd64f119800 2 removed watcher, disabling cache 2024-09-12T17:42:37.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.690+0000 7fd64f119800 20 remove_watcher() i=1 2024-09-12T17:42:37.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.691+0000 7fd64f119800 20 remove_watcher() i=2 2024-09-12T17:42:37.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.692+0000 7fd64f119800 20 remove_watcher() i=3 2024-09-12T17:42:37.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.693+0000 7fd64f119800 20 remove_watcher() i=4 2024-09-12T17:42:37.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.694+0000 7fd64f119800 20 remove_watcher() i=5 2024-09-12T17:42:37.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.695+0000 7fd64f119800 20 remove_watcher() i=6 2024-09-12T17:42:37.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:42:37.696+0000 7fd64f119800 20 remove_watcher() i=7 2024-09-12T17:42:37.708 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:42:37.708 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:42:37.708 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:37.708 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:07.796 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:07.832 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:07.832 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:07.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.875+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.876+0000 7f9e0313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.876+0000 7f9e0313d800 20 realm 2024-09-12T17:43:07.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.876+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.876+0000 7f9e0313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.876+0000 7f9e0313d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:07.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.876+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.877+0000 7f9e0313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.877+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.877+0000 7f9e0313d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:07.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.877+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.878+0000 7f9e0313d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:07.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.878+0000 7f9e0313d800 20 searching for the correct realm 2024-09-12T17:43:07.881 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.880+0000 7f9dff62b640 0 -- 172.21.15.63:0/358131955 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55c1b2cdac50 msgr2=0x55c1b2cdd070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:07.885 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.884+0000 7f9dfee2a640 0 -- 172.21.15.63:0/358131955 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x55c1b2cdefd0 msgr2=0x55c1b2ce13c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.892 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:07.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.890+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:07.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 zone default found 2024-09-12T17:43:07.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 4 Realm: () 2024-09-12T17:43:07.894 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 zonegroup default 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.891+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.892+0000 7f9e0313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.892+0000 7f9e0313d800 20 started sync module instance, tier type = 2024-09-12T17:43:07.895 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.892+0000 7f9e0313d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:07.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.901+0000 7f9e0313d800 20 add_watcher() i=0 2024-09-12T17:43:07.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.901+0000 7f9e0313d800 20 add_watcher() i=1 2024-09-12T17:43:07.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.901+0000 7f9e0313d800 20 add_watcher() i=2 2024-09-12T17:43:07.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.901+0000 7f9e0313d800 20 add_watcher() i=3 2024-09-12T17:43:07.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.901+0000 7f9e0313d800 20 add_watcher() i=4 2024-09-12T17:43:07.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.901+0000 7f9e0313d800 20 add_watcher() i=5 2024-09-12T17:43:07.903 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.901+0000 7f9e0313d800 20 add_watcher() i=6 2024-09-12T17:43:07.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.902+0000 7f9e0313d800 20 add_watcher() i=7 2024-09-12T17:43:07.904 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.902+0000 7f9e0313d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:07.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.904+0000 7f9cb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:07.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.904+0000 7f9e0313d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:07.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.904+0000 7f9e0313d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:07.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.904+0000 7f9e0313d800 5 note: GC not initialized 2024-09-12T17:43:07.907 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.904+0000 7f9c2ffff640 20 reqs_thread_entry: start 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.904+0000 7f9e0313d800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.904+0000 7f9e0313d800 20 Filter name: none 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9c2dffb640 20 reqs_thread_entry: start 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9e0313d800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9e0313d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9e0313d800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9e0313d800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9e0313d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : miss 2024-09-12T17:43:07.908 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.905+0000 7f9e0313d800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.906+0000 7f9e0313d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:43:07.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.906+0000 7f9e0313d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:43:07.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.906+0000 7f9e0313d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:43:07.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.906+0000 7f9e0313d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:07.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.906+0000 7f9e0313d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.906+0000 7f9e0313d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9e0313d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9e0313d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9e0313d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9e0313d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9ce27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94290416898512 notifier 7007 bl.length()=1015 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9ce27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9ce27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:43:07.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.911+0000 7f9ce27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.912+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:43:07.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.912+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:43:07.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.912+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:43:07.914 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.912+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:43:07.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:43:07.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.0 2024-09-12T17:43:07.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:43:07.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.1 2024-09-12T17:43:07.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:43:07.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.2 2024-09-12T17:43:07.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.3 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.4 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.5 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.6 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.7 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:43:07.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.8 2024-09-12T17:43:07.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:43:07.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.9 2024-09-12T17:43:07.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:43:07.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.10 2024-09-12T17:43:07.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:43:07.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1.11 2024-09-12T17:43:07.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.916+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:43:07.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.917+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:43:07.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.917+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:43:07.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.918+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:43:07.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.918+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:43:07.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.919+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:43:07.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.920+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:43:07.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.920+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:43:07.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.921+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:43:07.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.921+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:43:07.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.921+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:43:07.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.925+0000 7f9e0313d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:07.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.925+0000 7f9e0313d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:43:07.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9e0313d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:43:07.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9e0313d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:43:07.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9e0313d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9e0313d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9ce1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94290416898512 notifier 7007 bl.length()=1015 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9ce1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9ce1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.926+0000 7f9ce1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.927+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.927+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.927+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:43:07.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.927+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:43:07.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.929+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.0 2024-09-12T17:43:07.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.929+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.1 2024-09-12T17:43:07.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.930+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.2 2024-09-12T17:43:07.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.930+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.3 2024-09-12T17:43:07.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.930+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.4 2024-09-12T17:43:07.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.931+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.5 2024-09-12T17:43:07.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.931+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.6 2024-09-12T17:43:07.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.931+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.7 2024-09-12T17:43:07.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.931+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.8 2024-09-12T17:43:07.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.932+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.9 2024-09-12T17:43:07.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.932+0000 7f9e0313d800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33.10 2024-09-12T17:43:07.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.933+0000 7f9e0313d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:07.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.933+0000 7f9e0313d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 2024-09-12T17:43:07.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:43:07.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:43:07.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33, ofs0, ns] 2024-09-12T17:43:07.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9ce1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94290416898512 notifier 7007 bl.length()=983 2024-09-12T17:43:07.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9ce1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 info.flags=0x17 2024-09-12T17:43:07.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9ce1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 to cache LRU end 2024-09-12T17:43:07.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9ce1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_sources= new_sources= 2024-09-12T17:43:07.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential sources added=[] removed=[] 2024-09-12T17:43:07.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): orig_dests= new_dests= 2024-09-12T17:43:07.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.934+0000 7f9e0313d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33]): potential dests added=[] removed=[] 2024-09-12T17:43:07.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.936+0000 7f9e0313d800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:07.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.938+0000 7f9cb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:07.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.940+0000 7f9e0313d800 20 remove_watcher() i=0 2024-09-12T17:43:07.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.940+0000 7f9e0313d800 2 removed watcher, disabling cache 2024-09-12T17:43:07.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.941+0000 7f9e0313d800 20 remove_watcher() i=1 2024-09-12T17:43:07.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.942+0000 7f9e0313d800 20 remove_watcher() i=2 2024-09-12T17:43:07.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.943+0000 7f9e0313d800 20 remove_watcher() i=3 2024-09-12T17:43:07.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.945+0000 7f9e0313d800 20 remove_watcher() i=4 2024-09-12T17:43:07.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.946+0000 7f9e0313d800 20 remove_watcher() i=5 2024-09-12T17:43:07.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.948+0000 7f9e0313d800 20 remove_watcher() i=6 2024-09-12T17:43:07.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:07.949+0000 7f9e0313d800 20 remove_watcher() i=7 2024-09-12T17:43:07.963 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:43:07.993 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:07.993 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:08.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.031+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.032+0000 7fa5ff939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.032+0000 7fa5ff939800 20 realm 2024-09-12T17:43:08.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.032+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.032+0000 7fa5ff939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.032+0000 7fa5ff939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:08.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.032+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.033+0000 7fa5ff939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.035 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.033+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.234+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.234+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.234+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:08.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.234+0000 7fa5ff939800 20 searching for the correct realm 2024-09-12T17:43:08.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.236+0000 7fa5fbdcf640 0 -- 172.21.15.63:0/3722942963 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7fa5f008f400 msgr2=0x7fa5f008f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.239+0000 7fa5fb5ce640 0 -- 172.21.15.63:0/3722942963 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x562402863240 msgr2=0x562402865630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.248 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 zone default found 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 4 Realm: () 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 zonegroup default 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.246+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.247+0000 7fa5ff939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.247+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.247+0000 7fa5ff939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.247+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.247+0000 7fa5ff939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.247+0000 7fa5ff939800 20 started sync module instance, tier type = 2024-09-12T17:43:08.251 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.247+0000 7fa5ff939800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:08.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.256+0000 7fa5ff939800 20 add_watcher() i=0 2024-09-12T17:43:08.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.256+0000 7fa5ff939800 20 add_watcher() i=1 2024-09-12T17:43:08.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.256+0000 7fa5ff939800 20 add_watcher() i=2 2024-09-12T17:43:08.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.256+0000 7fa5ff939800 20 add_watcher() i=3 2024-09-12T17:43:08.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.256+0000 7fa5ff939800 20 add_watcher() i=4 2024-09-12T17:43:08.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.256+0000 7fa5ff939800 20 add_watcher() i=5 2024-09-12T17:43:08.259 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.256+0000 7fa5ff939800 20 add_watcher() i=6 2024-09-12T17:43:08.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.257+0000 7fa5ff939800 20 add_watcher() i=7 2024-09-12T17:43:08.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.257+0000 7fa5ff939800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:08.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.259+0000 7fa4b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa5ff939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:08.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa5ff939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:08.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa5ff939800 5 note: GC not initialized 2024-09-12T17:43:08.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa4b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:08.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa5ff939800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:08.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa5ff939800 20 Filter name: none 2024-09-12T17:43:08.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa42a7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:08.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.260+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.261+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.261+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.261+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.261+0000 7fa5ff939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.261+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.262+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.262+0000 7fa5ff939800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.262+0000 7fa5ff939800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:43:08.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.262+0000 7fa5ff939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.264+0000 7fa4b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.266+0000 7fa5ff939800 20 remove_watcher() i=0 2024-09-12T17:43:08.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.266+0000 7fa5ff939800 2 removed watcher, disabling cache 2024-09-12T17:43:08.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.267+0000 7fa5ff939800 20 remove_watcher() i=1 2024-09-12T17:43:08.269 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.268+0000 7fa5ff939800 20 remove_watcher() i=2 2024-09-12T17:43:08.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.269+0000 7fa5ff939800 20 remove_watcher() i=3 2024-09-12T17:43:08.271 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.270+0000 7fa5ff939800 20 remove_watcher() i=4 2024-09-12T17:43:08.273 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.271+0000 7fa5ff939800 20 remove_watcher() i=5 2024-09-12T17:43:08.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.272+0000 7fa5ff939800 20 remove_watcher() i=6 2024-09-12T17:43:08.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.273+0000 7fa5ff939800 20 remove_watcher() i=7 2024-09-12T17:43:08.286 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:08.286 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:08.286 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-commit-target-layout id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:08.286 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:08.361 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:43:08.361 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:08.612 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:43:08.642 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:08.642 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:08.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.679+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 20 realm 2024-09-12T17:43:08.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:08.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.681+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.682+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.682+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.682+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:08.685 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.682+0000 7f5772b3b800 20 searching for the correct realm 2024-09-12T17:43:08.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.685+0000 7f576e0ba640 0 -- 172.21.15.63:0/1849772046 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5764031930 msgr2=0x7f5764040410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.691 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.689+0000 7f576e0ba640 0 -- 172.21.15.63:0/1849772046 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56223cb74c20 msgr2=0x56223cb77090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.692+0000 7f5772b3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:08.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.692+0000 7f5772b3b800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.692+0000 7f5772b3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.692+0000 7f5772b3b800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.692+0000 7f5772b3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.692+0000 7f5772b3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.692+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:08.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 zone default found 2024-09-12T17:43:08.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 4 Realm: () 2024-09-12T17:43:08.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 zonegroup default 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.693+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.694+0000 7f5772b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.694+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.694+0000 7f5772b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.694+0000 7f5772b3b800 20 started sync module instance, tier type = 2024-09-12T17:43:08.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.694+0000 7f5772b3b800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:08.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.702+0000 7f5772b3b800 20 add_watcher() i=0 2024-09-12T17:43:08.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.702+0000 7f5772b3b800 20 add_watcher() i=1 2024-09-12T17:43:08.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.702+0000 7f5772b3b800 20 add_watcher() i=2 2024-09-12T17:43:08.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.702+0000 7f5772b3b800 20 add_watcher() i=3 2024-09-12T17:43:08.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.702+0000 7f5772b3b800 20 add_watcher() i=4 2024-09-12T17:43:08.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.702+0000 7f5772b3b800 20 add_watcher() i=5 2024-09-12T17:43:08.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.702+0000 7f5772b3b800 20 add_watcher() i=6 2024-09-12T17:43:08.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.703+0000 7f5772b3b800 20 add_watcher() i=7 2024-09-12T17:43:08.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.703+0000 7f5772b3b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:08.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.705+0000 7f56257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f5772b3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:08.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f5772b3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:08.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f5772b3b800 5 note: GC not initialized 2024-09-12T17:43:08.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f559ffff640 20 reqs_thread_entry: start 2024-09-12T17:43:08.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f5772b3b800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:08.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f5772b3b800 20 Filter name: none 2024-09-12T17:43:08.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f559dffb640 20 reqs_thread_entry: start 2024-09-12T17:43:08.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.706+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.707+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:08.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.707+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.707+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:08.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.707+0000 7f5772b3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.707+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.708+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:08.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.708+0000 7f5772b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.708+0000 7f5772b3b800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:08.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.708+0000 7f5772b3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.710+0000 7f56257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.712+0000 7f5772b3b800 20 remove_watcher() i=0 2024-09-12T17:43:08.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.712+0000 7f5772b3b800 2 removed watcher, disabling cache 2024-09-12T17:43:08.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.713+0000 7f5772b3b800 20 remove_watcher() i=1 2024-09-12T17:43:08.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.714+0000 7f5772b3b800 20 remove_watcher() i=2 2024-09-12T17:43:08.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.715+0000 7f5772b3b800 20 remove_watcher() i=3 2024-09-12T17:43:08.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.716+0000 7f5772b3b800 20 remove_watcher() i=4 2024-09-12T17:43:08.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.717+0000 7f5772b3b800 20 remove_watcher() i=5 2024-09-12T17:43:08.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.718+0000 7f5772b3b800 20 remove_watcher() i=6 2024-09-12T17:43:08.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.719+0000 7f5772b3b800 20 remove_watcher() i=7 2024-09-12T17:43:08.732 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:08.732 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:08.732 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-do-reshard id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:08.732 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:08.733 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:43:08.768 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:08.769 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:08.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.806+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 20 realm 2024-09-12T17:43:08.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:08.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.808+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.809+0000 7f0f8e040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.809+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.809+0000 7f0f8e040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:08.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.809+0000 7f0f8e040800 20 searching for the correct realm 2024-09-12T17:43:08.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:08.812+0000 7f0f8b329640 0 -- 172.21.15.63:0/3417089238 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f0f74033bb0 msgr2=0x7f0f74040910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:09.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.017+0000 7f0f8b329640 0 -- 172.21.15.63:0/3417089238 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55c7de786210 msgr2=0x55c7de788600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.021+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 zone default found 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 4 Realm: () 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 zonegroup default 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.022+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.023+0000 7f0f8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.023+0000 7f0f8e040800 20 started sync module instance, tier type = 2024-09-12T17:43:09.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.023+0000 7f0f8e040800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:09.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.031+0000 7f0f8e040800 20 add_watcher() i=0 2024-09-12T17:43:09.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.031+0000 7f0f8e040800 20 add_watcher() i=1 2024-09-12T17:43:09.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.031+0000 7f0f8e040800 20 add_watcher() i=2 2024-09-12T17:43:09.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.031+0000 7f0f8e040800 20 add_watcher() i=3 2024-09-12T17:43:09.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.031+0000 7f0f8e040800 20 add_watcher() i=4 2024-09-12T17:43:09.033 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.031+0000 7f0f8e040800 20 add_watcher() i=5 2024-09-12T17:43:09.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.031+0000 7f0f8e040800 20 add_watcher() i=6 2024-09-12T17:43:09.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.032+0000 7f0f8e040800 20 add_watcher() i=7 2024-09-12T17:43:09.034 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.032+0000 7f0f8e040800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.034+0000 7f0e41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.034+0000 7f0f8e040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.034+0000 7f0f8e040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.035+0000 7f0f8e040800 5 note: GC not initialized 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.035+0000 7f0e40fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.035+0000 7f0f8e040800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.035+0000 7f0f8e040800 20 Filter name: none 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.035+0000 7f0dba7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.035+0000 7f0f8e040800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:43:09.037 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.035+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:09.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:43:09.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:43:09.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 : miss 2024-09-12T17:43:09.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:09.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:09.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.036+0000 7f0f8e040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 2024-09-12T17:43:09.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.041+0000 7f0f8e040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.041+0000 7f0f8e040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.041+0000 7f0f8e040800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.043 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.041+0000 7f0f8e040800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34, ofs0, ns] 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0e6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 94316919347632 notifier 7058 bl.length()=995 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0e6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0e6a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0e6a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_sources= new_sources= 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential sources added=[] removed=[] 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_dests= new_dests= 2024-09-12T17:43:09.044 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.042+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential dests added=[] removed=[] 2024-09-12T17:43:09.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.046+0000 7f0f8e040800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:43:09.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.056+0000 7f0f8e040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:09.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.056+0000 7f0f8e040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 2024-09-12T17:43:09.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34, ofs0, ns] 2024-09-12T17:43:09.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0e6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94316919347632 notifier 7058 bl.length()=963 2024-09-12T17:43:09.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0e6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0e6a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0e6a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_sources= new_sources= 2024-09-12T17:43:09.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential sources added=[] removed=[] 2024-09-12T17:43:09.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_dests= new_dests= 2024-09-12T17:43:09.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential dests added=[] removed=[] 2024-09-12T17:43:09.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.058+0000 7f0f8e040800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:43:09.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.060+0000 7f0e41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.062+0000 7f0f8e040800 20 remove_watcher() i=0 2024-09-12T17:43:09.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.062+0000 7f0f8e040800 2 removed watcher, disabling cache 2024-09-12T17:43:09.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.063+0000 7f0f8e040800 20 remove_watcher() i=1 2024-09-12T17:43:09.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.064+0000 7f0f8e040800 20 remove_watcher() i=2 2024-09-12T17:43:09.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.065+0000 7f0f8e040800 20 remove_watcher() i=3 2024-09-12T17:43:09.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.066+0000 7f0f8e040800 20 remove_watcher() i=4 2024-09-12T17:43:09.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.067+0000 7f0f8e040800 20 remove_watcher() i=5 2024-09-12T17:43:09.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.068+0000 7f0f8e040800 20 remove_watcher() i=6 2024-09-12T17:43:09.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.069+0000 7f0f8e040800 20 remove_watcher() i=7 2024-09-12T17:43:09.085 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:43:09.112 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:09.113 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:09.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.149+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 20 realm 2024-09-12T17:43:09.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.155 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.151+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.152+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.152+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.152+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.152+0000 7fbf15811800 20 searching for the correct realm 2024-09-12T17:43:09.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.156+0000 7fbf10791640 0 -- 172.21.15.63:0/2180501028 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fbf04069ef0 msgr2=0x7fbf04068060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.159+0000 7fbf11793640 0 -- 172.21.15.63:0/2180501028 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5573ce28ceb0 msgr2=0x5573ce28f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:09.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:09.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.163+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 zone default found 2024-09-12T17:43:09.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 4 Realm: () 2024-09-12T17:43:09.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:09.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:09.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 zonegroup default 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.164+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.165+0000 7fbf15811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.165+0000 7fbf15811800 20 started sync module instance, tier type = 2024-09-12T17:43:09.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.165+0000 7fbf15811800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:09.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.174+0000 7fbf15811800 20 add_watcher() i=0 2024-09-12T17:43:09.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.174+0000 7fbf15811800 20 add_watcher() i=1 2024-09-12T17:43:09.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.174+0000 7fbf15811800 20 add_watcher() i=2 2024-09-12T17:43:09.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.174+0000 7fbf15811800 20 add_watcher() i=3 2024-09-12T17:43:09.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.174+0000 7fbf15811800 20 add_watcher() i=4 2024-09-12T17:43:09.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.174+0000 7fbf15811800 20 add_watcher() i=5 2024-09-12T17:43:09.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.174+0000 7fbf15811800 20 add_watcher() i=6 2024-09-12T17:43:09.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.175+0000 7fbf15811800 20 add_watcher() i=7 2024-09-12T17:43:09.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.175+0000 7fbf15811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.178+0000 7fbdc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.178+0000 7fbf15811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.178+0000 7fbf15811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.178+0000 7fbf15811800 5 note: GC not initialized 2024-09-12T17:43:09.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.178+0000 7fbdc5fe3640 20 reqs_thread_entry: start 2024-09-12T17:43:09.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.178+0000 7fbf15811800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.178+0000 7fbf15811800 20 Filter name: none 2024-09-12T17:43:09.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.179+0000 7fbd377fe640 20 reqs_thread_entry: start 2024-09-12T17:43:09.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.179+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.179+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:09.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.179+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.180+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:09.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.180+0000 7fbf15811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.180+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.180+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:09.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.180+0000 7fbf15811800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.180+0000 7fbf15811800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:09.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.180+0000 7fbf15811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.182+0000 7fbdc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.184+0000 7fbf15811800 20 remove_watcher() i=0 2024-09-12T17:43:09.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.184+0000 7fbf15811800 2 removed watcher, disabling cache 2024-09-12T17:43:09.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.185+0000 7fbf15811800 20 remove_watcher() i=1 2024-09-12T17:43:09.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.186+0000 7fbf15811800 20 remove_watcher() i=2 2024-09-12T17:43:09.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.187+0000 7fbf15811800 20 remove_watcher() i=3 2024-09-12T17:43:09.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.188+0000 7fbf15811800 20 remove_watcher() i=4 2024-09-12T17:43:09.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.189+0000 7fbf15811800 20 remove_watcher() i=5 2024-09-12T17:43:09.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.190+0000 7fbf15811800 20 remove_watcher() i=6 2024-09-12T17:43:09.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.191+0000 7fbf15811800 20 remove_watcher() i=7 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-do-reshard id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.326+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.327+0000 7ff8d460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.327+0000 7ff8d460e800 20 realm 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.327+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.328+0000 7ff8d460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.328+0000 7ff8d460e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.328+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.328+0000 7ff8d460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.328+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.328+0000 7ff8d460e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.329+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.329+0000 7ff8d460e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.329+0000 7ff8d460e800 20 searching for the correct realm 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.332+0000 7ff8cf458640 0 -- 172.21.15.63:0/928235315 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7ff8b8020950 msgr2=0x7ff8b802c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.336+0000 7ff8d045a640 0 -- 172.21.15.63:0/928235315 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x557a534fb490 msgr2=0x557a534fd8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.339+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 zone default found 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 4 Realm: () 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 zonegroup default 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.340+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.341+0000 7ff8d460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.341+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.341+0000 7ff8d460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.341+0000 7ff8d460e800 20 started sync module instance, tier type = 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.341+0000 7ff8d460e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.349+0000 7ff8d460e800 20 add_watcher() i=0 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.349+0000 7ff8d460e800 20 add_watcher() i=1 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.349+0000 7ff8d460e800 20 add_watcher() i=2 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.349+0000 7ff8d460e800 20 add_watcher() i=3 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.349+0000 7ff8d460e800 20 add_watcher() i=4 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.349+0000 7ff8d460e800 20 add_watcher() i=5 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.349+0000 7ff8d460e800 20 add_watcher() i=6 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.350+0000 7ff8d460e800 20 add_watcher() i=7 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.350+0000 7ff8d460e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.352+0000 7ff785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.352+0000 7ff8d460e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.352+0000 7ff8d460e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.352+0000 7ff8d460e800 5 note: GC not initialized 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.352+0000 7ff784fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.352+0000 7ff8d460e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 20 Filter name: none 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff6fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 : miss 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.353+0000 7ff8d460e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff8d460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff8d460e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff8d460e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff8d460e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34, ofs0, ns] 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff7ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 93983872169312 notifier 7521 bl.length()=995 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff7ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff7ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.358+0000 7ff7ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.359+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_sources= new_sources= 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.359+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential sources added=[] removed=[] 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.359+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_dests= new_dests= 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.359+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential dests added=[] removed=[] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.0 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.0 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.1 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.1 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.2 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.2 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.3 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.3 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.4 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.4 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.5 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.5 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.6 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.6 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.7 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.7 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.8 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.8 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.9 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.9 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.10 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.10 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.11 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1.11 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.0 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.366+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.2 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.367+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.3 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.367+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.4 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.368+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.5 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.368+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.6 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.368+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.7 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.369+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.8 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.369+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.9 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.370+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.10 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.373+0000 7ff8d460e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.373+0000 7ff8d460e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff8d460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff8d460e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff8d460e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff8d460e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34, ofs0, ns] 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff7aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431640 cookie 93983872169312 notifier 7521 bl.length()=995 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff7aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff7aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.374+0000 7ff7aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.375+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_sources= new_sources= 2024-09-12T17:43:09.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.375+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential sources added=[] removed=[] 2024-09-12T17:43:09.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.375+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_dests= new_dests= 2024-09-12T17:43:09.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.375+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential dests added=[] removed=[] 2024-09-12T17:43:09.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.377+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.0 2024-09-12T17:43:09.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.377+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.1 2024-09-12T17:43:09.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.377+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.2 2024-09-12T17:43:09.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.378+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.3 2024-09-12T17:43:09.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.378+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.4 2024-09-12T17:43:09.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.378+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.5 2024-09-12T17:43:09.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.379+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.6 2024-09-12T17:43:09.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.379+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.7 2024-09-12T17:43:09.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.379+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.8 2024-09-12T17:43:09.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.380+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.9 2024-09-12T17:43:09.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.380+0000 7ff8d460e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34.10 2024-09-12T17:43:09.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.380+0000 7ff8d460e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:09.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.380+0000 7ff8d460e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff8d460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff8d460e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff8d460e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff8d460e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34, ofs0, ns] 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff7aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431641 cookie 93983872169312 notifier 7521 bl.length()=963 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff7aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 info.flags=0x17 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff7aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 to cache LRU end 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.382+0000 7ff7aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.383+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_sources= new_sources= 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.383+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential sources added=[] removed=[] 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.383+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): orig_dests= new_dests= 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.383+0000 7ff8d460e800 20 handle_bi_update(): bucket=:error-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34]): potential dests added=[] removed=[] 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.385+0000 7ff8d460e800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.386+0000 7ff785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.389+0000 7ff8d460e800 20 remove_watcher() i=0 2024-09-12T17:43:09.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.389+0000 7ff8d460e800 2 removed watcher, disabling cache 2024-09-12T17:43:09.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.390+0000 7ff8d460e800 20 remove_watcher() i=1 2024-09-12T17:43:09.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.392+0000 7ff8d460e800 20 remove_watcher() i=2 2024-09-12T17:43:09.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.393+0000 7ff8d460e800 20 remove_watcher() i=3 2024-09-12T17:43:09.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.395+0000 7ff8d460e800 20 remove_watcher() i=4 2024-09-12T17:43:09.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.396+0000 7ff8d460e800 20 remove_watcher() i=5 2024-09-12T17:43:09.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.397+0000 7ff8d460e800 20 remove_watcher() i=6 2024-09-12T17:43:09.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.398+0000 7ff8d460e800 20 remove_watcher() i=7 2024-09-12T17:43:09.412 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:43:09.441 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:09.441 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:09.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.477+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 20 realm 2024-09-12T17:43:09.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.479+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.480+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.480+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.480+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.480+0000 7fa56851f800 20 searching for the correct realm 2024-09-12T17:43:09.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.483+0000 7fa55bfff640 0 -- 172.21.15.63:0/2178818702 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa54c02d070 msgr2=0x7fa54c03a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.688+0000 7fa564aa3640 0 -- 172.21.15.63:0/2178818702 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5590d4945310 msgr2=0x5590d4947700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 zone default found 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 4 Realm: () 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 zonegroup default 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.692+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.693+0000 7fa56851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.693+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.693+0000 7fa56851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.693+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.693+0000 7fa56851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.693+0000 7fa56851f800 20 started sync module instance, tier type = 2024-09-12T17:43:09.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.693+0000 7fa56851f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:09.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=0 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=1 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=2 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=3 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=4 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=5 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=6 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 20 add_watcher() i=7 2024-09-12T17:43:09.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.703+0000 7fa56851f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.705+0000 7fa41afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.705+0000 7fa56851f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.705+0000 7fa56851f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.705+0000 7fa56851f800 5 note: GC not initialized 2024-09-12T17:43:09.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.705+0000 7fa419fdb640 20 reqs_thread_entry: start 2024-09-12T17:43:09.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.706+0000 7fa56851f800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.706+0000 7fa56851f800 20 Filter name: none 2024-09-12T17:43:09.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.706+0000 7fa38b7fe640 20 reqs_thread_entry: start 2024-09-12T17:43:09.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.706+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.706+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:09.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.706+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.707+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:09.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.707+0000 7fa56851f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.707+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.708+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:09.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.708+0000 7fa56851f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.708+0000 7fa56851f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:09.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.708+0000 7fa56851f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.710+0000 7fa41afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.712+0000 7fa56851f800 20 remove_watcher() i=0 2024-09-12T17:43:09.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.712+0000 7fa56851f800 2 removed watcher, disabling cache 2024-09-12T17:43:09.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.713+0000 7fa56851f800 20 remove_watcher() i=1 2024-09-12T17:43:09.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.714+0000 7fa56851f800 20 remove_watcher() i=2 2024-09-12T17:43:09.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.715+0000 7fa56851f800 20 remove_watcher() i=3 2024-09-12T17:43:09.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.716+0000 7fa56851f800 20 remove_watcher() i=4 2024-09-12T17:43:09.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.716+0000 7fa56851f800 20 remove_watcher() i=5 2024-09-12T17:43:09.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.717+0000 7fa56851f800 20 remove_watcher() i=6 2024-09-12T17:43:09.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:09.718+0000 7fa56851f800 20 remove_watcher() i=7 2024-09-12T17:43:09.730 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:09.731 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:09.731 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-do-reshard id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:09.731 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:09.805 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:43:09.805 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:10.024 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:43:10.053 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:10.053 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:10.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.274+0000 7f058d602640 0 --2- 172.21.15.63:0/867572895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583fee62320 0x5583fefb43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:43:10.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.291+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 20 realm 2024-09-12T17:43:10.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:10.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.293+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.495+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:10.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.495+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.495+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:10.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.495+0000 7f0590319800 20 searching for the correct realm 2024-09-12T17:43:10.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.497+0000 7f058e604640 0 -- 172.21.15.63:0/1874709519 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5583ff096330 msgr2=0x5583ff098760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:10.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.500+0000 7f058e604640 0 -- 172.21.15.63:0/1874709519 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x7f05800b7070 msgr2=0x7f0580070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.707+0000 7f0590319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.707+0000 7f0590319800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.707+0000 7f0590319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.707+0000 7f0590319800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.707+0000 7f0590319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.707+0000 7f0590319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.707+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 zone default found 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 4 Realm: () 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 zonegroup default 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.708+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.709+0000 7f0590319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.709+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.709+0000 7f0590319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.709+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.709+0000 7f0590319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.709+0000 7f0590319800 20 started sync module instance, tier type = 2024-09-12T17:43:10.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.709+0000 7f0590319800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.719+0000 7f0590319800 20 add_watcher() i=0 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.719+0000 7f0590319800 20 add_watcher() i=1 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.719+0000 7f0590319800 20 add_watcher() i=2 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.719+0000 7f0590319800 20 add_watcher() i=3 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.719+0000 7f0590319800 20 add_watcher() i=4 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.719+0000 7f0590319800 20 add_watcher() i=5 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.719+0000 7f0590319800 20 add_watcher() i=6 2024-09-12T17:43:10.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.720+0000 7f0590319800 20 add_watcher() i=7 2024-09-12T17:43:10.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.720+0000 7f0590319800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:10.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.721+0000 7f043f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:10.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f0590319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:10.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f0590319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:10.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f0590319800 5 note: GC not initialized 2024-09-12T17:43:10.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f043e7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:10.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f0590319800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:10.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f0590319800 20 Filter name: none 2024-09-12T17:43:10.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f03affff640 20 reqs_thread_entry: start 2024-09-12T17:43:10.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.722+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.723+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:10.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.723+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.724+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:10.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.724+0000 7f0590319800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:10.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.724+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.724+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:10.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.724+0000 7f0590319800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.725+0000 7f0590319800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:10.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.725+0000 7f0590319800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:10.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.726+0000 7f043f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:10.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.729+0000 7f0590319800 20 remove_watcher() i=0 2024-09-12T17:43:10.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.729+0000 7f0590319800 2 removed watcher, disabling cache 2024-09-12T17:43:10.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.730+0000 7f0590319800 20 remove_watcher() i=1 2024-09-12T17:43:10.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.731+0000 7f0590319800 20 remove_watcher() i=2 2024-09-12T17:43:10.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.732+0000 7f0590319800 20 remove_watcher() i=3 2024-09-12T17:43:10.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.733+0000 7f0590319800 20 remove_watcher() i=4 2024-09-12T17:43:10.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.735+0000 7f0590319800 20 remove_watcher() i=5 2024-09-12T17:43:10.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.736+0000 7f0590319800 20 remove_watcher() i=6 2024-09-12T17:43:10.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.737+0000 7f0590319800 20 remove_watcher() i=7 2024-09-12T17:43:10.751 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:10.752 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:10.752 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-do-reshard id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:10.752 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:10.753 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:43:10.788 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:10.788 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:10.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.833+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 realm 2024-09-12T17:43:10.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.835+0000 7f0fdac0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:10.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:10.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:10.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:10.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:10.838 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 searching for the correct realm 2024-09-12T17:43:10.841 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:10.839+0000 7f0fd5b79640 0 -- 172.21.15.63:0/4187853511 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f0fcc0ad040 msgr2=0x7f0fcc0c6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:11.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.045+0000 7f0fd6b7b640 0 -- 172.21.15.63:0/4187853511 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561e610d0820 msgr2=0x561e610d2ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:11.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:11.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:11.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:11.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:11.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:11.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:11.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:11.053 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 zone default found 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 Realm: () 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 zonegroup default 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 started sync module instance, tier type = 2024-09-12T17:43:11.054 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:11.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=0 2024-09-12T17:43:11.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=1 2024-09-12T17:43:11.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=2 2024-09-12T17:43:11.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=3 2024-09-12T17:43:11.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=4 2024-09-12T17:43:11.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=5 2024-09-12T17:43:11.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=6 2024-09-12T17:43:11.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.061+0000 7f0fdac0e800 20 add_watcher() i=7 2024-09-12T17:43:11.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.061+0000 7f0fdac0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:11.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.062+0000 7f0e8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:11.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:11.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:11.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 note: GC not initialized 2024-09-12T17:43:11.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0e077fe640 20 reqs_thread_entry: start 2024-09-12T17:43:11.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:11.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 Filter name: none 2024-09-12T17:43:11.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0e057fa640 20 reqs_thread_entry: start 2024-09-12T17:43:11.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0fdac0e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:43:11.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:11.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:43:11.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:43:11.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 : miss 2024-09-12T17:43:11.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:11.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:11.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 2024-09-12T17:43:11.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35, ofs0, ns] 2024-09-12T17:43:11.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94688477305040 notifier 7135 bl.length()=995 2024-09-12T17:43:11.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_sources= new_sources= 2024-09-12T17:43:11.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential sources added=[] removed=[] 2024-09-12T17:43:11.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_dests= new_dests= 2024-09-12T17:43:11.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential dests added=[] removed=[] 2024-09-12T17:43:11.076 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0fdac0e800 time 2024-09-12T17:43:11.077123+0000 2024-09-12T17:43:11.077 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:11.077 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.077 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0fdbd8c71a] 2024-09-12T17:43:11.077 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.077 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.075+0000 7f0fdac0e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0fdac0e800 time 2024-09-12T17:43:11.077123+0000 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0fdbd8c71a] 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.078 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.079 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:43:11.079 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.079 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:43:11.079 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:43:11.079 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.079 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:43:11.079 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0fdac0e800 thread_name:radosgw-admin 2024-09-12T17:43:11.099 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.099 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0fdaa3e6f0] 2024-09-12T17:43:11.099 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0fdaa8b99c] 2024-09-12T17:43:11.099 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0fdbd8c774] 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.076+0000 7f0fdac0e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0fdac0e800 thread_name:radosgw-admin 2024-09-12T17:43:11.100 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0fdaa3e6f0] 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0fdaa8b99c] 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0fdbd8c774] 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:43:11.101 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding auth protocol: cephx 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding auth protocol: cephx 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.102 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: starting msgr at 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: starting objecter 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command objecter_requests hook 0x561e60feb5d0 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: setting wanted keys 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: calling monclient init 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding auth protocol: cephx 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding auth protocol: cephx 2024-09-12T17:43:11.103 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding auth protocol: cephx 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.104 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key hook 0x561e60fe7a18 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e60ea0950 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e60f2a980 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e60f30c60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.333338s 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e60ea0950 auth_method 0 2024-09-12T17:43:11.105 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e60f30c60 auth_method 0 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e60f2a980 auth_method 0 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.106 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_done global_id 7136 payload 824 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 1 monclient: found mon.noname-c 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:43:10.817+0000 7f0ec2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:43:10.817+0000 7f0ec2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:11.107 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:43:10.817+0000 7f0ec2e05640 10 monclient: dump: 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.108 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: dump: 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.109 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7136 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:43:10.818+0000 7f0ec4608640 4 set_mon_vals no callback set 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 1 librados: init done 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:43:10.819+0000 7f0ec2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:43:10.819+0000 7f0ec2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:43:10.819+0000 7f0ec2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:43:10.820+0000 7f0fd637a640 10 monclient: get_auth_request con 0x7f0ebc076470 auth_method 0 2024-09-12T17:43:11.110 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:43:10.820+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x561e6102fae0 auth_method 0 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:43:10.821+0000 7f0fd637a640 10 monclient: get_auth_request con 0x561e61032cc0 auth_method 0 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:43:10.822+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x561e61037d50 auth_method 0 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 10 monclient: build_initial_monmap 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 1 build_initial for_mkfs: 0 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 10 monclient: monmap: 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:11.111 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding auth protocol: cephx 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding auth protocol: cephx 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding auth protocol: cephx 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.112 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command objecter_requests cmddesc objecter_requests hook 0x561e6103f6a0 EEXIST 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding auth protocol: cephx 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding auth protocol: cephx 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding auth protocol: cephx 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.113 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key cmddesc rotate-key hook 0x561e6103ae60 EEXIST 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:11.114 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e61063390 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e61065660 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e61061b60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.340131s 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e61061b60 auth_method 0 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e61063390 auth_method 0 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.115 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e61065660 auth_method 0 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.116 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_done global_id 7569 payload 824 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:43:10.824+0000 7f0fd637a640 1 monclient: found mon.noname-a 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: dump: 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.117 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: dump: 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.118 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7569 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:43:10.824+0000 7f0fd737c640 4 set_mon_vals no callback set 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:43:10.825+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:43:10.825+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:43:10.826+0000 7f0ebbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:11.119 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:43:10.826+0000 7f0ebbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:43:10.826+0000 7f0ebbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:43:10.827+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0eb0076380 auth_method 0 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: get_monmap_and_config 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: build_initial_monmap 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 1 build_initial for_mkfs: 0 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: monmap: 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.120 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding auth protocol: cephx 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding auth protocol: cephx 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding auth protocol: cephx 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.121 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding auth protocol: cephx 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding auth protocol: cephx 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding auth protocol: cephx 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.122 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key cmddesc rotate-key hook 0x7ffe8e39a018 EEXIST 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e610b76b0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.123 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e610884d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e610b2ae0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.344456s 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e610884d0 auth_method 0 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e610b76b0 auth_method 0 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.124 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e610b2ae0 auth_method 0 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.125 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_done global_id 7132 payload 274 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:43:10.828+0000 7f0fd637a640 1 monclient: found mon.noname-b 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: dump: 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.126 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7132 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 4 set_mon_vals no callback set 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: dump: 2024-09-12T17:43:11.127 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: shutdown 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: build_initial_monmap 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 1 build_initial for_mkfs: 0 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: monmap: 2024-09-12T17:43:11.128 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding auth protocol: cephx 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding auth protocol: cephx 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding auth protocol: cephx 2024-09-12T17:43:11.129 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: starting msgr at 2024-09-12T17:43:11.130 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: starting objecter 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command objecter_requests cmddesc objecter_requests hook 0x561e610adc90 EEXIST 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: setting wanted keys 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: calling monclient init 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding auth protocol: cephx 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding auth protocol: cephx 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding auth protocol: cephx 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.131 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key cmddesc rotate-key hook 0x561e6107b288 EEXIST 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e610884d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.132 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e610b2ae0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e610b76b0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.346780s 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e610884d0 auth_method 0 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e610b76b0 auth_method 0 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.133 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e610b2ae0 auth_method 0 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.134 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:43:10.831+0000 7f0fd637a640 10 monclient(hunting): handle_auth_done global_id 7135 payload 824 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:43:10.831+0000 7f0fd637a640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:43:10.831+0000 7f0fd637a640 1 monclient: found mon.noname-b 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:43:10.831+0000 7f0fd637a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: dump: 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.135 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: dump: 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.136 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7135 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:43:10.831+0000 7f0eb9ffb640 4 set_mon_vals no callback set 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.137 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 1 librados: init done 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cr dump hook 0x561e610b31a8 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:43:10.833+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:43:10.833+0000 7f0ea7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:43:10.833+0000 7f0ea7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:43:10.833+0000 7f0ea7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:43:10.834+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0ea0076470 auth_method 0 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:43:10.834+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x561e610d0820 auth_method 0 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 realm 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:11.138 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:43:10.835+0000 7f0fd637a640 10 monclient: get_auth_request con 0x561e610d4c40 auth_method 0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 searching for the correct realm 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:43:10.836+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x561e610d9de0 auth_method 0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:43:10.837+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x7f0fcc06b020 auth_method 0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:43:10.838+0000 7f0fd637a640 10 monclient: get_auth_request con 0x7f0fc8034060 auth_method 0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:43:10.839+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0fcc0ad040 auth_method 0 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:43:10.839+0000 7f0fd5b79640 0 -- 172.21.15.63:0/4187853511 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f0fcc0ad040 msgr2=0x7f0fcc0c6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:11.139 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:43:11.041+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0fcc0ad040 auth_method 0 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:43:11.043+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x7f0fc801d040 auth_method 0 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:43:11.044+0000 7f0fd637a640 10 monclient: get_auth_request con 0x7f0fd0034040 auth_method 0 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:43:11.045+0000 7f0fd6b7b640 0 -- 172.21.15.63:0/4187853511 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561e610d0820 msgr2=0x561e610d2ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:43:11.045+0000 7f0ea7fff640 1 client.7135.objecter ms_handle_reset 0x561e610d0820 session 0x561e610d01a0 osd.6 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:43:11.045+0000 7f0ea7fff640 10 monclient: _renew_subs 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:43:11.045+0000 7f0ea7fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:43:11.045+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x7f0ea0086710 auth_method 0 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:11.140 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 zone default found 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 Realm: () 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:11.141 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 zonegroup default 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 started sync module instance, tier type = 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:43:11.056+0000 7f0ea7fff640 1 client.7135.objecter ms_handle_reset 0x7f0fcc0ad040 session 0x7f0fcc0d3920 osd.5 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:43:11.057+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x561e610d0820 auth_method 0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=0 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=1 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=2 2024-09-12T17:43:11.142 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=3 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=4 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=5 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=6 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:43:11.061+0000 7f0fdac0e800 20 add_watcher() i=7 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:43:11.061+0000 7f0fdac0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding auth protocol: cephx 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding auth protocol: cephx 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding auth protocol: cephx 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.143 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:43:11.062+0000 7f0e8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache list hook 0x561e610a70b0 2024-09-12T17:43:11.144 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache inspect hook 0x561e610a70b0 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache erase hook 0x561e610a70b0 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache zap hook 0x561e610a70b0 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 note: GC not initialized 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:43:11.063+0000 7f0e077fe640 20 reqs_thread_entry: start 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace show hook 0x7f0fd0004720 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace history hook 0x7f0fd0004720 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace active hook 0x7f0fd0004720 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace active_short hook 0x7f0fd0004720 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 Filter name: none 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:43:11.063+0000 7f0e057fa640 20 reqs_thread_entry: start 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.145 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 : miss 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.146 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35, ofs0, ns] 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94688477305040 notifier 7135 bl.length()=995 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_sources= new_sources= 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential sources added=[] removed=[] 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_dests= new_dests= 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential dests added=[] removed=[] 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:43:11.075+0000 7f0fdac0e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0fdac0e800 time 2024-09-12T17:43:11.077123+0000 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0fdbd8c71a] 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:43:11.076+0000 7f0fdac0e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0fdac0e800 thread_name:radosgw-admin 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0fdaa3e6f0] 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0fdaa8b99c] 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0fdbd8c774] 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:11.149 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:43:11.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:43:11.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:11.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:43:11.153 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:11.154 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:43:11.155 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0e057fa640 / http_manager 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0e077fe640 / http_manager 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0e8cfe1640 / rgw_dt_lg_renew 2024-09-12T17:43:11.156 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ea7fff640 / ms_dispatch 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0eb9ffb640 / io_context_pool 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ebbfff640 / ms_dispatch 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ec2e05640 / ms_dispatch 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ec4608640 / io_context_pool 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd5b79640 / msgr-worker-2 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd637a640 / msgr-worker-1 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd6b7b640 / msgr-worker-0 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd737c640 / io_context_pool 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fdac0e800 / radosgw-admin 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.129364.log 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:43:11.157 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding auth protocol: cephx 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding auth protocol: cephx 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.158 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: crc 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fecd90) adding con mode: secure 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: starting msgr at 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: starting objecter 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command objecter_requests hook 0x561e60feb5d0 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: setting wanted keys 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 1 librados: calling monclient init 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding auth protocol: cephx 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding auth protocol: cephx 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding auth protocol: cephx 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.159 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: crc 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 5 AuthRegistry(0x561e60fe78d0) adding con mode: secure 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:43:10.816+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key hook 0x561e60fe7a18 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.160 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e60ea0950 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e60f2a980 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e60f30c60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:43:10.817+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.333338s 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e60ea0950 auth_method 0 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e60f30c60 auth_method 0 2024-09-12T17:43:11.161 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e60f2a980 auth_method 0 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:43:10.817+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.162 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:43:10.817+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_done global_id 7136 payload 824 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 1 monclient: found mon.noname-c 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:43:10.817+0000 7f0fd5b79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:43:10.817+0000 7f0ec2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:43:10.817+0000 7f0ec2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:43:10.817+0000 7f0ec2e05640 10 monclient: dump: 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.163 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:43:10.818+0000 7f0ec2e05640 10 monclient: dump: 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.164 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7136 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:43:10.818+0000 7f0ec4608640 4 set_mon_vals no callback set 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.165 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:43:10.818+0000 7f0fdac0e800 1 librados: init done 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:43:10.819+0000 7f0ec2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:43:10.819+0000 7f0ec2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:43:10.819+0000 7f0ec2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:43:10.820+0000 7f0fd637a640 10 monclient: get_auth_request con 0x7f0ebc076470 auth_method 0 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:43:10.820+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x561e6102fae0 auth_method 0 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:43:10.821+0000 7f0fd637a640 10 monclient: get_auth_request con 0x561e61032cc0 auth_method 0 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:43:10.822+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x561e61037d50 auth_method 0 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 10 monclient: build_initial_monmap 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 1 build_initial for_mkfs: 0 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 10 monclient: monmap: 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:11.166 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding auth protocol: cephx 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding auth protocol: cephx 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding auth protocol: cephx 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.167 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: crc 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103bc30) adding con mode: secure 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command objecter_requests cmddesc objecter_requests hook 0x561e6103f6a0 EEXIST 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding auth protocol: cephx 2024-09-12T17:43:11.168 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding auth protocol: cephx 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding auth protocol: cephx 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: crc 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 5 AuthRegistry(0x561e6103ad18) adding con mode: secure 2024-09-12T17:43:11.169 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:43:10.823+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key cmddesc rotate-key hook 0x561e6103ae60 EEXIST 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e61063390 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e61065660 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e61061b60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.340131s 2024-09-12T17:43:11.170 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e61061b60 auth_method 0 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e61063390 auth_method 0 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e61065660 auth_method 0 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.171 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:43:10.824+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:43:10.824+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient(hunting): handle_auth_done global_id 7569 payload 824 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:43:10.824+0000 7f0fd637a640 1 monclient: found mon.noname-a 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:43:10.824+0000 7f0fd637a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.172 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: dump: 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.173 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:43:10.824+0000 7f0ebbfff640 10 monclient: dump: 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.174 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7569 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:43:10.824+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:43:10.824+0000 7f0fd737c640 4 set_mon_vals no callback set 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:43:10.825+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:43:10.825+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:43:10.826+0000 7f0ebbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:43:10.826+0000 7f0ebbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:43:10.826+0000 7f0ebbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:43:10.827+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0eb0076380 auth_method 0 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: get_monmap_and_config 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: build_initial_monmap 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 1 build_initial for_mkfs: 0 2024-09-12T17:43:11.175 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: monmap: 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding auth protocol: cephx 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding auth protocol: cephx 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding auth protocol: cephx 2024-09-12T17:43:11.176 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: crc 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x561e61083200) adding con mode: secure 2024-09-12T17:43:11.177 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding auth protocol: cephx 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding auth protocol: cephx 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding auth protocol: cephx 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.178 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: crc 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:43:10.827+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e399ed0) adding con mode: secure 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key cmddesc rotate-key hook 0x7ffe8e39a018 EEXIST 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e610b76b0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e610884d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e610b2ae0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.179 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:43:10.828+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.344456s 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e610884d0 auth_method 0 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e610b76b0 auth_method 0 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e610b2ae0 auth_method 0 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.180 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:43:10.828+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:43:10.828+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient(hunting): handle_auth_done global_id 7132 payload 274 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:43:10.828+0000 7f0fd637a640 1 monclient: found mon.noname-b 2024-09-12T17:43:11.181 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:43:10.828+0000 7f0fd637a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: dump: 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.182 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7132 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 4 set_mon_vals no callback set 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:43:10.829+0000 7f0eb9ffb640 10 monclient: dump: 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.183 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: shutdown 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: build_initial_monmap 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 1 build_initial for_mkfs: 0 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 10 monclient: monmap: 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:11.184 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding auth protocol: cephx 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding auth protocol: cephx 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding auth protocol: cephx 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.185 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: crc 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:43:10.829+0000 7f0fdac0e800 5 AuthRegistry(0x561e610a7e80) adding con mode: secure 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: starting msgr at 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: starting objecter 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command objecter_requests cmddesc objecter_requests hook 0x561e610adc90 EEXIST 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: setting wanted keys 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 1 librados: calling monclient init 2024-09-12T17:43:11.186 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient: init 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding auth protocol: cephx 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding auth protocol: cephx 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding auth protocol: cephx 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: crc 2024-09-12T17:43:11.187 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 AuthRegistry(0x561e6107b140) adding con mode: secure 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command rotate-key cmddesc rotate-key hook 0x561e6107b288 EEXIST 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-b con 0x561e610884d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-a con 0x561e610b2ae0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): picked mon.noname-c con 0x561e610b76b0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:11.188 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:43:10.830+0000 7f0fdac0e800 10 monclient(hunting): authenticate will time out at 2083.346780s 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): get_auth_request con 0x561e610884d0 auth_method 0 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request con 0x561e610b76b0 auth_method 0 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request con 0x561e610b2ae0 auth_method 0 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.189 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:43:10.830+0000 7f0fd637a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:43:10.830+0000 7f0fd6b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:43:10.830+0000 7f0fd5b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:43:10.831+0000 7f0fd637a640 10 monclient(hunting): handle_auth_done global_id 7135 payload 824 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:43:10.831+0000 7f0fd637a640 10 monclient: _finish_hunting 0 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:43:10.831+0000 7f0fd637a640 1 monclient: found mon.noname-b 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:43:10.831+0000 7f0fd637a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.190 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: dump: 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: _finish_auth 0 2024-09-12T17:43:11.191 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:43:10.831+0000 7f0ea7fff640 10 monclient: dump: 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:11.192 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 5 monclient: authenticate success, global_id 7135 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:43:10.831+0000 7f0eb9ffb640 4 set_mon_vals no callback set 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _renew_subs 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 1 librados: init done 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:43:10.831+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cr dump hook 0x561e610b31a8 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:43:10.833+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:43:10.833+0000 7f0ea7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:43:10.833+0000 7f0ea7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:43:10.833+0000 7f0ea7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:11.193 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:43:10.834+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0ea0076470 auth_method 0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:43:10.834+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x561e610d0820 auth_method 0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 realm 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:43:10.834+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:43:10.835+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:43:10.835+0000 7f0fd637a640 10 monclient: get_auth_request con 0x561e610d4c40 auth_method 0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.194 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:43:10.836+0000 7f0fdac0e800 20 searching for the correct realm 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:43:10.836+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x561e610d9de0 auth_method 0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:43:10.837+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x7f0fcc06b020 auth_method 0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:43:10.838+0000 7f0fd637a640 10 monclient: get_auth_request con 0x7f0fc8034060 auth_method 0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:43:10.839+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0fcc0ad040 auth_method 0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:43:10.839+0000 7f0fd5b79640 0 -- 172.21.15.63:0/4187853511 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f0fcc0ad040 msgr2=0x7f0fcc0c6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:43:11.041+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x7f0fcc0ad040 auth_method 0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:43:11.043+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x7f0fc801d040 auth_method 0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:43:11.044+0000 7f0fd637a640 10 monclient: get_auth_request con 0x7f0fd0034040 auth_method 0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:43:11.045+0000 7f0fd6b7b640 0 -- 172.21.15.63:0/4187853511 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561e610d0820 msgr2=0x561e610d2ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:43:11.045+0000 7f0ea7fff640 1 client.7135.objecter ms_handle_reset 0x561e610d0820 session 0x561e610d01a0 osd.6 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:43:11.045+0000 7f0ea7fff640 10 monclient: _renew_subs 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:43:11.045+0000 7f0ea7fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.82:3300/0 2024-09-12T17:43:11.195 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:43:11.045+0000 7f0fd6b7b640 10 monclient: get_auth_request con 0x7f0ea0086710 auth_method 0 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:43:11.049+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:11.196 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 zone default found 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 Realm: () 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 zonegroup default 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:43:11.050+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 started sync module instance, tier type = 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:43:11.051+0000 7f0fdac0e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:11.197 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:43:11.056+0000 7f0ea7fff640 1 client.7135.objecter ms_handle_reset 0x7f0fcc0ad040 session 0x7f0fcc0d3920 osd.5 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:43:11.057+0000 7f0fd5b79640 10 monclient: get_auth_request con 0x561e610d0820 auth_method 0 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=0 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=1 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=2 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=3 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=4 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=5 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:43:11.060+0000 7f0fdac0e800 20 add_watcher() i=6 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:43:11.061+0000 7f0fdac0e800 20 add_watcher() i=7 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:43:11.061+0000 7f0fdac0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding auth protocol: cephx 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding auth protocol: cephx 2024-09-12T17:43:11.198 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding auth protocol: cephx 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: crc 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:43:11.062+0000 7f0fdac0e800 5 AuthRegistry(0x7ffe8e39a3a0) adding con mode: secure 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:43:11.062+0000 7f0e8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:11.199 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache list hook 0x561e610a70b0 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache inspect hook 0x561e610a70b0 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache erase hook 0x561e610a70b0 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command cache zap hook 0x561e610a70b0 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 note: GC not initialized 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:43:11.063+0000 7f0e077fe640 20 reqs_thread_entry: start 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace show hook 0x7f0fd0004720 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace history hook 0x7f0fd0004720 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace active hook 0x7f0fd0004720 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 5 asok(0x561e60dc6730) register_command sync trace active_short hook 0x7f0fd0004720 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:11.200 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 Filter name: none 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:43:11.063+0000 7f0e057fa640 20 reqs_thread_entry: start 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:43:11.063+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 : miss 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:11.201 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:43:11.064+0000 7f0fdac0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:43:11.070+0000 7f0fdac0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35, ofs0, ns] 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94688477305040 notifier 7135 bl.length()=995 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:43:11.070+0000 7f0eb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_sources= new_sources= 2024-09-12T17:43:11.202 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential sources added=[] removed=[] 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_dests= new_dests= 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:43:11.071+0000 7f0fdac0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential dests added=[] removed=[] 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:43:11.075+0000 7f0fdac0e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0fdac0e800 time 2024-09-12T17:43:11.077123+0000 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0fdbd8c71a] 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:43:11.203 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:43:11.076+0000 7f0fdac0e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0fdac0e800 thread_name:radosgw-admin 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0fdaa3e6f0] 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0fdaa8b99c] 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0fdbd8c774] 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0fdbd8c8d8] 2024-09-12T17:43:11.204 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e5fe83841] 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561e5fe9357a] 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0fdaa29590] 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:43:11.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:43:11.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:43:11.207 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:11.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:43:11.209 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:11.210 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:43:11.211 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0e057fa640 / http_manager 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0e077fe640 / http_manager 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0e8cfe1640 / rgw_dt_lg_renew 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ea7fff640 / ms_dispatch 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0eb9ffb640 / io_context_pool 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ebbfff640 / ms_dispatch 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ec2e05640 / ms_dispatch 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0ec4608640 / io_context_pool 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd5b79640 / msgr-worker-2 2024-09-12T17:43:11.212 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd637a640 / msgr-worker-1 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd6b7b640 / msgr-worker-0 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fd737c640 / io_context_pool 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0fdac0e800 / radosgw-admin 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:43:11.078553Z_232e6d3f-855a-4647-bc99-f963fd77f4a8/log 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:43:11.213 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:43:11.214 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.153+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 20 realm 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.155+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.156+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.156+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.156+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:11.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.156+0000 7fa86b10c800 20 searching for the correct realm 2024-09-12T17:43:11.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.159+0000 7fa8683f5640 0 -- 172.21.15.63:0/3033167247 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa85c0433c0 msgr2=0x7fa85c043840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:11.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.363+0000 7fa8693f7640 0 -- 172.21.15.63:0/3033167247 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56240812eb40 msgr2=0x562408130fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:11.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.367+0000 7fa86b10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:11.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.367+0000 7fa86b10c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:11.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.367+0000 7fa86b10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:11.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.367+0000 7fa86b10c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.367+0000 7fa86b10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.367+0000 7fa86b10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 zone default found 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 4 Realm: () 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:11.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 zonegroup default 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.368+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.369+0000 7fa86b10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.369+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.369+0000 7fa86b10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.369+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.369+0000 7fa86b10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.369+0000 7fa86b10c800 20 started sync module instance, tier type = 2024-09-12T17:43:11.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.369+0000 7fa86b10c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.377+0000 7fa86b10c800 20 add_watcher() i=0 2024-09-12T17:43:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.377+0000 7fa86b10c800 20 add_watcher() i=1 2024-09-12T17:43:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.377+0000 7fa86b10c800 20 add_watcher() i=2 2024-09-12T17:43:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.377+0000 7fa86b10c800 20 add_watcher() i=3 2024-09-12T17:43:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.377+0000 7fa86b10c800 20 add_watcher() i=4 2024-09-12T17:43:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.377+0000 7fa86b10c800 20 add_watcher() i=5 2024-09-12T17:43:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.377+0000 7fa86b10c800 20 add_watcher() i=6 2024-09-12T17:43:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.379+0000 7fa86b10c800 20 add_watcher() i=7 2024-09-12T17:43:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.379+0000 7fa86b10c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:11.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.380+0000 7fa71f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa86b10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa86b10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa86b10c800 5 note: GC not initialized 2024-09-12T17:43:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa71e7e4640 20 reqs_thread_entry: start 2024-09-12T17:43:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa86b10c800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa86b10c800 20 Filter name: none 2024-09-12T17:43:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa7177fe640 20 reqs_thread_entry: start 2024-09-12T17:43:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.381+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.382+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.382+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.382+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:43:11.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.382+0000 7fa86b10c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:11.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.382+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.383+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:11.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.383+0000 7fa86b10c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.383+0000 7fa86b10c800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:43:11.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.383+0000 7fa86b10c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.385+0000 7fa71f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.387+0000 7fa86b10c800 20 remove_watcher() i=0 2024-09-12T17:43:11.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.387+0000 7fa86b10c800 2 removed watcher, disabling cache 2024-09-12T17:43:11.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.388+0000 7fa86b10c800 20 remove_watcher() i=1 2024-09-12T17:43:11.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.389+0000 7fa86b10c800 20 remove_watcher() i=2 2024-09-12T17:43:11.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.390+0000 7fa86b10c800 20 remove_watcher() i=3 2024-09-12T17:43:11.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.391+0000 7fa86b10c800 20 remove_watcher() i=4 2024-09-12T17:43:11.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.392+0000 7fa86b10c800 20 remove_watcher() i=5 2024-09-12T17:43:11.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.393+0000 7fa86b10c800 20 remove_watcher() i=6 2024-09-12T17:43:11.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.394+0000 7fa86b10c800 20 remove_watcher() i=7 2024-09-12T17:43:11.406 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.406 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:11.406 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-do-reshard id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:11.406 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:11.460 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:11.493 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:11.493 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:11.532 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.530+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.531+0000 7f8bb8d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.531+0000 7f8bb8d75800 20 realm 2024-09-12T17:43:11.533 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.531+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.531+0000 7f8bb8d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.531+0000 7f8bb8d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:11.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.531+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.532+0000 7f8bb8d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.532+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.534 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.532+0000 7f8bb8d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.532+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.533+0000 7f8bb8d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:11.535 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.533+0000 7f8bb8d75800 20 searching for the correct realm 2024-09-12T17:43:11.537 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.535+0000 7f8bb6065640 0 -- 172.21.15.63:0/3168372286 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f8bac0dabb0 msgr2=0x7f8bac0dc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:11.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.741+0000 7f8bb6866640 0 -- 172.21.15.63:0/3168372286 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f8bb0036410 msgr2=0x7f8bb0036890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.948+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 20 zone default found 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 4 Realm: () 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 20 zonegroup default 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.949+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.950+0000 7f8bb8d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.950+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.950+0000 7f8bb8d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.950+0000 7f8bb8d75800 20 started sync module instance, tier type = 2024-09-12T17:43:11.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.950+0000 7f8bb8d75800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.959+0000 7f8bb8d75800 20 add_watcher() i=0 2024-09-12T17:43:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.959+0000 7f8bb8d75800 20 add_watcher() i=1 2024-09-12T17:43:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.959+0000 7f8bb8d75800 20 add_watcher() i=2 2024-09-12T17:43:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.959+0000 7f8bb8d75800 20 add_watcher() i=3 2024-09-12T17:43:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.959+0000 7f8bb8d75800 20 add_watcher() i=4 2024-09-12T17:43:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.959+0000 7f8bb8d75800 20 add_watcher() i=5 2024-09-12T17:43:11.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.959+0000 7f8bb8d75800 20 add_watcher() i=6 2024-09-12T17:43:11.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.960+0000 7f8bb8d75800 20 add_watcher() i=7 2024-09-12T17:43:11.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.960+0000 7f8bb8d75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:11.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.962+0000 7f8a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.962+0000 7f8bb8d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.962+0000 7f8bb8d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.962+0000 7f8bb8d75800 5 note: GC not initialized 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.962+0000 7f89e7fff640 20 reqs_thread_entry: start 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 20 Filter name: none 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f89e5ffb640 20 reqs_thread_entry: start 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:43:11.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:43:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:43:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 : miss 2024-09-12T17:43:11.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.963+0000 7f8bb8d75800 20 rados->read ofs=0 len=0 2024-09-12T17:43:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.964+0000 7f8bb8d75800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:43:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.964+0000 7f8bb8d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.964+0000 7f8bb8d75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.964+0000 7f8bb8d75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.964+0000 7f8bb8d75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:11.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.964+0000 7f8bb8d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 2024-09-12T17:43:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.965+0000 7f8bb8d75800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to be held by another RGW process; skipping for now 2024-09-12T17:43:11.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.966+0000 7f8a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.968+0000 7f8bb8d75800 20 remove_watcher() i=0 2024-09-12T17:43:11.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.968+0000 7f8bb8d75800 2 removed watcher, disabling cache 2024-09-12T17:43:11.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.970+0000 7f8bb8d75800 20 remove_watcher() i=1 2024-09-12T17:43:11.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.971+0000 7f8bb8d75800 20 remove_watcher() i=2 2024-09-12T17:43:11.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.972+0000 7f8bb8d75800 20 remove_watcher() i=3 2024-09-12T17:43:11.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.973+0000 7f8bb8d75800 20 remove_watcher() i=4 2024-09-12T17:43:11.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.974+0000 7f8bb8d75800 20 remove_watcher() i=5 2024-09-12T17:43:11.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.975+0000 7f8bb8d75800 20 remove_watcher() i=6 2024-09-12T17:43:11.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:11.976+0000 7f8bb8d75800 20 remove_watcher() i=7 2024-09-12T17:43:11.989 INFO:tasks.workunit.client.0.smithi063.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:43:42.013 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:42.049 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:42.049 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:42.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.093+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 20 realm 2024-09-12T17:43:42.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:42.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.095+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.096+0000 7f2472687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.096+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.096+0000 7f2472687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:42.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.096+0000 7f2472687800 20 searching for the correct realm 2024-09-12T17:43:42.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.101+0000 7f246f970640 0 -- 172.21.15.63:0/2125259301 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f2464084bf0 msgr2=0x7f2464070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.308+0000 7f2470972640 0 -- 172.21.15.63:0/2125259301 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x562f18761680 msgr2=0x562f18763a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:42.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:42.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:42.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:42.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:42.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:42.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.313+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 20 zone default found 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 4 Realm: () 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 20 zonegroup default 2024-09-12T17:43:42.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.314+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.315+0000 7f2472687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.315+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.315+0000 7f2472687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.315+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.315+0000 7f2472687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.315+0000 7f2472687800 20 started sync module instance, tier type = 2024-09-12T17:43:42.317 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.315+0000 7f2472687800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:42.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.326+0000 7f2472687800 20 add_watcher() i=0 2024-09-12T17:43:42.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.326+0000 7f2472687800 20 add_watcher() i=1 2024-09-12T17:43:42.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.326+0000 7f2472687800 20 add_watcher() i=2 2024-09-12T17:43:42.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.326+0000 7f2472687800 20 add_watcher() i=3 2024-09-12T17:43:42.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.326+0000 7f2472687800 20 add_watcher() i=4 2024-09-12T17:43:42.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.326+0000 7f2472687800 20 add_watcher() i=5 2024-09-12T17:43:42.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.326+0000 7f2472687800 20 add_watcher() i=6 2024-09-12T17:43:42.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.327+0000 7f2472687800 20 add_watcher() i=7 2024-09-12T17:43:42.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.327+0000 7f2472687800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:42.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.329+0000 7f2326fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2472687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:42.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2472687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:42.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2472687800 5 note: GC not initialized 2024-09-12T17:43:42.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2325fdb640 20 reqs_thread_entry: start 2024-09-12T17:43:42.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2472687800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:42.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2472687800 20 Filter name: none 2024-09-12T17:43:42.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f22977fe640 20 reqs_thread_entry: start 2024-09-12T17:43:42.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2472687800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:43:42.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.330+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 : miss 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.331+0000 7f2472687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 2024-09-12T17:43:42.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.332+0000 7f2472687800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:43:42.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.340+0000 7f2472687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:42.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.340+0000 7f2472687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:42.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.340+0000 7f2472687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.340+0000 7f2472687800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35, ofs0, ns] 2024-09-12T17:43:42.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f23477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94760273905040 notifier 7196 bl.length()=995 2024-09-12T17:43:42.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f23477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:42.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f23477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:42.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f23477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_sources= new_sources= 2024-09-12T17:43:42.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential sources added=[] removed=[] 2024-09-12T17:43:42.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_dests= new_dests= 2024-09-12T17:43:42.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.341+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential dests added=[] removed=[] 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.0 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.0 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.1 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.1 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.2 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.2 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.3 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.3 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.4 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.4 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.5 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.5 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.6 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.6 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.7 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.7 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.8 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.8 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.9 2024-09-12T17:43:42.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.9 2024-09-12T17:43:42.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.10 2024-09-12T17:43:42.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.10 2024-09-12T17:43:42.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.11 2024-09-12T17:43:42.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2.11 2024-09-12T17:43:42.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.0 2024-09-12T17:43:42.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.349+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.1 2024-09-12T17:43:42.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.350+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2 2024-09-12T17:43:42.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.350+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.3 2024-09-12T17:43:42.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.351+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.4 2024-09-12T17:43:42.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.352+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.5 2024-09-12T17:43:42.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.352+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.6 2024-09-12T17:43:42.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.353+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.7 2024-09-12T17:43:42.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.353+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.8 2024-09-12T17:43:42.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.354+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.9 2024-09-12T17:43:42.355 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.354+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.10 2024-09-12T17:43:42.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.358+0000 7f2472687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:42.359 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.358+0000 7f2472687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 2024-09-12T17:43:42.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.359+0000 7f2472687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.359+0000 7f2472687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.359+0000 7f2472687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.359+0000 7f2472687800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35, ofs0, ns] 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 94760273905040 notifier 7196 bl.length()=995 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2346ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2346ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2346ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_sources= new_sources= 2024-09-12T17:43:42.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential sources added=[] removed=[] 2024-09-12T17:43:42.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_dests= new_dests= 2024-09-12T17:43:42.362 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.360+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential dests added=[] removed=[] 2024-09-12T17:43:42.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.363+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.0 2024-09-12T17:43:42.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.363+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.1 2024-09-12T17:43:42.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.363+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.2 2024-09-12T17:43:42.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.364+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.3 2024-09-12T17:43:42.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.364+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.4 2024-09-12T17:43:42.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.364+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.5 2024-09-12T17:43:42.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.365+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.6 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.365+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.7 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.365+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.8 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.366+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.9 2024-09-12T17:43:42.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.366+0000 7f2472687800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35.10 2024-09-12T17:43:42.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.367+0000 7f2472687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:42.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.367+0000 7f2472687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 2024-09-12T17:43:42.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2472687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:42.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2472687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:42.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2472687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2472687800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35, ofs0, ns] 2024-09-12T17:43:42.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94760273905040 notifier 7196 bl.length()=963 2024-09-12T17:43:42.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2346ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 info.flags=0x17 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2346ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 to cache LRU end 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.368+0000 7f2346ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.369+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_sources= new_sources= 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.369+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential sources added=[] removed=[] 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.369+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): orig_dests= new_dests= 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.369+0000 7f2472687800 20 handle_bi_update(): bucket=:abort-at-do-reshard[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35]): potential dests added=[] removed=[] 2024-09-12T17:43:42.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.371+0000 7f2472687800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:42.374 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.373+0000 7f2326fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.375+0000 7f2472687800 20 remove_watcher() i=0 2024-09-12T17:43:42.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.375+0000 7f2472687800 2 removed watcher, disabling cache 2024-09-12T17:43:42.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.376+0000 7f2472687800 20 remove_watcher() i=1 2024-09-12T17:43:42.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.377+0000 7f2472687800 20 remove_watcher() i=2 2024-09-12T17:43:42.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.378+0000 7f2472687800 20 remove_watcher() i=3 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.379+0000 7f2472687800 20 remove_watcher() i=4 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.380+0000 7f2472687800 20 remove_watcher() i=5 2024-09-12T17:43:42.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.381+0000 7f2472687800 20 remove_watcher() i=6 2024-09-12T17:43:42.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.382+0000 7f2472687800 20 remove_watcher() i=7 2024-09-12T17:43:42.397 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:43:42.427 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:42.427 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.465+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.467+0000 7f6d25a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.467+0000 7f6d25a98800 20 realm 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.467+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.468+0000 7f6d25a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.468+0000 7f6d25a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.468+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.468+0000 7f6d25a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.468+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.469+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.469+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.469+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.469+0000 7f6d25a98800 20 searching for the correct realm 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.472+0000 7f6d22d81640 0 -- 172.21.15.63:0/2867743508 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f6d180b8470 msgr2=0x7f6d180adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.677+0000 7f6d22d81640 0 -- 172.21.15.63:0/2867743508 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55d8edefc040 msgr2=0x55d8edefe450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.681+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 20 zone default found 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 4 Realm: () 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:42.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 20 zonegroup default 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.682+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.683+0000 7f6d25a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.683+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.683+0000 7f6d25a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.683+0000 7f6d25a98800 20 started sync module instance, tier type = 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.683+0000 7f6d25a98800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.692+0000 7f6d25a98800 20 add_watcher() i=0 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.692+0000 7f6d25a98800 20 add_watcher() i=1 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.692+0000 7f6d25a98800 20 add_watcher() i=2 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.692+0000 7f6d25a98800 20 add_watcher() i=3 2024-09-12T17:43:42.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.692+0000 7f6d25a98800 20 add_watcher() i=4 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.692+0000 7f6d25a98800 20 add_watcher() i=5 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.692+0000 7f6d25a98800 20 add_watcher() i=6 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.693+0000 7f6d25a98800 20 add_watcher() i=7 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.693+0000 7f6d25a98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6d25a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6d25a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6d25a98800 5 note: GC not initialized 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6bd8fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6d25a98800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6d25a98800 20 Filter name: none 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6b527fc640 20 reqs_thread_entry: start 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.695+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.696+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.696+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.697+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.697+0000 7f6d25a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.697+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.697+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.697+0000 7f6d25a98800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.697+0000 7f6d25a98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.697+0000 7f6d25a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.699+0000 7f6bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.701+0000 7f6d25a98800 20 remove_watcher() i=0 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.701+0000 7f6d25a98800 2 removed watcher, disabling cache 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.702+0000 7f6d25a98800 20 remove_watcher() i=1 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.703+0000 7f6d25a98800 20 remove_watcher() i=2 2024-09-12T17:43:42.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.704+0000 7f6d25a98800 20 remove_watcher() i=3 2024-09-12T17:43:42.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.705+0000 7f6d25a98800 20 remove_watcher() i=4 2024-09-12T17:43:42.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.707+0000 7f6d25a98800 20 remove_watcher() i=5 2024-09-12T17:43:42.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.708+0000 7f6d25a98800 20 remove_watcher() i=6 2024-09-12T17:43:42.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:42.709+0000 7f6d25a98800 20 remove_watcher() i=7 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-do-reshard id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:42.721 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:42.797 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:43:42.797 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:43.021 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:43:43.051 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:43.051 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:43.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.089+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 20 realm 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.091+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.092+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.092+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.092+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:43.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.092+0000 7f892310c800 20 searching for the correct realm 2024-09-12T17:43:43.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.095+0000 7f891bfff640 0 -- 172.21.15.63:0/3894409630 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f890c097280 msgr2=0x7f890c067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:43.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.300+0000 7f89213f7640 0 -- 172.21.15.63:0/3894409630 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e709c71370 msgr2=0x55e709c73760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:43.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.304+0000 7f892310c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:43.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.304+0000 7f892310c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:43.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.304+0000 7f892310c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:43.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.304+0000 7f892310c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:43.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.304+0000 7f892310c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:43.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.304+0000 7f892310c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:43.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.304+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 zone default found 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 4 Realm: () 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 zonegroup default 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.305+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.306+0000 7f892310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.306+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.306+0000 7f892310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.306+0000 7f892310c800 20 started sync module instance, tier type = 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.306+0000 7f892310c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:43.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.315+0000 7f892310c800 20 add_watcher() i=0 2024-09-12T17:43:43.315 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.315+0000 7f892310c800 20 add_watcher() i=1 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.315+0000 7f892310c800 20 add_watcher() i=2 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.315+0000 7f892310c800 20 add_watcher() i=3 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.315+0000 7f892310c800 20 add_watcher() i=4 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.315+0000 7f892310c800 20 add_watcher() i=5 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.315+0000 7f892310c800 20 add_watcher() i=6 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.316+0000 7f892310c800 20 add_watcher() i=7 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.316+0000 7f892310c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:43.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.317+0000 7f87d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.317+0000 7f892310c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.317+0000 7f892310c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.317+0000 7f892310c800 5 note: GC not initialized 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.318+0000 7f87d67e4640 20 reqs_thread_entry: start 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.318+0000 7f892310c800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.318+0000 7f892310c800 20 Filter name: none 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.318+0000 7f87cf7fe640 20 reqs_thread_entry: start 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.318+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.318+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.318+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.319+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.319+0000 7f892310c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.319+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.319+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.319+0000 7f892310c800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.320+0000 7f892310c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:43.321 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.320+0000 7f892310c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:43.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.322+0000 7f87d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.324+0000 7f892310c800 20 remove_watcher() i=0 2024-09-12T17:43:43.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.324+0000 7f892310c800 2 removed watcher, disabling cache 2024-09-12T17:43:43.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.325+0000 7f892310c800 20 remove_watcher() i=1 2024-09-12T17:43:43.327 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.326+0000 7f892310c800 20 remove_watcher() i=2 2024-09-12T17:43:43.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.327+0000 7f892310c800 20 remove_watcher() i=3 2024-09-12T17:43:43.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.328+0000 7f892310c800 20 remove_watcher() i=4 2024-09-12T17:43:43.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.329+0000 7f892310c800 20 remove_watcher() i=5 2024-09-12T17:43:43.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.330+0000 7f892310c800 20 remove_watcher() i=6 2024-09-12T17:43:43.332 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.331+0000 7f892310c800 20 remove_watcher() i=7 2024-09-12T17:43:43.343 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:43.343 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:43.343 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-logrecord-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:43.343 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:43.344 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:43:43.379 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:43.379 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:43.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.417+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 20 realm 2024-09-12T17:43:43.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:43.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.418+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.419+0000 7f4f43739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.419+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.419+0000 7f4f43739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:43.421 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.419+0000 7f4f43739800 20 searching for the correct realm 2024-09-12T17:43:43.423 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.423+0000 7f4f3ebcd640 0 -- 172.21.15.63:0/3153513205 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f4f2808fb10 msgr2=0x7f4f28076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:43.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.629+0000 7f4f3fbcf640 0 -- 172.21.15.63:0/3153513205 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55a0d67f5040 msgr2=0x55a0d67f7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:43.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:43.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:43.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:43.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:43.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:43.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:43.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.633+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:43.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 zone default found 2024-09-12T17:43:43.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 4 Realm: () 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 zonegroup default 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.634+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.635+0000 7f4f43739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.635+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.635+0000 7f4f43739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.635+0000 7f4f43739800 20 started sync module instance, tier type = 2024-09-12T17:43:43.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.635+0000 7f4f43739800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:43.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.644+0000 7f4f43739800 20 add_watcher() i=0 2024-09-12T17:43:43.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.644+0000 7f4f43739800 20 add_watcher() i=1 2024-09-12T17:43:43.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.644+0000 7f4f43739800 20 add_watcher() i=2 2024-09-12T17:43:43.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.644+0000 7f4f43739800 20 add_watcher() i=3 2024-09-12T17:43:43.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.644+0000 7f4f43739800 20 add_watcher() i=4 2024-09-12T17:43:43.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.644+0000 7f4f43739800 20 add_watcher() i=5 2024-09-12T17:43:43.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.644+0000 7f4f43739800 20 add_watcher() i=6 2024-09-12T17:43:43.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.645+0000 7f4f43739800 20 add_watcher() i=7 2024-09-12T17:43:43.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.645+0000 7f4f43739800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:43.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.646+0000 7f4df5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4f43739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4f43739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4f43739800 5 note: GC not initialized 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4df4fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4f43739800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4f43739800 20 Filter name: none 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4d6e7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4f43739800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.647+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 : miss 2024-09-12T17:43:43.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:43.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:43.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:43.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:43.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:43.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.648+0000 7f4f43739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4f43739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4f43739800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4f43739800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4f43739800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36, ofs0, ns] 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 94149281804096 notifier 7692 bl.length()=1007 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.653+0000 7f4e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:43.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.654+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_sources= new_sources= 2024-09-12T17:43:43.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.654+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential sources added=[] removed=[] 2024-09-12T17:43:43.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.654+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_dests= new_dests= 2024-09-12T17:43:43.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.654+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential dests added=[] removed=[] 2024-09-12T17:43:43.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.656+0000 7f4f43739800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:43:43.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.656+0000 7f4f43739800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:43:43.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.660+0000 7f4f43739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:43.661 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.661+0000 7f4f43739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 2024-09-12T17:43:43.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4f43739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:43.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4f43739800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:43.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4f43739800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:43.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4f43739800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36, ofs0, ns] 2024-09-12T17:43:43.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4e227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 94149281804096 notifier 7692 bl.length()=975 2024-09-12T17:43:43.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4e227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:43.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4e227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:43.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.662+0000 7f4e227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:43.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.663+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_sources= new_sources= 2024-09-12T17:43:43.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.663+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential sources added=[] removed=[] 2024-09-12T17:43:43.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.663+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_dests= new_dests= 2024-09-12T17:43:43.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.663+0000 7f4f43739800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential dests added=[] removed=[] 2024-09-12T17:43:43.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.664+0000 7f4df5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.666+0000 7f4f43739800 20 remove_watcher() i=0 2024-09-12T17:43:43.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.666+0000 7f4f43739800 2 removed watcher, disabling cache 2024-09-12T17:43:43.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.667+0000 7f4f43739800 20 remove_watcher() i=1 2024-09-12T17:43:43.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.668+0000 7f4f43739800 20 remove_watcher() i=2 2024-09-12T17:43:43.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.670+0000 7f4f43739800 20 remove_watcher() i=3 2024-09-12T17:43:43.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.671+0000 7f4f43739800 20 remove_watcher() i=4 2024-09-12T17:43:43.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.672+0000 7f4f43739800 20 remove_watcher() i=5 2024-09-12T17:43:43.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.673+0000 7f4f43739800 20 remove_watcher() i=6 2024-09-12T17:43:43.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.674+0000 7f4f43739800 20 remove_watcher() i=7 2024-09-12T17:43:43.687 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:43:43.717 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:43.717 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:43.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.755+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 20 realm 2024-09-12T17:43:43.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:43.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.757+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.758+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.758+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.758+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:43.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.758+0000 7f72e1c11800 20 searching for the correct realm 2024-09-12T17:43:43.762 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.762+0000 7f72dcb47640 0 -- 172.21.15.63:0/524036459 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f72d4050b40 msgr2=0x7f72d408bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:43.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.967+0000 7f72ddb49640 0 -- 172.21.15.63:0/524036459 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5612762e8140 msgr2=0x5612762ea560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:43.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.971+0000 7f72e1c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:43.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.971+0000 7f72e1c11800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:43.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.971+0000 7f72e1c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:43.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.971+0000 7f72e1c11800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:43.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.971+0000 7f72e1c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:43.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.971+0000 7f72e1c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:43.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.971+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:43.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 zone default found 2024-09-12T17:43:43.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 4 Realm: () 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 zonegroup default 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.972+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.973+0000 7f72e1c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.973+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.973+0000 7f72e1c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.973+0000 7f72e1c11800 20 started sync module instance, tier type = 2024-09-12T17:43:43.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.973+0000 7f72e1c11800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:43.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.982+0000 7f72e1c11800 20 add_watcher() i=0 2024-09-12T17:43:43.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.982+0000 7f72e1c11800 20 add_watcher() i=1 2024-09-12T17:43:43.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.982+0000 7f72e1c11800 20 add_watcher() i=2 2024-09-12T17:43:43.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.982+0000 7f72e1c11800 20 add_watcher() i=3 2024-09-12T17:43:43.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.982+0000 7f72e1c11800 20 add_watcher() i=4 2024-09-12T17:43:43.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.982+0000 7f72e1c11800 20 add_watcher() i=5 2024-09-12T17:43:43.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.982+0000 7f72e1c11800 20 add_watcher() i=6 2024-09-12T17:43:43.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.983+0000 7f72e1c11800 20 add_watcher() i=7 2024-09-12T17:43:43.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.983+0000 7f72e1c11800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:43.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.984+0000 7f71937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f72e1c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:43.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f72e1c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:43.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f72e1c11800 5 note: GC not initialized 2024-09-12T17:43:43.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f71927e4640 20 reqs_thread_entry: start 2024-09-12T17:43:43.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f72e1c11800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:43.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f72e1c11800 20 Filter name: none 2024-09-12T17:43:43.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f7103fff640 20 reqs_thread_entry: start 2024-09-12T17:43:43.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.985+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.986+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:43.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.986+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.987+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:43.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.987+0000 7f72e1c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:43.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.987+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.987+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:43.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.987+0000 7f72e1c11800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.987+0000 7f72e1c11800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:43.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.987+0000 7f72e1c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:43.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.989+0000 7f71937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.992+0000 7f72e1c11800 20 remove_watcher() i=0 2024-09-12T17:43:43.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.992+0000 7f72e1c11800 2 removed watcher, disabling cache 2024-09-12T17:43:43.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.993+0000 7f72e1c11800 20 remove_watcher() i=1 2024-09-12T17:43:43.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.994+0000 7f72e1c11800 20 remove_watcher() i=2 2024-09-12T17:43:43.995 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.995+0000 7f72e1c11800 20 remove_watcher() i=3 2024-09-12T17:43:43.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.996+0000 7f72e1c11800 20 remove_watcher() i=4 2024-09-12T17:43:43.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.997+0000 7f72e1c11800 20 remove_watcher() i=5 2024-09-12T17:43:43.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.998+0000 7f72e1c11800 20 remove_watcher() i=6 2024-09-12T17:43:43.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:43.999+0000 7f72e1c11800 20 remove_watcher() i=7 2024-09-12T17:43:44.010 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:44.010 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:44.010 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-logrecord-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:44.010 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:44.063 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:44.096 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:44.096 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:44.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.133+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 20 realm 2024-09-12T17:43:44.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:44.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.135+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.136+0000 7f8956b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:44.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.136+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.136+0000 7f8956b36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:44.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.136+0000 7f8956b36800 20 searching for the correct realm 2024-09-12T17:43:44.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.140+0000 7f89520b6640 0 -- 172.21.15.63:0/1915565762 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f8948061400 msgr2=0x7f8948061860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:44.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.345+0000 7f89530b8640 0 -- 172.21.15.63:0/1915565762 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561453860770 msgr2=0x561453862c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:44.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:44.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:44.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:44.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:44.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:44.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:44.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:44.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.349+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 20 zone default found 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 4 Realm: () 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 20 zonegroup default 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.352 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.350+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.351+0000 7f8956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.351+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.351+0000 7f8956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.351+0000 7f8956b36800 20 started sync module instance, tier type = 2024-09-12T17:43:44.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.351+0000 7f8956b36800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:44.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.359+0000 7f8956b36800 20 add_watcher() i=0 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.359+0000 7f8956b36800 20 add_watcher() i=1 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.359+0000 7f8956b36800 20 add_watcher() i=2 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.359+0000 7f8956b36800 20 add_watcher() i=3 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.359+0000 7f8956b36800 20 add_watcher() i=4 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.359+0000 7f8956b36800 20 add_watcher() i=5 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.360+0000 7f8956b36800 20 add_watcher() i=6 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.360+0000 7f8956b36800 20 add_watcher() i=7 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.360+0000 7f8956b36800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:44.363 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.362+0000 7f88097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.362+0000 7f8956b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.362+0000 7f8956b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.362+0000 7f8956b36800 5 note: GC not initialized 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8783fff640 20 reqs_thread_entry: start 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 20 Filter name: none 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8781ffb640 20 reqs_thread_entry: start 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:43:44.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:44.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:43:44.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:43:44.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 : miss 2024-09-12T17:43:44.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.363+0000 7f8956b36800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.364+0000 7f8956b36800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:44.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.364+0000 7f8956b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:44.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.364+0000 7f8956b36800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:44.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.364+0000 7f8956b36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:44.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.364+0000 7f8956b36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:44.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.364+0000 7f8956b36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 2024-09-12T17:43:44.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8956b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:44.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8956b36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:44.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8956b36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:44.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8956b36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36, ofs0, ns] 2024-09-12T17:43:44.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8835ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 94645300635424 notifier 7734 bl.length()=1007 2024-09-12T17:43:44.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8835ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:44.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8835ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:44.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.370+0000 7f8835ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:44.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.371+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_sources= new_sources= 2024-09-12T17:43:44.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.371+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential sources added=[] removed=[] 2024-09-12T17:43:44.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.371+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_dests= new_dests= 2024-09-12T17:43:44.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.371+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential dests added=[] removed=[] 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.0 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.0 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.1 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.1 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.2 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.2 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.3 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.3 2024-09-12T17:43:44.377 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.4 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.4 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.5 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.5 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.6 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.6 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.7 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.7 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.8 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.8 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.9 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.9 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.10 2024-09-12T17:43:44.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.10 2024-09-12T17:43:44.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.11 2024-09-12T17:43:44.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1.11 2024-09-12T17:43:44.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.0 2024-09-12T17:43:44.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.376+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1 2024-09-12T17:43:44.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.377+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.2 2024-09-12T17:43:44.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.377+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.3 2024-09-12T17:43:44.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.378+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.4 2024-09-12T17:43:44.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.378+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.5 2024-09-12T17:43:44.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.379+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.6 2024-09-12T17:43:44.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.379+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.7 2024-09-12T17:43:44.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.379+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.8 2024-09-12T17:43:44.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.380+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.9 2024-09-12T17:43:44.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.380+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.10 2024-09-12T17:43:44.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.383+0000 7f8956b36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:44.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.383+0000 7f8956b36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 2024-09-12T17:43:44.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.384+0000 7f8956b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:44.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.384+0000 7f8956b36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:44.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.384+0000 7f8956b36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:44.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.384+0000 7f8956b36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36, ofs0, ns] 2024-09-12T17:43:44.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f88367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 94645300635424 notifier 7734 bl.length()=1007 2024-09-12T17:43:44.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f88367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:44.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f88367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:44.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f88367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:44.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_sources= new_sources= 2024-09-12T17:43:44.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential sources added=[] removed=[] 2024-09-12T17:43:44.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_dests= new_dests= 2024-09-12T17:43:44.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.385+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential dests added=[] removed=[] 2024-09-12T17:43:44.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.387+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.0 2024-09-12T17:43:44.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.388+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.1 2024-09-12T17:43:44.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.388+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.2 2024-09-12T17:43:44.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.388+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.3 2024-09-12T17:43:44.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.389+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.4 2024-09-12T17:43:44.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.389+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.5 2024-09-12T17:43:44.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.390+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.6 2024-09-12T17:43:44.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.390+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.7 2024-09-12T17:43:44.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.390+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.8 2024-09-12T17:43:44.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.390+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.9 2024-09-12T17:43:44.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.391+0000 7f8956b36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36.10 2024-09-12T17:43:44.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.391+0000 7f8956b36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:44.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.391+0000 7f8956b36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 2024-09-12T17:43:44.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.392+0000 7f8956b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:44.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.392+0000 7f8956b36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:44.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.392+0000 7f8956b36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:44.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.392+0000 7f8956b36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36, ofs0, ns] 2024-09-12T17:43:44.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f88367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94645300635424 notifier 7734 bl.length()=975 2024-09-12T17:43:44.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f88367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 info.flags=0x17 2024-09-12T17:43:44.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f88367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 to cache LRU end 2024-09-12T17:43:44.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f88367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:44.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_sources= new_sources= 2024-09-12T17:43:44.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential sources added=[] removed=[] 2024-09-12T17:43:44.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): orig_dests= new_dests= 2024-09-12T17:43:44.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.393+0000 7f8956b36800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36]): potential dests added=[] removed=[] 2024-09-12T17:43:44.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.395+0000 7f8956b36800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:44.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.397+0000 7f88097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:44.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.400+0000 7f8956b36800 20 remove_watcher() i=0 2024-09-12T17:43:44.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.400+0000 7f8956b36800 2 removed watcher, disabling cache 2024-09-12T17:43:44.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.401+0000 7f8956b36800 20 remove_watcher() i=1 2024-09-12T17:43:44.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.401+0000 7f8956b36800 20 remove_watcher() i=2 2024-09-12T17:43:44.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.402+0000 7f8956b36800 20 remove_watcher() i=3 2024-09-12T17:43:44.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.403+0000 7f8956b36800 20 remove_watcher() i=4 2024-09-12T17:43:44.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.404+0000 7f8956b36800 20 remove_watcher() i=5 2024-09-12T17:43:44.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.405+0000 7f8956b36800 20 remove_watcher() i=6 2024-09-12T17:43:44.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.406+0000 7f8956b36800 20 remove_watcher() i=7 2024-09-12T17:43:44.420 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:43:44.449 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:44.449 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:44.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.487+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.488+0000 7f8fce80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.488+0000 7f8fce80e800 20 realm 2024-09-12T17:43:44.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.488+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.489+0000 7f8fce80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.489+0000 7f8fce80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:44.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.489+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.489+0000 7f8fce80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.489+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.490+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:44.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.490+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.490+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:44.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.490+0000 7f8fce80e800 20 searching for the correct realm 2024-09-12T17:43:44.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.493+0000 7f8fc9658640 0 -- 172.21.15.63:0/1615380031 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f8fc0019410 msgr2=0x7f8fc0019890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:44.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.698+0000 7f8fc9658640 0 -- 172.21.15.63:0/1615380031 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x557ae3db8520 msgr2=0x557ae3dba960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:44.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.702+0000 7f8fce80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:44.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.702+0000 7f8fce80e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:44.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.702+0000 7f8fce80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:44.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.702+0000 7f8fce80e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:44.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.702+0000 7f8fce80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:44.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.702+0000 7f8fce80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:44.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.702+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:44.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:44.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 zone default found 2024-09-12T17:43:44.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 4 Realm: () 2024-09-12T17:43:44.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 zonegroup default 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.703+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.704+0000 7f8fce80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.704+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.704+0000 7f8fce80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.704+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.704+0000 7f8fce80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.704+0000 7f8fce80e800 20 started sync module instance, tier type = 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.704+0000 7f8fce80e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.713+0000 7f8fce80e800 20 add_watcher() i=0 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.713+0000 7f8fce80e800 20 add_watcher() i=1 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.713+0000 7f8fce80e800 20 add_watcher() i=2 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.713+0000 7f8fce80e800 20 add_watcher() i=3 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.713+0000 7f8fce80e800 20 add_watcher() i=4 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.713+0000 7f8fce80e800 20 add_watcher() i=5 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.713+0000 7f8fce80e800 20 add_watcher() i=6 2024-09-12T17:43:44.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.714+0000 7f8fce80e800 20 add_watcher() i=7 2024-09-12T17:43:44.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.714+0000 7f8fce80e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:44.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.716+0000 7f8e7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.716+0000 7f8fce80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.716+0000 7f8fce80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.716+0000 7f8fce80e800 5 note: GC not initialized 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.717+0000 7f8e7a7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.717+0000 7f8fce80e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.717+0000 7f8fce80e800 20 Filter name: none 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.717+0000 7f8debfff640 20 reqs_thread_entry: start 2024-09-12T17:43:44.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.717+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.717+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:44.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.717+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.718+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:44.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.718+0000 7f8fce80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:44.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.718+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.718+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:44.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.718+0000 7f8fce80e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:44.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.719+0000 7f8fce80e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:44.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.719+0000 7f8fce80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:44.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.721+0000 7f8e7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:44.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.723+0000 7f8fce80e800 20 remove_watcher() i=0 2024-09-12T17:43:44.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.723+0000 7f8fce80e800 2 removed watcher, disabling cache 2024-09-12T17:43:44.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.724+0000 7f8fce80e800 20 remove_watcher() i=1 2024-09-12T17:43:44.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.725+0000 7f8fce80e800 20 remove_watcher() i=2 2024-09-12T17:43:44.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.726+0000 7f8fce80e800 20 remove_watcher() i=3 2024-09-12T17:43:44.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.727+0000 7f8fce80e800 20 remove_watcher() i=4 2024-09-12T17:43:44.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.728+0000 7f8fce80e800 20 remove_watcher() i=5 2024-09-12T17:43:44.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.729+0000 7f8fce80e800 20 remove_watcher() i=6 2024-09-12T17:43:44.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:44.730+0000 7f8fce80e800 20 remove_watcher() i=7 2024-09-12T17:43:44.742 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:44.742 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:44.742 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-logrecord-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:44.742 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:44.819 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:43:44.819 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.048 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:43:45.075 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:45.075 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:45.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.112+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.114+0000 7fbc21e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.114+0000 7fbc21e87800 20 realm 2024-09-12T17:43:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.114+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.114+0000 7fbc21e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.114+0000 7fbc21e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.114+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.115+0000 7fbc21e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.115+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.115+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.115+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.115+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.115+0000 7fbc21e87800 20 searching for the correct realm 2024-09-12T17:43:45.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.118+0000 7fbc1f170640 0 -- 172.21.15.63:0/2423596546 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fbc1401a040 msgr2=0x7fbc1402a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:45.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.323+0000 7fbc20172640 0 -- 172.21.15.63:0/2423596546 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5560b7315270 msgr2=0x5560b73176e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:45.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:45.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:45.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:45.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:45.328 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:45.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:45.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.329 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.327+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:45.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:45.330 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 zone default found 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 4 Realm: () 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 zonegroup default 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.328+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.329+0000 7fbc21e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.329+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.329+0000 7fbc21e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.329+0000 7fbc21e87800 20 started sync module instance, tier type = 2024-09-12T17:43:45.331 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.329+0000 7fbc21e87800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:45.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.337+0000 7fbc21e87800 20 add_watcher() i=0 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 20 add_watcher() i=1 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 20 add_watcher() i=2 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 20 add_watcher() i=3 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 20 add_watcher() i=4 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 20 add_watcher() i=5 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 20 add_watcher() i=6 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 20 add_watcher() i=7 2024-09-12T17:43:45.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.338+0000 7fbc21e87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:45.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.340+0000 7fbad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:45.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fbc21e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:45.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fbc21e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:45.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fbc21e87800 5 note: GC not initialized 2024-09-12T17:43:45.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fbad4fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:45.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fbc21e87800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:45.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fbc21e87800 20 Filter name: none 2024-09-12T17:43:45.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fba4e7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:45.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.341+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.342+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.342+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.342+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.342+0000 7fbc21e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.342+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.343+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.343+0000 7fbc21e87800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.343+0000 7fbc21e87800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.343+0000 7fbc21e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:45.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.345+0000 7fbad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:45.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.347+0000 7fbc21e87800 20 remove_watcher() i=0 2024-09-12T17:43:45.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.347+0000 7fbc21e87800 2 removed watcher, disabling cache 2024-09-12T17:43:45.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.348+0000 7fbc21e87800 20 remove_watcher() i=1 2024-09-12T17:43:45.350 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.349+0000 7fbc21e87800 20 remove_watcher() i=2 2024-09-12T17:43:45.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.350+0000 7fbc21e87800 20 remove_watcher() i=3 2024-09-12T17:43:45.351 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.351+0000 7fbc21e87800 20 remove_watcher() i=4 2024-09-12T17:43:45.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.352+0000 7fbc21e87800 20 remove_watcher() i=5 2024-09-12T17:43:45.353 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.353+0000 7fbc21e87800 20 remove_watcher() i=6 2024-09-12T17:43:45.354 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.354+0000 7fbc21e87800 20 remove_watcher() i=7 2024-09-12T17:43:45.366 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.366 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:45.366 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-logrecord-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:45.366 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.367 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:43:45.401 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:45.402 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:45.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.439+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.440+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.442 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.440+0000 7f5554032800 20 realm 2024-09-12T17:43:45.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.440+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.440+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.440+0000 7f5554032800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:45.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.440+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.441+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.441+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.643+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:45.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.643+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.643+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:45.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.643+0000 7f5554032800 20 searching for the correct realm 2024-09-12T17:43:45.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.647+0000 7f5546b52640 0 -- 172.21.15.63:0/1147252090 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f553807b070 msgr2=0x7f553807b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:45.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.650+0000 7f554f353640 0 -- 172.21.15.63:0/1147252090 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f5548017070 msgr2=0x7f55480650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:45.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.856+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:45.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 zone default found 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 4 Realm: () 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 zonegroup default 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.858+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.861 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.858+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.858+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.858+0000 7f5554032800 20 started sync module instance, tier type = 2024-09-12T17:43:45.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.858+0000 7f5554032800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:45.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=0 2024-09-12T17:43:45.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=1 2024-09-12T17:43:45.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=2 2024-09-12T17:43:45.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=3 2024-09-12T17:43:45.868 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=4 2024-09-12T17:43:45.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=5 2024-09-12T17:43:45.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=6 2024-09-12T17:43:45.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.868+0000 7f5554032800 20 add_watcher() i=7 2024-09-12T17:43:45.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.868+0000 7f5554032800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:45.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.870+0000 7f5405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:45.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5554032800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:45.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5554032800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:45.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5554032800 5 note: GC not initialized 2024-09-12T17:43:45.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5404fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:45.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5554032800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:45.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5554032800 20 Filter name: none 2024-09-12T17:43:45.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f537e7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:45.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5554032800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:43:45.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.871+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 : miss 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:45.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.872+0000 7f5554032800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 2024-09-12T17:43:45.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:45.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5554032800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:45.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5554032800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:45.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5554032800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37, ofs0, ns] 2024-09-12T17:43:45.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94471587845360 notifier 7791 bl.length()=1007 2024-09-12T17:43:45.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:45.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:45.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:45.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_sources= new_sources= 2024-09-12T17:43:45.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential sources added=[] removed=[] 2024-09-12T17:43:45.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_dests= new_dests= 2024-09-12T17:43:45.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential dests added=[] removed=[] 2024-09-12T17:43:45.882 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5554032800 time 2024-09-12T17:43:45.882823+0000 2024-09-12T17:43:45.882 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:45.883 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:45.883 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5554d8c71a] 2024-09-12T17:43:45.883 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:45.883 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:45.883 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f5554032800 thread_name:radosgw-admin 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.882+0000 7f5554032800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5554032800 time 2024-09-12T17:43:45.882823+0000 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5554d8c71a] 2024-09-12T17:43:45.884 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:43:45.885 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.903 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5553a3e6f0] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5553a8b99c] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5554d8c774] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:43:45.904 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.883+0000 7f5554032800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f5554032800 thread_name:radosgw-admin 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5553a3e6f0] 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5553a8b99c] 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5554d8c774] 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:45.905 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:43:45.422+0000 7f5554032800 10 monclient: shutdown 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:43:45.423+0000 7f5554032800 5 asok(0x55ebe13d5730) unregister_commands rotate-key 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:43:45.423+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:43:45.423+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:43:45.423+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding auth protocol: cephx 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding auth protocol: cephx 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding auth protocol: cephx 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.907 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:43:45.423+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: starting msgr at 2024-09-12T17:43:45.908 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: starting objecter 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:43:45.423+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command objecter_requests hook 0x55ebe15fbd50 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: setting wanted keys 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: calling monclient init 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:43:45.423+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding auth protocol: cephx 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding auth protocol: cephx 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding auth protocol: cephx 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.909 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:43:45.423+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:43:45.424+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:43:45.424+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key hook 0x55ebe15f6b48 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe14ac090 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe14ac4e0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe15fcb60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.939179s 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe14ac090 auth_method 0 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe15fcb60 auth_method 0 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.911 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe14ac4e0 auth_method 0 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_done global_id 7782 payload 824 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.912 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:43:45.424+0000 7f554f353640 1 monclient: found mon.noname-a 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: dump: 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.913 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: _check_auth_tickets 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: dump: 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.914 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:43:45.424+0000 7f5554032800 5 monclient: authenticate success, global_id 7782 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:43:45.424+0000 7f543d60a640 4 set_mon_vals no callback set 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:43:45.424+0000 7f5554032800 1 librados: init done 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:43:45.426+0000 7f543be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:43:45.426+0000 7f543be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.915 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:43:45.426+0000 7f543be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:43:45.427+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f5434076470 auth_method 0 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:43:45.427+0000 7f554fb54640 10 monclient: get_auth_request con 0x55ebe1624a80 auth_method 0 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:43:45.428+0000 7f554f353640 10 monclient: get_auth_request con 0x55ebe1643120 auth_method 0 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:43:45.429+0000 7f5546b52640 10 monclient: get_auth_request con 0x55ebe1646980 auth_method 0 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:43:45.429+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:43:45.429+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:43:45.429+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding auth protocol: cephx 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding auth protocol: cephx 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding auth protocol: cephx 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.917 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:43:45.430+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:43:45.430+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe164fe00 EEXIST 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding auth protocol: cephx 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding auth protocol: cephx 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding auth protocol: cephx 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.918 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:43:45.430+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:43:45.430+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.919 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:43:45.430+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key cmddesc rotate-key hook 0x55ebe164b530 EEXIST 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe1673af0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe1675dc0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe16722c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.945933s 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe1673af0 auth_method 0 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe16722c0 auth_method 0 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe1675dc0 auth_method 0 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.921 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_done global_id 7313 payload 824 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:43:45.431+0000 7f554f353640 1 monclient: found mon.noname-c 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: dump: 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.922 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: _check_auth_tickets 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:45.923 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: dump: 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:43:45.431+0000 7f5554032800 5 monclient: authenticate success, global_id 7313 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:43:45.431+0000 7f5550355640 4 set_mon_vals no callback set 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:43:45.433+0000 7f5439602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:43:45.433+0000 7f5439602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:43:45.433+0000 7f5439602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:43:45.433+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f5428076380 auth_method 0 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:43:45.433+0000 7f5554032800 10 monclient: get_monmap_and_config 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:43:45.433+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:43:45.433+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:43:45.433+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.925 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding auth protocol: cephx 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding auth protocol: cephx 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding auth protocol: cephx 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:43:45.433+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.927 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding auth protocol: cephx 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding auth protocol: cephx 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding auth protocol: cephx 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.928 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:43:45.434+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:43:45.434+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:43:45.434+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key cmddesc rotate-key hook 0x7fffb5931c68 EEXIST 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe16c7f90 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe16b88e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe16c33c0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.929 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.949545s 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe16b88e0 auth_method 0 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe16c7f90 auth_method 0 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.930 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe16c33c0 auth_method 0 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_done global_id 7788 payload 274 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:43:45.434+0000 7f5546b52640 1 monclient: found mon.noname-a 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:45.931 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: dump: 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: dump: 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.933 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:43:45.435+0000 7f5554032800 5 monclient: authenticate success, global_id 7788 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:43:45.435+0000 7f5554032800 4 set_mon_vals no callback set 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: shutdown 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:43:45.435+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.934 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding auth protocol: cephx 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding auth protocol: cephx 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding auth protocol: cephx 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.935 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:43:45.436+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: starting msgr at 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: starting objecter 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:43:45.436+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe1697400 EEXIST 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: setting wanted keys 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: calling monclient init 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding auth protocol: cephx 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding auth protocol: cephx 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding auth protocol: cephx 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.937 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:43:45.436+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:43:45.436+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:43:45.436+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key cmddesc rotate-key hook 0x55ebe168b9e8 EEXIST 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe16b88e0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe16c33c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe16c7f90 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.938 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.951884s 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe16c7f90 auth_method 0 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe16c33c0 auth_method 0 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.939 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe16b88e0 auth_method 0 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_done global_id 7791 payload 824 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:43:45.437+0000 7f554fb54640 1 monclient: found mon.noname-a 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: dump: 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.941 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: _check_auth_tickets 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: dump: 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.942 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:43:45.437+0000 7f5554032800 5 monclient: authenticate success, global_id 7791 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:43:45.437+0000 7f5432ffd640 4 set_mon_vals no callback set 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:43:45.437+0000 7f5554032800 1 librados: init done 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:43:45.437+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cr dump hook 0x55ebe16bec88 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:43:45.439+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:43:45.439+0000 7f54317fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:45.943 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:43:45.439+0000 7f54317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:43:45.439+0000 7f54317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:43:45.440+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5418076470 auth_method 0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:43:45.440+0000 7f5546b52640 10 monclient: get_auth_request con 0x55ebe16e2370 auth_method 0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:43:45.440+0000 7f5554032800 20 realm 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:43:45.440+0000 7f5554032800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:43:45.441+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:43:45.441+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:43:45.642+0000 7f554f353640 10 monclient: get_auth_request con 0x55ebe16e65a0 auth_method 0 2024-09-12T17:43:45.944 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:43:45.643+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:43:45.643+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:43:45.643+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:43:45.643+0000 7f5554032800 20 searching for the correct realm 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:43:45.644+0000 7f5546b52640 10 monclient: get_auth_request con 0x55ebe16eb830 auth_method 0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:43:45.644+0000 7f554fb54640 10 monclient: get_auth_request con 0x7f5538090040 auth_method 0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:43:45.645+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5540018070 auth_method 0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:43:45.646+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f553807b070 auth_method 0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:43:45.647+0000 7f5546b52640 0 -- 172.21.15.63:0/1147252090 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f553807b070 msgr2=0x7f553807b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:43:45.647+0000 7f54317fa640 1 client.7791.objecter ms_handle_reset 0x7f553807b070 session 0x7f5538005040 osd.5 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:43:45.647+0000 7f54317fa640 10 monclient: _renew_subs 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:43:45.647+0000 7f54317fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:43:45.647+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f5418086790 auth_method 0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:43:45.648+0000 7f54317fa640 1 client.7791.objecter ms_handle_reset 0x7f5540018070 session 0x7f554005d330 osd.0 2024-09-12T17:43:45.945 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:43:45.648+0000 7f554f353640 10 monclient: get_auth_request con 0x7f553807b070 auth_method 0 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:43:45.649+0000 7f554fb54640 10 monclient: get_auth_request con 0x7f554003eb70 auth_method 0 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:43:45.650+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5548017070 auth_method 0 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:43:45.650+0000 7f554f353640 0 -- 172.21.15.63:0/1147252090 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f5548017070 msgr2=0x7f55480650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:43:45.851+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5548017070 auth_method 0 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:43:45.856+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:43:45.856+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.946 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:43:45.856+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:43:45.857+0000 7f5554032800 20 zone default found 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:43:45.857+0000 7f5554032800 4 Realm: () 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:43:45.857+0000 7f5554032800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:43:45.857+0000 7f5554032800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:43:45.857+0000 7f5554032800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:43:45.857+0000 7f5554032800 20 zonegroup default 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:43:45.858+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:43:45.858+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:43:45.858+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:43:45.858+0000 7f5554032800 20 started sync module instance, tier type = 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:43:45.858+0000 7f5554032800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=0 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=1 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=2 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=3 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=4 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=5 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=6 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:43:45.868+0000 7f5554032800 20 add_watcher() i=7 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:43:45.868+0000 7f5554032800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:45.948 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding auth protocol: cephx 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding auth protocol: cephx 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding auth protocol: cephx 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:43:45.870+0000 7f5405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:43:45.871+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:43:45.871+0000 7f5554032800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:43:45.871+0000 7f5554032800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache list hook 0x55ebe16bf690 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache inspect hook 0x55ebe16bf690 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache erase hook 0x55ebe16bf690 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache zap hook 0x55ebe16bf690 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:43:45.871+0000 7f5554032800 5 note: GC not initialized 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:43:45.871+0000 7f5404fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace show hook 0x7f55380567c0 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace history hook 0x7f55380567c0 2024-09-12T17:43:45.950 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace active hook 0x7f55380567c0 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace active_short hook 0x7f55380567c0 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:43:45.871+0000 7f5554032800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:43:45.871+0000 7f5554032800 20 Filter name: none 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:43:45.871+0000 7f537e7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:43:45.871+0000 7f5554032800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:43:45.871+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:43:45.872+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:43:45.872+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:43:45.872+0000 7f5554032800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:43:45.872+0000 7f5554032800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 : miss 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:43:45.872+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:43:45.872+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:45.951 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:43:45.872+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:43:45.872+0000 7f5554032800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:43:45.872+0000 7f5554032800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:43:45.872+0000 7f5554032800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:43:45.872+0000 7f5554032800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:43:45.878+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:43:45.878+0000 7f5554032800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:43:45.878+0000 7f5554032800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:43:45.878+0000 7f5554032800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37, ofs0, ns] 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94471587845360 notifier 7791 bl.length()=1007 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:45.952 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_sources= new_sources= 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential sources added=[] removed=[] 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_dests= new_dests= 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential dests added=[] removed=[] 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:43:45.882+0000 7f5554032800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5554032800 time 2024-09-12T17:43:45.882823+0000 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5554d8c71a] 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:43:45.883+0000 7f5554032800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f5554032800 thread_name:radosgw-admin 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5553a3e6f0] 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5553a8b99c] 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5554d8c774] 2024-09-12T17:43:45.954 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:43:45.955 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:43:45.956 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:45.958 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:45.960 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:43:45.961 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 7f537e7fc640 / http_manager 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5404fe1640 / http_manager 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5405fe3640 / rgw_dt_lg_renew 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 7f54317fa640 / ms_dispatch 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5432ffd640 / io_context_pool 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5439602640 / ms_dispatch 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: 7f543be07640 / ms_dispatch 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: 7f543d60a640 / io_context_pool 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5546b52640 / msgr-worker-2 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: 7f554f353640 / msgr-worker-1 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: 7f554fb54640 / msgr-worker-0 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5550355640 / io_context_pool 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5554032800 / radosgw-admin 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.135844.log 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:43:45.963 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:43:45.422+0000 7f5554032800 10 monclient: shutdown 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:43:45.423+0000 7f5554032800 5 asok(0x55ebe13d5730) unregister_commands rotate-key 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:43:45.423+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:43:45.423+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:43:45.423+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.964 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding auth protocol: cephx 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding auth protocol: cephx 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding auth protocol: cephx 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.965 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: crc 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15fd040) adding con mode: secure 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:43:45.423+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: starting msgr at 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: starting objecter 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:43:45.423+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command objecter_requests hook 0x55ebe15fbd50 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: setting wanted keys 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:43:45.423+0000 7f5554032800 1 librados: calling monclient init 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:43:45.423+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding auth protocol: cephx 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding auth protocol: cephx 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding auth protocol: cephx 2024-09-12T17:43:45.966 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: crc 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:43:45.423+0000 7f5554032800 5 AuthRegistry(0x55ebe15f6a00) adding con mode: secure 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:43:45.423+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:43:45.424+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.967 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:43:45.424+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key hook 0x55ebe15f6b48 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe14ac090 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe14ac4e0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe15fcb60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.939179s 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe14ac090 auth_method 0 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe15fcb60 auth_method 0 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:43:45.424+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe14ac4e0 auth_method 0 2024-09-12T17:43:45.969 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:43:45.424+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient(hunting): handle_auth_done global_id 7782 payload 824 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:43:45.424+0000 7f554f353640 1 monclient: found mon.noname-a 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:43:45.424+0000 7f554f353640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: dump: 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.970 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: _check_auth_tickets 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:43:45.424+0000 7f543be07640 10 monclient: dump: 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.971 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:43:45.424+0000 7f5554032800 5 monclient: authenticate success, global_id 7782 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:43:45.424+0000 7f543d60a640 4 set_mon_vals no callback set 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:43:45.424+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:43:45.424+0000 7f5554032800 1 librados: init done 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:43:45.426+0000 7f543be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:43:45.426+0000 7f543be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:43:45.426+0000 7f543be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:43:45.427+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f5434076470 auth_method 0 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:43:45.427+0000 7f554fb54640 10 monclient: get_auth_request con 0x55ebe1624a80 auth_method 0 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:43:45.428+0000 7f554f353640 10 monclient: get_auth_request con 0x55ebe1643120 auth_method 0 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:43:45.429+0000 7f5546b52640 10 monclient: get_auth_request con 0x55ebe1646980 auth_method 0 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:43:45.429+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:43:45.429+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:43:45.429+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.973 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding auth protocol: cephx 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding auth protocol: cephx 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding auth protocol: cephx 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.974 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: crc 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:43:45.429+0000 7f5554032800 5 AuthRegistry(0x55ebe164c390) adding con mode: secure 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:43:45.430+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:43:45.430+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe164fe00 EEXIST 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding auth protocol: cephx 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding auth protocol: cephx 2024-09-12T17:43:45.975 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding auth protocol: cephx 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: crc 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:43:45.430+0000 7f5554032800 5 AuthRegistry(0x55ebe164b3e8) adding con mode: secure 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:43:45.430+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:43:45.430+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:43:45.430+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key cmddesc rotate-key hook 0x55ebe164b530 EEXIST 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe1673af0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe1675dc0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe16722c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:43:45.430+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.945933s 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe1673af0 auth_method 0 2024-09-12T17:43:45.977 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe16722c0 auth_method 0 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe1675dc0 auth_method 0 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.978 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:43:45.431+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:43:45.431+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient(hunting): handle_auth_done global_id 7313 payload 824 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:43:45.431+0000 7f554f353640 1 monclient: found mon.noname-c 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:43:45.431+0000 7f554f353640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: dump: 2024-09-12T17:43:45.979 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: _check_auth_tickets 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:45.980 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:43:45.431+0000 7f5439602640 10 monclient: dump: 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:43:45.431+0000 7f5554032800 5 monclient: authenticate success, global_id 7313 2024-09-12T17:43:45.981 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:43:45.431+0000 7f5550355640 4 set_mon_vals no callback set 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:43:45.431+0000 7f5554032800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:43:45.433+0000 7f5439602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:43:45.433+0000 7f5439602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:43:45.433+0000 7f5439602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:43:45.433+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f5428076380 auth_method 0 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:43:45.433+0000 7f5554032800 10 monclient: get_monmap_and_config 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:43:45.433+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:43:45.433+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:43:45.433+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding auth protocol: cephx 2024-09-12T17:43:45.983 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding auth protocol: cephx 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding auth protocol: cephx 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: crc 2024-09-12T17:43:45.984 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:43:45.433+0000 7f5554032800 5 AuthRegistry(0x55ebe1693970) adding con mode: secure 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:43:45.433+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding auth protocol: cephx 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding auth protocol: cephx 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding auth protocol: cephx 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.985 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: crc 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:43:45.434+0000 7f5554032800 5 AuthRegistry(0x7fffb5931b20) adding con mode: secure 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:43:45.434+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:43:45.434+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:43:45.434+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key cmddesc rotate-key hook 0x7fffb5931c68 EEXIST 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe16c7f90 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe16b88e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe16c33c0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.986 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:43:45.434+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.949545s 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe16b88e0 auth_method 0 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe16c7f90 auth_method 0 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.987 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:43:45.434+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe16c33c0 auth_method 0 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:43:45.434+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient(hunting): handle_auth_done global_id 7788 payload 274 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:43:45.434+0000 7f5546b52640 1 monclient: found mon.noname-a 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:43:45.434+0000 7f5546b52640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.988 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: dump: 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.989 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:43:45.435+0000 7f5432ffd640 10 monclient: dump: 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:43:45.435+0000 7f5554032800 5 monclient: authenticate success, global_id 7788 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:43:45.435+0000 7f5554032800 4 set_mon_vals no callback set 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: shutdown 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: build_initial_monmap 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:43:45.435+0000 7f5554032800 1 build_initial for_mkfs: 0 2024-09-12T17:43:45.991 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:43:45.435+0000 7f5554032800 10 monclient: monmap: 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding auth protocol: cephx 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding auth protocol: cephx 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding auth protocol: cephx 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: crc 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:43:45.435+0000 7f5554032800 5 AuthRegistry(0x55ebe16974f0) adding con mode: secure 2024-09-12T17:43:45.993 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:43:45.436+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: starting msgr at 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: starting objecter 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:43:45.436+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe1697400 EEXIST 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: setting wanted keys 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:43:45.436+0000 7f5554032800 1 librados: calling monclient init 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient: init 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding auth protocol: cephx 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding auth protocol: cephx 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding auth protocol: cephx 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.994 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: crc 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:43:45.436+0000 7f5554032800 5 AuthRegistry(0x55ebe168b8a0) adding con mode: secure 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:43:45.436+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:43:45.436+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:43:45.436+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command rotate-key cmddesc rotate-key hook 0x55ebe168b9e8 EEXIST 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): picked mon.noname-b con 0x55ebe16b88e0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): picked mon.noname-c con 0x55ebe16c33c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): picked mon.noname-a con 0x55ebe16c7f90 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:43:45.436+0000 7f5554032800 10 monclient(hunting): authenticate will time out at 2117.951884s 2024-09-12T17:43:45.996 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): get_auth_request con 0x55ebe16c7f90 auth_method 0 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:43:45.436+0000 7f554fb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): get_auth_request con 0x55ebe16c33c0 auth_method 0 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.997 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:43:45.437+0000 7f5546b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): get_auth_request con 0x55ebe16b88e0 auth_method 0 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:43:45.437+0000 7f554f353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient(hunting): handle_auth_done global_id 7791 payload 824 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient: _finish_hunting 0 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:43:45.437+0000 7f554fb54640 1 monclient: found mon.noname-a 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:43:45.437+0000 7f554fb54640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:45.998 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: dump: 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: _finish_auth 0 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: _check_auth_tickets 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:43:45.437+0000 7f54317fa640 10 monclient: dump: 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:43:46.000 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:43:45.437+0000 7f5554032800 5 monclient: authenticate success, global_id 7791 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:43:45.437+0000 7f5432ffd640 4 set_mon_vals no callback set 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _renew_subs 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:43:45.437+0000 7f5554032800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:43:45.437+0000 7f5554032800 1 librados: init done 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:43:45.437+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cr dump hook 0x55ebe16bec88 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:43:45.439+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:43:45.439+0000 7f54317fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:43:45.439+0000 7f54317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:43:45.439+0000 7f54317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:43:46.001 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:43:45.440+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5418076470 auth_method 0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:43:45.440+0000 7f5546b52640 10 monclient: get_auth_request con 0x55ebe16e2370 auth_method 0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:43:45.440+0000 7f5554032800 20 realm 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:43:45.440+0000 7f5554032800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:43:45.440+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:43:45.441+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:43:45.441+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:43:45.642+0000 7f554f353640 10 monclient: get_auth_request con 0x55ebe16e65a0 auth_method 0 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:43:45.643+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:46.002 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:43:45.643+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:43:45.643+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:43:45.643+0000 7f5554032800 20 searching for the correct realm 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:43:45.644+0000 7f5546b52640 10 monclient: get_auth_request con 0x55ebe16eb830 auth_method 0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:43:45.644+0000 7f554fb54640 10 monclient: get_auth_request con 0x7f5538090040 auth_method 0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:43:45.645+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5540018070 auth_method 0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:43:45.646+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f553807b070 auth_method 0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:43:45.647+0000 7f5546b52640 0 -- 172.21.15.63:0/1147252090 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f553807b070 msgr2=0x7f553807b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:43:45.647+0000 7f54317fa640 1 client.7791.objecter ms_handle_reset 0x7f553807b070 session 0x7f5538005040 osd.5 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:43:45.647+0000 7f54317fa640 10 monclient: _renew_subs 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:43:45.647+0000 7f54317fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:43:45.647+0000 7f5546b52640 10 monclient: get_auth_request con 0x7f5418086790 auth_method 0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:43:45.648+0000 7f54317fa640 1 client.7791.objecter ms_handle_reset 0x7f5540018070 session 0x7f554005d330 osd.0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:43:45.648+0000 7f554f353640 10 monclient: get_auth_request con 0x7f553807b070 auth_method 0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:43:45.649+0000 7f554fb54640 10 monclient: get_auth_request con 0x7f554003eb70 auth_method 0 2024-09-12T17:43:46.003 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:43:45.650+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5548017070 auth_method 0 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:43:45.650+0000 7f554f353640 0 -- 172.21.15.63:0/1147252090 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f5548017070 msgr2=0x7f55480650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:43:45.851+0000 7f554f353640 10 monclient: get_auth_request con 0x7f5548017070 auth_method 0 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:43:45.856+0000 7f5554032800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:43:45.856+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:43:45.856+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:43:45.856+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.004 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:43:45.857+0000 7f5554032800 20 zone default found 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:43:45.857+0000 7f5554032800 4 Realm: () 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:43:45.857+0000 7f5554032800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:43:45.857+0000 7f5554032800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:43:45.857+0000 7f5554032800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:43:45.857+0000 7f5554032800 20 zonegroup default 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:43:45.857+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:43:45.858+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:43:45.858+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:43:45.858+0000 7f5554032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:43:45.858+0000 7f5554032800 20 started sync module instance, tier type = 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:43:45.858+0000 7f5554032800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=0 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=1 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=2 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=3 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=4 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=5 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:43:45.867+0000 7f5554032800 20 add_watcher() i=6 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:43:45.868+0000 7f5554032800 20 add_watcher() i=7 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:43:45.868+0000 7f5554032800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding auth protocol: cephx 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding auth protocol: cephx 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding auth protocol: cephx 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:46.006 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:43:45.870+0000 7f5405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: crc 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:43:45.870+0000 7f5554032800 5 AuthRegistry(0x7fffb5931ff0) adding con mode: secure 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:43:45.871+0000 7f5554032800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:43:45.871+0000 7f5554032800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:43:45.871+0000 7f5554032800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:46.007 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache list hook 0x55ebe16bf690 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache inspect hook 0x55ebe16bf690 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache erase hook 0x55ebe16bf690 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command cache zap hook 0x55ebe16bf690 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:43:45.871+0000 7f5554032800 5 note: GC not initialized 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:43:45.871+0000 7f5404fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace show hook 0x7f55380567c0 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace history hook 0x7f55380567c0 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace active hook 0x7f55380567c0 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:43:45.871+0000 7f5554032800 5 asok(0x55ebe13d5730) register_command sync trace active_short hook 0x7f55380567c0 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:43:45.871+0000 7f5554032800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:43:45.871+0000 7f5554032800 20 Filter name: none 2024-09-12T17:43:46.008 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:43:45.871+0000 7f537e7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:43:45.871+0000 7f5554032800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:43:45.871+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:43:45.872+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:43:45.872+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:43:45.872+0000 7f5554032800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:43:45.872+0000 7f5554032800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 : miss 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:43:45.872+0000 7f5554032800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:43:45.872+0000 7f5554032800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:43:45.872+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:43:45.872+0000 7f5554032800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:43:45.872+0000 7f5554032800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:43:45.872+0000 7f5554032800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:43:45.872+0000 7f5554032800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 2024-09-12T17:43:46.009 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:43:45.878+0000 7f5554032800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:43:45.878+0000 7f5554032800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:43:45.878+0000 7f5554032800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:43:45.878+0000 7f5554032800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37, ofs0, ns] 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94471587845360 notifier 7791 bl.length()=1007 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:43:45.878+0000 7f5432ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_sources= new_sources= 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential sources added=[] removed=[] 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_dests= new_dests= 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:43:45.879+0000 7f5554032800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential dests added=[] removed=[] 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:43:45.882+0000 7f5554032800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5554032800 time 2024-09-12T17:43:45.882823+0000 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:46.010 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5554d8c71a] 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:43:45.883+0000 7f5554032800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f5554032800 thread_name:radosgw-admin 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:46.011 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5553a3e6f0] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5553a8b99c] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5554d8c774] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5554d8c8d8] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe0473841] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x55ebe098190c] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe048350d] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5553a29590] 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:46.013 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:46.014 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:46.015 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:46.017 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:43:46.018 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 7f537e7fc640 / http_manager 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5404fe1640 / http_manager 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5405fe3640 / rgw_dt_lg_renew 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 7f54317fa640 / ms_dispatch 2024-09-12T17:43:46.019 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5432ffd640 / io_context_pool 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5439602640 / ms_dispatch 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f543be07640 / ms_dispatch 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f543d60a640 / io_context_pool 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5546b52640 / msgr-worker-2 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f554f353640 / msgr-worker-1 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f554fb54640 / msgr-worker-0 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5550355640 / io_context_pool 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: 7f5554032800 / radosgw-admin 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:43:45.884503Z_5c03304c-e789-4a8d-89d9-41f7c2d3e3e7/log 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:43:46.020 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.961+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 20 realm 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.963+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.964+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:46.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.964+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.964+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:46.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.964+0000 7f09bdb2a800 20 searching for the correct realm 2024-09-12T17:43:46.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:45.968+0000 7f09b8f60640 0 -- 172.21.15.63:0/603087971 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f09a4062920 msgr2=0x7f09a40803f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:46.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.174+0000 7f09b9f62640 0 -- 172.21.15.63:0/603087971 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x562e296a01c0 msgr2=0x562e296a2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.180 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 zone default found 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 4 Realm: () 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 zonegroup default 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.178+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.179+0000 7f09bdb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.179+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.179+0000 7f09bdb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.179+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.179+0000 7f09bdb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.179+0000 7f09bdb2a800 20 started sync module instance, tier type = 2024-09-12T17:43:46.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.179+0000 7f09bdb2a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:46.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.187+0000 7f09bdb2a800 20 add_watcher() i=0 2024-09-12T17:43:46.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.187+0000 7f09bdb2a800 20 add_watcher() i=1 2024-09-12T17:43:46.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.187+0000 7f09bdb2a800 20 add_watcher() i=2 2024-09-12T17:43:46.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.187+0000 7f09bdb2a800 20 add_watcher() i=3 2024-09-12T17:43:46.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.187+0000 7f09bdb2a800 20 add_watcher() i=4 2024-09-12T17:43:46.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.187+0000 7f09bdb2a800 20 add_watcher() i=5 2024-09-12T17:43:46.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.188+0000 7f09bdb2a800 20 add_watcher() i=6 2024-09-12T17:43:46.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.188+0000 7f09bdb2a800 20 add_watcher() i=7 2024-09-12T17:43:46.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.188+0000 7f09bdb2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:46.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.190+0000 7f086ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:46.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.190+0000 7f09bdb2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:46.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.190+0000 7f09bdb2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:46.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.190+0000 7f09bdb2a800 5 note: GC not initialized 2024-09-12T17:43:46.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.191+0000 7f086efe5640 20 reqs_thread_entry: start 2024-09-12T17:43:46.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.191+0000 7f09bdb2a800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:46.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.191+0000 7f09bdb2a800 20 Filter name: none 2024-09-12T17:43:46.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.191+0000 7f086cfe1640 20 reqs_thread_entry: start 2024-09-12T17:43:46.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.191+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.191+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:46.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.191+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.192+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:43:46.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.192+0000 7f09bdb2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:46.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.192+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.192+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:46.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.192+0000 7f09bdb2a800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.192+0000 7f09bdb2a800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:43:46.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.192+0000 7f09bdb2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:46.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.194+0000 7f086ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:46.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.196+0000 7f09bdb2a800 20 remove_watcher() i=0 2024-09-12T17:43:46.197 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.196+0000 7f09bdb2a800 2 removed watcher, disabling cache 2024-09-12T17:43:46.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.197+0000 7f09bdb2a800 20 remove_watcher() i=1 2024-09-12T17:43:46.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.198+0000 7f09bdb2a800 20 remove_watcher() i=2 2024-09-12T17:43:46.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.199+0000 7f09bdb2a800 20 remove_watcher() i=3 2024-09-12T17:43:46.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.200+0000 7f09bdb2a800 20 remove_watcher() i=4 2024-09-12T17:43:46.202 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.201+0000 7f09bdb2a800 20 remove_watcher() i=5 2024-09-12T17:43:46.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.202+0000 7f09bdb2a800 20 remove_watcher() i=6 2024-09-12T17:43:46.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.203+0000 7f09bdb2a800 20 remove_watcher() i=7 2024-09-12T17:43:46.215 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:46.215 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:43:46.215 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-logrecord-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:46.215 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:43:46.269 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:46.301 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:46.301 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:46.341 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.340+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.341+0000 7f2a40487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.341+0000 7f2a40487800 20 realm 2024-09-12T17:43:46.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.341+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.342+0000 7f2a40487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.342+0000 7f2a40487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:46.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.342+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.342+0000 7f2a40487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.342+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.342+0000 7f2a40487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:46.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.342+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.343+0000 7f2a40487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:46.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.343+0000 7f2a40487800 20 searching for the correct realm 2024-09-12T17:43:46.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.344+0000 7f2a3df71640 0 -- 172.21.15.63:0/3615574193 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x55a9550313d0 msgr2=0x55a9550337c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:46.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.348+0000 7f2a3e772640 0 -- 172.21.15.63:0/3615574193 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x7f2a30060040 msgr2=0x7f2a3008e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:46.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:46.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:43:46.556 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.555+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:46.557 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:46.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 zone default found 2024-09-12T17:43:46.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 4 Realm: () 2024-09-12T17:43:46.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:43:46.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:43:46.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:46.559 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 zonegroup default 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.556+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.557+0000 7f2a40487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.557+0000 7f2a40487800 20 started sync module instance, tier type = 2024-09-12T17:43:46.560 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.557+0000 7f2a40487800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:43:46.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.565+0000 7f2a40487800 20 add_watcher() i=0 2024-09-12T17:43:46.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.565+0000 7f2a40487800 20 add_watcher() i=1 2024-09-12T17:43:46.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.565+0000 7f2a40487800 20 add_watcher() i=2 2024-09-12T17:43:46.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.565+0000 7f2a40487800 20 add_watcher() i=3 2024-09-12T17:43:46.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.565+0000 7f2a40487800 20 add_watcher() i=4 2024-09-12T17:43:46.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.565+0000 7f2a40487800 20 add_watcher() i=5 2024-09-12T17:43:46.566 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.565+0000 7f2a40487800 20 add_watcher() i=6 2024-09-12T17:43:46.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.566+0000 7f2a40487800 20 add_watcher() i=7 2024-09-12T17:43:46.567 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.566+0000 7f2a40487800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:46.568 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.568+0000 7f28f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.568+0000 7f2a40487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.568+0000 7f2a40487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.568+0000 7f2a40487800 5 note: GC not initialized 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.568+0000 7f28f2fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.568+0000 7f2a40487800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 20 Filter name: none 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f28f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:43:46.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:43:46.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:43:46.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 : miss 2024-09-12T17:43:46.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 20 rados->read ofs=0 len=0 2024-09-12T17:43:46.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:43:46.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:43:46.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:43:46.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:46.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:46.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.569+0000 7f2a40487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 2024-09-12T17:43:46.572 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.570+0000 7f2a40487800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to be held by another RGW process; skipping for now 2024-09-12T17:43:46.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.571+0000 7f28f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:46.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.573+0000 7f2a40487800 20 remove_watcher() i=0 2024-09-12T17:43:46.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.573+0000 7f2a40487800 2 removed watcher, disabling cache 2024-09-12T17:43:46.575 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.574+0000 7f2a40487800 20 remove_watcher() i=1 2024-09-12T17:43:46.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.575+0000 7f2a40487800 20 remove_watcher() i=2 2024-09-12T17:43:46.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.576+0000 7f2a40487800 20 remove_watcher() i=3 2024-09-12T17:43:46.578 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.577+0000 7f2a40487800 20 remove_watcher() i=4 2024-09-12T17:43:46.579 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.578+0000 7f2a40487800 20 remove_watcher() i=5 2024-09-12T17:43:46.580 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.579+0000 7f2a40487800 20 remove_watcher() i=6 2024-09-12T17:43:46.581 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:43:46.580+0000 7f2a40487800 20 remove_watcher() i=7 2024-09-12T17:43:46.591 INFO:tasks.workunit.client.0.smithi063.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:44:16.616 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:16.652 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:16.652 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:16.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.696+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 20 realm 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.698+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.699+0000 7f8757b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.699+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.699+0000 7f8757b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:16.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.699+0000 7f8757b26800 20 searching for the correct realm 2024-09-12T17:44:16.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.703+0000 7f875306e640 0 -- 172.21.15.63:0/3851303908 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f87480b4fa0 msgr2=0x7f87480b2bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.909+0000 7f8754070640 0 -- 172.21.15.63:0/3851303908 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559cb727a4a0 msgr2=0x559cb727c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.914+0000 7f8757b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:16.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.914+0000 7f8757b26800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:16.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.914+0000 7f8757b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:16.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.914+0000 7f8757b26800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:16.915 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.914+0000 7f8757b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:16.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.914+0000 7f8757b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:16.916 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.914+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.915+0000 7f8757b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.915+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.915+0000 7f8757b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.915+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.915+0000 7f8757b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 zone default found 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 4 Realm: () 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:16.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:16.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:16.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 zonegroup default 2024-09-12T17:44:16.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 started sync module instance, tier type = 2024-09-12T17:44:16.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.916+0000 7f8757b26800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:16.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.926+0000 7f8757b26800 20 add_watcher() i=0 2024-09-12T17:44:16.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.926+0000 7f8757b26800 20 add_watcher() i=1 2024-09-12T17:44:16.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.926+0000 7f8757b26800 20 add_watcher() i=2 2024-09-12T17:44:16.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.926+0000 7f8757b26800 20 add_watcher() i=3 2024-09-12T17:44:16.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.926+0000 7f8757b26800 20 add_watcher() i=4 2024-09-12T17:44:16.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.926+0000 7f8757b26800 20 add_watcher() i=5 2024-09-12T17:44:16.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.926+0000 7f8757b26800 20 add_watcher() i=6 2024-09-12T17:44:16.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.928+0000 7f8757b26800 20 add_watcher() i=7 2024-09-12T17:44:16.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.928+0000 7f8757b26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:16.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.930+0000 7f8609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.930+0000 7f8757b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.930+0000 7f8757b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.930+0000 7f8757b26800 5 note: GC not initialized 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.930+0000 7f8608fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.930+0000 7f8757b26800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 20 Filter name: none 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f85827fc640 20 reqs_thread_entry: start 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:44:16.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:44:16.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:44:16.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 : miss 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.931+0000 7f8757b26800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.932+0000 7f8757b26800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.932+0000 7f8757b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.932+0000 7f8757b26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.932+0000 7f8757b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.932+0000 7f8757b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.932+0000 7f8757b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 2024-09-12T17:44:16.935 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.933+0000 7f8757b26800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:44:16.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:44:16.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:44:16.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37, ofs0, ns] 2024-09-12T17:44:16.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f86327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94131576157824 notifier 7370 bl.length()=1007 2024-09-12T17:44:16.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f86327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:44:16.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f86327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:44:16.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f86327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_sources= new_sources= 2024-09-12T17:44:16.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential sources added=[] removed=[] 2024-09-12T17:44:16.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_dests= new_dests= 2024-09-12T17:44:16.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.941+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential dests added=[] removed=[] 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.0 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.0 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.1 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.1 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.2 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.2 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.3 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.3 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.4 2024-09-12T17:44:16.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.4 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.5 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.5 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.6 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.6 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.7 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.7 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.8 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.8 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.9 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.9 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.10 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.10 2024-09-12T17:44:16.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.11 2024-09-12T17:44:16.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2.11 2024-09-12T17:44:16.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.0 2024-09-12T17:44:16.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.948+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.1 2024-09-12T17:44:16.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.949+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2 2024-09-12T17:44:16.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.949+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.3 2024-09-12T17:44:16.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.950+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.4 2024-09-12T17:44:16.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.950+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.5 2024-09-12T17:44:16.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.951+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.6 2024-09-12T17:44:16.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.952+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.7 2024-09-12T17:44:16.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.952+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.8 2024-09-12T17:44:16.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.953+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.9 2024-09-12T17:44:16.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.953+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.10 2024-09-12T17:44:16.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.957+0000 7f8757b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:16.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.957+0000 7f8757b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 2024-09-12T17:44:16.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8757b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:44:16.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8757b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:44:16.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8757b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8757b26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37, ofs0, ns] 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8632ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94131576157824 notifier 7370 bl.length()=1007 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8632ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8632ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.958+0000 7f8632ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.959+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_sources= new_sources= 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.959+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential sources added=[] removed=[] 2024-09-12T17:44:16.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.959+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_dests= new_dests= 2024-09-12T17:44:16.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.959+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential dests added=[] removed=[] 2024-09-12T17:44:16.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.963+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.0 2024-09-12T17:44:16.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.964+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.1 2024-09-12T17:44:16.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.964+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.2 2024-09-12T17:44:16.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.964+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.3 2024-09-12T17:44:16.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.965+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.4 2024-09-12T17:44:16.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.965+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.5 2024-09-12T17:44:16.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.965+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.6 2024-09-12T17:44:16.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.966+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.7 2024-09-12T17:44:16.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.966+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.8 2024-09-12T17:44:16.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.966+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.9 2024-09-12T17:44:16.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.967+0000 7f8757b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37.10 2024-09-12T17:44:16.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.967+0000 7f8757b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:16.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.967+0000 7f8757b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.968+0000 7f8757b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.968+0000 7f8757b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.968+0000 7f8757b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.968+0000 7f8757b26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37, ofs0, ns] 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8632ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94131576157824 notifier 7370 bl.length()=975 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8632ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 info.flags=0x17 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8632ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 to cache LRU end 2024-09-12T17:44:16.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8632ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_sources= new_sources= 2024-09-12T17:44:16.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential sources added=[] removed=[] 2024-09-12T17:44:16.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): orig_dests= new_dests= 2024-09-12T17:44:16.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.969+0000 7f8757b26800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37]): potential dests added=[] removed=[] 2024-09-12T17:44:16.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.972+0000 7f8757b26800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:16.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.974+0000 7f8609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.976+0000 7f8757b26800 20 remove_watcher() i=0 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.976+0000 7f8757b26800 2 removed watcher, disabling cache 2024-09-12T17:44:16.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.977+0000 7f8757b26800 20 remove_watcher() i=1 2024-09-12T17:44:16.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.979+0000 7f8757b26800 20 remove_watcher() i=2 2024-09-12T17:44:16.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.980+0000 7f8757b26800 20 remove_watcher() i=3 2024-09-12T17:44:16.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.981+0000 7f8757b26800 20 remove_watcher() i=4 2024-09-12T17:44:16.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.982+0000 7f8757b26800 20 remove_watcher() i=5 2024-09-12T17:44:16.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.983+0000 7f8757b26800 20 remove_watcher() i=6 2024-09-12T17:44:16.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:16.984+0000 7f8757b26800 20 remove_watcher() i=7 2024-09-12T17:44:16.998 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:44:17.028 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:17.028 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:17.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.066+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.068+0000 7fdf10d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.068+0000 7fdf10d2c800 20 realm 2024-09-12T17:44:17.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.068+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.068+0000 7fdf10d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.068+0000 7fdf10d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:17.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.068+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.069+0000 7fdf10d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.069+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.069+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:17.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.069+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.070+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:17.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.070+0000 7fdf10d2c800 20 searching for the correct realm 2024-09-12T17:44:17.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.073+0000 7fdf07fff640 0 -- 172.21.15.63:0/1736953597 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fdef80c6be0 msgr2=0x7fdef80be130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:17.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.277+0000 7fdf0ca4f640 0 -- 172.21.15.63:0/1736953597 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fdf08018040 msgr2=0x7fdf08037440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:17.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:17.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:17.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:17.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:17.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:17.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:17.485 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.484+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 zone default found 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 4 Realm: () 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:17.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 zonegroup default 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.485+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.486+0000 7fdf10d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.486+0000 7fdf10d2c800 20 started sync module instance, tier type = 2024-09-12T17:44:17.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.486+0000 7fdf10d2c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:17.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.495+0000 7fdf10d2c800 20 add_watcher() i=0 2024-09-12T17:44:17.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.495+0000 7fdf10d2c800 20 add_watcher() i=1 2024-09-12T17:44:17.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.495+0000 7fdf10d2c800 20 add_watcher() i=2 2024-09-12T17:44:17.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.495+0000 7fdf10d2c800 20 add_watcher() i=3 2024-09-12T17:44:17.496 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.495+0000 7fdf10d2c800 20 add_watcher() i=4 2024-09-12T17:44:17.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.495+0000 7fdf10d2c800 20 add_watcher() i=5 2024-09-12T17:44:17.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.495+0000 7fdf10d2c800 20 add_watcher() i=6 2024-09-12T17:44:17.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.496+0000 7fdf10d2c800 20 add_watcher() i=7 2024-09-12T17:44:17.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.496+0000 7fdf10d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:17.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.498+0000 7fddc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.498+0000 7fdf10d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.498+0000 7fdf10d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.498+0000 7fdf10d2c800 5 note: GC not initialized 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.499+0000 7fddc27e4640 20 reqs_thread_entry: start 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.499+0000 7fdf10d2c800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.499+0000 7fdf10d2c800 20 Filter name: none 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.499+0000 7fddbbfff640 20 reqs_thread_entry: start 2024-09-12T17:44:17.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.499+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.499+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:44:17.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.499+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.500+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:44:17.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.500+0000 7fdf10d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:17.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.500+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.500+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:44:17.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.500+0000 7fdf10d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.501+0000 7fdf10d2c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:44:17.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.501+0000 7fdf10d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:17.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.503+0000 7fddc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:17.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.505+0000 7fdf10d2c800 20 remove_watcher() i=0 2024-09-12T17:44:17.506 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.505+0000 7fdf10d2c800 2 removed watcher, disabling cache 2024-09-12T17:44:17.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.506+0000 7fdf10d2c800 20 remove_watcher() i=1 2024-09-12T17:44:17.508 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.507+0000 7fdf10d2c800 20 remove_watcher() i=2 2024-09-12T17:44:17.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.508+0000 7fdf10d2c800 20 remove_watcher() i=3 2024-09-12T17:44:17.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.509+0000 7fdf10d2c800 20 remove_watcher() i=4 2024-09-12T17:44:17.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.510+0000 7fdf10d2c800 20 remove_watcher() i=5 2024-09-12T17:44:17.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.511+0000 7fdf10d2c800 20 remove_watcher() i=6 2024-09-12T17:44:17.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.512+0000 7fdf10d2c800 20 remove_watcher() i=7 2024-09-12T17:44:17.524 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:17.524 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:17.524 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-logrecord-writes id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:44:17.524 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:17.602 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:44:17.603 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:17.819 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:44:17.849 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:17.849 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:17.887 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.886+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.888+0000 7fba47a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.888+0000 7fba47a20800 20 realm 2024-09-12T17:44:17.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.888+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.889 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.888+0000 7fba47a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.888+0000 7fba47a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:17.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.888+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.889+0000 7fba47a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.889+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.889+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:17.890 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.889+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.889+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:17.891 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.889+0000 7fba47a20800 20 searching for the correct realm 2024-09-12T17:44:17.893 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.893+0000 7fba45511640 0 -- 172.21.15.63:0/3105776986 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fba3803d070 msgr2=0x7fba380903b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:17.896 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:17.896+0000 7fba45511640 0 -- 172.21.15.63:0/3105776986 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fba40015030 msgr2=0x7fba40041460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:18.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:18.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:18.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.103+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 zone default found 2024-09-12T17:44:18.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 4 Realm: () 2024-09-12T17:44:18.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:18.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:18.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 zonegroup default 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.104+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.105+0000 7fba47a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.105+0000 7fba47a20800 20 started sync module instance, tier type = 2024-09-12T17:44:18.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.105+0000 7fba47a20800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:18.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.113+0000 7fba47a20800 20 add_watcher() i=0 2024-09-12T17:44:18.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.113+0000 7fba47a20800 20 add_watcher() i=1 2024-09-12T17:44:18.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.113+0000 7fba47a20800 20 add_watcher() i=2 2024-09-12T17:44:18.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.113+0000 7fba47a20800 20 add_watcher() i=3 2024-09-12T17:44:18.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.113+0000 7fba47a20800 20 add_watcher() i=4 2024-09-12T17:44:18.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.113+0000 7fba47a20800 20 add_watcher() i=5 2024-09-12T17:44:18.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.113+0000 7fba47a20800 20 add_watcher() i=6 2024-09-12T17:44:18.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.114+0000 7fba47a20800 20 add_watcher() i=7 2024-09-12T17:44:18.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.114+0000 7fba47a20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.116+0000 7fb8fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.116+0000 7fba47a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.116+0000 7fba47a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.117+0000 7fba47a20800 5 note: GC not initialized 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.117+0000 7fb8fafe5640 20 reqs_thread_entry: start 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.117+0000 7fba47a20800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.117+0000 7fba47a20800 20 Filter name: none 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.117+0000 7fb8f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:18.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.117+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.118+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.118+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.118+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.118+0000 7fba47a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.118+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.118+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.118+0000 7fba47a20800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.119+0000 7fba47a20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.119+0000 7fba47a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.121+0000 7fb8fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.123+0000 7fba47a20800 20 remove_watcher() i=0 2024-09-12T17:44:18.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.123+0000 7fba47a20800 2 removed watcher, disabling cache 2024-09-12T17:44:18.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.124+0000 7fba47a20800 20 remove_watcher() i=1 2024-09-12T17:44:18.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.125+0000 7fba47a20800 20 remove_watcher() i=2 2024-09-12T17:44:18.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.126+0000 7fba47a20800 20 remove_watcher() i=3 2024-09-12T17:44:18.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.127+0000 7fba47a20800 20 remove_watcher() i=4 2024-09-12T17:44:18.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.128+0000 7fba47a20800 20 remove_watcher() i=5 2024-09-12T17:44:18.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.129+0000 7fba47a20800 20 remove_watcher() i=6 2024-09-12T17:44:18.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.130+0000 7fba47a20800 20 remove_watcher() i=7 2024-09-12T17:44:18.141 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:18.141 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:18.141 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:18.141 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:18.143 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:44:18.180 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:18.180 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:18.219 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.218+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 20 realm 2024-09-12T17:44:18.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.221 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:18.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.220+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.221+0000 7fef7e211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.222 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.221+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.221+0000 7fef7e211800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:18.223 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.221+0000 7fef7e211800 20 searching for the correct realm 2024-09-12T17:44:18.224 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.223+0000 7fef79992640 0 -- 172.21.15.63:0/762786676 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x5585be4dea60 msgr2=0x5585be4e0e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:18.227 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.226+0000 7fef7a193640 0 -- 172.21.15.63:0/762786676 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x7fef6c0a1040 msgr2=0x7fef6c0a4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:18.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:18.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.434+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 zone default found 2024-09-12T17:44:18.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 4 Realm: () 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 zonegroup default 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.435+0000 7fef7e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.436+0000 7fef7e211800 20 started sync module instance, tier type = 2024-09-12T17:44:18.438 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.436+0000 7fef7e211800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:18.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.444+0000 7fef7e211800 20 add_watcher() i=0 2024-09-12T17:44:18.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.444+0000 7fef7e211800 20 add_watcher() i=1 2024-09-12T17:44:18.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.444+0000 7fef7e211800 20 add_watcher() i=2 2024-09-12T17:44:18.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.444+0000 7fef7e211800 20 add_watcher() i=3 2024-09-12T17:44:18.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.444+0000 7fef7e211800 20 add_watcher() i=4 2024-09-12T17:44:18.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.444+0000 7fef7e211800 20 add_watcher() i=5 2024-09-12T17:44:18.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.444+0000 7fef7e211800 20 add_watcher() i=6 2024-09-12T17:44:18.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.445+0000 7fef7e211800 20 add_watcher() i=7 2024-09-12T17:44:18.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.445+0000 7fef7e211800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.447+0000 7fee2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.447+0000 7fef7e211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.447+0000 7fef7e211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.447+0000 7fef7e211800 5 note: GC not initialized 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fee2a7fc640 20 reqs_thread_entry: start 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 20 Filter name: none 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fed9bfff640 20 reqs_thread_entry: start 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 : miss 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.448+0000 7fef7e211800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.449+0000 7fef7e211800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.449+0000 7fef7e211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.449+0000 7fef7e211800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.449+0000 7fef7e211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.449+0000 7fef7e211800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.449+0000 7fef7e211800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38, ofs0, ns] 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fee5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 94032911794368 notifier 7418 bl.length()=1015 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fee5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fee5cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:18.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fee5cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_sources= new_sources= 2024-09-12T17:44:18.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential sources added=[] removed=[] 2024-09-12T17:44:18.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_dests= new_dests= 2024-09-12T17:44:18.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.454+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential dests added=[] removed=[] 2024-09-12T17:44:18.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.0 2024-09-12T17:44:18.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.0 2024-09-12T17:44:18.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.1 2024-09-12T17:44:18.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.1 2024-09-12T17:44:18.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.2 2024-09-12T17:44:18.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.2 2024-09-12T17:44:18.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.3 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.3 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.4 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.4 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.5 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.5 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.6 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.6 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.7 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.7 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.8 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.8 2024-09-12T17:44:18.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.9 2024-09-12T17:44:18.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.9 2024-09-12T17:44:18.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.10 2024-09-12T17:44:18.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.10 2024-09-12T17:44:18.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.11 2024-09-12T17:44:18.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.11 2024-09-12T17:44:18.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.0 2024-09-12T17:44:18.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.459+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1 2024-09-12T17:44:18.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.460+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.2 2024-09-12T17:44:18.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.460+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.3 2024-09-12T17:44:18.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.461+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.4 2024-09-12T17:44:18.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.461+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.5 2024-09-12T17:44:18.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.462+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.6 2024-09-12T17:44:18.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.462+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.7 2024-09-12T17:44:18.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.463+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.8 2024-09-12T17:44:18.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.463+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.9 2024-09-12T17:44:18.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.464+0000 7fef7e211800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.10 2024-09-12T17:44:18.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.467+0000 7fef7e211800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:44:18.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.467+0000 7fef7e211800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:44:18.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.476+0000 7fef7e211800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:18.477 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.476+0000 7fef7e211800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 2024-09-12T17:44:18.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fef7e211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:18.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fef7e211800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:18.478 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fef7e211800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fef7e211800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38, ofs0, ns] 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fee5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431607 cookie 94032911794368 notifier 7418 bl.length()=983 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fee5d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fee5d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.477+0000 7fee5d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.478+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_sources= new_sources= 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.478+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential sources added=[] removed=[] 2024-09-12T17:44:18.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.478+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_dests= new_dests= 2024-09-12T17:44:18.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.478+0000 7fef7e211800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential dests added=[] removed=[] 2024-09-12T17:44:18.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.478+0000 7fef7e211800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:44:18.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.480+0000 7fee2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.482+0000 7fef7e211800 20 remove_watcher() i=0 2024-09-12T17:44:18.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.482+0000 7fef7e211800 2 removed watcher, disabling cache 2024-09-12T17:44:18.483 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.483+0000 7fef7e211800 20 remove_watcher() i=1 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.484+0000 7fef7e211800 20 remove_watcher() i=2 2024-09-12T17:44:18.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.485+0000 7fef7e211800 20 remove_watcher() i=3 2024-09-12T17:44:18.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.485+0000 7fef7e211800 20 remove_watcher() i=4 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.486+0000 7fef7e211800 20 remove_watcher() i=5 2024-09-12T17:44:18.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.487+0000 7fef7e211800 20 remove_watcher() i=6 2024-09-12T17:44:18.489 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.488+0000 7fef7e211800 20 remove_watcher() i=7 2024-09-12T17:44:18.501 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.570+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.571+0000 7f6b94e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.571+0000 7f6b94e0e800 20 realm 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.571+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.572+0000 7f6b94e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.572+0000 7f6b94e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.572+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.572+0000 7f6b94e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.572+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.573+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.573+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.573+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.573+0000 7f6b94e0e800 20 searching for the correct realm 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.576+0000 7f6b8fc58640 0 -- 172.21.15.63:0/2935086339 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f6b84057400 msgr2=0x7f6b84057880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:18.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.780+0000 7f6b8fc58640 0 -- 172.21.15.63:0/2935086339 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x557c4504a600 msgr2=0x557c4504ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:18.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.784+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 zone default found 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 4 Realm: () 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 zonegroup default 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.785+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.786+0000 7f6b94e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.786+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.786+0000 7f6b94e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.786+0000 7f6b94e0e800 20 started sync module instance, tier type = 2024-09-12T17:44:18.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.786+0000 7f6b94e0e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:18.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.795+0000 7f6b94e0e800 20 add_watcher() i=0 2024-09-12T17:44:18.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.795+0000 7f6b94e0e800 20 add_watcher() i=1 2024-09-12T17:44:18.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.795+0000 7f6b94e0e800 20 add_watcher() i=2 2024-09-12T17:44:18.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.795+0000 7f6b94e0e800 20 add_watcher() i=3 2024-09-12T17:44:18.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.795+0000 7f6b94e0e800 20 add_watcher() i=4 2024-09-12T17:44:18.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.795+0000 7f6b94e0e800 20 add_watcher() i=5 2024-09-12T17:44:18.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.795+0000 7f6b94e0e800 20 add_watcher() i=6 2024-09-12T17:44:18.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.796+0000 7f6b94e0e800 20 add_watcher() i=7 2024-09-12T17:44:18.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.796+0000 7f6b94e0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.797+0000 7f6a46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f6b94e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f6b94e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f6b94e0e800 5 note: GC not initialized 2024-09-12T17:44:18.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f6a45fdb640 20 reqs_thread_entry: start 2024-09-12T17:44:18.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f6b94e0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f6b94e0e800 20 Filter name: none 2024-09-12T17:44:18.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f69b77fe640 20 reqs_thread_entry: start 2024-09-12T17:44:18.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.798+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.799+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.799+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.799+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.799+0000 7f6b94e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.799+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.800+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.800+0000 7f6b94e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.800+0000 7f6b94e0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.800+0000 7f6b94e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.802+0000 7f6a46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.804+0000 7f6b94e0e800 20 remove_watcher() i=0 2024-09-12T17:44:18.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.804+0000 7f6b94e0e800 2 removed watcher, disabling cache 2024-09-12T17:44:18.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.805+0000 7f6b94e0e800 20 remove_watcher() i=1 2024-09-12T17:44:18.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.806+0000 7f6b94e0e800 20 remove_watcher() i=2 2024-09-12T17:44:18.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.807+0000 7f6b94e0e800 20 remove_watcher() i=3 2024-09-12T17:44:18.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.808+0000 7f6b94e0e800 20 remove_watcher() i=4 2024-09-12T17:44:18.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.809+0000 7f6b94e0e800 20 remove_watcher() i=5 2024-09-12T17:44:18.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.810+0000 7f6b94e0e800 20 remove_watcher() i=6 2024-09-12T17:44:18.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.811+0000 7f6b94e0e800 20 remove_watcher() i=7 2024-09-12T17:44:18.823 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:18.823 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:18.823 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:18.823 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:18.876 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:18.908 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:18.908 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:18.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.946+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.948+0000 7fd2ef7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.948+0000 7fd2ef7af800 20 realm 2024-09-12T17:44:18.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.948+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.948+0000 7fd2ef7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.948+0000 7fd2ef7af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:18.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.948+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.949+0000 7fd2ef7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.949+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.949+0000 7fd2ef7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.949+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.950+0000 7fd2ef7af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:18.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.950+0000 7fd2ef7af800 20 searching for the correct realm 2024-09-12T17:44:18.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:18.952+0000 7fd2ed299640 0 -- 172.21.15.63:0/2549753578 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fd2e0049610 msgr2=0x7fd2e0062240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:19.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.157+0000 7fd2ed299640 0 -- 172.21.15.63:0/2549753578 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fd2e800e070 msgr2=0x7fd2e8024920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:19.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:19.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:19.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:19.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:19.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:19.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:19.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:19.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.364+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:19.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 zone default found 2024-09-12T17:44:19.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 4 Realm: () 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 zonegroup default 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.365+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.366+0000 7fd2ef7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.366+0000 7fd2ef7af800 20 started sync module instance, tier type = 2024-09-12T17:44:19.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.366+0000 7fd2ef7af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:19.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.374+0000 7fd2ef7af800 20 add_watcher() i=0 2024-09-12T17:44:19.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.374+0000 7fd2ef7af800 20 add_watcher() i=1 2024-09-12T17:44:19.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.374+0000 7fd2ef7af800 20 add_watcher() i=2 2024-09-12T17:44:19.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.374+0000 7fd2ef7af800 20 add_watcher() i=3 2024-09-12T17:44:19.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.374+0000 7fd2ef7af800 20 add_watcher() i=4 2024-09-12T17:44:19.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.374+0000 7fd2ef7af800 20 add_watcher() i=5 2024-09-12T17:44:19.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.374+0000 7fd2ef7af800 20 add_watcher() i=6 2024-09-12T17:44:19.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.375+0000 7fd2ef7af800 20 add_watcher() i=7 2024-09-12T17:44:19.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.375+0000 7fd2ef7af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:19.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.377+0000 7fd19ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:19.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.377+0000 7fd2ef7af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:19.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.377+0000 7fd2ef7af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:19.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.377+0000 7fd2ef7af800 5 note: GC not initialized 2024-09-12T17:44:19.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.377+0000 7fd19efe5640 20 reqs_thread_entry: start 2024-09-12T17:44:19.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.377+0000 7fd2ef7af800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:19.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 20 Filter name: none 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd19cfe1640 20 reqs_thread_entry: start 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 : miss 2024-09-12T17:44:19.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.378+0000 7fd2ef7af800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.379+0000 7fd2ef7af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:19.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.379+0000 7fd2ef7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:19.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.379+0000 7fd2ef7af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:19.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.379+0000 7fd2ef7af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:19.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.379+0000 7fd2ef7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:19.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.379+0000 7fd2ef7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 2024-09-12T17:44:19.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.383+0000 7fd2ef7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.383+0000 7fd2ef7af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.383+0000 7fd2ef7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.383+0000 7fd2ef7af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38, ofs0, ns] 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd1bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431608 cookie 94730975062848 notifier 7938 bl.length()=1015 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd1bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd1bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd1bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_sources= new_sources= 2024-09-12T17:44:19.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential sources added=[] removed=[] 2024-09-12T17:44:19.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_dests= new_dests= 2024-09-12T17:44:19.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.384+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential dests added=[] removed=[] 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.0 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.0 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.1 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.1 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.2 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.2 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.3 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.3 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.4 2024-09-12T17:44:19.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.4 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.5 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.5 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.6 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.6 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.7 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.7 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.8 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.8 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.9 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.9 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.10 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.10 2024-09-12T17:44:19.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.11 2024-09-12T17:44:19.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1.11 2024-09-12T17:44:19.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.0 2024-09-12T17:44:19.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1 2024-09-12T17:44:19.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.389+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.2 2024-09-12T17:44:19.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.390+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.3 2024-09-12T17:44:19.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.391+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.4 2024-09-12T17:44:19.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.391+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.5 2024-09-12T17:44:19.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.392+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.6 2024-09-12T17:44:19.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.392+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.7 2024-09-12T17:44:19.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.392+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.8 2024-09-12T17:44:19.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.393+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.9 2024-09-12T17:44:19.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.393+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.10 2024-09-12T17:44:19.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.396+0000 7fd2ef7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:19.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.397+0000 7fd2ef7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38, ofs0, ns] 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd1bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94730975062848 notifier 7938 bl.length()=1015 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd1bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd1bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:19.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd1bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:19.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_sources= new_sources= 2024-09-12T17:44:19.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential sources added=[] removed=[] 2024-09-12T17:44:19.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_dests= new_dests= 2024-09-12T17:44:19.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.398+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential dests added=[] removed=[] 2024-09-12T17:44:19.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.401+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.0 2024-09-12T17:44:19.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.401+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.1 2024-09-12T17:44:19.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.401+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.2 2024-09-12T17:44:19.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.402+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.3 2024-09-12T17:44:19.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.402+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.4 2024-09-12T17:44:19.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.402+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.5 2024-09-12T17:44:19.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.402+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.6 2024-09-12T17:44:19.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.403+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.7 2024-09-12T17:44:19.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.403+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.8 2024-09-12T17:44:19.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.403+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.9 2024-09-12T17:44:19.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.404+0000 7fd2ef7af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38.10 2024-09-12T17:44:19.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.404+0000 7fd2ef7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:19.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.404+0000 7fd2ef7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38, ofs0, ns] 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd1bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 94730975062848 notifier 7938 bl.length()=983 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd1bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 info.flags=0x17 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd1bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 to cache LRU end 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd1bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:19.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_sources= new_sources= 2024-09-12T17:44:19.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential sources added=[] removed=[] 2024-09-12T17:44:19.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): orig_dests= new_dests= 2024-09-12T17:44:19.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.406+0000 7fd2ef7af800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38]): potential dests added=[] removed=[] 2024-09-12T17:44:19.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.408+0000 7fd2ef7af800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:19.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.410+0000 7fd19ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:19.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.412+0000 7fd2ef7af800 20 remove_watcher() i=0 2024-09-12T17:44:19.413 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.412+0000 7fd2ef7af800 2 removed watcher, disabling cache 2024-09-12T17:44:19.414 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.413+0000 7fd2ef7af800 20 remove_watcher() i=1 2024-09-12T17:44:19.415 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.414+0000 7fd2ef7af800 20 remove_watcher() i=2 2024-09-12T17:44:19.416 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.415+0000 7fd2ef7af800 20 remove_watcher() i=3 2024-09-12T17:44:19.417 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.416+0000 7fd2ef7af800 20 remove_watcher() i=4 2024-09-12T17:44:19.418 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.417+0000 7fd2ef7af800 20 remove_watcher() i=5 2024-09-12T17:44:19.419 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.418+0000 7fd2ef7af800 20 remove_watcher() i=6 2024-09-12T17:44:19.420 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.419+0000 7fd2ef7af800 20 remove_watcher() i=7 2024-09-12T17:44:19.433 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:44:19.462 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:19.463 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:19.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.500+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 20 realm 2024-09-12T17:44:19.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:19.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.502+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.504 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.503+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:19.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.503+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.503+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:19.505 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.503+0000 7fbcf9d30800 20 searching for the correct realm 2024-09-12T17:44:19.507 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.506+0000 7fbceffff640 0 -- 172.21.15.63:0/1547633463 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fbce002d070 msgr2=0x7fbce003aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:19.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.711+0000 7fbcf62b1640 0 -- 172.21.15.63:0/1547633463 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55f4db925120 msgr2=0x55f4db927570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:19.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.715+0000 7fbcf9d30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.715+0000 7fbcf9d30800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.715+0000 7fbcf9d30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.715+0000 7fbcf9d30800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.715+0000 7fbcf9d30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.715+0000 7fbcf9d30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.715+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 zone default found 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 4 Realm: () 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 zonegroup default 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.716+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.717+0000 7fbcf9d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.717+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.717+0000 7fbcf9d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:19.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.717+0000 7fbcf9d30800 20 started sync module instance, tier type = 2024-09-12T17:44:19.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.717+0000 7fbcf9d30800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:19.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.726+0000 7fbcf9d30800 20 add_watcher() i=0 2024-09-12T17:44:19.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.726+0000 7fbcf9d30800 20 add_watcher() i=1 2024-09-12T17:44:19.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.726+0000 7fbcf9d30800 20 add_watcher() i=2 2024-09-12T17:44:19.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.726+0000 7fbcf9d30800 20 add_watcher() i=3 2024-09-12T17:44:19.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.726+0000 7fbcf9d30800 20 add_watcher() i=4 2024-09-12T17:44:19.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.726+0000 7fbcf9d30800 20 add_watcher() i=5 2024-09-12T17:44:19.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.726+0000 7fbcf9d30800 20 add_watcher() i=6 2024-09-12T17:44:19.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.727+0000 7fbcf9d30800 20 add_watcher() i=7 2024-09-12T17:44:19.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.727+0000 7fbcf9d30800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:19.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:19.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbcf9d30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:19.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbcf9d30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:19.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbcf9d30800 5 note: GC not initialized 2024-09-12T17:44:19.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbba67fc640 20 reqs_thread_entry: start 2024-09-12T17:44:19.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbcf9d30800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:19.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbcf9d30800 20 Filter name: none 2024-09-12T17:44:19.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.729+0000 7fbb17fff640 20 reqs_thread_entry: start 2024-09-12T17:44:19.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.730+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.730+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:19.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.730+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.730+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:19.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.730+0000 7fbcf9d30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:19.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.730+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.731+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:19.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.731+0000 7fbcf9d30800 20 rados->read ofs=0 len=0 2024-09-12T17:44:19.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.731+0000 7fbcf9d30800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:19.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.731+0000 7fbcf9d30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:19.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.733+0000 7fbba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:19.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.735+0000 7fbcf9d30800 20 remove_watcher() i=0 2024-09-12T17:44:19.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.735+0000 7fbcf9d30800 2 removed watcher, disabling cache 2024-09-12T17:44:19.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.736+0000 7fbcf9d30800 20 remove_watcher() i=1 2024-09-12T17:44:19.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.737+0000 7fbcf9d30800 20 remove_watcher() i=2 2024-09-12T17:44:19.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.738+0000 7fbcf9d30800 20 remove_watcher() i=3 2024-09-12T17:44:19.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.739+0000 7fbcf9d30800 20 remove_watcher() i=4 2024-09-12T17:44:19.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.740+0000 7fbcf9d30800 20 remove_watcher() i=5 2024-09-12T17:44:19.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.741+0000 7fbcf9d30800 20 remove_watcher() i=6 2024-09-12T17:44:19.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:19.742+0000 7fbcf9d30800 20 remove_watcher() i=7 2024-09-12T17:44:19.754 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:19.754 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:19.754 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:44:19.754 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:19.829 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:44:19.829 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:20.039 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:44:20.068 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:20.068 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:20.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.105+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.107+0000 7f915e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.107+0000 7f915e72c800 20 realm 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.107+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.108+0000 7f915e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.108+0000 7f915e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.108+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.108+0000 7f915e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.108+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.108+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:20.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.108+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.109+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:20.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.109+0000 7f915e72c800 20 searching for the correct realm 2024-09-12T17:44:20.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.112+0000 7f9151c4e640 0 -- 172.21.15.63:0/400284925 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f91440094b0 msgr2=0x7f9144087aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:20.318 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.317+0000 7f915ac50640 0 -- 172.21.15.63:0/400284925 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561b854e8760 msgr2=0x561b854eab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.323 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.322+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 zone default found 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 4 Realm: () 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 zonegroup default 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.325 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 started sync module instance, tier type = 2024-09-12T17:44:20.326 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.323+0000 7f915e72c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:20.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.332+0000 7f915e72c800 20 add_watcher() i=0 2024-09-12T17:44:20.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.332+0000 7f915e72c800 20 add_watcher() i=1 2024-09-12T17:44:20.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.332+0000 7f915e72c800 20 add_watcher() i=2 2024-09-12T17:44:20.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.332+0000 7f915e72c800 20 add_watcher() i=3 2024-09-12T17:44:20.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.332+0000 7f915e72c800 20 add_watcher() i=4 2024-09-12T17:44:20.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.332+0000 7f915e72c800 20 add_watcher() i=5 2024-09-12T17:44:20.333 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.332+0000 7f915e72c800 20 add_watcher() i=6 2024-09-12T17:44:20.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.333+0000 7f915e72c800 20 add_watcher() i=7 2024-09-12T17:44:20.334 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.333+0000 7f915e72c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:20.335 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f9010fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:20.336 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f915e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:20.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f915e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:20.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f915e72c800 5 note: GC not initialized 2024-09-12T17:44:20.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f8f8b7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:20.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f915e72c800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:20.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f915e72c800 20 Filter name: none 2024-09-12T17:44:20.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.335+0000 7f8f897fa640 20 reqs_thread_entry: start 2024-09-12T17:44:20.337 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.336+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.336+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:20.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.336+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.337+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:20.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.337+0000 7f915e72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:20.338 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.337+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.337+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:20.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.337+0000 7f915e72c800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.337+0000 7f915e72c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:20.339 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.337+0000 7f915e72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:20.340 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.339+0000 7f9010fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:20.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.341+0000 7f915e72c800 20 remove_watcher() i=0 2024-09-12T17:44:20.342 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.341+0000 7f915e72c800 2 removed watcher, disabling cache 2024-09-12T17:44:20.343 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.342+0000 7f915e72c800 20 remove_watcher() i=1 2024-09-12T17:44:20.344 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.343+0000 7f915e72c800 20 remove_watcher() i=2 2024-09-12T17:44:20.345 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.344+0000 7f915e72c800 20 remove_watcher() i=3 2024-09-12T17:44:20.346 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.345+0000 7f915e72c800 20 remove_watcher() i=4 2024-09-12T17:44:20.347 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.346+0000 7f915e72c800 20 remove_watcher() i=5 2024-09-12T17:44:20.348 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.347+0000 7f915e72c800 20 remove_watcher() i=6 2024-09-12T17:44:20.349 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.348+0000 7f915e72c800 20 remove_watcher() i=7 2024-09-12T17:44:20.360 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:20.360 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:20.360 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:20.360 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:20.361 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:44:20.398 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:20.399 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:20.437 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.436+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 20 realm 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.439 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.438+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.439+0000 7fe5d5946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:20.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.439+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.439+0000 7fe5d5946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:20.440 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.439+0000 7fe5d5946800 20 searching for the correct realm 2024-09-12T17:44:20.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.442+0000 7fe5cac36640 0 -- 172.21.15.63:0/102048678 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fe5bc072640 msgr2=0x7fe5bc070250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:20.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.647+0000 7fe5d3c38640 0 -- 172.21.15.63:0/102048678 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56108b415880 msgr2=0x56108b417cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.651+0000 7fe5d5946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.651+0000 7fe5d5946800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.651+0000 7fe5d5946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.651+0000 7fe5d5946800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.651+0000 7fe5d5946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.651+0000 7fe5d5946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.651+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:20.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 zone default found 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 4 Realm: () 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 zonegroup default 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.652+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.653+0000 7fe5d5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.653+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.653+0000 7fe5d5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.653+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.653+0000 7fe5d5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.653+0000 7fe5d5946800 20 started sync module instance, tier type = 2024-09-12T17:44:20.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.653+0000 7fe5d5946800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:20.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.662+0000 7fe5d5946800 20 add_watcher() i=0 2024-09-12T17:44:20.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.662+0000 7fe5d5946800 20 add_watcher() i=1 2024-09-12T17:44:20.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.662+0000 7fe5d5946800 20 add_watcher() i=2 2024-09-12T17:44:20.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.662+0000 7fe5d5946800 20 add_watcher() i=3 2024-09-12T17:44:20.663 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.662+0000 7fe5d5946800 20 add_watcher() i=4 2024-09-12T17:44:20.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.662+0000 7fe5d5946800 20 add_watcher() i=5 2024-09-12T17:44:20.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.662+0000 7fe5d5946800 20 add_watcher() i=6 2024-09-12T17:44:20.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.663+0000 7fe5d5946800 20 add_watcher() i=7 2024-09-12T17:44:20.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.663+0000 7fe5d5946800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:20.666 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.665+0000 7fe489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.665+0000 7fe5d5946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.665+0000 7fe5d5946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.665+0000 7fe5d5946800 5 note: GC not initialized 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe488fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 20 Filter name: none 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe4027fc640 20 reqs_thread_entry: start 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:44:20.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:20.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:20.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 : miss 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.666+0000 7fe5d5946800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.667+0000 7fe5d5946800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.667+0000 7fe5d5946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 info.flags=0x17 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.667+0000 7fe5d5946800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 to cache LRU end 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.667+0000 7fe5d5946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.667+0000 7fe5d5946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:20.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.667+0000 7fe5d5946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 2024-09-12T17:44:20.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 info.flags=0x17 2024-09-12T17:44:20.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 to cache LRU end 2024-09-12T17:44:20.673 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:20.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39, ofs0, ns] 2024-09-12T17:44:20.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe4b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94629055789392 notifier 7499 bl.length()=1015 2024-09-12T17:44:20.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe4b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 info.flags=0x17 2024-09-12T17:44:20.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe4b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 to cache LRU end 2024-09-12T17:44:20.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe4b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:20.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): orig_sources= new_sources= 2024-09-12T17:44:20.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): potential sources added=[] removed=[] 2024-09-12T17:44:20.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): orig_dests= new_dests= 2024-09-12T17:44:20.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.673+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): potential dests added=[] removed=[] 2024-09-12T17:44:20.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.0 2024-09-12T17:44:20.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.0 2024-09-12T17:44:20.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.1 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.1 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.2 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.2 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.3 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.3 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.4 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.4 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.5 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.5 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.6 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.6 2024-09-12T17:44:20.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.7 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.7 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.8 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.8 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.9 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.9 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.10 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.10 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.11 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1.11 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.678+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.0 2024-09-12T17:44:20.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.679+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1 2024-09-12T17:44:20.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.679+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.2 2024-09-12T17:44:20.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.680+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.3 2024-09-12T17:44:20.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.680+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.4 2024-09-12T17:44:20.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.681+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.5 2024-09-12T17:44:20.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.681+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.6 2024-09-12T17:44:20.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.682+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.7 2024-09-12T17:44:20.683 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.682+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.8 2024-09-12T17:44:20.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.683+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.9 2024-09-12T17:44:20.684 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.683+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.10 2024-09-12T17:44:20.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.686+0000 7fe5d5946800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:44:20.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.686+0000 7fe5d5946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:20.687 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.686+0000 7fe5d5946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 2024-09-12T17:44:20.688 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.687+0000 7fe5d5946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 info.flags=0x17 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.687+0000 7fe5d5946800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 to cache LRU end 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.687+0000 7fe5d5946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.687+0000 7fe5d5946800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39, ofs0, ns] 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe4b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94629055789392 notifier 7499 bl.length()=1015 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe4b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 info.flags=0x17 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe4b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 to cache LRU end 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe4b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:20.689 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): orig_sources= new_sources= 2024-09-12T17:44:20.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): potential sources added=[] removed=[] 2024-09-12T17:44:20.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): orig_dests= new_dests= 2024-09-12T17:44:20.690 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.688+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): potential dests added=[] removed=[] 2024-09-12T17:44:20.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.691+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.0 2024-09-12T17:44:20.692 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.691+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.1 2024-09-12T17:44:20.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.692+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.2 2024-09-12T17:44:20.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.692+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.3 2024-09-12T17:44:20.693 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.692+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.4 2024-09-12T17:44:20.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.693+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.5 2024-09-12T17:44:20.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.693+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.6 2024-09-12T17:44:20.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.693+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.7 2024-09-12T17:44:20.694 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.694+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.8 2024-09-12T17:44:20.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.694+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.9 2024-09-12T17:44:20.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.694+0000 7fe5d5946800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39.10 2024-09-12T17:44:20.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.695+0000 7fe5d5946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:20.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.695+0000 7fe5d5946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 2024-09-12T17:44:20.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe5d5946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 info.flags=0x17 2024-09-12T17:44:20.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe5d5946800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 to cache LRU end 2024-09-12T17:44:20.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe5d5946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:20.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe5d5946800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39, ofs0, ns] 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe4b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94629055789392 notifier 7499 bl.length()=983 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe4b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 info.flags=0x17 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe4b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 to cache LRU end 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.696+0000 7fe4b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.697+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): orig_sources= new_sources= 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.697+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): potential sources added=[] removed=[] 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.697+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): orig_dests= new_dests= 2024-09-12T17:44:20.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.697+0000 7fe5d5946800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39]): potential dests added=[] removed=[] 2024-09-12T17:44:20.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.699+0000 7fe5d5946800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:20.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.701+0000 7fe489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:20.703 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.703+0000 7fe5d5946800 20 remove_watcher() i=0 2024-09-12T17:44:20.704 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.703+0000 7fe5d5946800 2 removed watcher, disabling cache 2024-09-12T17:44:20.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.704+0000 7fe5d5946800 20 remove_watcher() i=1 2024-09-12T17:44:20.705 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.705+0000 7fe5d5946800 20 remove_watcher() i=2 2024-09-12T17:44:20.706 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.706+0000 7fe5d5946800 20 remove_watcher() i=3 2024-09-12T17:44:20.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.707+0000 7fe5d5946800 20 remove_watcher() i=4 2024-09-12T17:44:20.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.708+0000 7fe5d5946800 20 remove_watcher() i=5 2024-09-12T17:44:20.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.709+0000 7fe5d5946800 20 remove_watcher() i=6 2024-09-12T17:44:20.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.710+0000 7fe5d5946800 20 remove_watcher() i=7 2024-09-12T17:44:20.723 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:44:20.752 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:20.753 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:20.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.790+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 20 realm 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:20.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.792+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.793+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:20.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.793+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:20.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.793+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:20.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.793+0000 7f94e820e800 20 searching for the correct realm 2024-09-12T17:44:20.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:20.796+0000 7f94e3058640 0 -- 172.21.15.63:0/2516713091 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f94d8064430 msgr2=0x7f94d8064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.002+0000 7f94e405a640 0 -- 172.21.15.63:0/2516713091 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x562df7d6c400 msgr2=0x562df7d6e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.005+0000 7f94e820e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:21.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.005+0000 7f94e820e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:21.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.005+0000 7f94e820e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:21.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.005+0000 7f94e820e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:21.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.005+0000 7f94e820e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:21.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.005+0000 7f94e820e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:21.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.005+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:21.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 zone default found 2024-09-12T17:44:21.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 4 Realm: () 2024-09-12T17:44:21.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 zonegroup default 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.006+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.007+0000 7f94e820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.007+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.007+0000 7f94e820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.010 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.007+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.007+0000 7f94e820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.007+0000 7f94e820e800 20 started sync module instance, tier type = 2024-09-12T17:44:21.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.007+0000 7f94e820e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.016+0000 7f94e820e800 20 add_watcher() i=0 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.016+0000 7f94e820e800 20 add_watcher() i=1 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.016+0000 7f94e820e800 20 add_watcher() i=2 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.016+0000 7f94e820e800 20 add_watcher() i=3 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.016+0000 7f94e820e800 20 add_watcher() i=4 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.016+0000 7f94e820e800 20 add_watcher() i=5 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.016+0000 7f94e820e800 20 add_watcher() i=6 2024-09-12T17:44:21.017 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.017+0000 7f94e820e800 20 add_watcher() i=7 2024-09-12T17:44:21.018 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.017+0000 7f94e820e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:21.019 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.018+0000 7f9399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:21.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f94e820e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:21.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f94e820e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:21.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f94e820e800 5 note: GC not initialized 2024-09-12T17:44:21.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f9398fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:21.021 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f94e820e800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f94e820e800 20 Filter name: none 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f93127fc640 20 reqs_thread_entry: start 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.019+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.020+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.020+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.020+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.020+0000 7f94e820e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:21.022 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.020+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.021+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:21.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.021+0000 7f94e820e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.021+0000 7f94e820e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:21.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.021+0000 7f94e820e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:21.024 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.023+0000 7f9399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:21.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.025+0000 7f94e820e800 20 remove_watcher() i=0 2024-09-12T17:44:21.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.025+0000 7f94e820e800 2 removed watcher, disabling cache 2024-09-12T17:44:21.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.026+0000 7f94e820e800 20 remove_watcher() i=1 2024-09-12T17:44:21.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.027+0000 7f94e820e800 20 remove_watcher() i=2 2024-09-12T17:44:21.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.027+0000 7f94e820e800 20 remove_watcher() i=3 2024-09-12T17:44:21.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.028+0000 7f94e820e800 20 remove_watcher() i=4 2024-09-12T17:44:21.030 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.029+0000 7f94e820e800 20 remove_watcher() i=5 2024-09-12T17:44:21.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.030+0000 7f94e820e800 20 remove_watcher() i=6 2024-09-12T17:44:21.032 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.031+0000 7f94e820e800 20 remove_watcher() i=7 2024-09-12T17:44:21.043 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.043 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:21.043 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: error-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:44:21.043 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.119 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:44:21.119 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.337 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:44:21.366 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:21.366 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:21.404 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.403+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 20 realm 2024-09-12T17:44:21.406 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:21.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.405+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.406+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.406+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.406+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:21.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.406+0000 7f70aab35800 20 searching for the correct realm 2024-09-12T17:44:21.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.409+0000 7f70a60e3640 0 -- 172.21.15.63:0/2302333374 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f709c06c070 msgr2=0x7f709c0ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.614+0000 7f70a70e5640 0 -- 172.21.15.63:0/2302333374 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b496972130 msgr2=0x55b496974580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.618+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:21.621 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 zone default found 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 4 Realm: () 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 zonegroup default 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.619+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.620+0000 7f70aab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.620+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.620+0000 7f70aab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.620+0000 7f70aab35800 20 started sync module instance, tier type = 2024-09-12T17:44:21.623 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.620+0000 7f70aab35800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:21.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.629+0000 7f70aab35800 20 add_watcher() i=0 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.629+0000 7f70aab35800 20 add_watcher() i=1 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.629+0000 7f70aab35800 20 add_watcher() i=2 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.629+0000 7f70aab35800 20 add_watcher() i=3 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.629+0000 7f70aab35800 20 add_watcher() i=4 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.629+0000 7f70aab35800 20 add_watcher() i=5 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.629+0000 7f70aab35800 20 add_watcher() i=6 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.630+0000 7f70aab35800 20 add_watcher() i=7 2024-09-12T17:44:21.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.630+0000 7f70aab35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:21.632 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.631+0000 7f6f5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:21.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.631+0000 7f70aab35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:21.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.631+0000 7f70aab35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:21.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.632+0000 7f70aab35800 5 note: GC not initialized 2024-09-12T17:44:21.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.632+0000 7f6ed7fff640 20 reqs_thread_entry: start 2024-09-12T17:44:21.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.632+0000 7f70aab35800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:21.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.632+0000 7f70aab35800 20 Filter name: none 2024-09-12T17:44:21.633 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.632+0000 7f6ed5ffb640 20 reqs_thread_entry: start 2024-09-12T17:44:21.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.632+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.633+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:21.634 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.633+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.633+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:21.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.633+0000 7f70aab35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:21.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.633+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.634+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:21.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.634+0000 7f70aab35800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.634+0000 7f70aab35800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:21.635 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.634+0000 7f70aab35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:21.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.636+0000 7f6f5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:21.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.638+0000 7f70aab35800 20 remove_watcher() i=0 2024-09-12T17:44:21.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.638+0000 7f70aab35800 2 removed watcher, disabling cache 2024-09-12T17:44:21.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.639+0000 7f70aab35800 20 remove_watcher() i=1 2024-09-12T17:44:21.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.640+0000 7f70aab35800 20 remove_watcher() i=2 2024-09-12T17:44:21.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.641+0000 7f70aab35800 20 remove_watcher() i=3 2024-09-12T17:44:21.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.642+0000 7f70aab35800 20 remove_watcher() i=4 2024-09-12T17:44:21.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.643+0000 7f70aab35800 20 remove_watcher() i=5 2024-09-12T17:44:21.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.644+0000 7f70aab35800 20 remove_watcher() i=6 2024-09-12T17:44:21.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.645+0000 7f70aab35800 20 remove_watcher() i=7 2024-09-12T17:44:21.656 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.657 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:21.657 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:21.657 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.658 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:44:21.693 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:21.693 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:21.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.731+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 20 realm 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.734 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.734+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.734+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.734+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:21.735 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.734+0000 7f0821240800 20 searching for the correct realm 2024-09-12T17:44:21.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.738+0000 7f081f52b640 0 -- 172.21.15.63:0/1300757449 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7f081401e070 msgr2=0x7f0814067da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.741+0000 7f081ed2a640 0 -- 172.21.15.63:0/1300757449 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f0818070040 msgr2=0x7f081808a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.744+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:21.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 zone default found 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 4 Realm: () 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 zonegroup default 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.746+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.746+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.746+0000 7f0821240800 20 started sync module instance, tier type = 2024-09-12T17:44:21.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.746+0000 7f0821240800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:21.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=0 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=1 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=2 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=3 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=4 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=5 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=6 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.756+0000 7f0821240800 20 add_watcher() i=7 2024-09-12T17:44:21.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.756+0000 7f0821240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:21.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.757+0000 7f06d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f0821240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f0821240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f0821240800 5 note: GC not initialized 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f064ffff640 20 reqs_thread_entry: start 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f0821240800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f0821240800 20 Filter name: none 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f064dffb640 20 reqs_thread_entry: start 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f0821240800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:44:21.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.758+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:21.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:21.760 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 : miss 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.761 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.759+0000 7f0821240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 2024-09-12T17:44:21.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f0821240800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f0821240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f0821240800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40, ofs0, ns] 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94031963118944 notifier 7553 bl.length()=1015 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_sources= new_sources= 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential sources added=[] removed=[] 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_dests= new_dests= 2024-09-12T17:44:21.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential dests added=[] removed=[] 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.0 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.0 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.1 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.1 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.2 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.2 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.3 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.3 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.4 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.4 2024-09-12T17:44:21.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.5 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.5 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.6 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.6 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.7 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.7 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.8 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.8 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.9 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.9 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.10 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.10 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.11 2024-09-12T17:44:21.772 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.11 2024-09-12T17:44:21.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.0 2024-09-12T17:44:21.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1 2024-09-12T17:44:21.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.770+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2 2024-09-12T17:44:21.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.770+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.3 2024-09-12T17:44:21.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.771+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.4 2024-09-12T17:44:21.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.771+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.5 2024-09-12T17:44:21.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.6 2024-09-12T17:44:21.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.7 2024-09-12T17:44:21.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.8 2024-09-12T17:44:21.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.773+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.9 2024-09-12T17:44:21.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.773+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.10 2024-09-12T17:44:21.777 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0821240800 time 2024-09-12T17:44:21.777552+0000 2024-09-12T17:44:21.777 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f082478c71a] 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.778 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.777+0000 7f0821240800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0821240800 time 2024-09-12T17:44:21.777552+0000 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f082478c71a] 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.779 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:21.780 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:21.780 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.780 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:44:21.780 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0821240800 thread_name:radosgw-admin 2024-09-12T17:44:21.796 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.796 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f082343e6f0] 2024-09-12T17:44:21.796 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f082348b99c] 2024-09-12T17:44:21.796 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:21.796 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:21.796 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f082478c774] 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.778+0000 7f0821240800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0821240800 thread_name:radosgw-admin 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.797 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f082343e6f0] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f082348b99c] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f082478c774] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:21.798 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:44:21.715+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:44:21.715+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.799 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:44:21.715+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key hook 0x558585b2a9e8 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x5585859b48b0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x5585859df2a0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x5585859e2950 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.230861s 2024-09-12T17:44:21.800 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x5585859df2a0 auth_method 0 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x5585859b48b0 auth_method 0 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:44:21.716+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:44:21.716+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:44:21.716+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.801 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_done global_id 7544 payload 824 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:44:21.716+0000 7f081ed2a640 1 monclient: found mon.noname-c 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:44:21.716+0000 7f081f52b640 10 monclient: get_auth_request con 0x5585859e2950 auth_method 0 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: dump: 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.802 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: dump: 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.803 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:44:21.716+0000 7f0821240800 5 monclient: authenticate success, global_id 7544 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:44:21.716+0000 7f070ce09640 4 set_mon_vals no callback set 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:44:21.716+0000 7f0821240800 1 librados: init done 2024-09-12T17:44:21.804 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:44:21.718+0000 7f070b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:44:21.718+0000 7f070b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:44:21.718+0000 7f070b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:44:21.718+0000 7f081e529640 10 monclient: get_auth_request con 0x7f07040764a0 auth_method 0 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:44:21.719+0000 7f081f52b640 10 monclient: get_auth_request con 0x558585b53360 auth_method 0 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:44:21.719+0000 7f081ed2a640 10 monclient: get_auth_request con 0x558585b75a60 auth_method 0 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:44:21.721+0000 7f081e529640 10 monclient: get_auth_request con 0x558585b792c0 auth_method 0 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:44:21.722+0000 7f0821240800 10 monclient: build_initial_monmap 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:44:21.722+0000 7f0821240800 1 build_initial for_mkfs: 0 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:44:21.722+0000 7f0821240800 10 monclient: monmap: 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:21.805 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding auth protocol: cephx 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding auth protocol: cephx 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding auth protocol: cephx 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.806 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:44:21.722+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:44:21.722+0000 7f0821240800 5 asok(0x558585908730) register_command objecter_requests cmddesc objecter_requests hook 0x558585b820d0 EEXIST 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:44:21.722+0000 7f0821240800 10 monclient: init 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding auth protocol: cephx 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding auth protocol: cephx 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding auth protocol: cephx 2024-09-12T17:44:21.807 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:44:21.722+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:44:21.723+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:44:21.723+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key cmddesc rotate-key hook 0x558585b7dd60 EEXIST 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x558585ba63f0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x558585ba67d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x558585ba5100 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.238203s 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x558585ba67d0 auth_method 0 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): get_auth_request con 0x558585ba5100 auth_method 0 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x558585ba63f0 auth_method 0 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_done global_id 8034 payload 824 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:44:21.723+0000 7f081e529640 1 monclient: found mon.noname-a 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: dump: 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: dump: 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:44:21.723+0000 7f0821240800 5 monclient: authenticate success, global_id 8034 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:44:21.723+0000 7f081fd2c640 4 set_mon_vals no callback set 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:44:21.724+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:44:21.724+0000 7f0821240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:44:21.725+0000 7f0708e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:44:21.725+0000 7f0708e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:44:21.725+0000 7f0708e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:44:21.726+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f06f8076380 auth_method 0 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: get_monmap_and_config 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: build_initial_monmap 2024-09-12T17:44:21.814 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:44:21.726+0000 7f0821240800 1 build_initial for_mkfs: 0 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: monmap: 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding auth protocol: cephx 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding auth protocol: cephx 2024-09-12T17:44:21.815 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding auth protocol: cephx 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:44:21.726+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.816 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: init 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding auth protocol: cephx 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding auth protocol: cephx 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding auth protocol: cephx 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.817 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:44:21.727+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:44:21.727+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:44:21.727+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key cmddesc rotate-key hook 0x7ffd210215e8 EEXIST 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:44:21.818 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x558585bca2a0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x558585bf4d10 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x558585bf60c0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.242365s 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x558585bca2a0 auth_method 0 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x558585bf4d10 auth_method 0 2024-09-12T17:44:21.819 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): get_auth_request con 0x558585bf60c0 auth_method 0 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.820 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_done global_id 8037 payload 274 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:44:21.727+0000 7f081ed2a640 1 monclient: found mon.noname-a 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: dump: 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.821 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:44:21.727+0000 7f0821240800 5 monclient: authenticate success, global_id 8037 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:44:21.727+0000 7f0821240800 4 set_mon_vals no callback set 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:21.822 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: dump: 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:44:21.728+0000 7f0821240800 10 monclient: shutdown 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:44:21.728+0000 7f0821240800 10 monclient: build_initial_monmap 2024-09-12T17:44:21.823 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:44:21.728+0000 7f0821240800 1 build_initial for_mkfs: 0 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:44:21.728+0000 7f0821240800 10 monclient: monmap: 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:21.824 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding auth protocol: cephx 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding auth protocol: cephx 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding auth protocol: cephx 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.825 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:44:21.728+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:44:21.728+0000 7f0821240800 1 librados: starting msgr at 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:44:21.728+0000 7f0821240800 1 librados: starting objecter 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:44:21.729+0000 7f0821240800 5 asok(0x558585908730) register_command objecter_requests cmddesc objecter_requests hook 0x558585bc8800 EEXIST 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:44:21.729+0000 7f0821240800 1 librados: setting wanted keys 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:44:21.729+0000 7f0821240800 1 librados: calling monclient init 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient: init 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding auth protocol: cephx 2024-09-12T17:44:21.826 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding auth protocol: cephx 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding auth protocol: cephx 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.827 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:44:21.729+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:44:21.729+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:44:21.729+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key cmddesc rotate-key hook 0x558585bbadf8 EEXIST 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x558585bca2a0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x558585bf60c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x558585bf2ca0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.244670s 2024-09-12T17:44:21.828 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x558585bf60c0 auth_method 0 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x558585bca2a0 auth_method 0 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): get_auth_request con 0x558585bf2ca0 auth_method 0 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.829 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_done global_id 7553 payload 824 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:44:21.729+0000 7f081e529640 1 monclient: found mon.noname-c 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.830 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: dump: 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.831 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: dump: 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.832 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:44:21.730+0000 7f07027fc640 4 set_mon_vals no callback set 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:44:21.730+0000 7f0821240800 5 monclient: authenticate success, global_id 7553 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:44:21.730+0000 7f0821240800 1 librados: init done 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:44:21.730+0000 7f0821240800 5 asok(0x558585908730) register_command cr dump hook 0x558585bf2b98 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:44:21.731+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:44:21.732+0000 7f0700ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:44:21.732+0000 7f0700ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:44:21.732+0000 7f0700ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:44:21.732+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f06e8076470 auth_method 0 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:44:21.732+0000 7f081f52b640 10 monclient: get_auth_request con 0x558585c14d70 auth_method 0 2024-09-12T17:44:21.833 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:44:21.733+0000 7f0821240800 20 realm 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:44:21.733+0000 7f0821240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:44:21.733+0000 7f081ed2a640 10 monclient: get_auth_request con 0x558585c190c0 auth_method 0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:44:21.734+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:44:21.734+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:44:21.734+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:44:21.734+0000 7f0821240800 20 searching for the correct realm 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:44:21.734+0000 7f081e529640 10 monclient: get_auth_request con 0x558585c1e240 auth_method 0 2024-09-12T17:44:21.834 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:44:21.735+0000 7f081f52b640 10 monclient: get_auth_request con 0x7f081401e070 auth_method 0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:44:21.736+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f08100822d0 auth_method 0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:44:21.737+0000 7f081e529640 10 monclient: get_auth_request con 0x7f0814009040 auth_method 0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:44:21.738+0000 7f081f52b640 0 -- 172.21.15.63:0/1300757449 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7f081401e070 msgr2=0x7f0814067da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:44:21.738+0000 7f0700ff9640 1 client.7553.objecter ms_handle_reset 0x7f081401e070 session 0x7f081402a910 osd.2 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:44:21.738+0000 7f0700ff9640 10 monclient: _renew_subs 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:44:21.738+0000 7f0700ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:44:21.738+0000 7f081f52b640 10 monclient: get_auth_request con 0x7f06e8086790 auth_method 0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:44:21.739+0000 7f081f52b640 10 monclient: get_auth_request con 0x7f081005f810 auth_method 0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:44:21.740+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f0818070040 auth_method 0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:44:21.741+0000 7f081ed2a640 0 -- 172.21.15.63:0/1300757449 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f0818070040 msgr2=0x7f081808a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:44:21.741+0000 7f0700ff9640 1 client.7553.objecter ms_handle_reset 0x7f0818070040 session 0x7f0818082040 osd.3 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:44:21.741+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f081401e070 auth_method 0 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:21.835 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:44:21.744+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:44:21.745+0000 7f0821240800 20 zone default found 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:44:21.745+0000 7f0821240800 4 Realm: () 2024-09-12T17:44:21.836 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:44:21.745+0000 7f0821240800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:44:21.745+0000 7f0821240800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:44:21.745+0000 7f0821240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:44:21.745+0000 7f0821240800 20 zonegroup default 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:44:21.746+0000 7f0821240800 20 started sync module instance, tier type = 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:44:21.746+0000 7f0821240800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=0 2024-09-12T17:44:21.837 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=1 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=2 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=3 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=4 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=5 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=6 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:44:21.756+0000 7f0821240800 20 add_watcher() i=7 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:44:21.756+0000 7f0821240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding auth protocol: cephx 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding auth protocol: cephx 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding auth protocol: cephx 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.838 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:44:21.757+0000 7f06d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:44:21.758+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:44:21.758+0000 7f0821240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:44:21.758+0000 7f0821240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:21.839 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache list hook 0x558585bf3b60 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache inspect hook 0x558585bf3b60 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache erase hook 0x558585bf3b60 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache zap hook 0x558585bf3b60 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:44:21.758+0000 7f0821240800 5 note: GC not initialized 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:44:21.758+0000 7f064ffff640 20 reqs_thread_entry: start 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace show hook 0x7f0810085040 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace history hook 0x7f0810085040 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace active hook 0x7f0810085040 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace active_short hook 0x7f0810085040 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:44:21.758+0000 7f0821240800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:44:21.758+0000 7f0821240800 20 Filter name: none 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:44:21.758+0000 7f064dffb640 20 reqs_thread_entry: start 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:44:21.758+0000 7f0821240800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:44:21.840 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:44:21.758+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:44:21.759+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:44:21.759+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:44:21.759+0000 7f0821240800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:44:21.759+0000 7f0821240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 : miss 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:44:21.759+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:44:21.759+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:44:21.759+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:44:21.759+0000 7f0821240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:44:21.759+0000 7f0821240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:44:21.759+0000 7f0821240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:44:21.759+0000 7f0821240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:44:21.764+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.841 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:44:21.764+0000 7f0821240800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:44:21.764+0000 7f0821240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:44:21.764+0000 7f0821240800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40, ofs0, ns] 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94031963118944 notifier 7553 bl.length()=1015 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_sources= new_sources= 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential sources added=[] removed=[] 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_dests= new_dests= 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential dests added=[] removed=[] 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.0 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.0 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.1 2024-09-12T17:44:21.842 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.1 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.2 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.2 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.3 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.3 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.4 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.4 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.5 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.5 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.6 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.6 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.7 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.7 2024-09-12T17:44:21.843 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.8 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.8 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.9 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.9 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.10 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.10 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.11 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.11 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.0 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:44:21.770+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:44:21.770+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.3 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:44:21.771+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.4 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:44:21.771+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.5 2024-09-12T17:44:21.844 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.6 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.7 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.8 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:44:21.773+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.9 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:44:21.773+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.10 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:44:21.777+0000 7f0821240800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0821240800 time 2024-09-12T17:44:21.777552+0000 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f082478c71a] 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.845 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:44:21.778+0000 7f0821240800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0821240800 thread_name:radosgw-admin 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f082343e6f0] 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f082348b99c] 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:21.846 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f082478c774] 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:44:21.847 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:44:21.848 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:44:21.849 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:44:21.850 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:44:21.851 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:44:21.852 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:44:21.853 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 7f064dffb640 / http_manager 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 7f064ffff640 / http_manager 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06d57e2640 / rgw_dt_lg_renew 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0700ff9640 / ms_dispatch 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07027fc640 / io_context_pool 2024-09-12T17:44:21.854 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0708e01640 / ms_dispatch 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: 7f070b606640 / ms_dispatch 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: 7f070ce09640 / io_context_pool 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081e529640 / msgr-worker-2 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081ed2a640 / msgr-worker-1 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081f52b640 / msgr-worker-0 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081fd2c640 / io_context_pool 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0821240800 / radosgw-admin 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.144092.log 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.855 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: crc 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:44:21.715+0000 7f0821240800 5 AuthRegistry(0x558585b2a8a0) adding con mode: secure 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:44:21.715+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:44:21.715+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:44:21.715+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key hook 0x558585b2a9e8 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x5585859b48b0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.856 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x5585859df2a0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x5585859e2950 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:44:21.715+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.230861s 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x5585859df2a0 auth_method 0 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:44:21.715+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x5585859b48b0 auth_method 0 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.857 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:44:21.715+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:44:21.716+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:44:21.716+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:44:21.716+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient(hunting): handle_auth_done global_id 7544 payload 824 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:44:21.716+0000 7f081ed2a640 1 monclient: found mon.noname-c 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:44:21.716+0000 7f081ed2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:44:21.716+0000 7f081f52b640 10 monclient: get_auth_request con 0x5585859e2950 auth_method 0 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.858 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: dump: 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.859 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:44:21.716+0000 7f070b606640 10 monclient: dump: 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.860 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:44:21.716+0000 7f0821240800 5 monclient: authenticate success, global_id 7544 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:44:21.716+0000 7f070ce09640 4 set_mon_vals no callback set 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:44:21.716+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:44:21.716+0000 7f0821240800 1 librados: init done 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:44:21.718+0000 7f070b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:44:21.718+0000 7f070b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:44:21.718+0000 7f070b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:44:21.718+0000 7f081e529640 10 monclient: get_auth_request con 0x7f07040764a0 auth_method 0 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:44:21.719+0000 7f081f52b640 10 monclient: get_auth_request con 0x558585b53360 auth_method 0 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:44:21.719+0000 7f081ed2a640 10 monclient: get_auth_request con 0x558585b75a60 auth_method 0 2024-09-12T17:44:21.861 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:44:21.721+0000 7f081e529640 10 monclient: get_auth_request con 0x558585b792c0 auth_method 0 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:44:21.722+0000 7f0821240800 10 monclient: build_initial_monmap 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:44:21.722+0000 7f0821240800 1 build_initial for_mkfs: 0 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:44:21.722+0000 7f0821240800 10 monclient: monmap: 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:21.862 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding auth protocol: cephx 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding auth protocol: cephx 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding auth protocol: cephx 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.863 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: crc 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7ec10) adding con mode: secure 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:44:21.722+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:44:21.722+0000 7f0821240800 5 asok(0x558585908730) register_command objecter_requests cmddesc objecter_requests hook 0x558585b820d0 EEXIST 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:44:21.722+0000 7f0821240800 10 monclient: init 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding auth protocol: cephx 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding auth protocol: cephx 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding auth protocol: cephx 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.864 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: crc 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:44:21.722+0000 7f0821240800 5 AuthRegistry(0x558585b7dc18) adding con mode: secure 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:44:21.722+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:44:21.723+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:44:21.723+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key cmddesc rotate-key hook 0x558585b7dd60 EEXIST 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:44:21.865 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x558585ba63f0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x558585ba67d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x558585ba5100 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.238203s 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x558585ba67d0 auth_method 0 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): get_auth_request con 0x558585ba5100 auth_method 0 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.866 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x558585ba63f0 auth_method 0 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:44:21.723+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:44:21.723+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient(hunting): handle_auth_done global_id 8034 payload 824 2024-09-12T17:44:21.867 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:44:21.723+0000 7f081e529640 1 monclient: found mon.noname-a 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:44:21.723+0000 7f081e529640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: dump: 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.868 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:44:21.723+0000 7f0708e01640 10 monclient: dump: 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.869 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:44:21.723+0000 7f0821240800 5 monclient: authenticate success, global_id 8034 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:44:21.723+0000 7f0821240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:44:21.723+0000 7f081fd2c640 4 set_mon_vals no callback set 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:44:21.724+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:44:21.724+0000 7f0821240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:44:21.725+0000 7f0708e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:44:21.725+0000 7f0708e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:44:21.725+0000 7f0708e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:44:21.726+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f06f8076380 auth_method 0 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: get_monmap_and_config 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: build_initial_monmap 2024-09-12T17:44:21.870 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:44:21.726+0000 7f0821240800 1 build_initial for_mkfs: 0 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: monmap: 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding auth protocol: cephx 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding auth protocol: cephx 2024-09-12T17:44:21.871 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding auth protocol: cephx 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: crc 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x558585bc6110) adding con mode: secure 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:44:21.726+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:44:21.726+0000 7f0821240800 10 monclient: init 2024-09-12T17:44:21.872 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding auth protocol: cephx 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding auth protocol: cephx 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding auth protocol: cephx 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.873 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: crc 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:44:21.726+0000 7f0821240800 5 AuthRegistry(0x7ffd210214a0) adding con mode: secure 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:44:21.727+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:44:21.727+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:44:21.727+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key cmddesc rotate-key hook 0x7ffd210215e8 EEXIST 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x558585bca2a0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x558585bf4d10 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x558585bf60c0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.874 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.242365s 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x558585bca2a0 auth_method 0 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x558585bf4d10 auth_method 0 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): get_auth_request con 0x558585bf60c0 auth_method 0 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.875 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:44:21.727+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:44:21.727+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient(hunting): handle_auth_done global_id 8037 payload 274 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:44:21.727+0000 7f081ed2a640 1 monclient: found mon.noname-a 2024-09-12T17:44:21.876 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:44:21.727+0000 7f081ed2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: dump: 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.877 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:44:21.727+0000 7f0821240800 5 monclient: authenticate success, global_id 8037 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:44:21.727+0000 7f0821240800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:44:21.727+0000 7f0821240800 4 set_mon_vals no callback set 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:44:21.727+0000 7f07027fc640 10 monclient: dump: 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.878 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:44:21.728+0000 7f0821240800 10 monclient: shutdown 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:44:21.728+0000 7f0821240800 10 monclient: build_initial_monmap 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:44:21.728+0000 7f0821240800 1 build_initial for_mkfs: 0 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:44:21.728+0000 7f0821240800 10 monclient: monmap: 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:21.879 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding auth protocol: cephx 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding auth protocol: cephx 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding auth protocol: cephx 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.880 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: crc 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:44:21.728+0000 7f0821240800 5 AuthRegistry(0x558585becd10) adding con mode: secure 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:44:21.728+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:44:21.728+0000 7f0821240800 1 librados: starting msgr at 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:44:21.728+0000 7f0821240800 1 librados: starting objecter 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:44:21.729+0000 7f0821240800 5 asok(0x558585908730) register_command objecter_requests cmddesc objecter_requests hook 0x558585bc8800 EEXIST 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:44:21.729+0000 7f0821240800 1 librados: setting wanted keys 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:44:21.729+0000 7f0821240800 1 librados: calling monclient init 2024-09-12T17:44:21.881 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient: init 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding auth protocol: cephx 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding auth protocol: cephx 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding auth protocol: cephx 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: crc 2024-09-12T17:44:21.882 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:44:21.729+0000 7f0821240800 5 AuthRegistry(0x558585bbacb0) adding con mode: secure 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:44:21.729+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:44:21.729+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:44:21.729+0000 7f0821240800 5 asok(0x558585908730) register_command rotate-key cmddesc rotate-key hook 0x558585bbadf8 EEXIST 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): picked mon.noname-a con 0x558585bca2a0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): picked mon.noname-c con 0x558585bf60c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): picked mon.noname-b con 0x558585bf2ca0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:44:21.729+0000 7f0821240800 10 monclient(hunting): authenticate will time out at 2154.244670s 2024-09-12T17:44:21.883 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): get_auth_request con 0x558585bf60c0 auth_method 0 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): get_auth_request con 0x558585bca2a0 auth_method 0 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): get_auth_request con 0x558585bf2ca0 auth_method 0 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:21.884 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:44:21.729+0000 7f081ed2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:44:21.729+0000 7f081f52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient(hunting): handle_auth_done global_id 7553 payload 824 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient: _finish_hunting 0 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:44:21.729+0000 7f081e529640 1 monclient: found mon.noname-c 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:44:21.729+0000 7f081e529640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:21.885 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: dump: 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: _finish_auth 0 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:44:21.886 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:44:21.730+0000 7f0700ff9640 10 monclient: dump: 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.887 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:44:21.730+0000 7f07027fc640 4 set_mon_vals no callback set 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:44:21.730+0000 7f0821240800 5 monclient: authenticate success, global_id 7553 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _renew_subs 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:44:21.730+0000 7f0821240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:44:21.730+0000 7f0821240800 1 librados: init done 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:44:21.730+0000 7f0821240800 5 asok(0x558585908730) register_command cr dump hook 0x558585bf2b98 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:44:21.731+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:44:21.732+0000 7f0700ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:44:21.732+0000 7f0700ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:44:21.732+0000 7f0700ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:44:21.732+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f06e8076470 auth_method 0 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:44:21.732+0000 7f081f52b640 10 monclient: get_auth_request con 0x558585c14d70 auth_method 0 2024-09-12T17:44:21.888 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:44:21.733+0000 7f0821240800 20 realm 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:44:21.733+0000 7f0821240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:44:21.733+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:44:21.733+0000 7f081ed2a640 10 monclient: get_auth_request con 0x558585c190c0 auth_method 0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:44:21.734+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:44:21.734+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:44:21.734+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:44:21.734+0000 7f0821240800 20 searching for the correct realm 2024-09-12T17:44:21.889 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:44:21.734+0000 7f081e529640 10 monclient: get_auth_request con 0x558585c1e240 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:44:21.735+0000 7f081f52b640 10 monclient: get_auth_request con 0x7f081401e070 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:44:21.736+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f08100822d0 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:44:21.737+0000 7f081e529640 10 monclient: get_auth_request con 0x7f0814009040 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:44:21.738+0000 7f081f52b640 0 -- 172.21.15.63:0/1300757449 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7f081401e070 msgr2=0x7f0814067da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:44:21.738+0000 7f0700ff9640 1 client.7553.objecter ms_handle_reset 0x7f081401e070 session 0x7f081402a910 osd.2 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:44:21.738+0000 7f0700ff9640 10 monclient: _renew_subs 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:44:21.738+0000 7f0700ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:44:21.738+0000 7f081f52b640 10 monclient: get_auth_request con 0x7f06e8086790 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:44:21.739+0000 7f081f52b640 10 monclient: get_auth_request con 0x7f081005f810 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:44:21.740+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f0818070040 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:44:21.741+0000 7f081ed2a640 0 -- 172.21.15.63:0/1300757449 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f0818070040 msgr2=0x7f081808a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:44:21.741+0000 7f0700ff9640 1 client.7553.objecter ms_handle_reset 0x7f0818070040 session 0x7f0818082040 osd.3 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:44:21.741+0000 7f081ed2a640 10 monclient: get_auth_request con 0x7f081401e070 auth_method 0 2024-09-12T17:44:21.890 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:44:21.744+0000 7f0821240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:44:21.744+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:44:21.745+0000 7f0821240800 20 zone default found 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:44:21.745+0000 7f0821240800 4 Realm: () 2024-09-12T17:44:21.891 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:44:21.745+0000 7f0821240800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:44:21.745+0000 7f0821240800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:44:21.745+0000 7f0821240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:44:21.745+0000 7f0821240800 20 zonegroup default 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:44:21.745+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:44:21.746+0000 7f0821240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:44:21.746+0000 7f0821240800 20 started sync module instance, tier type = 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:44:21.746+0000 7f0821240800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=0 2024-09-12T17:44:21.892 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=1 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=2 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=3 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=4 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=5 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:44:21.755+0000 7f0821240800 20 add_watcher() i=6 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:44:21.756+0000 7f0821240800 20 add_watcher() i=7 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:44:21.756+0000 7f0821240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding auth protocol: cephx 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding auth protocol: cephx 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding auth protocol: cephx 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.893 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: crc 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:44:21.757+0000 7f0821240800 5 AuthRegistry(0x7ffd21021970) adding con mode: secure 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:44:21.757+0000 7f06d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:44:21.758+0000 7f0821240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:44:21.758+0000 7f0821240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:44:21.758+0000 7f0821240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:21.894 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache list hook 0x558585bf3b60 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache inspect hook 0x558585bf3b60 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache erase hook 0x558585bf3b60 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command cache zap hook 0x558585bf3b60 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:44:21.758+0000 7f0821240800 5 note: GC not initialized 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:44:21.758+0000 7f064ffff640 20 reqs_thread_entry: start 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace show hook 0x7f0810085040 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace history hook 0x7f0810085040 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace active hook 0x7f0810085040 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:44:21.758+0000 7f0821240800 5 asok(0x558585908730) register_command sync trace active_short hook 0x7f0810085040 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:44:21.758+0000 7f0821240800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:44:21.758+0000 7f0821240800 20 Filter name: none 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:44:21.758+0000 7f064dffb640 20 reqs_thread_entry: start 2024-09-12T17:44:21.895 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:44:21.758+0000 7f0821240800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:44:21.758+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:44:21.759+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:44:21.759+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:44:21.759+0000 7f0821240800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:44:21.759+0000 7f0821240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 : miss 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:44:21.759+0000 7f0821240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:44:21.759+0000 7f0821240800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:44:21.759+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:44:21.759+0000 7f0821240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:44:21.759+0000 7f0821240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:44:21.759+0000 7f0821240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:44:21.759+0000 7f0821240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 2024-09-12T17:44:21.896 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:44:21.764+0000 7f0821240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:44:21.764+0000 7f0821240800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:44:21.764+0000 7f0821240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:44:21.764+0000 7f0821240800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40, ofs0, ns] 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94031963118944 notifier 7553 bl.length()=1015 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:44:21.764+0000 7f07027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_sources= new_sources= 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential sources added=[] removed=[] 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_dests= new_dests= 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:44:21.765+0000 7f0821240800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential dests added=[] removed=[] 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.0 2024-09-12T17:44:21.897 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.0 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.1 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.1 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.2 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.2 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.3 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.3 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.4 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.4 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.5 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.5 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.6 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.6 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.7 2024-09-12T17:44:21.898 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.7 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.8 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.8 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.9 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.9 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.10 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.10 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:44:21.769+0000 7f0821240800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.11 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1.11 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.0 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:44:21.769+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:44:21.770+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:44:21.770+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.3 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:44:21.771+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.4 2024-09-12T17:44:21.899 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:44:21.771+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.5 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.6 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.7 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:44:21.772+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.8 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:44:21.773+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.9 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:44:21.773+0000 7f0821240800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.10 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:44:21.777+0000 7f0821240800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0821240800 time 2024-09-12T17:44:21.777552+0000 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f082478c71a] 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.900 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:44:21.778+0000 7f0821240800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f0821240800 thread_name:radosgw-admin 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f082343e6f0] 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f082348b99c] 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:21.901 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f082478c774] 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f082478c8d8] 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558583cf6841] 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558583d05734] 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558583d065d4] 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0823429590] 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:44:21.902 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:44:21.903 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:44:21.904 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:44:21.905 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:44:21.906 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:21.907 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:44:21.908 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 7f064dffb640 / http_manager 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 7f064ffff640 / http_manager 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06d57e2640 / rgw_dt_lg_renew 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0700ff9640 / ms_dispatch 2024-09-12T17:44:21.909 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07027fc640 / io_context_pool 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0708e01640 / ms_dispatch 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f070b606640 / ms_dispatch 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f070ce09640 / io_context_pool 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081e529640 / msgr-worker-2 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081ed2a640 / msgr-worker-1 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081f52b640 / msgr-worker-0 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f081fd2c640 / io_context_pool 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0821240800 / radosgw-admin 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:44:21.779180Z_67001f9b-a2a1-45ad-9d90-0d8e426e83af/log 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:44:21.910 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.855+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 20 realm 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:21.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:21.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.857+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.858+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:21.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.858+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:21.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.858+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:21.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.858+0000 7f62dbd2e800 20 searching for the correct realm 2024-09-12T17:44:21.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:21.861+0000 7f62d72dc640 0 -- 172.21.15.63:0/3447514902 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f62cc031040 msgr2=0x7f62cc031420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:22.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.066+0000 7f62d82de640 0 -- 172.21.15.63:0/3447514902 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b043fd4960 msgr2=0x55b043fd6e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.072 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.070+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 zone default found 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 4 Realm: () 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 zonegroup default 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.071+0000 7f62dbd2e800 20 started sync module instance, tier type = 2024-09-12T17:44:22.074 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.072+0000 7f62dbd2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:22.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.080+0000 7f62dbd2e800 20 add_watcher() i=0 2024-09-12T17:44:22.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.080+0000 7f62dbd2e800 20 add_watcher() i=1 2024-09-12T17:44:22.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.080+0000 7f62dbd2e800 20 add_watcher() i=2 2024-09-12T17:44:22.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.080+0000 7f62dbd2e800 20 add_watcher() i=3 2024-09-12T17:44:22.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.080+0000 7f62dbd2e800 20 add_watcher() i=4 2024-09-12T17:44:22.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.080+0000 7f62dbd2e800 20 add_watcher() i=5 2024-09-12T17:44:22.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.080+0000 7f62dbd2e800 20 add_watcher() i=6 2024-09-12T17:44:22.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.081+0000 7f62dbd2e800 20 add_watcher() i=7 2024-09-12T17:44:22.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.081+0000 7f62dbd2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:22.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.083+0000 7f618dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:22.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.083+0000 7f62dbd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:22.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.083+0000 7f62dbd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:22.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f62dbd2e800 5 note: GC not initialized 2024-09-12T17:44:22.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f618cfe1640 20 reqs_thread_entry: start 2024-09-12T17:44:22.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f62dbd2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:22.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f62dbd2e800 20 Filter name: none 2024-09-12T17:44:22.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f61067fc640 20 reqs_thread_entry: start 2024-09-12T17:44:22.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:22.086 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.084+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.085+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:22.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.085+0000 7f62dbd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:22.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.085+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.085+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:22.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.085+0000 7f62dbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.086+0000 7f62dbd2e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:22.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.086+0000 7f62dbd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:22.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.087+0000 7f618dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:22.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.089+0000 7f62dbd2e800 20 remove_watcher() i=0 2024-09-12T17:44:22.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.089+0000 7f62dbd2e800 2 removed watcher, disabling cache 2024-09-12T17:44:22.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.090+0000 7f62dbd2e800 20 remove_watcher() i=1 2024-09-12T17:44:22.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.091+0000 7f62dbd2e800 20 remove_watcher() i=2 2024-09-12T17:44:22.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.092+0000 7f62dbd2e800 20 remove_watcher() i=3 2024-09-12T17:44:22.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.093+0000 7f62dbd2e800 20 remove_watcher() i=4 2024-09-12T17:44:22.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.094+0000 7f62dbd2e800 20 remove_watcher() i=5 2024-09-12T17:44:22.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.095+0000 7f62dbd2e800 20 remove_watcher() i=6 2024-09-12T17:44:22.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.096+0000 7f62dbd2e800 20 remove_watcher() i=7 2024-09-12T17:44:22.108 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:22.108 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:22.108 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:22.108 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:22.162 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:22.194 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:22.194 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:22.233 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.232+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 20 realm 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.234+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.235+0000 7f56c1b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:22.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.235+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.235+0000 7f56c1b31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:22.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.235+0000 7f56c1b31800 20 searching for the correct realm 2024-09-12T17:44:22.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.238+0000 7f56bd075640 0 -- 172.21.15.63:0/1055220915 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f56b4087020 msgr2=0x7f56b40e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:22.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.442+0000 7f56be077640 0 -- 172.21.15.63:0/1055220915 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55aeb61d8b90 msgr2=0x55aeb61db020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:22.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.446+0000 7f56c1b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.446+0000 7f56c1b31800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.446+0000 7f56c1b31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.446+0000 7f56c1b31800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.446+0000 7f56c1b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.446+0000 7f56c1b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.446+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:22.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 zone default found 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 4 Realm: () 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 zonegroup default 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.447+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.448+0000 7f56c1b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.448+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.448+0000 7f56c1b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.448+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.448+0000 7f56c1b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.448+0000 7f56c1b31800 20 started sync module instance, tier type = 2024-09-12T17:44:22.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.448+0000 7f56c1b31800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:22.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.457+0000 7f56c1b31800 20 add_watcher() i=0 2024-09-12T17:44:22.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.457+0000 7f56c1b31800 20 add_watcher() i=1 2024-09-12T17:44:22.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.457+0000 7f56c1b31800 20 add_watcher() i=2 2024-09-12T17:44:22.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.457+0000 7f56c1b31800 20 add_watcher() i=3 2024-09-12T17:44:22.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.457+0000 7f56c1b31800 20 add_watcher() i=4 2024-09-12T17:44:22.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.457+0000 7f56c1b31800 20 add_watcher() i=5 2024-09-12T17:44:22.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.457+0000 7f56c1b31800 20 add_watcher() i=6 2024-09-12T17:44:22.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.458+0000 7f56c1b31800 20 add_watcher() i=7 2024-09-12T17:44:22.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.458+0000 7f56c1b31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:22.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.460+0000 7f5573fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:22.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.460+0000 7f56c1b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:22.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.460+0000 7f56c1b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.460+0000 7f56c1b31800 5 note: GC not initialized 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.460+0000 7f5572fe5640 20 reqs_thread_entry: start 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.460+0000 7f56c1b31800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.460+0000 7f56c1b31800 20 Filter name: none 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f5570fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 : miss 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.463 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:22.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:22.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:22.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:22.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:22.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.461+0000 7f56c1b31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 2024-09-12T17:44:22.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.463+0000 7f56c1b31800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to be held by another RGW process; skipping for now 2024-09-12T17:44:22.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.463+0000 7f5573fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:22.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.466+0000 7f56c1b31800 20 remove_watcher() i=0 2024-09-12T17:44:22.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.466+0000 7f56c1b31800 2 removed watcher, disabling cache 2024-09-12T17:44:22.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.467+0000 7f56c1b31800 20 remove_watcher() i=1 2024-09-12T17:44:22.468 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.468+0000 7f56c1b31800 20 remove_watcher() i=2 2024-09-12T17:44:22.469 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.469+0000 7f56c1b31800 20 remove_watcher() i=3 2024-09-12T17:44:22.470 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.470+0000 7f56c1b31800 20 remove_watcher() i=4 2024-09-12T17:44:22.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.471+0000 7f56c1b31800 20 remove_watcher() i=5 2024-09-12T17:44:22.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.472+0000 7f56c1b31800 20 remove_watcher() i=6 2024-09-12T17:44:22.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:22.472+0000 7f56c1b31800 20 remove_watcher() i=7 2024-09-12T17:44:22.484 INFO:tasks.workunit.client.0.smithi063.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:44:52.510 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:52.591 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.589+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 20 realm 2024-09-12T17:44:52.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:52.593 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.591+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.592+0000 7ff96c942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.592+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.594 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.592+0000 7ff96c942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:52.595 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.592+0000 7ff96c942800 20 searching for the correct realm 2024-09-12T17:44:52.598 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.596+0000 7ff967eec640 0 -- 172.21.15.63:0/34667156 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7ff95c095910 msgr2=0x7ff95c087400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.802+0000 7ff967eec640 0 -- 172.21.15.63:0/34667156 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x564ed85ada60 msgr2=0x564ed85afe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.808+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 zone default found 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 4 Realm: () 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 zonegroup default 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.809+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.810+0000 7ff96c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.810+0000 7ff96c942800 20 started sync module instance, tier type = 2024-09-12T17:44:52.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.810+0000 7ff96c942800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.820+0000 7ff96c942800 20 add_watcher() i=0 2024-09-12T17:44:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.820+0000 7ff96c942800 20 add_watcher() i=1 2024-09-12T17:44:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.820+0000 7ff96c942800 20 add_watcher() i=2 2024-09-12T17:44:52.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.820+0000 7ff96c942800 20 add_watcher() i=3 2024-09-12T17:44:52.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.820+0000 7ff96c942800 20 add_watcher() i=4 2024-09-12T17:44:52.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.820+0000 7ff96c942800 20 add_watcher() i=5 2024-09-12T17:44:52.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.820+0000 7ff96c942800 20 add_watcher() i=6 2024-09-12T17:44:52.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.822+0000 7ff96c942800 20 add_watcher() i=7 2024-09-12T17:44:52.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.822+0000 7ff96c942800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:52.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.823+0000 7ff81efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:52.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff96c942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:52.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff96c942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:52.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff96c942800 5 note: GC not initialized 2024-09-12T17:44:52.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff81dfdb640 20 reqs_thread_entry: start 2024-09-12T17:44:52.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff96c942800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:52.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff96c942800 20 Filter name: none 2024-09-12T17:44:52.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff78f7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:52.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff96c942800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:44:52.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.824+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 : miss 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:52.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:52.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.825+0000 7ff96c942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.826+0000 7ff96c942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 2024-09-12T17:44:52.829 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.827+0000 7ff96c942800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:44:52.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.834+0000 7ff96c942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:52.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.834+0000 7ff96c942800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:52.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.834+0000 7ff96c942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.834+0000 7ff96c942800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40, ofs0, ns] 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff83f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431656 cookie 94896637336048 notifier 8094 bl.length()=1015 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff83f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff83f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff83f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_sources= new_sources= 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential sources added=[] removed=[] 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_dests= new_dests= 2024-09-12T17:44:52.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.835+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential dests added=[] removed=[] 2024-09-12T17:44:52.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.0 2024-09-12T17:44:52.842 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.0 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.1 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.1 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.2 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.2 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.3 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.3 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.4 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.4 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.5 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.5 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.6 2024-09-12T17:44:52.843 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.6 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.7 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.7 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.8 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.8 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.9 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.9 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.10 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.10 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.11 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2.11 2024-09-12T17:44:52.844 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.840+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.0 2024-09-12T17:44:52.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.841+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1 2024-09-12T17:44:52.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.842+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2 2024-09-12T17:44:52.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.842+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.3 2024-09-12T17:44:52.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.843+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.4 2024-09-12T17:44:52.845 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.843+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.5 2024-09-12T17:44:52.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.844+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.6 2024-09-12T17:44:52.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.844+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.7 2024-09-12T17:44:52.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.845+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.8 2024-09-12T17:44:52.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.845+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.9 2024-09-12T17:44:52.847 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.846+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.10 2024-09-12T17:44:52.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.849+0000 7ff96c942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:52.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.849+0000 7ff96c942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 2024-09-12T17:44:52.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff96c942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:52.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff96c942800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:52.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff96c942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.852 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff96c942800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40, ofs0, ns] 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff83effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431657 cookie 94896637336048 notifier 8094 bl.length()=1015 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff83effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff83effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.850+0000 7ff83effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.851+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_sources= new_sources= 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.851+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential sources added=[] removed=[] 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.851+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_dests= new_dests= 2024-09-12T17:44:52.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.851+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential dests added=[] removed=[] 2024-09-12T17:44:52.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.854+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.0 2024-09-12T17:44:52.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.854+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.1 2024-09-12T17:44:52.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.855+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.2 2024-09-12T17:44:52.857 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.855+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.3 2024-09-12T17:44:52.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.856+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.4 2024-09-12T17:44:52.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.856+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.5 2024-09-12T17:44:52.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.856+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.6 2024-09-12T17:44:52.858 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.857+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.7 2024-09-12T17:44:52.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.857+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.8 2024-09-12T17:44:52.859 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.857+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.9 2024-09-12T17:44:52.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.858+0000 7ff96c942800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40.10 2024-09-12T17:44:52.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.858+0000 7ff96c942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:52.860 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.858+0000 7ff96c942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 2024-09-12T17:44:52.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff96c942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:52.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff96c942800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:52.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff96c942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff96c942800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40, ofs0, ns] 2024-09-12T17:44:52.862 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff83effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431658 cookie 94896637336048 notifier 8094 bl.length()=983 2024-09-12T17:44:52.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff83effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 info.flags=0x17 2024-09-12T17:44:52.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff83effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 to cache LRU end 2024-09-12T17:44:52.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.860+0000 7ff83effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.861+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_sources= new_sources= 2024-09-12T17:44:52.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.861+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential sources added=[] removed=[] 2024-09-12T17:44:52.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.861+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): orig_dests= new_dests= 2024-09-12T17:44:52.863 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.861+0000 7ff96c942800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40]): potential dests added=[] removed=[] 2024-09-12T17:44:52.865 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.863+0000 7ff96c942800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:52.867 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.865+0000 7ff81efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:52.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.867+0000 7ff96c942800 20 remove_watcher() i=0 2024-09-12T17:44:52.869 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.867+0000 7ff96c942800 2 removed watcher, disabling cache 2024-09-12T17:44:52.870 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.868+0000 7ff96c942800 20 remove_watcher() i=1 2024-09-12T17:44:52.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.869+0000 7ff96c942800 20 remove_watcher() i=2 2024-09-12T17:44:52.872 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.870+0000 7ff96c942800 20 remove_watcher() i=3 2024-09-12T17:44:52.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.871+0000 7ff96c942800 20 remove_watcher() i=4 2024-09-12T17:44:52.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.872+0000 7ff96c942800 20 remove_watcher() i=5 2024-09-12T17:44:52.876 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.874+0000 7ff96c942800 20 remove_watcher() i=6 2024-09-12T17:44:52.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.875+0000 7ff96c942800 20 remove_watcher() i=7 2024-09-12T17:44:52.890 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:44:52.920 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:52.920 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:52.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.957+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 20 realm 2024-09-12T17:44:52.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:52.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.959+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.960+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.960+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.960+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:52.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.960+0000 7fc907820800 20 searching for the correct realm 2024-09-12T17:44:52.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:52.964+0000 7fc904b09640 0 -- 172.21.15.63:0/4200829787 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fc8fc09cdd0 msgr2=0x7fc8fc069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:53.170 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.168+0000 7fc905b0b640 0 -- 172.21.15.63:0/4200829787 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55f3eacfca70 msgr2=0x55f3eacfeef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.175 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 zone default found 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 4 Realm: () 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 zonegroup default 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.173+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.174+0000 7fc907820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.174+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.174+0000 7fc907820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.174+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.175+0000 7fc907820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.175+0000 7fc907820800 20 started sync module instance, tier type = 2024-09-12T17:44:53.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.175+0000 7fc907820800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:53.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.185+0000 7fc907820800 20 add_watcher() i=0 2024-09-12T17:44:53.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.185+0000 7fc907820800 20 add_watcher() i=1 2024-09-12T17:44:53.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.185+0000 7fc907820800 20 add_watcher() i=2 2024-09-12T17:44:53.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.185+0000 7fc907820800 20 add_watcher() i=3 2024-09-12T17:44:53.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.185+0000 7fc907820800 20 add_watcher() i=4 2024-09-12T17:44:53.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.185+0000 7fc907820800 20 add_watcher() i=5 2024-09-12T17:44:53.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.185+0000 7fc907820800 20 add_watcher() i=6 2024-09-12T17:44:53.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.186+0000 7fc907820800 20 add_watcher() i=7 2024-09-12T17:44:53.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.186+0000 7fc907820800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:53.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.188+0000 7fc7bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc907820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:53.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc907820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:53.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc907820800 5 note: GC not initialized 2024-09-12T17:44:53.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc7bafe5640 20 reqs_thread_entry: start 2024-09-12T17:44:53.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc907820800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:53.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc907820800 20 Filter name: none 2024-09-12T17:44:53.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc7b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:53.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.189+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.190+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:53.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.190+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.191+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:53.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.191+0000 7fc907820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:53.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.191+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.191+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:53.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.191+0000 7fc907820800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.191+0000 7fc907820800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:53.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.191+0000 7fc907820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:53.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.193+0000 7fc7bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.196+0000 7fc907820800 20 remove_watcher() i=0 2024-09-12T17:44:53.198 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.196+0000 7fc907820800 2 removed watcher, disabling cache 2024-09-12T17:44:53.199 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.197+0000 7fc907820800 20 remove_watcher() i=1 2024-09-12T17:44:53.200 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.198+0000 7fc907820800 20 remove_watcher() i=2 2024-09-12T17:44:53.201 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.199+0000 7fc907820800 20 remove_watcher() i=3 2024-09-12T17:44:53.203 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.201+0000 7fc907820800 20 remove_watcher() i=4 2024-09-12T17:44:53.204 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.202+0000 7fc907820800 20 remove_watcher() i=5 2024-09-12T17:44:53.205 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.203+0000 7fc907820800 20 remove_watcher() i=6 2024-09-12T17:44:53.207 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.206+0000 7fc907820800 20 remove_watcher() i=7 2024-09-12T17:44:53.225 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:53.225 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:53.225 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: abort-at-change-reshard-state id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:44:53.225 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:53.301 INFO:tasks.workunit.client.0.smithi063.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:44:53.304 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:44:53.331 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:53.331 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:53.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.368+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.369+0000 7fa30e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.369+0000 7fa30e123800 20 realm 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.369+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.370+0000 7fa30e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.370+0000 7fa30e123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.370+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.370+0000 7fa30e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.372 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.370+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.371+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:53.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.371+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.371+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:53.373 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.371+0000 7fa30e123800 20 searching for the correct realm 2024-09-12T17:44:53.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.374+0000 7fa309612640 0 -- 172.21.15.63:0/634319804 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa3000083f0 msgr2=0x7fa300008870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:53.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.378+0000 7fa30a614640 0 -- 172.21.15.63:0/634319804 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x557fb710a410 msgr2=0x557fb710c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.382+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 zone default found 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 4 Realm: () 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 zonegroup default 2024-09-12T17:44:53.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 started sync module instance, tier type = 2024-09-12T17:44:53.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.383+0000 7fa30e123800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:53.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.392+0000 7fa30e123800 20 add_watcher() i=0 2024-09-12T17:44:53.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.392+0000 7fa30e123800 20 add_watcher() i=1 2024-09-12T17:44:53.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.392+0000 7fa30e123800 20 add_watcher() i=2 2024-09-12T17:44:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.392+0000 7fa30e123800 20 add_watcher() i=3 2024-09-12T17:44:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.392+0000 7fa30e123800 20 add_watcher() i=4 2024-09-12T17:44:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.392+0000 7fa30e123800 20 add_watcher() i=5 2024-09-12T17:44:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.392+0000 7fa30e123800 20 add_watcher() i=6 2024-09-12T17:44:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.393+0000 7fa30e123800 20 add_watcher() i=7 2024-09-12T17:44:53.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.393+0000 7fa30e123800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:53.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.394+0000 7fa1bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa30e123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:53.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa30e123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:53.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa30e123800 5 note: GC not initialized 2024-09-12T17:44:53.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa1ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:44:53.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa30e123800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:53.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa30e123800 20 Filter name: none 2024-09-12T17:44:53.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa12bfff640 20 reqs_thread_entry: start 2024-09-12T17:44:53.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.395+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:53.398 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.396+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.396+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:44:53.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.396+0000 7fa30e123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:53.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.396+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.396+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:53.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.396+0000 7fa30e123800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.397+0000 7fa30e123800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:44:53.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.397+0000 7fa30e123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:53.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.399+0000 7fa1bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.401+0000 7fa30e123800 20 remove_watcher() i=0 2024-09-12T17:44:53.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.401+0000 7fa30e123800 2 removed watcher, disabling cache 2024-09-12T17:44:53.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.402+0000 7fa30e123800 20 remove_watcher() i=1 2024-09-12T17:44:53.405 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.403+0000 7fa30e123800 20 remove_watcher() i=2 2024-09-12T17:44:53.407 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.405+0000 7fa30e123800 20 remove_watcher() i=3 2024-09-12T17:44:53.408 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.406+0000 7fa30e123800 20 remove_watcher() i=4 2024-09-12T17:44:53.409 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.407+0000 7fa30e123800 20 remove_watcher() i=5 2024-09-12T17:44:53.410 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.408+0000 7fa30e123800 20 remove_watcher() i=6 2024-09-12T17:44:53.411 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.409+0000 7fa30e123800 20 remove_watcher() i=7 2024-09-12T17:44:53.422 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:53.422 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:44:53.422 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:44:53.422 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:53.423 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:44:53.453 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:53.453 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:53.491 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.489+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.493 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.491+0000 7f650013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.491+0000 7f650013b800 20 realm 2024-09-12T17:44:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.491+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.491+0000 7f650013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.491+0000 7f650013b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.491+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.492+0000 7f650013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.494 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.492+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.492+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:53.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.492+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.493+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:53.495 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.493+0000 7f650013b800 20 searching for the correct realm 2024-09-12T17:44:53.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.496+0000 7f64fb6ba640 0 -- 172.21.15.63:0/14891020 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f64e4096930 msgr2=0x7f64e406c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:53.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.700+0000 7f64fb6ba640 0 -- 172.21.15.63:0/14891020 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55c8f97797c0 msgr2=0x55c8f977bc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:53.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.704+0000 7f650013b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:53.707 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.704+0000 7f650013b800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.704+0000 7f650013b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.704+0000 7f650013b800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.704+0000 7f650013b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.704+0000 7f650013b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.704+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 zone default found 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 4 Realm: () 2024-09-12T17:44:53.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 zonegroup default 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.705+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.706+0000 7f650013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.706+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.706+0000 7f650013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.706+0000 7f650013b800 20 started sync module instance, tier type = 2024-09-12T17:44:53.710 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.706+0000 7f650013b800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:53.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.716+0000 7f650013b800 20 add_watcher() i=0 2024-09-12T17:44:53.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.716+0000 7f650013b800 20 add_watcher() i=1 2024-09-12T17:44:53.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.716+0000 7f650013b800 20 add_watcher() i=2 2024-09-12T17:44:53.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.716+0000 7f650013b800 20 add_watcher() i=3 2024-09-12T17:44:53.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.716+0000 7f650013b800 20 add_watcher() i=4 2024-09-12T17:44:53.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.716+0000 7f650013b800 20 add_watcher() i=5 2024-09-12T17:44:53.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.716+0000 7f650013b800 20 add_watcher() i=6 2024-09-12T17:44:53.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.717+0000 7f650013b800 20 add_watcher() i=7 2024-09-12T17:44:53.719 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.717+0000 7f650013b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:53.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.719+0000 7f63b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.719+0000 7f650013b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.719+0000 7f650013b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.719+0000 7f650013b800 5 note: GC not initialized 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.719+0000 7f63b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.719+0000 7f650013b800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.719+0000 7f650013b800 20 Filter name: none 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.720+0000 7f632a7fc640 20 reqs_thread_entry: start 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.720+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.720+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:53.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.720+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.720+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:44:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.720+0000 7f650013b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.720+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.721+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.721+0000 7f650013b800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.721+0000 7f650013b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:44:53.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.721+0000 7f650013b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:53.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.723+0000 7f63b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.725+0000 7f650013b800 20 remove_watcher() i=0 2024-09-12T17:44:53.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.725+0000 7f650013b800 2 removed watcher, disabling cache 2024-09-12T17:44:53.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.726+0000 7f650013b800 20 remove_watcher() i=1 2024-09-12T17:44:53.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.727+0000 7f650013b800 20 remove_watcher() i=2 2024-09-12T17:44:53.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.728+0000 7f650013b800 20 remove_watcher() i=3 2024-09-12T17:44:53.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.729+0000 7f650013b800 20 remove_watcher() i=4 2024-09-12T17:44:53.731 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.730+0000 7f650013b800 20 remove_watcher() i=5 2024-09-12T17:44:53.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.731+0000 7f650013b800 20 remove_watcher() i=6 2024-09-12T17:44:53.733 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.732+0000 7f650013b800 20 remove_watcher() i=7 2024-09-12T17:44:53.746 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:44:53.781 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:53.781 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:53.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.818+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 20 realm 2024-09-12T17:44:53.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:53.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:53.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:53.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.820+0000 7f1f76a10800 20 searching for the correct realm 2024-09-12T17:44:53.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:53.824+0000 7f1f719bb640 0 -- 172.21.15.63:0/979998626 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1f5c01f040 msgr2=0x7f1f5c082970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:54.031 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.029+0000 7f1f729bd640 0 -- 172.21.15.63:0/979998626 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559878fc83c0 msgr2=0x559878fca800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.036 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 zone default found 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 4 Realm: () 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 zonegroup default 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.038 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.036+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.036+0000 7f1f76a10800 20 started sync module instance, tier type = 2024-09-12T17:44:54.039 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.036+0000 7f1f76a10800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=0 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=1 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=2 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=3 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=4 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=5 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=6 2024-09-12T17:44:54.047 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.046+0000 7f1f76a10800 20 add_watcher() i=7 2024-09-12T17:44:54.048 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.046+0000 7f1f76a10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:54.049 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.047+0000 7f1e28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1f76a10800 5 note: GC not initialized 2024-09-12T17:44:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1da37fe640 20 reqs_thread_entry: start 2024-09-12T17:44:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1f76a10800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1f76a10800 20 Filter name: none 2024-09-12T17:44:54.050 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1da17fa640 20 reqs_thread_entry: start 2024-09-12T17:44:54.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1f76a10800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:44:54.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:54.051 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.052 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.049+0000 7f1f76a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:44:54.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.055+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.055+0000 7f1f76a10800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.055+0000 7f1f76a10800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.055+0000 7f1f76a10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94113353250752 notifier 7667 bl.length()=911 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:44:54.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.1 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.1 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.2 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.2 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.3 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.3 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.4 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.4 2024-09-12T17:44:54.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.5 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.5 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.6 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.6 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.7 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.7 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.8 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.8 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.9 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.9 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.10 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.10 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.11 2024-09-12T17:44:54.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.11 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.12 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.12 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.13 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.13 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.062+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.062+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.064+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.064+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.066+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.066+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.066+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.066+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.067+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.067+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.068+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.068+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.071 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f76a10800 time 2024-09-12T17:44:54.071935+0000 2024-09-12T17:44:54.071 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:54.072 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.072 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f77b8c71a] 2024-09-12T17:44:54.072 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.072 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.070+0000 7f1f76a10800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f76a10800 time 2024-09-12T17:44:54.071935+0000 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f77b8c71a] 2024-09-12T17:44:54.073 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:44:54.074 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1f76a10800 thread_name:radosgw-admin 2024-09-12T17:44:54.091 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f7683e6f0] 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f7688b99c] 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f77b8c774] 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.092 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.071+0000 7f1f76a10800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1f76a10800 thread_name:radosgw-admin 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f7683e6f0] 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f7688b99c] 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f77b8c774] 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.094 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878d93090 auth_method 0 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:44:53.802+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:44:53.802+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:44:53.802+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_done global_id 8157 payload 824 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:44:53.802+0000 7f1f729bd640 1 monclient: found mon.noname-a 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: dump: 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.096 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: dump: 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.097 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:44:53.803+0000 7f1f76a10800 5 monclient: authenticate success, global_id 8157 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:44:53.803+0000 7f1e60608640 4 set_mon_vals no callback set 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:44:53.803+0000 7f1f76a10800 1 librados: init done 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:44:53.805+0000 7f1e5ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:54.098 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:44:53.805+0000 7f1e5ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:44:53.805+0000 7f1e5ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:44:53.805+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1e58076470 auth_method 0 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:44:53.805+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878f1d0e0 auth_method 0 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:44:53.806+0000 7f1f721bc640 10 monclient: get_auth_request con 0x559878f29f00 auth_method 0 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:44:53.807+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878f2d760 auth_method 0 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:44:53.808+0000 7f1f76a10800 10 monclient: build_initial_monmap 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:44:53.808+0000 7f1f76a10800 1 build_initial for_mkfs: 0 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:44:53.808+0000 7f1f76a10800 10 monclient: monmap: 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:54.099 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding auth protocol: cephx 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding auth protocol: cephx 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding auth protocol: cephx 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.100 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:44:53.808+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command objecter_requests cmddesc objecter_requests hook 0x559878f36ae0 EEXIST 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient: init 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding auth protocol: cephx 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding auth protocol: cephx 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding auth protocol: cephx 2024-09-12T17:44:54.101 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:44:53.809+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:44:53.809+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.102 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command rotate-key cmddesc rotate-key hook 0x559878f32250 EEXIST 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-a con 0x559878f5a7d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-c con 0x559878f5caa0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-b con 0x559878f58fa0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): authenticate will time out at 2186.325565s 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878f5a7d0 auth_method 0 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.103 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): get_auth_request con 0x559878f5caa0 auth_method 0 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): get_auth_request con 0x559878f58fa0 auth_method 0 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.104 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_done global_id 7661 payload 824 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:44:53.809+0000 7f1f719bb640 1 monclient: found mon.noname-c 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.105 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.106 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.107 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:44:53.810+0000 7f1f76a10800 5 monclient: authenticate success, global_id 7661 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:44:53.810+0000 7f1f731be640 4 set_mon_vals no callback set 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:44:53.812+0000 7f1e57fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:44:53.812+0000 7f1e57fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:44:53.812+0000 7f1e57fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:44:53.812+0000 7f1f76a10800 10 monclient: get_monmap_and_config 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:44:53.812+0000 7f1f76a10800 10 monclient: build_initial_monmap 2024-09-12T17:44:54.108 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:44:53.812+0000 7f1f76a10800 1 build_initial for_mkfs: 0 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:44:53.812+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1e4c076380 auth_method 0 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:44:53.812+0000 7f1f76a10800 10 monclient: monmap: 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding auth protocol: cephx 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding auth protocol: cephx 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding auth protocol: cephx 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.110 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:44:53.812+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient: init 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding auth protocol: cephx 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding auth protocol: cephx 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding auth protocol: cephx 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:44:53.813+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:44:53.813+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command rotate-key cmddesc rotate-key hook 0x7ffd61709a78 EEXIST 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-b con 0x559878faec60 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-c con 0x559878f7fbb0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-a con 0x559878faa500 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:54.112 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): authenticate will time out at 2186.329565s 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): get_auth_request con 0x559878f7fbb0 auth_method 0 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): get_auth_request con 0x559878faa500 auth_method 0 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.113 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878faec60 auth_method 0 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.114 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_done global_id 7664 payload 274 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:44:53.813+0000 7f1f719bb640 1 monclient: found mon.noname-c 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: dump: 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.115 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: dump: 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.116 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 monclient: authenticate success, global_id 7664 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:44:53.814+0000 7f1f76a10800 4 set_mon_vals no callback set 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: shutdown 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: build_initial_monmap 2024-09-12T17:44:54.117 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:44:53.814+0000 7f1f76a10800 1 build_initial for_mkfs: 0 2024-09-12T17:44:54.119 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: monmap: 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding auth protocol: cephx 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding auth protocol: cephx 2024-09-12T17:44:54.120 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding auth protocol: cephx 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:44:53.815+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.121 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: starting msgr at 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: starting objecter 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command objecter_requests cmddesc objecter_requests hook 0x559878fa9090 EEXIST 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: setting wanted keys 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: calling monclient init 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient: init 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding auth protocol: cephx 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding auth protocol: cephx 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding auth protocol: cephx 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.122 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:44:53.815+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:44:53.815+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command rotate-key cmddesc rotate-key hook 0x559878f726c8 EEXIST 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-b con 0x559878f7fbb0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:54.123 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-c con 0x559878faa500 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-a con 0x559878faec60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): authenticate will time out at 2186.331838s 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): get_auth_request con 0x559878faa500 auth_method 0 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): get_auth_request con 0x559878faec60 auth_method 0 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.124 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878f7fbb0 auth_method 0 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:44:53.816+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:44:53.816+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:44:53.816+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.125 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_done global_id 7667 payload 824 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:44:53.816+0000 7f1f719bb640 1 monclient: found mon.noname-c 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: dump: 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: dump: 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.127 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:44:53.816+0000 7f1f76a10800 5 monclient: authenticate success, global_id 7667 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:44:53.816+0000 7f1e55ffb640 4 set_mon_vals no callback set 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.128 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:44:53.816+0000 7f1f76a10800 1 librados: init done 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:44:53.816+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cr dump hook 0x559878faf118 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:44:53.818+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:44:53.818+0000 7f1e43fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:44:53.818+0000 7f1e43fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:44:53.818+0000 7f1e43fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:44:53.818+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1e3c076470 auth_method 0 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:44:53.818+0000 7f1f729bd640 10 monclient: get_auth_request con 0x559878fc83c0 auth_method 0 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 realm 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:44:53.819+0000 7f1f76a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:44:53.819+0000 7f1f721bc640 10 monclient: get_auth_request con 0x559878fcc5f0 auth_method 0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 searching for the correct realm 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:44:53.821+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878fd18e0 auth_method 0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:44:53.821+0000 7f1f729bd640 10 monclient: get_auth_request con 0x7f1f5c037030 auth_method 0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:44:53.822+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1f6408e470 auth_method 0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:44:53.823+0000 7f1f719bb640 10 monclient: get_auth_request con 0x7f1f5c01f040 auth_method 0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:44:53.824+0000 7f1f719bb640 0 -- 172.21.15.63:0/979998626 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1f5c01f040 msgr2=0x7f1f5c082970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:44:54.026+0000 7f1f719bb640 10 monclient: get_auth_request con 0x7f1f5c01f040 auth_method 0 2024-09-12T17:44:54.130 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:44:54.028+0000 7f1f729bd640 10 monclient: get_auth_request con 0x7f1f6408c950 auth_method 0 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:44:54.028+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1f6c01d060 auth_method 0 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:44:54.029+0000 7f1f729bd640 0 -- 172.21.15.63:0/979998626 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559878fc83c0 msgr2=0x559878fca800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:44:54.029+0000 7f1e43fff640 1 client.7667.objecter ms_handle_reset 0x559878fc83c0 session 0x559878fc7cf0 osd.6 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:44:54.029+0000 7f1e43fff640 10 monclient: _renew_subs 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:44:54.029+0000 7f1e43fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:44:54.030+0000 7f1f729bd640 10 monclient: get_auth_request con 0x7f1e3c086790 auth_method 0 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:44:54.032+0000 7f1e43fff640 1 client.7667.objecter ms_handle_reset 0x559878fd18e0 session 0x559878fd1260 osd.4 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:44:54.032+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878fc83c0 auth_method 0 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:54.131 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 zone default found 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:44:54.035+0000 7f1f76a10800 4 Realm: () 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:44:54.035+0000 7f1f76a10800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:44:54.035+0000 7f1f76a10800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:44:54.035+0000 7f1f76a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 zonegroup default 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.132 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:44:54.036+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:44:54.036+0000 7f1f76a10800 20 started sync module instance, tier type = 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:44:54.036+0000 7f1f76a10800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=0 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=1 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=2 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=3 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=4 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=5 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=6 2024-09-12T17:44:54.133 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:44:54.046+0000 7f1f76a10800 20 add_watcher() i=7 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:44:54.046+0000 7f1f76a10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding auth protocol: cephx 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding auth protocol: cephx 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding auth protocol: cephx 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.134 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:44:54.047+0000 7f1e28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:44:54.048+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache list hook 0x559878fadbc0 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache inspect hook 0x559878fadbc0 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache erase hook 0x559878fadbc0 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache zap hook 0x559878fadbc0 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 note: GC not initialized 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:44:54.048+0000 7f1da37fe640 20 reqs_thread_entry: start 2024-09-12T17:44:54.135 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace show hook 0x7f1f6404e8c0 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace history hook 0x7f1f6404e8c0 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace active hook 0x7f1f6404e8c0 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace active_short hook 0x7f1f6404e8c0 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 Filter name: none 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:44:54.048+0000 7f1da17fa640 20 reqs_thread_entry: start 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:44:54.048+0000 7f1f76a10800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:44:54.136 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94113353250752 notifier 7667 bl.length()=911 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.137 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.1 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.1 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.2 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.2 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.3 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.3 2024-09-12T17:44:54.138 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.4 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.4 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.5 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.5 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.6 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.6 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.7 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.7 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.8 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.8 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.9 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.9 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.10 2024-09-12T17:44:54.139 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.10 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.11 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.11 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.12 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.12 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.13 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.13 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:44:54.062+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:44:54.062+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.140 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:44:54.064+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:44:54.064+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:44:54.066+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:44:54.066+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.141 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:44:54.066+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:44:54.066+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:44:54.067+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:44:54.067+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:44:54.068+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:44:54.068+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:44:54.070+0000 7f1f76a10800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f76a10800 time 2024-09-12T17:44:54.071935+0000 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f77b8c71a] 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.142 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:44:54.071+0000 7f1f76a10800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1f76a10800 thread_name:radosgw-admin 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f7683e6f0] 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f7688b99c] 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f77b8c774] 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.144 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:54.146 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:44:54.147 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:54.148 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:44:54.149 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:54.150 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:54.151 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1da17fa640 / http_manager 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1da37fe640 / http_manager 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e28fe1640 / rgw_dt_lg_renew 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e43fff640 / ms_dispatch 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e55ffb640 / io_context_pool 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e57fff640 / ms_dispatch 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e5ee05640 / ms_dispatch 2024-09-12T17:44:54.152 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e60608640 / io_context_pool 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f719bb640 / msgr-worker-2 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f721bc640 / msgr-worker-1 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f729bd640 / msgr-worker-0 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f731be640 / io_context_pool 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f76a10800 / radosgw-admin 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.148215.log 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.153 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878d93090 auth_method 0 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:44:53.802+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:44:53.802+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:44:53.802+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.154 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:44:53.802+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient(hunting): handle_auth_done global_id 8157 payload 824 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:44:53.802+0000 7f1f729bd640 1 monclient: found mon.noname-a 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:44:53.802+0000 7f1f729bd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: dump: 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.155 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:44:53.803+0000 7f1e5ee05640 10 monclient: dump: 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.156 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:44:53.803+0000 7f1f76a10800 5 monclient: authenticate success, global_id 8157 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:44:53.803+0000 7f1e60608640 4 set_mon_vals no callback set 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:44:53.803+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:44:53.803+0000 7f1f76a10800 1 librados: init done 2024-09-12T17:44:54.157 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:44:53.805+0000 7f1e5ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:44:53.805+0000 7f1e5ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:44:53.805+0000 7f1e5ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:44:53.805+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1e58076470 auth_method 0 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:44:53.805+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878f1d0e0 auth_method 0 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:44:53.806+0000 7f1f721bc640 10 monclient: get_auth_request con 0x559878f29f00 auth_method 0 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:44:53.807+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878f2d760 auth_method 0 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:44:53.808+0000 7f1f76a10800 10 monclient: build_initial_monmap 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:44:53.808+0000 7f1f76a10800 1 build_initial for_mkfs: 0 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:44:53.808+0000 7f1f76a10800 10 monclient: monmap: 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:54.158 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding auth protocol: cephx 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding auth protocol: cephx 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding auth protocol: cephx 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.159 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: crc 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 AuthRegistry(0x559878f330b0) adding con mode: secure 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:44:53.808+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:44:53.808+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command objecter_requests cmddesc objecter_requests hook 0x559878f36ae0 EEXIST 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient: init 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding auth protocol: cephx 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding auth protocol: cephx 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding auth protocol: cephx 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.161 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: crc 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 AuthRegistry(0x559878f32108) adding con mode: secure 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:44:53.809+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:44:53.809+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:44:53.809+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command rotate-key cmddesc rotate-key hook 0x559878f32250 EEXIST 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-a con 0x559878f5a7d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-c con 0x559878f5caa0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-b con 0x559878f58fa0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.162 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:44:53.809+0000 7f1f76a10800 10 monclient(hunting): authenticate will time out at 2186.325565s 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878f5a7d0 auth_method 0 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): get_auth_request con 0x559878f5caa0 auth_method 0 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): get_auth_request con 0x559878f58fa0 auth_method 0 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.163 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:44:53.809+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:44:53.809+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient(hunting): handle_auth_done global_id 7661 payload 824 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:44:53.809+0000 7f1f719bb640 1 monclient: found mon.noname-c 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:44:53.809+0000 7f1f719bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.164 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.165 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:44:53.810+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.166 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:44:53.810+0000 7f1f76a10800 5 monclient: authenticate success, global_id 7661 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:44:53.810+0000 7f1f731be640 4 set_mon_vals no callback set 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:44:53.810+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:44:53.812+0000 7f1e57fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:44:53.812+0000 7f1e57fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:44:53.812+0000 7f1e57fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:44:53.812+0000 7f1f76a10800 10 monclient: get_monmap_and_config 2024-09-12T17:44:54.167 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:44:53.812+0000 7f1f76a10800 10 monclient: build_initial_monmap 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:44:53.812+0000 7f1f76a10800 1 build_initial for_mkfs: 0 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:44:53.812+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1e4c076380 auth_method 0 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:44:53.812+0000 7f1f76a10800 10 monclient: monmap: 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:54.168 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding auth protocol: cephx 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding auth protocol: cephx 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding auth protocol: cephx 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.169 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: crc 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:44:53.812+0000 7f1f76a10800 5 AuthRegistry(0x559878f7a5c0) adding con mode: secure 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:44:53.812+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient: init 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding auth protocol: cephx 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding auth protocol: cephx 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding auth protocol: cephx 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.170 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: crc 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709930) adding con mode: secure 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:44:53.813+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:44:53.813+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:44:53.813+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command rotate-key cmddesc rotate-key hook 0x7ffd61709a78 EEXIST 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-b con 0x559878faec60 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-c con 0x559878f7fbb0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-a con 0x559878faa500 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:54.171 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:44:53.813+0000 7f1f76a10800 10 monclient(hunting): authenticate will time out at 2186.329565s 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): get_auth_request con 0x559878f7fbb0 auth_method 0 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): get_auth_request con 0x559878faa500 auth_method 0 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.172 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878faec60 auth_method 0 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:44:53.813+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:44:53.813+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.173 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient(hunting): handle_auth_done global_id 7664 payload 274 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:44:53.813+0000 7f1f719bb640 1 monclient: found mon.noname-c 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:44:53.813+0000 7f1f719bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: dump: 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.174 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:44:53.814+0000 7f1e55ffb640 10 monclient: dump: 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.175 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 monclient: authenticate success, global_id 7664 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:44:53.814+0000 7f1f76a10800 4 set_mon_vals no callback set 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: shutdown 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: build_initial_monmap 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:44:53.814+0000 7f1f76a10800 1 build_initial for_mkfs: 0 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:44:53.814+0000 7f1f76a10800 10 monclient: monmap: 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding auth protocol: cephx 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding auth protocol: cephx 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding auth protocol: cephx 2024-09-12T17:44:54.177 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: crc 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:44:53.814+0000 7f1f76a10800 5 AuthRegistry(0x559878faae30) adding con mode: secure 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:44:53.815+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.178 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: starting msgr at 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: starting objecter 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command objecter_requests cmddesc objecter_requests hook 0x559878fa9090 EEXIST 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: setting wanted keys 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:44:53.815+0000 7f1f76a10800 1 librados: calling monclient init 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient: init 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding auth protocol: cephx 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding auth protocol: cephx 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding auth protocol: cephx 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.179 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: crc 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 AuthRegistry(0x559878f72580) adding con mode: secure 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:44:53.815+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:44:53.815+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:44:53.815+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command rotate-key cmddesc rotate-key hook 0x559878f726c8 EEXIST 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-b con 0x559878f7fbb0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:44:54.180 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-c con 0x559878faa500 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): picked mon.noname-a con 0x559878faec60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:44:53.815+0000 7f1f76a10800 10 monclient(hunting): authenticate will time out at 2186.331838s 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): get_auth_request con 0x559878faa500 auth_method 0 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:44:53.815+0000 7f1f719bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): get_auth_request con 0x559878faec60 auth_method 0 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.181 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:44:53.815+0000 7f1f729bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): get_auth_request con 0x559878f7fbb0 auth_method 0 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:44:53.816+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:44:53.816+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:44:53.816+0000 7f1f729bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:54.182 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:44:53.816+0000 7f1f721bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient(hunting): handle_auth_done global_id 7667 payload 824 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient: _finish_hunting 0 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:44:53.816+0000 7f1f719bb640 1 monclient: found mon.noname-c 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:44:53.816+0000 7f1f719bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: dump: 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.183 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: _finish_auth 0 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:44:53.816+0000 7f1e43fff640 10 monclient: dump: 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:44:54.184 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:44:53.816+0000 7f1f76a10800 5 monclient: authenticate success, global_id 7667 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:44:53.816+0000 7f1e55ffb640 4 set_mon_vals no callback set 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _renew_subs 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:44:53.816+0000 7f1f76a10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:44:53.816+0000 7f1f76a10800 1 librados: init done 2024-09-12T17:44:54.185 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:44:53.816+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cr dump hook 0x559878faf118 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:44:53.818+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:44:53.818+0000 7f1e43fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:44:53.818+0000 7f1e43fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:44:53.818+0000 7f1e43fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:44:53.818+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1e3c076470 auth_method 0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:44:53.818+0000 7f1f729bd640 10 monclient: get_auth_request con 0x559878fc83c0 auth_method 0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 realm 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:44:53.819+0000 7f1f76a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.186 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:44:53.819+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:44:53.819+0000 7f1f721bc640 10 monclient: get_auth_request con 0x559878fcc5f0 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:44:53.820+0000 7f1f76a10800 20 searching for the correct realm 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:44:53.821+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878fd18e0 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:44:53.821+0000 7f1f729bd640 10 monclient: get_auth_request con 0x7f1f5c037030 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:44:53.822+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1f6408e470 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:44:53.823+0000 7f1f719bb640 10 monclient: get_auth_request con 0x7f1f5c01f040 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:44:53.824+0000 7f1f719bb640 0 -- 172.21.15.63:0/979998626 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1f5c01f040 msgr2=0x7f1f5c082970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:44:54.026+0000 7f1f719bb640 10 monclient: get_auth_request con 0x7f1f5c01f040 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:44:54.028+0000 7f1f729bd640 10 monclient: get_auth_request con 0x7f1f6408c950 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:44:54.028+0000 7f1f721bc640 10 monclient: get_auth_request con 0x7f1f6c01d060 auth_method 0 2024-09-12T17:44:54.187 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:44:54.029+0000 7f1f729bd640 0 -- 172.21.15.63:0/979998626 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559878fc83c0 msgr2=0x559878fca800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:44:54.029+0000 7f1e43fff640 1 client.7667.objecter ms_handle_reset 0x559878fc83c0 session 0x559878fc7cf0 osd.6 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:44:54.029+0000 7f1e43fff640 10 monclient: _renew_subs 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:44:54.029+0000 7f1e43fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:44:54.030+0000 7f1f729bd640 10 monclient: get_auth_request con 0x7f1e3c086790 auth_method 0 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:44:54.032+0000 7f1e43fff640 1 client.7667.objecter ms_handle_reset 0x559878fd18e0 session 0x559878fd1260 osd.4 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:44:54.032+0000 7f1f719bb640 10 monclient: get_auth_request con 0x559878fc83c0 auth_method 0 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:54.188 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:44:54.034+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 zone default found 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:44:54.035+0000 7f1f76a10800 4 Realm: () 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:44:54.035+0000 7f1f76a10800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:44:54.035+0000 7f1f76a10800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:44:54.035+0000 7f1f76a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 zonegroup default 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.189 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:44:54.035+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:44:54.036+0000 7f1f76a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:44:54.036+0000 7f1f76a10800 20 started sync module instance, tier type = 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:44:54.036+0000 7f1f76a10800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=0 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=1 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=2 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=3 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=4 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=5 2024-09-12T17:44:54.190 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:44:54.045+0000 7f1f76a10800 20 add_watcher() i=6 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:44:54.046+0000 7f1f76a10800 20 add_watcher() i=7 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:44:54.046+0000 7f1f76a10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding auth protocol: cephx 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding auth protocol: cephx 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding auth protocol: cephx 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.191 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: crc 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:44:54.047+0000 7f1f76a10800 5 AuthRegistry(0x7ffd61709e00) adding con mode: secure 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:44:54.047+0000 7f1e28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:44:54.048+0000 7f1f76a10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache list hook 0x559878fadbc0 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache inspect hook 0x559878fadbc0 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache erase hook 0x559878fadbc0 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command cache zap hook 0x559878fadbc0 2024-09-12T17:44:54.192 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 note: GC not initialized 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:44:54.048+0000 7f1da37fe640 20 reqs_thread_entry: start 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace show hook 0x7f1f6404e8c0 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace history hook 0x7f1f6404e8c0 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace active hook 0x7f1f6404e8c0 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:44:54.048+0000 7f1f76a10800 5 asok(0x559878cbc730) register_command sync trace active_short hook 0x7f1f6404e8c0 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 Filter name: none 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:44:54.048+0000 7f1da17fa640 20 reqs_thread_entry: start 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:44:54.048+0000 7f1f76a10800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:44:54.048+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:44:54.193 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:44:54.049+0000 7f1f76a10800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:44:54.049+0000 7f1f76a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:44:54.055+0000 7f1f76a10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:44:54.194 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94113353250752 notifier 7667 bl.length()=911 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:44:54.056+0000 7f1e55ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:44:54.056+0000 7f1f76a10800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.1 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.1 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.2 2024-09-12T17:44:54.195 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.2 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.3 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.3 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.4 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.4 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.5 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.5 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.6 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.6 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.7 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.7 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.8 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.8 2024-09-12T17:44:54.196 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.9 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.9 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.10 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.10 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.11 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.11 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.12 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.12 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.13 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.13 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:44:54.061+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:44:54.061+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:44:54.062+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:44:54.062+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.197 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:44:54.063+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:44:54.063+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:44:54.064+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:44:54.064+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:44:54.065+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.198 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:44:54.065+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:44:54.066+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:44:54.066+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:44:54.066+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:44:54.066+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:44:54.067+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:44:54.067+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:44:54.068+0000 7f1f76a10800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:44:54.068+0000 7f1f76a10800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:44:54.070+0000 7f1f76a10800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f76a10800 time 2024-09-12T17:44:54.071935+0000 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.199 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f77b8c71a] 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:44:54.071+0000 7f1f76a10800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f1f76a10800 thread_name:radosgw-admin 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:54.200 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f7683e6f0] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f7688b99c] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f77b8c774] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f77b8c8d8] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559877c0d841] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x559877c1c734] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559877c1d5d4] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f76829590] 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:44:54.201 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:54.202 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:44:54.203 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:44:54.204 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:44:54.205 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:44:54.206 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:54.207 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1da17fa640 / http_manager 2024-09-12T17:44:54.208 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1da37fe640 / http_manager 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e28fe1640 / rgw_dt_lg_renew 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e43fff640 / ms_dispatch 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e55ffb640 / io_context_pool 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e57fff640 / ms_dispatch 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e5ee05640 / ms_dispatch 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1e60608640 / io_context_pool 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f719bb640 / msgr-worker-2 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f721bc640 / msgr-worker-1 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f729bd640 / msgr-worker-0 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f731be640 / io_context_pool 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: 7f1f76a10800 / radosgw-admin 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:44:54.209 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:44:54.073600Z_71c5edb2-15e3-48d9-ac38-c1abb1f70552/log 2024-09-12T17:44:54.210 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:44:54.210 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:44:54.211 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:54.211 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:54.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.150+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.152+0000 7f9cc1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.152+0000 7f9cc1098800 20 realm 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.152+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.152+0000 7f9cc1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.152+0000 7f9cc1098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.152+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.153+0000 7f9cc1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.153+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.153+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.153+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.154+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.154+0000 7f9cc1098800 20 searching for the correct realm 2024-09-12T17:44:54.212 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.157+0000 7f9cbe388640 0 -- 172.21.15.63:0/4144760631 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f9cb4028040 msgr2=0x7f9cb40a4750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:54.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.362+0000 7f9cbf38a640 0 -- 172.21.15.63:0/4144760631 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55759fbbb690 msgr2=0x55759fbbdae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:54.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:54.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:54.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:54.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:54.368 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:54.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:54.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.369 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.366+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:54.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 zone default found 2024-09-12T17:44:54.370 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 4 Realm: () 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 zonegroup default 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.367+0000 7f9cc1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.368+0000 7f9cc1098800 20 started sync module instance, tier type = 2024-09-12T17:44:54.371 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.368+0000 7f9cc1098800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.376+0000 7f9cc1098800 20 add_watcher() i=0 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.376+0000 7f9cc1098800 20 add_watcher() i=1 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.376+0000 7f9cc1098800 20 add_watcher() i=2 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.376+0000 7f9cc1098800 20 add_watcher() i=3 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.376+0000 7f9cc1098800 20 add_watcher() i=4 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.376+0000 7f9cc1098800 20 add_watcher() i=5 2024-09-12T17:44:54.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.376+0000 7f9cc1098800 20 add_watcher() i=6 2024-09-12T17:44:54.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.377+0000 7f9cc1098800 20 add_watcher() i=7 2024-09-12T17:44:54.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.377+0000 7f9cc1098800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:54.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9b757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:54.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9cc1098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:54.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9cc1098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:54.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9cc1098800 5 note: GC not initialized 2024-09-12T17:44:54.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9aeffff640 20 reqs_thread_entry: start 2024-09-12T17:44:54.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9cc1098800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:54.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9cc1098800 20 Filter name: none 2024-09-12T17:44:54.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.379+0000 7f9aedffb640 20 reqs_thread_entry: start 2024-09-12T17:44:54.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.380+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.380+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.380+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.380+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:44:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.380+0000 7f9cc1098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.380+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.381+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:54.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.381+0000 7f9cc1098800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.381+0000 7f9cc1098800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:44:54.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.381+0000 7f9cc1098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:54.385 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.383+0000 7f9b757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:54.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.385+0000 7f9cc1098800 20 remove_watcher() i=0 2024-09-12T17:44:54.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.385+0000 7f9cc1098800 2 removed watcher, disabling cache 2024-09-12T17:44:54.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.386+0000 7f9cc1098800 20 remove_watcher() i=1 2024-09-12T17:44:54.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.387+0000 7f9cc1098800 20 remove_watcher() i=2 2024-09-12T17:44:54.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.388+0000 7f9cc1098800 20 remove_watcher() i=3 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.389+0000 7f9cc1098800 20 remove_watcher() i=4 2024-09-12T17:44:54.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.390+0000 7f9cc1098800 20 remove_watcher() i=5 2024-09-12T17:44:54.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.391+0000 7f9cc1098800 20 remove_watcher() i=6 2024-09-12T17:44:54.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.392+0000 7f9cc1098800 20 remove_watcher() i=7 2024-09-12T17:44:54.417 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:44:54.446 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:54.446 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:54.484 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.482+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 20 realm 2024-09-12T17:44:54.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.486 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:54.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.484+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.485+0000 7f0b16f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.485+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.485+0000 7f0b16f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:54.488 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.485+0000 7f0b16f46800 20 searching for the correct realm 2024-09-12T17:44:54.490 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.488+0000 7f0b0ffff640 0 -- 172.21.15.63:0/3737767243 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f0b0006dfb0 msgr2=0x7f0b00076040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:54.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.693+0000 7f0b15238640 0 -- 172.21.15.63:0/3737767243 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56506ee82260 msgr2=0x56506ee84690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:54.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:54.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:44:54.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:54.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:44:54.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:54.699 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:54.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:54.700 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.697+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 zone default found 2024-09-12T17:44:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 4 Realm: () 2024-09-12T17:44:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:44:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:44:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:54.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 zonegroup default 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.698+0000 7f0b16f46800 20 started sync module instance, tier type = 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.699+0000 7f0b16f46800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:44:54.708 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.707+0000 7f0b16f46800 20 add_watcher() i=0 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.707+0000 7f0b16f46800 20 add_watcher() i=1 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.707+0000 7f0b16f46800 20 add_watcher() i=2 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.707+0000 7f0b16f46800 20 add_watcher() i=3 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.707+0000 7f0b16f46800 20 add_watcher() i=4 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.707+0000 7f0b16f46800 20 add_watcher() i=5 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.707+0000 7f0b16f46800 20 add_watcher() i=6 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.708+0000 7f0b16f46800 20 add_watcher() i=7 2024-09-12T17:44:54.709 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.708+0000 7f0b16f46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:54.711 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.709+0000 7f09cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f0b16f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f0b16f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f0b16f46800 5 note: GC not initialized 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f09c9fe3640 20 reqs_thread_entry: start 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f0b16f46800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f0b16f46800 20 Filter name: none 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f093b7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:54.712 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f0b16f46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:44:54.713 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.710+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:44:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:44:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:44:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:44:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 20 rados->read ofs=0 len=0 2024-09-12T17:44:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:44:54.714 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.711+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.712+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.712+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.712+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.715 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.712+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:44:54.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:44:54.716 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.713+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.714+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.714+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.714+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.714+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.714+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.717 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.714+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:44:54.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.715+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.715+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:44:54.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.715+0000 7f0b16f46800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.715+0000 7f0b16f46800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:44:54.718 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.716+0000 7f09cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:54.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.719+0000 7f0b16f46800 20 remove_watcher() i=0 2024-09-12T17:44:54.720 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.719+0000 7f0b16f46800 2 removed watcher, disabling cache 2024-09-12T17:44:54.721 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.720+0000 7f0b16f46800 20 remove_watcher() i=1 2024-09-12T17:44:54.722 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.721+0000 7f0b16f46800 20 remove_watcher() i=2 2024-09-12T17:44:54.723 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.722+0000 7f0b16f46800 20 remove_watcher() i=3 2024-09-12T17:44:54.724 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.723+0000 7f0b16f46800 20 remove_watcher() i=4 2024-09-12T17:44:54.725 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.724+0000 7f0b16f46800 20 remove_watcher() i=5 2024-09-12T17:44:54.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.725+0000 7f0b16f46800 20 remove_watcher() i=6 2024-09-12T17:44:54.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:44:54.727+0000 7f0b16f46800 20 remove_watcher() i=7 2024-09-12T17:45:24.762 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:45:24.801 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:24.801 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:24.846 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.845+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 20 realm 2024-09-12T17:45:24.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.848 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:24.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.847+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.849 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.848+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:24.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.848+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.849+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:24.850 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.849+0000 7fba18f46800 20 searching for the correct realm 2024-09-12T17:45:24.853 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:24.852+0000 7fba16236640 0 -- 172.21.15.63:0/2500410531 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fba0c096920 msgr2=0x7fba0c05eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:25.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.059+0000 7fba17238640 0 -- 172.21.15.63:0/2500410531 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55dab6e76900 msgr2=0x55dab6e78d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:25.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.064+0000 7fba18f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:25.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.064+0000 7fba18f46800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:25.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.064+0000 7fba18f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:25.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.064+0000 7fba18f46800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:25.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.064+0000 7fba18f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:25.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.064+0000 7fba18f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:25.066 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.064+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 zone default found 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 4 Realm: () 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 zonegroup default 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.065+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.066+0000 7fba18f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.066+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.066+0000 7fba18f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.066+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.066+0000 7fba18f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.067+0000 7fba18f46800 20 started sync module instance, tier type = 2024-09-12T17:45:25.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.067+0000 7fba18f46800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:25.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.077+0000 7fba18f46800 20 add_watcher() i=0 2024-09-12T17:45:25.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.077+0000 7fba18f46800 20 add_watcher() i=1 2024-09-12T17:45:25.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.077+0000 7fba18f46800 20 add_watcher() i=2 2024-09-12T17:45:25.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.077+0000 7fba18f46800 20 add_watcher() i=3 2024-09-12T17:45:25.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.077+0000 7fba18f46800 20 add_watcher() i=4 2024-09-12T17:45:25.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.077+0000 7fba18f46800 20 add_watcher() i=5 2024-09-12T17:45:25.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.077+0000 7fba18f46800 20 add_watcher() i=6 2024-09-12T17:45:25.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.078+0000 7fba18f46800 20 add_watcher() i=7 2024-09-12T17:45:25.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.078+0000 7fba18f46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:25.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.080+0000 7fb8cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.080+0000 7fba18f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:25.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.080+0000 7fba18f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:25.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.080+0000 7fba18f46800 5 note: GC not initialized 2024-09-12T17:45:25.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.080+0000 7fb8ccfe1640 20 reqs_thread_entry: start 2024-09-12T17:45:25.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.081+0000 7fba18f46800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:25.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.081+0000 7fba18f46800 20 Filter name: none 2024-09-12T17:45:25.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.081+0000 7fb8c5ffb640 20 reqs_thread_entry: start 2024-09-12T17:45:25.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.081+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.081+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:25.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.081+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.082+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:25.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.082+0000 7fba18f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:25.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.082+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.082+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:25.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.082+0000 7fba18f46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.082+0000 7fba18f46800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:25.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.082+0000 7fba18f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:25.085 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.085+0000 7fb8cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.087+0000 7fba18f46800 20 remove_watcher() i=0 2024-09-12T17:45:25.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.087+0000 7fba18f46800 2 removed watcher, disabling cache 2024-09-12T17:45:25.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.088+0000 7fba18f46800 20 remove_watcher() i=1 2024-09-12T17:45:25.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.089+0000 7fba18f46800 20 remove_watcher() i=2 2024-09-12T17:45:25.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.090+0000 7fba18f46800 20 remove_watcher() i=3 2024-09-12T17:45:25.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.091+0000 7fba18f46800 20 remove_watcher() i=4 2024-09-12T17:45:25.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.093+0000 7fba18f46800 20 remove_watcher() i=5 2024-09-12T17:45:25.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.094+0000 7fba18f46800 20 remove_watcher() i=6 2024-09-12T17:45:25.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.095+0000 7fba18f46800 20 remove_watcher() i=7 2024-09-12T17:45:25.136 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:45:25.166 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:25.166 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:25.208 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.207+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.208+0000 7f4e7ab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.209 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.208+0000 7f4e7ab35800 20 realm 2024-09-12T17:45:25.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.208+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.208+0000 7f4e7ab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.208+0000 7f4e7ab35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:25.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.209+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.209+0000 7f4e7ab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.210 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.209+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.209+0000 7f4e7ab35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.209+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.210+0000 7f4e7ab35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:25.211 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.210+0000 7f4e7ab35800 20 searching for the correct realm 2024-09-12T17:45:25.214 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.213+0000 7f4e760e3640 0 -- 172.21.15.63:0/2359093921 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f4e6c008410 msgr2=0x7f4e6c008890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:25.620 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.619+0000 7f4e768e4640 0 -- 172.21.15.63:0/2359093921 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f4e70005070 msgr2=0x7f4e7003d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:25.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.626+0000 7f4e7ab35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:25.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.626+0000 7f4e7ab35800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:25.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.626+0000 7f4e7ab35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:25.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.626+0000 7f4e7ab35800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:25.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.626+0000 7f4e7ab35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:25.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.626+0000 7f4e7ab35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:25.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.626+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.627+0000 7f4e7ab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.627+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.627+0000 7f4e7ab35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.627+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:25.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 20 zone default found 2024-09-12T17:45:25.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 4 Realm: () 2024-09-12T17:45:25.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:25.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:25.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:25.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 20 zonegroup default 2024-09-12T17:45:25.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.628+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.629+0000 7f4e7ab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.629+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.629+0000 7f4e7ab35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.629+0000 7f4e7ab35800 20 started sync module instance, tier type = 2024-09-12T17:45:25.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.629+0000 7f4e7ab35800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:25.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.639+0000 7f4e7ab35800 20 add_watcher() i=0 2024-09-12T17:45:25.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.639+0000 7f4e7ab35800 20 add_watcher() i=1 2024-09-12T17:45:25.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.639+0000 7f4e7ab35800 20 add_watcher() i=2 2024-09-12T17:45:25.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.639+0000 7f4e7ab35800 20 add_watcher() i=3 2024-09-12T17:45:25.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.639+0000 7f4e7ab35800 20 add_watcher() i=4 2024-09-12T17:45:25.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.639+0000 7f4e7ab35800 20 add_watcher() i=5 2024-09-12T17:45:25.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.639+0000 7f4e7ab35800 20 add_watcher() i=6 2024-09-12T17:45:25.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.640+0000 7f4e7ab35800 20 add_watcher() i=7 2024-09-12T17:45:25.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.640+0000 7f4e7ab35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:25.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.642+0000 7f4d2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.642+0000 7f4e7ab35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:25.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.642+0000 7f4e7ab35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:25.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.642+0000 7f4e7ab35800 5 note: GC not initialized 2024-09-12T17:45:25.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.642+0000 7f4ca7fff640 20 reqs_thread_entry: start 2024-09-12T17:45:25.644 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 20 Filter name: none 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4ca5ffb640 20 reqs_thread_entry: start 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:25.645 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.643+0000 7f4e7ab35800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:25.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:25.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:25.646 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.644+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.645+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.645+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.645+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:45:25.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.645+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.646+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.646+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.646+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.646+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.647+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.647+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.647+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:45:25.649 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.647+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:45:25.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.647+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:45:25.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.647+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:45:25.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.648+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:45:25.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.648+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:45:25.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.648+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:45:25.650 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.648+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:45:25.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.648+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:45:25.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.648+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:45:25.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.649+0000 7f4e7ab35800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:45:25.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.649+0000 7f4e7ab35800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:45:25.651 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.650+0000 7f4d2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.652+0000 7f4e7ab35800 20 remove_watcher() i=0 2024-09-12T17:45:25.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.652+0000 7f4e7ab35800 2 removed watcher, disabling cache 2024-09-12T17:45:25.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.654+0000 7f4e7ab35800 20 remove_watcher() i=1 2024-09-12T17:45:25.656 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.655+0000 7f4e7ab35800 20 remove_watcher() i=2 2024-09-12T17:45:25.657 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.656+0000 7f4e7ab35800 20 remove_watcher() i=3 2024-09-12T17:45:25.658 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.657+0000 7f4e7ab35800 20 remove_watcher() i=4 2024-09-12T17:45:25.659 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.658+0000 7f4e7ab35800 20 remove_watcher() i=5 2024-09-12T17:45:25.660 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.659+0000 7f4e7ab35800 20 remove_watcher() i=6 2024-09-12T17:45:25.662 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.661+0000 7f4e7ab35800 20 remove_watcher() i=7 2024-09-12T17:45:25.675 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:45:25.706 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:25.706 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:25.747 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.746+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.948+0000 7f408e739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.948+0000 7f408e739800 20 realm 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.948+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.949+0000 7f408e739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.949+0000 7f408e739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.949+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.949+0000 7f408e739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.949+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.950+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.950+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.950+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:25.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.950+0000 7f408e739800 20 searching for the correct realm 2024-09-12T17:45:25.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:25.954+0000 7f4089bc6640 0 -- 172.21.15.63:0/2056163840 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f407402e910 msgr2=0x7f407401e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:26.162 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.161+0000 7f4089bc6640 0 -- 172.21.15.63:0/2056163840 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5621c4274db0 msgr2=0x5621c42771a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.165+0000 7f408e739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.165+0000 7f408e739800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:26.166 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.165+0000 7f408e739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.165+0000 7f408e739800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.165+0000 7f408e739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.165+0000 7f408e739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.165+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 zone default found 2024-09-12T17:45:26.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 4 Realm: () 2024-09-12T17:45:26.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 zonegroup default 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.166+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.167+0000 7f408e739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.167+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.167+0000 7f408e739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.167+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.167+0000 7f408e739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.167+0000 7f408e739800 20 started sync module instance, tier type = 2024-09-12T17:45:26.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.167+0000 7f408e739800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:26.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.177+0000 7f408e739800 20 add_watcher() i=0 2024-09-12T17:45:26.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.177+0000 7f408e739800 20 add_watcher() i=1 2024-09-12T17:45:26.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.177+0000 7f408e739800 20 add_watcher() i=2 2024-09-12T17:45:26.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.177+0000 7f408e739800 20 add_watcher() i=3 2024-09-12T17:45:26.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.177+0000 7f408e739800 20 add_watcher() i=4 2024-09-12T17:45:26.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.177+0000 7f408e739800 20 add_watcher() i=5 2024-09-12T17:45:26.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.177+0000 7f408e739800 20 add_watcher() i=6 2024-09-12T17:45:26.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.178+0000 7f408e739800 20 add_watcher() i=7 2024-09-12T17:45:26.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.178+0000 7f408e739800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.181 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.180+0000 7f3f40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.181+0000 7f408e739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.181+0000 7f408e739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.181+0000 7f408e739800 5 note: GC not initialized 2024-09-12T17:45:26.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.181+0000 7f3ebb7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:26.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.181+0000 7f408e739800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.181+0000 7f408e739800 20 Filter name: none 2024-09-12T17:45:26.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.181+0000 7f3eb97fa640 20 reqs_thread_entry: start 2024-09-12T17:45:26.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.182+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.182+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.182+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.182+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.182+0000 7f408e739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.182+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.183+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.183+0000 7f408e739800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.183+0000 7f408e739800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:26.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.183+0000 7f408e739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.185+0000 7f3f40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.188+0000 7f408e739800 20 remove_watcher() i=0 2024-09-12T17:45:26.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.188+0000 7f408e739800 2 removed watcher, disabling cache 2024-09-12T17:45:26.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.189+0000 7f408e739800 20 remove_watcher() i=1 2024-09-12T17:45:26.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.190+0000 7f408e739800 20 remove_watcher() i=2 2024-09-12T17:45:26.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.191+0000 7f408e739800 20 remove_watcher() i=3 2024-09-12T17:45:26.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.192+0000 7f408e739800 20 remove_watcher() i=4 2024-09-12T17:45:26.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.193+0000 7f408e739800 20 remove_watcher() i=5 2024-09-12T17:45:26.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.194+0000 7f408e739800 20 remove_watcher() i=6 2024-09-12T17:45:26.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.196+0000 7f408e739800 20 remove_watcher() i=7 2024-09-12T17:45:26.208 INFO:tasks.workunit.client.0.smithi063.stderr: test: duplicated entries should be purged before reshard 2024-09-12T17:45:26.209 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:45:26.240 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:26.240 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:26.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.278+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 20 realm 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.281+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.282+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.282+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.282+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.282+0000 7efe1e535800 20 searching for the correct realm 2024-09-12T17:45:26.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.285+0000 7efe19a20640 0 -- 172.21.15.63:0/2499252167 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7efe10039b00 msgr2=0x7efe1002b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.491+0000 7efe19a20640 0 -- 172.21.15.63:0/2499252167 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55e60a30e8c0 msgr2=0x55e60a310d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.496+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 20 zone default found 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 4 Realm: () 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 20 zonegroup default 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.497+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.498+0000 7efe1e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.498+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.498+0000 7efe1e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.498+0000 7efe1e535800 20 started sync module instance, tier type = 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.498+0000 7efe1e535800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.508+0000 7efe1e535800 20 add_watcher() i=0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.508+0000 7efe1e535800 20 add_watcher() i=1 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.508+0000 7efe1e535800 20 add_watcher() i=2 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.508+0000 7efe1e535800 20 add_watcher() i=3 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.508+0000 7efe1e535800 20 add_watcher() i=4 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.508+0000 7efe1e535800 20 add_watcher() i=5 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.508+0000 7efe1e535800 20 add_watcher() i=6 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.509+0000 7efe1e535800 20 add_watcher() i=7 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.509+0000 7efe1e535800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.511+0000 7efcd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.511+0000 7efe1e535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.511+0000 7efe1e535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.511+0000 7efe1e535800 5 note: GC not initialized 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.512+0000 7efc4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.512+0000 7efe1e535800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.512+0000 7efe1e535800 20 Filter name: none 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.512+0000 7efc497fa640 20 reqs_thread_entry: start 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.512+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.512+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.512+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.513+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.513+0000 7efe1e535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.513+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.513+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.513+0000 7efe1e535800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.513+0000 7efe1e535800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.513+0000 7efe1e535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.515+0000 7efcd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.517+0000 7efe1e535800 20 remove_watcher() i=0 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.517+0000 7efe1e535800 2 removed watcher, disabling cache 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.519+0000 7efe1e535800 20 remove_watcher() i=1 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.520+0000 7efe1e535800 20 remove_watcher() i=2 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.521+0000 7efe1e535800 20 remove_watcher() i=3 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.522+0000 7efe1e535800 20 remove_watcher() i=4 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.523+0000 7efe1e535800 20 remove_watcher() i=5 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.524+0000 7efe1e535800 20 remove_watcher() i=6 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.525+0000 7efe1e535800 20 remove_watcher() i=7 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:26.612 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.611+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 20 realm 2024-09-12T17:45:26.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.614+0000 7fde0fc14800 20 searching for the correct realm 2024-09-12T17:45:26.619 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.618+0000 7fde0abdf640 0 -- 172.21.15.63:0/2237632142 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fddf4015070 msgr2=0x7fddf4048420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.622 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.622+0000 7fde0bbe1640 0 -- 172.21.15.63:0/2237632142 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b9d9b4f0d0 msgr2=0x55b9d9b51540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 zone default found 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 4 Realm: () 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 zonegroup default 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 started sync module instance, tier type = 2024-09-12T17:45:26.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.627+0000 7fde0fc14800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:26.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=0 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=1 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=2 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=3 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=4 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=5 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=6 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.637+0000 7fde0fc14800 20 add_watcher() i=7 2024-09-12T17:45:26.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.637+0000 7fde0fc14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.639+0000 7fdcc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fde0fc14800 5 note: GC not initialized 2024-09-12T17:45:26.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fdcc0fe1640 20 reqs_thread_entry: start 2024-09-12T17:45:26.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fde0fc14800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.641 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fde0fc14800 20 Filter name: none 2024-09-12T17:45:26.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fdc3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:45:26.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fde0fc14800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:26.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.642 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.643 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.641+0000 7fde0fc14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:26.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fde0fc14800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fde0fc14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fde0fc14800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94256709832496 notifier 8298 bl.length()=911 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:45:26.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:45:26.653 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde0fc14800 time 2024-09-12T17:45:26.653303+0000 2024-09-12T17:45:26.653 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.653 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde10d8c71a] 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fde0fc14800 thread_name:radosgw-admin 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.653+0000 7fde0fc14800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde0fc14800 time 2024-09-12T17:45:26.653303+0000 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.654 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde10d8c71a] 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:45:26.655 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.675 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.675 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde0fa3e6f0] 2024-09-12T17:45:26.675 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde0fa8b99c] 2024-09-12T17:45:26.675 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:26.675 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde10d8c774] 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.653+0000 7fde0fc14800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:26.676 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fde0fc14800 thread_name:radosgw-admin 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde0fa3e6f0] 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde0fa8b99c] 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde10d8c774] 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:45:26.593+0000 7fde0fc14800 5 monclient: authenticate success, global_id 7766 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.678 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: dump: 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.679 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:45:26.593+0000 7fde0fc14800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:45:26.593+0000 7fde0fc14800 4 set_mon_vals no callback set 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: shutdown 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 asok(0x55b9d9842730) unregister_commands rotate-key 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.680 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding auth protocol: cephx 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding auth protocol: cephx 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding auth protocol: cephx 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.681 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:45:26.594+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: starting msgr at 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: starting objecter 2024-09-12T17:45:26.682 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command objecter_requests hook 0x55b9d9a6be20 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: setting wanted keys 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: calling monclient init 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding auth protocol: cephx 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding auth protocol: cephx 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding auth protocol: cephx 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.683 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:45:26.595+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:45:26.595+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.684 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:45:26.595+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key hook 0x55b9d9a648c8 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d98edd50 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9918df0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d99ad860 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.110539s 2024-09-12T17:45:26.685 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d98edd50 auth_method 0 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request con 0x55b9d99ad860 auth_method 0 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.686 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: dump: 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.687 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.688 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: dump: 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.689 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:45:26.596+0000 7fde0fc14800 5 monclient: authenticate success, global_id 8289 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:45:26.596+0000 7fdcf960a640 4 set_mon_vals no callback set 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:45:26.596+0000 7fde0fc14800 1 librados: init done 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:45:26.598+0000 7fdcf7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:45:26.598+0000 7fdcf7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:45:26.598+0000 7fdcf7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.690 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:45:26.598+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fdcf0076470 auth_method 0 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:45:26.598+0000 7fde0abdf640 10 monclient: get_auth_request con 0x55b9d9a8ce90 auth_method 0 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:45:26.599+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x55b9d9aafe20 auth_method 0 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:45:26.601+0000 7fde0abdf640 10 monclient: get_auth_request con 0x55b9d9ab3680 auth_method 0 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:45:26.601+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:45:26.601+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:45:26.601+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.691 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding auth protocol: cephx 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding auth protocol: cephx 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding auth protocol: cephx 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:45:26.602+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command objecter_requests cmddesc objecter_requests hook 0x55b9d9abc870 EEXIST 2024-09-12T17:45:26.693 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding auth protocol: cephx 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding auth protocol: cephx 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding auth protocol: cephx 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:45:26.602+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:45:26.602+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key cmddesc rotate-key hook 0x55b9d9ab80e0 EEXIST 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d9ae0560 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9ae2830 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d9aded30 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.695 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.117867s 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d9ae0560 auth_method 0 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:45:26.602+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request con 0x55b9d9aded30 auth_method 0 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.696 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): get_auth_request con 0x55b9d9ae2830 auth_method 0 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:45:26.603+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:45:26.603+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.697 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:45:26.603+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: dump: 2024-09-12T17:45:26.698 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.699 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: dump: 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.700 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:45:26.603+0000 7fde0fc14800 5 monclient: authenticate success, global_id 7772 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:45:26.603+0000 7fde0c3e2640 4 set_mon_vals no callback set 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:45:26.605+0000 7fdcf5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:45:26.605+0000 7fdcf5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.701 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:45:26.605+0000 7fdcf5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:45:26.605+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fdce4076380 auth_method 0 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:45:26.605+0000 7fde0fc14800 10 monclient: get_monmap_and_config 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:45:26.605+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:45:26.605+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:45:26.605+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.702 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding auth protocol: cephx 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding auth protocol: cephx 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding auth protocol: cephx 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.703 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:45:26.606+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding auth protocol: cephx 2024-09-12T17:45:26.704 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding auth protocol: cephx 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding auth protocol: cephx 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.705 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:45:26.606+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:45:26.606+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key cmddesc rotate-key hook 0x7ffd8ec45fc8 EEXIST 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9b34a60 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d9b2ff60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d9b263d0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.706 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.121679s 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): get_auth_request con 0x55b9d9b2ff60 auth_method 0 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request con 0x55b9d9b263d0 auth_method 0 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.707 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d9b34a60 auth_method 0 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.708 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_done global_id 8295 payload 274 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:45:26.607+0000 7fde0abdf640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:45:26.607+0000 7fde0abdf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: dump: 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.710 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:45:26.607+0000 7fde0fc14800 5 monclient: authenticate success, global_id 8295 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:45:26.607+0000 7fde0fc14800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:45:26.607+0000 7fde0fc14800 4 set_mon_vals no callback set 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: dump: 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.711 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:45:26.607+0000 7fde0fc14800 10 monclient: shutdown 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:45:26.608+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:45:26.608+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.713 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding auth protocol: cephx 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding auth protocol: cephx 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding auth protocol: cephx 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.714 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:45:26.608+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: starting msgr at 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: starting objecter 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command objecter_requests cmddesc objecter_requests hook 0x55b9d9b04b30 EEXIST 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: setting wanted keys 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: calling monclient init 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:45:26.608+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding auth protocol: cephx 2024-09-12T17:45:26.715 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding auth protocol: cephx 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding auth protocol: cephx 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.716 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:45:26.608+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:45:26.609+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:45:26.609+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key cmddesc rotate-key hook 0x55b9d9af8458 EEXIST 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d9b263d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d9b2ff60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9b34a60 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.717 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.124137s 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d9b263d0 auth_method 0 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): get_auth_request con 0x55b9d9b2ff60 auth_method 0 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.718 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.719 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:45:26.609+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x55b9d9b34a60 auth_method 0 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: dump: 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.720 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: dump: 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.721 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:45:26.609+0000 7fde0fc14800 5 monclient: authenticate success, global_id 8298 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:45:26.609+0000 7fdceeffd640 4 set_mon_vals no callback set 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.722 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:45:26.609+0000 7fde0fc14800 1 librados: init done 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:45:26.609+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cr dump hook 0x55b9d9b2c8c8 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:45:26.611+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:45:26.612+0000 7fdced7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:45:26.612+0000 7fdced7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:45:26.612+0000 7fdced7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:45:26.612+0000 7fde0abdf640 10 monclient: get_auth_request con 0x7fdcd4076470 auth_method 0 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:45:26.612+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x55b9d9b4f0d0 auth_method 0 2024-09-12T17:45:26.723 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 realm 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:45:26.613+0000 7fde0fc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:45:26.613+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x55b9d9b53430 auth_method 0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.724 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 searching for the correct realm 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:45:26.615+0000 7fde0abdf640 10 monclient: get_auth_request con 0x55b9d9b585d0 auth_method 0 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:45:26.615+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x7fddf4031040 auth_method 0 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:45:26.617+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fddfc0ba640 auth_method 0 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:45:26.618+0000 7fde0abdf640 10 monclient: get_auth_request con 0x7fddf4015070 auth_method 0 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:45:26.618+0000 7fde0abdf640 0 -- 172.21.15.63:0/2237632142 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fddf4015070 msgr2=0x7fddf4048420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:45:26.618+0000 7fdced7fa640 1 client.8298.objecter ms_handle_reset 0x7fddf4015070 session 0x7fddf40157f0 osd.5 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:45:26.618+0000 7fdced7fa640 10 monclient: _renew_subs 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:45:26.618+0000 7fdced7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:45:26.618+0000 7fde0abdf640 10 monclient: get_auth_request con 0x7fdcd4086790 auth_method 0 2024-09-12T17:45:26.725 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:45:26.620+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x7fddfc0e70b0 auth_method 0 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:45:26.621+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fde04015030 auth_method 0 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:45:26.622+0000 7fde0bbe1640 0 -- 172.21.15.63:0/2237632142 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b9d9b4f0d0 msgr2=0x55b9d9b51540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:45:26.622+0000 7fdced7fa640 1 client.8298.objecter ms_handle_reset 0x55b9d9b4f0d0 session 0x55b9d9b4ea00 osd.6 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:45:26.622+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x7fddf4015070 auth_method 0 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.726 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 zone default found 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:45:26.627+0000 7fde0fc14800 4 Realm: () 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:45:26.627+0000 7fde0fc14800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:45:26.627+0000 7fde0fc14800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:45:26.627+0000 7fde0fc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 zonegroup default 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 started sync module instance, tier type = 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=0 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=1 2024-09-12T17:45:26.728 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=2 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=3 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=4 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=5 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=6 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:45:26.637+0000 7fde0fc14800 20 add_watcher() i=7 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:45:26.637+0000 7fde0fc14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding auth protocol: cephx 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding auth protocol: cephx 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding auth protocol: cephx 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.729 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:45:26.639+0000 7fdcc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:45:26.640+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache list hook 0x55b9d9b2df10 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache inspect hook 0x55b9d9b2df10 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache erase hook 0x55b9d9b2df10 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache zap hook 0x55b9d9b2df10 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 note: GC not initialized 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:45:26.640+0000 7fdcc0fe1640 20 reqs_thread_entry: start 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace show hook 0x7fddfc01c3e0 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace history hook 0x7fddfc01c3e0 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace active hook 0x7fddfc01c3e0 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace active_short hook 0x7fddfc01c3e0 2024-09-12T17:45:26.731 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 Filter name: none 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:45:26.640+0000 7fdc3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:45:26.640+0000 7fde0fc14800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.732 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:45:26.733 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94256709832496 notifier 8298 bl.length()=911 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:45:26.653+0000 7fde0fc14800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde0fc14800 time 2024-09-12T17:45:26.653303+0000 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.734 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde10d8c71a] 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.735 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:45:26.653+0000 7fde0fc14800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fde0fc14800 thread_name:radosgw-admin 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde0fa3e6f0] 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde0fa8b99c] 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde10d8c774] 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.736 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:45:26.737 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:45:26.738 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:45:26.739 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:45:26.741 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdc3a7fc640 / http_manager 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcc0fe1640 / http_manager 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcc1fe3640 / rgw_dt_lg_renew 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdced7fa640 / ms_dispatch 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcee7fc640 / io_context_pool 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdceeffd640 / io_context_pool 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcf5602640 / ms_dispatch 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcf7e07640 / ms_dispatch 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcf960a640 / io_context_pool 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0abdf640 / msgr-worker-2 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0b3e0640 / msgr-worker-1 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0bbe1640 / msgr-worker-0 2024-09-12T17:45:26.746 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0c3e2640 / io_context_pool 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0fc14800 / radosgw-admin 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.152338.log 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:45:26.593+0000 7fde0fc14800 5 monclient: authenticate success, global_id 7766 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.747 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:45:26.593+0000 7fdcf960a640 10 monclient: dump: 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.748 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:45:26.593+0000 7fde0fc14800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:45:26.593+0000 7fde0fc14800 4 set_mon_vals no callback set 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: shutdown 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 asok(0x55b9d9842730) unregister_commands rotate-key 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding auth protocol: cephx 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding auth protocol: cephx 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding auth protocol: cephx 2024-09-12T17:45:26.750 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: crc 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a69f10) adding con mode: secure 2024-09-12T17:45:26.751 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:45:26.594+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: starting msgr at 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: starting objecter 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command objecter_requests hook 0x55b9d9a6be20 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: setting wanted keys 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:45:26.594+0000 7fde0fc14800 1 librados: calling monclient init 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:45:26.594+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding auth protocol: cephx 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding auth protocol: cephx 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding auth protocol: cephx 2024-09-12T17:45:26.752 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: crc 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:45:26.594+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9a64780) adding con mode: secure 2024-09-12T17:45:26.753 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:45:26.595+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:45:26.595+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:45:26.595+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key hook 0x55b9d9a648c8 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d98edd50 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9918df0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d99ad860 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:45:26.595+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.110539s 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d98edd50 auth_method 0 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request con 0x55b9d99ad860 auth_method 0 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:45:26.595+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:45:26.595+0000 7fde0bbe1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: dump: 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:45:26.596+0000 7fdcf7e07640 10 monclient: dump: 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:45:26.596+0000 7fde0fc14800 5 monclient: authenticate success, global_id 8289 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:45:26.596+0000 7fdcf960a640 4 set_mon_vals no callback set 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:45:26.596+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:45:26.596+0000 7fde0fc14800 1 librados: init done 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:45:26.598+0000 7fdcf7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:45:26.598+0000 7fdcf7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:45:26.598+0000 7fdcf7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:45:26.598+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fdcf0076470 auth_method 0 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:45:26.598+0000 7fde0abdf640 10 monclient: get_auth_request con 0x55b9d9a8ce90 auth_method 0 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:45:26.599+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x55b9d9aafe20 auth_method 0 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:45:26.601+0000 7fde0abdf640 10 monclient: get_auth_request con 0x55b9d9ab3680 auth_method 0 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:45:26.601+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:45:26.601+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:45:26.601+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding auth protocol: cephx 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding auth protocol: cephx 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding auth protocol: cephx 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.762 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: crc 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:45:26.601+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab8f50) adding con mode: secure 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:45:26.602+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command objecter_requests cmddesc objecter_requests hook 0x55b9d9abc870 EEXIST 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding auth protocol: cephx 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding auth protocol: cephx 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding auth protocol: cephx 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: crc 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9ab7f98) adding con mode: secure 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:45:26.602+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:45:26.602+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:45:26.602+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key cmddesc rotate-key hook 0x55b9d9ab80e0 EEXIST 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d9ae0560 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9ae2830 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d9aded30 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:45:26.602+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.117867s 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d9ae0560 auth_method 0 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:45:26.602+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:45:26.602+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request con 0x55b9d9aded30 auth_method 0 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.766 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): get_auth_request con 0x55b9d9ae2830 auth_method 0 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:45:26.603+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:45:26.603+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:45:26.603+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:45:26.603+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:45:26.603+0000 7fde0bbe1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: dump: 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:45:26.603+0000 7fdcf5602640 10 monclient: dump: 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:45:26.603+0000 7fde0fc14800 5 monclient: authenticate success, global_id 7772 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:45:26.603+0000 7fde0c3e2640 4 set_mon_vals no callback set 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:45:26.603+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:45:26.605+0000 7fdcf5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:45:26.605+0000 7fdcf5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:45:26.605+0000 7fdcf5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:45:26.605+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fdce4076380 auth_method 0 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:45:26.605+0000 7fde0fc14800 10 monclient: get_monmap_and_config 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:45:26.605+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:45:26.605+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:45:26.605+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.772 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding auth protocol: cephx 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding auth protocol: cephx 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding auth protocol: cephx 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.773 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: crc 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:45:26.605+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b00430) adding con mode: secure 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:45:26.606+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.774 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding auth protocol: cephx 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding auth protocol: cephx 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding auth protocol: cephx 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.775 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: crc 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec45e80) adding con mode: secure 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:45:26.606+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:45:26.606+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:45:26.606+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key cmddesc rotate-key hook 0x7ffd8ec45fc8 EEXIST 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9b34a60 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d9b2ff60 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d9b263d0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.776 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:45:26.606+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.121679s 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): get_auth_request con 0x55b9d9b2ff60 auth_method 0 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request con 0x55b9d9b263d0 auth_method 0 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.777 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d9b34a60 auth_method 0 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:45:26.606+0000 7fde0bbe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.778 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:45:26.606+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient(hunting): handle_auth_done global_id 8295 payload 274 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:45:26.606+0000 7fde0abdf640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:45:26.607+0000 7fde0abdf640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:45:26.607+0000 7fde0abdf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: dump: 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.779 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.780 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:45:26.607+0000 7fde0fc14800 5 monclient: authenticate success, global_id 8295 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:45:26.607+0000 7fde0fc14800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:45:26.607+0000 7fde0fc14800 4 set_mon_vals no callback set 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:45:26.607+0000 7fdceeffd640 10 monclient: dump: 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.781 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:45:26.607+0000 7fde0fc14800 10 monclient: shutdown 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:45:26.608+0000 7fde0fc14800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:45:26.608+0000 7fde0fc14800 10 monclient: monmap: 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding auth protocol: cephx 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding auth protocol: cephx 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding auth protocol: cephx 2024-09-12T17:45:26.783 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: crc 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9b003e0) adding con mode: secure 2024-09-12T17:45:26.784 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:45:26.608+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: starting msgr at 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: starting objecter 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command objecter_requests cmddesc objecter_requests hook 0x55b9d9b04b30 EEXIST 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: setting wanted keys 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:45:26.608+0000 7fde0fc14800 1 librados: calling monclient init 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:45:26.608+0000 7fde0fc14800 10 monclient: init 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding auth protocol: cephx 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding auth protocol: cephx 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding auth protocol: cephx 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.785 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: crc 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:45:26.608+0000 7fde0fc14800 5 AuthRegistry(0x55b9d9af8310) adding con mode: secure 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:45:26.608+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:45:26.609+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:45:26.609+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command rotate-key cmddesc rotate-key hook 0x55b9d9af8458 EEXIST 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-a con 0x55b9d9b263d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-c con 0x55b9d9b2ff60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): picked mon.noname-b con 0x55b9d9b34a60 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient(hunting): authenticate will time out at 2219.124137s 2024-09-12T17:45:26.787 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request con 0x55b9d9b263d0 auth_method 0 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): get_auth_request con 0x55b9d9b2ff60 auth_method 0 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.788 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:45:26.609+0000 7fde0abdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:45:26.609+0000 7fde0b3e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:45:26.609+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x55b9d9b34a60 auth_method 0 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: dump: 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.790 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:45:26.609+0000 7fdced7fa640 10 monclient: dump: 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:26.791 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:45:26.609+0000 7fde0fc14800 5 monclient: authenticate success, global_id 8298 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:45:26.609+0000 7fdceeffd640 4 set_mon_vals no callback set 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _renew_subs 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:45:26.609+0000 7fde0fc14800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:45:26.609+0000 7fde0fc14800 1 librados: init done 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:45:26.609+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cr dump hook 0x55b9d9b2c8c8 2024-09-12T17:45:26.792 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:45:26.611+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:45:26.612+0000 7fdced7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:45:26.612+0000 7fdced7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:45:26.612+0000 7fdced7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:45:26.612+0000 7fde0abdf640 10 monclient: get_auth_request con 0x7fdcd4076470 auth_method 0 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:45:26.612+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x55b9d9b4f0d0 auth_method 0 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 realm 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:45:26.613+0000 7fde0fc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.793 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:45:26.613+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:45:26.613+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x55b9d9b53430 auth_method 0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:45:26.614+0000 7fde0fc14800 20 searching for the correct realm 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:45:26.615+0000 7fde0abdf640 10 monclient: get_auth_request con 0x55b9d9b585d0 auth_method 0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:45:26.615+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x7fddf4031040 auth_method 0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:45:26.617+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fddfc0ba640 auth_method 0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:45:26.618+0000 7fde0abdf640 10 monclient: get_auth_request con 0x7fddf4015070 auth_method 0 2024-09-12T17:45:26.794 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:45:26.618+0000 7fde0abdf640 0 -- 172.21.15.63:0/2237632142 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fddf4015070 msgr2=0x7fddf4048420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:45:26.618+0000 7fdced7fa640 1 client.8298.objecter ms_handle_reset 0x7fddf4015070 session 0x7fddf40157f0 osd.5 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:45:26.618+0000 7fdced7fa640 10 monclient: _renew_subs 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:45:26.618+0000 7fdced7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:45:26.618+0000 7fde0abdf640 10 monclient: get_auth_request con 0x7fdcd4086790 auth_method 0 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:45:26.620+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x7fddfc0e70b0 auth_method 0 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:45:26.621+0000 7fde0b3e0640 10 monclient: get_auth_request con 0x7fde04015030 auth_method 0 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:45:26.622+0000 7fde0bbe1640 0 -- 172.21.15.63:0/2237632142 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b9d9b4f0d0 msgr2=0x55b9d9b51540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:45:26.622+0000 7fdced7fa640 1 client.8298.objecter ms_handle_reset 0x55b9d9b4f0d0 session 0x55b9d9b4ea00 osd.6 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:45:26.622+0000 7fde0bbe1640 10 monclient: get_auth_request con 0x7fddf4015070 auth_method 0 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:26.795 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:45:26.626+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 zone default found 2024-09-12T17:45:26.796 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:45:26.627+0000 7fde0fc14800 4 Realm: () 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:45:26.627+0000 7fde0fc14800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:45:26.627+0000 7fde0fc14800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:45:26.627+0000 7fde0fc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 zonegroup default 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 started sync module instance, tier type = 2024-09-12T17:45:26.797 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:45:26.627+0000 7fde0fc14800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=0 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=1 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=2 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=3 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=4 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=5 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:45:26.636+0000 7fde0fc14800 20 add_watcher() i=6 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:45:26.637+0000 7fde0fc14800 20 add_watcher() i=7 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:45:26.637+0000 7fde0fc14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding auth protocol: cephx 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding auth protocol: cephx 2024-09-12T17:45:26.798 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding auth protocol: cephx 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.799 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: crc 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:45:26.639+0000 7fdcc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:45:26.639+0000 7fde0fc14800 5 AuthRegistry(0x7ffd8ec46350) adding con mode: secure 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:45:26.640+0000 7fde0fc14800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache list hook 0x55b9d9b2df10 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache inspect hook 0x55b9d9b2df10 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache erase hook 0x55b9d9b2df10 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command cache zap hook 0x55b9d9b2df10 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 note: GC not initialized 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:45:26.640+0000 7fdcc0fe1640 20 reqs_thread_entry: start 2024-09-12T17:45:26.800 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace show hook 0x7fddfc01c3e0 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace history hook 0x7fddfc01c3e0 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace active hook 0x7fddfc01c3e0 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:45:26.640+0000 7fde0fc14800 5 asok(0x55b9d9842730) register_command sync trace active_short hook 0x7fddfc01c3e0 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 Filter name: none 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:45:26.640+0000 7fdc3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:45:26.640+0000 7fde0fc14800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:45:26.640+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:26.801 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:45:26.641+0000 7fde0fc14800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:45:26.641+0000 7fde0fc14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:45:26.646+0000 7fde0fc14800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:45:26.802 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94256709832496 notifier 8298 bl.length()=911 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:45:26.646+0000 7fdcee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:45:26.647+0000 7fde0fc14800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:45:26.653+0000 7fde0fc14800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde0fc14800 time 2024-09-12T17:45:26.653303+0000 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.803 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde10d8c71a] 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:45:26.653+0000 7fde0fc14800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fde0fc14800 thread_name:radosgw-admin 2024-09-12T17:45:26.804 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde0fa3e6f0] 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde0fa8b99c] 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde10d8c774] 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde10d8c8d8] 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9d7e1d841] 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b9d7e2d57a] 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde0fa29590] 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:45:26.806 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:45:26.807 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:45:26.808 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:45:26.809 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:45:26.810 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:45:26.812 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:45:26.813 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdc3a7fc640 / http_manager 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcc0fe1640 / http_manager 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcc1fe3640 / rgw_dt_lg_renew 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdced7fa640 / ms_dispatch 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcee7fc640 / io_context_pool 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdceeffd640 / io_context_pool 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcf5602640 / ms_dispatch 2024-09-12T17:45:26.814 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcf7e07640 / ms_dispatch 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: 7fdcf960a640 / io_context_pool 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0abdf640 / msgr-worker-2 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0b3e0640 / msgr-worker-1 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0bbe1640 / msgr-worker-0 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0c3e2640 / io_context_pool 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: 7fde0fc14800 / radosgw-admin 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:45:26.654704Z_adfe63cd-98bb-4520-ab65-2a6a6a9efa5d/log 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:45:26.815 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:45:26.817 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:26.817 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:26.817 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.731+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 20 realm 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.733+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.734+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.734+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.734+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.734+0000 7feeb4496800 20 searching for the correct realm 2024-09-12T17:45:26.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.737+0000 7feeb177f640 0 -- 172.21.15.63:0/948381737 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7feea8064940 msgr2=0x7feea807c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:26.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.943+0000 7feeb177f640 0 -- 172.21.15.63:0/948381737 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56129c825c80 msgr2=0x56129c828070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:26.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:26.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.947+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 zone default found 2024-09-12T17:45:26.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 4 Realm: () 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 zonegroup default 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.948+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.949+0000 7feeb4496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.949+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.949+0000 7feeb4496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.949+0000 7feeb4496800 20 started sync module instance, tier type = 2024-09-12T17:45:26.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.949+0000 7feeb4496800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:26.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.958+0000 7feeb4496800 20 add_watcher() i=0 2024-09-12T17:45:26.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.958+0000 7feeb4496800 20 add_watcher() i=1 2024-09-12T17:45:26.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.958+0000 7feeb4496800 20 add_watcher() i=2 2024-09-12T17:45:26.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.958+0000 7feeb4496800 20 add_watcher() i=3 2024-09-12T17:45:26.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.958+0000 7feeb4496800 20 add_watcher() i=4 2024-09-12T17:45:26.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.958+0000 7feeb4496800 20 add_watcher() i=5 2024-09-12T17:45:26.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.958+0000 7feeb4496800 20 add_watcher() i=6 2024-09-12T17:45:26.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.959+0000 7feeb4496800 20 add_watcher() i=7 2024-09-12T17:45:26.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.959+0000 7feeb4496800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.960+0000 7fed67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7feeb4496800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7feeb4496800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7feeb4496800 5 note: GC not initialized 2024-09-12T17:45:26.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7fed66fe5640 20 reqs_thread_entry: start 2024-09-12T17:45:26.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7feeb4496800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7feeb4496800 20 Filter name: none 2024-09-12T17:45:26.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7fed64fe1640 20 reqs_thread_entry: start 2024-09-12T17:45:26.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.961+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.962+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.962+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.962+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.962+0000 7feeb4496800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.962+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.963+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.963+0000 7feeb4496800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.963+0000 7feeb4496800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:26.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.963+0000 7feeb4496800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.965+0000 7fed67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.967+0000 7feeb4496800 20 remove_watcher() i=0 2024-09-12T17:45:26.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.967+0000 7feeb4496800 2 removed watcher, disabling cache 2024-09-12T17:45:26.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.968+0000 7feeb4496800 20 remove_watcher() i=1 2024-09-12T17:45:26.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.969+0000 7feeb4496800 20 remove_watcher() i=2 2024-09-12T17:45:26.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.970+0000 7feeb4496800 20 remove_watcher() i=3 2024-09-12T17:45:26.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.971+0000 7feeb4496800 20 remove_watcher() i=4 2024-09-12T17:45:26.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.972+0000 7feeb4496800 20 remove_watcher() i=5 2024-09-12T17:45:26.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.973+0000 7feeb4496800 20 remove_watcher() i=6 2024-09-12T17:45:26.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:26.974+0000 7feeb4496800 20 remove_watcher() i=7 2024-09-12T17:45:26.998 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:45:27.027 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:27.027 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:27.067 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.066+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 20 realm 2024-09-12T17:45:27.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.069 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.067+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.068+0000 7f7329519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.068+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.068+0000 7f7329519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:27.070 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.069+0000 7f7329519800 20 searching for the correct realm 2024-09-12T17:45:27.073 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.072+0000 7f731ffff640 0 -- 172.21.15.63:0/3218476939 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f73100423c0 msgr2=0x7f7310042840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:27.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.075+0000 7f732700a640 0 -- 172.21.15.63:0/3218476939 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f7320017040 msgr2=0x7f732000c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:27.081 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.082 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 zone default found 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 4 Realm: () 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 zonegroup default 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.080+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.081+0000 7f7329519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.083 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.081+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.081+0000 7f7329519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.081+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.081+0000 7f7329519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.081+0000 7f7329519800 20 started sync module instance, tier type = 2024-09-12T17:45:27.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.081+0000 7f7329519800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:27.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.089+0000 7f7329519800 20 add_watcher() i=0 2024-09-12T17:45:27.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.089+0000 7f7329519800 20 add_watcher() i=1 2024-09-12T17:45:27.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.089+0000 7f7329519800 20 add_watcher() i=2 2024-09-12T17:45:27.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.089+0000 7f7329519800 20 add_watcher() i=3 2024-09-12T17:45:27.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.089+0000 7f7329519800 20 add_watcher() i=4 2024-09-12T17:45:27.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.089+0000 7f7329519800 20 add_watcher() i=5 2024-09-12T17:45:27.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.089+0000 7f7329519800 20 add_watcher() i=6 2024-09-12T17:45:27.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.090+0000 7f7329519800 20 add_watcher() i=7 2024-09-12T17:45:27.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.090+0000 7f7329519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:27.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.092+0000 7f71ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:27.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.092+0000 7f7329519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.092+0000 7f7329519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.092+0000 7f7329519800 5 note: GC not initialized 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.092+0000 7f71dcfe1640 20 reqs_thread_entry: start 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.092+0000 7f7329519800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.092+0000 7f7329519800 20 Filter name: none 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f71567fc640 20 reqs_thread_entry: start 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:27.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:27.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.093+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.094+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.094+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.094+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.094+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.094+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.094+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.095+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:45:27.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.095+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:45:27.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.095+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.095+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.095+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.095+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.096+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.096+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.096+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.096+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.096+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.096+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.097+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:45:27.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.097+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:45:27.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.097+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:45:27.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.097+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:45:27.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.097+0000 7f7329519800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:45:27.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.097+0000 7f7329519800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:45:27.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.098+0000 7f71ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:27.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.101+0000 7f7329519800 20 remove_watcher() i=0 2024-09-12T17:45:27.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.101+0000 7f7329519800 2 removed watcher, disabling cache 2024-09-12T17:45:27.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.102+0000 7f7329519800 20 remove_watcher() i=1 2024-09-12T17:45:27.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.103+0000 7f7329519800 20 remove_watcher() i=2 2024-09-12T17:45:27.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.103+0000 7f7329519800 20 remove_watcher() i=3 2024-09-12T17:45:27.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.104+0000 7f7329519800 20 remove_watcher() i=4 2024-09-12T17:45:27.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.105+0000 7f7329519800 20 remove_watcher() i=5 2024-09-12T17:45:27.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.106+0000 7f7329519800 20 remove_watcher() i=6 2024-09-12T17:45:27.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:27.107+0000 7f7329519800 20 remove_watcher() i=7 2024-09-12T17:45:57.150 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:45:57.189 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:57.189 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:57.234 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.233+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 realm 2024-09-12T17:45:57.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:57.237 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 searching for the correct realm 2024-09-12T17:45:57.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.240+0000 7f07c4f60640 0 -- 172.21.15.63:0/254209590 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f07bc022910 msgr2=0x7f07bc008410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:57.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.446+0000 7f07c5f62640 0 -- 172.21.15.63:0/254209590 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559b2bb73a00 msgr2=0x559b2bb75e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:57.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:57.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:57.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:57.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:57.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:57.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.452+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.452+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 zone default found 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 Realm: () 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:57.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:57.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 zonegroup default 2024-09-12T17:45:57.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 started sync module instance, tier type = 2024-09-12T17:45:57.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:57.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=0 2024-09-12T17:45:57.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=1 2024-09-12T17:45:57.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=2 2024-09-12T17:45:57.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=3 2024-09-12T17:45:57.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=4 2024-09-12T17:45:57.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=5 2024-09-12T17:45:57.466 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=6 2024-09-12T17:45:57.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.465+0000 7f07c9b2a800 20 add_watcher() i=7 2024-09-12T17:45:57.467 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.465+0000 7f07c9b2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:57.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.468+0000 7f067b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:57.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:57.471 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 note: GC not initialized 2024-09-12T17:45:57.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.468+0000 7f067a7e4640 20 reqs_thread_entry: start 2024-09-12T17:45:57.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:57.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 Filter name: none 2024-09-12T17:45:57.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f05ebfff640 20 reqs_thread_entry: start 2024-09-12T17:45:57.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:57.472 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.473 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:57.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:57.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.474 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:57.475 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.471+0000 7f07c9b2a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:45:57.479 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:45:57.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94124941727952 notifier 7832 bl.length()=911 2024-09-12T17:45:57.480 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.481 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:45:57.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:45:57.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:45:57.482 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f07c9b2a800 time 2024-09-12T17:45:57.484103+0000 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:57.485 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.485 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f07cb18c71a] 2024-09-12T17:45:57.485 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.485 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.485 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f07c9b2a800 thread_name:radosgw-admin 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.484+0000 7f07c9b2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f07c9b2a800 time 2024-09-12T17:45:57.484103+0000 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.488 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f07cb18c71a] 2024-09-12T17:45:57.488 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.488 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.488 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.488 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.488 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:45:57.489 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.489 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:45:57.489 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:45:57.489 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.510 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f07c9e3e6f0] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f07c9e8b99c] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f07cb18c774] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.484+0000 7f07c9b2a800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f07c9b2a800 thread_name:radosgw-admin 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f07c9e3e6f0] 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f07c9e8b99c] 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f07cb18c774] 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.513 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.513 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.513 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:45:57.513 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.513 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:45:57.513 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:45:57.514 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:57.514 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.514 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:45:57.514 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:45:57.214+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.514 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.514 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.514 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding auth protocol: cephx 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding auth protocol: cephx 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding auth protocol: cephx 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: starting msgr at 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: starting objecter 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command objecter_requests hook 0x559b2ba89d10 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: setting wanted keys 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: calling monclient init 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding auth protocol: cephx 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding auth protocol: cephx 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding auth protocol: cephx 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key hook 0x559b2ba88918 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2b935240 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2b9cb7c0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2b9d1eb0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.731055s 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2b9d1eb0 auth_method 0 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2b935240 auth_method 0 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.522 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2b9cb7c0 auth_method 0 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.523 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:45:57.216+0000 7f07c5f62640 1 monclient: found mon.noname-a 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.524 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: dump: 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: dump: 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 8343 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:45:57.216+0000 7f06b3606640 4 set_mon_vals no callback set 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.528 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 1 librados: init done 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:45:57.219+0000 7f06b1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:45:57.219+0000 7f06b1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:45:57.219+0000 7f06b1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:45:57.219+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f06ac0764a0 auth_method 0 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:45:57.219+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bacb570 auth_method 0 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:45:57.220+0000 7f07c5761640 10 monclient: get_auth_request con 0x559b2bad4d40 auth_method 0 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:45:57.222+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bad85c0 auth_method 0 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 10 monclient: build_initial_monmap 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 1 build_initial for_mkfs: 0 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding auth protocol: cephx 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding auth protocol: cephx 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding auth protocol: cephx 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command objecter_requests cmddesc objecter_requests hook 0x559b2bae1900 EEXIST 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding auth protocol: cephx 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding auth protocol: cephx 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding auth protocol: cephx 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key cmddesc rotate-key hook 0x559b2badd0b0 EEXIST 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2bb055f0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2bb078c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2bb03dc0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.739373s 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2bb03dc0 auth_method 0 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2bb078c0 auth_method 0 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2bb055f0 auth_method 0 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_done global_id 8346 payload 824 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:45:57.224+0000 7f07c5f62640 1 monclient: found mon.noname-a 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.535 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: dump: 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: dump: 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 8346 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:45:57.225+0000 7f07c6763640 4 set_mon_vals no callback set 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:45:57.227+0000 7f06aaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:45:57.227+0000 7f06aaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:45:57.227+0000 7f06aaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:45:57.227+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f06a0076380 auth_method 0 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: get_monmap_and_config 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: build_initial_monmap 2024-09-12T17:45:57.538 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 1 build_initial for_mkfs: 0 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding auth protocol: cephx 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding auth protocol: cephx 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding auth protocol: cephx 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.540 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding auth protocol: cephx 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding auth protocol: cephx 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding auth protocol: cephx 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key cmddesc rotate-key hook 0x7ffe91b879a8 EEXIST 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2bb596d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2bb54bd0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2bb4b040 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.542 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.743525s 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2bb54bd0 auth_method 0 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2bb4b040 auth_method 0 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.543 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2bb596d0 auth_method 0 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_done global_id 7829 payload 274 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:45:57.228+0000 7f07c4f60640 1 monclient: found mon.noname-c 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: dump: 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.546 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.546 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.546 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.546 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.546 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: dump: 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 7829 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 4 set_mon_vals no callback set 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 10 monclient: shutdown 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 10 monclient: build_initial_monmap 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 build_initial for_mkfs: 0 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.549 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.549 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.549 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.549 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.549 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.549 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.550 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.550 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.550 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.550 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding auth protocol: cephx 2024-09-12T17:45:57.550 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding auth protocol: cephx 2024-09-12T17:45:57.550 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding auth protocol: cephx 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: starting msgr at 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: starting objecter 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command objecter_requests cmddesc objecter_requests hook 0x559b2bb54a60 EEXIST 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: setting wanted keys 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: calling monclient init 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding auth protocol: cephx 2024-09-12T17:45:57.552 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding auth protocol: cephx 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding auth protocol: cephx 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.553 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.556 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.556 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.556 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.556 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.556 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key cmddesc rotate-key hook 0x559b2bb1d4e8 EEXIST 2024-09-12T17:45:57.556 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.556 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2bb4b040 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2bb54bd0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2bb596d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.746067s 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2bb4b040 auth_method 0 2024-09-12T17:45:57.557 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2bb54bd0 auth_method 0 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.558 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2bb596d0 auth_method 0 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_done global_id 7832 payload 824 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:45:57.231+0000 7f07c5761640 1 monclient: found mon.noname-c 2024-09-12T17:45:57.559 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: dump: 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.560 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: dump: 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.561 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 7832 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:45:57.231+0000 7f06a8ff9640 4 set_mon_vals no callback set 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 1 librados: init done 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cr dump hook 0x559b2bb4bdb8 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:45:57.233+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:45:57.234+0000 7f0696ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:57.562 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:45:57.234+0000 7f0696ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:45:57.234+0000 7f0696ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:45:57.234+0000 7f07c4f60640 10 monclient: get_auth_request con 0x7f0690076470 auth_method 0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:45:57.234+0000 7f07c5f62640 10 monclient: get_auth_request con 0x559b2bb73a00 auth_method 0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 realm 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:45:57.236+0000 7f07c5761640 10 monclient: get_auth_request con 0x559b2bb77c60 auth_method 0 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.563 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 searching for the correct realm 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:45:57.237+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bb7cf20 auth_method 0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:45:57.238+0000 7f07c5f62640 10 monclient: get_auth_request con 0x7f07bc02cb40 auth_method 0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:45:57.239+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f07b8093060 auth_method 0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:45:57.240+0000 7f07c4f60640 10 monclient: get_auth_request con 0x7f07bc022910 auth_method 0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:45:57.240+0000 7f07c4f60640 0 -- 172.21.15.63:0/254209590 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f07bc022910 msgr2=0x7f07bc008410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:45:57.441+0000 7f07c4f60640 10 monclient: get_auth_request con 0x7f07bc022910 auth_method 0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:45:57.444+0000 7f07c5f62640 10 monclient: get_auth_request con 0x7f07b807c070 auth_method 0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:45:57.445+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f07c002a030 auth_method 0 2024-09-12T17:45:57.564 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:45:57.446+0000 7f07c5f62640 0 -- 172.21.15.63:0/254209590 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559b2bb73a00 msgr2=0x559b2bb75e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:45:57.446+0000 7f0696ffd640 1 client.7832.objecter ms_handle_reset 0x559b2bb73a00 session 0x559b2bb73380 osd.6 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:45:57.446+0000 7f0696ffd640 10 monclient: _renew_subs 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:45:57.446+0000 7f0696ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:45:57.446+0000 7f07c5f62640 10 monclient: get_auth_request con 0x7f0690086790 auth_method 0 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:45:57.452+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:45:57.452+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:45:57.452+0000 7f0696ffd640 1 client.7832.objecter ms_handle_reset 0x7f07bc022910 session 0x7f07bc012040 osd.5 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:45:57.452+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bb73a00 auth_method 0 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 zone default found 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 Realm: () 2024-09-12T17:45:57.566 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 zonegroup default 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 started sync module instance, tier type = 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:57.567 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=0 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=1 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=2 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=3 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=4 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=5 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=6 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:45:57.465+0000 7f07c9b2a800 20 add_watcher() i=7 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:45:57.465+0000 7f07c9b2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding auth protocol: cephx 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding auth protocol: cephx 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding auth protocol: cephx 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.568 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.569 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:45:57.468+0000 7f067b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache list hook 0x559b2bb4f050 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache inspect hook 0x559b2bb4f050 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache erase hook 0x559b2bb4f050 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache zap hook 0x559b2bb4f050 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 note: GC not initialized 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:45:57.468+0000 7f067a7e4640 20 reqs_thread_entry: start 2024-09-12T17:45:57.570 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace show hook 0x7f07bc004df0 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace history hook 0x7f07bc004df0 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace active hook 0x7f07bc004df0 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace active_short hook 0x7f07bc004df0 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 Filter name: none 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:45:57.469+0000 7f05ebfff640 20 reqs_thread_entry: start 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.571 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:45:57.471+0000 7f07c9b2a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:45:57.572 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94124941727952 notifier 7832 bl.length()=911 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:45:57.484+0000 7f07c9b2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f07c9b2a800 time 2024-09-12T17:45:57.484103+0000 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f07cb18c71a] 2024-09-12T17:45:57.573 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:45:57.484+0000 7f07c9b2a800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:57.574 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f07c9b2a800 thread_name:radosgw-admin 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f07c9e3e6f0] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f07c9e8b99c] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f07cb18c774] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.575 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:45:57.576 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:45:57.577 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:45:57.578 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:45:57.579 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:45:57.580 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:45:57.581 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:45:57.582 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 7f05ebfff640 / http_manager 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 7f067a7e4640 / http_manager 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 7f067b7e6640 / rgw_dt_lg_renew 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0696ffd640 / ms_dispatch 2024-09-12T17:45:57.583 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06a8ff9640 / io_context_pool 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06aaffd640 / ms_dispatch 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06b1e03640 / ms_dispatch 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06b3606640 / io_context_pool 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c4f60640 / msgr-worker-2 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c5761640 / msgr-worker-1 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c5f62640 / msgr-worker-0 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c6763640 / io_context_pool 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c9b2a800 / radosgw-admin 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:45:57.584 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.154105.log 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:45:57.214+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.585 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding auth protocol: cephx 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding auth protocol: cephx 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding auth protocol: cephx 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.586 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: crc 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bab6830) adding con mode: secure 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: starting msgr at 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: starting objecter 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command objecter_requests hook 0x559b2ba89d10 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: setting wanted keys 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 1 librados: calling monclient init 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding auth protocol: cephx 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding auth protocol: cephx 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding auth protocol: cephx 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.587 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: crc 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 AuthRegistry(0x559b2ba887d0) adding con mode: secure 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key hook 0x559b2ba88918 2024-09-12T17:45:57.588 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:45:57.215+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2b935240 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2b9cb7c0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2b9d1eb0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.731055s 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2b9d1eb0 auth_method 0 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.589 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2b935240 auth_method 0 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:45:57.216+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2b9cb7c0 auth_method 0 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.590 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:45:57.216+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:45:57.216+0000 7f07c5f62640 1 monclient: found mon.noname-a 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:45:57.216+0000 7f07c5f62640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:57.591 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: dump: 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.592 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:45:57.216+0000 7f06b1e03640 10 monclient: dump: 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.593 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 8343 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:45:57.216+0000 7f06b3606640 4 set_mon_vals no callback set 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:45:57.216+0000 7f07c9b2a800 1 librados: init done 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:45:57.219+0000 7f06b1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:45:57.219+0000 7f06b1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:45:57.219+0000 7f06b1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:45:57.219+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f06ac0764a0 auth_method 0 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:45:57.219+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bacb570 auth_method 0 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:45:57.220+0000 7f07c5761640 10 monclient: get_auth_request con 0x559b2bad4d40 auth_method 0 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:45:57.222+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bad85c0 auth_method 0 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 10 monclient: build_initial_monmap 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 1 build_initial for_mkfs: 0 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.595 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.596 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding auth protocol: cephx 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding auth protocol: cephx 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding auth protocol: cephx 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.597 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: crc 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2baddfb0) adding con mode: secure 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.598 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command objecter_requests cmddesc objecter_requests hook 0x559b2bae1900 EEXIST 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding auth protocol: cephx 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding auth protocol: cephx 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding auth protocol: cephx 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.599 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.600 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.600 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.600 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.600 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.600 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.601 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: crc 2024-09-12T17:45:57.601 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:45:57.223+0000 7f07c9b2a800 5 AuthRegistry(0x559b2badcf68) adding con mode: secure 2024-09-12T17:45:57.601 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.601 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.601 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key cmddesc rotate-key hook 0x559b2badd0b0 EEXIST 2024-09-12T17:45:57.601 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.601 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2bb055f0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2bb078c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2bb03dc0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:45:57.224+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.739373s 2024-09-12T17:45:57.602 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2bb03dc0 auth_method 0 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2bb078c0 auth_method 0 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2bb055f0 auth_method 0 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.603 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:45:57.224+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:45:57.224+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient(hunting): handle_auth_done global_id 8346 payload 824 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:45:57.224+0000 7f07c5f62640 1 monclient: found mon.noname-a 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:45:57.224+0000 7f07c5f62640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.604 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: dump: 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.605 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:45:57.225+0000 7f06aaffd640 10 monclient: dump: 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.606 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 8346 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:45:57.225+0000 7f07c6763640 4 set_mon_vals no callback set 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:45:57.225+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.63:3300/0 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:45:57.227+0000 7f06aaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:45:57.227+0000 7f06aaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:45:57.227+0000 7f06aaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:45:57.227+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f06a0076380 auth_method 0 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: get_monmap_and_config 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: build_initial_monmap 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 1 build_initial for_mkfs: 0 2024-09-12T17:45:57.607 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding auth protocol: cephx 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding auth protocol: cephx 2024-09-12T17:45:57.608 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding auth protocol: cephx 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: crc 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb250e0) adding con mode: secure 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.609 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding auth protocol: cephx 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding auth protocol: cephx 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding auth protocol: cephx 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.610 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: crc 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:45:57.227+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87860) adding con mode: secure 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key cmddesc rotate-key hook 0x7ffe91b879a8 EEXIST 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2bb596d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2bb54bd0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2bb4b040 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.611 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:45:57.228+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.743525s 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2bb54bd0 auth_method 0 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2bb4b040 auth_method 0 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.612 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:45:57.228+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2bb596d0 auth_method 0 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:45:57.228+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient(hunting): handle_auth_done global_id 7829 payload 274 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:45:57.228+0000 7f07c4f60640 1 monclient: found mon.noname-c 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:45:57.228+0000 7f07c4f60640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: dump: 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.613 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.614 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:45:57.229+0000 7f06a8ff9640 10 monclient: dump: 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 7829 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:57.615 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 4 set_mon_vals no callback set 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 10 monclient: shutdown 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:45:57.229+0000 7f07c9b2a800 10 monclient: build_initial_monmap 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 build_initial for_mkfs: 0 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 10 monclient: monmap: 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:45:57.616 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding auth protocol: cephx 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding auth protocol: cephx 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding auth protocol: cephx 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.617 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: crc 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb25090) adding con mode: secure 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: starting msgr at 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: starting objecter 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command objecter_requests cmddesc objecter_requests hook 0x559b2bb54a60 EEXIST 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: setting wanted keys 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 1 librados: calling monclient init 2024-09-12T17:45:57.618 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 10 monclient: init 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding auth protocol: cephx 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding auth protocol: cephx 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding auth protocol: cephx 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.619 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: crc 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 AuthRegistry(0x559b2bb1d3a0) adding con mode: secure 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command rotate-key cmddesc rotate-key hook 0x559b2bb1d4e8 EEXIST 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:45:57.230+0000 7f07c9b2a800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-c con 0x559b2bb4b040 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:45:57.620 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-a con 0x559b2bb54bd0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): picked mon.noname-b con 0x559b2bb596d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient(hunting): authenticate will time out at 2249.746067s 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): get_auth_request con 0x559b2bb4b040 auth_method 0 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): get_auth_request con 0x559b2bb54bd0 auth_method 0 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.621 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:45:57.231+0000 7f07c4f60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): get_auth_request con 0x559b2bb596d0 auth_method 0 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:57.622 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:45:57.231+0000 7f07c5f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient(hunting): handle_auth_done global_id 7832 payload 824 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient: _finish_hunting 0 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:45:57.231+0000 7f07c5761640 1 monclient: found mon.noname-c 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:45:57.231+0000 7f07c5761640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: dump: 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.623 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: _finish_auth 0 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:45:57.231+0000 7f0696ffd640 10 monclient: dump: 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.624 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 5 monclient: authenticate success, global_id 7832 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:45:57.231+0000 7f06a8ff9640 4 set_mon_vals no callback set 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _renew_subs 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.625 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 1 librados: init done 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:45:57.231+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cr dump hook 0x559b2bb4bdb8 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:45:57.233+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:45:57.234+0000 7f0696ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:45:57.234+0000 7f0696ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:45:57.234+0000 7f0696ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:45:57.234+0000 7f07c4f60640 10 monclient: get_auth_request con 0x7f0690076470 auth_method 0 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:45:57.234+0000 7f07c5f62640 10 monclient: get_auth_request con 0x559b2bb73a00 auth_method 0 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 realm 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.626 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:45:57.235+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:45:57.236+0000 7f07c5761640 10 monclient: get_auth_request con 0x559b2bb77c60 auth_method 0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:45:57.236+0000 7f07c9b2a800 20 searching for the correct realm 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:45:57.237+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bb7cf20 auth_method 0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:45:57.238+0000 7f07c5f62640 10 monclient: get_auth_request con 0x7f07bc02cb40 auth_method 0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:45:57.239+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f07b8093060 auth_method 0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:45:57.240+0000 7f07c4f60640 10 monclient: get_auth_request con 0x7f07bc022910 auth_method 0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:45:57.240+0000 7f07c4f60640 0 -- 172.21.15.63:0/254209590 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f07bc022910 msgr2=0x7f07bc008410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:45:57.441+0000 7f07c4f60640 10 monclient: get_auth_request con 0x7f07bc022910 auth_method 0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:45:57.444+0000 7f07c5f62640 10 monclient: get_auth_request con 0x7f07b807c070 auth_method 0 2024-09-12T17:45:57.627 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:45:57.445+0000 7f07c5761640 10 monclient: get_auth_request con 0x7f07c002a030 auth_method 0 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:45:57.446+0000 7f07c5f62640 0 -- 172.21.15.63:0/254209590 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559b2bb73a00 msgr2=0x559b2bb75e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:45:57.446+0000 7f0696ffd640 1 client.7832.objecter ms_handle_reset 0x559b2bb73a00 session 0x559b2bb73380 osd.6 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:45:57.446+0000 7f0696ffd640 10 monclient: _renew_subs 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:45:57.446+0000 7f0696ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:45:57.446+0000 7f07c5f62640 10 monclient: get_auth_request con 0x7f0690086790 auth_method 0 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.628 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:45:57.451+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:45:57.452+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:45:57.452+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:45:57.452+0000 7f0696ffd640 1 client.7832.objecter ms_handle_reset 0x7f07bc022910 session 0x7f07bc012040 osd.5 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:45:57.452+0000 7f07c4f60640 10 monclient: get_auth_request con 0x559b2bb73a00 auth_method 0 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 zone default found 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 Realm: () 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 zonegroup default 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.629 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:45:57.453+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 started sync module instance, tier type = 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:45:57.454+0000 7f07c9b2a800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=0 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=1 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=2 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=3 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=4 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=5 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:45:57.464+0000 7f07c9b2a800 20 add_watcher() i=6 2024-09-12T17:45:57.630 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:45:57.465+0000 7f07c9b2a800 20 add_watcher() i=7 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:45:57.465+0000 7f07c9b2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding auth protocol: cephx 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding auth protocol: cephx 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding auth protocol: cephx 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.631 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: crc 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 AuthRegistry(0x7ffe91b87d30) adding con mode: secure 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:45:57.468+0000 7f067b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache list hook 0x559b2bb4f050 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache inspect hook 0x559b2bb4f050 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache erase hook 0x559b2bb4f050 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command cache zap hook 0x559b2bb4f050 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 note: GC not initialized 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:45:57.468+0000 7f067a7e4640 20 reqs_thread_entry: start 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace show hook 0x7f07bc004df0 2024-09-12T17:45:57.632 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace history hook 0x7f07bc004df0 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace active hook 0x7f07bc004df0 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 5 asok(0x559b2b867730) register_command sync trace active_short hook 0x7f07bc004df0 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:45:57.468+0000 7f07c9b2a800 20 Filter name: none 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:45:57.469+0000 7f05ebfff640 20 reqs_thread_entry: start 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:45:57.469+0000 7f07c9b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:45:57.471+0000 7f07c9b2a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:45:57.478+0000 7f07c9b2a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94124941727952 notifier 7832 bl.length()=911 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.634 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:45:57.479+0000 7f06a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:45:57.479+0000 7f07c9b2a800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:45:57.484+0000 7f07c9b2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f07c9b2a800 time 2024-09-12T17:45:57.484103+0000 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f07cb18c71a] 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: 4: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 6: main() 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 8: __libc_start_main() 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 9: _start() 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:45:57.484+0000 7f07c9b2a800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7f07c9b2a800 thread_name:radosgw-admin 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f07c9e3e6f0] 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f07c9e8b99c] 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f07cb18c774] 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f07cb18c8d8] 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b2a139841] 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 8: radosgw-admin(+0xd7490c) [0x559b2a64790c] 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559b2a14950d] 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 10: main() 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f07c9e29590] 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 12: __libc_start_main() 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 13: _start() 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:45:57.637 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:45:57.638 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:45:57.640 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:45:57.641 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:45:57.642 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f05ebfff640 / http_manager 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f067a7e4640 / http_manager 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f067b7e6640 / rgw_dt_lg_renew 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f0696ffd640 / ms_dispatch 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06a8ff9640 / io_context_pool 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06aaffd640 / ms_dispatch 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06b1e03640 / ms_dispatch 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f06b3606640 / io_context_pool 2024-09-12T17:45:57.644 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c4f60640 / msgr-worker-2 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c5761640 / msgr-worker-1 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c5f62640 / msgr-worker-0 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c6763640 / io_context_pool 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr: 7f07c9b2a800 / radosgw-admin 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:45:57.485779Z_d44181c6-bd9a-4fee-9d37-aca8b14af23c/log 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:45:57.645 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.565+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 20 realm 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.567+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.568+0000 7f6c0ef36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.647 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.568+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.568+0000 7f6c0ef36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:57.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.568+0000 7f6c0ef36800 20 searching for the correct realm 2024-09-12T17:45:57.648 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.571+0000 7f6c0a4b6640 0 -- 172.21.15.63:0/1573331404 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f6c0006d070 msgr2=0x7f6c000b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.776+0000 7f6c0b4b8640 0 -- 172.21.15.63:0/1573331404 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56076167c1a0 msgr2=0x56076167e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:57.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:45:57.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:57.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:45:57.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:57.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:57.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.781+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.784 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 zone default found 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 4 Realm: () 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 zonegroup default 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.782+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.783+0000 7f6c0ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.783+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.783+0000 7f6c0ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.783+0000 7f6c0ef36800 20 started sync module instance, tier type = 2024-09-12T17:45:57.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.783+0000 7f6c0ef36800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:45:57.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.793+0000 7f6c0ef36800 20 add_watcher() i=0 2024-09-12T17:45:57.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.793+0000 7f6c0ef36800 20 add_watcher() i=1 2024-09-12T17:45:57.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.793+0000 7f6c0ef36800 20 add_watcher() i=2 2024-09-12T17:45:57.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.793+0000 7f6c0ef36800 20 add_watcher() i=3 2024-09-12T17:45:57.794 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.793+0000 7f6c0ef36800 20 add_watcher() i=4 2024-09-12T17:45:57.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.793+0000 7f6c0ef36800 20 add_watcher() i=5 2024-09-12T17:45:57.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.793+0000 7f6c0ef36800 20 add_watcher() i=6 2024-09-12T17:45:57.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.794+0000 7f6c0ef36800 20 add_watcher() i=7 2024-09-12T17:45:57.795 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.794+0000 7f6c0ef36800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:57.796 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.795+0000 7f6ac17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6c0ef36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6c0ef36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6c0ef36800 5 note: GC not initialized 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6a3bfff640 20 reqs_thread_entry: start 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6c0ef36800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6c0ef36800 20 Filter name: none 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6a39ffb640 20 reqs_thread_entry: start 2024-09-12T17:45:57.798 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6c0ef36800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:45:57.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.796+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:45:57.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:45:57.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:45:57.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:45:57.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:45:57.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:45:57.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:45:57.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.797+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.798+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.798+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.799+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.799+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.799+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.799+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.799+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.799+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:45:57.801 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:45:57.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:45:57.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:45:57.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.800+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.801+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.801+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.801+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.801+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.802+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:45:57.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.802+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:45:57.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.802+0000 7f6c0ef36800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:45:57.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.802+0000 7f6c0ef36800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:45:57.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.803+0000 7f6ac17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.805+0000 7f6c0ef36800 20 remove_watcher() i=0 2024-09-12T17:45:57.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.805+0000 7f6c0ef36800 2 removed watcher, disabling cache 2024-09-12T17:45:57.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.806+0000 7f6c0ef36800 20 remove_watcher() i=1 2024-09-12T17:45:57.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.808+0000 7f6c0ef36800 20 remove_watcher() i=2 2024-09-12T17:45:57.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.809+0000 7f6c0ef36800 20 remove_watcher() i=3 2024-09-12T17:45:57.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.810+0000 7f6c0ef36800 20 remove_watcher() i=4 2024-09-12T17:45:57.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.811+0000 7f6c0ef36800 20 remove_watcher() i=5 2024-09-12T17:45:57.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.812+0000 7f6c0ef36800 20 remove_watcher() i=6 2024-09-12T17:45:57.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:45:57.813+0000 7f6c0ef36800 20 remove_watcher() i=7 2024-09-12T17:45:57.825 INFO:tasks.workunit.client.0.smithi063.stderr: test: duplicated entries can be purged manually 2024-09-12T17:46:27.842 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:46:27.875 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:27.875 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:27.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.918+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:27.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 20 realm 2024-09-12T17:46:27.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:27.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:27.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:27.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.921+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.922+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:27.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.922+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.922+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:27.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.922+0000 7f5626d2e800 20 searching for the correct realm 2024-09-12T17:46:27.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.926+0000 7f56222dc640 0 -- 172.21.15.63:0/1529711785 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5618075690 msgr2=0x7f5618075040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:27.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.930+0000 7f5622add640 0 -- 172.21.15.63:0/1529711785 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f561c026040 msgr2=0x7f561c026420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:27.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:27.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.935+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 zone default found 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 4 Realm: () 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 zonegroup default 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:27.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.936+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.937+0000 7f5626d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.937+0000 7f5626d2e800 20 started sync module instance, tier type = 2024-09-12T17:46:27.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.937+0000 7f5626d2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:27.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.946+0000 7f5626d2e800 20 add_watcher() i=0 2024-09-12T17:46:27.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.946+0000 7f5626d2e800 20 add_watcher() i=1 2024-09-12T17:46:27.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.946+0000 7f5626d2e800 20 add_watcher() i=2 2024-09-12T17:46:27.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.946+0000 7f5626d2e800 20 add_watcher() i=3 2024-09-12T17:46:27.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.946+0000 7f5626d2e800 20 add_watcher() i=4 2024-09-12T17:46:27.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.946+0000 7f5626d2e800 20 add_watcher() i=5 2024-09-12T17:46:27.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.946+0000 7f5626d2e800 20 add_watcher() i=6 2024-09-12T17:46:27.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.947+0000 7f5626d2e800 20 add_watcher() i=7 2024-09-12T17:46:27.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.947+0000 7f5626d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:27.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.949+0000 7f54d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5626d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5626d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5626d2e800 5 note: GC not initialized 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5453fff640 20 reqs_thread_entry: start 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5626d2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5626d2e800 20 Filter name: none 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5451ffb640 20 reqs_thread_entry: start 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.950+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.951+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:27.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.951+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.951+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:27.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.951+0000 7f5626d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:27.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.951+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.952+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:27.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.952+0000 7f5626d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:27.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.952+0000 7f5626d2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:27.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.952+0000 7f5626d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:27.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.954+0000 7f54d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:27.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.956+0000 7f5626d2e800 20 remove_watcher() i=0 2024-09-12T17:46:27.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.956+0000 7f5626d2e800 2 removed watcher, disabling cache 2024-09-12T17:46:27.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.957+0000 7f5626d2e800 20 remove_watcher() i=1 2024-09-12T17:46:27.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.958+0000 7f5626d2e800 20 remove_watcher() i=2 2024-09-12T17:46:27.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.959+0000 7f5626d2e800 20 remove_watcher() i=3 2024-09-12T17:46:27.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.960+0000 7f5626d2e800 20 remove_watcher() i=4 2024-09-12T17:46:27.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.961+0000 7f5626d2e800 20 remove_watcher() i=5 2024-09-12T17:46:27.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.962+0000 7f5626d2e800 20 remove_watcher() i=6 2024-09-12T17:46:27.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:27.963+0000 7f5626d2e800 20 remove_watcher() i=7 2024-09-12T17:46:27.977 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:27.977 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:46:27.977 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T17:46:27.977 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:27.978 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:46:28.016 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:28.017 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:28.057 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.055+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 20 realm 2024-09-12T17:46:28.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.058 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:28.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.059 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:28.060 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.057+0000 7fa348f20800 20 searching for the correct realm 2024-09-12T17:46:28.062 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.060+0000 7fa33ffff640 0 -- 172.21.15.63:0/438827020 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa33008f170 msgr2=0x7fa330072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:28.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.265+0000 7fa345469640 0 -- 172.21.15.63:0/438827020 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55631bb26ec0 msgr2=0x55631bb29340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:28.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:28.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:28.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:28.274 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:28.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:28.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:28.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.269+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.275 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 zone default found 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 4 Realm: () 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 zonegroup default 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.276 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.271+0000 7fa348f20800 20 started sync module instance, tier type = 2024-09-12T17:46:28.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.271+0000 7fa348f20800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=0 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=1 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=2 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=3 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=4 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=5 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=6 2024-09-12T17:46:28.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.281+0000 7fa348f20800 20 add_watcher() i=7 2024-09-12T17:46:28.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.281+0000 7fa348f20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:28.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.282+0000 7fa1fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:28.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa348f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:28.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa348f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:28.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa348f20800 5 note: GC not initialized 2024-09-12T17:46:28.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa1fa7e4640 20 reqs_thread_entry: start 2024-09-12T17:46:28.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa348f20800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:28.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa348f20800 20 Filter name: none 2024-09-12T17:46:28.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa1f3fff640 20 reqs_thread_entry: start 2024-09-12T17:46:28.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa348f20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:28.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.283+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:28.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:28.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:28.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:46:28.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:28.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:28.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.284+0000 7fa348f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:46:28.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.285+0000 7fa348f20800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:46:28.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:46:28.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 93884154809872 notifier 7880 bl.length()=911 2024-09-12T17:46:28.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:46:28.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:46:28.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:46:28.296 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:46:28.300 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa348f20800 time 2024-09-12T17:46:28.300773+0000 2024-09-12T17:46:28.300 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:28.301 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.301 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa34a78c71a] 2024-09-12T17:46:28.301 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fa348f20800 thread_name:radosgw-admin 2024-09-12T17:46:28.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.299+0000 7fa348f20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa348f20800 time 2024-09-12T17:46:28.300773+0000 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa34a78c71a] 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.303 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:46:28.304 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:46:28.304 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.322 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa34943e6f0] 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa34948b99c] 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa34a78c774] 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:46:28.323 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.300+0000 7fa348f20800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fa348f20800 thread_name:radosgw-admin 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa34943e6f0] 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa34948b99c] 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa34a78c774] 2024-09-12T17:46:28.324 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:46:28.038+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.325 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding auth protocol: cephx 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding auth protocol: cephx 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding auth protocol: cephx 2024-09-12T17:46:28.326 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:46:28.038+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: starting msgr at 2024-09-12T17:46:28.327 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: starting objecter 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 asok(0x55631b81a730) register_command objecter_requests hook 0x55631ba42d40 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: setting wanted keys 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: calling monclient init 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding auth protocol: cephx 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding auth protocol: cephx 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding auth protocol: cephx 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.328 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:46:28.039+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:46:28.039+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key hook 0x55631ba3b538 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631b8e76e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631b8e8390 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631b8f49e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.329 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.555747s 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631b8e76e0 auth_method 0 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631b8f49e0 auth_method 0 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.330 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631b8e8390 auth_method 0 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.331 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:46:28.040+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:46:28.040+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:46:28.040+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:46:28.040+0000 7fa344c68640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:46:28.040+0000 7fa344c68640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:46:28.040+0000 7fa344c68640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:46:28.040+0000 7fa344c68640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: dump: 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.332 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.333 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: dump: 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:46:28.040+0000 7fa348f20800 5 monclient: authenticate success, global_id 7871 2024-09-12T17:46:28.334 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:46:28.040+0000 7fa232e05640 4 set_mon_vals no callback set 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:46:28.040+0000 7fa348f20800 1 librados: init done 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:46:28.042+0000 7fa231602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:46:28.042+0000 7fa231602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:46:28.042+0000 7fa231602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:46:28.042+0000 7fa33ffff640 10 monclient: get_auth_request con 0x7fa22c0764a0 auth_method 0 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:46:28.042+0000 7fa345469640 10 monclient: get_auth_request con 0x55631ba77bd0 auth_method 0 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:46:28.043+0000 7fa344c68640 10 monclient: get_auth_request con 0x55631ba87ad0 auth_method 0 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:46:28.044+0000 7fa33ffff640 10 monclient: get_auth_request con 0x55631ba8b330 auth_method 0 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:46:28.045+0000 7fa348f20800 10 monclient: build_initial_monmap 2024-09-12T17:46:28.335 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:46:28.045+0000 7fa348f20800 1 build_initial for_mkfs: 0 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:46:28.045+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding auth protocol: cephx 2024-09-12T17:46:28.336 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding auth protocol: cephx 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding auth protocol: cephx 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.337 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:46:28.045+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 asok(0x55631b81a730) register_command objecter_requests cmddesc objecter_requests hook 0x55631ba94670 EEXIST 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding auth protocol: cephx 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding auth protocol: cephx 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding auth protocol: cephx 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.338 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:46:28.046+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:46:28.046+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key cmddesc rotate-key hook 0x55631ba8fda0 EEXIST 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631bab8360 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631baba630 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.339 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631bab6b30 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.562620s 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631baba630 auth_method 0 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631bab6b30 auth_method 0 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.340 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631bab8360 auth_method 0 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.341 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_done global_id 7874 payload 824 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:46:28.047+0000 7fa33ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:46:28.047+0000 7fa33ffff640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:46:28.047+0000 7fa33ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: dump: 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.342 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: dump: 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.343 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:46:28.047+0000 7fa348f20800 5 monclient: authenticate success, global_id 7874 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:46:28.047+0000 7fa345c6a640 4 set_mon_vals no callback set 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.344 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:46:28.049+0000 7fa22a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:46:28.049+0000 7fa22a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:46:28.049+0000 7fa22a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:46:28.049+0000 7fa344c68640 10 monclient: get_auth_request con 0x7fa21c076380 auth_method 0 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:46:28.049+0000 7fa348f20800 10 monclient: get_monmap_and_config 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:46:28.049+0000 7fa348f20800 10 monclient: build_initial_monmap 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:46:28.049+0000 7fa348f20800 1 build_initial for_mkfs: 0 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:46:28.049+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.345 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding auth protocol: cephx 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding auth protocol: cephx 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding auth protocol: cephx 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.346 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.347 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.347 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.347 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:46:28.049+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding auth protocol: cephx 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding auth protocol: cephx 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding auth protocol: cephx 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.348 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:46:28.050+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:46:28.050+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key cmddesc rotate-key hook 0x7ffc0de632f8 EEXIST 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.349 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631bb0c7d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631bafd120 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631bb07c00 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.566627s 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631bafd120 auth_method 0 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.350 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631bb07c00 auth_method 0 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631bb0c7d0 auth_method 0 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.351 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_done global_id 7877 payload 274 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:46:28.050+0000 7fa33ffff640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:46:28.352 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.353 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.354 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 monclient: authenticate success, global_id 7877 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: get_monmap_and_config success 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:46:28.051+0000 7fa348f20800 4 set_mon_vals no callback set 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: shutdown 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: build_initial_monmap 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:46:28.051+0000 7fa348f20800 1 build_initial for_mkfs: 0 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.355 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding auth protocol: cephx 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding auth protocol: cephx 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding auth protocol: cephx 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.356 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.357 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:46:28.052+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: starting msgr at 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: starting objecter 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 asok(0x55631b81a730) register_command objecter_requests cmddesc objecter_requests hook 0x55631badcf50 EEXIST 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: setting wanted keys 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: calling monclient init 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding auth protocol: cephx 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding auth protocol: cephx 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding auth protocol: cephx 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.358 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:46:28.052+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:46:28.052+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key cmddesc rotate-key hook 0x55631bad0258 EEXIST 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:46:28.359 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631bafd120 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631bb07c00 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631bb0c7d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.568876s 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631bafd120 auth_method 0 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.360 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631bb0c7d0 auth_method 0 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631bb07c00 auth_method 0 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:46:28.053+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:46:28.053+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.361 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:46:28.053+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_done global_id 7880 payload 824 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:46:28.053+0000 7fa344c68640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.362 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: dump: 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.363 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: dump: 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.364 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:46:28.053+0000 7fa348f20800 5 monclient: authenticate success, global_id 7880 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:46:28.053+0000 7fa21bfff640 4 set_mon_vals no callback set 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:46:28.053+0000 7fa348f20800 1 librados: init done 2024-09-12T17:46:28.365 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:46:28.053+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cr dump hook 0x55631bb08598 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:46:28.055+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:46:28.055+0000 7fa21a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:46:28.055+0000 7fa21a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:46:28.055+0000 7fa21a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:46:28.055+0000 7fa33ffff640 10 monclient: get_auth_request con 0x7fa210076470 auth_method 0 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:46:28.056+0000 7fa345469640 10 monclient: get_auth_request con 0x55631bb26ec0 auth_method 0 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 realm 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:46:28.056+0000 7fa348f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.366 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:46:28.057+0000 7fa344c68640 10 monclient: get_auth_request con 0x55631bb2b270 auth_method 0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 searching for the correct realm 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:46:28.058+0000 7fa33ffff640 10 monclient: get_auth_request con 0x55631bb30420 auth_method 0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:46:28.058+0000 7fa345469640 10 monclient: get_auth_request con 0x7fa33009f240 auth_method 0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:46:28.060+0000 7fa344c68640 10 monclient: get_auth_request con 0x7fa33806b020 auth_method 0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:46:28.060+0000 7fa33ffff640 0 -- 172.21.15.63:0/438827020 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa33008f170 msgr2=0x7fa330072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:46:28.262+0000 7fa33ffff640 10 monclient: get_auth_request con 0x7fa33008f170 auth_method 0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:46:28.263+0000 7fa345469640 10 monclient: get_auth_request con 0x7fa3380bfbf0 auth_method 0 2024-09-12T17:46:28.367 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:46:28.264+0000 7fa344c68640 10 monclient: get_auth_request con 0x7fa340029040 auth_method 0 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:46:28.265+0000 7fa345469640 0 -- 172.21.15.63:0/438827020 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55631bb26ec0 msgr2=0x55631bb29340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:46:28.265+0000 7fa21a7fc640 1 client.7880.objecter ms_handle_reset 0x55631bb26ec0 session 0x55631bb267f0 osd.6 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:46:28.265+0000 7fa21a7fc640 10 monclient: _renew_subs 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:46:28.265+0000 7fa21a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:46:28.266+0000 7fa345469640 10 monclient: get_auth_request con 0x7fa210086790 auth_method 0 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.368 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 zone default found 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:46:28.270+0000 7fa348f20800 4 Realm: () 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:46:28.270+0000 7fa348f20800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:46:28.270+0000 7fa348f20800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:46:28.270+0000 7fa348f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 zonegroup default 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.369 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 started sync module instance, tier type = 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=0 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=1 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=2 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=3 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=4 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=5 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=6 2024-09-12T17:46:28.370 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:46:28.281+0000 7fa348f20800 20 add_watcher() i=7 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:46:28.281+0000 7fa348f20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding auth protocol: cephx 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding auth protocol: cephx 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding auth protocol: cephx 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.371 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:46:28.282+0000 7fa1fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:46:28.283+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache list hook 0x55631bb04190 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache inspect hook 0x55631bb04190 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache erase hook 0x55631bb04190 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache zap hook 0x55631bb04190 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 note: GC not initialized 2024-09-12T17:46:28.372 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:46:28.283+0000 7fa1fa7e4640 20 reqs_thread_entry: start 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace show hook 0x7fa340004040 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace history hook 0x7fa340004040 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace active hook 0x7fa340004040 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace active_short hook 0x7fa340004040 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 Filter name: none 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:46:28.283+0000 7fa1f3fff640 20 reqs_thread_entry: start 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:46:28.283+0000 7fa348f20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:28.373 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:46:28.285+0000 7fa348f20800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.374 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 93884154809872 notifier 7880 bl.length()=911 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:46:28.299+0000 7fa348f20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa348f20800 time 2024-09-12T17:46:28.300773+0000 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.375 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa34a78c71a] 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:46:28.300+0000 7fa348f20800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fa348f20800 thread_name:radosgw-admin 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.376 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa34943e6f0] 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa34948b99c] 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa34a78c774] 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:28.377 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:46:28.378 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:46:28.379 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:46:28.380 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:46:28.381 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:46:28.382 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:46:28.383 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:46:28.384 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa1f3fff640 / http_manager 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa1fa7e4640 / http_manager 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa1fb7e6640 / rgw_dt_lg_renew 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa21a7fc640 / ms_dispatch 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa21bfff640 / io_context_pool 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa22a7fc640 / ms_dispatch 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa231602640 / ms_dispatch 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa232e05640 / io_context_pool 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa33ffff640 / msgr-worker-2 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa344c68640 / msgr-worker-1 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa345469640 / msgr-worker-0 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa345c6a640 / io_context_pool 2024-09-12T17:46:28.385 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa348f20800 / radosgw-admin 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/log/ceph/ceph-client.admin.155872.log 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:--- begin dump of recent events --- 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr: -499> 2024-09-12T17:46:28.038+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.386 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -498> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding auth protocol: cephx 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -497> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding auth protocol: cephx 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -496> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding auth protocol: cephx 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -495> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -494> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -493> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -492> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -491> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -490> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.387 INFO:tasks.workunit.client.0.smithi063.stderr: -489> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -488> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -487> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -486> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -485> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: crc 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -484> 2024-09-12T17:46:28.038+0000 7fa348f20800 5 AuthRegistry(0x55631ba40bb0) adding con mode: secure 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -483> 2024-09-12T17:46:28.038+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -482> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: starting msgr at 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -481> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: starting objecter 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -480> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 asok(0x55631b81a730) register_command objecter_requests hook 0x55631ba42d40 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -479> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: setting wanted keys 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -478> 2024-09-12T17:46:28.039+0000 7fa348f20800 1 librados: calling monclient init 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -477> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.388 INFO:tasks.workunit.client.0.smithi063.stderr: -476> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding auth protocol: cephx 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -475> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding auth protocol: cephx 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -474> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding auth protocol: cephx 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -473> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -472> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -471> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -470> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -469> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -468> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -467> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -466> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -465> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -464> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.389 INFO:tasks.workunit.client.0.smithi063.stderr: -463> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: crc 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -462> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 AuthRegistry(0x55631ba3b3f0) adding con mode: secure 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -461> 2024-09-12T17:46:28.039+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -460> 2024-09-12T17:46:28.039+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -459> 2024-09-12T17:46:28.039+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key hook 0x55631ba3b538 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -458> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -457> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -456> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631b8e76e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -455> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631b8e8390 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -454> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631b8f49e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -453> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -452> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -451> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.390 INFO:tasks.workunit.client.0.smithi063.stderr: -450> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -449> 2024-09-12T17:46:28.039+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.555747s 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -448> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631b8e76e0 auth_method 0 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -447> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -446> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -445> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -444> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631b8f49e0 auth_method 0 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -443> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -442> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -441> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -440> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -439> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -438> 2024-09-12T17:46:28.039+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.391 INFO:tasks.workunit.client.0.smithi063.stderr: -437> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -436> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -435> 2024-09-12T17:46:28.039+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -434> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631b8e8390 auth_method 0 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -433> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -432> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -431> 2024-09-12T17:46:28.039+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -430> 2024-09-12T17:46:28.040+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -429> 2024-09-12T17:46:28.040+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -428> 2024-09-12T17:46:28.040+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -427> 2024-09-12T17:46:28.040+0000 7fa344c68640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -426> 2024-09-12T17:46:28.040+0000 7fa344c68640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -425> 2024-09-12T17:46:28.040+0000 7fa344c68640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.392 INFO:tasks.workunit.client.0.smithi063.stderr: -424> 2024-09-12T17:46:28.040+0000 7fa344c68640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr: -423> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr: -422> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr: -421> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: dump: 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.393 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr: -420> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr: -419> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr: -418> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr: -417> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr: -416> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr: -415> 2024-09-12T17:46:28.040+0000 7fa231602640 10 monclient: dump: 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.394 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -414> 2024-09-12T17:46:28.040+0000 7fa348f20800 5 monclient: authenticate success, global_id 7871 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -413> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -412> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -411> 2024-09-12T17:46:28.040+0000 7fa232e05640 4 set_mon_vals no callback set 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -410> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -409> 2024-09-12T17:46:28.040+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -408> 2024-09-12T17:46:28.040+0000 7fa348f20800 1 librados: init done 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -407> 2024-09-12T17:46:28.042+0000 7fa231602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -406> 2024-09-12T17:46:28.042+0000 7fa231602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -405> 2024-09-12T17:46:28.042+0000 7fa231602640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.395 INFO:tasks.workunit.client.0.smithi063.stderr: -404> 2024-09-12T17:46:28.042+0000 7fa33ffff640 10 monclient: get_auth_request con 0x7fa22c0764a0 auth_method 0 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr: -403> 2024-09-12T17:46:28.042+0000 7fa345469640 10 monclient: get_auth_request con 0x55631ba77bd0 auth_method 0 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr: -402> 2024-09-12T17:46:28.043+0000 7fa344c68640 10 monclient: get_auth_request con 0x55631ba87ad0 auth_method 0 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr: -401> 2024-09-12T17:46:28.044+0000 7fa33ffff640 10 monclient: get_auth_request con 0x55631ba8b330 auth_method 0 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr: -400> 2024-09-12T17:46:28.045+0000 7fa348f20800 10 monclient: build_initial_monmap 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr: -399> 2024-09-12T17:46:28.045+0000 7fa348f20800 1 build_initial for_mkfs: 0 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr: -398> 2024-09-12T17:46:28.045+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.396 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -397> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding auth protocol: cephx 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -396> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding auth protocol: cephx 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -395> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding auth protocol: cephx 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -394> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -393> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -392> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -391> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -390> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -389> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.397 INFO:tasks.workunit.client.0.smithi063.stderr: -388> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -387> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -386> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -385> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -384> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: crc 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -383> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 AuthRegistry(0x55631ba90ca0) adding con mode: secure 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -382> 2024-09-12T17:46:28.045+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -381> 2024-09-12T17:46:28.045+0000 7fa348f20800 5 asok(0x55631b81a730) register_command objecter_requests cmddesc objecter_requests hook 0x55631ba94670 EEXIST 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -380> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -379> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding auth protocol: cephx 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -378> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding auth protocol: cephx 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -377> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding auth protocol: cephx 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -376> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.398 INFO:tasks.workunit.client.0.smithi063.stderr: -375> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -374> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -373> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -372> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -371> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -370> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -369> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -368> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -367> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -366> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: crc 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -365> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 AuthRegistry(0x55631ba8fc58) adding con mode: secure 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -364> 2024-09-12T17:46:28.046+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -363> 2024-09-12T17:46:28.046+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.399 INFO:tasks.workunit.client.0.smithi063.stderr: -362> 2024-09-12T17:46:28.046+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key cmddesc rotate-key hook 0x55631ba8fda0 EEXIST 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -361> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -360> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -359> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631bab8360 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -358> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631baba630 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -357> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631bab6b30 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -356> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -355> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -354> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -353> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -352> 2024-09-12T17:46:28.046+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.562620s 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -351> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631baba630 auth_method 0 2024-09-12T17:46:28.400 INFO:tasks.workunit.client.0.smithi063.stderr: -350> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.401 INFO:tasks.workunit.client.0.smithi063.stderr: -349> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.401 INFO:tasks.workunit.client.0.smithi063.stderr: -348> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.401 INFO:tasks.workunit.client.0.smithi063.stderr: -347> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631bab6b30 auth_method 0 2024-09-12T17:46:28.401 INFO:tasks.workunit.client.0.smithi063.stderr: -346> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.401 INFO:tasks.workunit.client.0.smithi063.stderr: -345> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.401 INFO:tasks.workunit.client.0.smithi063.stderr: -344> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.401 INFO:tasks.workunit.client.0.smithi063.stderr: -343> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631bab8360 auth_method 0 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -342> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -341> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -340> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -339> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -338> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -337> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -336> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -335> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -334> 2024-09-12T17:46:28.046+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -333> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -332> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.402 INFO:tasks.workunit.client.0.smithi063.stderr: -331> 2024-09-12T17:46:28.046+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr: -330> 2024-09-12T17:46:28.046+0000 7fa33ffff640 10 monclient(hunting): handle_auth_done global_id 7874 payload 824 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr: -329> 2024-09-12T17:46:28.047+0000 7fa33ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr: -328> 2024-09-12T17:46:28.047+0000 7fa33ffff640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr: -327> 2024-09-12T17:46:28.047+0000 7fa33ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr: -326> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr: -325> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr: -324> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: dump: 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.403 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr: -323> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr: -322> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr: -321> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr: -320> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.404 INFO:tasks.workunit.client.0.smithi063.stderr: -319> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr: -318> 2024-09-12T17:46:28.047+0000 7fa22a7fc640 10 monclient: dump: 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr: -317> 2024-09-12T17:46:28.047+0000 7fa348f20800 5 monclient: authenticate success, global_id 7874 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr: -316> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.405 INFO:tasks.workunit.client.0.smithi063.stderr: -315> 2024-09-12T17:46:28.047+0000 7fa345c6a640 4 set_mon_vals no callback set 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -314> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -313> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -312> 2024-09-12T17:46:28.047+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -311> 2024-09-12T17:46:28.049+0000 7fa22a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -310> 2024-09-12T17:46:28.049+0000 7fa22a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -309> 2024-09-12T17:46:28.049+0000 7fa22a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -308> 2024-09-12T17:46:28.049+0000 7fa344c68640 10 monclient: get_auth_request con 0x7fa21c076380 auth_method 0 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -307> 2024-09-12T17:46:28.049+0000 7fa348f20800 10 monclient: get_monmap_and_config 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -306> 2024-09-12T17:46:28.049+0000 7fa348f20800 10 monclient: build_initial_monmap 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -305> 2024-09-12T17:46:28.049+0000 7fa348f20800 1 build_initial for_mkfs: 0 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr: -304> 2024-09-12T17:46:28.049+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.406 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr: -303> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding auth protocol: cephx 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr: -302> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding auth protocol: cephx 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr: -301> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding auth protocol: cephx 2024-09-12T17:46:28.407 INFO:tasks.workunit.client.0.smithi063.stderr: -300> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -299> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -298> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -297> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -296> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -295> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -294> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -293> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -292> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -291> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -290> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: crc 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -289> 2024-09-12T17:46:28.049+0000 7fa348f20800 5 AuthRegistry(0x55631bad81b0) adding con mode: secure 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -288> 2024-09-12T17:46:28.049+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.408 INFO:tasks.workunit.client.0.smithi063.stderr: -287> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -286> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding auth protocol: cephx 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -285> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding auth protocol: cephx 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -284> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding auth protocol: cephx 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -283> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -282> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -281> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -280> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -279> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -278> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -277> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -276> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -275> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.409 INFO:tasks.workunit.client.0.smithi063.stderr: -274> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -273> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: crc 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -272> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de631b0) adding con mode: secure 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -271> 2024-09-12T17:46:28.050+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -270> 2024-09-12T17:46:28.050+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -269> 2024-09-12T17:46:28.050+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key cmddesc rotate-key hook 0x7ffc0de632f8 EEXIST 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -268> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -267> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -266> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631bb0c7d0 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -265> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631bafd120 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -264> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631bb07c00 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -263> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -262> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.410 INFO:tasks.workunit.client.0.smithi063.stderr: -261> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -260> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -259> 2024-09-12T17:46:28.050+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.566627s 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -258> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631bafd120 auth_method 0 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -257> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -256> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -255> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -254> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631bb07c00 auth_method 0 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -253> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -252> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -251> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -250> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631bb0c7d0 auth_method 0 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -249> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.411 INFO:tasks.workunit.client.0.smithi063.stderr: -248> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -247> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -246> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -245> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -244> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -243> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -242> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -241> 2024-09-12T17:46:28.050+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -240> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -239> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -238> 2024-09-12T17:46:28.050+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -237> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient(hunting): handle_auth_done global_id 7877 payload 274 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -236> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.412 INFO:tasks.workunit.client.0.smithi063.stderr: -235> 2024-09-12T17:46:28.050+0000 7fa33ffff640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr: -234> 2024-09-12T17:46:28.050+0000 7fa33ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr: -233> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr: -232> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr: -231> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.413 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr: -230> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr: -229> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr: -228> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr: -227> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr: -226> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr: -225> 2024-09-12T17:46:28.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.414 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: -224> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 monclient: authenticate success, global_id 7877 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: -223> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: get_monmap_and_config success 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: -222> 2024-09-12T17:46:28.051+0000 7fa348f20800 4 set_mon_vals no callback set 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: -221> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: shutdown 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: -220> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: build_initial_monmap 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: -219> 2024-09-12T17:46:28.051+0000 7fa348f20800 1 build_initial for_mkfs: 0 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr: -218> 2024-09-12T17:46:28.051+0000 7fa348f20800 10 monclient: monmap: 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 0 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:28.415 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 0.000000 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr:created 0.000000 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-a 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.noname-b 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-c 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr: -217> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding auth protocol: cephx 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr: -216> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding auth protocol: cephx 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr: -215> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding auth protocol: cephx 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr: -214> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.416 INFO:tasks.workunit.client.0.smithi063.stderr: -213> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -212> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -211> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -210> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -209> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -208> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -207> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -206> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -205> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -204> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: crc 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -203> 2024-09-12T17:46:28.051+0000 7fa348f20800 5 AuthRegistry(0x55631badbd30) adding con mode: secure 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -202> 2024-09-12T17:46:28.052+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -201> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: starting msgr at 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -200> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: starting objecter 2024-09-12T17:46:28.417 INFO:tasks.workunit.client.0.smithi063.stderr: -199> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 asok(0x55631b81a730) register_command objecter_requests cmddesc objecter_requests hook 0x55631badcf50 EEXIST 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -198> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: setting wanted keys 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -197> 2024-09-12T17:46:28.052+0000 7fa348f20800 1 librados: calling monclient init 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -196> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient: init 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -195> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding auth protocol: cephx 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -194> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding auth protocol: cephx 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -193> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding auth protocol: cephx 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -192> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -191> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -190> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -189> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -188> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -187> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.418 INFO:tasks.workunit.client.0.smithi063.stderr: -186> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -185> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -184> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -183> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -182> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: crc 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -181> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 AuthRegistry(0x55631bad0110) adding con mode: secure 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -180> 2024-09-12T17:46:28.052+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -179> 2024-09-12T17:46:28.052+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -178> 2024-09-12T17:46:28.052+0000 7fa348f20800 5 asok(0x55631b81a730) register_command rotate-key cmddesc rotate-key hook 0x55631bad0258 EEXIST 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -177> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -176> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -175> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-c con 0x55631bafd120 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -174> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-b con 0x55631bb07c00 addr [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-12T17:46:28.419 INFO:tasks.workunit.client.0.smithi063.stderr: -173> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): picked mon.noname-a con 0x55631bb0c7d0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -172> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -171> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -170> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -169> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -168> 2024-09-12T17:46:28.052+0000 7fa348f20800 10 monclient(hunting): authenticate will time out at 2280.568876s 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -167> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): get_auth_request con 0x55631bafd120 auth_method 0 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -166> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -165> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -164> 2024-09-12T17:46:28.052+0000 7fa344c68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -163> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): get_auth_request con 0x55631bb0c7d0 auth_method 0 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -162> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -161> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.420 INFO:tasks.workunit.client.0.smithi063.stderr: -160> 2024-09-12T17:46:28.052+0000 7fa345469640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -159> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -158> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -157> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -156> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): get_auth_request con 0x55631bb07c00 auth_method 0 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -155> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -154> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -153> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -152> 2024-09-12T17:46:28.053+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -151> 2024-09-12T17:46:28.053+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -150> 2024-09-12T17:46:28.053+0000 7fa345469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -149> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -148> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:28.421 INFO:tasks.workunit.client.0.smithi063.stderr: -147> 2024-09-12T17:46:28.053+0000 7fa33ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr: -146> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient(hunting): handle_auth_done global_id 7880 payload 824 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr: -145> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient: _finish_hunting 0 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr: -144> 2024-09-12T17:46:28.053+0000 7fa344c68640 1 monclient: found mon.noname-c 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr: -143> 2024-09-12T17:46:28.053+0000 7fa344c68640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr: -142> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr: -141> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr: -140> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: dump: 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.422 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr: -139> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr: -138> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr: -137> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr: -136> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr: -135> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr: -134> 2024-09-12T17:46:28.053+0000 7fa21a7fc640 10 monclient: dump: 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr:epoch 1 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr:fsid 40c8ab5f-c624-4f6c-a988-0ddc1f0db948 2024-09-12T17:46:28.423 INFO:tasks.workunit.client.0.smithi063.stderr:last_changed 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr:created 2024-09-12T17:20:44.208591+0000 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr:election_strategy: 1 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr:2: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.c 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr: -133> 2024-09-12T17:46:28.053+0000 7fa348f20800 5 monclient: authenticate success, global_id 7880 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr: -132> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr: -131> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr: -130> 2024-09-12T17:46:28.053+0000 7fa21bfff640 4 set_mon_vals no callback set 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr: -129> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _renew_subs 2024-09-12T17:46:28.424 INFO:tasks.workunit.client.0.smithi063.stderr: -128> 2024-09-12T17:46:28.053+0000 7fa348f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -127> 2024-09-12T17:46:28.053+0000 7fa348f20800 1 librados: init done 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -126> 2024-09-12T17:46:28.053+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cr dump hook 0x55631bb08598 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -125> 2024-09-12T17:46:28.055+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -124> 2024-09-12T17:46:28.055+0000 7fa21a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -123> 2024-09-12T17:46:28.055+0000 7fa21a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -122> 2024-09-12T17:46:28.055+0000 7fa21a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.82:6832/2727355490,v1:172.21.15.82:6833/2727355490] 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -121> 2024-09-12T17:46:28.055+0000 7fa33ffff640 10 monclient: get_auth_request con 0x7fa210076470 auth_method 0 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -120> 2024-09-12T17:46:28.056+0000 7fa345469640 10 monclient: get_auth_request con 0x55631bb26ec0 auth_method 0 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -119> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -118> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 realm 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -117> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -116> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.425 INFO:tasks.workunit.client.0.smithi063.stderr: -115> 2024-09-12T17:46:28.056+0000 7fa348f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -114> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -113> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -112> 2024-09-12T17:46:28.056+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -111> 2024-09-12T17:46:28.057+0000 7fa344c68640 10 monclient: get_auth_request con 0x55631bb2b270 auth_method 0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -110> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -109> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -108> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -107> 2024-09-12T17:46:28.057+0000 7fa348f20800 20 searching for the correct realm 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -106> 2024-09-12T17:46:28.058+0000 7fa33ffff640 10 monclient: get_auth_request con 0x55631bb30420 auth_method 0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -105> 2024-09-12T17:46:28.058+0000 7fa345469640 10 monclient: get_auth_request con 0x7fa33009f240 auth_method 0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -104> 2024-09-12T17:46:28.060+0000 7fa344c68640 10 monclient: get_auth_request con 0x7fa33806b020 auth_method 0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -103> 2024-09-12T17:46:28.060+0000 7fa33ffff640 0 -- 172.21.15.63:0/438827020 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa33008f170 msgr2=0x7fa330072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -102> 2024-09-12T17:46:28.262+0000 7fa33ffff640 10 monclient: get_auth_request con 0x7fa33008f170 auth_method 0 2024-09-12T17:46:28.426 INFO:tasks.workunit.client.0.smithi063.stderr: -101> 2024-09-12T17:46:28.263+0000 7fa345469640 10 monclient: get_auth_request con 0x7fa3380bfbf0 auth_method 0 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -100> 2024-09-12T17:46:28.264+0000 7fa344c68640 10 monclient: get_auth_request con 0x7fa340029040 auth_method 0 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -99> 2024-09-12T17:46:28.265+0000 7fa345469640 0 -- 172.21.15.63:0/438827020 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55631bb26ec0 msgr2=0x55631bb29340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -98> 2024-09-12T17:46:28.265+0000 7fa21a7fc640 1 client.7880.objecter ms_handle_reset 0x55631bb26ec0 session 0x55631bb267f0 osd.6 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -97> 2024-09-12T17:46:28.265+0000 7fa21a7fc640 10 monclient: _renew_subs 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -96> 2024-09-12T17:46:28.265+0000 7fa21a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.63:3301/0 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -95> 2024-09-12T17:46:28.266+0000 7fa345469640 10 monclient: get_auth_request con 0x7fa210086790 auth_method 0 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -94> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -93> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -92> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -91> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -90> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -89> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:28.427 INFO:tasks.workunit.client.0.smithi063.stderr: -88> 2024-09-12T17:46:28.269+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -87> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -86> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -85> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -84> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -83> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -82> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 zone default found 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -81> 2024-09-12T17:46:28.270+0000 7fa348f20800 4 Realm: () 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -80> 2024-09-12T17:46:28.270+0000 7fa348f20800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -79> 2024-09-12T17:46:28.270+0000 7fa348f20800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -78> 2024-09-12T17:46:28.270+0000 7fa348f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -77> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 zonegroup default 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -76> 2024-09-12T17:46:28.270+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.428 INFO:tasks.workunit.client.0.smithi063.stderr: -75> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -74> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -73> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -72> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -71> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -70> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 started sync module instance, tier type = 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -69> 2024-09-12T17:46:28.271+0000 7fa348f20800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -68> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=0 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -67> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=1 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -66> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=2 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -65> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=3 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -64> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=4 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -63> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=5 2024-09-12T17:46:28.429 INFO:tasks.workunit.client.0.smithi063.stderr: -62> 2024-09-12T17:46:28.280+0000 7fa348f20800 20 add_watcher() i=6 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -61> 2024-09-12T17:46:28.281+0000 7fa348f20800 20 add_watcher() i=7 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -60> 2024-09-12T17:46:28.281+0000 7fa348f20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -59> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding auth protocol: cephx 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -58> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding auth protocol: cephx 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -57> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding auth protocol: cephx 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -56> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -55> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -54> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -53> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -52> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -51> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -50> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.430 INFO:tasks.workunit.client.0.smithi063.stderr: -49> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -48> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -47> 2024-09-12T17:46:28.282+0000 7fa1fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -46> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -45> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: crc 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -44> 2024-09-12T17:46:28.282+0000 7fa348f20800 5 AuthRegistry(0x7ffc0de63680) adding con mode: secure 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -43> 2024-09-12T17:46:28.283+0000 7fa348f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -42> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -41> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -40> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache list hook 0x55631bb04190 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -39> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache inspect hook 0x55631bb04190 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -38> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache erase hook 0x55631bb04190 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -37> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command cache zap hook 0x55631bb04190 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -36> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 note: GC not initialized 2024-09-12T17:46:28.431 INFO:tasks.workunit.client.0.smithi063.stderr: -35> 2024-09-12T17:46:28.283+0000 7fa1fa7e4640 20 reqs_thread_entry: start 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -34> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace show hook 0x7fa340004040 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -33> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace history hook 0x7fa340004040 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -32> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace active hook 0x7fa340004040 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -31> 2024-09-12T17:46:28.283+0000 7fa348f20800 5 asok(0x55631b81a730) register_command sync trace active_short hook 0x7fa340004040 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -30> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -29> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 Filter name: none 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -28> 2024-09-12T17:46:28.283+0000 7fa1f3fff640 20 reqs_thread_entry: start 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -27> 2024-09-12T17:46:28.283+0000 7fa348f20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -26> 2024-09-12T17:46:28.283+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -25> 2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -24> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -23> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:28.432 INFO:tasks.workunit.client.0.smithi063.stderr: -22> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -21> 2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -20> 2024-09-12T17:46:28.284+0000 7fa348f20800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -19> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -18> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -17> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -16> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -15> 2024-09-12T17:46:28.284+0000 7fa348f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -14> 2024-09-12T17:46:28.285+0000 7fa348f20800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -13> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -12> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -11> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -10> 2024-09-12T17:46:28.293+0000 7fa348f20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:46:28.433 INFO:tasks.workunit.client.0.smithi063.stderr: -9> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 93884154809872 notifier 7880 bl.length()=911 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -8> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -7> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -6> 2024-09-12T17:46:28.293+0000 7fa21bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -5> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -4> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -3> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -2> 2024-09-12T17:46:28.293+0000 7fa348f20800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: -1> 2024-09-12T17:46:28.299+0000 7fa348f20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa348f20800 time 2024-09-12T17:46:28.300773+0000 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa34a78c71a] 2024-09-12T17:46:28.434 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 5: main() 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 7: __libc_start_main() 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 8: _start() 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 0> 2024-09-12T17:46:28.300+0000 7fa348f20800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: in thread 7fa348f20800 thread_name:radosgw-admin 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa34943e6f0] 2024-09-12T17:46:28.435 INFO:tasks.workunit.client.0.smithi063.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa34948b99c] 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 3: raise() 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 4: abort() 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa34a78c774] 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa34a78c8d8] 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563190af841] 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5563190bf57a] 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 9: main() 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa349429590] 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 11: __libc_start_main() 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 12: _start() 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:28.436 INFO:tasks.workunit.client.0.smithi063.stderr:--- logging levels --- 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 none 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 lockdep 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 context 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 crush 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_balancer 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_locker 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_log_expire 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mds_migrator 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 3/ 5 mds_quiesce 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 buffer 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 timer 2024-09-12T17:46:28.437 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 filer 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 striper 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 1 objecter 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rados 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_mirror 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_replay 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 rbd_pwl 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 journaler 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objectcacher 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 client 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 osd 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 optracker 2024-09-12T17:46:28.438 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 objclass 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 filestore 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 journal 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 ms 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mon 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 0/10 monc 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 paxos 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 tp 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 auth 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 crypto 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 finisher 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 reserver 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 heartbeatmap 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 perfcounter 2024-09-12T17:46:28.439 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_sync 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_datacache 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_access 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_flight 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 20/20 rgw_notification 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 javaclient 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 asok 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 1 throttle 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 0 refs 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 compressor 2024-09-12T17:46:28.440 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluestore 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 bluefs 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 3 bdev 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 kstore 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 4/ 5 rocksdb 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 fuse 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 2/ 5 mgr 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mgrc 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 dpdk 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 eventtrace 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 prioritycache 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 test 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cephsqlite 2024-09-12T17:46:28.441 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_onode 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_odata 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_omap 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_tm 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_t 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_epm 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_lba 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_cache 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_journal 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_device 2024-09-12T17:46:28.442 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 seastore_backref 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 alienstore 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 mclock 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 cyanstore 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 ceph_exporter 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 memstore 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 1/ 5 trace 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 0/ 5 ceph_dedup 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: -2/-2 (syslog threshold) 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 99/99 (stderr threshold) 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa1f3fff640 / http_manager 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa1fa7e4640 / http_manager 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa1fb7e6640 / rgw_dt_lg_renew 2024-09-12T17:46:28.443 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa21a7fc640 / ms_dispatch 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa21bfff640 / io_context_pool 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa22a7fc640 / ms_dispatch 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa231602640 / ms_dispatch 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa232e05640 / io_context_pool 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa33ffff640 / msgr-worker-2 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa344c68640 / msgr-worker-1 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa345469640 / msgr-worker-0 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa345c6a640 / io_context_pool 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: 7fa348f20800 / radosgw-admin 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: max_recent 500 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: max_new 1000 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:46:28.302228Z_1676cd94-d04c-495e-813c-a60a285d4ee4/log 2024-09-12T17:46:28.444 INFO:tasks.workunit.client.0.smithi063.stderr:--- end dump of recent events --- 2024-09-12T17:46:28.445 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:46:28.449 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.378+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 20 realm 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.380+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.381+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.381+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.381+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.381+0000 7f401ed2e800 20 searching for the correct realm 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.385+0000 7f401a2dc640 0 -- 172.21.15.63:0/1575876701 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f4010065b10 msgr2=0x7f401007b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.388+0000 7f401aadd640 0 -- 172.21.15.63:0/1575876701 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f401409a040 msgr2=0x7f4014065040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.392+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 zone default found 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 4 Realm: () 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 zonegroup default 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.393+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.394+0000 7f401ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.394+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.394+0000 7f401ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.394+0000 7f401ed2e800 20 started sync module instance, tier type = 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.394+0000 7f401ed2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.402+0000 7f401ed2e800 20 add_watcher() i=0 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.402+0000 7f401ed2e800 20 add_watcher() i=1 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.402+0000 7f401ed2e800 20 add_watcher() i=2 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.402+0000 7f401ed2e800 20 add_watcher() i=3 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.402+0000 7f401ed2e800 20 add_watcher() i=4 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.402+0000 7f401ed2e800 20 add_watcher() i=5 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.403+0000 7f401ed2e800 20 add_watcher() i=6 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.403+0000 7f401ed2e800 20 add_watcher() i=7 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.403+0000 7f401ed2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:28.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.405+0000 7f3ed17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.405+0000 7f401ed2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.405+0000 7f401ed2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.405+0000 7f401ed2e800 5 note: GC not initialized 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.406+0000 7f3e4bfff640 20 reqs_thread_entry: start 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.406+0000 7f401ed2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.406+0000 7f401ed2e800 20 Filter name: none 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.406+0000 7f3e49ffb640 20 reqs_thread_entry: start 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.406+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.406+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.406+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.407+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:28.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.407+0000 7f401ed2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.407+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.407+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.407+0000 7f401ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.407+0000 7f401ed2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.407+0000 7f401ed2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.409+0000 7f3ed17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.412+0000 7f401ed2e800 20 remove_watcher() i=0 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.412+0000 7f401ed2e800 2 removed watcher, disabling cache 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.413+0000 7f401ed2e800 20 remove_watcher() i=1 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.414+0000 7f401ed2e800 20 remove_watcher() i=2 2024-09-12T17:46:28.455 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.415+0000 7f401ed2e800 20 remove_watcher() i=3 2024-09-12T17:46:28.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.416+0000 7f401ed2e800 20 remove_watcher() i=4 2024-09-12T17:46:28.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.417+0000 7f401ed2e800 20 remove_watcher() i=5 2024-09-12T17:46:28.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.417+0000 7f401ed2e800 20 remove_watcher() i=6 2024-09-12T17:46:28.456 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.418+0000 7f401ed2e800 20 remove_watcher() i=7 2024-09-12T17:46:28.456 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:46:28.472 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:28.473 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:28.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.509+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 20 realm 2024-09-12T17:46:28.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:28.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.511+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.512+0000 7fb8e122f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.512+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.512+0000 7fb8e122f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:28.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.512+0000 7fb8e122f800 20 searching for the correct realm 2024-09-12T17:46:28.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.515+0000 7fb8dbd8a640 0 -- 172.21.15.63:0/22240023 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x56197d481430 msgr2=0x56197d4838f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:28.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.518+0000 7fb8dc58b640 0 -- 172.21.15.63:0/22240023 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fb8d402a040 msgr2=0x7fb8d4037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:28.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:28.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:28.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:28.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:28.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:28.726 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:28.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.724+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 zone default found 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 4 Realm: () 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:28.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 zonegroup default 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.725+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.726+0000 7fb8e122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.726+0000 7fb8e122f800 20 started sync module instance, tier type = 2024-09-12T17:46:28.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.726+0000 7fb8e122f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:28.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.734+0000 7fb8e122f800 20 add_watcher() i=0 2024-09-12T17:46:28.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.734+0000 7fb8e122f800 20 add_watcher() i=1 2024-09-12T17:46:28.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.734+0000 7fb8e122f800 20 add_watcher() i=2 2024-09-12T17:46:28.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.734+0000 7fb8e122f800 20 add_watcher() i=3 2024-09-12T17:46:28.736 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.734+0000 7fb8e122f800 20 add_watcher() i=4 2024-09-12T17:46:28.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.734+0000 7fb8e122f800 20 add_watcher() i=5 2024-09-12T17:46:28.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.734+0000 7fb8e122f800 20 add_watcher() i=6 2024-09-12T17:46:28.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.735+0000 7fb8e122f800 20 add_watcher() i=7 2024-09-12T17:46:28.737 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.735+0000 7fb8e122f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:28.738 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.737+0000 7fb792fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:28.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.737+0000 7fb8e122f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:28.739 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.737+0000 7fb8e122f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:28.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.737+0000 7fb8e122f800 5 note: GC not initialized 2024-09-12T17:46:28.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.737+0000 7fb791fdb640 20 reqs_thread_entry: start 2024-09-12T17:46:28.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.737+0000 7fb8e122f800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:28.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 20 Filter name: none 2024-09-12T17:46:28.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb7037fe640 20 reqs_thread_entry: start 2024-09-12T17:46:28.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:28.740 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:28.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:28.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:28.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:46:28.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:28.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:28.741 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.738+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.739+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.739+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.739+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:46:28.742 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.739+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.740+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.740+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.740+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.740+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.741+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.741+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.741+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:46:28.743 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.741+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:46:28.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.741+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:46:28.744 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.741+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.742+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.742+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.742+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.742+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.742+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.742+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.743+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.743+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.743+0000 7fb8e122f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:46:28.745 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.743+0000 7fb8e122f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:46:28.746 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.744+0000 7fb792fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:28.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.746+0000 7fb8e122f800 20 remove_watcher() i=0 2024-09-12T17:46:28.748 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.746+0000 7fb8e122f800 2 removed watcher, disabling cache 2024-09-12T17:46:28.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.747+0000 7fb8e122f800 20 remove_watcher() i=1 2024-09-12T17:46:28.750 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.748+0000 7fb8e122f800 20 remove_watcher() i=2 2024-09-12T17:46:28.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.749+0000 7fb8e122f800 20 remove_watcher() i=3 2024-09-12T17:46:28.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.750+0000 7fb8e122f800 20 remove_watcher() i=4 2024-09-12T17:46:28.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.751+0000 7fb8e122f800 20 remove_watcher() i=5 2024-09-12T17:46:28.754 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.752+0000 7fb8e122f800 20 remove_watcher() i=6 2024-09-12T17:46:28.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:28.753+0000 7fb8e122f800 20 remove_watcher() i=7 2024-09-12T17:46:58.791 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T17:46:58.826 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:58.826 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:58.871 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.870+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 20 realm 2024-09-12T17:46:58.873 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:58.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.872+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.874 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.873+0000 7fb5d2e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:58.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.873+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.873+0000 7fb5d2e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:58.875 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.874+0000 7fb5d2e2f800 20 searching for the correct realm 2024-09-12T17:46:58.878 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:58.877+0000 7fb5d011f640 0 -- 172.21.15.63:0/1658247200 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb5c4040410 msgr2=0x7fb5c4040890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.084 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.083+0000 7fb5d011f640 0 -- 172.21.15.63:0/1658247200 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b4931e2d50 msgr2=0x55b4931e5210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:59.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.089+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 20 zone default found 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 4 Realm: () 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 20 zonegroup default 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.090+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.091+0000 7fb5d2e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.091+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.091+0000 7fb5d2e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.091+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.092+0000 7fb5d2e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.092+0000 7fb5d2e2f800 20 started sync module instance, tier type = 2024-09-12T17:46:59.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.092+0000 7fb5d2e2f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:59.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.102+0000 7fb5d2e2f800 20 add_watcher() i=0 2024-09-12T17:46:59.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.103+0000 7fb5d2e2f800 20 add_watcher() i=1 2024-09-12T17:46:59.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.103+0000 7fb5d2e2f800 20 add_watcher() i=2 2024-09-12T17:46:59.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.103+0000 7fb5d2e2f800 20 add_watcher() i=3 2024-09-12T17:46:59.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.103+0000 7fb5d2e2f800 20 add_watcher() i=4 2024-09-12T17:46:59.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.103+0000 7fb5d2e2f800 20 add_watcher() i=5 2024-09-12T17:46:59.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.103+0000 7fb5d2e2f800 20 add_watcher() i=6 2024-09-12T17:46:59.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.104+0000 7fb5d2e2f800 20 add_watcher() i=7 2024-09-12T17:46:59.104 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.104+0000 7fb5d2e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:59.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.106+0000 7fb4877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.106+0000 7fb5d2e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:59.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.106+0000 7fb5d2e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:59.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.106+0000 7fb5d2e2f800 5 note: GC not initialized 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.106+0000 7fb4867e4640 20 reqs_thread_entry: start 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.106+0000 7fb5d2e2f800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 20 Filter name: none 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb47ffff640 20 reqs_thread_entry: start 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:59.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:59.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:59.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:46:59.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.107+0000 7fb5d2e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.108+0000 7fb5d2e2f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:59.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.108+0000 7fb5d2e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:59.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.108+0000 7fb5d2e2f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:59.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.108+0000 7fb5d2e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:59.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.108+0000 7fb5d2e2f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:59.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.108+0000 7fb5d2e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:46:59.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.113+0000 7fb4877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.115+0000 7fb5d2e2f800 20 remove_watcher() i=0 2024-09-12T17:46:59.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.115+0000 7fb5d2e2f800 2 removed watcher, disabling cache 2024-09-12T17:46:59.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.116+0000 7fb5d2e2f800 20 remove_watcher() i=1 2024-09-12T17:46:59.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.118+0000 7fb5d2e2f800 20 remove_watcher() i=2 2024-09-12T17:46:59.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.119+0000 7fb5d2e2f800 20 remove_watcher() i=3 2024-09-12T17:46:59.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.120+0000 7fb5d2e2f800 20 remove_watcher() i=4 2024-09-12T17:46:59.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.122+0000 7fb5d2e2f800 20 remove_watcher() i=5 2024-09-12T17:46:59.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.123+0000 7fb5d2e2f800 20 remove_watcher() i=6 2024-09-12T17:46:59.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.124+0000 7fb5d2e2f800 20 remove_watcher() i=7 2024-09-12T17:46:59.140 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:46:59.172 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:59.172 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:59.213 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.212+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.214+0000 7f2e31d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.214+0000 7f2e31d22800 20 realm 2024-09-12T17:46:59.215 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.214+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.214+0000 7f2e31d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.214+0000 7f2e31d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:59.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.214+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.215+0000 7f2e31d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.216 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.215+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.215+0000 7f2e31d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.215+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.216+0000 7f2e31d22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:59.217 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.216+0000 7f2e31d22800 20 searching for the correct realm 2024-09-12T17:46:59.220 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.219+0000 7f2e2d101640 0 -- 172.21.15.63:0/304951455 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f2e2402f000 msgr2=0x7f2e240a0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.427 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.426+0000 7f2e2e103640 0 -- 172.21.15.63:0/304951455 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561583984ab0 msgr2=0x561583986f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:59.432 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.431+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.434 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 zone default found 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 4 Realm: () 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 zonegroup default 2024-09-12T17:46:59.435 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.432+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.433+0000 7f2e31d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.433+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.433+0000 7f2e31d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.433+0000 7f2e31d22800 20 started sync module instance, tier type = 2024-09-12T17:46:59.436 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.433+0000 7f2e31d22800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:59.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.442+0000 7f2e31d22800 20 add_watcher() i=0 2024-09-12T17:46:59.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.442+0000 7f2e31d22800 20 add_watcher() i=1 2024-09-12T17:46:59.443 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.442+0000 7f2e31d22800 20 add_watcher() i=2 2024-09-12T17:46:59.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.442+0000 7f2e31d22800 20 add_watcher() i=3 2024-09-12T17:46:59.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.442+0000 7f2e31d22800 20 add_watcher() i=4 2024-09-12T17:46:59.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.442+0000 7f2e31d22800 20 add_watcher() i=5 2024-09-12T17:46:59.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.443+0000 7f2e31d22800 20 add_watcher() i=6 2024-09-12T17:46:59.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.444+0000 7f2e31d22800 20 add_watcher() i=7 2024-09-12T17:46:59.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.444+0000 7f2e31d22800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:59.446 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.445+0000 7f2cdf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2e31d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2e31d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2e31d22800 5 note: GC not initialized 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2cde7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2e31d22800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2e31d22800 20 Filter name: none 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2c4ffff640 20 reqs_thread_entry: start 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2e31d22800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:59.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.446+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:59.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:59.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:59.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:46:59.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:46:59.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.447+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.448+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.448+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.448+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.448+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.449+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.449+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.449+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:46:59.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.449+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.449+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.450+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.450+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.450+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.450+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.450+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.451+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:46:59.452 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.451+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.451+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.451+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.451+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.451+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.452+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.452+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.452+0000 7f2e31d22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:46:59.453 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.452+0000 7f2e31d22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:46:59.454 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.453+0000 7f2cdf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.456+0000 7f2e31d22800 20 remove_watcher() i=0 2024-09-12T17:46:59.457 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.456+0000 7f2e31d22800 2 removed watcher, disabling cache 2024-09-12T17:46:59.458 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.457+0000 7f2e31d22800 20 remove_watcher() i=1 2024-09-12T17:46:59.459 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.458+0000 7f2e31d22800 20 remove_watcher() i=2 2024-09-12T17:46:59.460 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.459+0000 7f2e31d22800 20 remove_watcher() i=3 2024-09-12T17:46:59.461 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.461+0000 7f2e31d22800 20 remove_watcher() i=4 2024-09-12T17:46:59.462 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.462+0000 7f2e31d22800 20 remove_watcher() i=5 2024-09-12T17:46:59.464 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.463+0000 7f2e31d22800 20 remove_watcher() i=6 2024-09-12T17:46:59.465 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.464+0000 7f2e31d22800 20 remove_watcher() i=7 2024-09-12T17:46:59.476 INFO:tasks.workunit.client.0.smithi063.stderr:check reshard logrecord successfully 2024-09-12T17:46:59.476 INFO:tasks.workunit.client.0.smithi063.stderr: test: reshard versioned bucket 2024-09-12T17:46:59.478 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:46:59.508 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:59.508 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:59.548 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.547+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 20 realm 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.549+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.550+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.551 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.550+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.550+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:59.552 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.550+0000 7fd83230c800 20 searching for the correct realm 2024-09-12T17:46:59.554 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.553+0000 7fd82f5f5640 0 -- 172.21.15.63:0/620549321 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fd824064970 msgr2=0x7fd824065410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:59.759 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.758+0000 7fd82f5f5640 0 -- 172.21.15.63:0/620549321 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55aad34e0dc0 msgr2=0x55aad34e3250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:59.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:46:59.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:59.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:46:59.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:59.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:59.764 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.765 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.763+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 zone default found 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 4 Realm: () 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:46:59.766 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 zonegroup default 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.764+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.765+0000 7fd83230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.765+0000 7fd83230c800 20 started sync module instance, tier type = 2024-09-12T17:46:59.767 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.765+0000 7fd83230c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:46:59.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.774+0000 7fd83230c800 20 add_watcher() i=0 2024-09-12T17:46:59.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.774+0000 7fd83230c800 20 add_watcher() i=1 2024-09-12T17:46:59.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.774+0000 7fd83230c800 20 add_watcher() i=2 2024-09-12T17:46:59.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.774+0000 7fd83230c800 20 add_watcher() i=3 2024-09-12T17:46:59.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.774+0000 7fd83230c800 20 add_watcher() i=4 2024-09-12T17:46:59.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.774+0000 7fd83230c800 20 add_watcher() i=5 2024-09-12T17:46:59.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.774+0000 7fd83230c800 20 add_watcher() i=6 2024-09-12T17:46:59.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.776+0000 7fd83230c800 20 add_watcher() i=7 2024-09-12T17:46:59.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.776+0000 7fd83230c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:59.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.778+0000 7fd6e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.778+0000 7fd83230c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:59.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.778+0000 7fd83230c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:59.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.778+0000 7fd83230c800 5 note: GC not initialized 2024-09-12T17:46:59.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.778+0000 7fd6e4fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:59.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.779+0000 7fd83230c800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:59.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.779+0000 7fd83230c800 20 Filter name: none 2024-09-12T17:46:59.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.779+0000 7fd65e7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:59.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.779+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.779+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:46:59.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.780+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.780+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:46:59.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.780+0000 7fd83230c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:59.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.780+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.780+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:46:59.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.780+0000 7fd83230c800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.781+0000 7fd83230c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:46:59.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.781+0000 7fd83230c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:59.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.783+0000 7fd6e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.785+0000 7fd83230c800 20 remove_watcher() i=0 2024-09-12T17:46:59.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.785+0000 7fd83230c800 2 removed watcher, disabling cache 2024-09-12T17:46:59.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.786+0000 7fd83230c800 20 remove_watcher() i=1 2024-09-12T17:46:59.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.787+0000 7fd83230c800 20 remove_watcher() i=2 2024-09-12T17:46:59.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.788+0000 7fd83230c800 20 remove_watcher() i=3 2024-09-12T17:46:59.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.789+0000 7fd83230c800 20 remove_watcher() i=4 2024-09-12T17:46:59.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.790+0000 7fd83230c800 20 remove_watcher() i=5 2024-09-12T17:46:59.792 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.791+0000 7fd83230c800 20 remove_watcher() i=6 2024-09-12T17:46:59.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.792+0000 7fd83230c800 20 remove_watcher() i=7 2024-09-12T17:46:59.804 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:59.804 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:46:59.805 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: myver id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:46:59.805 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:46:59.806 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T17:46:59.838 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:59.838 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:59.877 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.876+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 20 realm 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.879 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.878+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.879+0000 7fb2aaf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.879+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.879+0000 7fb2aaf23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:59.880 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.879+0000 7fb2aaf23800 20 searching for the correct realm 2024-09-12T17:46:59.883 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:46:59.883+0000 7fb2a6412640 0 -- 172.21.15.63:0/1371523862 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb29c001c10 msgr2=0x7fb29c05e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.089+0000 7fb2a6412640 0 -- 172.21.15.63:0/1371523862 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56191f39aed0 msgr2=0x56191f39d360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.093+0000 7fb2aaf23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:00.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.093+0000 7fb2aaf23800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:00.094 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.093+0000 7fb2aaf23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:00.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.093+0000 7fb2aaf23800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:00.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.093+0000 7fb2aaf23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:00.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.093+0000 7fb2aaf23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:00.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.093+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.095 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.096 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 zone default found 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 4 Realm: () 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 zonegroup default 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.094+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.095+0000 7fb2aaf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.095+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.095+0000 7fb2aaf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.095+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.095+0000 7fb2aaf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.097 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.095+0000 7fb2aaf23800 20 started sync module instance, tier type = 2024-09-12T17:47:00.098 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.095+0000 7fb2aaf23800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:00.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.105+0000 7fb2aaf23800 20 add_watcher() i=0 2024-09-12T17:47:00.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.105+0000 7fb2aaf23800 20 add_watcher() i=1 2024-09-12T17:47:00.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.105+0000 7fb2aaf23800 20 add_watcher() i=2 2024-09-12T17:47:00.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.105+0000 7fb2aaf23800 20 add_watcher() i=3 2024-09-12T17:47:00.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.105+0000 7fb2aaf23800 20 add_watcher() i=4 2024-09-12T17:47:00.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.105+0000 7fb2aaf23800 20 add_watcher() i=5 2024-09-12T17:47:00.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.105+0000 7fb2aaf23800 20 add_watcher() i=6 2024-09-12T17:47:00.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.106+0000 7fb2aaf23800 20 add_watcher() i=7 2024-09-12T17:47:00.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.106+0000 7fb2aaf23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:00.109 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.108+0000 7fb15d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.108+0000 7fb2aaf23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.108+0000 7fb2aaf23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.108+0000 7fb2aaf23800 5 note: GC not initialized 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.108+0000 7fb0d7fff640 20 reqs_thread_entry: start 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.108+0000 7fb2aaf23800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 20 Filter name: none 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb0d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:47:00.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : miss 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.109+0000 7fb2aaf23800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.110+0000 7fb2aaf23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.110+0000 7fb2aaf23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.110+0000 7fb2aaf23800 10 adding default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:00.111 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.110+0000 7fb2aaf23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:00.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.110+0000 7fb2aaf23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:00.112 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.110+0000 7fb2aaf23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:00.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb189ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431663 cookie 94665898054080 notifier 7985 bl.length()=905 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb189ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb189ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb189ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:00.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:00.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:00.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:00.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.116+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.0 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.0 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.1 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.1 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.2 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.2 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.3 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.3 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.4 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.4 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.5 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.5 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.6 2024-09-12T17:47:00.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.6 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.7 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.7 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.8 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.8 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.9 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.9 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.10 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.10 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.11 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.11 2024-09-12T17:47:00.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.0 2024-09-12T17:47:00.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.122+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1 2024-09-12T17:47:00.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.123+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2 2024-09-12T17:47:00.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.123+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3 2024-09-12T17:47:00.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.123+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.4 2024-09-12T17:47:00.125 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.124+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.5 2024-09-12T17:47:00.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.124+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.6 2024-09-12T17:47:00.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.125+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.7 2024-09-12T17:47:00.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.125+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.8 2024-09-12T17:47:00.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.126+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.9 2024-09-12T17:47:00.127 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.127+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.10 2024-09-12T17:47:00.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.127+0000 7fb2aaf23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:00.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.127+0000 7fb2aaf23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:00.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb2aaf23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:00.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb2aaf23800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:00.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb2aaf23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:00.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb2aaf23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:00.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb18a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431664 cookie 94665898054080 notifier 7985 bl.length()=905 2024-09-12T17:47:00.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb18a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:00.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb18a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:00.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.129+0000 7fb18a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:00.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.130+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:00.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.130+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:00.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.130+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:00.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.130+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:00.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.132+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.0 2024-09-12T17:47:00.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.132+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1 2024-09-12T17:47:00.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.133+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2 2024-09-12T17:47:00.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.133+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3 2024-09-12T17:47:00.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.133+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.4 2024-09-12T17:47:00.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.134+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.5 2024-09-12T17:47:00.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.134+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.6 2024-09-12T17:47:00.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.134+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.7 2024-09-12T17:47:00.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.135+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.8 2024-09-12T17:47:00.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.135+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.9 2024-09-12T17:47:00.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.135+0000 7fb2aaf23800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.10 2024-09-12T17:47:00.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.136+0000 7fb2aaf23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:00.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.136+0000 7fb2aaf23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:00.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb2aaf23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:00.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb2aaf23800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:00.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb2aaf23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:00.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb2aaf23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:00.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb18a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431665 cookie 94665898054080 notifier 7985 bl.length()=873 2024-09-12T17:47:00.138 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb18a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:00.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb18a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:00.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.137+0000 7fb18a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:00.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.138+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:00.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.138+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:00.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.138+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:00.139 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.138+0000 7fb2aaf23800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:00.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.140+0000 7fb2aaf23800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T17:47:00.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.142+0000 7fb15d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.144+0000 7fb2aaf23800 20 remove_watcher() i=0 2024-09-12T17:47:00.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.144+0000 7fb2aaf23800 2 removed watcher, disabling cache 2024-09-12T17:47:00.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.145+0000 7fb2aaf23800 20 remove_watcher() i=1 2024-09-12T17:47:00.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.146+0000 7fb2aaf23800 20 remove_watcher() i=2 2024-09-12T17:47:00.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.147+0000 7fb2aaf23800 20 remove_watcher() i=3 2024-09-12T17:47:00.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.148+0000 7fb2aaf23800 20 remove_watcher() i=4 2024-09-12T17:47:00.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.149+0000 7fb2aaf23800 20 remove_watcher() i=5 2024-09-12T17:47:00.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.150+0000 7fb2aaf23800 20 remove_watcher() i=6 2024-09-12T17:47:00.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.151+0000 7fb2aaf23800 20 remove_watcher() i=7 2024-09-12T17:47:00.164 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:47:00.193 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:00.193 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:00.232 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.231+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 20 realm 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.234+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.235+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.235+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.235+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:00.236 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.235+0000 7f411a820800 20 searching for the correct realm 2024-09-12T17:47:00.238 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.237+0000 7f4118311640 0 -- 172.21.15.63:0/1152930564 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f410806a070 msgr2=0x7f41080095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:00.444 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.443+0000 7f4118311640 0 -- 172.21.15.63:0/1152930564 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f4104003ab0 msgr2=0x7f41100638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.652 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.653 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.651+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 20 zone default found 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 4 Realm: () 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 20 zonegroup default 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.652+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.653+0000 7f411a820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.654 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.653+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.653+0000 7f411a820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.653+0000 7f411a820800 20 started sync module instance, tier type = 2024-09-12T17:47:00.655 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.653+0000 7f411a820800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:00.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.663+0000 7f411a820800 20 add_watcher() i=0 2024-09-12T17:47:00.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.663+0000 7f411a820800 20 add_watcher() i=1 2024-09-12T17:47:00.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.663+0000 7f411a820800 20 add_watcher() i=2 2024-09-12T17:47:00.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.663+0000 7f411a820800 20 add_watcher() i=3 2024-09-12T17:47:00.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.663+0000 7f411a820800 20 add_watcher() i=4 2024-09-12T17:47:00.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.663+0000 7f411a820800 20 add_watcher() i=5 2024-09-12T17:47:00.664 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.663+0000 7f411a820800 20 add_watcher() i=6 2024-09-12T17:47:00.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.664+0000 7f411a820800 20 add_watcher() i=7 2024-09-12T17:47:00.665 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.664+0000 7f411a820800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:00.667 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.666+0000 7f3fcefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.667+0000 7f411a820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:00.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.667+0000 7f411a820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:00.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.667+0000 7f411a820800 5 note: GC not initialized 2024-09-12T17:47:00.668 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.667+0000 7f3fcdfdb640 20 reqs_thread_entry: start 2024-09-12T17:47:00.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.667+0000 7f411a820800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:00.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.667+0000 7f411a820800 20 Filter name: none 2024-09-12T17:47:00.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.667+0000 7f3f3f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:00.669 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.668+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.668+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.668+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.668+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.668+0000 7f411a820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.669+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.669+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.669+0000 7f411a820800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.669+0000 7f411a820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:00.670 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.669+0000 7f411a820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:00.672 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.671+0000 7f3fcefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.673+0000 7f411a820800 20 remove_watcher() i=0 2024-09-12T17:47:00.674 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.673+0000 7f411a820800 2 removed watcher, disabling cache 2024-09-12T17:47:00.675 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.674+0000 7f411a820800 20 remove_watcher() i=1 2024-09-12T17:47:00.676 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.676+0000 7f411a820800 20 remove_watcher() i=2 2024-09-12T17:47:00.678 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.677+0000 7f411a820800 20 remove_watcher() i=3 2024-09-12T17:47:00.679 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.678+0000 7f411a820800 20 remove_watcher() i=4 2024-09-12T17:47:00.680 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.679+0000 7f411a820800 20 remove_watcher() i=5 2024-09-12T17:47:00.681 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.680+0000 7f411a820800 20 remove_watcher() i=6 2024-09-12T17:47:00.682 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.681+0000 7f411a820800 20 remove_watcher() i=7 2024-09-12T17:47:00.693 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:47:00.693 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:47:00.693 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: myver id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:47:00.693 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:47:00.741 INFO:tasks.workunit.client.0.smithi063.stderr: test: reshard removes olh entries with empty name 2024-09-12T17:47:00.835 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:47:00.864 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:00.864 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:00.902 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.902+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.903+0000 7fa2a2b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.903+0000 7fa2a2b3d800 20 realm 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.903+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.904+0000 7fa2a2b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.904+0000 7fa2a2b3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.904+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.904+0000 7fa2a2b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.905 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.904+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.905+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.905+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.905+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:00.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.905+0000 7fa2a2b3d800 20 searching for the correct realm 2024-09-12T17:47:00.909 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.908+0000 7fa29e029640 0 -- 172.21.15.63:0/3825047710 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fa2940dd7f0 msgr2=0x7fa2940a57e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.912+0000 7fa29f02b640 0 -- 172.21.15.63:0/3825047710 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5608a63afa40 msgr2=0x5608a63b1e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.917 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.916+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 zone default found 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 4 Realm: () 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 zonegroup default 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.919 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 started sync module instance, tier type = 2024-09-12T17:47:00.920 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.917+0000 7fa2a2b3d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:00.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=0 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=1 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=2 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=3 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=4 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=5 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=6 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 20 add_watcher() i=7 2024-09-12T17:47:00.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.926+0000 7fa2a2b3d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:00.929 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.928+0000 7fa1557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.928+0000 7fa2a2b3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.928+0000 7fa2a2b3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa2a2b3d800 5 note: GC not initialized 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa0cffff640 20 reqs_thread_entry: start 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa2a2b3d800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa2a2b3d800 20 Filter name: none 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa0cdffb640 20 reqs_thread_entry: start 2024-09-12T17:47:00.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:00.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.929+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.931 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.930+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:00.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.930+0000 7fa2a2b3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:00.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.930+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.930+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:00.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.930+0000 7fa2a2b3d800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.931+0000 7fa2a2b3d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:00.932 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.931+0000 7fa2a2b3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:00.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.933+0000 7fa1557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.935+0000 7fa2a2b3d800 20 remove_watcher() i=0 2024-09-12T17:47:00.936 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.935+0000 7fa2a2b3d800 2 removed watcher, disabling cache 2024-09-12T17:47:00.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.936+0000 7fa2a2b3d800 20 remove_watcher() i=1 2024-09-12T17:47:00.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.937+0000 7fa2a2b3d800 20 remove_watcher() i=2 2024-09-12T17:47:00.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.938+0000 7fa2a2b3d800 20 remove_watcher() i=3 2024-09-12T17:47:00.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.939+0000 7fa2a2b3d800 20 remove_watcher() i=4 2024-09-12T17:47:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.940+0000 7fa2a2b3d800 20 remove_watcher() i=5 2024-09-12T17:47:00.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.941+0000 7fa2a2b3d800 20 remove_watcher() i=6 2024-09-12T17:47:00.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:00.942+0000 7fa2a2b3d800 20 remove_watcher() i=7 2024-09-12T17:47:00.953 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:47:00.954 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:47:00.954 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: a-bucket id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T17:47:00.954 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:47:00.955 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T17:47:00.984 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:00.984 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:01.023 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.022+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 20 realm 2024-09-12T17:47:01.025 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:01.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.026 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.024+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.025+0000 7ffb4752b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.025+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.027 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.025+0000 7ffb4752b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:01.028 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.025+0000 7ffb4752b800 20 searching for the correct realm 2024-09-12T17:47:01.029 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.028+0000 7ffb42a72640 0 -- 172.21.15.63:0/3697238004 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7ffb38070550 msgr2=0x7ffb380b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.235 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.234+0000 7ffb43a74640 0 -- 172.21.15.63:0/3697238004 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561f7ae81250 msgr2=0x561f7ae83670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:01.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:01.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:01.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:01.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:01.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:01.239 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.240 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.238+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 zone default found 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 4 Realm: () 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 zonegroup default 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.241 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.239+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.240+0000 7ffb4752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.240+0000 7ffb4752b800 20 started sync module instance, tier type = 2024-09-12T17:47:01.242 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.240+0000 7ffb4752b800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:01.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.248+0000 7ffb4752b800 20 add_watcher() i=0 2024-09-12T17:47:01.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.248+0000 7ffb4752b800 20 add_watcher() i=1 2024-09-12T17:47:01.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.248+0000 7ffb4752b800 20 add_watcher() i=2 2024-09-12T17:47:01.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.248+0000 7ffb4752b800 20 add_watcher() i=3 2024-09-12T17:47:01.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.248+0000 7ffb4752b800 20 add_watcher() i=4 2024-09-12T17:47:01.249 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.248+0000 7ffb4752b800 20 add_watcher() i=5 2024-09-12T17:47:01.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.248+0000 7ffb4752b800 20 add_watcher() i=6 2024-09-12T17:47:01.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.249+0000 7ffb4752b800 20 add_watcher() i=7 2024-09-12T17:47:01.250 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.249+0000 7ffb4752b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:01.252 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.251+0000 7ff9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.251+0000 7ffb4752b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.251+0000 7ffb4752b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.251+0000 7ffb4752b800 5 note: GC not initialized 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.252+0000 7ff9f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.252+0000 7ffb4752b800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.252+0000 7ffb4752b800 20 Filter name: none 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.252+0000 7ff9727fc640 20 reqs_thread_entry: start 2024-09-12T17:47:01.253 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.252+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.252+0000 7ffb4752b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:01.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.252+0000 7ffb4752b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.253+0000 7ffb4752b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:01.254 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.253+0000 7ffb4752b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:01.255 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.254+0000 7ff9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.256+0000 7ffb4752b800 20 remove_watcher() i=0 2024-09-12T17:47:01.257 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.256+0000 7ffb4752b800 2 removed watcher, disabling cache 2024-09-12T17:47:01.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.257+0000 7ffb4752b800 20 remove_watcher() i=1 2024-09-12T17:47:01.258 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.258+0000 7ffb4752b800 20 remove_watcher() i=2 2024-09-12T17:47:01.260 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.259+0000 7ffb4752b800 20 remove_watcher() i=3 2024-09-12T17:47:01.261 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.260+0000 7ffb4752b800 20 remove_watcher() i=4 2024-09-12T17:47:01.262 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.261+0000 7ffb4752b800 20 remove_watcher() i=5 2024-09-12T17:47:01.263 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.262+0000 7ffb4752b800 20 remove_watcher() i=6 2024-09-12T17:47:01.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.263+0000 7ffb4752b800 20 remove_watcher() i=7 2024-09-12T17:47:01.276 INFO:tasks.workunit.client.0.smithi063.stderr:rados -p default.rgw.buckets.index setomapval .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T17:47:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:01.302 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:01.320 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:47:01.349 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:01.349 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:01.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.387+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.388+0000 7f8444b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.388+0000 7f8444b26800 20 realm 2024-09-12T17:47:01.389 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.388+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.389+0000 7f8444b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.389+0000 7f8444b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:01.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.389+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.389+0000 7f8444b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.389+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.390+0000 7f8444b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.390+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.390+0000 7f8444b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:01.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.390+0000 7f8444b26800 20 searching for the correct realm 2024-09-12T17:47:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.394+0000 7f843ff08640 0 -- 172.21.15.63:0/4245569075 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f8434057b20 msgr2=0x7f84340d2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.601 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.600+0000 7f8440f0a640 0 -- 172.21.15.63:0/4245569075 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55ac0f4eda30 msgr2=0x55ac0f4efe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.604+0000 7f8444b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:01.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.604+0000 7f8444b26800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:01.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.604+0000 7f8444b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:01.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.604+0000 7f8444b26800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:01.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.604+0000 7f8444b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:01.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.604+0000 7f8444b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:01.605 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.604+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.802+0000 7f8444b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.803 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.802+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.804 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 20 zone default found 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 4 Realm: () 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 20 zonegroup default 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.803+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.804+0000 7f8444b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.805 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.804+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.804+0000 7f8444b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.804+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.804+0000 7f8444b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.804+0000 7f8444b26800 20 started sync module instance, tier type = 2024-09-12T17:47:01.806 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.804+0000 7f8444b26800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.814+0000 7f8444b26800 20 add_watcher() i=0 2024-09-12T17:47:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.814+0000 7f8444b26800 20 add_watcher() i=1 2024-09-12T17:47:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.814+0000 7f8444b26800 20 add_watcher() i=2 2024-09-12T17:47:01.815 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.814+0000 7f8444b26800 20 add_watcher() i=3 2024-09-12T17:47:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.814+0000 7f8444b26800 20 add_watcher() i=4 2024-09-12T17:47:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.814+0000 7f8444b26800 20 add_watcher() i=5 2024-09-12T17:47:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.814+0000 7f8444b26800 20 add_watcher() i=6 2024-09-12T17:47:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.815+0000 7f8444b26800 20 add_watcher() i=7 2024-09-12T17:47:01.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.815+0000 7f8444b26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:01.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.817+0000 7f82f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f8444b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:01.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f8444b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:01.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f8444b26800 5 note: GC not initialized 2024-09-12T17:47:01.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f82f5fdb640 20 reqs_thread_entry: start 2024-09-12T17:47:01.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f8444b26800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:01.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f8444b26800 20 Filter name: none 2024-09-12T17:47:01.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f82677fe640 20 reqs_thread_entry: start 2024-09-12T17:47:01.820 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.818+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 20 INFO: main: starting shard=0 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.819+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.820+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.820+0000 7f8444b26800 20 INFO: main: starting shard=1 2024-09-12T17:47:01.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.820+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:47:01.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.820+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:47:01.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 INFO: main: starting shard=2 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 INFO: main: starting shard=3 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 INFO: main: starting shard=4 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:47:01.823 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.821+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:47:01.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 20 INFO: main: starting shard=5 2024-09-12T17:47:01.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:47:01.824 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 20 INFO: main: starting shard=6 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.822+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 20 INFO: main: starting shard=7 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 20 INFO: main: starting shard=8 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:47:01.825 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.823+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:47:01.826 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 20 INFO: main: starting shard=9 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 20 INFO: main: starting shard=10 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.824+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.825+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.825+0000 7f8444b26800 20 INFO: main: starting shard=11 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.825+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.825+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.825+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.825+0000 7f8444b26800 20 INFO: main: starting shard=12 2024-09-12T17:47:01.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.826+0000 7f8444b26800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:47:01.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.826+0000 7f8444b26800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:47:01.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.826+0000 7f8444b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:01.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.826+0000 7f8444b26800 20 INFO: main: done 2024-09-12T17:47:01.828 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.827+0000 7f82f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.829+0000 7f8444b26800 20 remove_watcher() i=0 2024-09-12T17:47:01.830 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.829+0000 7f8444b26800 2 removed watcher, disabling cache 2024-09-12T17:47:01.831 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.830+0000 7f8444b26800 20 remove_watcher() i=1 2024-09-12T17:47:01.832 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.831+0000 7f8444b26800 20 remove_watcher() i=2 2024-09-12T17:47:01.833 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.832+0000 7f8444b26800 20 remove_watcher() i=3 2024-09-12T17:47:01.834 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.833+0000 7f8444b26800 20 remove_watcher() i=4 2024-09-12T17:47:01.835 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.834+0000 7f8444b26800 20 remove_watcher() i=5 2024-09-12T17:47:01.836 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.835+0000 7f8444b26800 20 remove_watcher() i=6 2024-09-12T17:47:01.837 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.836+0000 7f8444b26800 20 remove_watcher() i=7 2024-09-12T17:47:01.849 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T17:47:01.883 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:01.883 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:01.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.921+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 20 realm 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.923+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.924+0000 7f86bc52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.924+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.924+0000 7f86bc52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:01.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.924+0000 7f86bc52c800 20 searching for the correct realm 2024-09-12T17:47:01.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:01.927+0000 7f86b7ad9640 0 -- 172.21.15.63:0/1057743772 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f86ac00d3c0 msgr2=0x7f86ac00d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:02.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.133+0000 7f86b8adb640 0 -- 172.21.15.63:0/1057743772 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55f06f426c30 msgr2=0x55f06f429020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:02.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.137+0000 7f86bc52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:02.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.137+0000 7f86bc52c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:02.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.137+0000 7f86bc52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:02.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.137+0000 7f86bc52c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:02.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.137+0000 7f86bc52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:02.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.137+0000 7f86bc52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:02.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.137+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:02.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:02.143 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 zone default found 2024-09-12T17:47:02.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 4 Realm: () 2024-09-12T17:47:02.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:02.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:02.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:02.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 zonegroup default 2024-09-12T17:47:02.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.138+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.139+0000 7f86bc52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.139+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.139+0000 7f86bc52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.139+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.139+0000 7f86bc52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.139+0000 7f86bc52c800 20 started sync module instance, tier type = 2024-09-12T17:47:02.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.139+0000 7f86bc52c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:02.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.149+0000 7f86bc52c800 20 add_watcher() i=0 2024-09-12T17:47:02.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.149+0000 7f86bc52c800 20 add_watcher() i=1 2024-09-12T17:47:02.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.149+0000 7f86bc52c800 20 add_watcher() i=2 2024-09-12T17:47:02.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.149+0000 7f86bc52c800 20 add_watcher() i=3 2024-09-12T17:47:02.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.149+0000 7f86bc52c800 20 add_watcher() i=4 2024-09-12T17:47:02.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.149+0000 7f86bc52c800 20 add_watcher() i=5 2024-09-12T17:47:02.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.149+0000 7f86bc52c800 20 add_watcher() i=6 2024-09-12T17:47:02.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.150+0000 7f86bc52c800 20 add_watcher() i=7 2024-09-12T17:47:02.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.150+0000 7f86bc52c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.152+0000 7f856efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.152+0000 7f86bc52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.152+0000 7f86bc52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:02.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 5 note: GC not initialized 2024-09-12T17:47:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f856dfdb640 20 reqs_thread_entry: start 2024-09-12T17:47:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 20 Filter name: none 2024-09-12T17:47:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f84df7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:02.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:02.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:02.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:02.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : miss 2024-09-12T17:47:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.153+0000 7f86bc52c800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.154+0000 7f86bc52c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.154+0000 7f86bc52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:47:02.160 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.154+0000 7f86bc52c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:47:02.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.154+0000 7f86bc52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:02.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.154+0000 7f86bc52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.161 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.154+0000 7f86bc52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:47:02.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:47:02.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:47:02.163 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:47:02.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f858effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94491147142864 notifier 8616 bl.length()=911 2024-09-12T17:47:02.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f858effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:47:02.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f858effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:47:02.164 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f858effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:47:02.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:47:02.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:47:02.165 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.158+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:47:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.164+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:47:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.164+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:47:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.164+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:47:02.167 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.164+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:47:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.164+0000 7f86bc52c800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T17:47:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.164+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:47:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.164+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:47:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.165+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:47:02.168 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.165+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:47:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.165+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:47:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.165+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:47:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.165+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:47:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.165+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:47:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.166+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:47:02.169 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.166+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:47:02.171 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.166+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:47:02.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.167+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:47:02.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.167+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:47:02.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.167+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:47:02.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.167+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:47:02.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.167+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:47:02.172 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.168+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:47:02.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.168+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:47:02.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.168+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:47:02.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.168+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:47:02.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.169+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:47:02.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.169+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:47:02.173 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.170+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:47:02.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.170+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:47:02.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.170+0000 7f86bc52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:02.174 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.170+0000 7f86bc52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:47:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.171+0000 7f86bc52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:47:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.171+0000 7f86bc52c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:47:02.176 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.171+0000 7f86bc52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.171+0000 7f86bc52c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:47:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f858f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94491147142864 notifier 8616 bl.length()=911 2024-09-12T17:47:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f858f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:47:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f858f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:47:02.177 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f858f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:47:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:47:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:47:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.172+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:47:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.175+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:47:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.175+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.0 2024-09-12T17:47:02.178 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.175+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:47:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.175+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.1 2024-09-12T17:47:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.175+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:47:02.179 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.175+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.2 2024-09-12T17:47:02.182 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.176+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:47:02.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.176+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.3 2024-09-12T17:47:02.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.176+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:47:02.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.176+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.4 2024-09-12T17:47:02.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.176+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:47:02.183 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.176+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.5 2024-09-12T17:47:02.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.177+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:47:02.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.177+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.6 2024-09-12T17:47:02.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.177+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:47:02.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.177+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.7 2024-09-12T17:47:02.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.177+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:47:02.184 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.177+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.8 2024-09-12T17:47:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.178+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:47:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.178+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.9 2024-09-12T17:47:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.178+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:47:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.178+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.10 2024-09-12T17:47:02.185 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.178+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:47:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.178+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.11 2024-09-12T17:47:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.179+0000 7f86bc52c800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:47:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.179+0000 7f86bc52c800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.2.12 2024-09-12T17:47:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.179+0000 7f86bc52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.179+0000 7f86bc52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 2024-09-12T17:47:02.186 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:47:02.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:47:02.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18, ofs0, ns] 2024-09-12T17:47:02.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f858f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94491147142864 notifier 8616 bl.length()=879 2024-09-12T17:47:02.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f858f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 info.flags=0x17 2024-09-12T17:47:02.187 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f858f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18 to cache LRU end 2024-09-12T17:47:02.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f858f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_sources= new_sources= 2024-09-12T17:47:02.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential sources added=[] removed=[] 2024-09-12T17:47:02.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): orig_dests= new_dests= 2024-09-12T17:47:02.188 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.181+0000 7f86bc52c800 20 handle_bi_update(): bucket=:a-bucket[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18]): potential dests added=[] removed=[] 2024-09-12T17:47:02.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.184+0000 7f86bc52c800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T17:47:02.189 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.186+0000 7f856efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:02.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.188+0000 7f86bc52c800 20 remove_watcher() i=0 2024-09-12T17:47:02.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.188+0000 7f86bc52c800 2 removed watcher, disabling cache 2024-09-12T17:47:02.190 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.189+0000 7f86bc52c800 20 remove_watcher() i=1 2024-09-12T17:47:02.191 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.190+0000 7f86bc52c800 20 remove_watcher() i=2 2024-09-12T17:47:02.192 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.191+0000 7f86bc52c800 20 remove_watcher() i=3 2024-09-12T17:47:02.193 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.192+0000 7f86bc52c800 20 remove_watcher() i=4 2024-09-12T17:47:02.194 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.193+0000 7f86bc52c800 20 remove_watcher() i=5 2024-09-12T17:47:02.195 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.194+0000 7f86bc52c800 20 remove_watcher() i=6 2024-09-12T17:47:02.196 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.196+0000 7f86bc52c800 20 remove_watcher() i=7 2024-09-12T17:47:02.209 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:47:02.238 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:02.238 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:02.277 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.276+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 20 realm 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.278+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.279+0000 7f3e4032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:02.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.279+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.279+0000 7f3e4032e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:02.280 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.279+0000 7f3e4032e800 20 searching for the correct realm 2024-09-12T17:47:02.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.283+0000 7f3e3c8de640 0 -- 172.21.15.63:0/2611917447 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7f3e24018070 msgr2=0x7f3e240823a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:02.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.286+0000 7f3e3c0dd640 0 -- 172.21.15.63:0/2611917447 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f3e3401e040 msgr2=0x7f3e3400e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:02.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.290+0000 7f3e4032e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:02.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.290+0000 7f3e4032e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:02.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.290+0000 7f3e4032e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:02.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.290+0000 7f3e4032e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:02.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.290+0000 7f3e4032e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:02.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.290+0000 7f3e4032e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:02.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.290+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:02.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:02.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 zone default found 2024-09-12T17:47:02.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 4 Realm: () 2024-09-12T17:47:02.293 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 zonegroup default 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.291+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.292+0000 7f3e4032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.292+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.292+0000 7f3e4032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.292+0000 7f3e4032e800 20 started sync module instance, tier type = 2024-09-12T17:47:02.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.292+0000 7f3e4032e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:02.301 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.300+0000 7f3e4032e800 20 add_watcher() i=0 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.300+0000 7f3e4032e800 20 add_watcher() i=1 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.300+0000 7f3e4032e800 20 add_watcher() i=2 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.300+0000 7f3e4032e800 20 add_watcher() i=3 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.300+0000 7f3e4032e800 20 add_watcher() i=4 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.300+0000 7f3e4032e800 20 add_watcher() i=5 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.301+0000 7f3e4032e800 20 add_watcher() i=6 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.301+0000 7f3e4032e800 20 add_watcher() i=7 2024-09-12T17:47:02.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.301+0000 7f3e4032e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.303+0000 7f3cf2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.303+0000 7f3e4032e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.303+0000 7f3e4032e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.303+0000 7f3e4032e800 5 note: GC not initialized 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.303+0000 7f3cf1fdb640 20 reqs_thread_entry: start 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.304+0000 7f3e4032e800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.304+0000 7f3e4032e800 20 Filter name: none 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.304+0000 7f3c637fe640 20 reqs_thread_entry: start 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.304+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.304+0000 7f3e4032e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:02.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.304+0000 7f3e4032e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:02.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:02.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T17:47:02.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 20 INFO: main: starting shard=0 2024-09-12T17:47:02.306 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:47:02.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18.3.0 2024-09-12T17:47:02.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:02.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.305+0000 7f3e4032e800 20 INFO: main: done 2024-09-12T17:47:02.307 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.306+0000 7f3cf2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:02.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.308+0000 7f3e4032e800 20 remove_watcher() i=0 2024-09-12T17:47:02.309 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.308+0000 7f3e4032e800 2 removed watcher, disabling cache 2024-09-12T17:47:02.310 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.309+0000 7f3e4032e800 20 remove_watcher() i=1 2024-09-12T17:47:02.311 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.310+0000 7f3e4032e800 20 remove_watcher() i=2 2024-09-12T17:47:02.312 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.311+0000 7f3e4032e800 20 remove_watcher() i=3 2024-09-12T17:47:02.313 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.312+0000 7f3e4032e800 20 remove_watcher() i=4 2024-09-12T17:47:02.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.313+0000 7f3e4032e800 20 remove_watcher() i=5 2024-09-12T17:47:02.314 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.314+0000 7f3e4032e800 20 remove_watcher() i=6 2024-09-12T17:47:02.316 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.315+0000 7f3e4032e800 20 remove_watcher() i=7 2024-09-12T17:47:02.327 INFO:tasks.workunit.client.0.smithi063.stderr: test: PUT succeeds during reshard 2024-09-12T17:47:02.328 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:47:02.358 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:02.358 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:02.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.396+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.399 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 20 realm 2024-09-12T17:47:02.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:02.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.400 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.398+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.399+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:02.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.399+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.401 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.399+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:02.402 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.399+0000 7ff86e41b800 20 searching for the correct realm 2024-09-12T17:47:02.403 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.402+0000 7ff863fff640 0 -- 172.21.15.63:0/1806345900 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7ff854072490 msgr2=0x7ff85409f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:02.609 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.608+0000 7ff869beb640 0 -- 172.21.15.63:0/1806345900 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7ff864027020 msgr2=0x7ff864064560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:02.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.613+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:02.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 20 zone default found 2024-09-12T17:47:02.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 4 Realm: () 2024-09-12T17:47:02.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:02.615 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 20 zonegroup default 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.614+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.615+0000 7ff86e41b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.615+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.615+0000 7ff86e41b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.615+0000 7ff86e41b800 20 started sync module instance, tier type = 2024-09-12T17:47:02.617 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.615+0000 7ff86e41b800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:02.624 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.624+0000 7ff86e41b800 20 add_watcher() i=0 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.624+0000 7ff86e41b800 20 add_watcher() i=1 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.624+0000 7ff86e41b800 20 add_watcher() i=2 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.624+0000 7ff86e41b800 20 add_watcher() i=3 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.624+0000 7ff86e41b800 20 add_watcher() i=4 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.624+0000 7ff86e41b800 20 add_watcher() i=5 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.624+0000 7ff86e41b800 20 add_watcher() i=6 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.625+0000 7ff86e41b800 20 add_watcher() i=7 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.625+0000 7ff86e41b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:02.627 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.626+0000 7ff71bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff86e41b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff86e41b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff86e41b800 5 note: GC not initialized 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff71affd640 20 reqs_thread_entry: start 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff86e41b800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff86e41b800 20 Filter name: none 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff718ff9640 20 reqs_thread_entry: start 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.627+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.629 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.628+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.628+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.628+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.628+0000 7ff86e41b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.628+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.628+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.628+0000 7ff86e41b800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.629+0000 7ff86e41b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:02.630 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.629+0000 7ff86e41b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:02.631 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.630+0000 7ff71bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:02.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.632+0000 7ff86e41b800 20 remove_watcher() i=0 2024-09-12T17:47:02.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.632+0000 7ff86e41b800 2 removed watcher, disabling cache 2024-09-12T17:47:02.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.633+0000 7ff86e41b800 20 remove_watcher() i=1 2024-09-12T17:47:02.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.635+0000 7ff86e41b800 20 remove_watcher() i=2 2024-09-12T17:47:02.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.636+0000 7ff86e41b800 20 remove_watcher() i=3 2024-09-12T17:47:02.637 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.637+0000 7ff86e41b800 20 remove_watcher() i=4 2024-09-12T17:47:02.638 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.638+0000 7ff86e41b800 20 remove_watcher() i=5 2024-09-12T17:47:02.639 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.639+0000 7ff86e41b800 20 remove_watcher() i=6 2024-09-12T17:47:02.640 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.640+0000 7ff86e41b800 20 remove_watcher() i=7 2024-09-12T17:47:02.652 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:47:02.652 INFO:tasks.workunit.client.0.smithi063.stderr:BUCKET_STATS: 2024-09-12T17:47:02.652 INFO:tasks.workunit.client.0.smithi063.stderr:bucket: myver id: 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:47:02.652 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:47:02.653 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T17:47:02.687 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:02.687 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:02.727 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.726+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 20 realm 2024-09-12T17:47:02.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.728 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:02.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.727+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.728+0000 7faeca42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:02.729 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.728+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.728+0000 7faeca42f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:02.730 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.728+0000 7faeca42f800 20 searching for the correct realm 2024-09-12T17:47:02.732 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.731+0000 7faec7718640 0 -- 172.21.15.63:0/13266107 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7faeb0019450 msgr2=0x7faeb00198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:02.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.937+0000 7faec871a640 0 -- 172.21.15.63:0/13266107 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55f855a2ee20 msgr2=0x55f855a312c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:02.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:02.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:02.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:02.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:02.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.941+0000 7faeca42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 20 zone default found 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 4 Realm: () 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 20 zonegroup default 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.942+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.943+0000 7faeca42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.943+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.943+0000 7faeca42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:02.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.943+0000 7faeca42f800 20 started sync module instance, tier type = 2024-09-12T17:47:02.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.943+0000 7faeca42f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:02.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.951+0000 7faeca42f800 20 add_watcher() i=0 2024-09-12T17:47:02.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.951+0000 7faeca42f800 20 add_watcher() i=1 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.951+0000 7faeca42f800 20 add_watcher() i=2 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.951+0000 7faeca42f800 20 add_watcher() i=3 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.951+0000 7faeca42f800 20 add_watcher() i=4 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.951+0000 7faeca42f800 20 add_watcher() i=5 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.951+0000 7faeca42f800 20 add_watcher() i=6 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.952+0000 7faeca42f800 20 add_watcher() i=7 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.952+0000 7faeca42f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:02.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.954+0000 7fad7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:02.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.954+0000 7faeca42f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:02.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.954+0000 7faeca42f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:02.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.955+0000 7faeca42f800 5 note: GC not initialized 2024-09-12T17:47:02.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.955+0000 7fad7cfe1640 20 reqs_thread_entry: start 2024-09-12T17:47:02.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.955+0000 7faeca42f800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:02.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.955+0000 7faeca42f800 20 Filter name: none 2024-09-12T17:47:02.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.955+0000 7facf67fc640 20 reqs_thread_entry: start 2024-09-12T17:47:02.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.955+0000 7faeca42f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:47:02.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.955+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : miss 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:02.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:02.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 adding default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:02.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:02.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.956+0000 7faeca42f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:02.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.961+0000 7faeca42f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:02.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.961+0000 7faeca42f800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:02.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.961+0000 7faeca42f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.961+0000 7faeca42f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:02.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7fada67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431666 cookie 94525076997376 notifier 8117 bl.length()=905 2024-09-12T17:47:02.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7fada67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:02.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7fada67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:02.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7fada67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:02.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:02.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:02.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:02.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.962+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:02.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:02.966+0000 7faeca42f800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T17:47:03.673 INFO:tasks.workunit.client.0.smithi063.stderr:put object successful 2024-09-12T17:47:07.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:07.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:07.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:07.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.0 2024-09-12T17:47:07.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.967+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.0 2024-09-12T17:47:07.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.968+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.1 2024-09-12T17:47:07.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.968+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.1 2024-09-12T17:47:07.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.969+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.2 2024-09-12T17:47:07.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.969+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.2 2024-09-12T17:47:07.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.970+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.3 2024-09-12T17:47:07.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.970+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.3 2024-09-12T17:47:07.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.970+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.4 2024-09-12T17:47:07.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.970+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.4 2024-09-12T17:47:07.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.971+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.5 2024-09-12T17:47:07.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.971+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.5 2024-09-12T17:47:07.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.972+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.6 2024-09-12T17:47:07.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.972+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.6 2024-09-12T17:47:07.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.972+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.7 2024-09-12T17:47:07.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.972+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.7 2024-09-12T17:47:07.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.973+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.8 2024-09-12T17:47:07.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.973+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.8 2024-09-12T17:47:07.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.974+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.9 2024-09-12T17:47:07.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.974+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.9 2024-09-12T17:47:07.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.975+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.10 2024-09-12T17:47:07.975 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.975+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.10 2024-09-12T17:47:07.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.975+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.11 2024-09-12T17:47:07.976 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.975+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.11 2024-09-12T17:47:07.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.977+0000 7faeca42f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:07.978 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.977+0000 7faeca42f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:07.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.979+0000 7faeca42f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:07.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.979+0000 7faeca42f800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:07.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.979+0000 7faeca42f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:07.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.979+0000 7faeca42f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:07.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7fada6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431667 cookie 94525076997376 notifier 8117 bl.length()=905 2024-09-12T17:47:07.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7fada6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:07.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7fada6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:07.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7fada6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:07.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:07.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:07.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:07.981 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.980+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:07.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.983+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.0 2024-09-12T17:47:07.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.983+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.0 2024-09-12T17:47:07.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.984+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.1 2024-09-12T17:47:07.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.984+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.1 2024-09-12T17:47:07.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.984+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.2 2024-09-12T17:47:07.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.984+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.2 2024-09-12T17:47:07.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.985+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.3 2024-09-12T17:47:07.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.985+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.3 2024-09-12T17:47:07.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.985+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.4 2024-09-12T17:47:07.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.985+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.4 2024-09-12T17:47:07.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.986+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.5 2024-09-12T17:47:07.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.986+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.5 2024-09-12T17:47:07.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.986+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.6 2024-09-12T17:47:07.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.986+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.6 2024-09-12T17:47:07.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.987+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.7 2024-09-12T17:47:07.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.987+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.7 2024-09-12T17:47:07.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.987+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.8 2024-09-12T17:47:07.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.987+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.8 2024-09-12T17:47:07.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.987+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.9 2024-09-12T17:47:07.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.987+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.9 2024-09-12T17:47:07.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.988+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.10 2024-09-12T17:47:07.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.988+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.10 2024-09-12T17:47:07.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.988+0000 7faeca42f800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.11 2024-09-12T17:47:07.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.988+0000 7faeca42f800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.1.11 2024-09-12T17:47:07.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.990+0000 7faeca42f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:07.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.990+0000 7faeca42f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:07.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7faeca42f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:07.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7faeca42f800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:07.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7faeca42f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:07.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7faeca42f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:07.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7fada67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94525076997376 notifier 8117 bl.length()=873 2024-09-12T17:47:07.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7fada67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:07.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7fada67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:07.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.992+0000 7fada67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:07.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.993+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:07.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.993+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:07.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.993+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:07.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.993+0000 7faeca42f800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:07.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.996+0000 7faeca42f800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T17:47:07.999 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:07.998+0000 7fad7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:08.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.000+0000 7faeca42f800 20 remove_watcher() i=0 2024-09-12T17:47:08.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.000+0000 7faeca42f800 2 removed watcher, disabling cache 2024-09-12T17:47:08.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.002+0000 7faeca42f800 20 remove_watcher() i=1 2024-09-12T17:47:08.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.004+0000 7faeca42f800 20 remove_watcher() i=2 2024-09-12T17:47:08.006 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.005+0000 7faeca42f800 20 remove_watcher() i=3 2024-09-12T17:47:08.007 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.006+0000 7faeca42f800 20 remove_watcher() i=4 2024-09-12T17:47:08.008 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.008+0000 7faeca42f800 20 remove_watcher() i=5 2024-09-12T17:47:08.009 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.009+0000 7faeca42f800 20 remove_watcher() i=6 2024-09-12T17:47:08.011 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:08.010+0000 7faeca42f800 20 remove_watcher() i=7 2024-09-12T17:47:08.679 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T17:47:08.679 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T17:47:08.792 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:47:09.204 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:47:10.669 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:47:10.671 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T17:47:10.706 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:10.706 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:10.749 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.748+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.750+0000 7f51d5811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:10.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.750+0000 7f51d5811800 20 realm 2024-09-12T17:47:10.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.750+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.750+0000 7f51d5811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:10.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.750+0000 7f51d5811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:10.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.750+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.751+0000 7f51d5811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:10.752 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.751+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.751+0000 7f51d5811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:10.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.751+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.752+0000 7f51d5811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:10.753 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.752+0000 7f51d5811800 20 searching for the correct realm 2024-09-12T17:47:10.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.755+0000 7f51d0747640 0 -- 172.21.15.63:0/307028723 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f51c4028bd0 msgr2=0x7f51c4033410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:10.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.961+0000 7f51d0747640 0 -- 172.21.15.63:0/307028723 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55d532ec7e60 msgr2=0x55d532eca2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:10.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:10.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.966+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 zone default found 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 4 Realm: () 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 zonegroup default 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.967+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.968+0000 7f51d5811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:10.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.968+0000 7f51d5811800 20 started sync module instance, tier type = 2024-09-12T17:47:10.970 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.968+0000 7f51d5811800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:10.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.978+0000 7f51d5811800 20 add_watcher() i=0 2024-09-12T17:47:10.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.978+0000 7f51d5811800 20 add_watcher() i=1 2024-09-12T17:47:10.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.978+0000 7f51d5811800 20 add_watcher() i=2 2024-09-12T17:47:10.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.978+0000 7f51d5811800 20 add_watcher() i=3 2024-09-12T17:47:10.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.978+0000 7f51d5811800 20 add_watcher() i=4 2024-09-12T17:47:10.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.978+0000 7f51d5811800 20 add_watcher() i=5 2024-09-12T17:47:10.979 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.978+0000 7f51d5811800 20 add_watcher() i=6 2024-09-12T17:47:10.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.979+0000 7f51d5811800 20 add_watcher() i=7 2024-09-12T17:47:10.980 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.979+0000 7f51d5811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:10.982 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.981+0000 7f50877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:10.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.982+0000 7f51d5811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:10.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.982+0000 7f51d5811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:10.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.982+0000 7f51d5811800 5 note: GC not initialized 2024-09-12T17:47:10.983 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.982+0000 7f50867e4640 20 reqs_thread_entry: start 2024-09-12T17:47:10.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.982+0000 7f51d5811800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:10.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.982+0000 7f51d5811800 20 Filter name: none 2024-09-12T17:47:10.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.982+0000 7f507ffff640 20 reqs_thread_entry: start 2024-09-12T17:47:10.984 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.983+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.983+0000 7f51d5811800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.983+0000 7f51d5811800 20 rados->read ofs=0 len=0 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 INFO: main: starting shard=0 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:10.985 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 INFO: main: starting shard=1 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.984+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 20 INFO: main: starting shard=2 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:10.986 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:10.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 20 INFO: main: starting shard=3 2024-09-12T17:47:10.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:10.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.985+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:10.987 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.986+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.986+0000 7f51d5811800 20 INFO: main: starting shard=4 2024-09-12T17:47:10.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.986+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:10.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.986+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:10.988 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.987+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.987+0000 7f51d5811800 20 INFO: main: starting shard=5 2024-09-12T17:47:10.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.987+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:10.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.987+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:10.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.987+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:47:10.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.988+0000 7f51d5811800 20 INFO: main: starting shard=6 2024-09-12T17:47:10.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.988+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:10.989 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.988+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.988+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.988+0000 7f51d5811800 20 INFO: main: starting shard=7 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.988+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.988+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 20 INFO: main: starting shard=8 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:10.990 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:10.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 20 INFO: main: starting shard=9 2024-09-12T17:47:10.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:10.991 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.989+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:10.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.990+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.990+0000 7f51d5811800 20 INFO: main: starting shard=10 2024-09-12T17:47:10.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.990+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:10.992 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.990+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 20 INFO: main: starting shard=11 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 20 INFO: main: starting shard=12 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.991+0000 7f51d5811800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.992+0000 7f51d5811800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.992+0000 7f51d5811800 20 INFO: main: done 2024-09-12T17:47:10.994 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.993+0000 7f50877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:10.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.995+0000 7f51d5811800 20 remove_watcher() i=0 2024-09-12T17:47:10.996 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.995+0000 7f51d5811800 2 removed watcher, disabling cache 2024-09-12T17:47:10.997 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.996+0000 7f51d5811800 20 remove_watcher() i=1 2024-09-12T17:47:10.998 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.997+0000 7f51d5811800 20 remove_watcher() i=2 2024-09-12T17:47:11.000 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:10.999+0000 7f51d5811800 20 remove_watcher() i=3 2024-09-12T17:47:11.001 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.000+0000 7f51d5811800 20 remove_watcher() i=4 2024-09-12T17:47:11.002 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.001+0000 7f51d5811800 20 remove_watcher() i=5 2024-09-12T17:47:11.003 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.003+0000 7f51d5811800 20 remove_watcher() i=6 2024-09-12T17:47:11.004 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.004+0000 7f51d5811800 20 remove_watcher() i=7 2024-09-12T17:47:11.074 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:47:11.076 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T17:47:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:11.108 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:11.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.146+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 20 realm 2024-09-12T17:47:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.148+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.149+0000 7facb01af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:11.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.149+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.149+0000 7facb01af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:11.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.149+0000 7facb01af800 20 searching for the correct realm 2024-09-12T17:47:11.153 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.153+0000 7facad49f640 0 -- 172.21.15.63:0/3198673091 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7faca4095910 msgr2=0x7faca4087400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:11.360 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.359+0000 7facae4a1640 0 -- 172.21.15.63:0/3198673091 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55dc3c3380f0 msgr2=0x55dc3c33a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:11.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:11.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:11.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:11.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:11.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:11.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:11.364 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.365 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.363+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 zone default found 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 4 Realm: () 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:11.366 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 zonegroup default 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.364+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.365+0000 7facb01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.365+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.365+0000 7facb01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.365+0000 7facb01af800 20 started sync module instance, tier type = 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.365+0000 7facb01af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:11.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.374+0000 7facb01af800 20 add_watcher() i=0 2024-09-12T17:47:11.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.374+0000 7facb01af800 20 add_watcher() i=1 2024-09-12T17:47:11.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.374+0000 7facb01af800 20 add_watcher() i=2 2024-09-12T17:47:11.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.374+0000 7facb01af800 20 add_watcher() i=3 2024-09-12T17:47:11.375 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.374+0000 7facb01af800 20 add_watcher() i=4 2024-09-12T17:47:11.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.374+0000 7facb01af800 20 add_watcher() i=5 2024-09-12T17:47:11.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.374+0000 7facb01af800 20 add_watcher() i=6 2024-09-12T17:47:11.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.376+0000 7facb01af800 20 add_watcher() i=7 2024-09-12T17:47:11.376 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.376+0000 7facb01af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:11.378 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.377+0000 7fab5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:11.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7facb01af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:11.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7facb01af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:11.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7facb01af800 5 note: GC not initialized 2024-09-12T17:47:11.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7fab5e7fc640 20 reqs_thread_entry: start 2024-09-12T17:47:11.379 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7facb01af800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7facb01af800 20 Filter name: none 2024-09-12T17:47:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7faacffff640 20 reqs_thread_entry: start 2024-09-12T17:47:11.380 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.378+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 20 INFO: main: starting shard=0 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.379+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 20 INFO: main: starting shard=1 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:11.381 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:11.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 20 INFO: main: starting shard=2 2024-09-12T17:47:11.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:11.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.380+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:11.382 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.381+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.381+0000 7facb01af800 20 INFO: main: starting shard=3 2024-09-12T17:47:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.381+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:11.383 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.381+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 20 INFO: main: starting shard=4 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 20 INFO: main: starting shard=5 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.382+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 20 INFO: main: starting shard=6 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:11.384 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 20 INFO: main: starting shard=7 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.383+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 20 INFO: main: starting shard=8 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 20 INFO: main: starting shard=9 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:11.386 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.384+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:11.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:47:11.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 20 INFO: main: starting shard=10 2024-09-12T17:47:11.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:11.387 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 20 INFO: main: starting shard=11 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.385+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.386+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.386+0000 7facb01af800 20 INFO: main: starting shard=12 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.386+0000 7facb01af800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.386+0000 7facb01af800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.386+0000 7facb01af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.386+0000 7facb01af800 20 INFO: main: done 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.387+0000 7fab5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:11.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.389+0000 7facb01af800 20 remove_watcher() i=0 2024-09-12T17:47:11.390 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.389+0000 7facb01af800 2 removed watcher, disabling cache 2024-09-12T17:47:11.391 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.390+0000 7facb01af800 20 remove_watcher() i=1 2024-09-12T17:47:11.392 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.392+0000 7facb01af800 20 remove_watcher() i=2 2024-09-12T17:47:11.393 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.393+0000 7facb01af800 20 remove_watcher() i=3 2024-09-12T17:47:11.394 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.394+0000 7facb01af800 20 remove_watcher() i=4 2024-09-12T17:47:11.395 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.395+0000 7facb01af800 20 remove_watcher() i=5 2024-09-12T17:47:11.396 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.396+0000 7facb01af800 20 remove_watcher() i=6 2024-09-12T17:47:11.397 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.397+0000 7facb01af800 20 remove_watcher() i=7 2024-09-12T17:47:11.466 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:47:11.467 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T17:47:11.499 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:11.499 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:11.538 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.537+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.539+0000 7f3cd7926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.539+0000 7f3cd7926800 20 realm 2024-09-12T17:47:11.540 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.539+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.539+0000 7f3cd7926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.539+0000 7f3cd7926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:11.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.539+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.540+0000 7f3cd7926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.540+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.541 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.540+0000 7f3cd7926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:11.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.540+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.541+0000 7f3cd7926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:11.542 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.541+0000 7f3cd7926800 20 searching for the correct realm 2024-09-12T17:47:11.545 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.544+0000 7f3cd2dd8640 0 -- 172.21.15.63:0/1975335661 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f3cc80693f0 msgr2=0x7f3cc80a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:11.751 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.750+0000 7f3cd3dda640 0 -- 172.21.15.63:0/1975335661 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b91149a8d0 msgr2=0x55b91149ccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:11.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.754+0000 7f3cd7926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:11.755 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.754+0000 7f3cd7926800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:11.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.754+0000 7f3cd7926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:11.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.754+0000 7f3cd7926800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:11.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.754+0000 7f3cd7926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:11.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.754+0000 7f3cd7926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:11.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.754+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.756 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:11.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:11.757 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 zone default found 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 4 Realm: () 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 zonegroup default 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.755+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.756+0000 7f3cd7926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.756+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.756+0000 7f3cd7926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.756+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.756+0000 7f3cd7926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.756+0000 7f3cd7926800 20 started sync module instance, tier type = 2024-09-12T17:47:11.758 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.756+0000 7f3cd7926800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:11.768 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.768+0000 7f3cd7926800 20 add_watcher() i=0 2024-09-12T17:47:11.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.768+0000 7f3cd7926800 20 add_watcher() i=1 2024-09-12T17:47:11.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.768+0000 7f3cd7926800 20 add_watcher() i=2 2024-09-12T17:47:11.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.768+0000 7f3cd7926800 20 add_watcher() i=3 2024-09-12T17:47:11.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.768+0000 7f3cd7926800 20 add_watcher() i=4 2024-09-12T17:47:11.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.768+0000 7f3cd7926800 20 add_watcher() i=5 2024-09-12T17:47:11.769 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.768+0000 7f3cd7926800 20 add_watcher() i=6 2024-09-12T17:47:11.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.770+0000 7f3cd7926800 20 add_watcher() i=7 2024-09-12T17:47:11.771 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.770+0000 7f3cd7926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:11.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.772+0000 7f3b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:11.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.772+0000 7f3cd7926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:11.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.772+0000 7f3cd7926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:11.773 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.772+0000 7f3cd7926800 5 note: GC not initialized 2024-09-12T17:47:11.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.772+0000 7f3b88fe1640 20 reqs_thread_entry: start 2024-09-12T17:47:11.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.773+0000 7f3cd7926800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:11.774 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.773+0000 7f3cd7926800 20 Filter name: none 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.773+0000 7f3b027fc640 20 reqs_thread_entry: start 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.773+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.773+0000 7f3cd7926800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.773+0000 7f3cd7926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 INFO: main: starting shard=0 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:11.775 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 INFO: main: starting shard=1 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.774+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 20 INFO: main: starting shard=2 2024-09-12T17:47:11.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:11.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:11.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 20 INFO: main: starting shard=3 2024-09-12T17:47:11.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:11.777 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.775+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.776+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.776+0000 7f3cd7926800 20 INFO: main: starting shard=4 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.776+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.776+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 20 INFO: main: starting shard=5 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:11.778 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 20 INFO: main: starting shard=6 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.777+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 20 INFO: main: starting shard=7 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:11.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 20 INFO: main: starting shard=8 2024-09-12T17:47:11.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:11.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.778+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:11.780 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.779+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.779+0000 7f3cd7926800 20 INFO: main: starting shard=9 2024-09-12T17:47:11.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.779+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:11.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.779+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:11.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 20 INFO: main: starting shard=10 2024-09-12T17:47:11.781 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 20 INFO: main: starting shard=11 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.780+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.781+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.781+0000 7f3cd7926800 20 INFO: main: starting shard=12 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.781+0000 7f3cd7926800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:11.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.781+0000 7f3cd7926800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:11.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.781+0000 7f3cd7926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:47:11.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.781+0000 7f3cd7926800 20 INFO: main: done 2024-09-12T17:47:11.783 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.782+0000 7f3b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:11.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.784+0000 7f3cd7926800 20 remove_watcher() i=0 2024-09-12T17:47:11.785 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.784+0000 7f3cd7926800 2 removed watcher, disabling cache 2024-09-12T17:47:11.786 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.785+0000 7f3cd7926800 20 remove_watcher() i=1 2024-09-12T17:47:11.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.786+0000 7f3cd7926800 20 remove_watcher() i=2 2024-09-12T17:47:11.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.788+0000 7f3cd7926800 20 remove_watcher() i=3 2024-09-12T17:47:11.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.789+0000 7f3cd7926800 20 remove_watcher() i=4 2024-09-12T17:47:11.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.790+0000 7f3cd7926800 20 remove_watcher() i=5 2024-09-12T17:47:11.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.791+0000 7f3cd7926800 20 remove_watcher() i=6 2024-09-12T17:47:11.793 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:11.792+0000 7f3cd7926800 20 remove_watcher() i=7 2024-09-12T17:47:11.811 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:47:12.218 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:47:12.623 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T17:47:12.655 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:12.655 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:12.695 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.694+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.695+0000 7f57f5b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:12.696 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.695+0000 7f57f5b22800 20 realm 2024-09-12T17:47:12.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.695+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.695+0000 7f57f5b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:12.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.695+0000 7f57f5b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:12.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.695+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.696+0000 7f57f5b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:12.697 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.696+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.696+0000 7f57f5b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:12.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.696+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.697+0000 7f57f5b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:12.698 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.697+0000 7f57f5b22800 20 searching for the correct realm 2024-09-12T17:47:12.701 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.700+0000 7f57f1067640 0 -- 172.21.15.63:0/840000402 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f57dc0c50d0 msgr2=0x7f57dc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:12.906 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.905+0000 7f57f2069640 0 -- 172.21.15.63:0/840000402 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x557cf5e90eb0 msgr2=0x557cf5e932d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:12.910 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.909+0000 7f57f5b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.909+0000 7f57f5b22800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.909+0000 7f57f5b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.909+0000 7f57f5b22800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.909+0000 7f57f5b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.909+0000 7f57f5b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.909+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:12.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:12.912 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 zone default found 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 4 Realm: () 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 zonegroup default 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.910+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.911+0000 7f57f5b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.911+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.911+0000 7f57f5b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.911+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.911+0000 7f57f5b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.911+0000 7f57f5b22800 20 started sync module instance, tier type = 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.911+0000 7f57f5b22800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:12.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.921+0000 7f57f5b22800 20 add_watcher() i=0 2024-09-12T17:47:12.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.921+0000 7f57f5b22800 20 add_watcher() i=1 2024-09-12T17:47:12.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.921+0000 7f57f5b22800 20 add_watcher() i=2 2024-09-12T17:47:12.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.921+0000 7f57f5b22800 20 add_watcher() i=3 2024-09-12T17:47:12.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.921+0000 7f57f5b22800 20 add_watcher() i=4 2024-09-12T17:47:12.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.921+0000 7f57f5b22800 20 add_watcher() i=5 2024-09-12T17:47:12.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.921+0000 7f57f5b22800 20 add_watcher() i=6 2024-09-12T17:47:12.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.922+0000 7f57f5b22800 20 add_watcher() i=7 2024-09-12T17:47:12.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.922+0000 7f57f5b22800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:12.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.924+0000 7f56a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:12.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.924+0000 7f57f5b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:12.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.924+0000 7f57f5b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:12.925 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.924+0000 7f57f5b22800 5 note: GC not initialized 2024-09-12T17:47:12.926 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f56a27fc640 20 reqs_thread_entry: start 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 20 Filter name: none 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f5613fff640 20 reqs_thread_entry: start 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : miss 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.925+0000 7f57f5b22800 20 rados->read ofs=0 len=0 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.926+0000 7f57f5b22800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:12.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.926+0000 7f57f5b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:12.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.926+0000 7f57f5b22800 10 adding default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:12.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.926+0000 7f57f5b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:12.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.926+0000 7f57f5b22800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:12.928 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.926+0000 7f57f5b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:12.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f57f5b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:12.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f57f5b22800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:12.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f57f5b22800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:12.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f57f5b22800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:12.933 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f56d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431669 cookie 93995190048416 notifier 8772 bl.length()=905 2024-09-12T17:47:12.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f56d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:12.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f56d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:12.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.932+0000 7f56d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:12.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.933+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:12.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.933+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:12.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.933+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:12.934 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.933+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.0 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.0 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.1 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.1 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.2 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.2 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.3 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.3 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.4 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.4 2024-09-12T17:47:12.940 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.5 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.5 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.6 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.6 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.7 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.7 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.8 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.8 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.10 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.10 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.11 2024-09-12T17:47:12.941 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.11 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.12 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.12 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.13 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.13 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.14 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.14 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.15 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.15 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.16 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.16 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.938+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.939+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:12.943 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.939+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.939+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.939+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.940+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.940+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.941+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.941+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.941+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.941+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.942+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.942+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.942+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:12.944 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.942+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:12.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.942+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:12.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.942+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:12.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.943+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:12.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.943+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:12.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.944+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:12.945 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.944+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:12.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.944+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:12.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.944+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:12.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.945+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:12.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.945+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:12.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.947+0000 7f57f5b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:12.947 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.947+0000 7f57f5b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:12.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:12.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:12.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:12.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:12.949 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f56d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431670 cookie 93995190048416 notifier 8772 bl.length()=905 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f56d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f56d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f56d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.948+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:12.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.951+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:12.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.951+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.0 2024-09-12T17:47:12.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.951+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:12.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.951+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.1 2024-09-12T17:47:12.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.952+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:12.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.952+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.2 2024-09-12T17:47:12.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.952+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:12.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.952+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.3 2024-09-12T17:47:12.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.952+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:12.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.952+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.4 2024-09-12T17:47:12.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.953+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:12.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.953+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.5 2024-09-12T17:47:12.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.953+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:12.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.953+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.6 2024-09-12T17:47:12.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.954+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:12.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.954+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.7 2024-09-12T17:47:12.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.954+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:12.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.954+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.8 2024-09-12T17:47:12.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.954+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:12.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.954+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.9 2024-09-12T17:47:12.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.955+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:12.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.955+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.10 2024-09-12T17:47:12.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.955+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:12.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.955+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.11 2024-09-12T17:47:12.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.955+0000 7f57f5b22800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:12.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.955+0000 7f57f5b22800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.2.12 2024-09-12T17:47:12.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.956+0000 7f57f5b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:12.957 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.956+0000 7f57f5b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:12.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f57f5b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:12.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f57f5b22800 10 moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:12.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f57f5b22800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:12.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f57f5b22800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19, ofs0, ns] 2024-09-12T17:47:12.958 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f56d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431671 cookie 93995190048416 notifier 8772 bl.length()=873 2024-09-12T17:47:12.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f56d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:12.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f56d4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:12.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.957+0000 7f56d4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:12.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.958+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_sources= new_sources= 2024-09-12T17:47:12.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.958+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential sources added=[] removed=[] 2024-09-12T17:47:12.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.958+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): orig_dests= new_dests= 2024-09-12T17:47:12.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.958+0000 7f57f5b22800 20 handle_bi_update(): bucket=:myver[44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19]): potential dests added=[] removed=[] 2024-09-12T17:47:12.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.961+0000 7f57f5b22800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T17:47:12.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.963+0000 7f56a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:12.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.965+0000 7f57f5b22800 20 remove_watcher() i=0 2024-09-12T17:47:12.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.965+0000 7f57f5b22800 2 removed watcher, disabling cache 2024-09-12T17:47:12.967 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.966+0000 7f57f5b22800 20 remove_watcher() i=1 2024-09-12T17:47:12.968 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.968+0000 7f57f5b22800 20 remove_watcher() i=2 2024-09-12T17:47:12.969 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.969+0000 7f57f5b22800 20 remove_watcher() i=3 2024-09-12T17:47:12.971 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.970+0000 7f57f5b22800 20 remove_watcher() i=4 2024-09-12T17:47:12.972 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.971+0000 7f57f5b22800 20 remove_watcher() i=5 2024-09-12T17:47:12.973 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.972+0000 7f57f5b22800 20 remove_watcher() i=6 2024-09-12T17:47:12.974 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:12.973+0000 7f57f5b22800 20 remove_watcher() i=7 2024-09-12T17:47:12.987 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:47:13.022 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:13.022 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:13.061 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.060+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 20 realm 2024-09-12T17:47:13.063 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:13.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.064 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.062+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.063+0000 7f14baf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:13.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.063+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.063+0000 7f14baf75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:13.065 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.063+0000 7f14baf75800 20 searching for the correct realm 2024-09-12T17:47:13.068 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.067+0000 7f14b825e640 0 -- 172.21.15.63:0/1736634696 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f14ac095ad0 msgr2=0x7f14ac0a0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:13.071 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.070+0000 7f14b8a5f640 0 -- 172.21.15.63:0/1736634696 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f14b000b040 msgr2=0x7f14b0014420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:13.075 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.074+0000 7f14baf75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.074+0000 7f14baf75800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.074+0000 7f14baf75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.074+0000 7f14baf75800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.074+0000 7f14baf75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.074+0000 7f14baf75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.074+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:13.077 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 zone default found 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 4 Realm: () 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 zonegroup default 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.075+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.076+0000 7f14baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.076+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.076+0000 7f14baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.076+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.076+0000 7f14baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.078 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.076+0000 7f14baf75800 20 started sync module instance, tier type = 2024-09-12T17:47:13.079 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.076+0000 7f14baf75800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:13.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.086+0000 7f14baf75800 20 add_watcher() i=0 2024-09-12T17:47:13.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.086+0000 7f14baf75800 20 add_watcher() i=1 2024-09-12T17:47:13.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.086+0000 7f14baf75800 20 add_watcher() i=2 2024-09-12T17:47:13.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.086+0000 7f14baf75800 20 add_watcher() i=3 2024-09-12T17:47:13.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.086+0000 7f14baf75800 20 add_watcher() i=4 2024-09-12T17:47:13.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.086+0000 7f14baf75800 20 add_watcher() i=5 2024-09-12T17:47:13.087 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.086+0000 7f14baf75800 20 add_watcher() i=6 2024-09-12T17:47:13.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.087+0000 7f14baf75800 20 add_watcher() i=7 2024-09-12T17:47:13.088 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.087+0000 7f14baf75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:13.089 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.089+0000 7f136f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:13.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.089+0000 7f14baf75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:13.090 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.089+0000 7f14baf75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:13.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.089+0000 7f14baf75800 5 note: GC not initialized 2024-09-12T17:47:13.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.089+0000 7f136e7e4640 20 reqs_thread_entry: start 2024-09-12T17:47:13.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.089+0000 7f14baf75800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:13.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.089+0000 7f14baf75800 20 Filter name: none 2024-09-12T17:47:13.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f1367fff640 20 reqs_thread_entry: start 2024-09-12T17:47:13.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f14baf75800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:47:13.091 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f14baf75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f14baf75800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f14baf75800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f14baf75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 : miss 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.090+0000 7f14baf75800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 info.flags=0x17 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 10 adding default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 to cache LRU end 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:13.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:13.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19 2024-09-12T17:47:13.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.0 2024-09-12T17:47:13.093 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.0 2024-09-12T17:47:13.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:47:13.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.1 2024-09-12T17:47:13.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.091+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.1 2024-09-12T17:47:13.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.092+0000 7f14baf75800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:47:13.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.092+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.2 2024-09-12T17:47:13.099 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.092+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.2 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.092+0000 7f14baf75800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.092+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.3 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.092+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.3 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.093+0000 7f14baf75800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.093+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.4 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.093+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.4 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.093+0000 7f14baf75800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.093+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.5 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.093+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.5 2024-09-12T17:47:13.100 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.094+0000 7f14baf75800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.094+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.6 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.094+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.6 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.094+0000 7f14baf75800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.094+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.7 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.094+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.7 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.8 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.8 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.101 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.10 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.095+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.10 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.096+0000 7f14baf75800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.096+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.11 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.096+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.11 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.096+0000 7f14baf75800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.096+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.12 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.096+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.12 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.097+0000 7f14baf75800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.097+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.13 2024-09-12T17:47:13.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.097+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.13 2024-09-12T17:47:13.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.097+0000 7f14baf75800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T17:47:13.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.097+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.14 2024-09-12T17:47:13.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.097+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.14 2024-09-12T17:47:13.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.098+0000 7f14baf75800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T17:47:13.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.098+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.15 2024-09-12T17:47:13.103 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.098+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.15 2024-09-12T17:47:13.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.098+0000 7f14baf75800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T17:47:13.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.098+0000 7f14baf75800 10 bucket_obj is .dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.16 2024-09-12T17:47:13.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.098+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.16 2024-09-12T17:47:13.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.099+0000 7f14baf75800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T17:47:13.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.099+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.099+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:x state=0x55a27c765aa8 s->prefetch_data=0 2024-09-12T17:47:13.105 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.100+0000 7f14baf75800 20 get_obj_state: setting s->obj_tag to yu8lhasoa9nc4zzpesh4tvb7f1r45cr7 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.100+0000 7f14baf75800 20 get_obj_state_impl: setting s->olh_tag to nk08mitu9se4bt43e7fxg9a9i2up6hvv 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.100+0000 7f14baf75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nk08mitu9se4bt43e7fxg9a9i2up6hvv 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.101+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.102+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 20 olh_log_entry: epoch=2 op=3 key=x[TM9DVyNqFatD7y78dczHFqlzhlz-MHr] 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:_:TM9DVyNqFatD7y78dczHFqlzhlz-MHr_x state=0x55a27c7a3078 s->prefetch_data=0 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 10 manifest: total_size = 11 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6766783784844565649 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:_:TM9DVyNqFatD7y78dczHFqlzhlz-MHr_x state=0x55a27c7a3078 s->prefetch_data=0 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 20 prepare_atomic_modification: state is not atomic. state=0x55a27c7a3078 2024-09-12T17:47:13.106 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.103+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.106+0000 7f14baf75800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:47:13.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.106+0000 7f14baf75800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:47:13.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.106+0000 7f14baf75800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:47:13.107 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.106+0000 7f14baf75800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19__shadow:TM9DVyNqFatD7y78dczHFqlzhlz-MHr_.lLyC3N4uKZxlC_sGlpZ9ZuV1rQoAh4a_0 2024-09-12T17:47:13.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.107+0000 7f138ffff640 20 handle_completion(): completion ok for obj=x[TM9DVyNqFatD7y78dczHFqlzhlz-MHr] 2024-09-12T17:47:13.108 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.107+0000 7f14baf75800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:47:13.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.109+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:x state=0x55a27c765aa8 s->prefetch_data=0 2024-09-12T17:47:13.110 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.109+0000 7f14baf75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nk08mitu9se4bt43e7fxg9a9i2up6hvv 2024-09-12T17:47:13.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.112+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.113+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.114 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.113+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.114+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:y state=0x55a27c767208 s->prefetch_data=0 2024-09-12T17:47:13.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.114+0000 7f14baf75800 20 get_obj_state: setting s->obj_tag to gmmyvn8qtk1xyupr0r5sfnysqr6facva 2024-09-12T17:47:13.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.114+0000 7f14baf75800 20 get_obj_state_impl: setting s->olh_tag to kaox07nxee8c6e53fgmj09pce8yipq98 2024-09-12T17:47:13.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.114+0000 7f14baf75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kaox07nxee8c6e53fgmj09pce8yipq98 2024-09-12T17:47:13.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.116+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.117+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.117+0000 7f14baf75800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T17:47:13.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.117+0000 7f14baf75800 20 olh_log_entry: epoch=2 op=3 key=y[ldNSoyLuh8SUcmYG2OqSV25T3yn88fX] 2024-09-12T17:47:13.118 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.117+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:_:ldNSoyLuh8SUcmYG2OqSV25T3yn88fX_y state=0x55a27c7a2068 s->prefetch_data=0 2024-09-12T17:47:13.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.118+0000 7f14baf75800 10 manifest: total_size = 12 2024-09-12T17:47:13.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.118+0000 7f14baf75800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7276748239234178435 2024-09-12T17:47:13.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.118+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:_:ldNSoyLuh8SUcmYG2OqSV25T3yn88fX_y state=0x55a27c7a2068 s->prefetch_data=0 2024-09-12T17:47:13.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.118+0000 7f14baf75800 20 prepare_atomic_modification: state is not atomic. state=0x55a27c7a2068 2024-09-12T17:47:13.119 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.118+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.120+0000 7f14baf75800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:47:13.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.120+0000 7f14baf75800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:47:13.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.120+0000 7f14baf75800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:47:13.121 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.120+0000 7f14baf75800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19__shadow:ldNSoyLuh8SUcmYG2OqSV25T3yn88fX_.89miiokiEB4CzYg7MLbTfh_fwE66tKF_0 2024-09-12T17:47:13.122 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.121+0000 7f14baf75800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:47:13.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.122+0000 7f138f7fe640 20 handle_completion(): completion ok for obj=y[ldNSoyLuh8SUcmYG2OqSV25T3yn88fX] 2024-09-12T17:47:13.123 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.123+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:y state=0x55a27c767208 s->prefetch_data=0 2024-09-12T17:47:13.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.123+0000 7f14baf75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kaox07nxee8c6e53fgmj09pce8yipq98 2024-09-12T17:47:13.126 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.125+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.127+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.127+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.127+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:z state=0x55a27c765598 s->prefetch_data=0 2024-09-12T17:47:13.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.127+0000 7f14baf75800 20 get_obj_state: setting s->obj_tag to 6fl1f1fhb170bsmn5f87igwet0kmvl3c 2024-09-12T17:47:13.128 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.127+0000 7f14baf75800 20 get_obj_state_impl: setting s->olh_tag to 2e7ka9vttpvj19t5rasgu3msxvppkb6j 2024-09-12T17:47:13.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.127+0000 7f14baf75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2e7ka9vttpvj19t5rasgu3msxvppkb6j 2024-09-12T17:47:13.129 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.129+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.130+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.130+0000 7f14baf75800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.130+0000 7f14baf75800 20 olh_log_entry: epoch=2 op=3 key=z[tcMgNszpgC2xVxU2SE95sUZBCwlDUol] 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.130+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:_:tcMgNszpgC2xVxU2SE95sUZBCwlDUol_z state=0x55a27c7a1058 s->prefetch_data=0 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.131+0000 7f14baf75800 10 manifest: total_size = 22 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.131+0000 7f14baf75800 20 get_obj_state: setting s->obj_tag to 44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9989628010810616217 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.131+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:_:tcMgNszpgC2xVxU2SE95sUZBCwlDUol_z state=0x55a27c7a1058 s->prefetch_data=0 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.131+0000 7f14baf75800 20 prepare_atomic_modification: state is not atomic. state=0x55a27c7a1058 2024-09-12T17:47:13.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.131+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.133+0000 7f14baf75800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:47:13.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.133+0000 7f14baf75800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:47:13.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.133+0000 7f14baf75800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:47:13.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.133+0000 7f14baf75800 5 delete_objs_inline: removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19__shadow:tcMgNszpgC2xVxU2SE95sUZBCwlDUol_.TG_6KMIUor_LMANEpZMIRKvRxMVGRMr_0 2024-09-12T17:47:13.135 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.135+0000 7f138ffff640 20 handle_completion(): completion ok for obj=z[tcMgNszpgC2xVxU2SE95sUZBCwlDUol] 2024-09-12T17:47:13.136 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.135+0000 7f14baf75800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:47:13.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.136+0000 7f14baf75800 20 get_obj_state: octx=0x55a27c4b2c60 obj=myver:z state=0x55a27c765598 s->prefetch_data=0 2024-09-12T17:47:13.137 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.136+0000 7f14baf75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2e7ka9vttpvj19t5rasgu3msxvppkb6j 2024-09-12T17:47:13.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.139+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.140+0000 7f14baf75800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19.3.9 2024-09-12T17:47:13.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.140+0000 7f14baf75800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T17:47:13.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.140+0000 7f14baf75800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T17:47:13.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.141+0000 7f136f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:13.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.143+0000 7f14baf75800 20 remove_watcher() i=0 2024-09-12T17:47:13.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.143+0000 7f14baf75800 2 removed watcher, disabling cache 2024-09-12T17:47:13.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.144+0000 7f14baf75800 20 remove_watcher() i=1 2024-09-12T17:47:13.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.145+0000 7f14baf75800 20 remove_watcher() i=2 2024-09-12T17:47:13.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.146+0000 7f14baf75800 20 remove_watcher() i=3 2024-09-12T17:47:13.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.147+0000 7f14baf75800 20 remove_watcher() i=4 2024-09-12T17:47:13.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.148+0000 7f14baf75800 20 remove_watcher() i=5 2024-09-12T17:47:13.150 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.149+0000 7f14baf75800 20 remove_watcher() i=6 2024-09-12T17:47:13.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.150+0000 7f14baf75800 20 remove_watcher() i=7 2024-09-12T17:47:13.213 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:47:13.243 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:13.243 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:13.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.282+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.283+0000 7f27db926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.283+0000 7f27db926800 20 realm 2024-09-12T17:47:13.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.283+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.284+0000 7f27db926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.284+0000 7f27db926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:13.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.284+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.284+0000 7f27db926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.284+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.285+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:13.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.285+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.285+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:13.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.285+0000 7f27db926800 20 searching for the correct realm 2024-09-12T17:47:13.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.287+0000 7f27d7509640 0 -- 172.21.15.63:0/2885201515 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x55e0532fcb80 msgr2=0x55e0532fef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:13.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.290+0000 7f27d7d0a640 0 -- 172.21.15.63:0/2885201515 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x7f27c803c420 msgr2=0x7f27c803c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:13.499 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.498+0000 7f27db926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.498+0000 7f27db926800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.498+0000 7f27db926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.498+0000 7f27db926800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.498+0000 7f27db926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.498+0000 7f27db926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.498+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:13.501 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 zone default found 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 4 Realm: () 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 zonegroup default 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.499+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.500+0000 7f27db926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.500+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.500+0000 7f27db926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.500+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.500+0000 7f27db926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:13.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.500+0000 7f27db926800 20 started sync module instance, tier type = 2024-09-12T17:47:13.503 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.500+0000 7f27db926800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:47:13.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.509+0000 7f27db926800 20 add_watcher() i=0 2024-09-12T17:47:13.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.509+0000 7f27db926800 20 add_watcher() i=1 2024-09-12T17:47:13.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.509+0000 7f27db926800 20 add_watcher() i=2 2024-09-12T17:47:13.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.509+0000 7f27db926800 20 add_watcher() i=3 2024-09-12T17:47:13.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.509+0000 7f27db926800 20 add_watcher() i=4 2024-09-12T17:47:13.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.509+0000 7f27db926800 20 add_watcher() i=5 2024-09-12T17:47:13.510 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.509+0000 7f27db926800 20 add_watcher() i=6 2024-09-12T17:47:13.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.510+0000 7f27db926800 20 add_watcher() i=7 2024-09-12T17:47:13.511 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.510+0000 7f27db926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:13.513 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.512+0000 7f268dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f27db926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f27db926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f27db926800 5 note: GC not initialized 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f268cfe1640 20 reqs_thread_entry: start 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f27db926800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f27db926800 20 Filter name: none 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f26067fc640 20 reqs_thread_entry: start 2024-09-12T17:47:13.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.513+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.515 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.514+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.514+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.514+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.514+0000 7f27db926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.514+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.514+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.514+0000 7f27db926800 20 rados->read ofs=0 len=0 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.515+0000 7f27db926800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:47:13.516 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.515+0000 7f27db926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:13.517 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.517+0000 7f268dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:13.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.519+0000 7f27db926800 20 remove_watcher() i=0 2024-09-12T17:47:13.520 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.519+0000 7f27db926800 2 removed watcher, disabling cache 2024-09-12T17:47:13.521 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.520+0000 7f27db926800 20 remove_watcher() i=1 2024-09-12T17:47:13.522 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.521+0000 7f27db926800 20 remove_watcher() i=2 2024-09-12T17:47:13.523 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.522+0000 7f27db926800 20 remove_watcher() i=3 2024-09-12T17:47:13.524 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.523+0000 7f27db926800 20 remove_watcher() i=4 2024-09-12T17:47:13.525 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.524+0000 7f27db926800 20 remove_watcher() i=5 2024-09-12T17:47:13.526 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.525+0000 7f27db926800 20 remove_watcher() i=6 2024-09-12T17:47:13.527 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T17:47:13.526+0000 7f27db926800 20 remove_watcher() i=7 2024-09-12T17:47:13.539 INFO:tasks.workunit.client.0.smithi063.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:47:13.539 INFO:tasks.workunit.client.0.smithi063.stderr:Deleting bucket a-bucket 2024-09-12T17:47:13.559 INFO:tasks.workunit.client.0.smithi063.stderr:Deleting bucket myver 2024-09-12T17:47:13.637 INFO:tasks.workunit.client.0.smithi063.stderr:Completed resharding tests 2024-09-12T17:47:13.637 INFO:tasks.workunit.client.0.smithi063.stdout:connected to http://localhost:80 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ deactivate 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ export PATH 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ hash -r 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T17:47:13.718 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:47:13.718 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:47:13.718 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset -f deactivate 2024-09-12T17:47:13.718 INFO:tasks.workunit.client.0.smithi063.stderr:+ echo OK. 2024-09-12T17:47:13.719 INFO:tasks.workunit.client.0.smithi063.stdout:OK. 2024-09-12T17:47:13.719 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:47:13.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:47:13.798 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T17:47:13.799 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:47:14.232 DEBUG:teuthology.parallel:result is None 2024-09-12T17:47:14.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:47:14.272 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:47:14.272 DEBUG:teuthology.orchestra.run.smithi063:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:47:14.341 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:47:14.341 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T17:47:14.359 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T17:47:14.359 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T17:47:14.360 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T17:47:14.360 DEBUG:teuthology.orchestra.run.smithi063:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:47:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T17:47:19.031 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T17:47:19.031 DEBUG:teuthology.orchestra.run.smithi063:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T17:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T17:47:21.750 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:29:11 ago on Thu 12 Sep 2024 05:18:10 PM UTC. 2024-09-12T17:47:21.897 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-12T17:47:21.898 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-12T17:47:21.898 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-12T17:47:21.898 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-12T17:47:21.898 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-12T17:47:21.898 INFO:teuthology.orchestra.run.smithi063.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T17:47:21.898 INFO:teuthology.orchestra.run.smithi063.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout:Install 5 Packages 2024-09-12T17:47:21.899 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:47:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 46 M 2024-09-12T17:47:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 166 M 2024-09-12T17:47:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-12T17:47:22.582 INFO:teuthology.orchestra.run.smithi063.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 647 kB/s | 426 kB 00:00 2024-09-12T17:47:23.607 INFO:teuthology.orchestra.run.smithi063.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 2.1 MB/s | 3.5 MB 00:01 2024-09-12T17:47:23.716 INFO:teuthology.orchestra.run.smithi063.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 239 kB/s | 26 kB 00:00 2024-09-12T17:47:26.693 INFO:teuthology.orchestra.run.smithi063.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 2.0 MB/s | 9.3 MB 00:04 2024-09-12T17:48:02.325 INFO:teuthology.orchestra.run.smithi063.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 832 kB/s | 32 MB 00:39 2024-09-12T17:48:02.325 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:48:02.325 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.1 MB/s | 46 MB 00:40 2024-09-12T17:48:02.761 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-12T17:48:02.784 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-12T17:48:02.784 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-12T17:48:03.287 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-12T17:48:03.287 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-12T17:48:03.822 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T17:48:03.977 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-12T17:48:04.175 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T17:48:04.942 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T17:48:05.001 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:48:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:48:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:48:05.523 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:48:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:48:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:48:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T17:48:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T17:48:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:48:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T17:48:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T17:48:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T17:48:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:08.576 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-12T17:48:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: Gradle will be installed under /opt/gradle 2024-09-12T17:48:09.061 INFO:teuthology.orchestra.run.smithi063.stderr:--2024-09-12 17:48:09-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T17:48:09.452 INFO:teuthology.orchestra.run.smithi063.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T17:48:09.465 INFO:teuthology.orchestra.run.smithi063.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T17:48:09.549 INFO:teuthology.orchestra.run.smithi063.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T17:48:09.549 INFO:teuthology.orchestra.run.smithi063.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T17:48:09.549 INFO:teuthology.orchestra.run.smithi063.stderr:--2024-09-12 17:48:09-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T17:48:09.549 INFO:teuthology.orchestra.run.smithi063.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-12T17:48:09.557 INFO:teuthology.orchestra.run.smithi063.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-12T17:48:09.712 INFO:teuthology.orchestra.run.smithi063.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T17:48:09.712 INFO:teuthology.orchestra.run.smithi063.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T174809Z&X-Amz-Expires=300&X-Amz-Signature=860d82afcb92f4c48ea8f02af9b3def21d7bec17703e6b3c7a6e7b7be313ad83&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T17:48:09.712 INFO:teuthology.orchestra.run.smithi063.stderr:--2024-09-12 17:48:09-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T174809Z&X-Amz-Expires=300&X-Amz-Signature=860d82afcb92f4c48ea8f02af9b3def21d7bec17703e6b3c7a6e7b7be313ad83&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T17:48:09.721 INFO:teuthology.orchestra.run.smithi063.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.110.133, 185.199.108.133, ... 2024-09-12T17:48:09.733 INFO:teuthology.orchestra.run.smithi063.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-12T17:48:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T17:48:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T17:48:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T17:48:09.806 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T17:48:09.821 INFO:teuthology.orchestra.run.smithi063.stderr: 0K .......... .......... .......... .......... .......... 0% 3.56M 25s 2024-09-12T17:48:09.831 INFO:teuthology.orchestra.run.smithi063.stderr: 50K .......... .......... .......... .......... .......... 0% 4.04M 24s 2024-09-12T17:48:09.840 INFO:teuthology.orchestra.run.smithi063.stderr: 100K .......... .......... .......... .......... .......... 0% 5.65M 21s 2024-09-12T17:48:09.841 INFO:teuthology.orchestra.run.smithi063.stderr: 150K .......... .......... .......... .......... .......... 0% 27.7M 17s 2024-09-12T17:48:09.844 INFO:teuthology.orchestra.run.smithi063.stderr: 200K .......... .......... .......... .......... .......... 0% 21.3M 14s 2024-09-12T17:48:09.846 INFO:teuthology.orchestra.run.smithi063.stderr: 250K .......... .......... .......... .......... .......... 0% 29.8M 12s 2024-09-12T17:48:09.852 INFO:teuthology.orchestra.run.smithi063.stderr: 300K .......... .......... .......... .......... .......... 0% 7.76M 12s 2024-09-12T17:48:09.853 INFO:teuthology.orchestra.run.smithi063.stderr: 350K .......... .......... .......... .......... .......... 0% 40.7M 11s 2024-09-12T17:48:09.855 INFO:teuthology.orchestra.run.smithi063.stderr: 400K .......... .......... .......... .......... .......... 0% 29.0M 10s 2024-09-12T17:48:09.855 INFO:teuthology.orchestra.run.smithi063.stderr: 450K .......... .......... .......... .......... .......... 0% 86.5M 9s 2024-09-12T17:48:09.856 INFO:teuthology.orchestra.run.smithi063.stderr: 500K .......... .......... .......... .......... .......... 0% 112M 8s 2024-09-12T17:48:09.857 INFO:teuthology.orchestra.run.smithi063.stderr: 550K .......... .......... .......... .......... .......... 0% 39.3M 8s 2024-09-12T17:48:09.864 INFO:teuthology.orchestra.run.smithi063.stderr: 600K .......... .......... .......... .......... .......... 0% 7.87M 8s 2024-09-12T17:48:09.864 INFO:teuthology.orchestra.run.smithi063.stderr: 650K .......... .......... .......... .......... .......... 0% 344M 8s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 700K .......... .......... .......... .......... .......... 0% 146M 7s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 750K .......... .......... .......... .......... .......... 0% 49.0M 7s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 800K .......... .......... .......... .......... .......... 0% 57.5M 7s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 850K .......... .......... .......... .......... .......... 0% 54.9M 6s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 900K .......... .......... .......... .......... .......... 1% 269M 6s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 950K .......... .......... .......... .......... .......... 1% 136M 6s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 1000K .......... .......... .......... .......... .......... 1% 88.7M 5s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 1050K .......... .......... .......... .......... .......... 1% 83.3M 5s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 1100K .......... .......... .......... .......... .......... 1% 85.6M 5s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 1150K .......... .......... .......... .......... .......... 1% 277M 5s 2024-09-12T17:48:09.873 INFO:teuthology.orchestra.run.smithi063.stderr: 1200K .......... .......... .......... .......... .......... 1% 77.7M 5s 2024-09-12T17:48:11.490 INFO:teuthology.orchestra.run.smithi063.stderr: 1250K .......... .......... .......... .......... .......... 1% 8.96M 5s 2024-09-12T17:48:11.490 INFO:teuthology.orchestra.run.smithi063.stderr: 1300K .......... .......... .......... .......... .......... 1% 224M 5s 2024-09-12T17:48:11.490 INFO:teuthology.orchestra.run.smithi063.stderr: 1350K .......... .......... .......... .......... .......... 1% 324M 5s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1400K .......... .......... .......... .......... .......... 1% 218M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1450K .......... .......... .......... .......... .......... 1% 118M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1500K .......... .......... .......... .......... .......... 1% 117M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1550K .......... .......... .......... .......... .......... 1% 98.7M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1600K .......... .......... .......... .......... .......... 1% 161M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1650K .......... .......... .......... .......... .......... 1% 289M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1700K .......... .......... .......... .......... .......... 1% 139M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1750K .......... .......... .......... .......... .......... 1% 144M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1800K .......... .......... .......... .......... .......... 1% 152M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1850K .......... .......... .......... .......... .......... 2% 237M 4s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1900K .......... .......... .......... .......... .......... 2% 131M 3s 2024-09-12T17:48:11.491 INFO:teuthology.orchestra.run.smithi063.stderr: 1950K .......... .......... .......... .......... .......... 2% 179M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2000K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2050K .......... .......... .......... .......... .......... 2% 234M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2100K .......... .......... .......... .......... .......... 2% 287M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2150K .......... .......... .......... .......... .......... 2% 134M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2200K .......... .......... .......... .......... .......... 2% 229M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2250K .......... .......... .......... .......... .......... 2% 178M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2300K .......... .......... .......... .......... .......... 2% 167M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2350K .......... .......... .......... .......... .......... 2% 323M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2400K .......... .......... .......... .......... .......... 2% 201M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2450K .......... .......... .......... .......... .......... 2% 194M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2500K .......... .......... .......... .......... .......... 2% 11.1M 3s 2024-09-12T17:48:11.492 INFO:teuthology.orchestra.run.smithi063.stderr: 2550K .......... .......... .......... .......... .......... 2% 297M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2600K .......... .......... .......... .......... .......... 2% 320M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2650K .......... .......... .......... .......... .......... 2% 300M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2700K .......... .......... .......... .......... .......... 2% 179M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2750K .......... .......... .......... .......... .......... 3% 237M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2800K .......... .......... .......... .......... .......... 3% 311M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2850K .......... .......... .......... .......... .......... 3% 255M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2900K .......... .......... .......... .......... .......... 3% 278M 3s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 2950K .......... .......... .......... .......... .......... 3% 243M 2s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 3000K .......... .......... .......... .......... .......... 3% 302M 2s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 3050K .......... .......... .......... .......... .......... 3% 276M 2s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 3100K .......... .......... .......... .......... .......... 3% 250M 2s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 3150K .......... .......... .......... .......... .......... 3% 283M 2s 2024-09-12T17:48:11.493 INFO:teuthology.orchestra.run.smithi063.stderr: 3200K .......... .......... .......... .......... .......... 3% 241M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3250K .......... .......... .......... .......... .......... 3% 260M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3300K .......... .......... .......... .......... .......... 3% 270M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3350K .......... .......... .......... .......... .......... 3% 289M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3400K .......... .......... .......... .......... .......... 3% 322M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3450K .......... .......... .......... .......... .......... 3% 331M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3500K .......... .......... .......... .......... .......... 3% 264M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3550K .......... .......... .......... .......... .......... 3% 260M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3600K .......... .......... .......... .......... .......... 3% 306M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3650K .......... .......... .......... .......... .......... 3% 281M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3700K .......... .......... .......... .......... .......... 4% 255M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3750K .......... .......... .......... .......... .......... 4% 265M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3800K .......... .......... .......... .......... .......... 4% 274M 2s 2024-09-12T17:48:11.494 INFO:teuthology.orchestra.run.smithi063.stderr: 3850K .......... .......... .......... .......... .......... 4% 257M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 3900K .......... .......... .......... .......... .......... 4% 237M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 3950K .......... .......... .......... .......... .......... 4% 269M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4000K .......... .......... .......... .......... .......... 4% 307M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4050K .......... .......... .......... .......... .......... 4% 319M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4100K .......... .......... .......... .......... .......... 4% 238M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4150K .......... .......... .......... .......... .......... 4% 317M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4200K .......... .......... .......... .......... .......... 4% 304M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4250K .......... .......... .......... .......... .......... 4% 313M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4300K .......... .......... .......... .......... .......... 4% 264M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4350K .......... .......... .......... .......... .......... 4% 306M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4400K .......... .......... .......... .......... .......... 4% 297M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4450K .......... .......... .......... .......... .......... 4% 314M 2s 2024-09-12T17:48:11.495 INFO:teuthology.orchestra.run.smithi063.stderr: 4500K .......... .......... .......... .......... .......... 4% 272M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4550K .......... .......... .......... .......... .......... 4% 319M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4600K .......... .......... .......... .......... .......... 5% 317M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4650K .......... .......... .......... .......... .......... 5% 314M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4700K .......... .......... .......... .......... .......... 5% 260M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4750K .......... .......... .......... .......... .......... 5% 336M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4800K .......... .......... .......... .......... .......... 5% 335M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4850K .......... .......... .......... .......... .......... 5% 325M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4900K .......... .......... .......... .......... .......... 5% 299M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 4950K .......... .......... .......... .......... .......... 5% 327M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 5000K .......... .......... .......... .......... .......... 5% 335M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 5050K .......... .......... .......... .......... .......... 5% 17.7M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 5100K .......... .......... .......... .......... .......... 5% 259M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 5150K .......... .......... .......... .......... .......... 5% 313M 2s 2024-09-12T17:48:11.496 INFO:teuthology.orchestra.run.smithi063.stderr: 5200K .......... .......... .......... .......... .......... 5% 116M 2s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5250K .......... .......... .......... .......... .......... 5% 306M 2s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5300K .......... .......... .......... .......... .......... 5% 250M 2s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5350K .......... .......... .......... .......... .......... 5% 310M 2s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5400K .......... .......... .......... .......... .......... 5% 262M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5450K .......... .......... .......... .......... .......... 5% 277M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5500K .......... .......... .......... .......... .......... 5% 255M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5550K .......... .......... .......... .......... .......... 6% 307M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5600K .......... .......... .......... .......... .......... 6% 299M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5650K .......... .......... .......... .......... .......... 6% 307M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5700K .......... .......... .......... .......... .......... 6% 237M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5750K .......... .......... .......... .......... .......... 6% 266M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5800K .......... .......... .......... .......... .......... 6% 309M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5850K .......... .......... .......... .......... .......... 6% 319M 1s 2024-09-12T17:48:11.497 INFO:teuthology.orchestra.run.smithi063.stderr: 5900K .......... .......... .......... .......... .......... 6% 270M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 5950K .......... .......... .......... .......... .......... 6% 311M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6000K .......... .......... .......... .......... .......... 6% 334M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6050K .......... .......... .......... .......... .......... 6% 321M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6100K .......... .......... .......... .......... .......... 6% 248M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6150K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6200K .......... .......... .......... .......... .......... 6% 251M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6250K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6300K .......... .......... .......... .......... .......... 6% 251M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6350K .......... .......... .......... .......... .......... 6% 280M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6400K .......... .......... .......... .......... .......... 6% 351M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6450K .......... .......... .......... .......... .......... 6% 347M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6500K .......... .......... .......... .......... .......... 7% 300M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6550K .......... .......... .......... .......... .......... 7% 311M 1s 2024-09-12T17:48:11.498 INFO:teuthology.orchestra.run.smithi063.stderr: 6600K .......... .......... .......... .......... .......... 7% 353M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 6650K .......... .......... .......... .......... .......... 7% 347M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 6700K .......... .......... .......... .......... .......... 7% 292M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 6750K .......... .......... .......... .......... .......... 7% 334M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 6800K .......... .......... .......... .......... .......... 7% 300M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 6850K .......... .......... .......... .......... .......... 7% 318M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 6900K .......... .......... .......... .......... .......... 7% 288M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 6950K .......... .......... .......... .......... .......... 7% 345M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 7000K .......... .......... .......... .......... .......... 7% 327M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 7050K .......... .......... .......... .......... .......... 7% 303M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 7100K .......... .......... .......... .......... .......... 7% 223M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 7150K .......... .......... .......... .......... .......... 7% 291M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 7200K .......... .......... .......... .......... .......... 7% 268M 1s 2024-09-12T17:48:11.499 INFO:teuthology.orchestra.run.smithi063.stderr: 7250K .......... .......... .......... .......... .......... 7% 303M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7300K .......... .......... .......... .......... .......... 7% 295M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7350K .......... .......... .......... .......... .......... 7% 355M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7400K .......... .......... .......... .......... .......... 8% 365M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7450K .......... .......... .......... .......... .......... 8% 362M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7500K .......... .......... .......... .......... .......... 8% 286M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7550K .......... .......... .......... .......... .......... 8% 345M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7600K .......... .......... .......... .......... .......... 8% 347M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7650K .......... .......... .......... .......... .......... 8% 357M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7700K .......... .......... .......... .......... .......... 8% 321M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7750K .......... .......... .......... .......... .......... 8% 367M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7800K .......... .......... .......... .......... .......... 8% 19.4M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7850K .......... .......... .......... .......... .......... 8% 270M 1s 2024-09-12T17:48:11.500 INFO:teuthology.orchestra.run.smithi063.stderr: 7900K .......... .......... .......... .......... .......... 8% 273M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 7950K .......... .......... .......... .......... .......... 8% 339M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8000K .......... .......... .......... .......... .......... 8% 336M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8050K .......... .......... .......... .......... .......... 8% 355M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8100K .......... .......... .......... .......... .......... 8% 314M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8150K .......... .......... .......... .......... .......... 8% 344M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8200K .......... .......... .......... .......... .......... 8% 312M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8250K .......... .......... .......... .......... .......... 8% 345M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8300K .......... .......... .......... .......... .......... 8% 293M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8350K .......... .......... .......... .......... .......... 9% 358M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8400K .......... .......... .......... .......... .......... 9% 345M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8450K .......... .......... .......... .......... .......... 9% 324M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8500K .......... .......... .......... .......... .......... 9% 299M 1s 2024-09-12T17:48:11.501 INFO:teuthology.orchestra.run.smithi063.stderr: 8550K .......... .......... .......... .......... .......... 9% 356M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8600K .......... .......... .......... .......... .......... 9% 335M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8650K .......... .......... .......... .......... .......... 9% 346M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8700K .......... .......... .......... .......... .......... 9% 275M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8750K .......... .......... .......... .......... .......... 9% 273M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8800K .......... .......... .......... .......... .......... 9% 335M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8850K .......... .......... .......... .......... .......... 9% 332M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8900K .......... .......... .......... .......... .......... 9% 318M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 8950K .......... .......... .......... .......... .......... 9% 317M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 9000K .......... .......... .......... .......... .......... 9% 244M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 9050K .......... .......... .......... .......... .......... 9% 323M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 9100K .......... .......... .......... .......... .......... 9% 210M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 9150K .......... .......... .......... .......... .......... 9% 344M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 9200K .......... .......... .......... .......... .......... 9% 339M 1s 2024-09-12T17:48:11.502 INFO:teuthology.orchestra.run.smithi063.stderr: 9250K .......... .......... .......... .......... .......... 10% 350M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9300K .......... .......... .......... .......... .......... 10% 318M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9350K .......... .......... .......... .......... .......... 10% 347M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9400K .......... .......... .......... .......... .......... 10% 344M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9450K .......... .......... .......... .......... .......... 10% 340M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9500K .......... .......... .......... .......... .......... 10% 280M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9550K .......... .......... .......... .......... .......... 10% 324M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9600K .......... .......... .......... .......... .......... 10% 368M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9650K .......... .......... .......... .......... .......... 10% 352M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9700K .......... .......... .......... .......... .......... 10% 286M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9750K .......... .......... .......... .......... .......... 10% 359M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9800K .......... .......... .......... .......... .......... 10% 351M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9850K .......... .......... .......... .......... .......... 10% 338M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9900K .......... .......... .......... .......... .......... 10% 286M 1s 2024-09-12T17:48:11.503 INFO:teuthology.orchestra.run.smithi063.stderr: 9950K .......... .......... .......... .......... .......... 10% 331M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10000K .......... .......... .......... .......... .......... 10% 338M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10050K .......... .......... .......... .......... .......... 10% 356M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10100K .......... .......... .......... .......... .......... 10% 304M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10150K .......... .......... .......... .......... .......... 10% 343M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10200K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10250K .......... .......... .......... .......... .......... 11% 377M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10300K .......... .......... .......... .......... .......... 11% 345M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10350K .......... .......... .......... .......... .......... 11% 298M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10400K .......... .......... .......... .......... .......... 11% 365M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10450K .......... .......... .......... .......... .......... 11% 14.1M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10500K .......... .......... .......... .......... .......... 11% 309M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10550K .......... .......... .......... .......... .......... 11% 285M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10600K .......... .......... .......... .......... .......... 11% 339M 1s 2024-09-12T17:48:11.504 INFO:teuthology.orchestra.run.smithi063.stderr: 10650K .......... .......... .......... .......... .......... 11% 337M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 10700K .......... .......... .......... .......... .......... 11% 347M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 10750K .......... .......... .......... .......... .......... 11% 289M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 10800K .......... .......... .......... .......... .......... 11% 349M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 10850K .......... .......... .......... .......... .......... 11% 334M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 10900K .......... .......... .......... .......... .......... 11% 302M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 10950K .......... .......... .......... .......... .......... 11% 286M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 11000K .......... .......... .......... .......... .......... 11% 335M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 11050K .......... .......... .......... .......... .......... 11% 359M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 11100K .......... .......... .......... .......... .......... 12% 340M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 11150K .......... .......... .......... .......... .......... 12% 288M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 11200K .......... .......... .......... .......... .......... 12% 352M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 11250K .......... .......... .......... .......... .......... 12% 315M 1s 2024-09-12T17:48:11.505 INFO:teuthology.orchestra.run.smithi063.stderr: 11300K .......... .......... .......... .......... .......... 12% 351M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11350K .......... .......... .......... .......... .......... 12% 300M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11400K .......... .......... .......... .......... .......... 12% 276M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11450K .......... .......... .......... .......... .......... 12% 307M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11500K .......... .......... .......... .......... .......... 12% 329M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11550K .......... .......... .......... .......... .......... 12% 271M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11600K .......... .......... .......... .......... .......... 12% 334M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11650K .......... .......... .......... .......... .......... 12% 362M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11700K .......... .......... .......... .......... .......... 12% 340M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11750K .......... .......... .......... .......... .......... 12% 298M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11800K .......... .......... .......... .......... .......... 12% 340M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11850K .......... .......... .......... .......... .......... 12% 346M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11900K .......... .......... .......... .......... .......... 12% 322M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 11950K .......... .......... .......... .......... .......... 12% 288M 1s 2024-09-12T17:48:11.506 INFO:teuthology.orchestra.run.smithi063.stderr: 12000K .......... .......... .......... .......... .......... 12% 340M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12050K .......... .......... .......... .......... .......... 13% 339M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12100K .......... .......... .......... .......... .......... 13% 344M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12150K .......... .......... .......... .......... .......... 13% 310M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12200K .......... .......... .......... .......... .......... 13% 344M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12250K .......... .......... .......... .......... .......... 13% 324M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12300K .......... .......... .......... .......... .......... 13% 348M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12350K .......... .......... .......... .......... .......... 13% 295M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12400K .......... .......... .......... .......... .......... 13% 308M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12450K .......... .......... .......... .......... .......... 13% 359M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12500K .......... .......... .......... .......... .......... 13% 312M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12550K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12600K .......... .......... .......... .......... .......... 13% 290M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12650K .......... .......... .......... .......... .......... 13% 355M 1s 2024-09-12T17:48:11.507 INFO:teuthology.orchestra.run.smithi063.stderr: 12700K .......... .......... .......... .......... .......... 13% 359M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 12750K .......... .......... .......... .......... .......... 13% 280M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 12800K .......... .......... .......... .......... .......... 13% 337M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 12850K .......... .......... .......... .......... .......... 13% 344M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 12900K .......... .......... .......... .......... .......... 13% 341M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 12950K .......... .......... .......... .......... .......... 13% 301M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13000K .......... .......... .......... .......... .......... 14% 337M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13050K .......... .......... .......... .......... .......... 14% 350M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13100K .......... .......... .......... .......... .......... 14% 348M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13150K .......... .......... .......... .......... .......... 14% 181M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13200K .......... .......... .......... .......... .......... 14% 357M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13250K .......... .......... .......... .......... .......... 14% 362M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13300K .......... .......... .......... .......... .......... 14% 345M 1s 2024-09-12T17:48:11.508 INFO:teuthology.orchestra.run.smithi063.stderr: 13350K .......... .......... .......... .......... .......... 14% 318M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13400K .......... .......... .......... .......... .......... 14% 362M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13450K .......... .......... .......... .......... .......... 14% 18.1M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13500K .......... .......... .......... .......... .......... 14% 345M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13550K .......... .......... .......... .......... .......... 14% 278M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13600K .......... .......... .......... .......... .......... 14% 306M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13650K .......... .......... .......... .......... .......... 14% 310M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13700K .......... .......... .......... .......... .......... 14% 332M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13750K .......... .......... .......... .......... .......... 14% 326M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13800K .......... .......... .......... .......... .......... 14% 360M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13850K .......... .......... .......... .......... .......... 14% 347M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13900K .......... .......... .......... .......... .......... 15% 351M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 13950K .......... .......... .......... .......... .......... 15% 92.3M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 14000K .......... .......... .......... .......... .......... 15% 344M 1s 2024-09-12T17:48:11.509 INFO:teuthology.orchestra.run.smithi063.stderr: 14050K .......... .......... .......... .......... .......... 15% 341M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14100K .......... .......... .......... .......... .......... 15% 346M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14150K .......... .......... .......... .......... .......... 15% 293M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14200K .......... .......... .......... .......... .......... 15% 322M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14250K .......... .......... .......... .......... .......... 15% 351M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14300K .......... .......... .......... .......... .......... 15% 364M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14350K .......... .......... .......... .......... .......... 15% 275M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14400K .......... .......... .......... .......... .......... 15% 284M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14450K .......... .......... .......... .......... .......... 15% 296M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14500K .......... .......... .......... .......... .......... 15% 290M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14550K .......... .......... .......... .......... .......... 15% 242M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14600K .......... .......... .......... .......... .......... 15% 265M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14650K .......... .......... .......... .......... .......... 15% 337M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14700K .......... .......... .......... .......... .......... 15% 339M 1s 2024-09-12T17:48:11.510 INFO:teuthology.orchestra.run.smithi063.stderr: 14750K .......... .......... .......... .......... .......... 15% 263M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 14800K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 14850K .......... .......... .......... .......... .......... 16% 328M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 14900K .......... .......... .......... .......... .......... 16% 340M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 14950K .......... .......... .......... .......... .......... 16% 305M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15000K .......... .......... .......... .......... .......... 16% 338M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15050K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15100K .......... .......... .......... .......... .......... 16% 351M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15150K .......... .......... .......... .......... .......... 16% 291M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15200K .......... .......... .......... .......... .......... 16% 361M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15250K .......... .......... .......... .......... .......... 16% 356M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15300K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15350K .......... .......... .......... .......... .......... 16% 304M 1s 2024-09-12T17:48:11.511 INFO:teuthology.orchestra.run.smithi063.stderr: 15400K .......... .......... .......... .......... .......... 16% 351M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15450K .......... .......... .......... .......... .......... 16% 339M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15500K .......... .......... .......... .......... .......... 16% 363M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15550K .......... .......... .......... .......... .......... 16% 290M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15600K .......... .......... .......... .......... .......... 16% 323M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15650K .......... .......... .......... .......... .......... 16% 329M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15700K .......... .......... .......... .......... .......... 16% 357M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15750K .......... .......... .......... .......... .......... 17% 286M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15800K .......... .......... .......... .......... .......... 17% 335M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15850K .......... .......... .......... .......... .......... 17% 285M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15900K .......... .......... .......... .......... .......... 17% 341M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 15950K .......... .......... .......... .......... .......... 17% 349M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 16000K .......... .......... .......... .......... .......... 17% 352M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 16050K .......... .......... .......... .......... .......... 17% 322M 1s 2024-09-12T17:48:11.512 INFO:teuthology.orchestra.run.smithi063.stderr: 16100K .......... .......... .......... .......... .......... 17% 331M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16150K .......... .......... .......... .......... .......... 17% 231M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16200K .......... .......... .......... .......... .......... 17% 330M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16250K .......... .......... .......... .......... .......... 17% 374M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16300K .......... .......... .......... .......... .......... 17% 363M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16350K .......... .......... .......... .......... .......... 17% 277M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16400K .......... .......... .......... .......... .......... 17% 364M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16450K .......... .......... .......... .......... .......... 17% 22.2M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16500K .......... .......... .......... .......... .......... 17% 281M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16550K .......... .......... .......... .......... .......... 17% 304M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16600K .......... .......... .......... .......... .......... 17% 368M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16650K .......... .......... .......... .......... .......... 17% 354M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16700K .......... .......... .......... .......... .......... 18% 340M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16750K .......... .......... .......... .......... .......... 18% 295M 1s 2024-09-12T17:48:11.513 INFO:teuthology.orchestra.run.smithi063.stderr: 16800K .......... .......... .......... .......... .......... 18% 349M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 16850K .......... .......... .......... .......... .......... 18% 120M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 16900K .......... .......... .......... .......... .......... 18% 211M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 16950K .......... .......... .......... .......... .......... 18% 152M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17000K .......... .......... .......... .......... .......... 18% 356M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17050K .......... .......... .......... .......... .......... 18% 311M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17100K .......... .......... .......... .......... .......... 18% 342M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17150K .......... .......... .......... .......... .......... 18% 285M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17200K .......... .......... .......... .......... .......... 18% 340M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17250K .......... .......... .......... .......... .......... 18% 358M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17300K .......... .......... .......... .......... .......... 18% 333M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17350K .......... .......... .......... .......... .......... 18% 284M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17400K .......... .......... .......... .......... .......... 18% 329M 1s 2024-09-12T17:48:11.514 INFO:teuthology.orchestra.run.smithi063.stderr: 17450K .......... .......... .......... .......... .......... 18% 289M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17500K .......... .......... .......... .......... .......... 18% 360M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17550K .......... .......... .......... .......... .......... 18% 253M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17600K .......... .......... .......... .......... .......... 18% 299M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17650K .......... .......... .......... .......... .......... 19% 355M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17700K .......... .......... .......... .......... .......... 19% 267M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17750K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17800K .......... .......... .......... .......... .......... 19% 339M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17850K .......... .......... .......... .......... .......... 19% 339M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17900K .......... .......... .......... .......... .......... 19% 336M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 17950K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 18000K .......... .......... .......... .......... .......... 19% 301M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 18050K .......... .......... .......... .......... .......... 19% 360M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 18100K .......... .......... .......... .......... .......... 19% 343M 1s 2024-09-12T17:48:11.515 INFO:teuthology.orchestra.run.smithi063.stderr: 18150K .......... .......... .......... .......... .......... 19% 302M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18200K .......... .......... .......... .......... .......... 19% 361M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18250K .......... .......... .......... .......... .......... 19% 287M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18300K .......... .......... .......... .......... .......... 19% 338M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18350K .......... .......... .......... .......... .......... 19% 287M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18400K .......... .......... .......... .......... .......... 19% 358M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18450K .......... .......... .......... .......... .......... 19% 359M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18500K .......... .......... .......... .......... .......... 19% 339M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18550K .......... .......... .......... .......... .......... 20% 269M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18600K .......... .......... .......... .......... .......... 20% 327M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18650K .......... .......... .......... .......... .......... 20% 364M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18700K .......... .......... .......... .......... .......... 20% 340M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18750K .......... .......... .......... .......... .......... 20% 286M 1s 2024-09-12T17:48:11.516 INFO:teuthology.orchestra.run.smithi063.stderr: 18800K .......... .......... .......... .......... .......... 20% 343M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 18850K .......... .......... .......... .......... .......... 20% 349M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 18900K .......... .......... .......... .......... .......... 20% 328M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 18950K .......... .......... .......... .......... .......... 20% 283M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19000K .......... .......... .......... .......... .......... 20% 313M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19050K .......... .......... .......... .......... .......... 20% 226M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19100K .......... .......... .......... .......... .......... 20% 345M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19150K .......... .......... .......... .......... .......... 20% 294M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19200K .......... .......... .......... .......... .......... 20% 355M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19250K .......... .......... .......... .......... .......... 20% 343M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19300K .......... .......... .......... .......... .......... 20% 21.4M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19350K .......... .......... .......... .......... .......... 20% 256M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19400K .......... .......... .......... .......... .......... 20% 346M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19450K .......... .......... .......... .......... .......... 20% 359M 1s 2024-09-12T17:48:11.517 INFO:teuthology.orchestra.run.smithi063.stderr: 19500K .......... .......... .......... .......... .......... 21% 355M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19550K .......... .......... .......... .......... .......... 21% 275M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19600K .......... .......... .......... .......... .......... 21% 376M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19650K .......... .......... .......... .......... .......... 21% 386M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19700K .......... .......... .......... .......... .......... 21% 391M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19750K .......... .......... .......... .......... .......... 21% 349M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19800K .......... .......... .......... .......... .......... 21% 377M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19850K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19900K .......... .......... .......... .......... .......... 21% 365M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 19950K .......... .......... .......... .......... .......... 21% 154M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 20000K .......... .......... .......... .......... .......... 21% 285M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 20050K .......... .......... .......... .......... .......... 21% 278M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 20100K .......... .......... .......... .......... .......... 21% 255M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 20150K .......... .......... .......... .......... .......... 21% 286M 1s 2024-09-12T17:48:11.518 INFO:teuthology.orchestra.run.smithi063.stderr: 20200K .......... .......... .......... .......... .......... 21% 343M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20250K .......... .......... .......... .......... .......... 21% 337M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20300K .......... .......... .......... .......... .......... 21% 372M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20350K .......... .......... .......... .......... .......... 21% 291M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20400K .......... .......... .......... .......... .......... 22% 341M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20450K .......... .......... .......... .......... .......... 22% 358M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20500K .......... .......... .......... .......... .......... 22% 335M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20550K .......... .......... .......... .......... .......... 22% 344M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20600K .......... .......... .......... .......... .......... 22% 300M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20650K .......... .......... .......... .......... .......... 22% 323M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20700K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20750K .......... .......... .......... .......... .......... 22% 253M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20800K .......... .......... .......... .......... .......... 22% 322M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20850K .......... .......... .......... .......... .......... 22% 335M 1s 2024-09-12T17:48:11.519 INFO:teuthology.orchestra.run.smithi063.stderr: 20900K .......... .......... .......... .......... .......... 22% 308M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 20950K .......... .......... .......... .......... .......... 22% 261M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21000K .......... .......... .......... .......... .......... 22% 347M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21050K .......... .......... .......... .......... .......... 22% 333M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21100K .......... .......... .......... .......... .......... 22% 277M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21150K .......... .......... .......... .......... .......... 22% 329M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21200K .......... .......... .......... .......... .......... 22% 209M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21250K .......... .......... .......... .......... .......... 22% 356M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21300K .......... .......... .......... .......... .......... 22% 300M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21350K .......... .......... .......... .......... .......... 23% 345M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21400K .......... .......... .......... .......... .......... 23% 336M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21450K .......... .......... .......... .......... .......... 23% 342M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21500K .......... .......... .......... .......... .......... 23% 273M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21550K .......... .......... .......... .......... .......... 23% 357M 1s 2024-09-12T17:48:11.520 INFO:teuthology.orchestra.run.smithi063.stderr: 21600K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 21650K .......... .......... .......... .......... .......... 23% 317M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 21700K .......... .......... .......... .......... .......... 23% 328M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 21750K .......... .......... .......... .......... .......... 23% 324M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 21800K .......... .......... .......... .......... .......... 23% 265M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 21850K .......... .......... .......... .......... .......... 23% 338M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 21900K .......... .......... .......... .......... .......... 23% 349M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 21950K .......... .......... .......... .......... .......... 23% 350M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 22000K .......... .......... .......... .......... .......... 23% 304M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 22050K .......... .......... .......... .......... .......... 23% 342M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 22100K .......... .......... .......... .......... .......... 23% 294M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 22150K .......... .......... .......... .......... .......... 23% 200M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 22200K .......... .......... .......... .......... .......... 23% 18.9M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 22250K .......... .......... .......... .......... .......... 24% 338M 1s 2024-09-12T17:48:11.521 INFO:teuthology.orchestra.run.smithi063.stderr: 22300K .......... .......... .......... .......... .......... 24% 282M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22350K .......... .......... .......... .......... .......... 24% 330M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22400K .......... .......... .......... .......... .......... 24% 324M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22450K .......... .......... .......... .......... .......... 24% 317M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22500K .......... .......... .......... .......... .......... 24% 304M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22550K .......... .......... .......... .......... .......... 24% 345M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22600K .......... .......... .......... .......... .......... 24% 349M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22650K .......... .......... .......... .......... .......... 24% 347M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22700K .......... .......... .......... .......... .......... 24% 300M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22750K .......... .......... .......... .......... .......... 24% 339M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22800K .......... .......... .......... .......... .......... 24% 338M 1s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22850K .......... .......... .......... .......... .......... 24% 326M 0s 2024-09-12T17:48:11.522 INFO:teuthology.orchestra.run.smithi063.stderr: 22900K .......... .......... .......... .......... .......... 24% 281M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 22950K .......... .......... .......... .......... .......... 24% 352M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23000K .......... .......... .......... .......... .......... 24% 339M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23050K .......... .......... .......... .......... .......... 24% 362M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23100K .......... .......... .......... .......... .......... 24% 290M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23150K .......... .......... .......... .......... .......... 24% 327M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23200K .......... .......... .......... .......... .......... 25% 325M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23250K .......... .......... .......... .......... .......... 25% 342M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23300K .......... .......... .......... .......... .......... 25% 257M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23350K .......... .......... .......... .......... .......... 25% 307M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23400K .......... .......... .......... .......... .......... 25% 303M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23450K .......... .......... .......... .......... .......... 25% 339M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23500K .......... .......... .......... .......... .......... 25% 278M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23550K .......... .......... .......... .......... .......... 25% 342M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23600K .......... .......... .......... .......... .......... 25% 360M 0s 2024-09-12T17:48:11.523 INFO:teuthology.orchestra.run.smithi063.stderr: 23650K .......... .......... .......... .......... .......... 25% 331M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 23700K .......... .......... .......... .......... .......... 25% 303M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 23750K .......... .......... .......... .......... .......... 25% 351M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 23800K .......... .......... .......... .......... .......... 25% 357M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 23850K .......... .......... .......... .......... .......... 25% 316M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 23900K .......... .......... .......... .......... .......... 25% 298M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 23950K .......... .......... .......... .......... .......... 25% 339M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 24000K .......... .......... .......... .......... .......... 25% 353M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 24050K .......... .......... .......... .......... .......... 25% 338M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 24100K .......... .......... .......... .......... .......... 25% 313M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 24150K .......... .......... .......... .......... .......... 26% 329M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 24200K .......... .......... .......... .......... .......... 26% 315M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 24250K .......... .......... .......... .......... .......... 26% 305M 0s 2024-09-12T17:48:11.524 INFO:teuthology.orchestra.run.smithi063.stderr: 24300K .......... .......... .......... .......... .......... 26% 291M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24350K .......... .......... .......... .......... .......... 26% 347M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24400K .......... .......... .......... .......... .......... 26% 339M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24450K .......... .......... .......... .......... .......... 26% 352M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24500K .......... .......... .......... .......... .......... 26% 273M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24550K .......... .......... .......... .......... .......... 26% 331M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24600K .......... .......... .......... .......... .......... 26% 352M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24650K .......... .......... .......... .......... .......... 26% 291M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24700K .......... .......... .......... .......... .......... 26% 220M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24750K .......... .......... .......... .......... .......... 26% 263M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24800K .......... .......... .......... .......... .......... 26% 319M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24850K .......... .......... .......... .......... .......... 26% 322M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24900K .......... .......... .......... .......... .......... 26% 262M 0s 2024-09-12T17:48:11.525 INFO:teuthology.orchestra.run.smithi063.stderr: 24950K .......... .......... .......... .......... .......... 26% 327M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25000K .......... .......... .......... .......... .......... 26% 352M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25050K .......... .......... .......... .......... .......... 27% 337M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25100K .......... .......... .......... .......... .......... 27% 294M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25150K .......... .......... .......... .......... .......... 27% 332M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25200K .......... .......... .......... .......... .......... 27% 343M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25250K .......... .......... .......... .......... .......... 27% 20.8M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25300K .......... .......... .......... .......... .......... 27% 188M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25350K .......... .......... .......... .......... .......... 27% 323M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25400K .......... .......... .......... .......... .......... 27% 337M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25450K .......... .......... .......... .......... .......... 27% 197M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25500K .......... .......... .......... .......... .......... 27% 279M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25550K .......... .......... .......... .......... .......... 27% 333M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25600K .......... .......... .......... .......... .......... 27% 337M 0s 2024-09-12T17:48:11.526 INFO:teuthology.orchestra.run.smithi063.stderr: 25650K .......... .......... .......... .......... .......... 27% 333M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 25700K .......... .......... .......... .......... .......... 27% 305M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 25750K .......... .......... .......... .......... .......... 27% 340M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 25800K .......... .......... .......... .......... .......... 27% 335M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 25850K .......... .......... .......... .......... .......... 27% 336M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 25900K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 25950K .......... .......... .......... .......... .......... 27% 334M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26000K .......... .......... .......... .......... .......... 28% 340M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26050K .......... .......... .......... .......... .......... 28% 350M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26100K .......... .......... .......... .......... .......... 28% 293M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26150K .......... .......... .......... .......... .......... 28% 353M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26200K .......... .......... .......... .......... .......... 28% 338M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26250K .......... .......... .......... .......... .......... 28% 333M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26300K .......... .......... .......... .......... .......... 28% 292M 0s 2024-09-12T17:48:11.527 INFO:teuthology.orchestra.run.smithi063.stderr: 26350K .......... .......... .......... .......... .......... 28% 254M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26400K .......... .......... .......... .......... .......... 28% 299M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26450K .......... .......... .......... .......... .......... 28% 317M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26500K .......... .......... .......... .......... .......... 28% 307M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26550K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26600K .......... .......... .......... .......... .......... 28% 329M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26650K .......... .......... .......... .......... .......... 28% 336M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26700K .......... .......... .......... .......... .......... 28% 282M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26750K .......... .......... .......... .......... .......... 28% 332M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26800K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26850K .......... .......... .......... .......... .......... 28% 334M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26900K .......... .......... .......... .......... .......... 29% 311M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 26950K .......... .......... .......... .......... .......... 29% 334M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 27000K .......... .......... .......... .......... .......... 29% 325M 0s 2024-09-12T17:48:11.528 INFO:teuthology.orchestra.run.smithi063.stderr: 27050K .......... .......... .......... .......... .......... 29% 344M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27100K .......... .......... .......... .......... .......... 29% 290M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27150K .......... .......... .......... .......... .......... 29% 327M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27200K .......... .......... .......... .......... .......... 29% 326M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27250K .......... .......... .......... .......... .......... 29% 360M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27300K .......... .......... .......... .......... .......... 29% 302M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27350K .......... .......... .......... .......... .......... 29% 345M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27400K .......... .......... .......... .......... .......... 29% 341M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27450K .......... .......... .......... .......... .......... 29% 344M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27500K .......... .......... .......... .......... .......... 29% 310M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27550K .......... .......... .......... .......... .......... 29% 316M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27600K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27650K .......... .......... .......... .......... .......... 29% 263M 0s 2024-09-12T17:48:11.529 INFO:teuthology.orchestra.run.smithi063.stderr: 27700K .......... .......... .......... .......... .......... 29% 336M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 27750K .......... .......... .......... .......... .......... 29% 351M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 27800K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 27850K .......... .......... .......... .......... .......... 30% 343M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 27900K .......... .......... .......... .......... .......... 30% 270M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 27950K .......... .......... .......... .......... .......... 30% 333M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28000K .......... .......... .......... .......... .......... 30% 346M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28050K .......... .......... .......... .......... .......... 30% 297M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28100K .......... .......... .......... .......... .......... 30% 342M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28150K .......... .......... .......... .......... .......... 30% 360M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28200K .......... .......... .......... .......... .......... 30% 22.9M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28250K .......... .......... .......... .......... .......... 30% 338M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28300K .......... .......... .......... .......... .......... 30% 284M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28350K .......... .......... .......... .......... .......... 30% 126M 0s 2024-09-12T17:48:11.530 INFO:teuthology.orchestra.run.smithi063.stderr: 28400K .......... .......... .......... .......... .......... 30% 224M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28450K .......... .......... .......... .......... .......... 30% 275M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28500K .......... .......... .......... .......... .......... 30% 264M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28550K .......... .......... .......... .......... .......... 30% 331M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28600K .......... .......... .......... .......... .......... 30% 308M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28650K .......... .......... .......... .......... .......... 30% 318M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28700K .......... .......... .......... .......... .......... 30% 281M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28750K .......... .......... .......... .......... .......... 31% 350M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28800K .......... .......... .......... .......... .......... 31% 336M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28850K .......... .......... .......... .......... .......... 31% 335M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28900K .......... .......... .......... .......... .......... 31% 313M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 28950K .......... .......... .......... .......... .......... 31% 351M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 29000K .......... .......... .......... .......... .......... 31% 282M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 29050K .......... .......... .......... .......... .......... 31% 205M 0s 2024-09-12T17:48:11.531 INFO:teuthology.orchestra.run.smithi063.stderr: 29100K .......... .......... .......... .......... .......... 31% 243M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29150K .......... .......... .......... .......... .......... 31% 333M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29200K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29250K .......... .......... .......... .......... .......... 31% 201M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29300K .......... .......... .......... .......... .......... 31% 335M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29350K .......... .......... .......... .......... .......... 31% 347M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29400K .......... .......... .......... .......... .......... 31% 294M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29450K .......... .......... .......... .......... .......... 31% 339M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29500K .......... .......... .......... .......... .......... 31% 348M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29550K .......... .......... .......... .......... .......... 31% 361M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29600K .......... .......... .......... .......... .......... 31% 276M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29650K .......... .......... .......... .......... .......... 31% 264M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29700K .......... .......... .......... .......... .......... 32% 338M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29750K .......... .......... .......... .......... .......... 32% 316M 0s 2024-09-12T17:48:11.532 INFO:teuthology.orchestra.run.smithi063.stderr: 29800K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 29850K .......... .......... .......... .......... .......... 32% 362M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 29900K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 29950K .......... .......... .......... .......... .......... 32% 323M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30000K .......... .......... .......... .......... .......... 32% 345M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30050K .......... .......... .......... .......... .......... 32% 311M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30100K .......... .......... .......... .......... .......... 32% 304M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30150K .......... .......... .......... .......... .......... 32% 365M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30200K .......... .......... .......... .......... .......... 32% 359M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30250K .......... .......... .......... .......... .......... 32% 339M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30300K .......... .......... .......... .......... .......... 32% 299M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30350K .......... .......... .......... .......... .......... 32% 348M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30400K .......... .......... .......... .......... .......... 32% 320M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30450K .......... .......... .......... .......... .......... 32% 342M 0s 2024-09-12T17:48:11.533 INFO:teuthology.orchestra.run.smithi063.stderr: 30500K .......... .......... .......... .......... .......... 32% 267M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30550K .......... .......... .......... .......... .......... 32% 335M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30600K .......... .......... .......... .......... .......... 32% 351M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30650K .......... .......... .......... .......... .......... 33% 372M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30700K .......... .......... .......... .......... .......... 33% 303M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30750K .......... .......... .......... .......... .......... 33% 296M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30800K .......... .......... .......... .......... .......... 33% 338M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30850K .......... .......... .......... .......... .......... 33% 364M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30900K .......... .......... .......... .......... .......... 33% 351M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 30950K .......... .......... .......... .......... .......... 33% 305M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 31000K .......... .......... .......... .......... .......... 33% 352M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 31050K .......... .......... .......... .......... .......... 33% 331M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 31100K .......... .......... .......... .......... .......... 33% 335M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 31150K .......... .......... .......... .......... .......... 33% 265M 0s 2024-09-12T17:48:11.534 INFO:teuthology.orchestra.run.smithi063.stderr: 31200K .......... .......... .......... .......... .......... 33% 342M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31250K .......... .......... .......... .......... .......... 33% 27.1M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31300K .......... .......... .......... .......... .......... 33% 311M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31350K .......... .......... .......... .......... .......... 33% 321M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31400K .......... .......... .......... .......... .......... 33% 169M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31450K .......... .......... .......... .......... .......... 33% 178M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31500K .......... .......... .......... .......... .......... 33% 352M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31550K .......... .......... .......... .......... .......... 34% 146M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31600K .......... .......... .......... .......... .......... 34% 338M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31650K .......... .......... .......... .......... .......... 34% 344M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31700K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31750K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31800K .......... .......... .......... .......... .......... 34% 334M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31850K .......... .......... .......... .......... .......... 34% 339M 0s 2024-09-12T17:48:11.535 INFO:teuthology.orchestra.run.smithi063.stderr: 31900K .......... .......... .......... .......... .......... 34% 341M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 31950K .......... .......... .......... .......... .......... 34% 294M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32000K .......... .......... .......... .......... .......... 34% 340M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32050K .......... .......... .......... .......... .......... 34% 60.1M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32100K .......... .......... .......... .......... .......... 34% 317M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32150K .......... .......... .......... .......... .......... 34% 286M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32200K .......... .......... .......... .......... .......... 34% 344M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32250K .......... .......... .......... .......... .......... 34% 356M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32300K .......... .......... .......... .......... .......... 34% 308M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32350K .......... .......... .......... .......... .......... 34% 284M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32400K .......... .......... .......... .......... .......... 34% 294M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32450K .......... .......... .......... .......... .......... 34% 276M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32500K .......... .......... .......... .......... .......... 35% 317M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32550K .......... .......... .......... .......... .......... 35% 278M 0s 2024-09-12T17:48:11.536 INFO:teuthology.orchestra.run.smithi063.stderr: 32600K .......... .......... .......... .......... .......... 35% 354M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 32650K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 32700K .......... .......... .......... .......... .......... 35% 377M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 32750K .......... .......... .......... .......... .......... 35% 286M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 32800K .......... .......... .......... .......... .......... 35% 321M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 32850K .......... .......... .......... .......... .......... 35% 344M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 32900K .......... .......... .......... .......... .......... 35% 333M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 32950K .......... .......... .......... .......... .......... 35% 321M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 33000K .......... .......... .......... .......... .......... 35% 300M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 33050K .......... .......... .......... .......... .......... 35% 357M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 33100K .......... .......... .......... .......... .......... 35% 341M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 33150K .......... .......... .......... .......... .......... 35% 286M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 33200K .......... .......... .......... .......... .......... 35% 345M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 33250K .......... .......... .......... .......... .......... 35% 359M 0s 2024-09-12T17:48:11.537 INFO:teuthology.orchestra.run.smithi063.stderr: 33300K .......... .......... .......... .......... .......... 35% 347M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33350K .......... .......... .......... .......... .......... 35% 278M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33400K .......... .......... .......... .......... .......... 36% 351M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33450K .......... .......... .......... .......... .......... 36% 352M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33500K .......... .......... .......... .......... .......... 36% 359M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33550K .......... .......... .......... .......... .......... 36% 265M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33600K .......... .......... .......... .......... .......... 36% 266M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33650K .......... .......... .......... .......... .......... 36% 297M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33700K .......... .......... .......... .......... .......... 36% 293M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33750K .......... .......... .......... .......... .......... 36% 271M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33800K .......... .......... .......... .......... .......... 36% 332M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33850K .......... .......... .......... .......... .......... 36% 338M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33900K .......... .......... .......... .......... .......... 36% 313M 0s 2024-09-12T17:48:11.538 INFO:teuthology.orchestra.run.smithi063.stderr: 33950K .......... .......... .......... .......... .......... 36% 271M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34000K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34050K .......... .......... .......... .......... .......... 36% 329M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34100K .......... .......... .......... .......... .......... 36% 350M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34150K .......... .......... .......... .......... .......... 36% 331M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34200K .......... .......... .......... .......... .......... 36% 373M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34250K .......... .......... .......... .......... .......... 36% 133M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34300K .......... .......... .......... .......... .......... 36% 47.9M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34350K .......... .......... .......... .......... .......... 37% 283M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34400K .......... .......... .......... .......... .......... 37% 323M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34450K .......... .......... .......... .......... .......... 37% 110M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34500K .......... .......... .......... .......... .......... 37% 320M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34550K .......... .......... .......... .......... .......... 37% 267M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34600K .......... .......... .......... .......... .......... 37% 101M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34650K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-12T17:48:11.539 INFO:teuthology.orchestra.run.smithi063.stderr: 34700K .......... .......... .......... .......... .......... 37% 341M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 34750K .......... .......... .......... .......... .......... 37% 299M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 34800K .......... .......... .......... .......... .......... 37% 338M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 34850K .......... .......... .......... .......... .......... 37% 294M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 34900K .......... .......... .......... .......... .......... 37% 311M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 34950K .......... .......... .......... .......... .......... 37% 271M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35000K .......... .......... .......... .......... .......... 37% 365M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35050K .......... .......... .......... .......... .......... 37% 367M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35100K .......... .......... .......... .......... .......... 37% 81.1M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35150K .......... .......... .......... .......... .......... 37% 120M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35200K .......... .......... .......... .......... .......... 37% 221M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35250K .......... .......... .......... .......... .......... 37% 280M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35300K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35350K .......... .......... .......... .......... .......... 38% 323M 0s 2024-09-12T17:48:11.540 INFO:teuthology.orchestra.run.smithi063.stderr: 35400K .......... .......... .......... .......... .......... 38% 288M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35450K .......... .......... .......... .......... .......... 38% 360M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35500K .......... .......... .......... .......... .......... 38% 331M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35550K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35600K .......... .......... .......... .......... .......... 38% 352M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35650K .......... .......... .......... .......... .......... 38% 342M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35700K .......... .......... .......... .......... .......... 38% 361M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35750K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35800K .......... .......... .......... .......... .......... 38% 352M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35850K .......... .......... .......... .......... .......... 38% 333M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35900K .......... .......... .......... .......... .......... 38% 331M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 35950K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 36000K .......... .......... .......... .......... .......... 38% 366M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 36050K .......... .......... .......... .......... .......... 38% 356M 0s 2024-09-12T17:48:11.541 INFO:teuthology.orchestra.run.smithi063.stderr: 36100K .......... .......... .......... .......... .......... 38% 329M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36150K .......... .......... .......... .......... .......... 38% 295M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36200K .......... .......... .......... .......... .......... 39% 343M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36250K .......... .......... .......... .......... .......... 39% 345M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36300K .......... .......... .......... .......... .......... 39% 340M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36350K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36400K .......... .......... .......... .......... .......... 39% 363M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36450K .......... .......... .......... .......... .......... 39% 337M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36500K .......... .......... .......... .......... .......... 39% 342M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36550K .......... .......... .......... .......... .......... 39% 308M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36600K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36650K .......... .......... .......... .......... .......... 39% 265M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36700K .......... .......... .......... .......... .......... 39% 349M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36750K .......... .......... .......... .......... .......... 39% 245M 0s 2024-09-12T17:48:11.542 INFO:teuthology.orchestra.run.smithi063.stderr: 36800K .......... .......... .......... .......... .......... 39% 263M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 36850K .......... .......... .......... .......... .......... 39% 265M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 36900K .......... .......... .......... .......... .......... 39% 363M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 36950K .......... .......... .......... .......... .......... 39% 291M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37000K .......... .......... .......... .......... .......... 39% 338M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37050K .......... .......... .......... .......... .......... 39% 357M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37100K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37150K .......... .......... .......... .......... .......... 40% 294M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37200K .......... .......... .......... .......... .......... 40% 136M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37250K .......... .......... .......... .......... .......... 40% 342M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37300K .......... .......... .......... .......... .......... 40% 353M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37350K .......... .......... .......... .......... .......... 40% 204M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37400K .......... .......... .......... .......... .......... 40% 56.0M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37450K .......... .......... .......... .......... .......... 40% 354M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37500K .......... .......... .......... .......... .......... 40% 333M 0s 2024-09-12T17:48:11.543 INFO:teuthology.orchestra.run.smithi063.stderr: 37550K .......... .......... .......... .......... .......... 40% 185M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37600K .......... .......... .......... .......... .......... 40% 336M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37650K .......... .......... .......... .......... .......... 40% 130M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37700K .......... .......... .......... .......... .......... 40% 142M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37750K .......... .......... .......... .......... .......... 40% 312M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37800K .......... .......... .......... .......... .......... 40% 362M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37850K .......... .......... .......... .......... .......... 40% 293M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37900K .......... .......... .......... .......... .......... 40% 339M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 37950K .......... .......... .......... .......... .......... 40% 285M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38000K .......... .......... .......... .......... .......... 40% 331M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38050K .......... .......... .......... .......... .......... 41% 361M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38100K .......... .......... .......... .......... .......... 41% 77.6M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38150K .......... .......... .......... .......... .......... 41% 298M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38200K .......... .......... .......... .......... .......... 41% 225M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38250K .......... .......... .......... .......... .......... 41% 273M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38300K .......... .......... .......... .......... .......... 41% 267M 0s 2024-09-12T17:48:11.544 INFO:teuthology.orchestra.run.smithi063.stderr: 38350K .......... .......... .......... .......... .......... 41% 179M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38400K .......... .......... .......... .......... .......... 41% 198M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38450K .......... .......... .......... .......... .......... 41% 353M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38500K .......... .......... .......... .......... .......... 41% 344M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38550K .......... .......... .......... .......... .......... 41% 320M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38600K .......... .......... .......... .......... .......... 41% 152M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38650K .......... .......... .......... .......... .......... 41% 259M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38700K .......... .......... .......... .......... .......... 41% 322M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38750K .......... .......... .......... .......... .......... 41% 299M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38800K .......... .......... .......... .......... .......... 41% 348M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38850K .......... .......... .......... .......... .......... 41% 355M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38900K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 38950K .......... .......... .......... .......... .......... 41% 309M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 39000K .......... .......... .......... .......... .......... 42% 361M 0s 2024-09-12T17:48:11.545 INFO:teuthology.orchestra.run.smithi063.stderr: 39050K .......... .......... .......... .......... .......... 42% 364M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39100K .......... .......... .......... .......... .......... 42% 348M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39150K .......... .......... .......... .......... .......... 42% 282M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39200K .......... .......... .......... .......... .......... 42% 350M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39250K .......... .......... .......... .......... .......... 42% 367M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39300K .......... .......... .......... .......... .......... 42% 355M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39350K .......... .......... .......... .......... .......... 42% 294M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39400K .......... .......... .......... .......... .......... 42% 348M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39450K .......... .......... .......... .......... .......... 42% 319M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39500K .......... .......... .......... .......... .......... 42% 363M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39550K .......... .......... .......... .......... .......... 42% 304M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39600K .......... .......... .......... .......... .......... 42% 347M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39650K .......... .......... .......... .......... .......... 42% 350M 0s 2024-09-12T17:48:11.546 INFO:teuthology.orchestra.run.smithi063.stderr: 39700K .......... .......... .......... .......... .......... 42% 337M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 39750K .......... .......... .......... .......... .......... 42% 315M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 39800K .......... .......... .......... .......... .......... 42% 304M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 39850K .......... .......... .......... .......... .......... 42% 340M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 39900K .......... .......... .......... .......... .......... 43% 362M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 39950K .......... .......... .......... .......... .......... 43% 290M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40000K .......... .......... .......... .......... .......... 43% 334M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40050K .......... .......... .......... .......... .......... 43% 342M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40100K .......... .......... .......... .......... .......... 43% 77.4M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40150K .......... .......... .......... .......... .......... 43% 314M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40200K .......... .......... .......... .......... .......... 43% 344M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40250K .......... .......... .......... .......... .......... 43% 348M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40300K .......... .......... .......... .......... .......... 43% 369M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40350K .......... .......... .......... .......... .......... 43% 69.6M 0s 2024-09-12T17:48:11.547 INFO:teuthology.orchestra.run.smithi063.stderr: 40400K .......... .......... .......... .......... .......... 43% 244M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40450K .......... .......... .......... .......... .......... 43% 345M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40500K .......... .......... .......... .......... .......... 43% 347M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40550K .......... .......... .......... .......... .......... 43% 316M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40600K .......... .......... .......... .......... .......... 43% 328M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40650K .......... .......... .......... .......... .......... 43% 356M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40700K .......... .......... .......... .......... .......... 43% 239M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40750K .......... .......... .......... .......... .......... 43% 118M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40800K .......... .......... .......... .......... .......... 43% 165M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40850K .......... .......... .......... .......... .......... 44% 319M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40900K .......... .......... .......... .......... .......... 44% 389M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 40950K .......... .......... .......... .......... .......... 44% 347M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 41000K .......... .......... .......... .......... .......... 44% 264M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 41050K .......... .......... .......... .......... .......... 44% 298M 0s 2024-09-12T17:48:11.548 INFO:teuthology.orchestra.run.smithi063.stderr: 41100K .......... .......... .......... .......... .......... 44% 62.5M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41150K .......... .......... .......... .......... .......... 44% 290M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41200K .......... .......... .......... .......... .......... 44% 276M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41250K .......... .......... .......... .......... .......... 44% 272M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41300K .......... .......... .......... .......... .......... 44% 332M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41350K .......... .......... .......... .......... .......... 44% 326M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41400K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41450K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41500K .......... .......... .......... .......... .......... 44% 349M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41550K .......... .......... .......... .......... .......... 44% 342M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41600K .......... .......... .......... .......... .......... 44% 320M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41650K .......... .......... .......... .......... .......... 44% 181M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41700K .......... .......... .......... .......... .......... 44% 147M 0s 2024-09-12T17:48:11.549 INFO:teuthology.orchestra.run.smithi063.stderr: 41750K .......... .......... .......... .......... .......... 44% 229M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 41800K .......... .......... .......... .......... .......... 45% 347M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 41850K .......... .......... .......... .......... .......... 45% 331M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 41900K .......... .......... .......... .......... .......... 45% 350M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 41950K .......... .......... .......... .......... .......... 45% 290M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42000K .......... .......... .......... .......... .......... 45% 354M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42050K .......... .......... .......... .......... .......... 45% 354M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42100K .......... .......... .......... .......... .......... 45% 345M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42150K .......... .......... .......... .......... .......... 45% 179M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42200K .......... .......... .......... .......... .......... 45% 275M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42250K .......... .......... .......... .......... .......... 45% 314M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42300K .......... .......... .......... .......... .......... 45% 323M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42350K .......... .......... .......... .......... .......... 45% 288M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42400K .......... .......... .......... .......... .......... 45% 136M 0s 2024-09-12T17:48:11.550 INFO:teuthology.orchestra.run.smithi063.stderr: 42450K .......... .......... .......... .......... .......... 45% 276M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42500K .......... .......... .......... .......... .......... 45% 360M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42550K .......... .......... .......... .......... .......... 45% 300M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42600K .......... .......... .......... .......... .......... 45% 332M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42650K .......... .......... .......... .......... .......... 45% 346M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42700K .......... .......... .......... .......... .......... 46% 323M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42750K .......... .......... .......... .......... .......... 46% 257M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42800K .......... .......... .......... .......... .......... 46% 346M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42850K .......... .......... .......... .......... .......... 46% 362M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42900K .......... .......... .......... .......... .......... 46% 352M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 42950K .......... .......... .......... .......... .......... 46% 318M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 43000K .......... .......... .......... .......... .......... 46% 357M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 43050K .......... .......... .......... .......... .......... 46% 343M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 43100K .......... .......... .......... .......... .......... 46% 354M 0s 2024-09-12T17:48:11.551 INFO:teuthology.orchestra.run.smithi063.stderr: 43150K .......... .......... .......... .......... .......... 46% 185M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43200K .......... .......... .......... .......... .......... 46% 348M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43250K .......... .......... .......... .......... .......... 46% 363M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43300K .......... .......... .......... .......... .......... 46% 53.8M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43350K .......... .......... .......... .......... .......... 46% 210M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43400K .......... .......... .......... .......... .......... 46% 327M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43450K .......... .......... .......... .......... .......... 46% 355M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43500K .......... .......... .......... .......... .......... 46% 345M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43550K .......... .......... .......... .......... .......... 46% 273M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43600K .......... .......... .......... .......... .......... 46% 344M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43650K .......... .......... .......... .......... .......... 47% 339M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43700K .......... .......... .......... .......... .......... 47% 359M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43750K .......... .......... .......... .......... .......... 47% 298M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43800K .......... .......... .......... .......... .......... 47% 245M 0s 2024-09-12T17:48:11.552 INFO:teuthology.orchestra.run.smithi063.stderr: 43850K .......... .......... .......... .......... .......... 47% 303M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 43900K .......... .......... .......... .......... .......... 47% 346M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 43950K .......... .......... .......... .......... .......... 47% 175M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44000K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44050K .......... .......... .......... .......... .......... 47% 355M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44100K .......... .......... .......... .......... .......... 47% 63.9M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44150K .......... .......... .......... .......... .......... 47% 283M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44200K .......... .......... .......... .......... .......... 47% 335M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44250K .......... .......... .......... .......... .......... 47% 243M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44300K .......... .......... .......... .......... .......... 47% 314M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44350K .......... .......... .......... .......... .......... 47% 264M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44400K .......... .......... .......... .......... .......... 47% 362M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44450K .......... .......... .......... .......... .......... 47% 156M 0s 2024-09-12T17:48:11.553 INFO:teuthology.orchestra.run.smithi063.stderr: 44500K .......... .......... .......... .......... .......... 47% 314M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44550K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44600K .......... .......... .......... .......... .......... 48% 358M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44650K .......... .......... .......... .......... .......... 48% 333M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44700K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44750K .......... .......... .......... .......... .......... 48% 272M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44800K .......... .......... .......... .......... .......... 48% 165M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44850K .......... .......... .......... .......... .......... 48% 347M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44900K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 44950K .......... .......... .......... .......... .......... 48% 320M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 45000K .......... .......... .......... .......... .......... 48% 320M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 45050K .......... .......... .......... .......... .......... 48% 310M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 45100K .......... .......... .......... .......... .......... 48% 327M 0s 2024-09-12T17:48:11.554 INFO:teuthology.orchestra.run.smithi063.stderr: 45150K .......... .......... .......... .......... .......... 48% 290M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45200K .......... .......... .......... .......... .......... 48% 160M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45250K .......... .......... .......... .......... .......... 48% 308M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45300K .......... .......... .......... .......... .......... 48% 335M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45350K .......... .......... .......... .......... .......... 48% 116M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45400K .......... .......... .......... .......... .......... 48% 208M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45450K .......... .......... .......... .......... .......... 48% 324M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45500K .......... .......... .......... .......... .......... 49% 317M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45550K .......... .......... .......... .......... .......... 49% 270M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45600K .......... .......... .......... .......... .......... 49% 337M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45650K .......... .......... .......... .......... .......... 49% 226M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45700K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45750K .......... .......... .......... .......... .......... 49% 280M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45800K .......... .......... .......... .......... .......... 49% 293M 0s 2024-09-12T17:48:11.555 INFO:teuthology.orchestra.run.smithi063.stderr: 45850K .......... .......... .......... .......... .......... 49% 338M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 45900K .......... .......... .......... .......... .......... 49% 340M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 45950K .......... .......... .......... .......... .......... 49% 296M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46000K .......... .......... .......... .......... .......... 49% 359M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46050K .......... .......... .......... .......... .......... 49% 322M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46100K .......... .......... .......... .......... .......... 49% 283M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46150K .......... .......... .......... .......... .......... 49% 322M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46200K .......... .......... .......... .......... .......... 49% 378M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46250K .......... .......... .......... .......... .......... 49% 322M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46300K .......... .......... .......... .......... .......... 49% 70.4M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46350K .......... .......... .......... .......... .......... 49% 300M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46400K .......... .......... .......... .......... .......... 49% 351M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46450K .......... .......... .......... .......... .......... 50% 346M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46500K .......... .......... .......... .......... .......... 50% 337M 0s 2024-09-12T17:48:11.556 INFO:teuthology.orchestra.run.smithi063.stderr: 46550K .......... .......... .......... .......... .......... 50% 305M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46600K .......... .......... .......... .......... .......... 50% 320M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46650K .......... .......... .......... .......... .......... 50% 354M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46700K .......... .......... .......... .......... .......... 50% 351M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46750K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46800K .......... .......... .......... .......... .......... 50% 294M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46850K .......... .......... .......... .......... .......... 50% 200M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46900K .......... .......... .......... .......... .......... 50% 231M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 46950K .......... .......... .......... .......... .......... 50% 195M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 47000K .......... .......... .......... .......... .......... 50% 310M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 47050K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 47100K .......... .......... .......... .......... .......... 50% 78.5M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 47150K .......... .......... .......... .......... .......... 50% 285M 0s 2024-09-12T17:48:11.557 INFO:teuthology.orchestra.run.smithi063.stderr: 47200K .......... .......... .......... .......... .......... 50% 352M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47250K .......... .......... .......... .......... .......... 50% 217M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47300K .......... .......... .......... .......... .......... 50% 330M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47350K .......... .......... .......... .......... .......... 51% 315M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47400K .......... .......... .......... .......... .......... 51% 345M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47450K .......... .......... .......... .......... .......... 51% 81.8M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47500K .......... .......... .......... .......... .......... 51% 335M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47550K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47600K .......... .......... .......... .......... .......... 51% 343M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47650K .......... .......... .......... .......... .......... 51% 350M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47700K .......... .......... .......... .......... .......... 51% 347M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47750K .......... .......... .......... .......... .......... 51% 312M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47800K .......... .......... .......... .......... .......... 51% 342M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47850K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47900K .......... .......... .......... .......... .......... 51% 329M 0s 2024-09-12T17:48:11.558 INFO:teuthology.orchestra.run.smithi063.stderr: 47950K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48000K .......... .......... .......... .......... .......... 51% 354M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48050K .......... .......... .......... .......... .......... 51% 167M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48100K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48150K .......... .......... .......... .......... .......... 51% 310M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48200K .......... .......... .......... .......... .......... 51% 269M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48250K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48300K .......... .......... .......... .......... .......... 52% 359M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48350K .......... .......... .......... .......... .......... 52% 112M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48400K .......... .......... .......... .......... .......... 52% 332M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48450K .......... .......... .......... .......... .......... 52% 353M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48500K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48550K .......... .......... .......... .......... .......... 52% 300M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48600K .......... .......... .......... .......... .......... 52% 349M 0s 2024-09-12T17:48:11.559 INFO:teuthology.orchestra.run.smithi063.stderr: 48650K .......... .......... .......... .......... .......... 52% 352M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 48700K .......... .......... .......... .......... .......... 52% 342M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 48750K .......... .......... .......... .......... .......... 52% 225M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 48800K .......... .......... .......... .......... .......... 52% 351M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 48850K .......... .......... .......... .......... .......... 52% 199M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 48900K .......... .......... .......... .......... .......... 52% 256M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 48950K .......... .......... .......... .......... .......... 52% 300M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49000K .......... .......... .......... .......... .......... 52% 324M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49050K .......... .......... .......... .......... .......... 52% 90.3M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49100K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49150K .......... .......... .......... .......... .......... 52% 275M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49200K .......... .......... .......... .......... .......... 53% 348M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49250K .......... .......... .......... .......... .......... 53% 368M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49300K .......... .......... .......... .......... .......... 53% 353M 0s 2024-09-12T17:48:11.560 INFO:teuthology.orchestra.run.smithi063.stderr: 49350K .......... .......... .......... .......... .......... 53% 170M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49400K .......... .......... .......... .......... .......... 53% 118M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49450K .......... .......... .......... .......... .......... 53% 182M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49500K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49550K .......... .......... .......... .......... .......... 53% 283M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49600K .......... .......... .......... .......... .......... 53% 327M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49650K .......... .......... .......... .......... .......... 53% 323M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49700K .......... .......... .......... .......... .......... 53% 340M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49750K .......... .......... .......... .......... .......... 53% 297M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49800K .......... .......... .......... .......... .......... 53% 358M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49850K .......... .......... .......... .......... .......... 53% 347M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49900K .......... .......... .......... .......... .......... 53% 322M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 49950K .......... .......... .......... .......... .......... 53% 291M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 50000K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-12T17:48:11.561 INFO:teuthology.orchestra.run.smithi063.stderr: 50050K .......... .......... .......... .......... .......... 53% 352M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50100K .......... .......... .......... .......... .......... 53% 81.0M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50150K .......... .......... .......... .......... .......... 54% 248M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50200K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50250K .......... .......... .......... .......... .......... 54% 351M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50300K .......... .......... .......... .......... .......... 54% 234M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50350K .......... .......... .......... .......... .......... 54% 190M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50400K .......... .......... .......... .......... .......... 54% 302M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50450K .......... .......... .......... .......... .......... 54% 344M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50500K .......... .......... .......... .......... .......... 54% 213M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50550K .......... .......... .......... .......... .......... 54% 156M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50600K .......... .......... .......... .......... .......... 54% 326M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50650K .......... .......... .......... .......... .......... 54% 345M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50700K .......... .......... .......... .......... .......... 54% 329M 0s 2024-09-12T17:48:11.562 INFO:teuthology.orchestra.run.smithi063.stderr: 50750K .......... .......... .......... .......... .......... 54% 279M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 50800K .......... .......... .......... .......... .......... 54% 339M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 50850K .......... .......... .......... .......... .......... 54% 337M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 50900K .......... .......... .......... .......... .......... 54% 345M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 50950K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51000K .......... .......... .......... .......... .......... 54% 200M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51050K .......... .......... .......... .......... .......... 55% 188M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51100K .......... .......... .......... .......... .......... 55% 352M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51150K .......... .......... .......... .......... .......... 55% 290M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51200K .......... .......... .......... .......... .......... 55% 282M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51250K .......... .......... .......... .......... .......... 55% 361M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51300K .......... .......... .......... .......... .......... 55% 85.4M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51350K .......... .......... .......... .......... .......... 55% 341M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51400K .......... .......... .......... .......... .......... 55% 346M 0s 2024-09-12T17:48:11.563 INFO:teuthology.orchestra.run.smithi063.stderr: 51450K .......... .......... .......... .......... .......... 55% 294M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51500K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51550K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51600K .......... .......... .......... .......... .......... 55% 325M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51650K .......... .......... .......... .......... .......... 55% 294M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51700K .......... .......... .......... .......... .......... 55% 278M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51750K .......... .......... .......... .......... .......... 55% 276M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51800K .......... .......... .......... .......... .......... 55% 313M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51850K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51900K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 51950K .......... .......... .......... .......... .......... 55% 343M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 52000K .......... .......... .......... .......... .......... 56% 343M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 52050K .......... .......... .......... .......... .......... 56% 359M 0s 2024-09-12T17:48:11.564 INFO:teuthology.orchestra.run.smithi063.stderr: 52100K .......... .......... .......... .......... .......... 56% 174M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52150K .......... .......... .......... .......... .......... 56% 113M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52200K .......... .......... .......... .......... .......... 56% 84.6M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52250K .......... .......... .......... .......... .......... 56% 264M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52300K .......... .......... .......... .......... .......... 56% 288M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52350K .......... .......... .......... .......... .......... 56% 346M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52400K .......... .......... .......... .......... .......... 56% 352M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52450K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52500K .......... .......... .......... .......... .......... 56% 91.9M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52550K .......... .......... .......... .......... .......... 56% 309M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52600K .......... .......... .......... .......... .......... 56% 332M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52650K .......... .......... .......... .......... .......... 56% 333M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52700K .......... .......... .......... .......... .......... 56% 261M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52750K .......... .......... .......... .......... .......... 56% 340M 0s 2024-09-12T17:48:11.565 INFO:teuthology.orchestra.run.smithi063.stderr: 52800K .......... .......... .......... .......... .......... 56% 353M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 52850K .......... .......... .......... .......... .......... 56% 339M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 52900K .......... .......... .......... .......... .......... 56% 310M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 52950K .......... .......... .......... .......... .......... 57% 338M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53000K .......... .......... .......... .......... .......... 57% 345M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53050K .......... .......... .......... .......... .......... 57% 330M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53100K .......... .......... .......... .......... .......... 57% 187M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53150K .......... .......... .......... .......... .......... 57% 335M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53200K .......... .......... .......... .......... .......... 57% 316M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53250K .......... .......... .......... .......... .......... 57% 321M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53300K .......... .......... .......... .......... .......... 57% 256M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53350K .......... .......... .......... .......... .......... 57% 329M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53400K .......... .......... .......... .......... .......... 57% 328M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53450K .......... .......... .......... .......... .......... 57% 204M 0s 2024-09-12T17:48:11.566 INFO:teuthology.orchestra.run.smithi063.stderr: 53500K .......... .......... .......... .......... .......... 57% 170M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53550K .......... .......... .......... .......... .......... 57% 309M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53600K .......... .......... .......... .......... .......... 57% 101M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53650K .......... .......... .......... .......... .......... 57% 333M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53700K .......... .......... .......... .......... .......... 57% 303M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53750K .......... .......... .......... .......... .......... 57% 325M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53800K .......... .......... .......... .......... .......... 57% 341M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53850K .......... .......... .......... .......... .......... 58% 348M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53900K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 53950K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 54000K .......... .......... .......... .......... .......... 58% 331M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 54050K .......... .......... .......... .......... .......... 58% 353M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 54100K .......... .......... .......... .......... .......... 58% 291M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 54150K .......... .......... .......... .......... .......... 58% 358M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 54200K .......... .......... .......... .......... .......... 58% 326M 0s 2024-09-12T17:48:11.567 INFO:teuthology.orchestra.run.smithi063.stderr: 54250K .......... .......... .......... .......... .......... 58% 338M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54300K .......... .......... .......... .......... .......... 58% 288M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54350K .......... .......... .......... .......... .......... 58% 99.6M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54400K .......... .......... .......... .......... .......... 58% 308M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54450K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54500K .......... .......... .......... .......... .......... 58% 305M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54550K .......... .......... .......... .......... .......... 58% 279M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54600K .......... .......... .......... .......... .......... 58% 353M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54650K .......... .......... .......... .......... .......... 58% 193M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54700K .......... .......... .......... .......... .......... 58% 256M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54750K .......... .......... .......... .......... .......... 58% 318M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54800K .......... .......... .......... .......... .......... 59% 320M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54850K .......... .......... .......... .......... .......... 59% 346M 0s 2024-09-12T17:48:11.568 INFO:teuthology.orchestra.run.smithi063.stderr: 54900K .......... .......... .......... .......... .......... 59% 263M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 54950K .......... .......... .......... .......... .......... 59% 200M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55000K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55050K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55100K .......... .......... .......... .......... .......... 59% 268M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55150K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55200K .......... .......... .......... .......... .......... 59% 307M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55250K .......... .......... .......... .......... .......... 59% 79.0M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55300K .......... .......... .......... .......... .......... 59% 200M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55350K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55400K .......... .......... .......... .......... .......... 59% 349M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55450K .......... .......... .......... .......... .......... 59% 329M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55500K .......... .......... .......... .......... .......... 59% 254M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55550K .......... .......... .......... .......... .......... 59% 101M 0s 2024-09-12T17:48:11.569 INFO:teuthology.orchestra.run.smithi063.stderr: 55600K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 55650K .......... .......... .......... .......... .......... 59% 68.5M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 55700K .......... .......... .......... .......... .......... 60% 299M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 55750K .......... .......... .......... .......... .......... 60% 321M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 55800K .......... .......... .......... .......... .......... 60% 352M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 55850K .......... .......... .......... .......... .......... 60% 331M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 55900K .......... .......... .......... .......... .......... 60% 289M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 55950K .......... .......... .......... .......... .......... 60% 358M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 56000K .......... .......... .......... .......... .......... 60% 153M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 56050K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 56100K .......... .......... .......... .......... .......... 60% 290M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 56150K .......... .......... .......... .......... .......... 60% 339M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 56200K .......... .......... .......... .......... .......... 60% 359M 0s 2024-09-12T17:48:11.570 INFO:teuthology.orchestra.run.smithi063.stderr: 56250K .......... .......... .......... .......... .......... 60% 349M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56300K .......... .......... .......... .......... .......... 60% 279M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56350K .......... .......... .......... .......... .......... 60% 346M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56400K .......... .......... .......... .......... .......... 60% 343M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56450K .......... .......... .......... .......... .......... 60% 359M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56500K .......... .......... .......... .......... .......... 60% 321M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56550K .......... .......... .......... .......... .......... 60% 357M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56600K .......... .......... .......... .......... .......... 60% 134M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56650K .......... .......... .......... .......... .......... 61% 359M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56700K .......... .......... .......... .......... .......... 61% 284M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56750K .......... .......... .......... .......... .......... 61% 307M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56800K .......... .......... .......... .......... .......... 61% 329M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56850K .......... .......... .......... .......... .......... 61% 349M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56900K .......... .......... .......... .......... .......... 61% 261M 0s 2024-09-12T17:48:11.571 INFO:teuthology.orchestra.run.smithi063.stderr: 56950K .......... .......... .......... .......... .......... 61% 307M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57000K .......... .......... .......... .......... .......... 61% 306M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57050K .......... .......... .......... .......... .......... 61% 317M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57100K .......... .......... .......... .......... .......... 61% 286M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57150K .......... .......... .......... .......... .......... 61% 329M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57200K .......... .......... .......... .......... .......... 61% 336M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57250K .......... .......... .......... .......... .......... 61% 325M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57300K .......... .......... .......... .......... .......... 61% 314M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57350K .......... .......... .......... .......... .......... 61% 124M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57400K .......... .......... .......... .......... .......... 61% 303M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57450K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57500K .......... .......... .......... .......... .......... 61% 274M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57550K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57600K .......... .......... .......... .......... .......... 62% 338M 0s 2024-09-12T17:48:11.572 INFO:teuthology.orchestra.run.smithi063.stderr: 57650K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 57700K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 57750K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 57800K .......... .......... .......... .......... .......... 62% 318M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 57850K .......... .......... .......... .......... .......... 62% 245M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 57900K .......... .......... .......... .......... .......... 62% 192M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 57950K .......... .......... .......... .......... .......... 62% 330M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 58000K .......... .......... .......... .......... .......... 62% 317M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 58050K .......... .......... .......... .......... .......... 62% 196M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 58100K .......... .......... .......... .......... .......... 62% 298M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 58150K .......... .......... .......... .......... .......... 62% 350M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 58200K .......... .......... .......... .......... .......... 62% 343M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 58250K .......... .......... .......... .......... .......... 62% 348M 0s 2024-09-12T17:48:11.573 INFO:teuthology.orchestra.run.smithi063.stderr: 58300K .......... .......... .......... .......... .......... 62% 115M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58350K .......... .......... .......... .......... .......... 62% 89.6M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58400K .......... .......... .......... .......... .......... 62% 330M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58450K .......... .......... .......... .......... .......... 62% 331M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58500K .......... .......... .......... .......... .......... 63% 288M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58550K .......... .......... .......... .......... .......... 63% 350M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58600K .......... .......... .......... .......... .......... 63% 351M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58650K .......... .......... .......... .......... .......... 63% 222M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58700K .......... .......... .......... .......... .......... 63% 54.2M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58750K .......... .......... .......... .......... .......... 63% 114M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58800K .......... .......... .......... .......... .......... 63% 272M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58850K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58900K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 58950K .......... .......... .......... .......... .......... 63% 354M 0s 2024-09-12T17:48:11.574 INFO:teuthology.orchestra.run.smithi063.stderr: 59000K .......... .......... .......... .......... .......... 63% 97.9M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59050K .......... .......... .......... .......... .......... 63% 263M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59100K .......... .......... .......... .......... .......... 63% 229M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59150K .......... .......... .......... .......... .......... 63% 333M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59200K .......... .......... .......... .......... .......... 63% 334M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59250K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59300K .......... .......... .......... .......... .......... 63% 326M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59350K .......... .......... .......... .......... .......... 63% 321M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59400K .......... .......... .......... .......... .......... 63% 342M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59450K .......... .......... .......... .......... .......... 64% 350M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59500K .......... .......... .......... .......... .......... 64% 292M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59550K .......... .......... .......... .......... .......... 64% 346M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59600K .......... .......... .......... .......... .......... 64% 346M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59650K .......... .......... .......... .......... .......... 64% 296M 0s 2024-09-12T17:48:11.575 INFO:teuthology.orchestra.run.smithi063.stderr: 59700K .......... .......... .......... .......... .......... 64% 346M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 59750K .......... .......... .......... .......... .......... 64% 345M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 59800K .......... .......... .......... .......... .......... 64% 291M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 59850K .......... .......... .......... .......... .......... 64% 311M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 59900K .......... .......... .......... .......... .......... 64% 336M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 59950K .......... .......... .......... .......... .......... 64% 339M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60000K .......... .......... .......... .......... .......... 64% 287M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60050K .......... .......... .......... .......... .......... 64% 361M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60100K .......... .......... .......... .......... .......... 64% 302M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60150K .......... .......... .......... .......... .......... 64% 341M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60200K .......... .......... .......... .......... .......... 64% 343M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60250K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60300K .......... .......... .......... .......... .......... 64% 288M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60350K .......... .......... .......... .......... .......... 65% 179M 0s 2024-09-12T17:48:11.576 INFO:teuthology.orchestra.run.smithi063.stderr: 60400K .......... .......... .......... .......... .......... 65% 294M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60450K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60500K .......... .......... .......... .......... .......... 65% 259M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60550K .......... .......... .......... .......... .......... 65% 331M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60600K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60650K .......... .......... .......... .......... .......... 65% 284M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60700K .......... .......... .......... .......... .......... 65% 240M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60750K .......... .......... .......... .......... .......... 65% 326M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60800K .......... .......... .......... .......... .......... 65% 336M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60850K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60900K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 60950K .......... .......... .......... .......... .......... 65% 339M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 61000K .......... .......... .......... .......... .......... 65% 339M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 61050K .......... .......... .......... .......... .......... 65% 347M 0s 2024-09-12T17:48:11.577 INFO:teuthology.orchestra.run.smithi063.stderr: 61100K .......... .......... .......... .......... .......... 65% 277M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61150K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61200K .......... .......... .......... .......... .......... 65% 330M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61250K .......... .......... .......... .......... .......... 65% 199M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61300K .......... .......... .......... .......... .......... 66% 308M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61350K .......... .......... .......... .......... .......... 66% 330M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61400K .......... .......... .......... .......... .......... 66% 300M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61450K .......... .......... .......... .......... .......... 66% 103M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61500K .......... .......... .......... .......... .......... 66% 178M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61550K .......... .......... .......... .......... .......... 66% 148M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61600K .......... .......... .......... .......... .......... 66% 289M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61650K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61700K .......... .......... .......... .......... .......... 66% 366M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61750K .......... .......... .......... .......... .......... 66% 75.1M 0s 2024-09-12T17:48:11.578 INFO:teuthology.orchestra.run.smithi063.stderr: 61800K .......... .......... .......... .......... .......... 66% 99.8M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 61850K .......... .......... .......... .......... .......... 66% 265M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 61900K .......... .......... .......... .......... .......... 66% 331M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 61950K .......... .......... .......... .......... .......... 66% 297M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62000K .......... .......... .......... .......... .......... 66% 91.5M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62050K .......... .......... .......... .......... .......... 66% 296M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62100K .......... .......... .......... .......... .......... 66% 356M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62150K .......... .......... .......... .......... .......... 66% 166M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62200K .......... .......... .......... .......... .......... 67% 287M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62250K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62300K .......... .......... .......... .......... .......... 67% 345M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62350K .......... .......... .......... .......... .......... 67% 284M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62400K .......... .......... .......... .......... .......... 67% 187M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62450K .......... .......... .......... .......... .......... 67% 329M 0s 2024-09-12T17:48:11.579 INFO:teuthology.orchestra.run.smithi063.stderr: 62500K .......... .......... .......... .......... .......... 67% 339M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62550K .......... .......... .......... .......... .......... 67% 316M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62600K .......... .......... .......... .......... .......... 67% 176M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62650K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62700K .......... .......... .......... .......... .......... 67% 333M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62750K .......... .......... .......... .......... .......... 67% 232M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62800K .......... .......... .......... .......... .......... 67% 355M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62850K .......... .......... .......... .......... .......... 67% 275M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62900K .......... .......... .......... .......... .......... 67% 350M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 62950K .......... .......... .......... .......... .......... 67% 289M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 63000K .......... .......... .......... .......... .......... 67% 298M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 63050K .......... .......... .......... .......... .......... 67% 285M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 63100K .......... .......... .......... .......... .......... 67% 349M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 63150K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-12T17:48:11.580 INFO:teuthology.orchestra.run.smithi063.stderr: 63200K .......... .......... .......... .......... .......... 68% 351M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63250K .......... .......... .......... .......... .......... 68% 330M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63300K .......... .......... .......... .......... .......... 68% 343M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63350K .......... .......... .......... .......... .......... 68% 322M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63400K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63450K .......... .......... .......... .......... .......... 68% 293M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63500K .......... .......... .......... .......... .......... 68% 344M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63550K .......... .......... .......... .......... .......... 68% 362M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63600K .......... .......... .......... .......... .......... 68% 347M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63650K .......... .......... .......... .......... .......... 68% 297M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63700K .......... .......... .......... .......... .......... 68% 346M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63750K .......... .......... .......... .......... .......... 68% 356M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63800K .......... .......... .......... .......... .......... 68% 342M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63850K .......... .......... .......... .......... .......... 68% 292M 0s 2024-09-12T17:48:11.581 INFO:teuthology.orchestra.run.smithi063.stderr: 63900K .......... .......... .......... .......... .......... 68% 351M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 63950K .......... .......... .......... .......... .......... 68% 277M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64000K .......... .......... .......... .......... .......... 68% 260M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64050K .......... .......... .......... .......... .......... 68% 312M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64100K .......... .......... .......... .......... .......... 69% 273M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64150K .......... .......... .......... .......... .......... 69% 286M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64200K .......... .......... .......... .......... .......... 69% 303M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64250K .......... .......... .......... .......... .......... 69% 304M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64300K .......... .......... .......... .......... .......... 69% 353M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64350K .......... .......... .......... .......... .......... 69% 153M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64400K .......... .......... .......... .......... .......... 69% 328M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64450K .......... .......... .......... .......... .......... 69% 344M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64500K .......... .......... .......... .......... .......... 69% 345M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64550K .......... .......... .......... .......... .......... 69% 152M 0s 2024-09-12T17:48:11.582 INFO:teuthology.orchestra.run.smithi063.stderr: 64600K .......... .......... .......... .......... .......... 69% 261M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 64650K .......... .......... .......... .......... .......... 69% 357M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 64700K .......... .......... .......... .......... .......... 69% 128M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 64750K .......... .......... .......... .......... .......... 69% 76.5M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 64800K .......... .......... .......... .......... .......... 69% 349M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 64850K .......... .......... .......... .......... .......... 69% 133M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 64900K .......... .......... .......... .......... .......... 69% 281M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 64950K .......... .......... .......... .......... .......... 69% 244M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65000K .......... .......... .......... .......... .......... 70% 294M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65050K .......... .......... .......... .......... .......... 70% 78.1M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65100K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65150K .......... .......... .......... .......... .......... 70% 297M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65200K .......... .......... .......... .......... .......... 70% 111M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65250K .......... .......... .......... .......... .......... 70% 231M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65300K .......... .......... .......... .......... .......... 70% 349M 0s 2024-09-12T17:48:11.583 INFO:teuthology.orchestra.run.smithi063.stderr: 65350K .......... .......... .......... .......... .......... 70% 217M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65400K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65450K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65500K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65550K .......... .......... .......... .......... .......... 70% 170M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65600K .......... .......... .......... .......... .......... 70% 261M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65650K .......... .......... .......... .......... .......... 70% 317M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65700K .......... .......... .......... .......... .......... 70% 370M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65750K .......... .......... .......... .......... .......... 70% 286M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65800K .......... .......... .......... .......... .......... 70% 341M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65850K .......... .......... .......... .......... .......... 70% 351M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65900K .......... .......... .......... .......... .......... 70% 346M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 65950K .......... .......... .......... .......... .......... 71% 285M 0s 2024-09-12T17:48:11.584 INFO:teuthology.orchestra.run.smithi063.stderr: 66000K .......... .......... .......... .......... .......... 71% 362M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66050K .......... .......... .......... .......... .......... 71% 346M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66100K .......... .......... .......... .......... .......... 71% 359M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66150K .......... .......... .......... .......... .......... 71% 310M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66200K .......... .......... .......... .......... .......... 71% 269M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66250K .......... .......... .......... .......... .......... 71% 194M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66300K .......... .......... .......... .......... .......... 71% 346M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66350K .......... .......... .......... .......... .......... 71% 300M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66400K .......... .......... .......... .......... .......... 71% 362M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66450K .......... .......... .......... .......... .......... 71% 355M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66500K .......... .......... .......... .......... .......... 71% 272M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66550K .......... .......... .......... .......... .......... 71% 256M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66600K .......... .......... .......... .......... .......... 71% 293M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66650K .......... .......... .......... .......... .......... 71% 271M 0s 2024-09-12T17:48:11.585 INFO:teuthology.orchestra.run.smithi063.stderr: 66700K .......... .......... .......... .......... .......... 71% 353M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 66750K .......... .......... .......... .......... .......... 71% 258M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 66800K .......... .......... .......... .......... .......... 71% 262M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 66850K .......... .......... .......... .......... .......... 72% 297M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 66900K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 66950K .......... .......... .......... .......... .......... 72% 320M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67000K .......... .......... .......... .......... .......... 72% 357M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67050K .......... .......... .......... .......... .......... 72% 335M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67100K .......... .......... .......... .......... .......... 72% 339M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67150K .......... .......... .......... .......... .......... 72% 291M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67200K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67250K .......... .......... .......... .......... .......... 72% 360M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67300K .......... .......... .......... .......... .......... 72% 340M 0s 2024-09-12T17:48:11.586 INFO:teuthology.orchestra.run.smithi063.stderr: 67350K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67400K .......... .......... .......... .......... .......... 72% 213M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67450K .......... .......... .......... .......... .......... 72% 348M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67500K .......... .......... .......... .......... .......... 72% 329M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67550K .......... .......... .......... .......... .......... 72% 286M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67600K .......... .......... .......... .......... .......... 72% 353M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67650K .......... .......... .......... .......... .......... 72% 234M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67700K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67750K .......... .......... .......... .......... .......... 72% 149M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67800K .......... .......... .......... .......... .......... 73% 85.5M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67850K .......... .......... .......... .......... .......... 73% 255M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67900K .......... .......... .......... .......... .......... 73% 306M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 67950K .......... .......... .......... .......... .......... 73% 122M 0s 2024-09-12T17:48:11.587 INFO:teuthology.orchestra.run.smithi063.stderr: 68000K .......... .......... .......... .......... .......... 73% 218M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68050K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68100K .......... .......... .......... .......... .......... 73% 99.0M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68150K .......... .......... .......... .......... .......... 73% 149M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68200K .......... .......... .......... .......... .......... 73% 241M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68250K .......... .......... .......... .......... .......... 73% 163M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68300K .......... .......... .......... .......... .......... 73% 183M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68350K .......... .......... .......... .......... .......... 73% 194M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68400K .......... .......... .......... .......... .......... 73% 325M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68450K .......... .......... .......... .......... .......... 73% 332M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68500K .......... .......... .......... .......... .......... 73% 351M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68550K .......... .......... .......... .......... .......... 73% 293M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68600K .......... .......... .......... .......... .......... 73% 211M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68650K .......... .......... .......... .......... .......... 73% 270M 0s 2024-09-12T17:48:11.588 INFO:teuthology.orchestra.run.smithi063.stderr: 68700K .......... .......... .......... .......... .......... 74% 330M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 68750K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 68800K .......... .......... .......... .......... .......... 74% 352M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 68850K .......... .......... .......... .......... .......... 74% 351M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 68900K .......... .......... .......... .......... .......... 74% 343M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 68950K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69000K .......... .......... .......... .......... .......... 74% 141M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69050K .......... .......... .......... .......... .......... 74% 337M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69100K .......... .......... .......... .......... .......... 74% 343M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69150K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69200K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69250K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69300K .......... .......... .......... .......... .......... 74% 330M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69350K .......... .......... .......... .......... .......... 74% 287M 0s 2024-09-12T17:48:11.589 INFO:teuthology.orchestra.run.smithi063.stderr: 69400K .......... .......... .......... .......... .......... 74% 280M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69450K .......... .......... .......... .......... .......... 74% 355M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69500K .......... .......... .......... .......... .......... 74% 357M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69550K .......... .......... .......... .......... .......... 74% 299M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69600K .......... .......... .......... .......... .......... 74% 208M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69650K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69700K .......... .......... .......... .......... .......... 75% 361M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69750K .......... .......... .......... .......... .......... 75% 220M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69800K .......... .......... .......... .......... .......... 75% 307M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69850K .......... .......... .......... .......... .......... 75% 368M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69900K .......... .......... .......... .......... .......... 75% 170M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 69950K .......... .......... .......... .......... .......... 75% 284M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 70000K .......... .......... .......... .......... .......... 75% 347M 0s 2024-09-12T17:48:11.590 INFO:teuthology.orchestra.run.smithi063.stderr: 70050K .......... .......... .......... .......... .......... 75% 328M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70100K .......... .......... .......... .......... .......... 75% 335M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70150K .......... .......... .......... .......... .......... 75% 297M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70200K .......... .......... .......... .......... .......... 75% 324M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70250K .......... .......... .......... .......... .......... 75% 360M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70300K .......... .......... .......... .......... .......... 75% 82.5M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70350K .......... .......... .......... .......... .......... 75% 143M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70400K .......... .......... .......... .......... .......... 75% 267M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70450K .......... .......... .......... .......... .......... 75% 306M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70500K .......... .......... .......... .......... .......... 75% 300M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70550K .......... .......... .......... .......... .......... 75% 278M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70600K .......... .......... .......... .......... .......... 76% 371M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70650K .......... .......... .......... .......... .......... 76% 346M 0s 2024-09-12T17:48:11.591 INFO:teuthology.orchestra.run.smithi063.stderr: 70700K .......... .......... .......... .......... .......... 76% 377M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 70750K .......... .......... .......... .......... .......... 76% 44.9M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 70800K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 70850K .......... .......... .......... .......... .......... 76% 113M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 70900K .......... .......... .......... .......... .......... 76% 318M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 70950K .......... .......... .......... .......... .......... 76% 293M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71000K .......... .......... .......... .......... .......... 76% 340M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71050K .......... .......... .......... .......... .......... 76% 348M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71100K .......... .......... .......... .......... .......... 76% 354M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71150K .......... .......... .......... .......... .......... 76% 236M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71200K .......... .......... .......... .......... .......... 76% 277M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71250K .......... .......... .......... .......... .......... 76% 322M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71300K .......... .......... .......... .......... .......... 76% 350M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71350K .......... .......... .......... .......... .......... 76% 326M 0s 2024-09-12T17:48:11.592 INFO:teuthology.orchestra.run.smithi063.stderr: 71400K .......... .......... .......... .......... .......... 76% 359M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71450K .......... .......... .......... .......... .......... 76% 183M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71500K .......... .......... .......... .......... .......... 77% 244M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71550K .......... .......... .......... .......... .......... 77% 194M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71600K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71650K .......... .......... .......... .......... .......... 77% 322M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71700K .......... .......... .......... .......... .......... 77% 341M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71750K .......... .......... .......... .......... .......... 77% 309M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71800K .......... .......... .......... .......... .......... 77% 289M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71850K .......... .......... .......... .......... .......... 77% 315M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71900K .......... .......... .......... .......... .......... 77% 282M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 71950K .......... .......... .......... .......... .......... 77% 355M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 72000K .......... .......... .......... .......... .......... 77% 345M 0s 2024-09-12T17:48:11.593 INFO:teuthology.orchestra.run.smithi063.stderr: 72050K .......... .......... .......... .......... .......... 77% 269M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72100K .......... .......... .......... .......... .......... 77% 240M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72150K .......... .......... .......... .......... .......... 77% 332M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72200K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72250K .......... .......... .......... .......... .......... 77% 356M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72300K .......... .......... .......... .......... .......... 77% 272M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72350K .......... .......... .......... .......... .......... 77% 333M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72400K .......... .......... .......... .......... .......... 77% 331M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72450K .......... .......... .......... .......... .......... 78% 325M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72500K .......... .......... .......... .......... .......... 78% 306M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72550K .......... .......... .......... .......... .......... 78% 349M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72600K .......... .......... .......... .......... .......... 78% 344M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72650K .......... .......... .......... .......... .......... 78% 321M 0s 2024-09-12T17:48:11.594 INFO:teuthology.orchestra.run.smithi063.stderr: 72700K .......... .......... .......... .......... .......... 78% 247M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 72750K .......... .......... .......... .......... .......... 78% 197M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 72800K .......... .......... .......... .......... .......... 78% 297M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 72850K .......... .......... .......... .......... .......... 78% 292M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 72900K .......... .......... .......... .......... .......... 78% 192M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 72950K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73000K .......... .......... .......... .......... .......... 78% 262M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73050K .......... .......... .......... .......... .......... 78% 307M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73100K .......... .......... .......... .......... .......... 78% 281M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73150K .......... .......... .......... .......... .......... 78% 351M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73200K .......... .......... .......... .......... .......... 78% 199M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73250K .......... .......... .......... .......... .......... 78% 107M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73300K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73350K .......... .......... .......... .......... .......... 79% 340M 0s 2024-09-12T17:48:11.595 INFO:teuthology.orchestra.run.smithi063.stderr: 73400K .......... .......... .......... .......... .......... 79% 167M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73450K .......... .......... .......... .......... .......... 79% 29.5M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73500K .......... .......... .......... .......... .......... 79% 216M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73550K .......... .......... .......... .......... .......... 79% 334M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73600K .......... .......... .......... .......... .......... 79% 325M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73650K .......... .......... .......... .......... .......... 79% 334M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73700K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73750K .......... .......... .......... .......... .......... 79% 308M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73800K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73850K .......... .......... .......... .......... .......... 79% 72.3M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73900K .......... .......... .......... .......... .......... 79% 193M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 73950K .......... .......... .......... .......... .......... 79% 301M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 74000K .......... .......... .......... .......... .......... 79% 283M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 74050K .......... .......... .......... .......... .......... 79% 318M 0s 2024-09-12T17:48:11.596 INFO:teuthology.orchestra.run.smithi063.stderr: 74100K .......... .......... .......... .......... .......... 79% 268M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74150K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74200K .......... .......... .......... .......... .......... 79% 353M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74250K .......... .......... .......... .......... .......... 79% 365M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74300K .......... .......... .......... .......... .......... 80% 304M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74350K .......... .......... .......... .......... .......... 80% 347M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74400K .......... .......... .......... .......... .......... 80% 345M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74450K .......... .......... .......... .......... .......... 80% 345M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74500K .......... .......... .......... .......... .......... 80% 319M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74550K .......... .......... .......... .......... .......... 80% 357M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74600K .......... .......... .......... .......... .......... 80% 377M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74650K .......... .......... .......... .......... .......... 80% 376M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74700K .......... .......... .......... .......... .......... 80% 279M 0s 2024-09-12T17:48:11.597 INFO:teuthology.orchestra.run.smithi063.stderr: 74750K .......... .......... .......... .......... .......... 80% 346M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 74800K .......... .......... .......... .......... .......... 80% 243M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 74850K .......... .......... .......... .......... .......... 80% 303M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 74900K .......... .......... .......... .......... .......... 80% 331M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 74950K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75000K .......... .......... .......... .......... .......... 80% 261M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75050K .......... .......... .......... .......... .......... 80% 228M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75100K .......... .......... .......... .......... .......... 80% 285M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75150K .......... .......... .......... .......... .......... 80% 337M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75200K .......... .......... .......... .......... .......... 81% 333M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75250K .......... .......... .......... .......... .......... 81% 346M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75300K .......... .......... .......... .......... .......... 81% 314M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75350K .......... .......... .......... .......... .......... 81% 324M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75400K .......... .......... .......... .......... .......... 81% 354M 0s 2024-09-12T17:48:11.598 INFO:teuthology.orchestra.run.smithi063.stderr: 75450K .......... .......... .......... .......... .......... 81% 240M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75500K .......... .......... .......... .......... .......... 81% 248M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75550K .......... .......... .......... .......... .......... 81% 293M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75600K .......... .......... .......... .......... .......... 81% 282M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75650K .......... .......... .......... .......... .......... 81% 326M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75700K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75750K .......... .......... .......... .......... .......... 81% 349M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75800K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75850K .......... .......... .......... .......... .......... 81% 351M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75900K .......... .......... .......... .......... .......... 81% 297M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 75950K .......... .......... .......... .......... .......... 81% 332M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 76000K .......... .......... .......... .......... .......... 81% 349M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 76050K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 76100K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-12T17:48:11.599 INFO:teuthology.orchestra.run.smithi063.stderr: 76150K .......... .......... .......... .......... .......... 82% 351M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76200K .......... .......... .......... .......... .......... 82% 335M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76250K .......... .......... .......... .......... .......... 82% 364M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76300K .......... .......... .......... .......... .......... 82% 237M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76350K .......... .......... .......... .......... .......... 82% 283M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76400K .......... .......... .......... .......... .......... 82% 340M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76450K .......... .......... .......... .......... .......... 82% 282M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76500K .......... .......... .......... .......... .......... 82% 33.3M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76550K .......... .......... .......... .......... .......... 82% 184M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76600K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76650K .......... .......... .......... .......... .......... 82% 247M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76700K .......... .......... .......... .......... .......... 82% 148M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76750K .......... .......... .......... .......... .......... 82% 311M 0s 2024-09-12T17:48:11.600 INFO:teuthology.orchestra.run.smithi063.stderr: 76800K .......... .......... .......... .......... .......... 82% 89.2M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 76850K .......... .......... .......... .......... .......... 82% 343M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 76900K .......... .......... .......... .......... .......... 82% 258M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 76950K .......... .......... .......... .......... .......... 82% 324M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77000K .......... .......... .......... .......... .......... 82% 149M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77050K .......... .......... .......... .......... .......... 82% 261M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77100K .......... .......... .......... .......... .......... 83% 219M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77150K .......... .......... .......... .......... .......... 83% 314M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77200K .......... .......... .......... .......... .......... 83% 327M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77250K .......... .......... .......... .......... .......... 83% 350M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77300K .......... .......... .......... .......... .......... 83% 317M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77350K .......... .......... .......... .......... .......... 83% 344M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77400K .......... .......... .......... .......... .......... 83% 336M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77450K .......... .......... .......... .......... .......... 83% 353M 0s 2024-09-12T17:48:11.601 INFO:teuthology.orchestra.run.smithi063.stderr: 77500K .......... .......... .......... .......... .......... 83% 279M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77550K .......... .......... .......... .......... .......... 83% 311M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77600K .......... .......... .......... .......... .......... 83% 345M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77650K .......... .......... .......... .......... .......... 83% 218M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77700K .......... .......... .......... .......... .......... 83% 309M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77750K .......... .......... .......... .......... .......... 83% 352M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77800K .......... .......... .......... .......... .......... 83% 337M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77850K .......... .......... .......... .......... .......... 83% 326M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77900K .......... .......... .......... .......... .......... 83% 276M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 77950K .......... .......... .......... .......... .......... 83% 348M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 78000K .......... .......... .......... .......... .......... 84% 342M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 78050K .......... .......... .......... .......... .......... 84% 358M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 78100K .......... .......... .......... .......... .......... 84% 300M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 78150K .......... .......... .......... .......... .......... 84% 331M 0s 2024-09-12T17:48:11.602 INFO:teuthology.orchestra.run.smithi063.stderr: 78200K .......... .......... .......... .......... .......... 84% 347M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78250K .......... .......... .......... .......... .......... 84% 338M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78300K .......... .......... .......... .......... .......... 84% 280M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78350K .......... .......... .......... .......... .......... 84% 334M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78400K .......... .......... .......... .......... .......... 84% 358M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78450K .......... .......... .......... .......... .......... 84% 330M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78500K .......... .......... .......... .......... .......... 84% 178M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78550K .......... .......... .......... .......... .......... 84% 262M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78600K .......... .......... .......... .......... .......... 84% 341M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78650K .......... .......... .......... .......... .......... 84% 342M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78700K .......... .......... .......... .......... .......... 84% 283M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78750K .......... .......... .......... .......... .......... 84% 331M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78800K .......... .......... .......... .......... .......... 84% 345M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78850K .......... .......... .......... .......... .......... 84% 345M 0s 2024-09-12T17:48:11.603 INFO:teuthology.orchestra.run.smithi063.stderr: 78900K .......... .......... .......... .......... .......... 84% 297M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 78950K .......... .......... .......... .......... .......... 85% 349M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79000K .......... .......... .......... .......... .......... 85% 364M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79050K .......... .......... .......... .......... .......... 85% 329M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79100K .......... .......... .......... .......... .......... 85% 275M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79150K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79200K .......... .......... .......... .......... .......... 85% 367M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79250K .......... .......... .......... .......... .......... 85% 148M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79300K .......... .......... .......... .......... .......... 85% 305M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79350K .......... .......... .......... .......... .......... 85% 329M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79400K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79450K .......... .......... .......... .......... .......... 85% 337M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79500K .......... .......... .......... .......... .......... 85% 283M 0s 2024-09-12T17:48:11.604 INFO:teuthology.orchestra.run.smithi063.stderr: 79550K .......... .......... .......... .......... .......... 85% 61.0M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79600K .......... .......... .......... .......... .......... 85% 78.9M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79650K .......... .......... .......... .......... .......... 85% 227M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79700K .......... .......... .......... .......... .......... 85% 277M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79750K .......... .......... .......... .......... .......... 85% 158M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79800K .......... .......... .......... .......... .......... 85% 331M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79850K .......... .......... .......... .......... .......... 86% 349M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79900K .......... .......... .......... .......... .......... 86% 89.6M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 79950K .......... .......... .......... .......... .......... 86% 276M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 80000K .......... .......... .......... .......... .......... 86% 309M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 80050K .......... .......... .......... .......... .......... 86% 174M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 80100K .......... .......... .......... .......... .......... 86% 282M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 80150K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-12T17:48:11.605 INFO:teuthology.orchestra.run.smithi063.stderr: 80200K .......... .......... .......... .......... .......... 86% 192M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80250K .......... .......... .......... .......... .......... 86% 317M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80300K .......... .......... .......... .......... .......... 86% 217M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80350K .......... .......... .......... .......... .......... 86% 313M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80400K .......... .......... .......... .......... .......... 86% 342M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80450K .......... .......... .......... .......... .......... 86% 148M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80500K .......... .......... .......... .......... .......... 86% 220M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80550K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80600K .......... .......... .......... .......... .......... 86% 299M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80650K .......... .......... .......... .......... .......... 86% 351M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80700K .......... .......... .......... .......... .......... 86% 301M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80750K .......... .......... .......... .......... .......... 86% 338M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80800K .......... .......... .......... .......... .......... 87% 318M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80850K .......... .......... .......... .......... .......... 87% 326M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80900K .......... .......... .......... .......... .......... 87% 288M 0s 2024-09-12T17:48:11.606 INFO:teuthology.orchestra.run.smithi063.stderr: 80950K .......... .......... .......... .......... .......... 87% 345M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81000K .......... .......... .......... .......... .......... 87% 313M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81050K .......... .......... .......... .......... .......... 87% 281M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81100K .......... .......... .......... .......... .......... 87% 238M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81150K .......... .......... .......... .......... .......... 87% 336M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81200K .......... .......... .......... .......... .......... 87% 314M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81250K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81300K .......... .......... .......... .......... .......... 87% 313M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81350K .......... .......... .......... .......... .......... 87% 357M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81400K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81450K .......... .......... .......... .......... .......... 87% 348M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81500K .......... .......... .......... .......... .......... 87% 295M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81550K .......... .......... .......... .......... .......... 87% 309M 0s 2024-09-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi063.stderr: 81600K .......... .......... .......... .......... .......... 87% 331M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 81650K .......... .......... .......... .......... .......... 87% 332M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 81700K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 81750K .......... .......... .......... .......... .......... 88% 352M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 81800K .......... .......... .......... .......... .......... 88% 324M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 81850K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 81900K .......... .......... .......... .......... .......... 88% 290M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 81950K .......... .......... .......... .......... .......... 88% 300M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 82000K .......... .......... .......... .......... .......... 88% 350M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 82050K .......... .......... .......... .......... .......... 88% 319M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 82100K .......... .......... .......... .......... .......... 88% 294M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 82150K .......... .......... .......... .......... .......... 88% 284M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 82200K .......... .......... .......... .......... .......... 88% 284M 0s 2024-09-12T17:48:11.608 INFO:teuthology.orchestra.run.smithi063.stderr: 82250K .......... .......... .......... .......... .......... 88% 289M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82300K .......... .......... .......... .......... .......... 88% 305M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82350K .......... .......... .......... .......... .......... 88% 175M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82400K .......... .......... .......... .......... .......... 88% 260M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82450K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82500K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82550K .......... .......... .......... .......... .......... 88% 108M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82600K .......... .......... .......... .......... .......... 88% 295M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82650K .......... .......... .......... .......... .......... 89% 360M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82700K .......... .......... .......... .......... .......... 89% 75.5M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82750K .......... .......... .......... .......... .......... 89% 269M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82800K .......... .......... .......... .......... .......... 89% 125M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82850K .......... .......... .......... .......... .......... 89% 49.2M 0s 2024-09-12T17:48:11.609 INFO:teuthology.orchestra.run.smithi063.stderr: 82900K .......... .......... .......... .......... .......... 89% 319M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 82950K .......... .......... .......... .......... .......... 89% 323M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83000K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83050K .......... .......... .......... .......... .......... 89% 358M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83100K .......... .......... .......... .......... .......... 89% 361M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83150K .......... .......... .......... .......... .......... 89% 278M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83200K .......... .......... .......... .......... .......... 89% 326M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83250K .......... .......... .......... .......... .......... 89% 365M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83300K .......... .......... .......... .......... .......... 89% 316M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83350K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83400K .......... .......... .......... .......... .......... 89% 371M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83450K .......... .......... .......... .......... .......... 89% 115M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83500K .......... .......... .......... .......... .......... 89% 255M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83550K .......... .......... .......... .......... .......... 89% 249M 0s 2024-09-12T17:48:11.610 INFO:teuthology.orchestra.run.smithi063.stderr: 83600K .......... .......... .......... .......... .......... 90% 292M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 83650K .......... .......... .......... .......... .......... 90% 327M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 83700K .......... .......... .......... .......... .......... 90% 339M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 83750K .......... .......... .......... .......... .......... 90% 271M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 83800K .......... .......... .......... .......... .......... 90% 303M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 83850K .......... .......... .......... .......... .......... 90% 362M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 83900K .......... .......... .......... .......... .......... 90% 360M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 83950K .......... .......... .......... .......... .......... 90% 183M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 84000K .......... .......... .......... .......... .......... 90% 284M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 84050K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 84100K .......... .......... .......... .......... .......... 90% 342M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 84150K .......... .......... .......... .......... .......... 90% 294M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 84200K .......... .......... .......... .......... .......... 90% 317M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 84250K .......... .......... .......... .......... .......... 90% 361M 0s 2024-09-12T17:48:11.611 INFO:teuthology.orchestra.run.smithi063.stderr: 84300K .......... .......... .......... .......... .......... 90% 338M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84350K .......... .......... .......... .......... .......... 90% 256M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84400K .......... .......... .......... .......... .......... 90% 346M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84450K .......... .......... .......... .......... .......... 90% 354M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84500K .......... .......... .......... .......... .......... 91% 353M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84550K .......... .......... .......... .......... .......... 91% 335M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84600K .......... .......... .......... .......... .......... 91% 349M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84650K .......... .......... .......... .......... .......... 91% 346M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84700K .......... .......... .......... .......... .......... 91% 311M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84750K .......... .......... .......... .......... .......... 91% 212M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84800K .......... .......... .......... .......... .......... 91% 340M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84850K .......... .......... .......... .......... .......... 91% 324M 0s 2024-09-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi063.stderr: 84900K .......... .......... .......... .......... .......... 91% 346M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 84950K .......... .......... .......... .......... .......... 91% 308M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85000K .......... .......... .......... .......... .......... 91% 351M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85050K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85100K .......... .......... .......... .......... .......... 91% 348M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85150K .......... .......... .......... .......... .......... 91% 294M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85200K .......... .......... .......... .......... .......... 91% 308M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85250K .......... .......... .......... .......... .......... 91% 287M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85300K .......... .......... .......... .......... .......... 91% 285M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85350K .......... .......... .......... .......... .......... 91% 312M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85400K .......... .......... .......... .......... .......... 91% 342M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85450K .......... .......... .......... .......... .......... 92% 371M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85500K .......... .......... .......... .......... .......... 92% 180M 0s 2024-09-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi063.stderr: 85550K .......... .......... .......... .......... .......... 92% 76.4M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85600K .......... .......... .......... .......... .......... 92% 351M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85650K .......... .......... .......... .......... .......... 92% 348M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85700K .......... .......... .......... .......... .......... 92% 206M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85750K .......... .......... .......... .......... .......... 92% 280M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85800K .......... .......... .......... .......... .......... 92% 335M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85850K .......... .......... .......... .......... .......... 92% 176M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85900K .......... .......... .......... .......... .......... 92% 297M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 85950K .......... .......... .......... .......... .......... 92% 43.5M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 86000K .......... .......... .......... .......... .......... 92% 250M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 86050K .......... .......... .......... .......... .......... 92% 308M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 86100K .......... .......... .......... .......... .......... 92% 325M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 86150K .......... .......... .......... .......... .......... 92% 316M 0s 2024-09-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi063.stderr: 86200K .......... .......... .......... .......... .......... 92% 144M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86250K .......... .......... .......... .......... .......... 92% 329M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86300K .......... .......... .......... .......... .......... 92% 342M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86350K .......... .......... .......... .......... .......... 93% 306M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86400K .......... .......... .......... .......... .......... 93% 367M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86450K .......... .......... .......... .......... .......... 93% 124M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86500K .......... .......... .......... .......... .......... 93% 344M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86550K .......... .......... .......... .......... .......... 93% 250M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86600K .......... .......... .......... .......... .......... 93% 318M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86650K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86700K .......... .......... .......... .......... .......... 93% 350M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86750K .......... .......... .......... .......... .......... 93% 226M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86800K .......... .......... .......... .......... .......... 93% 208M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86850K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi063.stderr: 86900K .......... .......... .......... .......... .......... 93% 340M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 86950K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87000K .......... .......... .......... .......... .......... 93% 354M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87050K .......... .......... .......... .......... .......... 93% 302M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87100K .......... .......... .......... .......... .......... 93% 365M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87150K .......... .......... .......... .......... .......... 93% 157M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87200K .......... .......... .......... .......... .......... 93% 344M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87250K .......... .......... .......... .......... .......... 93% 344M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87300K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87350K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87400K .......... .......... .......... .......... .......... 94% 354M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87450K .......... .......... .......... .......... .......... 94% 313M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87500K .......... .......... .......... .......... .......... 94% 354M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87550K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87600K .......... .......... .......... .......... .......... 94% 360M 0s 2024-09-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi063.stderr: 87650K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 87700K .......... .......... .......... .......... .......... 94% 339M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 87750K .......... .......... .......... .......... .......... 94% 300M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 87800K .......... .......... .......... .......... .......... 94% 342M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 87850K .......... .......... .......... .......... .......... 94% 323M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 87900K .......... .......... .......... .......... .......... 94% 342M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 87950K .......... .......... .......... .......... .......... 94% 277M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88000K .......... .......... .......... .......... .......... 94% 281M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88050K .......... .......... .......... .......... .......... 94% 356M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88100K .......... .......... .......... .......... .......... 94% 277M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88150K .......... .......... .......... .......... .......... 94% 286M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88200K .......... .......... .......... .......... .......... 94% 375M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88250K .......... .......... .......... .......... .......... 95% 334M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88300K .......... .......... .......... .......... .......... 95% 286M 0s 2024-09-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi063.stderr: 88350K .......... .......... .......... .......... .......... 95% 296M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88400K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88450K .......... .......... .......... .......... .......... 95% 351M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88500K .......... .......... .......... .......... .......... 95% 331M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88550K .......... .......... .......... .......... .......... 95% 317M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88600K .......... .......... .......... .......... .......... 95% 124M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88650K .......... .......... .......... .......... .......... 95% 228M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88700K .......... .......... .......... .......... .......... 95% 353M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88750K .......... .......... .......... .......... .......... 95% 185M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88800K .......... .......... .......... .......... .......... 95% 194M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88850K .......... .......... .......... .......... .......... 95% 350M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88900K .......... .......... .......... .......... .......... 95% 323M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 88950K .......... .......... .......... .......... .......... 95% 318M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 89000K .......... .......... .......... .......... .......... 95% 49.5M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 89050K .......... .......... .......... .......... .......... 95% 133M 0s 2024-09-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi063.stderr: 89100K .......... .......... .......... .......... .......... 95% 345M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89150K .......... .......... .......... .......... .......... 96% 270M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89200K .......... .......... .......... .......... .......... 96% 345M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89250K .......... .......... .......... .......... .......... 96% 133M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89300K .......... .......... .......... .......... .......... 96% 148M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89350K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89400K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89450K .......... .......... .......... .......... .......... 96% 135M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89500K .......... .......... .......... .......... .......... 96% 318M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89550K .......... .......... .......... .......... .......... 96% 280M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89600K .......... .......... .......... .......... .......... 96% 370M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89650K .......... .......... .......... .......... .......... 96% 393M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89700K .......... .......... .......... .......... .......... 96% 377M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89750K .......... .......... .......... .......... .......... 96% 246M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89800K .......... .......... .......... .......... .......... 96% 352M 0s 2024-09-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi063.stderr: 89850K .......... .......... .......... .......... .......... 96% 378M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 89900K .......... .......... .......... .......... .......... 96% 388M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 89950K .......... .......... .......... .......... .......... 96% 176M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90000K .......... .......... .......... .......... .......... 96% 352M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90050K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90100K .......... .......... .......... .......... .......... 97% 345M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90150K .......... .......... .......... .......... .......... 97% 316M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90200K .......... .......... .......... .......... .......... 97% 325M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90250K .......... .......... .......... .......... .......... 97% 359M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90300K .......... .......... .......... .......... .......... 97% 233M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90350K .......... .......... .......... .......... .......... 97% 291M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90400K .......... .......... .......... .......... .......... 97% 270M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90450K .......... .......... .......... .......... .......... 97% 342M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90500K .......... .......... .......... .......... .......... 97% 350M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90550K .......... .......... .......... .......... .......... 97% 306M 0s 2024-09-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi063.stderr: 90600K .......... .......... .......... .......... .......... 97% 322M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 90650K .......... .......... .......... .......... .......... 97% 320M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 90700K .......... .......... .......... .......... .......... 97% 324M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 90750K .......... .......... .......... .......... .......... 97% 256M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 90800K .......... .......... .......... .......... .......... 97% 188M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 90850K .......... .......... .......... .......... .......... 97% 268M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 90900K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 90950K .......... .......... .......... .......... .......... 97% 269M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 91000K .......... .......... .......... .......... .......... 98% 306M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 91050K .......... .......... .......... .......... .......... 98% 327M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 91100K .......... .......... .......... .......... .......... 98% 323M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 91150K .......... .......... .......... .......... .......... 98% 290M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 91200K .......... .......... .......... .......... .......... 98% 354M 0s 2024-09-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi063.stderr: 91250K .......... .......... .......... .......... .......... 98% 355M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91300K .......... .......... .......... .......... .......... 98% 351M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91350K .......... .......... .......... .......... .......... 98% 316M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91400K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91450K .......... .......... .......... .......... .......... 98% 269M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91500K .......... .......... .......... .......... .......... 98% 287M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91550K .......... .......... .......... .......... .......... 98% 268M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91600K .......... .......... .......... .......... .......... 98% 198M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91650K .......... .......... .......... .......... .......... 98% 333M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91700K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91750K .......... .......... .......... .......... .......... 98% 308M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91800K .......... .......... .......... .......... .......... 98% 363M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91850K .......... .......... .......... .......... .......... 98% 132M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91900K .......... .......... .......... .......... .......... 98% 348M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 91950K .......... .......... .......... .......... .......... 99% 49.2M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 92000K .......... .......... .......... .......... .......... 99% 293M 0s 2024-09-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi063.stderr: 92050K .......... .......... .......... .......... .......... 99% 340M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92100K .......... .......... .......... .......... .......... 99% 119M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92150K .......... .......... .......... .......... .......... 99% 256M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92200K .......... .......... .......... .......... .......... 99% 345M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92250K .......... .......... .......... .......... .......... 99% 187M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92300K .......... .......... .......... .......... .......... 99% 345M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92350K .......... .......... .......... .......... .......... 99% 155M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92400K .......... .......... .......... .......... .......... 99% 338M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92450K .......... .......... .......... .......... .......... 99% 321M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92500K .......... .......... .......... .......... .......... 99% 105M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92550K .......... .......... .......... .......... .......... 99% 338M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92600K .......... .......... .......... .......... .......... 99% 351M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92650K .......... .......... .......... .......... .......... 99% 243M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92700K .......... .......... .......... .......... .......... 99% 339M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92750K .......... .......... .......... .......... .......... 99% 299M 0s 2024-09-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi063.stderr: 92800K .......... .......... .......... .......... .......... 99% 305M 0s 2024-09-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi063.stderr: 92850K .......... .......... .......... .......... .......... 99% 303M 0s 2024-09-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi063.stderr: 92900K 100% 134G=0.4s 2024-09-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12 17:48:10 (209 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T17:48:11.663 INFO:teuthology.orchestra.run.smithi063.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T17:48:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T17:48:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T17:48:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T17:48:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T17:48:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T17:48:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T17:48:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T17:48:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T17:48:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T17:48:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T17:48:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T17:48:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T17:48:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T17:48:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T17:48:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T17:48:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T17:48:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T17:48:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout:Welcome to Gradle 6.0.1! 2024-09-12T17:48:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout:Here are the highlights of this release: 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Substantial improvements in dependency management, including 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Advanced control of transitive versions 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Support for optional features and dependencies 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Rules to tweak published metadata 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Support for Java 13 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - New Zinc compiler for Scala 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - VS2019 support 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:------------------------------------------------------------ 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:Gradle 6.0.1 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:------------------------------------------------------------ 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:Kotlin: 1.3.50 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:Groovy: 2.5.8 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T17:48:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:11.683 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T17:48:11.683 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:48:11.683 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T17:48:11.683 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:48:11.683 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T17:48:11.683 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T17:48:11.904 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T17:48:11.904 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T17:48:11.904 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'HBZHCBNWWPPGDWBJNMJZ', 'access_secret': 'ZmBIQ9XourCVNvP3PxmJJBDLHHTfUnQD7mCy49rI4Pafk6FQxBiYIg==', 'region': 'mexico', 'endpoint': 'smithi063.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi063.front.sepia.ceph.com'} 2024-09-12T17:48:11.904 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T17:48:11.904 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'HBZHCBNWWPPGDWBJNMJZ', '--secret', 'ZmBIQ9XourCVNvP3PxmJJBDLHHTfUnQD7mCy49rI4Pafk6FQxBiYIg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T17:48:11.905 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key HBZHCBNWWPPGDWBJNMJZ --secret ZmBIQ9XourCVNvP3PxmJJBDLHHTfUnQD7mCy49rI4Pafk6FQxBiYIg== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T17:48:11.971 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:11.972 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:12.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.007+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 20 realm 2024-09-12T17:48:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.009+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.010+0000 7fce47d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:12.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.010+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.010+0000 7fce47d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:12.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.010+0000 7fce47d19800 20 searching for the correct realm 2024-09-12T17:48:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.014+0000 7fce45002640 0 -- 172.21.15.63:0/3449362611 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fce3c06c900 msgr2=0x7fce3c0803d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:12.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.018+0000 7fce45002640 0 -- 172.21.15.63:0/3449362611 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x558b9f219730 msgr2=0x558b9f21bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:12.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:48:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:48:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.022+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 zone default found 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 4 Realm: () 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 zonegroup default 2024-09-12T17:48:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.023+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.024+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.024+0000 7fce47d19800 20 started sync module instance, tier type = 2024-09-12T17:48:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.024+0000 7fce47d19800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:48:12.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.033+0000 7fce47d19800 20 add_watcher() i=0 2024-09-12T17:48:12.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.033+0000 7fce47d19800 20 add_watcher() i=1 2024-09-12T17:48:12.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.033+0000 7fce47d19800 20 add_watcher() i=2 2024-09-12T17:48:12.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.033+0000 7fce47d19800 20 add_watcher() i=3 2024-09-12T17:48:12.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.033+0000 7fce47d19800 20 add_watcher() i=4 2024-09-12T17:48:12.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.033+0000 7fce47d19800 20 add_watcher() i=5 2024-09-12T17:48:12.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.033+0000 7fce47d19800 20 add_watcher() i=6 2024-09-12T17:48:12.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.034+0000 7fce47d19800 20 add_watcher() i=7 2024-09-12T17:48:12.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.034+0000 7fce47d19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:12.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.036+0000 7fccf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:12.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.036+0000 7fce47d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:12.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.036+0000 7fce47d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:12.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.036+0000 7fce47d19800 5 note: GC not initialized 2024-09-12T17:48:12.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fccf67fc640 20 reqs_thread_entry: start 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 20 Filter name: none 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fcc67fff640 20 reqs_thread_entry: start 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:48:12.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.037+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 10 cache get: name=default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ : miss 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 10 cache put: name=default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ info.flags=0x0 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 10 adding default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ to cache LRU end 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 10 cache get: name=default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ : hit (negative entry) 2024-09-12T17:48:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.038+0000 7fce47d19800 10 cache get: name=default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ : hit (negative entry) 2024-09-12T17:48:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.039+0000 7fce47d19800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:48:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.039+0000 7fce47d19800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:48:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.039+0000 7fce47d19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:48:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.040+0000 7fcd297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431661 cookie 94058158658400 notifier 8823 bl.length()=670 2024-09-12T17:48:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.040+0000 7fcd297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:48:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.040+0000 7fcd297fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:48:12.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.041+0000 7fce47d19800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:48:12.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.041+0000 7fce47d19800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:48:12.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.041+0000 7fce47d19800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:48:12.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.042+0000 7fcd28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94058158649552 notifier 8823 bl.length()=200 2024-09-12T17:48:12.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.042+0000 7fcd28ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:48:12.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.042+0000 7fcd28ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:48:12.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.043+0000 7fce47d19800 10 cache put: name=default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ info.flags=0x7 2024-09-12T17:48:12.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.043+0000 7fce47d19800 10 moving default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ to cache LRU end 2024-09-12T17:48:12.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.043+0000 7fce47d19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:HBZHCBNWWPPGDWBJNMJZ, ofs0, ns] 2024-09-12T17:48:12.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.043+0000 7fcd297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431674 cookie 94058158600704 notifier 8823 bl.length()=189 2024-09-12T17:48:12.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.043+0000 7fcd297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ info.flags=0x7 2024-09-12T17:48:12.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.043+0000 7fcd297fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HBZHCBNWWPPGDWBJNMJZ to cache LRU end 2024-09-12T17:48:12.045 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:48:12.045 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "tester.client.0", 2024-09-12T17:48:12.045 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T17:48:12.045 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T17:48:12.045 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "tester.client.0", 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "HBZHCBNWWPPGDWBJNMJZ", 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "ZmBIQ9XourCVNvP3PxmJJBDLHHTfUnQD7mCy49rI4Pafk6FQxBiYIg==", 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:48:12.039392Z" 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:48:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:48:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:48:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:48:12.049 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:48:12.039381Z", 2024-09-12T17:48:12.049 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:48:12.049 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:48:12.049 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:48:12.049 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:12.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.045+0000 7fccf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:12.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.047+0000 7fce47d19800 20 remove_watcher() i=0 2024-09-12T17:48:12.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.047+0000 7fce47d19800 2 removed watcher, disabling cache 2024-09-12T17:48:12.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.048+0000 7fce47d19800 20 remove_watcher() i=1 2024-09-12T17:48:12.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.049+0000 7fce47d19800 20 remove_watcher() i=2 2024-09-12T17:48:12.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.050+0000 7fce47d19800 20 remove_watcher() i=3 2024-09-12T17:48:12.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.051+0000 7fce47d19800 20 remove_watcher() i=4 2024-09-12T17:48:12.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.052+0000 7fce47d19800 20 remove_watcher() i=5 2024-09-12T17:48:12.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.053+0000 7fce47d19800 20 remove_watcher() i=6 2024-09-12T17:48:12.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.054+0000 7fce47d19800 20 remove_watcher() i=7 2024-09-12T17:48:12.067 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:48:12.067 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T17:48:12.100 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T17:48:12.100 DEBUG:teuthology.orchestra.run.smithi063:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T17:48:12.168 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:48:12.261 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:12.261 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:12.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.299+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.301+0000 7fc101214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.301+0000 7fc101214800 20 realm 2024-09-12T17:48:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.301+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.302+0000 7fc101214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.302+0000 7fc101214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.302+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.302+0000 7fc101214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.302+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.303+0000 7fc101214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.303+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.303+0000 7fc101214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.303+0000 7fc101214800 20 searching for the correct realm 2024-09-12T17:48:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.306+0000 7fc0fc8cb640 0 -- 172.21.15.63:0/2776891941 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fc0ec06d070 msgr2=0x7fc0ec06f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.310+0000 7fc0fc8cb640 0 -- 172.21.15.63:0/2776891941 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fc0f4018040 msgr2=0x7fc0f403e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:48:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:48:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.518+0000 7fc101214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 20 zone default found 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 4 Realm: () 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 20 zonegroup default 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.519+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.520+0000 7fc101214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.520+0000 7fc101214800 20 rados->read ofs=0 len=0 2024-09-12T17:48:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.520+0000 7fc101214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.520+0000 7fc101214800 20 started sync module instance, tier type = 2024-09-12T17:48:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.520+0000 7fc101214800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:48:12.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.530+0000 7fc101214800 20 add_watcher() i=0 2024-09-12T17:48:12.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.530+0000 7fc101214800 20 add_watcher() i=1 2024-09-12T17:48:12.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.530+0000 7fc101214800 20 add_watcher() i=2 2024-09-12T17:48:12.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.530+0000 7fc101214800 20 add_watcher() i=3 2024-09-12T17:48:12.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.530+0000 7fc101214800 20 add_watcher() i=4 2024-09-12T17:48:12.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.530+0000 7fc101214800 20 add_watcher() i=5 2024-09-12T17:48:12.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.530+0000 7fc101214800 20 add_watcher() i=6 2024-09-12T17:48:12.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.531+0000 7fc101214800 20 add_watcher() i=7 2024-09-12T17:48:12.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.531+0000 7fc101214800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:12.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.533+0000 7fbfb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:12.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.533+0000 7fc101214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:12.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.533+0000 7fc101214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.570+0000 7fbfb1fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.570+0000 7fc101214800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.570+0000 7fc101214800 20 Filter name: none 2024-09-12T17:48:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.571+0000 7fbf237fe640 20 reqs_thread_entry: start 2024-09-12T17:48:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.571+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:48:12.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.572+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.572+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16193334204703452196', time=2024-09-12T19:40:14.505590+0000, chain.objs.size()=1 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.-AqSsaNQzXG8RyP5RHviFJUloz8nFWU_0 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14368109730840992353', time=2024-09-12T19:40:14.508531+0000, chain.objs.size()=1 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.uWzs-bBNQ1ZkX3f1FD8STer4G4L0xo1_0 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13550781003453708315', time=2024-09-12T19:40:49.754676+0000, chain.objs.size()=1 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.fbWA1WTDWs-71rp3iBycKo-3lcb4mE1_0 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7596603029854875315', time=2024-09-12T19:41:23.604741+0000, chain.objs.size()=1 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.1i6mEzxoz4V0grfssbOCRjZme-iS8rJ_0 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6252889106123147806', time=2024-09-12T19:42:01.354144+0000, chain.objs.size()=1 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.lkenZT4UHRPLLZtp5hpIr1I0t0oAviy_0 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12688642845146469844', time=2024-09-12T19:42:33.328816+0000, chain.objs.size()=1 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.DgkRS6j0_vVG6OtJynIw0CYpwM7I7xP_0 2024-09-12T17:48:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13515768010035831149', time=2024-09-12T19:43:09.749188+0000, chain.objs.size()=1 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.Dz2XRLU22jriOrax2fXGk-GcAzStQt-_0 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15046339111462717620', time=2024-09-12T19:43:42.740428+0000, chain.objs.size()=1 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.t02DROf4Jgt2bB85_gciT8gyn04x17a_0 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16053825759101596926', time=2024-09-12T19:44:19.770597+0000, chain.objs.size()=1 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.wF55OXp-_ae_elqGUWssKlDPxTxsY7b_0 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11683951820039992163', time=2024-09-12T19:44:19.774966+0000, chain.objs.size()=1 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.G2crwWzmyNfOPhL_GDL4g_qDD_ZyAwP_0 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15456851211389977337', time=2024-09-12T19:44:19.778647+0000, chain.objs.size()=1 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.uT9DybC65Noq3S4Mw7KzRH3iV4BflQb_0 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7184889098479013742', time=2024-09-12T19:44:53.249195+0000, chain.objs.size()=1 2024-09-12T17:48:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.573+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.nDV9pSa6HcjAL03EOQUivpOeutgILl9_0 2024-09-12T17:48:12.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.579+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.582+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:48:12.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.583+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_xiNPIAYVO-udnwXiXQkD2aSKKQ0K_ar', time=2024-09-12T19:38:53.859103+0000, chain.objs.size()=2 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.B8dkGizCHRohTxSkXLQJCaxmoScDlHn_0 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.B8dkGizCHRohTxSkXLQJCaxmoScDlHn_1 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16309112010083051788', time=2024-09-12T19:40:14.499286+0000, chain.objs.size()=1 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.H_cr5urVmvGGVYBUAr6XNkITCLOUe2W_0 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8215264306314984301', time=2024-09-12T19:40:15.793954+0000, chain.objs.size()=1 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.HdhSD9gHr-kRBDWOL5NLQlPAC2a67gI_0 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11569856418055384479', time=2024-09-12T19:40:15.802574+0000, chain.objs.size()=1 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.vl3Y9cx3JursrmUU857Hzsi2ZxH-eSF_0 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12381794124730117980', time=2024-09-12T19:40:47.938197+0000, chain.objs.size()=1 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.FIWwG83iygh471FgNzALp59ZxjDZeI-_0 2024-09-12T17:48:12.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15865249685536248228', time=2024-09-12T19:41:25.410843+0000, chain.objs.size()=1 2024-09-12T17:48:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_._66v1u3_dB49kjuaPtf_fu1dPZOHYZE_0 2024-09-12T17:48:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15869397346436436794', time=2024-09-12T19:41:25.411502+0000, chain.objs.size()=1 2024-09-12T17:48:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_._fZDoBSW89OPWFahBHs3cqdaiTfWR80_0 2024-09-12T17:48:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7554914292905877216', time=2024-09-12T19:42:01.343637+0000, chain.objs.size()=1 2024-09-12T17:48:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.oz5wBbbvybw5-GXJlb8zIfHnuotuuhY_0 2024-09-12T17:48:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.584+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8291616260398059932', time=2024-09-12T19:42:35.359165+0000, chain.objs.size()=1 2024-09-12T17:48:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.585+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.vHPih_dGRIhluGrDHAfSeajzOcLN05m_0 2024-09-12T17:48:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.585+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5332429098297248862', time=2024-09-12T19:42:36.655485+0000, chain.objs.size()=1 2024-09-12T17:48:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.585+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.hA9ENZ_s6B2_9yQtFlcLOBnLSz0Vu5Q_0 2024-09-12T17:48:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.585+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6742388622082083233', time=2024-09-12T19:43:08.303397+0000, chain.objs.size()=1 2024-09-12T17:48:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.585+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.9IHStDz1sQkv-_xrdN4qHf_7oygTX_1_0 2024-09-12T17:48:12.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.588+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9657701209602674801', time=2024-09-12T19:43:09.745359+0000, chain.objs.size()=1 2024-09-12T17:48:12.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.588+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.cDS8A9dEShDZOsUbgFL28lWWr_IXDat_0 2024-09-12T17:48:12.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.588+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10428144601134438911', time=2024-09-12T19:43:09.748299+0000, chain.objs.size()=1 2024-09-12T17:48:12.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.588+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.Evxa2b5LFL2wtwjf1SDmLEVuxvb47S8_0 2024-09-12T17:48:12.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.588+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13724594484589085247', time=2024-09-12T19:43:42.739688+0000, chain.objs.size()=1 2024-09-12T17:48:12.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.588+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.da-mEUy42rVi_izYWeV0VgcaRzJRPaF_0 2024-09-12T17:48:12.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17309236551570993219', time=2024-09-12T19:43:44.017021+0000, chain.objs.size()=1 2024-09-12T17:48:12.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.a_7DS8lcrPsTbi0KeNxR_4YyIObKclf_0 2024-09-12T17:48:12.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8772576829220243995', time=2024-09-12T19:43:44.769567+0000, chain.objs.size()=1 2024-09-12T17:48:12.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.9kS3MntP97WkRx0Q0yGEsbw-QA5Mrwr_0 2024-09-12T17:48:12.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15672287990840531746', time=2024-09-12T19:43:44.770272+0000, chain.objs.size()=1 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.6fzrud9L5DNFpEMpdALYZFgglVTmA5T_0 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2077639359970552576', time=2024-09-12T19:44:17.539952+0000, chain.objs.size()=1 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.ih54umQq3lz7xf_3HKlQqkow3aj4sbK_0 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9510253772655658201', time=2024-09-12T19:44:17.545736+0000, chain.objs.size()=1 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.VnYbCWuIZyhAO66sfLikAeSaxP5LHTP_0 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6587435819228892322', time=2024-09-12T19:44:17.547581+0000, chain.objs.size()=1 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.590+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.xsSoUrUoH4Y_IV3Nwqd98QQDZzu09An_0 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.591+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4853914577588692566', time=2024-09-12T19:44:19.770070+0000, chain.objs.size()=1 2024-09-12T17:48:12.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.591+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_._-aJcMmQdfmjriBOwleTRZTHojzxpf5_0 2024-09-12T17:48:12.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.591+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11379793975673912784', time=2024-09-12T19:44:21.068527+0000, chain.objs.size()=1 2024-09-12T17:48:12.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.591+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.t48qzmofRiITBtTHriv3BymaTmZIY-B_0 2024-09-12T17:48:12.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.597+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.599+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:48:12.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.600+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_L4xYiq0CaQl4Occ4qt2A46MorhDnPo-', time=2024-09-12T19:38:53.957709+0000, chain.objs.size()=1 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.hgi3q1P7ybnipwgvF-hqvI_PeFkTa-t_0 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10288380613716162100', time=2024-09-12T19:40:15.795548+0000, chain.objs.size()=1 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.Y-1O9bnTPkqSX3RM-iQJ38lzeDzGQqb_0 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11863452374152852952', time=2024-09-12T19:40:15.804282+0000, chain.objs.size()=1 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.tPPx-TwZ4e-eJSP-6BmUEA1vAZEiTdf_0 2024-09-12T17:48:12.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12537295089958973471', time=2024-09-12T19:40:47.940731+0000, chain.objs.size()=1 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.6OIAKlQtrpmJIsszrcIDptfAB_vRdQr_0 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15021761726844279989', time=2024-09-12T19:40:49.750424+0000, chain.objs.size()=1 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.zWMRE8ZfQlB9sW15IHzByhuSF05MExr_0 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2082522204765856586', time=2024-09-12T19:40:49.751641+0000, chain.objs.size()=1 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.CF61FurhpUcTrCk9CRuD13k5Qd1pdfR_0 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13070573215145368384', time=2024-09-12T19:40:51.026802+0000, chain.objs.size()=1 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.ICHmkroEpkEUOTExcAzPVs4N-FFA5bb_0 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3153249910343854218', time=2024-09-12T19:40:51.033106+0000, chain.objs.size()=1 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.wyDs39_tYr-utITmA8jJQmU_m3W0BvE_0 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11012995553150432451', time=2024-09-12T19:41:23.601888+0000, chain.objs.size()=1 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.Psz6yPKTxb-3Fbq7BM5vy0dnV0cYTvD_0 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11545509047915483578', time=2024-09-12T19:41:26.717116+0000, chain.objs.size()=1 2024-09-12T17:48:12.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.JnvntGncwfmCzFad6aNTFH6D2L5Vcf__0 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7025006770613188766', time=2024-09-12T19:41:26.719689+0000, chain.objs.size()=1 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.uFDTLCxt_Zf1k1Bw_QF3-d8AozB_Jtr_0 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18218120142521706414', time=2024-09-12T19:42:01.343653+0000, chain.objs.size()=1 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.601+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.VGCtuAOhNssaxJd6Pj82EqQ2SelRz3Q_0 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.604+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.323974469589966050', time=2024-09-12T19:42:33.329003+0000, chain.objs.size()=1 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.604+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.FYSLQXekog-p0PC7nWwi4vI2-wh6AVp_0 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.604+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1538700208839651437', time=2024-09-12T19:42:33.336650+0000, chain.objs.size()=1 2024-09-12T17:48:12.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.604+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.vPKzfmY0ogsPrYTEMkZVl2RfKGZP4JY_0 2024-09-12T17:48:12.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4802081787239256477', time=2024-09-12T19:42:35.362260+0000, chain.objs.size()=1 2024-09-12T17:48:12.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.UYCaLXM8FQX1KVmbVo6252zOcH2Th-O_0 2024-09-12T17:48:12.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5545410578202223980', time=2024-09-12T19:42:36.651900+0000, chain.objs.size()=1 2024-09-12T17:48:12.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.y5f37T5mCAja3Wvd8qi7UEETxe015mL_0 2024-09-12T17:48:12.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14961408290356953002', time=2024-09-12T19:44:17.540287+0000, chain.objs.size()=1 2024-09-12T17:48:12.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.j1Q7VQFI1tjse9rb-waM0A9f6z12SZE_0 2024-09-12T17:48:12.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10080317453166474099', time=2024-09-12T19:44:53.244428+0000, chain.objs.size()=1 2024-09-12T17:48:12.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.606+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.7kAmo0e2WdMylx-N1DlTqP5XZeWg4Tv_0 2024-09-12T17:48:12.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.610+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.612+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:48:12.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_mWdfkipM96Nm1XmD9vLPXJ40ygeysQc', time=2024-09-12T19:38:53.842783+0000, chain.objs.size()=1 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.m08cQywAyvBSy7Nx_cXezMauqsNWGvJ_0 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6837361483874250176', time=2024-09-12T19:40:49.744659+0000, chain.objs.size()=1 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.7hNPLNwLlU4RFzWy7eUe9LvoAi5YvV5_0 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13857529195078871150', time=2024-09-12T19:41:26.727651+0000, chain.objs.size()=1 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.DpIp0fYjGdB-UVY_7p1-r_7jUB-j98a_0 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11796638496087355065', time=2024-09-12T19:42:35.360578+0000, chain.objs.size()=1 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.a9h65q8-RHQvxYZrxRYfLqfWVdXJkYF_0 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12166543737581398512', time=2024-09-12T19:42:36.651359+0000, chain.objs.size()=1 2024-09-12T17:48:12.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.tgQQ8fIszLyC2gXR9GSWlnu_JsOvPPR_0 2024-09-12T17:48:12.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7514433722531800517', time=2024-09-12T19:43:08.304456+0000, chain.objs.size()=1 2024-09-12T17:48:12.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.x2_70Qdg0Dw0TztbG8bCvHfkAiE5SfN_0 2024-09-12T17:48:12.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15056713129949181921', time=2024-09-12T19:43:09.752073+0000, chain.objs.size()=1 2024-09-12T17:48:12.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.59s9KQp04i1PkQHZp-9tTStEImF9gCe_0 2024-09-12T17:48:12.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1641318788577598959', time=2024-09-12T19:43:42.739237+0000, chain.objs.size()=1 2024-09-12T17:48:12.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.3lh8y8SB5t1rphulcWxz51VmOUfvz1b_0 2024-09-12T17:48:12.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7351127739921061360', time=2024-09-12T19:43:44.758963+0000, chain.objs.size()=1 2024-09-12T17:48:12.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.614+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.lR53m6qpJR4FJ0plb5ZdNw5Ftes7Kst_0 2024-09-12T17:48:12.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.615+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16351459237243487342', time=2024-09-12T19:43:44.760620+0000, chain.objs.size()=1 2024-09-12T17:48:12.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.615+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.Ykq13LfwNkQt6kpxD-omtPtgD0dc8HB_0 2024-09-12T17:48:12.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.615+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15129915768175246827', time=2024-09-12T19:44:17.547080+0000, chain.objs.size()=1 2024-09-12T17:48:12.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.615+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.kqaf1OWfOgyo6YIHVzZBcCSfoQ_pJb5_0 2024-09-12T17:48:12.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.615+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3555002703817862529', time=2024-09-12T19:44:21.059598+0000, chain.objs.size()=1 2024-09-12T17:48:12.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.615+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.QgeEDMbu4eWQrKVMLLQCiDfj9O_j0wI_0 2024-09-12T17:48:12.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.617+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15055806049380272480', time=2024-09-12T19:44:53.247758+0000, chain.objs.size()=1 2024-09-12T17:48:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.617+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_._p2H_17A9rjPolaDbx7F_UOt8THfoha_0 2024-09-12T17:48:12.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.621+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.623+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:48:12.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.624+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_wLx6uckmU1IkuaKwD9F6A1EGnQuKW43', time=2024-09-12T19:38:53.941295+0000, chain.objs.size()=3 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bVPc9E7H03FzWE10iTHFzlmd_vRZnCo_0 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bVPc9E7H03FzWE10iTHFzlmd_vRZnCo_1 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bVPc9E7H03FzWE10iTHFzlmd_vRZnCo_2 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16575849601070791514', time=2024-09-12T19:40:14.500139+0000, chain.objs.size()=1 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.Cg6K5ByK1K9gBvgjjALA2aa45lGzspV_0 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9113885207350217168', time=2024-09-12T19:40:14.501865+0000, chain.objs.size()=1 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.5GkRhrcGMRK-WX8v8KL_2nFzZ-45lvY_0 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12138390352388410427', time=2024-09-12T19:40:15.798235+0000, chain.objs.size()=1 2024-09-12T17:48:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.aSxQVYgVThI6TtyVCpXSeH8AoIUDa5L_0 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8670148146504853904', time=2024-09-12T19:40:47.944317+0000, chain.objs.size()=1 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.nuaSmCMt9X_Kr3hLhzONyQ0Z6tiU8ar_0 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12653779865372736993', time=2024-09-12T19:40:49.743639+0000, chain.objs.size()=1 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.rTBzsnH0J-pFSWA7o93k-hBtYGzWswq_0 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8464358469522375596', time=2024-09-12T19:40:49.748327+0000, chain.objs.size()=1 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.v2KfjilnSpE7n9EDbnOJ-DoxuENWweT_0 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5313721367144842760', time=2024-09-12T19:40:51.033107+0000, chain.objs.size()=1 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.p1EfTO0ffo_-UIoEw5yS049gq4jfj-r_0 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11021664716124651923', time=2024-09-12T19:41:25.409617+0000, chain.objs.size()=1 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.-fiPLKmXDpXrAOUbdx4mM7nbeYZMBvv_0 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17770142406089050601', time=2024-09-12T19:42:01.342534+0000, chain.objs.size()=1 2024-09-12T17:48:12.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.625+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.swbrHAqvZCGo8hD3xR000UKIVdQ8ZQb_0 2024-09-12T17:48:12.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.629+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1145535241760205223', time=2024-09-12T19:43:08.306423+0000, chain.objs.size()=1 2024-09-12T17:48:12.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.629+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.GuycUh_MmosNn0rMMDh6938BlxdAJhl_0 2024-09-12T17:48:12.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14342750372587569314', time=2024-09-12T19:43:46.222084+0000, chain.objs.size()=1 2024-09-12T17:48:12.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.lw5nbZXJobHZ1pUSnFyMKIQz5cCcHXx_0 2024-09-12T17:48:12.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16698234101399429924', time=2024-09-12T19:44:17.541582+0000, chain.objs.size()=1 2024-09-12T17:48:12.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.tbR3Y1AadzviTjhX9sNoHs571ZSpS-i_0 2024-09-12T17:48:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4036828762567665976', time=2024-09-12T19:44:19.774066+0000, chain.objs.size()=1 2024-09-12T17:48:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.Ktk7IdEted98uVC7azZGwGP1t9iDYy9_0 2024-09-12T17:48:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2685918377984959100', time=2024-09-12T19:44:21.065243+0000, chain.objs.size()=1 2024-09-12T17:48:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.BoUfp1nh0FZ5hQaRft8lNY6eG4YSX4U_0 2024-09-12T17:48:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8586894383665470483', time=2024-09-12T19:44:53.245107+0000, chain.objs.size()=1 2024-09-12T17:48:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.cprwni5QViY4PgAbZ_vGQ_tm1GPu7NT_0 2024-09-12T17:48:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15999229584496576454', time=2024-09-12T19:44:53.245950+0000, chain.objs.size()=1 2024-09-12T17:48:12.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.nVn0slqQdZlVX75MySe8Uke3tGLQ1Ue_0 2024-09-12T17:48:12.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17232598135959973753', time=2024-09-12T19:44:53.246677+0000, chain.objs.size()=1 2024-09-12T17:48:12.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.630+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.MckuGe5TDel33PDXvl3OBlKxAU8NKxO_0 2024-09-12T17:48:12.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.636+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.638+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:48:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.639+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:48:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9377258730288145717', time=2024-09-12T19:38:53.702879+0000, chain.objs.size()=1 2024-09-12T17:48:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.T9dzvA5sgo-eJZqdhL7zOvk1ibJ6JFB_0 2024-09-12T17:48:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8800330626856408305', time=2024-09-12T19:38:53.724662+0000, chain.objs.size()=1 2024-09-12T17:48:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.Np0QhzPQUgMWg7e8AzGnAiBnywbJVXL_0 2024-09-12T17:48:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1702479025952665293', time=2024-09-12T19:38:53.945374+0000, chain.objs.size()=5 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1_1 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2_1 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.3 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15649977093232844740', time=2024-09-12T19:40:15.792536+0000, chain.objs.size()=1 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.WhERqkkAisrqyfu7Io_OduTZC42ghYZ_0 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15916620492703215433', time=2024-09-12T19:40:15.795571+0000, chain.objs.size()=1 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.5j59Dut-JPepyuXMteRSzUzKYO_gdtg_0 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4249582751307153445', time=2024-09-12T19:40:47.940989+0000, chain.objs.size()=1 2024-09-12T17:48:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.VB6eJJY-B5DGWyG9D38m8aOPm5Nitc0_0 2024-09-12T17:48:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9004735687889227662', time=2024-09-12T19:40:47.942945+0000, chain.objs.size()=1 2024-09-12T17:48:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.50mk8K-Oj-V9uYWmYIhwpFR1z7Nq4Un_0 2024-09-12T17:48:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16632000319041332727', time=2024-09-12T19:40:48.997672+0000, chain.objs.size()=1 2024-09-12T17:48:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.640+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.EGNY71dnGUcuRZanASD4afeE2-E_I1h_0 2024-09-12T17:48:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.643+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14036054994441063915', time=2024-09-12T19:40:51.033516+0000, chain.objs.size()=1 2024-09-12T17:48:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.643+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.1FEGHDK0PONfGuR1QwRqQWDwq8PB6uX_0 2024-09-12T17:48:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1810719328081828235', time=2024-09-12T19:40:51.036567+0000, chain.objs.size()=1 2024-09-12T17:48:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.Rasxb_HbErBIn5kILXcvibAwkNpdyyb_0 2024-09-12T17:48:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16106613499952523473', time=2024-09-12T19:40:51.041186+0000, chain.objs.size()=1 2024-09-12T17:48:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.mVjRK05lM6kE4T2bS7qAXTjun8-pV1f_0 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7114027731819474733', time=2024-09-12T19:41:23.604554+0000, chain.objs.size()=1 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.p2MqWQ73qUSBwiVkY4RXi0--0sDpsbo_0 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15222440275438299481', time=2024-09-12T19:41:23.605381+0000, chain.objs.size()=1 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.TYOSusMEX8vh-Mt39Vu5NoqQbQ2ui6Y_0 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12968219203168246362', time=2024-09-12T19:41:25.405826+0000, chain.objs.size()=1 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.17WCzQXdPBfZDCbxfd-cD7JttLkUluB_0 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12808591257468598307', time=2024-09-12T19:41:26.715476+0000, chain.objs.size()=1 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.J0_obn2FLBg5Ir0wLv_07l3tLdyf5fx_0 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11802218423824737393', time=2024-09-12T19:42:36.663938+0000, chain.objs.size()=1 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.GjSHGmegxdQBFdk6kzGYTtTIXqhZsY4_0 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4195609180033500345', time=2024-09-12T19:43:42.736360+0000, chain.objs.size()=1 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.644+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.t_0dnvlZ9-sLpg3l7DitO9SCr6xyaiZ_0 2024-09-12T17:48:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.645+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3807386653034429344', time=2024-09-12T19:47:13.182316+0000, chain.objs.size()=1 2024-09-12T17:48:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.645+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19__shadow:0AV5yneqBMvmMPPOlpQSu5iVqY1l532_.ZnWf8QqhniwFyyeZTOi8e-y74Cr_dTE_0 2024-09-12T17:48:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.650+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.652+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:48:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.654+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.654+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:48:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13849379604806785469', time=2024-09-12T19:38:53.991608+0000, chain.objs.size()=5 2024-09-12T17:48:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.1 2024-09-12T17:48:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.1_1 2024-09-12T17:48:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.2 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.2_1 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-LUKEWARM.2~n89CgEnKn4qrFgHZYL8N8MpeWI2f9-0.3 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1960424202472669712', time=2024-09-12T19:40:14.508611+0000, chain.objs.size()=1 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.smn_cvdg7JtLPF27aEJw3_Lq5H1IW9V_0 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.456963763098765853', time=2024-09-12T19:40:47.941411+0000, chain.objs.size()=1 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.CFJNs_mALz2MsX3D3ZNXbr1qBuMl32x_0 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2814835168814441237', time=2024-09-12T19:40:49.743997+0000, chain.objs.size()=1 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.Hcx6Wm-UcCYCw7MObmNPjyztxlI_idZ_0 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6053276707751592371', time=2024-09-12T19:41:25.419278+0000, chain.objs.size()=1 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.w3unl0Q0Qfc8n2B-3WKUYzqSeJtYAIK_0 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5264807882468898378', time=2024-09-12T19:41:26.719691+0000, chain.objs.size()=1 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.vke0oOM7F8b0XahF0OZpYQVhfdyYR6A_0 2024-09-12T17:48:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2149681089516664800', time=2024-09-12T19:41:26.724045+0000, chain.objs.size()=1 2024-09-12T17:48:12.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.7mCn4X9j5TooJnoCHinaFq1JYf15bgr_0 2024-09-12T17:48:12.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7470825045015186921', time=2024-09-12T19:42:35.359239+0000, chain.objs.size()=1 2024-09-12T17:48:12.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.655+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.nVvysHER7h23aSQCZxKPK3Pjq-Nf8a9_0 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.658+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12925651354696255500', time=2024-09-12T19:42:35.359938+0000, chain.objs.size()=1 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.658+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.dpG_yiMDkAA2g42ALGDR5bhLJAJthQr_0 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6565729709288814600', time=2024-09-12T19:43:09.746177+0000, chain.objs.size()=1 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.aV1uTMIRrpHl2N5JQksnvLo6scbWxGl_0 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13276680013519774814', time=2024-09-12T19:43:42.747329+0000, chain.objs.size()=1 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.IuT1z_1Bkqj87ePUuCV8YKfYNJLGqXu_0 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1785397542496314078', time=2024-09-12T19:43:44.760670+0000, chain.objs.size()=1 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.M1yhXCcaLG71-S4pHDKKdfskgFOi9Pj_0 2024-09-12T17:48:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.413654262460278305', time=2024-09-12T19:44:17.553107+0000, chain.objs.size()=1 2024-09-12T17:48:12.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.mXBUvpEVY_cyp0eJQqGSakaeIK7dT_W_0 2024-09-12T17:48:12.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.459268071887477908', time=2024-09-12T19:44:19.775984+0000, chain.objs.size()=1 2024-09-12T17:48:12.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.i6fE1B0Y_SDPjHeS0_3GvrBc5290QVg_0 2024-09-12T17:48:12.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.827862509169949273', time=2024-09-12T19:47:00.828222+0000, chain.objs.size()=1 2024-09-12T17:48:12.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.659+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.fHlmBF-6infRVtGAWON_TIFihy04dgc_0 2024-09-12T17:48:12.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.664+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.666+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:48:12.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.668+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.668+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12169596922728131145', time=2024-09-12T19:38:53.731296+0000, chain.objs.size()=1 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.7XNvxOuxS72MZwqSOrlbw5Ub21f4Pj-_0 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13093500823343196536', time=2024-09-12T19:38:54.015629+0000, chain.objs.size()=1 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.Ukz0OJlJLK1TSVzmNxx5ZXQQXvMyKXw_0 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2402911673606873659', time=2024-09-12T19:40:14.505242+0000, chain.objs.size()=1 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.G59XACFqbDKB2gdlO2amF9auxPXzuzC_0 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10412250641040745931', time=2024-09-12T19:40:14.516113+0000, chain.objs.size()=1 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.0-PEwyE4Ylmc29kq_dKWG4xVHN_B8Cd_0 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10940261252560693662', time=2024-09-12T19:40:15.805751+0000, chain.objs.size()=1 2024-09-12T17:48:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.zPTVDVMSHPXxx3XMDLMooPGtgDIhYwP_0 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15199947450182219321', time=2024-09-12T19:40:47.938200+0000, chain.objs.size()=1 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.QRUbhjkEzpJOERmij58US4royb6DAVb_0 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1655402642014361933', time=2024-09-12T19:40:49.743741+0000, chain.objs.size()=1 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.6LZdnPI8EQzlnX5xzIMgq1xQXsiDUCK_0 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12217383429231280245', time=2024-09-12T19:41:23.604375+0000, chain.objs.size()=1 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.3wTj2OWZwo1SdTiL6Na97wE0oG0z-b-_0 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2141749983793166886', time=2024-09-12T19:42:01.348172+0000, chain.objs.size()=1 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.bmYHAoX3NkxgIh2VjUMpn9zg4VfKI06_0 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6753739197072095625', time=2024-09-12T19:42:33.329320+0000, chain.objs.size()=1 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.-pxGwnAzeC1vvwizmw8pbtCd6IO_L_U_0 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8423320210460641615', time=2024-09-12T19:43:42.740567+0000, chain.objs.size()=1 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.669+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.p4MgYRYbdBQSHoLQ24kCoCxABCTYrq6_0 2024-09-12T17:48:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.670+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12313228339417450034', time=2024-09-12T19:43:44.760456+0000, chain.objs.size()=1 2024-09-12T17:48:12.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.670+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.ZlX5E7F5-ruRde4uYM6dNYPycY-Tu3X_0 2024-09-12T17:48:12.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12248159062802564294', time=2024-09-12T19:43:44.762337+0000, chain.objs.size()=1 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.qImKdPxU9-IIDQMGeRbNtxzkFc8k1pm_0 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15132924927415175701', time=2024-09-12T19:44:19.780161+0000, chain.objs.size()=1 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.N6owyXlHHizrCz6YmO4wa3QO76Q5Lps_0 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8379675096303841968', time=2024-09-12T19:44:21.066172+0000, chain.objs.size()=1 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.SXomJyYFd8Mp4eqNdhRCOw5lu1mhRSh_0 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6202680090258836272', time=2024-09-12T19:44:53.247956+0000, chain.objs.size()=1 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.r-kc3polL8oD6oIJAxqOb2LQ9Kx9XMF_0 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7607374623690222124', time=2024-09-12T19:47:00.827168+0000, chain.objs.size()=1 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.itKmzxiA5rjMOn7iUtv9dNeC6CtZ1Qx_0 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11455091945124607409', time=2024-09-12T19:47:13.181705+0000, chain.objs.size()=1 2024-09-12T17:48:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.674+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19__shadow:cqLq0W2c0aHWUQU9bWchB-7imSXgRgb_.faDaWU0uBbNB6I_2Y_idmEJDTHOYZc8_0 2024-09-12T17:48:12.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.678+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.681+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:48:12.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:48:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6871039996888060935', time=2024-09-12T19:38:53.850950+0000, chain.objs.size()=2 2024-09-12T17:48:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_0 2024-09-12T17:48:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_1 2024-09-12T17:48:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17361355683188347775', time=2024-09-12T19:38:53.949383+0000, chain.objs.size()=3 2024-09-12T17:48:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.1 2024-09-12T17:48:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.2 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.3 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14479100401225494045', time=2024-09-12T19:38:53.953595+0000, chain.objs.size()=5 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.1_1 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.2_1 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-LUKEWARM.2~2zM9UPsiwTsO7K0PJwc4kmZg6iGnks-.3 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4224949862392007576', time=2024-09-12T19:40:49.744329+0000, chain.objs.size()=1 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.683+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.vfz8XgGAOEX4Bxjp1Fcd6SxJHoTY8rE_0 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.684+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7958021998103278582', time=2024-09-12T19:40:51.032629+0000, chain.objs.size()=1 2024-09-12T17:48:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.684+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_._FtcEt8V7Oc34MD2sdqFVyzjvdaNxMZ_0 2024-09-12T17:48:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15298259372381439063', time=2024-09-12T19:41:23.618422+0000, chain.objs.size()=1 2024-09-12T17:48:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.nyfcDR97gxtEA0IRj08zabvDQlXk075_0 2024-09-12T17:48:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15723683554392704329', time=2024-09-12T19:42:01.344049+0000, chain.objs.size()=1 2024-09-12T17:48:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.I2JAkKKzi2dy6mwotdIJb1hWQjtIxVU_0 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1798560184811186871', time=2024-09-12T19:42:01.344864+0000, chain.objs.size()=1 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.Ot1ngQ-QBpFkHWbB_RyVVRTT0BjE6Kr_0 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7967253490513667881', time=2024-09-12T19:42:01.349111+0000, chain.objs.size()=1 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.OKc5goFk4HaC8h_w5M69Sn9fagzxsFo_0 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5169091547429850605', time=2024-09-12T19:42:33.329368+0000, chain.objs.size()=1 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.fj_HzhwfNcvmspk4FIamv7je85e7m6F_0 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7662301786097578933', time=2024-09-12T19:42:33.331562+0000, chain.objs.size()=1 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.CRUuoMKD8jafoDQey6UjjH2wCcPysI4_0 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3386588296521734883', time=2024-09-12T19:43:08.313527+0000, chain.objs.size()=1 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.686+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.bgsF8-w6-YT79MEpXycyahW8ibZkPtW_0 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.687+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5795632660187625777', time=2024-09-12T19:43:09.755883+0000, chain.objs.size()=1 2024-09-12T17:48:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.687+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.ZFGvQP1gSZZzKGq2ufvmZ_DIiOJ_Z9q_0 2024-09-12T17:48:12.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.687+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9204508590444640317', time=2024-09-12T19:43:42.738847+0000, chain.objs.size()=1 2024-09-12T17:48:12.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.687+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.fUHsYRbhTdmrhfgNVrr8UBOMPiX1aJB_0 2024-09-12T17:48:12.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.688+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17916433091916991527', time=2024-09-12T19:44:17.553439+0000, chain.objs.size()=1 2024-09-12T17:48:12.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.688+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.JbbcOjUEW8iVjNaKJqZpaEizp6w4eOs_0 2024-09-12T17:48:12.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.688+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3367311898659322151', time=2024-09-12T19:44:21.072312+0000, chain.objs.size()=1 2024-09-12T17:48:12.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.688+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.l-sFSMLQUbsufkoQmSqYEDnSY4sDj6a_0 2024-09-12T17:48:12.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.692+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.695+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:48:12.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.696+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:48:12.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15443319512532237876', time=2024-09-12T19:38:53.713143+0000, chain.objs.size()=1 2024-09-12T17:48:12.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.Et8xCar--rUzw5vGPZMrezGb5Lq-0zP_0 2024-09-12T17:48:12.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7155220720436364623', time=2024-09-12T19:38:53.797798+0000, chain.objs.size()=4 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.1 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.2 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.3 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11__multipart_foo.2~0kZE59C4YqDzer2mOfYywUQjDuX2RyL.4 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14543854310956338570', time=2024-09-12T19:38:53.863796+0000, chain.objs.size()=1 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.T1WvK2vEVbgv7t8K02DR8Zd7vhK-XTh_0 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9361867794258095710', time=2024-09-12T19:38:54.085769+0000, chain.objs.size()=1 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.WL8rMY04YAVBgdXSPyyAUWSyo1HD2LD_0 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5222413098910914333', time=2024-09-12T19:40:15.798438+0000, chain.objs.size()=1 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_._Ou5okeCBIMoetHlV9QI-MNlcp3Szx3_0 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52917872935893794', time=2024-09-12T19:40:51.027238+0000, chain.objs.size()=1 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.lc8wR79cDoESSqJdEMUHhE8nqQPBrEo_0 2024-09-12T17:48:12.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3502361620067889064', time=2024-09-12T19:41:25.411562+0000, chain.objs.size()=1 2024-09-12T17:48:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.LrlE7Xy6036ud0EWa_unl7fc6irrKuY_0 2024-09-12T17:48:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5737108084478701651', time=2024-09-12T19:42:01.342159+0000, chain.objs.size()=1 2024-09-12T17:48:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.xTvIgcr23X9Uh5gVXm5QiUbtIUDlVkb_0 2024-09-12T17:48:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6613577666517426295', time=2024-09-12T19:42:01.354344+0000, chain.objs.size()=1 2024-09-12T17:48:12.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.697+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.3J-KpoA4T61JafmNzly0kYH21oMroF5_0 2024-09-12T17:48:12.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.700+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2546350450915556636', time=2024-09-12T19:42:35.368854+0000, chain.objs.size()=1 2024-09-12T17:48:12.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.700+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.xP8SEz91CxQjCzCqFUQjgI4YU4W0WFY_0 2024-09-12T17:48:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.701+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17826009963239827434', time=2024-09-12T19:42:36.654174+0000, chain.objs.size()=1 2024-09-12T17:48:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.701+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.WODpCGCXIFt63lkYiphbGhIuSccuZ3H_0 2024-09-12T17:48:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.701+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7172040150145346083', time=2024-09-12T19:43:08.308430+0000, chain.objs.size()=1 2024-09-12T17:48:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.701+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.wk_8RZvmI4_csVycxnG-eXxGMKC0WAx_0 2024-09-12T17:48:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.701+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8210749908172418307', time=2024-09-12T19:43:44.762771+0000, chain.objs.size()=1 2024-09-12T17:48:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.701+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.9mUPetgSm3XGl_vYOj3p8BcIAFc2Tgx_0 2024-09-12T17:48:12.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.702+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10909626568034141815', time=2024-09-12T19:44:18.829572+0000, chain.objs.size()=1 2024-09-12T17:48:12.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.702+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.lCfgP5Qf4tjFL6VcYSTBYzGO2dWn8bt_0 2024-09-12T17:48:12.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.702+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16985587333809653543', time=2024-09-12T19:44:21.073314+0000, chain.objs.size()=1 2024-09-12T17:48:12.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.702+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.dH7bzAfyEMvGa7bNBGdZB8tP6p2B3-j_0 2024-09-12T17:48:12.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.702+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3636297437286401753', time=2024-09-12T19:44:53.239797+0000, chain.objs.size()=1 2024-09-12T17:48:12.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.702+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.61jkNraLFTSuAf6XLvcBmNoudLD891S_0 2024-09-12T17:48:12.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.706+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.709+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:48:12.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.710+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:48:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5691453307185360167', time=2024-09-12T19:40:13.965603+0000, chain.objs.size()=1 2024-09-12T17:48:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.uzRXSK8LgagjU8SOKgLeRCmvVLBpmNj_0 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11430714915855950125', time=2024-09-12T19:41:25.405496+0000, chain.objs.size()=1 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.f8mO4WBoCagXf8WPlXey8MNEASglkA2_0 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18300963642579531003', time=2024-09-12T19:41:25.411504+0000, chain.objs.size()=1 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.YpJtedLHQan3PVeLR2upkJ8WFGLzeyA_0 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8875529961611279834', time=2024-09-12T19:41:26.715626+0000, chain.objs.size()=1 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.VHzl-eJGaFXw6TlFsQKQXzWsdhuz6rd_0 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10787023467191874370', time=2024-09-12T19:41:26.730159+0000, chain.objs.size()=1 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.Jq_7gkeeHsPSpAn17IsKTnhN86rGOwT_0 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15356352068569244459', time=2024-09-12T19:41:58.898004+0000, chain.objs.size()=1 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.6clLEOBIgRle8KtDYyW3nIfVgsW5aAt_0 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3975481626080674599', time=2024-09-12T19:42:33.326505+0000, chain.objs.size()=1 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.KvGfucZ9Zxe4meXZyVkRvtK6WqW1NM__0 2024-09-12T17:48:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2466749116044328680', time=2024-09-12T19:42:36.651507+0000, chain.objs.size()=1 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.SxQzJMjcFwNmww7XYvudzS9GETOfxqw_0 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1583952048475479272', time=2024-09-12T19:43:09.756228+0000, chain.objs.size()=1 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.9qCAds0OrRrcWRUrTCugqoMLTIgZ9Vv_0 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5115217371067180963', time=2024-09-12T19:43:42.743858+0000, chain.objs.size()=1 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.xIRZFHUprseBaR-n5RFUrHdpd-8E0qA_0 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13911719296675716593', time=2024-09-12T19:43:44.761105+0000, chain.objs.size()=1 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.HTl2tsCNQOP2jY-HAgG0AUUkG6-lda3_0 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12562446460646023007', time=2024-09-12T19:44:19.769773+0000, chain.objs.size()=1 2024-09-12T17:48:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.711+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.K1NJZSzgNyYUMEEZ38UAUtyrk0KMJcZ_0 2024-09-12T17:48:12.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.715+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8184395855626604333', time=2024-09-12T19:44:53.251318+0000, chain.objs.size()=1 2024-09-12T17:48:12.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.716+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.6Tcp6W6ZGAqSJUOXxVm1YTo2QcsrfAi_0 2024-09-12T17:48:12.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.716+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11874650753638260781', time=2024-09-12T19:47:00.826653+0000, chain.objs.size()=1 2024-09-12T17:48:12.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.716+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.eqXTG1s-J1NauHO-HvMVcTfLmMV3Qd3_0 2024-09-12T17:48:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.718+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.721+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:48:12.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.722+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.722+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7701439051988211042', time=2024-09-12T19:38:53.924516+0000, chain.objs.size()=5 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1_1 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2_1 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.3 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.860461203120895824', time=2024-09-12T19:38:53.982759+0000, chain.objs.size()=5 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.1 2024-09-12T17:48:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.1_1 2024-09-12T17:48:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.2 2024-09-12T17:48:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__shadow_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.2_1 2024-09-12T17:48:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-FROZEN.2~rjBL7bW7Sqgllq70wfaUZB1W1yHddeg.3 2024-09-12T17:48:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7929603428816834986', time=2024-09-12T19:40:15.798112+0000, chain.objs.size()=1 2024-09-12T17:48:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.-5WZ4sb-xYEqJnkYFXNZvvrYMaleyea_0 2024-09-12T17:48:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9544849272657951284', time=2024-09-12T19:40:47.941549+0000, chain.objs.size()=1 2024-09-12T17:48:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.723+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.MnS6pjGLSDZKLeIQYSOZaiHLamzBJI6_0 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1166412721470438853', time=2024-09-12T19:40:49.754333+0000, chain.objs.size()=1 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.LciD7XY1_co8RCqtdkNGra14Mr9oq7A_0 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14666732032009035202', time=2024-09-12T19:40:52.484940+0000, chain.objs.size()=1 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.27CqBTZmwfNFDMczV4ucSSMz7xVihBV_0 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.548950944273439765', time=2024-09-12T19:41:25.411428+0000, chain.objs.size()=1 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.ohKDI1g_flnCbRjmEGjYWH5D6wVzJ9H_0 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14002691111718638992', time=2024-09-12T19:41:26.720689+0000, chain.objs.size()=1 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.7UaCjxdqUmwsqaLh11VrvMI4wJHSWER_0 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10431467185918016294', time=2024-09-12T19:42:01.342728+0000, chain.objs.size()=1 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.CyL7Li1jRSCYJpGpVnIdJ4FzXXv42oi_0 2024-09-12T17:48:12.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1434257653886848435', time=2024-09-12T19:43:08.305541+0000, chain.objs.size()=1 2024-09-12T17:48:12.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.725+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.m7V3CoZovpvpB6P3dZbuoOXa6TRsPJB_0 2024-09-12T17:48:12.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.726+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2107518491560175468', time=2024-09-12T19:43:08.313279+0000, chain.objs.size()=1 2024-09-12T17:48:12.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.726+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.HYnFcoBgbBdOjNwBv57gD2td9JUGQWT_0 2024-09-12T17:48:12.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.727+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8944953720599981664', time=2024-09-12T19:43:09.751588+0000, chain.objs.size()=1 2024-09-12T17:48:12.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.727+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.Z5ZDgLehzQYx93-9HtTX_-CHU_NIZh5_0 2024-09-12T17:48:12.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.727+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7768650623515133158', time=2024-09-12T19:44:21.058682+0000, chain.objs.size()=1 2024-09-12T17:48:12.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.727+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.suRV4N-o62kbev50WfUyS_56Tpfq3nl_0 2024-09-12T17:48:12.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.727+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6703849624047685100', time=2024-09-12T19:44:21.075352+0000, chain.objs.size()=1 2024-09-12T17:48:12.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.727+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.zcql9F-BeRg93LtXI-RY-Qig19B5-Zc_0 2024-09-12T17:48:12.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.731+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.733+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:48:12.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:48:12.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13132960841371927727', time=2024-09-12T19:38:53.893724+0000, chain.objs.size()=2 2024-09-12T17:48:12.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_0 2024-09-12T17:48:12.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.iuFYxL3sFPdL5BWrbmqm_KH63gOJobH_1 2024-09-12T17:48:12.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2011521100251824061', time=2024-09-12T19:40:15.800180+0000, chain.objs.size()=1 2024-09-12T17:48:12.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.xM265qqgor9bfg3uYeLBOm2RbJjgiVI_0 2024-09-12T17:48:12.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.771398694223345666', time=2024-09-12T19:40:15.801260+0000, chain.objs.size()=1 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.egBkvcFN5zenKUdWOmsdU1K8OlYf6dY_0 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17534146462330425746', time=2024-09-12T19:40:15.806886+0000, chain.objs.size()=1 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.ge_YMaml7rD3MHUnLkPmdTa7bNHkbiD_0 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5337619280472400320', time=2024-09-12T19:40:47.941837+0000, chain.objs.size()=1 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.mr7go9H6OkG-A1S6Fu-vz6Rlsdelkdg_0 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.735+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.389919514069656038', time=2024-09-12T19:40:49.748444+0000, chain.objs.size()=1 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.LSFfQk1p41mwlGu-HMqNCy0ijzbT-Ut_0 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15109830774114716040', time=2024-09-12T19:40:51.030252+0000, chain.objs.size()=1 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.3MXZSOw3_qYSSgzWTsBonwreo75Hbfs_0 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12517866644769487433', time=2024-09-12T19:40:51.033140+0000, chain.objs.size()=1 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.NIdQpLxhlQ0Xm0JB9NbgCBUecAmaiLJ_0 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1552807420638841692', time=2024-09-12T19:41:23.615286+0000, chain.objs.size()=1 2024-09-12T17:48:12.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.ETGJ71FpeDHyBfzO48rDu8ZJWCUqyDF_0 2024-09-12T17:48:12.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5942852161436560957', time=2024-09-12T19:42:33.328992+0000, chain.objs.size()=1 2024-09-12T17:48:12.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.4iP3ZGoWg2D9ChfEJ11afZ5D8YQtfNP_0 2024-09-12T17:48:12.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5633200239958708831', time=2024-09-12T19:42:33.333709+0000, chain.objs.size()=1 2024-09-12T17:48:12.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.736+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.R2qAicXQTEBrtR9aS0oY9jBPPo3FCoV_0 2024-09-12T17:48:12.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.738+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6679563904350805729', time=2024-09-12T19:42:33.334503+0000, chain.objs.size()=1 2024-09-12T17:48:12.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.738+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.pxvH1dMjjYo-6nl_agtzSaZ6hfIOjAm_0 2024-09-12T17:48:12.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.739+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7923727457404487537', time=2024-09-12T19:42:36.654223+0000, chain.objs.size()=1 2024-09-12T17:48:12.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.739+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.wZfhdqIQ6arWvEGI_CNN--NQzB7HE6x_0 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9160484708747908730', time=2024-09-12T19:43:09.747670+0000, chain.objs.size()=1 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.vUBEcL6jgXYQva2z9JkxXbr1mXaRsZ0_0 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16004135748999299591', time=2024-09-12T19:43:44.766963+0000, chain.objs.size()=1 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_._d31VmyfH85rPegiQCmrHHnZPGgh0U-_0 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18256671439291198878', time=2024-09-12T19:44:17.547435+0000, chain.objs.size()=1 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.xgoqFPJRmrKsLTwn_94R9RUhWNouRV1_0 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10857286827990234669', time=2024-09-12T19:44:53.241726+0000, chain.objs.size()=1 2024-09-12T17:48:12.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.740+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.InLmMDQSzg42OnigUCj8cIDDQeKpTy3_0 2024-09-12T17:48:12.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.744+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.746+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:48:12.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.747+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743818386706277867', time=2024-09-12T19:38:53.735930+0000, chain.objs.size()=1 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.g1ghhkT3R8znmo6Apm3ftGnmrExFlS7_0 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1365187130805176022', time=2024-09-12T19:38:54.072829+0000, chain.objs.size()=1 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.DpkoIKitMX_ACAkbEZi1hhl1ZCIEHS8_0 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9682073937427924726', time=2024-09-12T19:38:54.080909+0000, chain.objs.size()=1 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.AsFKYhzo2B8I7S8xbKMIEOm7BvuQ4Z5_0 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16467952458776549319', time=2024-09-12T19:40:14.514761+0000, chain.objs.size()=1 2024-09-12T17:48:12.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.92ZLsV8QPFmjH0td0ep9nDtah3jrbbm_0 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1183585728539021757', time=2024-09-12T19:40:47.944030+0000, chain.objs.size()=1 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.748+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.xF5_p5JidxdpmHxGKTNnlMsfJHrU5VI_0 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7046572032441038771', time=2024-09-12T19:41:23.604415+0000, chain.objs.size()=1 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.gaUjcZePBUsXlLgWBGtAQC2qG4lI05C_0 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7163874915332443491', time=2024-09-12T19:41:26.716451+0000, chain.objs.size()=1 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.0-yXtYU2U4KdtoNEaMwJdbVAMgJoWsT_0 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15330608120902161397', time=2024-09-12T19:42:35.359918+0000, chain.objs.size()=1 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.C2N5OdWnOVXbPcZ9dcs_uIPEBRQZYxt_0 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15055904091365970548', time=2024-09-12T19:42:36.650898+0000, chain.objs.size()=1 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.3InGzoMWl4h3RI9NHr-nyTFNpSTwNOq_0 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9988285092877253167', time=2024-09-12T19:43:07.748904+0000, chain.objs.size()=1 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.UzxiPTSXCUQ-e-pr6nk22IpillOjia2_0 2024-09-12T17:48:12.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8807401458930887172', time=2024-09-12T19:43:08.307868+0000, chain.objs.size()=1 2024-09-12T17:48:12.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.eW6fzDiM9z19xm1Rh-HsClCsW6Qtw-p_0 2024-09-12T17:48:12.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12180494385860045996', time=2024-09-12T19:43:42.741022+0000, chain.objs.size()=1 2024-09-12T17:48:12.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.749+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.nZfqmUUkv63dJyk_DGX5Wft83Y_xFBL_0 2024-09-12T17:48:12.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.752+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17880561572915447250', time=2024-09-12T19:47:00.830720+0000, chain.objs.size()=1 2024-09-12T17:48:12.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.752+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.GZwZ-kL6sanBz3FsHXWERDYST33gnA0_0 2024-09-12T17:48:12.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.755+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.757+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:48:12.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12994591421420392263', time=2024-09-12T19:38:53.775086+0000, chain.objs.size()=7 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.1 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__shadow_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.1_1 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.2 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__shadow_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.2_1 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.3 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__shadow_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.3_1 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13__multipart_foo.2~nrd8XK_wQuGSBaYKqstCB5snQn0o4QE.4 2024-09-12T17:48:12.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_IVVSSpgHUu7g_GenfZF_GqkvQYtjbeB', time=2024-09-12T19:38:53.855206+0000, chain.objs.size()=2 2024-09-12T17:48:12.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.G_wdfFnkBy7cDSRVLOPFitGPzLTPyx1_0 2024-09-12T17:48:12.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.759+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.G_wdfFnkBy7cDSRVLOPFitGPzLTPyx1_1 2024-09-12T17:48:12.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.760+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_LBxL6m-WyTLEdjjNx1uVG1OO0xkEC4L', time=2024-09-12T19:38:53.920386+0000, chain.objs.size()=3 2024-09-12T17:48:12.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.760+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.8ZsQIb794Svy2ANgywtUePjb3-hspWA_0 2024-09-12T17:48:12.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.760+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.8ZsQIb794Svy2ANgywtUePjb3-hspWA_1 2024-09-12T17:48:12.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.760+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.8ZsQIb794Svy2ANgywtUePjb3-hspWA_2 2024-09-12T17:48:12.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.762+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6188138823520568398', time=2024-09-12T19:40:51.033842+0000, chain.objs.size()=1 2024-09-12T17:48:12.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.762+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.Af_SaCJ3tbCH74RHccKUFjn8XPvScR3_0 2024-09-12T17:48:12.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.763+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16034561073706654856', time=2024-09-12T19:40:51.035055+0000, chain.objs.size()=1 2024-09-12T17:48:12.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.763+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.GYCNZSZNmiY7Q4OTzhif0nxXHhHNZip_0 2024-09-12T17:48:12.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.763+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1907978987944013471', time=2024-09-12T19:41:23.607624+0000, chain.objs.size()=1 2024-09-12T17:48:12.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.763+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.KNT65TtLNk4tkVvFMqh1XO8RhzlsxLj_0 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.764+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5957923493564175980', time=2024-09-12T19:41:25.409614+0000, chain.objs.size()=1 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.764+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.V3733OPG76_ahw8WJWjlxBTGg6w8JTN_0 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.764+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3580080866214469295', time=2024-09-12T19:41:27.969649+0000, chain.objs.size()=1 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.764+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.qv3Uv68dlWr-Mg6OgEzlSVdP5dn7l_B_0 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5898273406425249165', time=2024-09-12T19:41:58.897266+0000, chain.objs.size()=1 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.9S21R8hg-3MKiBnUkF6X3rv_eMs0SiV_0 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6873366049118859615', time=2024-09-12T19:42:01.346446+0000, chain.objs.size()=1 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.S-wbukRXQKR4EH1nshSEWgL31kGw4GO_0 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1878649103217783924', time=2024-09-12T19:42:33.332598+0000, chain.objs.size()=1 2024-09-12T17:48:12.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.q4H7Dfj2uxu1D9APIP9qPWlKdRSklU7_0 2024-09-12T17:48:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5234591823090686151', time=2024-09-12T19:42:33.338014+0000, chain.objs.size()=1 2024-09-12T17:48:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.5p6Pd5RRN_npXBKnw8dp4EachWUFo5e_0 2024-09-12T17:48:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10661700499043202134', time=2024-09-12T19:42:36.653083+0000, chain.objs.size()=1 2024-09-12T17:48:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_._jUfNzWJfMC_84ufpfLHGMKOL6YqH1N_0 2024-09-12T17:48:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1879757655836692466', time=2024-09-12T19:44:17.542170+0000, chain.objs.size()=1 2024-09-12T17:48:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.765+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.syohL8d62NfFN0-j4LzUEmNA5nFQtLb_0 2024-09-12T17:48:12.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.769+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13618563717758659370', time=2024-09-12T19:44:17.545558+0000, chain.objs.size()=1 2024-09-12T17:48:12.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.769+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.ggSLDdWiI1fC_9f-PnkbIgD8rI_2l60_0 2024-09-12T17:48:12.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.770+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11690670915162741001', time=2024-09-12T19:44:19.769751+0000, chain.objs.size()=1 2024-09-12T17:48:12.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.770+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.Wv8cnMZcX_T4hsmEs6KtO0mv7maH6K6_0 2024-09-12T17:48:12.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.773+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.776+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:48:12.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.777+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.777+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:48:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17841756963435020265', time=2024-09-12T19:38:53.822822+0000, chain.objs.size()=4 2024-09-12T17:48:12.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.1 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.2 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.3 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10__multipart_foo.2~7qBnfHXyBiKbwtlVcc6AtBxKtP3VlHF.4 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12957066202514927682', time=2024-09-12T19:40:14.497735+0000, chain.objs.size()=1 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.9hLanTL2kyVzlx2Ju5QFaMTLni7zQ7V_0 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6324990890519428175', time=2024-09-12T19:40:51.032508+0000, chain.objs.size()=1 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.A06sivWm9w6aASd-Lh4hIOuJCXBay_D_0 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9301881891735831020', time=2024-09-12T19:41:23.605745+0000, chain.objs.size()=1 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.N-e2JSudawqWkv4EeWIaBiyKTHVN6H7_0 2024-09-12T17:48:12.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2702995458355790141', time=2024-09-12T19:41:25.407955+0000, chain.objs.size()=1 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.gdkiQFjEvn14IWJzJPth60XMoNlhqeN_0 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.530315038421184701', time=2024-09-12T19:41:26.720704+0000, chain.objs.size()=1 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.3gYro_Ru5ghIWnyWzr2kuMW7A6Tg0Ma_0 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13492573164734114418', time=2024-09-12T19:41:58.895703+0000, chain.objs.size()=1 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.IQUql4L1b9Ee2S5DbHRysdk5cLDWl3I_0 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11300562098928169819', time=2024-09-12T19:41:58.898771+0000, chain.objs.size()=1 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.5SENfFh1MfiT-l09VKGBXtx42OzDLeJ_0 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2982705165418212500', time=2024-09-12T19:42:35.362840+0000, chain.objs.size()=1 2024-09-12T17:48:12.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.778+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.iekaWwsczYiOoQlAWudi_jzJEL7yj1s_0 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1575391207571609573', time=2024-09-12T19:42:35.363911+0000, chain.objs.size()=1 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.yzUxh9u1iYVe0iDgtlDtvVwiN6sBSJT_0 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10306891878642108238', time=2024-09-12T19:42:35.367175+0000, chain.objs.size()=1 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.2RzWfaMCU9uYDM6iMUQDUeUh61H8vxn_0 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6549273905094070977', time=2024-09-12T19:42:36.656143+0000, chain.objs.size()=1 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.hlKDLw-0vUorV8_04NfYrGHeE98KusT_0 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7144177053326109079', time=2024-09-12T19:43:09.763894+0000, chain.objs.size()=1 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.GPa3RSeuMYTPnY0wSsAWdXd40Py0_K5_0 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2923865605080310987', time=2024-09-12T19:43:42.747745+0000, chain.objs.size()=1 2024-09-12T17:48:12.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.781+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.ELuLvCKYZds46Tk1IBDlJhZEdgisUnb_0 2024-09-12T17:48:12.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.784+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18063298356523669386', time=2024-09-12T19:47:00.827108+0000, chain.objs.size()=1 2024-09-12T17:48:12.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.784+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.GExgt16iALWtubOFm_1i95hCCnP_OTo_0 2024-09-12T17:48:12.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.787+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.789+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:48:12.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.790+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:48:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_wRqzu_TsBNOUGck3ka1CEPBq5igoMsT', time=2024-09-12T19:38:53.932448+0000, chain.objs.size()=3 2024-09-12T17:48:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lz3wCFwUTEWaMU1-A9FCZs5y-VEL_Vs_0 2024-09-12T17:48:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lz3wCFwUTEWaMU1-A9FCZs5y-VEL_Vs_1 2024-09-12T17:48:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lz3wCFwUTEWaMU1-A9FCZs5y-VEL_Vs_2 2024-09-12T17:48:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1315691892551464428', time=2024-09-12T19:40:17.041018+0000, chain.objs.size()=1 2024-09-12T17:48:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.AubPBOLzL8n-AbjWt8Wl2HnP38wCwms_0 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18020874643987082978', time=2024-09-12T19:41:23.600676+0000, chain.objs.size()=1 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.53LKnmyS6bzmBC0e8nAjfJqkHeFrd7Y_0 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2634519741359638274', time=2024-09-12T19:41:23.601745+0000, chain.objs.size()=1 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.wkUKZGKr_O0KOdv0644a3cBCoNMxLVz_0 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.98141180880703071', time=2024-09-12T19:41:26.717858+0000, chain.objs.size()=1 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.ptCWOxjDc33stIZsTK50zabPUndMG6D_0 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9655593141552875145', time=2024-09-12T19:41:58.900368+0000, chain.objs.size()=1 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.cRc7wlWzh26azEUVmektwXFnw0CsKE9_0 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9070889686310495003', time=2024-09-12T19:42:01.346325+0000, chain.objs.size()=1 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.aFd4Wh9d_BZyvDTmFp_o92OYxgT8faN_0 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16069936887326099984', time=2024-09-12T19:42:34.612011+0000, chain.objs.size()=1 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.m1BPit4FydnAHmhVV0xyFy5PEkBWpFz_0 2024-09-12T17:48:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17171049944038037545', time=2024-09-12T19:42:36.647120+0000, chain.objs.size()=1 2024-09-12T17:48:12.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.9txaqjGCT2Benm0txOg4H8yLSAKTtQX_0 2024-09-12T17:48:12.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3818123382199921698', time=2024-09-12T19:43:08.303918+0000, chain.objs.size()=1 2024-09-12T17:48:12.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.791+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.FNXA_XSuUqoMDCIo1m3cqcENDLplDj4_0 2024-09-12T17:48:12.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8175062835837298553', time=2024-09-12T19:43:09.747578+0000, chain.objs.size()=1 2024-09-12T17:48:12.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.jdUlH83FmzMLpiGrMW4bxPH_AXUMocM_0 2024-09-12T17:48:12.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11010205121126642533', time=2024-09-12T19:43:42.738685+0000, chain.objs.size()=1 2024-09-12T17:48:12.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.Zj4rqDyDdg6bPVFiJtyW01pWvNsqe0a_0 2024-09-12T17:48:12.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3350461042428728295', time=2024-09-12T19:43:44.757841+0000, chain.objs.size()=1 2024-09-12T17:48:12.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.UnnEn8UHO4Nx3y-BpitggWvYlIci09X_0 2024-09-12T17:48:12.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13447464335743470471', time=2024-09-12T19:43:44.758604+0000, chain.objs.size()=1 2024-09-12T17:48:12.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.b6OGqQCUsnJaPJagpN7s_-1Fp62rVm-_0 2024-09-12T17:48:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10620479047455308182', time=2024-09-12T19:44:53.241671+0000, chain.objs.size()=1 2024-09-12T17:48:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.If838Lg9EHHfEoHfPgTXSnICk_FXU6v_0 2024-09-12T17:48:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11688442788952599121', time=2024-09-12T19:44:53.248076+0000, chain.objs.size()=1 2024-09-12T17:48:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.795+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.M-naTmTcyxEZHXQCC4HaXFb6il_BA1Z_0 2024-09-12T17:48:12.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.799+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.802+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:48:12.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.803+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.803+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.803+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:48:12.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.803+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17769391315658062980', time=2024-09-12T19:40:14.506499+0000, chain.objs.size()=1 2024-09-12T17:48:12.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.803+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.J3GNjdXqv5nsp83KGpBI1xXFEAVpEEl_0 2024-09-12T17:48:12.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.803+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10945839049977626614', time=2024-09-12T19:41:23.618186+0000, chain.objs.size()=1 2024-09-12T17:48:12.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.803+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.keP1JGReJU9dNtNh4pSHBOrx-4w5MWV_0 2024-09-12T17:48:12.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3438776261971109448', time=2024-09-12T19:41:58.898121+0000, chain.objs.size()=1 2024-09-12T17:48:12.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.zLb0i5vKKCJHc7XWukzHKdL2bLz7VMF_0 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8739844339548540573', time=2024-09-12T19:41:58.905620+0000, chain.objs.size()=1 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.9dRzRMh-fDSdb8DfDzO8ERpxRgUGHoU_0 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14255166452112000934', time=2024-09-12T19:42:33.324717+0000, chain.objs.size()=1 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.bpG0VorpFqHMm5X_oYDwjnQXs-woX0g_0 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9735255873462037565', time=2024-09-12T19:42:36.662313+0000, chain.objs.size()=1 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.HSnbZ64Q08uqzpDQ7s3rp2YA5B1aJOz_0 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8097386133822192705', time=2024-09-12T19:43:09.751974+0000, chain.objs.size()=1 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.1-kT-x1BRC3K6VozGQLarnoJ6WrcdzU_0 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7548681716158272787', time=2024-09-12T19:43:42.741133+0000, chain.objs.size()=1 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.-17wAj_3VmSvQiIzTj8raOCT1fTYvyF_0 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.464012883943664890', time=2024-09-12T19:44:19.770902+0000, chain.objs.size()=1 2024-09-12T17:48:12.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.HUy0AJJipjAmMWa3hMAzy7hvmjkTXzh_0 2024-09-12T17:48:12.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3560563847368799272', time=2024-09-12T19:44:19.772495+0000, chain.objs.size()=1 2024-09-12T17:48:12.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.pVECO7PtnsDctu4QR0l6W-IB_aH6BXl_0 2024-09-12T17:48:12.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4238074416638845961', time=2024-09-12T19:44:21.060658+0000, chain.objs.size()=1 2024-09-12T17:48:12.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.Y9CpJo-Z3XyjhpgJ9NN13zjXauh6GwG_0 2024-09-12T17:48:12.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6535825600121422865', time=2024-09-12T19:44:21.063424+0000, chain.objs.size()=1 2024-09-12T17:48:12.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.804+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.UCLcKB2JmlhJrhqFaKmv7L06iQ2M34e_0 2024-09-12T17:48:12.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.807+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13552912182903399963', time=2024-09-12T19:44:21.067132+0000, chain.objs.size()=1 2024-09-12T17:48:12.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.807+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.dwUli5XEUYTTAa38sV5ImRlUlHchv2O_0 2024-09-12T17:48:12.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.810+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.814+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:48:12.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.815+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.815+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4427656836834026766', time=2024-09-12T19:38:54.105560+0000, chain.objs.size()=1 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.xUPnqn7vxkeMInREuqkl8_qJgC3566o_0 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11193471497674095352', time=2024-09-12T19:40:14.505612+0000, chain.objs.size()=1 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.fdjyHMxri_FjXcTX6Wn4hHX8Sp8E5L7_0 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18206931166940799078', time=2024-09-12T19:40:15.792924+0000, chain.objs.size()=1 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.M6uB3Cs6y4F3zwjNTnCbu0Vy5itCBJ3_0 2024-09-12T17:48:12.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12683626524608010072', time=2024-09-12T19:40:47.950227+0000, chain.objs.size()=1 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.tJ4fXiKHf5cCVdldJOKcqj7xbl4oSv7_0 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5966246384975335114', time=2024-09-12T19:40:49.751083+0000, chain.objs.size()=1 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.r7yRIZ4eJExzcewPR-AnVX7fWPYJc-__0 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7081699144033005163', time=2024-09-12T19:41:23.600970+0000, chain.objs.size()=1 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_._r4rN_3Clu3o5KRCrhZ_sEtSVrsr8vz_0 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.816334413202473283', time=2024-09-12T19:41:25.408874+0000, chain.objs.size()=1 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.h2xlZWd4_FNbVnI8cs37vwjQn3zPK9z_0 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10248748565868625632', time=2024-09-12T19:41:25.412806+0000, chain.objs.size()=1 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.trhu_-h6om4C3aTXdGDVEBgW736WSFy_0 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14633874136900895198', time=2024-09-12T19:41:26.722980+0000, chain.objs.size()=1 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.wH6xTXkJWi6nRqy0xXh6YtldeQRagzX_0 2024-09-12T17:48:12.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11576659858405942151', time=2024-09-12T19:41:58.895415+0000, chain.objs.size()=1 2024-09-12T17:48:12.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.EvNkyF6x6yuEPJ9QmZ7AAFWrN7cKag6_0 2024-09-12T17:48:12.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7424734443242377740', time=2024-09-12T19:44:17.545207+0000, chain.objs.size()=1 2024-09-12T17:48:12.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.U05ce6FgoSzZiLCNa2zSyYiZFHXAUTO_0 2024-09-12T17:48:12.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9232420695371715235', time=2024-09-12T19:47:00.826586+0000, chain.objs.size()=1 2024-09-12T17:48:12.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.816+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.K9-s_EJmR6kHrqWyMi9LFnC977Ay8y__0 2024-09-12T17:48:12.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.822+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.824+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:48:12.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.826+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.826+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_IfQ2Tv0q7EIFK57jcvTarGi31c8WnCM', time=2024-09-12T19:38:53.916284+0000, chain.objs.size()=1 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.lp7xA9xVRHoHRn_qGgWP0ORHJVlBrLc_0 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9656201133291160305', time=2024-09-12T19:38:54.109770+0000, chain.objs.size()=1 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.FyUWg53Y7sjyMwihVGUkKD7dgzg9Dhe_0 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17022065068566608349', time=2024-09-12T19:40:51.035861+0000, chain.objs.size()=1 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.1UPXEhBjoJCo6xwOQxEzpslmBOEJiz1_0 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12761228010419749595', time=2024-09-12T19:41:58.900257+0000, chain.objs.size()=1 2024-09-12T17:48:12.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.Nt8b3gGxujMiC7uleU_3FXaC-TghySt_0 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12554668690749870199', time=2024-09-12T19:41:58.906900+0000, chain.objs.size()=1 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.xSI_-X6ZsGL5xsi_l3IoxbfjfhYXela_0 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12766530186891025456', time=2024-09-12T19:42:02.405336+0000, chain.objs.size()=1 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.j65wT9UArXCGhamYGoTtBQdIkYpPQ_D_0 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16288262246013664576', time=2024-09-12T19:42:33.323955+0000, chain.objs.size()=1 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.hZpK2G6oA6UPYOVmiejgVd2rdfsrIU9_0 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4235951234480841285', time=2024-09-12T19:42:35.359603+0000, chain.objs.size()=1 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.yuMoftHEKPrVOEtZhQiVsBLk9lz5-q8_0 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11366844904426608100', time=2024-09-12T19:42:36.654754+0000, chain.objs.size()=1 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.mLdJ_pLEbNappp2Q-BBZY7F19yX4kyp_0 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18035779248474527987', time=2024-09-12T19:42:36.655734+0000, chain.objs.size()=1 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.efwcD6iRxKRWD4EJPzz3-026PxIxNZt_0 2024-09-12T17:48:12.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12124522453744735198', time=2024-09-12T19:43:08.301715+0000, chain.objs.size()=1 2024-09-12T17:48:12.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.fJJWW7kdE3Je4lWe37tBDuL9TQLUbPw_0 2024-09-12T17:48:12.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17032018645119366598', time=2024-09-12T19:43:08.307670+0000, chain.objs.size()=1 2024-09-12T17:48:12.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.827+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.EKm4uXB_1ZBHR3AHeFhu1ZgKL23SQm__0 2024-09-12T17:48:12.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5976637645742936552', time=2024-09-12T19:43:42.749250+0000, chain.objs.size()=1 2024-09-12T17:48:12.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.jPg3VzGd9dha_sQHqdydAwnAqNoM2dj_0 2024-09-12T17:48:12.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10827649687489174888', time=2024-09-12T19:43:44.769089+0000, chain.objs.size()=1 2024-09-12T17:48:12.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.Lo46Om50DlWq2Mh_to8vS_P69-6BOAI_0 2024-09-12T17:48:12.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12008957628870062334', time=2024-09-12T19:44:21.062088+0000, chain.objs.size()=1 2024-09-12T17:48:12.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.VivL7At7vtt2aFkTcxdMZxO9zQ6IGq4_0 2024-09-12T17:48:12.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1520640994906579058', time=2024-09-12T19:44:21.064129+0000, chain.objs.size()=1 2024-09-12T17:48:12.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.830+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.oMfQVwHchL8gTNdj1eAN1FJ4L2wz3pa_0 2024-09-12T17:48:12.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.833+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.836+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:48:12.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.837+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.837+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:48:12.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2983645858664195491', time=2024-09-12T19:38:53.720080+0000, chain.objs.size()=1 2024-09-12T17:48:12.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.A03C0tyrlukFk1S2VJxspyVfx_zEuZU_0 2024-09-12T17:48:12.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_qm9lsSpCcG4dNvqoFwOPDpQhYRiE-XO', time=2024-09-12T19:38:53.846936+0000, chain.objs.size()=2 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.zArZsfhL6FGvkkQw4CIkAvEH6Lgxl3g_0 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.zArZsfhL6FGvkkQw4CIkAvEH6Lgxl3g_1 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11087113576329641743', time=2024-09-12T19:40:14.505542+0000, chain.objs.size()=1 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.5hX4yjveGkoqRy2-GhtEC2nxQ5Brqgn_0 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2807216200134303226', time=2024-09-12T19:40:51.029484+0000, chain.objs.size()=1 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.TbXFnE9Xx3gLaRYc7Bz2utGjdTZ8UqM_0 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16267188613612037120', time=2024-09-12T19:41:25.407226+0000, chain.objs.size()=1 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.kSwL4zdxX7JLGHaxTSzf-LSphgCZ5KW_0 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15377252754169373207', time=2024-09-12T19:42:36.649375+0000, chain.objs.size()=1 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_._fxHZvaW7bE6pNkvHABLd3WXUuH8ROb_0 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15159511008794951319', time=2024-09-12T19:43:09.755590+0000, chain.objs.size()=1 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.nGz6MkgkNg6Q1E8dL9TRc6Nz9mcg_1H_0 2024-09-12T17:48:12.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7405971076795735767', time=2024-09-12T19:43:44.757428+0000, chain.objs.size()=1 2024-09-12T17:48:12.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.1he_wzJinbC-d1Kt6xVR7MRUbxC088v_0 2024-09-12T17:48:12.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2289953461159715272', time=2024-09-12T19:44:17.539353+0000, chain.objs.size()=1 2024-09-12T17:48:12.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.yOqE7wzuV7Q62I7-UVlXsPYeR6wrE9__0 2024-09-12T17:48:12.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9395196337713066065', time=2024-09-12T19:47:00.829494+0000, chain.objs.size()=1 2024-09-12T17:48:12.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.838+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.-xdhSlnGO_5h7X6nRY9Hy_jw6ky2r6E_0 2024-09-12T17:48:12.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.843+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.846+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:48:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.847+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.848+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:48:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17036667429545280426', time=2024-09-12T19:38:53.884319+0000, chain.objs.size()=2 2024-09-12T17:48:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_0 2024-09-12T17:48:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_1 2024-09-12T17:48:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6040790888859541100', time=2024-09-12T19:40:14.508290+0000, chain.objs.size()=1 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.aygZrmlqRgVzKfCwH33S_AxU2Cjx57C_0 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4113082030414924445', time=2024-09-12T19:40:15.801336+0000, chain.objs.size()=1 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.SXOil_YZ7KGymCdYe5NdGqHvitPmf5w_0 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4454713003915480437', time=2024-09-12T19:40:15.802001+0000, chain.objs.size()=1 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.VufFW4n-5FszldJI_pLEBqPSrRi-Erf_0 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10935445856459617476', time=2024-09-12T19:40:15.802625+0000, chain.objs.size()=1 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.GWWt5F4_LgHN7XSpQl7gDSMYkre-ydV_0 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6349470832304794125', time=2024-09-12T19:40:47.941427+0000, chain.objs.size()=1 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.ZwydxBcLtmk-JmwchsK6RSae_j5hRaP_0 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2807943777582830950', time=2024-09-12T19:40:51.040486+0000, chain.objs.size()=1 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.gklSEBiK4W5hNal70pnwaOM8bfwqRhi_0 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3251157043740169825', time=2024-09-12T19:41:23.605218+0000, chain.objs.size()=1 2024-09-12T17:48:12.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.xKKT5c7P_TkFpRZeX1N_AcjzZDhzsmo_0 2024-09-12T17:48:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.525020367463992075', time=2024-09-12T19:41:58.898298+0000, chain.objs.size()=1 2024-09-12T17:48:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.aSzjlAvPmwwfxKNsldN3ab_gKpj1o17_0 2024-09-12T17:48:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15094389792734109321', time=2024-09-12T19:42:01.339660+0000, chain.objs.size()=1 2024-09-12T17:48:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.icTkiJ6CuzT5o9TNhm9o3rhUlA3sNC3_0 2024-09-12T17:48:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9640564628436792489', time=2024-09-12T19:42:36.655612+0000, chain.objs.size()=1 2024-09-12T17:48:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.849+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.MPS_yftwCcXi1zNydcwaZzl9rLyYLTi_0 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2803860015558638205', time=2024-09-12T19:43:42.739675+0000, chain.objs.size()=1 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.po7LNksMiQZNPM7ZozR2TyV9tqYvmia_0 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3629480424732981121', time=2024-09-12T19:44:19.772112+0000, chain.objs.size()=1 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.t1urTh9n7Cv1nw4w_ekOKU4hkVwX1xH_0 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12870278631042377092', time=2024-09-12T19:44:21.062496+0000, chain.objs.size()=1 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.nDOKmIQE0C56PA-RHNEw4TNMEkpXyLM_0 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14682878185965943496', time=2024-09-12T19:44:22.116007+0000, chain.objs.size()=1 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.H4tuxUm6VaxEzqyXtZiUjyp2mWuCUzD_0 2024-09-12T17:48:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9660714874298570875', time=2024-09-12T19:44:53.243673+0000, chain.objs.size()=1 2024-09-12T17:48:12.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.853+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.fopnhaZEzBkQ17rmgwcrWdtNRNfpkZk_0 2024-09-12T17:48:12.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.856+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.859+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:48:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.860+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8397306178104069296', time=2024-09-12T19:38:53.961992+0000, chain.objs.size()=5 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.1_1 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.2_1 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-FROZEN.2~oOGjf1ZeOrvrFtpRAnQM4ip2CY-OEdg.3 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3157625835509693513', time=2024-09-12T19:38:54.076897+0000, chain.objs.size()=1 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8__shadow_.S9XFPokD_r7cMCu-OD4vl72lvF8LZW8_0 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11806542143254564258', time=2024-09-12T19:40:49.745896+0000, chain.objs.size()=1 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.pmAg8JUzgTJt9c6tZ_jEGYtamMNjAWa_0 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9770642048771168418', time=2024-09-12T19:41:23.604395+0000, chain.objs.size()=1 2024-09-12T17:48:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.V8JnvHjJ71HWkFqVb8kMOTARhdsC3GA_0 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4107730832950807953', time=2024-09-12T19:41:25.407678+0000, chain.objs.size()=1 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.FujldtH8rs88pWDH-BwRk8rW5AiY88l_0 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3948055494063645835', time=2024-09-12T19:41:26.727932+0000, chain.objs.size()=1 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.ATtLgSeBTb9WUP9u5TRWc6tihSJI5Sd_0 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1428006806205389882', time=2024-09-12T19:41:58.906546+0000, chain.objs.size()=1 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.tYVI8CL7CNUpoOblyp6Ag4wWehhs2fk_0 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14030474454666052482', time=2024-09-12T19:42:01.348059+0000, chain.objs.size()=1 2024-09-12T17:48:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.861+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.BhZLj2GcVDKuLdbyCyitH6GA6pPERon_0 2024-09-12T17:48:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.864+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1093759443925308107', time=2024-09-12T19:43:09.749569+0000, chain.objs.size()=1 2024-09-12T17:48:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.864+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.r2gkxSgOP5v2m7gKssJnoo0PFDix_bx_0 2024-09-12T17:48:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.864+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1676456446544290034', time=2024-09-12T19:43:42.740716+0000, chain.objs.size()=1 2024-09-12T17:48:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.864+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.iBfZJBWslizZ57irHW4h6kfDO88h-80_0 2024-09-12T17:48:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.864+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17218711420917312532', time=2024-09-12T19:43:42.741818+0000, chain.objs.size()=1 2024-09-12T17:48:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.864+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.YGxcoMuvKxMwMw8_wDJ9YVOjKEtr6wd_0 2024-09-12T17:48:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.865+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17238602886532003059', time=2024-09-12T19:43:44.759702+0000, chain.objs.size()=1 2024-09-12T17:48:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.865+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.xBk14cUyUpcyxbw5z-3_iUKq6l7fAkV_0 2024-09-12T17:48:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.865+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16569546040843213623', time=2024-09-12T19:44:53.246380+0000, chain.objs.size()=1 2024-09-12T17:48:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.865+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.NrcHYiDU749v9eKMsHDPQ1_Ml21SYs8_0 2024-09-12T17:48:12.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.868+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.871+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:48:12.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.872+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.872+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:48:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16532944081775054579', time=2024-09-12T19:38:53.707652+0000, chain.objs.size()=1 2024-09-12T17:48:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.vPs41NKryOwyAVIlVeeptABdXOKyzkz_0 2024-09-12T17:48:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17441666693944310441', time=2024-09-12T19:38:54.118083+0000, chain.objs.size()=1 2024-09-12T17:48:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.1NrMWBzBasVTHkQP0Vp3zkh_sMNsIgR_0 2024-09-12T17:48:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9567584980215282550', time=2024-09-12T19:40:49.745920+0000, chain.objs.size()=1 2024-09-12T17:48:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.qw2F_3eG0kLaqOLF0pFVgEh8m6k60rw_0 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11474090050550782712', time=2024-09-12T19:40:49.754332+0000, chain.objs.size()=1 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.d3OFr26E0a1W0FgxKubAH43w2uu0vIm_0 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15604832547014649691', time=2024-09-12T19:41:25.405951+0000, chain.objs.size()=1 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.hk3zegC6f7Gr7NUebLFJ4zNwm3FDS5s_0 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6645303225439157588', time=2024-09-12T19:41:25.411112+0000, chain.objs.size()=1 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.G7EBoBDeqs33-J8uxXPN0eEpVgDqPdZ_0 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10289854750369704809', time=2024-09-12T19:42:35.362230+0000, chain.objs.size()=1 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.T_vwePqhPcK6wXdldhOx9Ln2Qy0VvEs_0 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5474391406766897172', time=2024-09-12T19:43:08.301432+0000, chain.objs.size()=1 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.y_WHEX3fYcYXwkKSam_jt7x6VJighIy_0 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9007845113925323912', time=2024-09-12T19:43:08.307543+0000, chain.objs.size()=1 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.7vb4Z3x6w7j3I91yQae7WjSLNU2YOpq_0 2024-09-12T17:48:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16021772180223155342', time=2024-09-12T19:43:09.210453+0000, chain.objs.size()=1 2024-09-12T17:48:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.QFnjkr-i1gGfXZdt7bsray_jiFHyB7q_0 2024-09-12T17:48:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.776830547509492738', time=2024-09-12T19:43:09.744699+0000, chain.objs.size()=1 2024-09-12T17:48:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.q-Ct7kWAeswORug5hniXQeVysUpEGdO_0 2024-09-12T17:48:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17237865598086426869', time=2024-09-12T19:43:09.764073+0000, chain.objs.size()=1 2024-09-12T17:48:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.873+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.TR8xzzOq3zAAMya9D5ttOUqXCqk6n6h_0 2024-09-12T17:48:12.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.877+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4028047263844733268', time=2024-09-12T19:44:17.545217+0000, chain.objs.size()=1 2024-09-12T17:48:12.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.877+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.wzQ0gLaQKgyQoos4NiYrgFm8qNqLny5_0 2024-09-12T17:48:12.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.877+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5764152461782685158', time=2024-09-12T19:44:19.771909+0000, chain.objs.size()=1 2024-09-12T17:48:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.877+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.2wJcBkGI5Rb4Mm9wi7-Ionzqm1stIXy_0 2024-09-12T17:48:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.878+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10427010272067593010', time=2024-09-12T19:44:21.070350+0000, chain.objs.size()=1 2024-09-12T17:48:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.878+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.NGCMfX18PG5L8CIHQ7HkjsJFqvxGPsb_0 2024-09-12T17:48:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.881+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.883+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:48:12.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:48:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5008790407583146598', time=2024-09-12T19:38:53.874767+0000, chain.objs.size()=2 2024-09-12T17:48:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_0 2024-09-12T17:48:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.g9dpNLrfxibjSkW8dssbDYDhycHCH55_1 2024-09-12T17:48:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9803399960553217648', time=2024-09-12T19:40:14.501107+0000, chain.objs.size()=1 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.z2uLsxQdZ3yqu1pTtF4ryCTeqtqk3_l_0 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.867206944429282292', time=2024-09-12T19:40:15.806198+0000, chain.objs.size()=1 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.885+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.JylPDBZ-2kIXmUeF8Fa2SBvi1GbcFyd_0 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1089698473323423051', time=2024-09-12T19:40:47.948904+0000, chain.objs.size()=1 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.2FkjEX_2HjbWZiRRkZE_IQ9VxbAYMrl_0 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3342751741289535292', time=2024-09-12T19:40:49.746599+0000, chain.objs.size()=1 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.A1HY1_Nfflw10twkHlYM0X3YmN6Pi_7_0 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13624707035797418501', time=2024-09-12T19:40:51.040691+0000, chain.objs.size()=1 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.VHIRZ1VBjf5mzt8zTX_G2JUmdT37jdB_0 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15069982174468999505', time=2024-09-12T19:40:51.044280+0000, chain.objs.size()=1 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.ZbHMuyo6cnTRLFqqoEQ2IAsk__gH2CV_0 2024-09-12T17:48:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.877006165091963454', time=2024-09-12T19:41:23.612968+0000, chain.objs.size()=1 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.zgga_yQ0SRnoKalFLUdonKjawUTEqp2_0 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11598663861018875027', time=2024-09-12T19:41:58.898284+0000, chain.objs.size()=1 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.H7yJLQKRfH5Iuk7nzJNcj4jW18G9jsU_0 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17615444919564733666', time=2024-09-12T19:41:59.979880+0000, chain.objs.size()=1 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.qX9exAjpC3xI3AhQ8XuY3zFfEYLV2Rn_0 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12201842586932091767', time=2024-09-12T19:42:33.330646+0000, chain.objs.size()=1 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.886+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.0uO1MfpEBr6c4cCY5OMc_YzbcPpeKV4_0 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.888+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11758581575397181343', time=2024-09-12T19:42:35.359174+0000, chain.objs.size()=1 2024-09-12T17:48:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.888+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.y8a7F0qO6VqQBObIG_8KQcMzf-Rw8yL_0 2024-09-12T17:48:12.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.888+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8454587808468235687', time=2024-09-12T19:42:35.359860+0000, chain.objs.size()=1 2024-09-12T17:48:12.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.888+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.vJdG3vqKsU7t9b_YNYxUMSFP-WBFIi__0 2024-09-12T17:48:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9848362254850451140', time=2024-09-12T19:43:08.303044+0000, chain.objs.size()=1 2024-09-12T17:48:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.ZTFNydd_BBSa49WUbFSGULYkjmu1Vkd_0 2024-09-12T17:48:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1636283997387742934', time=2024-09-12T19:43:11.413133+0000, chain.objs.size()=1 2024-09-12T17:48:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.am3J1edIC8YpWiplV2XzzOYHIAmUlbf_0 2024-09-12T17:48:12.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10386863180596394934', time=2024-09-12T19:44:17.540404+0000, chain.objs.size()=1 2024-09-12T17:48:12.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.z6094Tva00-g23ZnYsXOV-8Tra81YK7_0 2024-09-12T17:48:12.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6826727336510396726', time=2024-09-12T19:44:19.771382+0000, chain.objs.size()=1 2024-09-12T17:48:12.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.890+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.IyG7QOjpw7dXqb_vJRA0tWs7guEEXSE_0 2024-09-12T17:48:12.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.894+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.896+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:48:12.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:48:12.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_h0G9WHZgDVc3tnpxmHXZbXOnNTVdb01', time=2024-09-12T19:38:53.888528+0000, chain.objs.size()=1 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.54Vpx6FKjseT8whf_weiZ-eZWIRXjjk_0 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_MmPX1xJfNYeOuZjuGBV-whRVPqRkegn', time=2024-09-12T19:38:53.928387+0000, chain.objs.size()=3 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bQSf7jHXgQz1zb0hPVk-lIAfIZ1Bc11_0 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bQSf7jHXgQz1zb0hPVk-lIAfIZ1Bc11_1 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__shadow_.bQSf7jHXgQz1zb0hPVk-lIAfIZ1Bc11_2 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13270676448367995564', time=2024-09-12T19:38:53.987313+0000, chain.objs.size()=3 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.898+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-STANDARD.2~ga_EGywADQPpfw1G68NdD-bEVQWECyY.1 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-STANDARD.2~ga_EGywADQPpfw1G68NdD-bEVQWECyY.2 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15__multipart_foo-STANDARD.2~ga_EGywADQPpfw1G68NdD-bEVQWECyY.3 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10485447438065578677', time=2024-09-12T19:40:49.742388+0000, chain.objs.size()=1 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.GwRCiMW3VwolhBceF_QmQQj4b4v8Lzs_0 2024-09-12T17:48:12.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18274727554381117578', time=2024-09-12T19:41:24.664269+0000, chain.objs.size()=1 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.LpaX38E8AS37QHFwUEjvUa2gz2ks2au_0 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4672333769851899377', time=2024-09-12T19:41:26.723039+0000, chain.objs.size()=1 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.ZCGH88HWYVKy7XvwrsdO0XKELjtIiWh_0 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9629124777557931175', time=2024-09-12T19:41:26.723688+0000, chain.objs.size()=1 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.O424vYNlP588cY9NRn9goYmW65v43A-_0 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1910340744517360535', time=2024-09-12T19:41:58.895072+0000, chain.objs.size()=1 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.899+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.ABSB20EWYoM83U6uFc-RClt726ctGJo_0 2024-09-12T17:48:12.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.901+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14218927192985350872', time=2024-09-12T19:42:35.362250+0000, chain.objs.size()=1 2024-09-12T17:48:12.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.901+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.-iEFn5uJ-bwl0Vxi0mujY_uqn5MUKF6_0 2024-09-12T17:48:12.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.901+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1491623077571190433', time=2024-09-12T19:42:36.661811+0000, chain.objs.size()=1 2024-09-12T17:48:12.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.902+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.essF5AyzvZwAO2jOSd-2eRelAh9Mrhq_0 2024-09-12T17:48:12.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.902+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15602717752993431239', time=2024-09-12T19:43:08.301942+0000, chain.objs.size()=1 2024-09-12T17:48:12.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.902+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.OktaD13gZ3wZ3WSBgEAv2Ka3ut4fHsr_0 2024-09-12T17:48:12.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.902+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16608514575475736263', time=2024-09-12T19:44:53.253763+0000, chain.objs.size()=1 2024-09-12T17:48:12.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.902+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.acPAI6KsnQWD1PFM7KYSwU7OudFqDc2_0 2024-09-12T17:48:12.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.902+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12863128120258590566', time=2024-09-12T19:47:00.832136+0000, chain.objs.size()=1 2024-09-12T17:48:12.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.902+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.V01XAJ92EyVyB5ABUxLPO8LcSi93tx4_0 2024-09-12T17:48:12.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.906+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.909+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:48:12.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.910+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.910+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:48:12.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4817609501868175766', time=2024-09-12T19:38:53.694375+0000, chain.objs.size()=1 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.LlKOnW8xEWUWSU6tIreVoBt8XxDXU2X_0 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8847413019500979159', time=2024-09-12T19:38:54.011276+0000, chain.objs.size()=3 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.afdGEyNSauR3oDrMzITRnK47KkIk6Z3_0 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.afdGEyNSauR3oDrMzITRnK47KkIk6Z3_1 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.afdGEyNSauR3oDrMzITRnK47KkIk6Z3_2 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.621498427356270725', time=2024-09-12T19:40:14.500432+0000, chain.objs.size()=1 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.S7hpHEcMYhPJEFAeUPCNcn1WB-hFh7n_0 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6184669667536056053', time=2024-09-12T19:40:47.938121+0000, chain.objs.size()=1 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.qTyEpWw4o-vLIAaFWksiWvF6QyziTEg_0 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16508037006444554223', time=2024-09-12T19:41:26.718953+0000, chain.objs.size()=1 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.j2t51fTqornGdrO4NltsM4Xaw_UCT48_0 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2945935533809667316', time=2024-09-12T19:41:58.899514+0000, chain.objs.size()=1 2024-09-12T17:48:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.TkwnG3a6AZtbZWvpXTtGYo5J04ts6zc_0 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16640382243092444378', time=2024-09-12T19:42:01.343944+0000, chain.objs.size()=1 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.AGpy74K7cSJVHCd16gTqaPjrzguUeJ0_0 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12352084205438706029', time=2024-09-12T19:42:36.659771+0000, chain.objs.size()=1 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.OwAZbJDmreYPKUISYQpV7tyAC_3hwlR_0 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3394547560271172533', time=2024-09-12T19:44:53.253781+0000, chain.objs.size()=1 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.AMiCn0qm8qogP1L9xkDgs08d0LBNEGx_0 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17783924447664614890', time=2024-09-12T19:47:00.827474+0000, chain.objs.size()=1 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.911+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.B9PoIRd8peo59LFDjKMclRbBxe19wBa_0 2024-09-12T17:48:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.913+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.182203705275756234', time=2024-09-12T19:47:00.828260+0000, chain.objs.size()=1 2024-09-12T17:48:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.913+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.l-Lzl8njIQJc3D0QMMyufldeaLEKbGP_0 2024-09-12T17:48:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.916+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.918+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:48:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.920+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.920+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7195650118022146785', time=2024-09-12T19:38:53.755760+0000, chain.objs.size()=4 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.1 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.2 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.3 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12__multipart_foo.2~d9mnooOvnYZeGD4IeIhx4_eIE6H0r-I.4 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14508652410513579194', time=2024-09-12T19:38:53.879459+0000, chain.objs.size()=1 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.T1WvK2vEVbgv7t8K02DR8Zd7vhK-XTh_0 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11387412115418875937', time=2024-09-12T19:38:54.113781+0000, chain.objs.size()=1 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9__shadow_.vqhI9lvDt6aa4AwR6mZQcLKQ9FAaG28_0 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3285964368892162728', time=2024-09-12T19:40:14.501525+0000, chain.objs.size()=1 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.lsbo6FV02tddD8_ai50x8IE-9TD2WWT_0 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6134065975448473561', time=2024-09-12T19:40:47.942967+0000, chain.objs.size()=1 2024-09-12T17:48:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.ShVFVrWjX92d3i3MP9nr7lqe2tWq8NN_0 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.650147144266262331', time=2024-09-12T19:41:23.608195+0000, chain.objs.size()=1 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.q23Pcpivh_C2uCb8PeW6j_ld4M1arBS_0 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8165390081476311367', time=2024-09-12T19:41:25.421930+0000, chain.objs.size()=1 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.RbdUjT1N6qh9IEgmKtednRw9eJRSHzA_0 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15334480493719246281', time=2024-09-12T19:41:58.895879+0000, chain.objs.size()=1 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.v-_8_1HWaUQji9B0rWJZ_657EEhzPGt_0 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15591170445486902711', time=2024-09-12T19:42:35.369004+0000, chain.objs.size()=1 2024-09-12T17:48:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.921+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.TaBQxH6I4nR6jeOW2VnZBrlcigaAF9p_0 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16181080906422949500', time=2024-09-12T19:43:08.303640+0000, chain.objs.size()=1 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.5Ya0U9gJCLbdJYSXS6rBsitg960MNIe_0 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1955739337891645031', time=2024-09-12T19:43:08.313154+0000, chain.objs.size()=1 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.qXrrA7KQz2o0_fDiS4z7Qr8Bdfyc8aP_0 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16850289223908690838', time=2024-09-12T19:43:09.745425+0000, chain.objs.size()=1 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_._0A-P-exPrO2W_gYyoTQzxx54a_HZaM_0 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9218274051169206993', time=2024-09-12T19:43:09.751726+0000, chain.objs.size()=1 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.924+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.VqV0J4S321ivSY8HlAB7fjooGk5FllJ_0 2024-09-12T17:48:12.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.925+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13708439983297916142', time=2024-09-12T19:44:19.772961+0000, chain.objs.size()=1 2024-09-12T17:48:12.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.925+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.Zk8HOwIv_N0T4c-nvPQKmS1cbVbWOlT_0 2024-09-12T17:48:12.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.925+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16699202439418761190', time=2024-09-12T19:47:00.826701+0000, chain.objs.size()=1 2024-09-12T17:48:12.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.925+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.2WiZnMgx2ezUMuNiNEZZ_BZUZBSmPGM_0 2024-09-12T17:48:12.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.930+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.933+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:48:12.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.934+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.934+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:48:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='_5ouc2jdTuPQCJMQIlLgV3mOQyATbI2E', time=2024-09-12T19:38:53.869357+0000, chain.objs.size()=2 2024-09-12T17:48:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.97BW1Wc6FOvf9AAAPZwPm1UzIFmnZJn_0 2024-09-12T17:48:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16__shadow_.97BW1Wc6FOvf9AAAPZwPm1UzIFmnZJn_1 2024-09-12T17:48:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3588420868909237933', time=2024-09-12T19:38:53.937221+0000, chain.objs.size()=3 2024-09-12T17:48:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.1 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.2 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17__multipart_foo-STANDARD.2~qNHqkiLCDghnCfzaJ1oemFcc_65a142.3 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17178889370819696436', time=2024-09-12T19:40:47.944978+0000, chain.objs.size()=1 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.J9cpmzIDcYLqPPgno72LQy5bycKV9-a_0 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14750619305334603588', time=2024-09-12T19:40:49.740795+0000, chain.objs.size()=1 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.BF0Weyn7SR4tLAYeE3HNQSowTOrrLFS_0 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4625184123935625116', time=2024-09-12T19:40:51.030104+0000, chain.objs.size()=1 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.B0KlUMlsPTduVT3_FMJOoG05Luwe709_0 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6451428870968354771', time=2024-09-12T19:42:35.357183+0000, chain.objs.size()=1 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.U4yXgACBTzJAfG3BNT71DdBMvl5F0pH_0 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18346394238005582911', time=2024-09-12T19:43:42.739933+0000, chain.objs.size()=1 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.Ff-v-0a9kwAgExNI1sEDBUsjDPDHSCm_0 2024-09-12T17:48:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.357942317487326758', time=2024-09-12T19:43:44.758950+0000, chain.objs.size()=1 2024-09-12T17:48:12.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.rPEMJQQq4CKta00KyRgEClE2qXvb62o_0 2024-09-12T17:48:12.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10756335198234019267', time=2024-09-12T19:43:44.759676+0000, chain.objs.size()=1 2024-09-12T17:48:12.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.935+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.fpEE0uwHZYSY7ZkazsBa__nNwDyrUAV_0 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9999036695630882999', time=2024-09-12T19:43:44.764002+0000, chain.objs.size()=1 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.ze47wBmVsyPAPhKEjhS1dqBghLeZHyG_0 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11434095249074209131', time=2024-09-12T19:44:17.544514+0000, chain.objs.size()=1 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.Jryv4VL6_iRnc7XCwi75fD2XEnuBrgJ_0 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11054457915634161655', time=2024-09-12T19:44:19.773937+0000, chain.objs.size()=1 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.mQ18855oxK4N7HXxP-W2WUG0mvFR89g_0 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11446871530287564982', time=2024-09-12T19:47:00.826656+0000, chain.objs.size()=1 2024-09-12T17:48:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.940+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18__shadow_.BdNNGofbNdIBvPHLkyZb9RlHLj3zhyS_0 2024-09-12T17:48:12.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.944+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.946+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:48:12.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.947+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.948+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7213780826540300440', time=2024-09-12T19:40:14.516092+0000, chain.objs.size()=1 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_.kdHavi81mJNbE1sCmAFsWCdO09XhRnW_0 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13219594213721917493', time=2024-09-12T19:40:15.794975+0000, chain.objs.size()=1 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.M1JQw3-fVoxlydSxqkAEec2HjsQpDjX_0 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8112165981418304326', time=2024-09-12T19:40:47.945240+0000, chain.objs.size()=1 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.XCF-NPA7blUcfLuztWmWOoU25f8qinD_0 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16314109673137575896', time=2024-09-12T19:41:26.723954+0000, chain.objs.size()=1 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.cHngSbV1BjSz_zPbxtmX6lkm0horv7m_0 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2774825500192231537', time=2024-09-12T19:41:58.897027+0000, chain.objs.size()=1 2024-09-12T17:48:12.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.5ZO6U2iJeR6zf-a_3edKYDacXBqrwPu_0 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9172233636481984422', time=2024-09-12T19:41:58.897968+0000, chain.objs.size()=1 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.iQrjLhX3tmXTTMn2mCB5WZAMWbNUWJo_0 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7885799629409061810', time=2024-09-12T19:42:01.341241+0000, chain.objs.size()=1 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.ni5FG07WVXFbOHa4-KA-j-TW67sCxYb_0 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11333868808746017717', time=2024-09-12T19:42:33.331383+0000, chain.objs.size()=1 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.1w1fr-zXV_JpFoaLrDoRCKs2DUwgaAh_0 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14193651316664537755', time=2024-09-12T19:42:36.655809+0000, chain.objs.size()=1 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.m1R8TALivZ3rb6_MCaJdmoY0Z0HANJF_0 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11465488123668246217', time=2024-09-12T19:43:09.763416+0000, chain.objs.size()=1 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.34__shadow_.Knq7k_tK3C-5n3WQHA9AMqoHsjuULXJ_0 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7417851642012579453', time=2024-09-12T19:43:42.736062+0000, chain.objs.size()=1 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.SwErXQoToL-b0eg28tkKWWbMNCkk8GF_0 2024-09-12T17:48:12.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6704167677454793018', time=2024-09-12T19:44:17.543639+0000, chain.objs.size()=1 2024-09-12T17:48:12.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.949+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.Rf_V9I2Axa5OgkMNWEB7CmeQHxoVUqx_0 2024-09-12T17:48:12.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.951+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15831245364491193768', time=2024-09-12T19:44:19.769430+0000, chain.objs.size()=1 2024-09-12T17:48:12.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.951+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.t3pZyVzR6ew4NW4M8TT8REQ-VEG9aWa_0 2024-09-12T17:48:12.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3022761518552769967', time=2024-09-12T19:44:19.780050+0000, chain.objs.size()=1 2024-09-12T17:48:12.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.ItI0u-Yk4173l2ElmftuEKXkhJ-tdm3_0 2024-09-12T17:48:12.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5817201815433813877', time=2024-09-12T19:44:21.058002+0000, chain.objs.size()=1 2024-09-12T17:48:12.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.St2CT_-wsvvbKTPZ-zJZiD6jQiHKuvy_0 2024-09-12T17:48:12.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2492710180302227754', time=2024-09-12T19:44:21.061561+0000, chain.objs.size()=1 2024-09-12T17:48:12.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.gY9l2PKmiTR98Q3abc87JQxBtHyLC6v_0 2024-09-12T17:48:12.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16576944315196780924', time=2024-09-12T19:44:53.248876+0000, chain.objs.size()=1 2024-09-12T17:48:12.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.cCinPviGi6xJrnmfzCKAaJNjw9gmu9U_0 2024-09-12T17:48:12.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7976587781623241837', time=2024-09-12T19:47:08.698391+0000, chain.objs.size()=1 2024-09-12T17:48:12.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.953+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19__shadow:V5uXh-9uCXj.p12QHYNmzmDZFlvQ8r5_.G-vHPhJq4zMMiXmczQwnX9JlzKj17Sl_0 2024-09-12T17:48:12.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.957+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.959+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:48:12.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.960+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12887123126376645968', time=2024-09-12T19:38:53.698528+0000, chain.objs.size()=1 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5__shadow_.8nHvItIUhiRS_7ULxF_MohZSpBvTvBW_0 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1353714290024355722', time=2024-09-12T19:38:54.021233+0000, chain.objs.size()=3 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.OVbNV8QfdfzSdSMXNx8xUPRJiTnpGyS_0 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.OVbNV8QfdfzSdSMXNx8xUPRJiTnpGyS_1 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14__shadow_.OVbNV8QfdfzSdSMXNx8xUPRJiTnpGyS_2 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8017111540378912013', time=2024-09-12T19:40:49.745951+0000, chain.objs.size()=1 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23__shadow_.6dUCe9u8x98e_cDDzrIlZLebRWfZYEX_0 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1991610601340635401', time=2024-09-12T19:40:51.030293+0000, chain.objs.size()=1 2024-09-12T17:48:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24__shadow_.e6mnDlJBlayy2LybY9jIwrc5yVvNkjk_0 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15506313549936732165', time=2024-09-12T19:41:26.719106+0000, chain.objs.size()=1 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.MOFj90vsdGHnyTBsNGJrTVsPrBbS6Ku_0 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6453391937640067414', time=2024-09-12T19:41:58.895764+0000, chain.objs.size()=1 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.28__shadow_.Nah-Nn3JBBeNMYBu_O_8XxUZiNdvN2b_0 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7849488072532161050', time=2024-09-12T19:42:33.327953+0000, chain.objs.size()=1 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.MLdKoUtSDsvzEqD9c7wY5TfnQX_YR3Q_0 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14855508692854196365', time=2024-09-12T19:42:33.336378+0000, chain.objs.size()=1 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.0eMDz-Su658dVq5pgFoAmwXOw3STj53_0 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10418062509564571330', time=2024-09-12T19:42:35.362788+0000, chain.objs.size()=1 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.ujH40oVkH3dxdgQlG8iD1Laa4glw2rd_0 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10843664023573277136', time=2024-09-12T19:43:08.301864+0000, chain.objs.size()=1 2024-09-12T17:48:12.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.961+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.oq4ezCMJPsjWF7EuGEZ1LyHGkHOiFfB_0 2024-09-12T17:48:12.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.965+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15565007473236395771', time=2024-09-12T19:43:42.740108+0000, chain.objs.size()=1 2024-09-12T17:48:12.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.965+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.35__shadow_.sWsuRp7Zf3TLtGUR4Xswclj3XKBCC77_0 2024-09-12T17:48:12.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.965+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2723483065801266174', time=2024-09-12T19:43:44.763085+0000, chain.objs.size()=1 2024-09-12T17:48:12.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.965+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36__shadow_.VtyU0JNwj7asWR4fYjYkJu4GGQ2s7R6_0 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10738416471633098501', time=2024-09-12T19:44:17.551704+0000, chain.objs.size()=1 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.3vlzFxFLkwE-Sf6cJEah2QIQQuhLQ-X_0 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1431069367339100313', time=2024-09-12T19:44:21.063692+0000, chain.objs.size()=1 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_._k1E9FHJOKE_YPSxFOUUyLJh-H2s3Hm_0 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16576373494543836741', time=2024-09-12T19:44:53.243620+0000, chain.objs.size()=1 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.DXONoDJx8i2O7Qh0xVnNjekyOXmoKhW_0 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4074193784381854922', time=2024-09-12T19:44:53.251554+0000, chain.objs.size()=1 2024-09-12T17:48:12.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.967+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.40__shadow_.td4YycINLydIMqg63gC0SztAaZ0P-NW_0 2024-09-12T17:48:12.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.970+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.973+0000 7fc101214800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:48:12.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.974+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:12.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.974+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:12.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:48:12.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15662719053093943939', time=2024-09-12T19:40:14.505247+0000, chain.objs.size()=1 2024-09-12T17:48:12.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20__shadow_._bL1VHPivimnZoBq3TYIydgAd5FxXha_0 2024-09-12T17:48:12.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5021396641120615291', time=2024-09-12T19:40:15.795590+0000, chain.objs.size()=1 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.21__shadow_.xn4z1QsDu_y9TwmEwZF19_F4GjYOX93_0 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3071712517914127806', time=2024-09-12T19:40:47.943910+0000, chain.objs.size()=1 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.HljJD0e98mD4fO58oGVKeGrWfWpj5NI_0 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7126568082190545839', time=2024-09-12T19:40:47.951053+0000, chain.objs.size()=1 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.22__shadow_.h6K-04mCnib5Fpbp5zmePZwei2Kq1rW_0 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13237289301773163292', time=2024-09-12T19:41:23.604407+0000, chain.objs.size()=1 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.25__shadow_.1UKXQn3MGOpJQmUclrMhI0NImIvMRTC_0 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16048147514498458546', time=2024-09-12T19:41:25.422045+0000, chain.objs.size()=1 2024-09-12T17:48:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.26__shadow_.8QAVBv9XgdeFbRYBqQfb1N_kpIh2mAa_0 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2261025788235863066', time=2024-09-12T19:41:26.728890+0000, chain.objs.size()=1 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27__shadow_.hgJ5Vmcx3jBbZJBLJCVKUtufMhLCv9z_0 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8875665488217368211', time=2024-09-12T19:42:01.352725+0000, chain.objs.size()=1 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.S3i63hGebzwI6ldwljIbvt-li_buIC4_0 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1044614473733016690', time=2024-09-12T19:42:01.353541+0000, chain.objs.size()=1 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.29__shadow_.AqKSl6wyOZJA8iqHoVsPk2YmSi7wbyG_0 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2892634808787996782', time=2024-09-12T19:42:33.330327+0000, chain.objs.size()=1 2024-09-12T17:48:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.30__shadow_.XrfdV1jqy8H0MNBod3cS9zTO8jBtile_0 2024-09-12T17:48:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5666053039048290672', time=2024-09-12T19:42:35.355877+0000, chain.objs.size()=1 2024-09-12T17:48:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.31__shadow_.cYGJqIdc_0IvTh9NoKzhxrk9vX2iyJ9_0 2024-09-12T17:48:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12127724855812944083', time=2024-09-12T19:42:36.650519+0000, chain.objs.size()=1 2024-09-12T17:48:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.975+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.32__shadow_.j2EIu3cXQUuatvcPMkxQC102GRVxFq9_0 2024-09-12T17:48:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.977+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6314477688233587232', time=2024-09-12T19:43:08.303886+0000, chain.objs.size()=1 2024-09-12T17:48:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.977+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.33__shadow_.VA9OoS6jXP44z7jsVOAPs0zVrVRwIB5_0 2024-09-12T17:48:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10531426674759896184', time=2024-09-12T19:44:17.547745+0000, chain.objs.size()=1 2024-09-12T17:48:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.37__shadow_.lBke_iDmnNbp974NSMneOD7btyuNOH__0 2024-09-12T17:48:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7656373484394192780', time=2024-09-12T19:44:19.774941+0000, chain.objs.size()=1 2024-09-12T17:48:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38__shadow_.guyJlrncSj5HTw3meVONYxFu9QDvGnQ_0 2024-09-12T17:48:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13668672421729294015', time=2024-09-12T19:44:21.062234+0000, chain.objs.size()=1 2024-09-12T17:48:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.O-OCa7RLeNBwn83aU0lAR_dZo0tLjvw_0 2024-09-12T17:48:12.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15750397193004404047', time=2024-09-12T19:44:21.066277+0000, chain.objs.size()=1 2024-09-12T17:48:12.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39__shadow_.FihGFJ9AlPKDovRmVqiLp4m58_DUMyZ_0 2024-09-12T17:48:12.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6640838930629677343', time=2024-09-12T19:47:13.181619+0000, chain.objs.size()=1 2024-09-12T17:48:12.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.980+0000 7fc101214800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.19__shadow:9dNYVBISopJcnqTZ5CedPxuX8v58xZE_.fZvs_IQt_d2khVnQai2wn3UADxtLAwr_0 2024-09-12T17:48:12.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.983+0000 7fc101214800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.987+0000 7fbfb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.989+0000 7fc101214800 20 remove_watcher() i=0 2024-09-12T17:48:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.989+0000 7fc101214800 2 removed watcher, disabling cache 2024-09-12T17:48:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.990+0000 7fc101214800 20 remove_watcher() i=1 2024-09-12T17:48:12.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.991+0000 7fc101214800 20 remove_watcher() i=2 2024-09-12T17:48:12.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.992+0000 7fc101214800 20 remove_watcher() i=3 2024-09-12T17:48:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.993+0000 7fc101214800 20 remove_watcher() i=4 2024-09-12T17:48:12.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.994+0000 7fc101214800 20 remove_watcher() i=5 2024-09-12T17:48:12.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.995+0000 7fc101214800 20 remove_watcher() i=6 2024-09-12T17:48:12.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:12.996+0000 7fc101214800 20 remove_watcher() i=7 2024-09-12T17:48:13.008 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:48:13.102 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:13.102 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:13.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.141+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 20 realm 2024-09-12T17:48:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.142+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.143+0000 7ff7a2b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.143+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.143+0000 7ff7a2b42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.143+0000 7ff7a2b42800 20 searching for the correct realm 2024-09-12T17:48:13.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.146+0000 7ff79e886640 0 -- 172.21.15.63:0/4178397733 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7ff790098040 msgr2=0x7ff79008c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:13.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.351+0000 7ff79e886640 0 -- 172.21.15.63:0/4178397733 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7ff798034040 msgr2=0x7ff798025430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.557+0000 7ff7a2b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.557+0000 7ff7a2b42800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.557+0000 7ff7a2b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.557+0000 7ff7a2b42800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.557+0000 7ff7a2b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.557+0000 7ff7a2b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.557+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:13.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 zone default found 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 4 Realm: () 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 zonegroup default 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.558+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.559+0000 7ff7a2b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.559+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.559+0000 7ff7a2b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.559+0000 7ff7a2b42800 20 rados->read ofs=0 len=0 2024-09-12T17:48:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.559+0000 7ff7a2b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.559+0000 7ff7a2b42800 20 started sync module instance, tier type = 2024-09-12T17:48:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.559+0000 7ff7a2b42800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:48:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.568+0000 7ff7a2b42800 20 add_watcher() i=0 2024-09-12T17:48:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.568+0000 7ff7a2b42800 20 add_watcher() i=1 2024-09-12T17:48:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.568+0000 7ff7a2b42800 20 add_watcher() i=2 2024-09-12T17:48:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.568+0000 7ff7a2b42800 20 add_watcher() i=3 2024-09-12T17:48:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.568+0000 7ff7a2b42800 20 add_watcher() i=4 2024-09-12T17:48:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.568+0000 7ff7a2b42800 20 add_watcher() i=5 2024-09-12T17:48:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.568+0000 7ff7a2b42800 20 add_watcher() i=6 2024-09-12T17:48:13.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.569+0000 7ff7a2b42800 20 add_watcher() i=7 2024-09-12T17:48:13.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.569+0000 7ff7a2b42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:13.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.570+0000 7ff6557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:13.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.571+0000 7ff7a2b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:13.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.571+0000 7ff7a2b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:13.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.607+0000 7ff5cffff640 20 reqs_thread_entry: start 2024-09-12T17:48:13.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.607+0000 7ff7a2b42800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:13.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.607+0000 7ff7a2b42800 20 Filter name: none 2024-09-12T17:48:13.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.607+0000 7ff5cdffb640 20 reqs_thread_entry: start 2024-09-12T17:48:13.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.607+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:48:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.609+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.609+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.610+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.610+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:48:13.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.612+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.612+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.613+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.614+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:48:13.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.615+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.615+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.616+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.617+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:48:13.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.618+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.618+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.618+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.619+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:48:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.621+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.621+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.621+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.622+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:48:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.624+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.624+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.624+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.625+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:48:13.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.627+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.627+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.628+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.629+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:48:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.630+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.630+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.631+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.632+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:48:13.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.633+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.634+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.634+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.635+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:48:13.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.637+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.637+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.638+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.639+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:48:13.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.640+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.640+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.640+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.641+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:48:13.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.643+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.643+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.644+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.645+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.646+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.646+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.647+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.647+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:48:13.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.649+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.650+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.650+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.651+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.652+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.652+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.653+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.654+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.655+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.656+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.656+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.657+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:48:13.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.658+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.659+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.659+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.660+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:48:13.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.661+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.661+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.662+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.663+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:48:13.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.664+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.664+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.664+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.665+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:48:13.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.667+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.667+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.668+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.669+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:48:13.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.670+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.671+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.671+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.672+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:48:13.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.673+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.673+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.674+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.675+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:48:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.676+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.677+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.677+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.678+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:48:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.679+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.679+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.680+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.681+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:48:13.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.682+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.682+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.682+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.683+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:48:13.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.685+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.685+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.685+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.686+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:48:13.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.688+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.688+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.688+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.689+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:48:13.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.691+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.691+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.691+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.692+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:48:13.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.694+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.694+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.694+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.695+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:48:13.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.696+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.697+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.697+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.698+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:48:13.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.699+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.700+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.700+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.701+0000 7ff7a2b42800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:48:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.702+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.703+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.703+0000 7ff7a2b42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.705+0000 7ff6557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:13.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.707+0000 7ff7a2b42800 20 remove_watcher() i=0 2024-09-12T17:48:13.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.707+0000 7ff7a2b42800 2 removed watcher, disabling cache 2024-09-12T17:48:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.708+0000 7ff7a2b42800 20 remove_watcher() i=1 2024-09-12T17:48:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.709+0000 7ff7a2b42800 20 remove_watcher() i=2 2024-09-12T17:48:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.710+0000 7ff7a2b42800 20 remove_watcher() i=3 2024-09-12T17:48:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.711+0000 7ff7a2b42800 20 remove_watcher() i=4 2024-09-12T17:48:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.712+0000 7ff7a2b42800 20 remove_watcher() i=5 2024-09-12T17:48:13.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.713+0000 7ff7a2b42800 20 remove_watcher() i=6 2024-09-12T17:48:13.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:48:13.714+0000 7ff7a2b42800 20 remove_watcher() i=7 2024-09-12T17:48:13.726 DEBUG:teuthology.orchestra.run.smithi063:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T17:48:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T17:48:17.926 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :clean UP-TO-DATE 2024-09-12T17:48:36.625 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :compileJava 2024-09-12T17:48:36.625 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :processResources 2024-09-12T17:48:36.625 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :classes 2024-09-12T17:48:37.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :compileTestJava 2024-09-12T17:48:37.426 INFO:teuthology.orchestra.run.smithi063.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:48:37.426 INFO:teuthology.orchestra.run.smithi063.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:48:37.426 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:48:37.426 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :testClasses 2024-09-12T17:48:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:43.525 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :test 2024-09-12T17:48:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:43.525 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T17:48:44.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:44.525 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T17:48:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:44.725 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T17:48:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:44.825 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T17:48:45.024 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:45.025 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T17:48:45.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:45.425 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T17:48:45.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:45.625 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:48:45.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:45.625 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:48:45.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:45.725 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T17:48:45.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:45.725 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T17:48:46.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:46.025 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T17:48:46.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:46.325 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T17:48:46.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:46.725 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12 17:48:46,807 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:48:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:51.625 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:48:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:52.025 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T17:48:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:52.025 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T17:48:52.225 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:52.225 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T17:48:52.225 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:52.225 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T17:48:52.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:52.525 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T17:48:52.925 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:52.925 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T17:48:53.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:53.125 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:48:53.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:53.125 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:48:53.224 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:53.225 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T17:48:55.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:55.525 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T17:48:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:55.725 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:48:56.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:56.425 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:48:56.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:56.625 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T17:48:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:48:57.125 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:49:04.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:04.125 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:49:04.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:04.425 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T17:49:05.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:05.325 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T17:49:05.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:05.525 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T17:49:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T17:49:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:06.225 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T17:49:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:06.525 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T17:49:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:06.725 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T17:49:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:06.825 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T17:49:07.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.025 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T17:49:07.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.025 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T17:49:07.225 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.225 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T17:49:07.225 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.225 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T17:49:07.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.425 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T17:49:07.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.425 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T17:49:07.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.625 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T17:49:07.724 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.725 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T17:49:07.924 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.925 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T17:49:07.925 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:07.925 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T17:49:08.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:08.325 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T17:49:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:08.825 INFO:teuthology.orchestra.run.smithi063.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout:---------------------------------------------------------------------- 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout:---------------------------------------------------------------------- 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:09.126 INFO:teuthology.orchestra.run.smithi063.stdout:BUILD SUCCESSFUL in 55s 2024-09-12T17:49:09.127 INFO:teuthology.orchestra.run.smithi063.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T17:49:09.469 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:09.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.561+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:09.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 20 realm 2024-09-12T17:49:09.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:09.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:09.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:09.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.563+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.564+0000 7fd90e726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:09.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.564+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.564+0000 7fd90e726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:09.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.564+0000 7fd90e726800 20 searching for the correct realm 2024-09-12T17:49:09.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.569+0000 7fd90a3d9640 0 -- 172.21.15.63:0/177581429 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fd8fc01f070 msgr2=0x7fd8fc063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:09.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.572+0000 7fd90a3d9640 0 -- 172.21.15.63:0/177581429 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fd904027060 msgr2=0x7fd904062b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:09.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.575+0000 7fd90e726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.575+0000 7fd90e726800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.575+0000 7fd90e726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.575+0000 7fd90e726800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.575+0000 7fd90e726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.575+0000 7fd90e726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.575+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.576+0000 7fd90e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:09.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.576+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.576+0000 7fd90e726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:09.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.576+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 zone default found 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 4 Realm: () 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 zonegroup default 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 rados->read ofs=0 len=0 2024-09-12T17:49:09.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:09.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 started sync module instance, tier type = 2024-09-12T17:49:09.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.577+0000 7fd90e726800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.586+0000 7fd90e726800 20 add_watcher() i=0 2024-09-12T17:49:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.586+0000 7fd90e726800 20 add_watcher() i=1 2024-09-12T17:49:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.586+0000 7fd90e726800 20 add_watcher() i=2 2024-09-12T17:49:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.586+0000 7fd90e726800 20 add_watcher() i=3 2024-09-12T17:49:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.586+0000 7fd90e726800 20 add_watcher() i=4 2024-09-12T17:49:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.586+0000 7fd90e726800 20 add_watcher() i=5 2024-09-12T17:49:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.586+0000 7fd90e726800 20 add_watcher() i=6 2024-09-12T17:49:09.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.587+0000 7fd90e726800 20 add_watcher() i=7 2024-09-12T17:49:09.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.587+0000 7fd90e726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:09.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.588+0000 7fd7c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:09.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.589+0000 7fd90e726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:09.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.589+0000 7fd90e726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:09.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.624+0000 7fd73b7fe640 20 reqs_thread_entry: start 2024-09-12T17:49:09.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.624+0000 7fd90e726800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:09.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.624+0000 7fd90e726800 20 Filter name: none 2024-09-12T17:49:09.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.625+0000 7fd7397fa640 20 reqs_thread_entry: start 2024-09-12T17:49:09.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.625+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:09.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.626+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.626+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17737434241154978310', time=2024-09-12T19:48:56.482290+0000, chain.objs.size()=1 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_.vdw41lW5bPyu747_SfK2uzJlh2M6r6n_0 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18018053298694272125', time=2024-09-12T19:49:04.075062+0000, chain.objs.size()=16 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.1 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.1_1 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.1_2 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.2 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.2_1 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.2_2 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.3 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.3_1 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.3_2 2024-09-12T17:49:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.4 2024-09-12T17:49:09.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.627+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.4_1 2024-09-12T17:49:09.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.630+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.4_2 2024-09-12T17:49:09.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.630+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.5 2024-09-12T17:49:09.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.632+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.5_1 2024-09-12T17:49:09.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.633+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.5_2 2024-09-12T17:49:09.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.634+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~ThrEeYQ-IB_5KR2iKetodgRaJmrDsWm.6 2024-09-12T17:49:09.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.634+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8397148038318194023', time=2024-09-12T19:49:04.805133+0000, chain.objs.size()=1 2024-09-12T17:49:09.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.634+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__shadow_.9rIPNtjeSeKo107_jip0LKbUIkAIhGw_0 2024-09-12T17:49:09.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.634+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3013503751474338213', time=2024-09-12T19:49:06.814965+0000, chain.objs.size()=1 2024-09-12T17:49:09.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.634+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.60__shadow_.V8ObUxOXHnV7ZBH7OFmbMgy8jMTAtH7_0 2024-09-12T17:49:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.639+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.641+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:09.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.643+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.643+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.272490087566557840', time=2024-09-12T19:49:08.898819+0000, chain.objs.size()=21 2024-09-12T17:49:09.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.1 2024-09-12T17:49:09.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.1_1 2024-09-12T17:49:09.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.2 2024-09-12T17:49:09.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.2_1 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.3 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.3_1 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.4 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.4_1 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.5 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.5_1 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.6 2024-09-12T17:49:09.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.644+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.6_1 2024-09-12T17:49:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.7 2024-09-12T17:49:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.7_1 2024-09-12T17:49:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.8 2024-09-12T17:49:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.8_1 2024-09-12T17:49:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.9 2024-09-12T17:49:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.9_1 2024-09-12T17:49:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.10 2024-09-12T17:49:09.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__shadow_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.10_1 2024-09-12T17:49:09.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.649+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67__multipart_key1.2~uvmL1k-BNXbiLpaJbPl5KeF3zVu3kPT.11 2024-09-12T17:49:09.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.655+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.658+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:09.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.659+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.659+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.660+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.661+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:09.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.662+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:09.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14619736437037773702', time=2024-09-12T19:48:45.488961+0000, chain.objs.size()=9 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__multipart_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.1 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__shadow_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.1_1 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__multipart_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.2 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__shadow_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.2_1 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__multipart_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.3 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__shadow_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.3_1 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__multipart_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.4 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__shadow_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.4_1 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.43__multipart_key1.2~-UikuJU36uEv-vrs1PTG_z9K8nI86Ee.5 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='2~TR89CEqEsPq5-RvsnlYZAfy1GtGLXYh', time=2024-09-12T19:48:57.014798+0000, chain.objs.size()=5 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.55__multipart_key1.2~TR89CEqEsPq5-RvsnlYZAfy1GtGLXYh.7 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.55__shadow_key1.2~TR89CEqEsPq5-RvsnlYZAfy1GtGLXYh.7_1 2024-09-12T17:49:09.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.663+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.55__multipart_key1.2~TR89CEqEsPq5-RvsnlYZAfy1GtGLXYh.10 2024-09-12T17:49:09.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.667+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.55__shadow_key1.2~TR89CEqEsPq5-RvsnlYZAfy1GtGLXYh.10_1 2024-09-12T17:49:09.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.667+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.55__multipart_key1.2~TR89CEqEsPq5-RvsnlYZAfy1GtGLXYh.13 2024-09-12T17:49:09.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.671+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.673+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:09.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.675+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.675+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4013618854697788709', time=2024-09-12T19:48:50.703088+0000, chain.objs.size()=9 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.1 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.1_1 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.2 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.2_1 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.3 2024-09-12T17:49:09.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.3_1 2024-09-12T17:49:09.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.4 2024-09-12T17:49:09.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.4_1 2024-09-12T17:49:09.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~7N7blQp5V9XFxEXYbZOyKEJWPMgyGni.5 2024-09-12T17:49:09.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13859653654999645361', time=2024-09-12T19:48:51.682300+0000, chain.objs.size()=6 2024-09-12T17:49:09.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.47__shadow_.-aKcopfWKl5M2D1msDZ4CUF_L8KMRtW_0 2024-09-12T17:49:09.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.676+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.47__shadow_.-aKcopfWKl5M2D1msDZ4CUF_L8KMRtW_1 2024-09-12T17:49:09.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.677+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.47__shadow_.-aKcopfWKl5M2D1msDZ4CUF_L8KMRtW_2 2024-09-12T17:49:09.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.679+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.47__shadow_.-aKcopfWKl5M2D1msDZ4CUF_L8KMRtW_3 2024-09-12T17:49:09.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.679+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.47__shadow_.-aKcopfWKl5M2D1msDZ4CUF_L8KMRtW_4 2024-09-12T17:49:09.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.681+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.47__shadow_.-aKcopfWKl5M2D1msDZ4CUF_L8KMRtW_5 2024-09-12T17:49:09.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.685+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.687+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.345173030682946328', time=2024-09-12T19:48:46.399607+0000, chain.objs.size()=9 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.1 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.1_1 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.2 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.2_1 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.3 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.3_1 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.4 2024-09-12T17:49:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.4_1 2024-09-12T17:49:09.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.5 2024-09-12T17:49:09.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15297012993183456981', time=2024-09-12T19:48:51.541401+0000, chain.objs.size()=7 2024-09-12T17:49:09.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.689+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~cUwNKTgergxepR_87kuF1YFgBTHEeqm.1 2024-09-12T17:49:09.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.690+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~cUwNKTgergxepR_87kuF1YFgBTHEeqm.1_1 2024-09-12T17:49:09.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.690+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~cUwNKTgergxepR_87kuF1YFgBTHEeqm.1_2 2024-09-12T17:49:09.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.692+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~cUwNKTgergxepR_87kuF1YFgBTHEeqm.2 2024-09-12T17:49:09.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.695+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~cUwNKTgergxepR_87kuF1YFgBTHEeqm.2_1 2024-09-12T17:49:09.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.695+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~cUwNKTgergxepR_87kuF1YFgBTHEeqm.2_2 2024-09-12T17:49:09.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.695+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~cUwNKTgergxepR_87kuF1YFgBTHEeqm.3 2024-09-12T17:49:09.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.698+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.700+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:09.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.702+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.702+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.702+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:09.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.702+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2699112107516389521', time=2024-09-12T19:49:07.264222+0000, chain.objs.size()=1 2024-09-12T17:49:09.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.702+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.62__shadow_.Y96dunM4CxsFihALLU4nnKI-RfBD8bm_0 2024-09-12T17:49:09.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.702+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1453530351605963842', time=2024-09-12T19:49:07.941330+0000, chain.objs.size()=1 2024-09-12T17:49:09.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.702+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.65__shadow_.F-3N1XpmNLH5I0oUabubkVytI2PzRjw_0 2024-09-12T17:49:09.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.704+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.706+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:09.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.708+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.708+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.708+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.710+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:09.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.711+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.711+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.712+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.713+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:09.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.714+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.714+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.715+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.716+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:09.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.717+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17326535548196152727', time=2024-09-12T19:48:55.523000+0000, chain.objs.size()=9 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__multipart_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.1 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__shadow_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.1_1 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__multipart_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.2 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__shadow_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.2_1 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__multipart_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.3 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__shadow_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.3_1 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__multipart_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.4 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__shadow_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.4_1 2024-09-12T17:49:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.718+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.53__multipart_key1.2~xJZJiaTM852_cKOuiPlMRMxB6t8RIyV.5 2024-09-12T17:49:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.722+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.726+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.727+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.728+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.728+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.729+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.730+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.731+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.731+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.731+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11228246402011749314', time=2024-09-12T19:48:56.469547+0000, chain.objs.size()=1 2024-09-12T17:49:09.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.731+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_.HmQNMfEOs9aIArhHmDvm6yYSyPqVE7Z_0 2024-09-12T17:49:09.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.733+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.735+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.737+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.738+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.738+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.739+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:09.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.740+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:09.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4328232056277473411', time=2024-09-12T19:48:51.123980+0000, chain.objs.size()=7 2024-09-12T17:49:09.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~VpmPYwftjfZGJMkKVlJSJAlaxORsvhZ.1 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~VpmPYwftjfZGJMkKVlJSJAlaxORsvhZ.1_1 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~VpmPYwftjfZGJMkKVlJSJAlaxORsvhZ.1_2 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~VpmPYwftjfZGJMkKVlJSJAlaxORsvhZ.2 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~VpmPYwftjfZGJMkKVlJSJAlaxORsvhZ.2_1 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~VpmPYwftjfZGJMkKVlJSJAlaxORsvhZ.2_2 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~VpmPYwftjfZGJMkKVlJSJAlaxORsvhZ.3 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4867681771346124813', time=2024-09-12T19:48:56.487802+0000, chain.objs.size()=1 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_.70PVWEMe8Ks4agi16fAF_WA5_90klxp_0 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15736124009485203234', time=2024-09-12T19:49:00.058447+0000, chain.objs.size()=21 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.1 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.1_1 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.2 2024-09-12T17:49:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.741+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.2_1 2024-09-12T17:49:09.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.744+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.3 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.3_1 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.4 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.4_1 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.5 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.5_1 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.6 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.6_1 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.7 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.7_1 2024-09-12T17:49:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.747+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.8 2024-09-12T17:49:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.752+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.8_1 2024-09-12T17:49:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.9 2024-09-12T17:49:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.9_1 2024-09-12T17:49:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.10 2024-09-12T17:49:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.10_1 2024-09-12T17:49:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~9oRRavXLLF7O8NYkRqdzHAZ7fKgVDOx.11 2024-09-12T17:49:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6658188015555402623', time=2024-09-12T19:49:06.014142+0000, chain.objs.size()=9 2024-09-12T17:49:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__multipart_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.1 2024-09-12T17:49:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__shadow_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.1_1 2024-09-12T17:49:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__multipart_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.2 2024-09-12T17:49:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__shadow_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.2_1 2024-09-12T17:49:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.753+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__multipart_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.3 2024-09-12T17:49:09.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.757+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__shadow_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.3_1 2024-09-12T17:49:09.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.757+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__multipart_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.4 2024-09-12T17:49:09.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.760+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__shadow_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.4_1 2024-09-12T17:49:09.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.761+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.58__multipart_key1.2~1Buc2MyuRza_MO4KGrppBSrkDs2of8D.5 2024-09-12T17:49:09.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.763+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.766+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.767+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.767+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12909518098627067924', time=2024-09-12T19:49:05.346066+0000, chain.objs.size()=9 2024-09-12T17:49:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__multipart_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.1 2024-09-12T17:49:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__shadow_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.1_1 2024-09-12T17:49:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__multipart_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.2 2024-09-12T17:49:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__shadow_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.2_1 2024-09-12T17:49:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__multipart_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.3 2024-09-12T17:49:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__shadow_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.3_1 2024-09-12T17:49:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__multipart_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.4 2024-09-12T17:49:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__shadow_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.4_1 2024-09-12T17:49:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.768+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.57__multipart_key1.2~bads3OQtGZsSyncXY8t22WsElygKu5n.5 2024-09-12T17:49:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.772+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.775+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.776+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:49:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9835207841757314243', time=2024-09-12T19:48:46.523068+0000, chain.objs.size()=9 2024-09-12T17:49:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.1 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.1_1 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.2 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.2_1 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.3 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.3_1 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.4 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__shadow_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.4_1 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45__multipart_key1.2~TtJ4lt7j9Q463SpEf1aa2Wrl0N6F7E6.5 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12427489743187091424', time=2024-09-12T19:48:52.918356+0000, chain.objs.size()=9 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__multipart_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.1 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__shadow_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.1_1 2024-09-12T17:49:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.777+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__multipart_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.2 2024-09-12T17:49:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__shadow_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.2_1 2024-09-12T17:49:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__multipart_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.3 2024-09-12T17:49:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__shadow_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.3_1 2024-09-12T17:49:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__multipart_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.4 2024-09-12T17:49:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__shadow_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.4_1 2024-09-12T17:49:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.52__multipart_key1.2~0SWy9do8AuvxCQEd7wG2v3cRg5sb8iJ.5 2024-09-12T17:49:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8567485195112546496', time=2024-09-12T19:48:56.462696+0000, chain.objs.size()=9 2024-09-12T17:49:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.782+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.1 2024-09-12T17:49:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.783+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.1_1 2024-09-12T17:49:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.783+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.2 2024-09-12T17:49:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.783+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.2_1 2024-09-12T17:49:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.783+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.3 2024-09-12T17:49:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.789+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.3_1 2024-09-12T17:49:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.789+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.4 2024-09-12T17:49:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.789+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.4_1 2024-09-12T17:49:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.789+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file.mpg.2~pMZYmKeC8Jt8x3GTq0vTCQGlIHislkf.5 2024-09-12T17:49:09.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.793+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.795+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.796+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.797+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.797+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.798+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:09.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.800+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.800+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.800+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.801+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.802+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.803+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.803+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.804+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.805+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13487715409186619613', time=2024-09-12T19:48:51.805411+0000, chain.objs.size()=7 2024-09-12T17:49:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~mY2KxMqSv9LjrCVcN0PN5jjm7aUSiVT.1 2024-09-12T17:49:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~mY2KxMqSv9LjrCVcN0PN5jjm7aUSiVT.1_1 2024-09-12T17:49:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~mY2KxMqSv9LjrCVcN0PN5jjm7aUSiVT.1_2 2024-09-12T17:49:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~mY2KxMqSv9LjrCVcN0PN5jjm7aUSiVT.2 2024-09-12T17:49:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~mY2KxMqSv9LjrCVcN0PN5jjm7aUSiVT.2_1 2024-09-12T17:49:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~mY2KxMqSv9LjrCVcN0PN5jjm7aUSiVT.2_2 2024-09-12T17:49:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.806+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~mY2KxMqSv9LjrCVcN0PN5jjm7aUSiVT.3 2024-09-12T17:49:09.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.810+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.813+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:09.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.814+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.815+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.815+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.816+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:09.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.817+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.817+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G', time=2024-09-12T19:49:06.641680+0000, chain.objs.size()=92 2024-09-12T17:49:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.1 2024-09-12T17:49:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.2 2024-09-12T17:49:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.3 2024-09-12T17:49:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.4 2024-09-12T17:49:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.5 2024-09-12T17:49:09.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.6 2024-09-12T17:49:09.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.7 2024-09-12T17:49:09.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.8 2024-09-12T17:49:09.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.9 2024-09-12T17:49:09.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.10 2024-09-12T17:49:09.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.11 2024-09-12T17:49:09.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.818+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.12 2024-09-12T17:49:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.13 2024-09-12T17:49:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.14 2024-09-12T17:49:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.15 2024-09-12T17:49:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.16 2024-09-12T17:49:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.17 2024-09-12T17:49:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.18 2024-09-12T17:49:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.19 2024-09-12T17:49:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.20 2024-09-12T17:49:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.21 2024-09-12T17:49:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.22 2024-09-12T17:49:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.824+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.23 2024-09-12T17:49:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.829+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.24 2024-09-12T17:49:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.829+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.25 2024-09-12T17:49:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.829+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.26 2024-09-12T17:49:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.829+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.27 2024-09-12T17:49:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.829+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.28 2024-09-12T17:49:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.829+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.29 2024-09-12T17:49:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.830+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.30 2024-09-12T17:49:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.830+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.31 2024-09-12T17:49:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.832+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.32 2024-09-12T17:49:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.832+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.33 2024-09-12T17:49:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.832+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.34 2024-09-12T17:49:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.833+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.35 2024-09-12T17:49:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.833+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.36 2024-09-12T17:49:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.833+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.37 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.836+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.38 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.837+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.39 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.837+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.40 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.837+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.41 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.837+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.42 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.837+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.43 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.837+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.44 2024-09-12T17:49:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.837+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.45 2024-09-12T17:49:09.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.838+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.46 2024-09-12T17:49:09.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.838+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.47 2024-09-12T17:49:09.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.838+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.48 2024-09-12T17:49:09.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.840+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.49 2024-09-12T17:49:09.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.840+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.50 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.51 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.52 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.53 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.54 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.55 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.56 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.57 2024-09-12T17:49:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.58 2024-09-12T17:49:09.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.59 2024-09-12T17:49:09.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.60 2024-09-12T17:49:09.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.843+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.61 2024-09-12T17:49:09.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.847+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.62 2024-09-12T17:49:09.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.848+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.63 2024-09-12T17:49:09.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.848+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.64 2024-09-12T17:49:09.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.848+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.65 2024-09-12T17:49:09.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.848+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.66 2024-09-12T17:49:09.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.849+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.67 2024-09-12T17:49:09.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.849+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.68 2024-09-12T17:49:09.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.849+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.69 2024-09-12T17:49:09.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.849+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.70 2024-09-12T17:49:09.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.849+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.71 2024-09-12T17:49:09.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.849+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.72 2024-09-12T17:49:09.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.851+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.73 2024-09-12T17:49:09.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.853+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.74 2024-09-12T17:49:09.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.854+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.75 2024-09-12T17:49:09.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.854+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.76 2024-09-12T17:49:09.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.854+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.77 2024-09-12T17:49:09.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.854+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.78 2024-09-12T17:49:09.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.855+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.79 2024-09-12T17:49:09.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.855+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.80 2024-09-12T17:49:09.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.855+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.81 2024-09-12T17:49:09.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.855+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.82 2024-09-12T17:49:09.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.855+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.83 2024-09-12T17:49:09.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.856+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.84 2024-09-12T17:49:09.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.856+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.85 2024-09-12T17:49:09.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.857+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.86 2024-09-12T17:49:09.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.859+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.87 2024-09-12T17:49:09.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.859+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.88 2024-09-12T17:49:09.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.859+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.89 2024-09-12T17:49:09.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.859+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.90 2024-09-12T17:49:09.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.859+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.91 2024-09-12T17:49:09.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.859+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.59__multipart_key1.2~zzLmGDvuEXbHDuHwgMirxbKfJKJia-G.92 2024-09-12T17:49:09.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.864+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.866+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:09.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.868+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.868+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16620021413336228006', time=2024-09-12T19:49:04.214066+0000, chain.objs.size()=16 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.1 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.1_1 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.1_2 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.2 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.2_1 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.2_2 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.3 2024-09-12T17:49:09.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.3_1 2024-09-12T17:49:09.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.3_2 2024-09-12T17:49:09.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.4 2024-09-12T17:49:09.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.4_1 2024-09-12T17:49:09.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.869+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.4_2 2024-09-12T17:49:09.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.872+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.5 2024-09-12T17:49:09.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.872+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.5_1 2024-09-12T17:49:09.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.873+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.5_2 2024-09-12T17:49:09.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.875+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~HJSMZCPgWa6d-hcildGCndBJefG-Xr-.6 2024-09-12T17:49:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.881+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.888+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.890+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.890+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.890+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.891+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:09.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.892+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:49:09.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6560997056380209310', time=2024-09-12T19:48:49.729206+0000, chain.objs.size()=9 2024-09-12T17:49:09.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.1 2024-09-12T17:49:09.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.1_1 2024-09-12T17:49:09.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.2 2024-09-12T17:49:09.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.2_1 2024-09-12T17:49:09.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.3 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.3_1 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.4 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.4_1 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~Whg6rJw5xC7_7T85HJ7GYC6miJEwrwP.5 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.893+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15860352519060439967', time=2024-09-12T19:49:00.818571+0000, chain.objs.size()=21 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.894+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.1 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.894+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.1_1 2024-09-12T17:49:09.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.894+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.2 2024-09-12T17:49:09.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.897+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.2_1 2024-09-12T17:49:09.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.897+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.3 2024-09-12T17:49:09.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.3_1 2024-09-12T17:49:09.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.4 2024-09-12T17:49:09.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.4_1 2024-09-12T17:49:09.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.5 2024-09-12T17:49:09.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.5_1 2024-09-12T17:49:09.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.6 2024-09-12T17:49:09.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.6_1 2024-09-12T17:49:09.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.7 2024-09-12T17:49:09.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.899+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.7_1 2024-09-12T17:49:09.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.902+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.8 2024-09-12T17:49:09.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.903+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.8_1 2024-09-12T17:49:09.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.904+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.9 2024-09-12T17:49:09.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.904+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.9_1 2024-09-12T17:49:09.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.906+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.10 2024-09-12T17:49:09.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.906+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.10_1 2024-09-12T17:49:09.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.906+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~DiyPh_zMRipNE-a0YDt1prVoIUs9LmB.11 2024-09-12T17:49:09.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.906+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2586884070993306988', time=2024-09-12T19:49:03.446567+0000, chain.objs.size()=16 2024-09-12T17:49:09.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.906+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.1 2024-09-12T17:49:09.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.908+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.1_1 2024-09-12T17:49:09.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.908+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.1_2 2024-09-12T17:49:09.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.908+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.2 2024-09-12T17:49:09.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.908+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.2_1 2024-09-12T17:49:09.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.908+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.2_2 2024-09-12T17:49:09.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.909+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.3 2024-09-12T17:49:09.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.910+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.3_1 2024-09-12T17:49:09.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.910+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.3_2 2024-09-12T17:49:09.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.910+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.4 2024-09-12T17:49:09.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.912+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.4_1 2024-09-12T17:49:09.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.912+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.4_2 2024-09-12T17:49:09.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.913+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.5 2024-09-12T17:49:09.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.913+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.5_1 2024-09-12T17:49:09.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.913+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.5_2 2024-09-12T17:49:09.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.913+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~S_ml4pvU-XT3FaOhZE9eze3AOYjd-Lg.6 2024-09-12T17:49:09.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.918+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.921+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:09.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.922+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:09.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i', time=2024-09-12T19:48:44.477878+0000, chain.objs.size()=9 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__multipart_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.1 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__shadow_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.1_1 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__multipart_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.2 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__shadow_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.2_1 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__multipart_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.3 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__shadow_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.3_1 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__multipart_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.4 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__shadow_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.4_1 2024-09-12T17:49:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.41__multipart_key1.2~5j3NltsJXiSXXkEPNo9k7tzQTsMn26i.5 2024-09-12T17:49:09.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8132440846731387108', time=2024-09-12T19:49:07.486665+0000, chain.objs.size()=1 2024-09-12T17:49:09.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.923+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.63__shadow_.9DeL0HVj6btJmya798IxIBvpLsj2xao_0 2024-09-12T17:49:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.928+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.931+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.932+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13175050009845410824', time=2024-09-12T19:48:56.476391+0000, chain.objs.size()=9 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.1 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.1_1 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.2 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.2_1 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.3 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.3_1 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.4 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__shadow_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.4_1 2024-09-12T17:49:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.933+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.54__multipart_file2.mpg.2~VTGWb-QNzCuS1mQ_QNWLK1GPUce0yz3.5 2024-09-12T17:49:09.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.937+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.940+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:09.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.941+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.942+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.942+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.943+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:09.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.944+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15187216912876012823', time=2024-09-12T19:49:02.809093+0000, chain.objs.size()=19 2024-09-12T17:49:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.1 2024-09-12T17:49:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.1_1 2024-09-12T17:49:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.2 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.2_1 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.3 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.3_1 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.4 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.4_1 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.5 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.5_1 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.6 2024-09-12T17:49:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.945+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.6_1 2024-09-12T17:49:09.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.950+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.7 2024-09-12T17:49:09.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.950+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.7_1 2024-09-12T17:49:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.952+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.8 2024-09-12T17:49:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.952+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.8_1 2024-09-12T17:49:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.952+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.9 2024-09-12T17:49:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.952+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__shadow_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.9_1 2024-09-12T17:49:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.952+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.56__multipart_key1.2~99fzUpNP4bJn3YkL-5hNmkDaLbgajt8.10 2024-09-12T17:49:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.952+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7714477377649343312', time=2024-09-12T19:49:07.710333+0000, chain.objs.size()=1 2024-09-12T17:49:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.952+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.64__shadow_.EujL01xPYUtXbKcZDwiVMoqQ78cviJC_0 2024-09-12T17:49:09.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.958+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.960+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:09.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.961+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6569653360121716218', time=2024-09-12T19:48:48.617195+0000, chain.objs.size()=9 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.1 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.1_1 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.2 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.2_1 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.3 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.3_1 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.4 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__shadow_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.4_1 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.48__multipart_key1.2~fj8DarZE-EFWAZelURP7ACQ5wUGoYtU.5 2024-09-12T17:49:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11875413320311669234', time=2024-09-12T19:49:07.039717+0000, chain.objs.size()=1 2024-09-12T17:49:09.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.962+0000 7fd90e726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.61__shadow_.dLsLBQp6eS0-852ck5LcfX3XwMQbfCl_0 2024-09-12T17:49:09.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.968+0000 7fd90e726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:09.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.970+0000 7fd90e726800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:09.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.972+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.972+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:09.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.972+0000 7fd90e726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:09.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.974+0000 7fd7c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:09.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.976+0000 7fd90e726800 20 remove_watcher() i=0 2024-09-12T17:49:09.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.976+0000 7fd90e726800 2 removed watcher, disabling cache 2024-09-12T17:49:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.977+0000 7fd90e726800 20 remove_watcher() i=1 2024-09-12T17:49:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.978+0000 7fd90e726800 20 remove_watcher() i=2 2024-09-12T17:49:09.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.979+0000 7fd90e726800 20 remove_watcher() i=3 2024-09-12T17:49:09.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.980+0000 7fd90e726800 20 remove_watcher() i=4 2024-09-12T17:49:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.981+0000 7fd90e726800 20 remove_watcher() i=5 2024-09-12T17:49:09.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.982+0000 7fd90e726800 20 remove_watcher() i=6 2024-09-12T17:49:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:09.983+0000 7fd90e726800 20 remove_watcher() i=7 2024-09-12T17:49:09.996 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.087+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 20 realm 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.089+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.090+0000 7f8965c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.090+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.090+0000 7f8965c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.090+0000 7f8965c20800 20 searching for the correct realm 2024-09-12T17:49:10.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.093+0000 7f8962f10640 0 -- 172.21.15.63:0/2099867657 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f8958087020 msgr2=0x7f89580b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:10.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.298+0000 7f8963f12640 0 -- 172.21.15.63:0/2099867657 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5636f16adc60 msgr2=0x5636f16b00c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.302+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:10.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:10.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 zone default found 2024-09-12T17:49:10.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 4 Realm: () 2024-09-12T17:49:10.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 zonegroup default 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.303+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.304+0000 7f8965c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.304+0000 7f8965c20800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.304+0000 7f8965c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.304+0000 7f8965c20800 20 started sync module instance, tier type = 2024-09-12T17:49:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.304+0000 7f8965c20800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:10.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.312+0000 7f8965c20800 20 add_watcher() i=0 2024-09-12T17:49:10.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.312+0000 7f8965c20800 20 add_watcher() i=1 2024-09-12T17:49:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.312+0000 7f8965c20800 20 add_watcher() i=2 2024-09-12T17:49:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.312+0000 7f8965c20800 20 add_watcher() i=3 2024-09-12T17:49:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.312+0000 7f8965c20800 20 add_watcher() i=4 2024-09-12T17:49:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.312+0000 7f8965c20800 20 add_watcher() i=5 2024-09-12T17:49:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.312+0000 7f8965c20800 20 add_watcher() i=6 2024-09-12T17:49:10.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.313+0000 7f8965c20800 20 add_watcher() i=7 2024-09-12T17:49:10.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.313+0000 7f8965c20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:10.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.315+0000 7f8819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:10.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.316+0000 7f8965c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:10.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.316+0000 7f8965c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:10.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.349+0000 7f8818fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:10.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.349+0000 7f8965c20800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:10.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.349+0000 7f8965c20800 20 Filter name: none 2024-09-12T17:49:10.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.350+0000 7f87927fc640 20 reqs_thread_entry: start 2024-09-12T17:49:10.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.350+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:10.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.351+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.351+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.352+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.353+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:10.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.354+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.354+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.355+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.356+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:10.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.357+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.357+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.357+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.358+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:10.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.359+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.360+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.360+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.361+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:10.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.362+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.363+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.363+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.364+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:10.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.365+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.366+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.366+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.367+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:10.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.368+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.368+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.369+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.370+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:10.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.372+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.373+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.373+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.374+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:10.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.375+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.376+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.376+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.377+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:10.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.378+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.379+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.379+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.380+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:10.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.382+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.382+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.382+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.383+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.384+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.385+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.385+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.386+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.387+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.388+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.388+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.389+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.390+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.391+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.391+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.392+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.393+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.394+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.394+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.395+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.397+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.397+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.398+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.399+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.400+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.400+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.401+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.402+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.403+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.403+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.403+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.404+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.406+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.406+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.406+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.407+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:10.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.408+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.409+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.409+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.410+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:10.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.411+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.412+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.412+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.413+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:10.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.414+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.415+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.415+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.416+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:10.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.417+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.418+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.418+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.419+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:10.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.420+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.420+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.421+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.422+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:10.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.423+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.424+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.424+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.425+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:10.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.427+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.427+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.427+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.428+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.429+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.430+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.430+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.431+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.432+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.433+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.433+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.434+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:10.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.435+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.436+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.436+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.437+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:10.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.438+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.438+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.439+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.440+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.441+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.441+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.442+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.442+0000 7f8965c20800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.444+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.444+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.444+0000 7f8965c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.446+0000 7f8819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:10.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.448+0000 7f8965c20800 20 remove_watcher() i=0 2024-09-12T17:49:10.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.448+0000 7f8965c20800 2 removed watcher, disabling cache 2024-09-12T17:49:10.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.449+0000 7f8965c20800 20 remove_watcher() i=1 2024-09-12T17:49:10.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.450+0000 7f8965c20800 20 remove_watcher() i=2 2024-09-12T17:49:10.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.451+0000 7f8965c20800 20 remove_watcher() i=3 2024-09-12T17:49:10.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.452+0000 7f8965c20800 20 remove_watcher() i=4 2024-09-12T17:49:10.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.453+0000 7f8965c20800 20 remove_watcher() i=5 2024-09-12T17:49:10.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.454+0000 7f8965c20800 20 remove_watcher() i=6 2024-09-12T17:49:10.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.455+0000 7f8965c20800 20 remove_watcher() i=7 2024-09-12T17:49:10.468 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:10.521 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:10.521 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.559+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.560+0000 7f92bc724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.560+0000 7f92bc724800 20 realm 2024-09-12T17:49:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.560+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.560+0000 7f92bc724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.560+0000 7f92bc724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.560+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.561+0000 7f92bc724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.561+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.561+0000 7f92bc724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:10.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.561+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.562+0000 7f92bc724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:10.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.562+0000 7f92bc724800 20 searching for the correct realm 2024-09-12T17:49:10.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.565+0000 7f92b7c67640 0 -- 172.21.15.63:0/4096236254 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f92ac09e1e0 msgr2=0x7f92ac06e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:10.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.771+0000 7f92b8c69640 0 -- 172.21.15.63:0/4096236254 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x564cda2180a0 msgr2=0x564cda21a510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.775+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:10.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 zone default found 2024-09-12T17:49:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 4 Realm: () 2024-09-12T17:49:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 zonegroup default 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.776+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.777+0000 7f92bc724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.777+0000 7f92bc724800 20 rados->read ofs=0 len=0 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.777+0000 7f92bc724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.777+0000 7f92bc724800 20 started sync module instance, tier type = 2024-09-12T17:49:10.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.777+0000 7f92bc724800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.785+0000 7f92bc724800 20 add_watcher() i=0 2024-09-12T17:49:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.785+0000 7f92bc724800 20 add_watcher() i=1 2024-09-12T17:49:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.785+0000 7f92bc724800 20 add_watcher() i=2 2024-09-12T17:49:10.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.785+0000 7f92bc724800 20 add_watcher() i=3 2024-09-12T17:49:10.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.785+0000 7f92bc724800 20 add_watcher() i=4 2024-09-12T17:49:10.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.785+0000 7f92bc724800 20 add_watcher() i=5 2024-09-12T17:49:10.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.785+0000 7f92bc724800 20 add_watcher() i=6 2024-09-12T17:49:10.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.786+0000 7f92bc724800 20 add_watcher() i=7 2024-09-12T17:49:10.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.786+0000 7f92bc724800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:10.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.788+0000 7f916efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:10.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.789+0000 7f92bc724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:10.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.789+0000 7f92bc724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:10.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.828+0000 7f916dfdb640 20 reqs_thread_entry: start 2024-09-12T17:49:10.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.828+0000 7f92bc724800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:10.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.828+0000 7f92bc724800 20 Filter name: none 2024-09-12T17:49:10.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.828+0000 7f90df7fe640 20 reqs_thread_entry: start 2024-09-12T17:49:10.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.828+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:10.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.830+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.830+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.830+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.831+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:10.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.832+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.833+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.833+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.834+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.835+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.836+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.836+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.837+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:10.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.838+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.839+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.839+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.840+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:10.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.841+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.842+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.842+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.843+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:10.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.844+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.844+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.845+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.846+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:10.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.847+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.847+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.848+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.849+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:10.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.850+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.850+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.851+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.852+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.853+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.853+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.854+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.855+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.856+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.856+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.856+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.857+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.859+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.859+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.859+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.860+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.862+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.862+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.863+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.864+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:10.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.865+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.866+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.866+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.867+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.868+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.869+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.869+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.870+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.871+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.871+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.872+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.872+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.874+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.874+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.875+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.876+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.878+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.878+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.878+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.879+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:10.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.880+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.881+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.881+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.882+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:10.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.883+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.884+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.884+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.885+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:10.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.886+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.887+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.887+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.888+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:10.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.890+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.890+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.890+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.892+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:10.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.894+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.894+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.894+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.895+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:10.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.897+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.897+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.898+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.899+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:10.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.900+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.901+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.901+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.902+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:10.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.903+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.904+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.904+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.905+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:10.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.906+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.907+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.907+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.908+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:10.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.910+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.910+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.911+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.912+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.913+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.914+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.914+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.915+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:10.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.916+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.916+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.917+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.918+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:10.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.919+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.920+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.920+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.921+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:10.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.923+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.923+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.923+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.924+0000 7f92bc724800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:10.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.925+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.926+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:10.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.926+0000 7f92bc724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:10.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.928+0000 7f916efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:10.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.930+0000 7f92bc724800 20 remove_watcher() i=0 2024-09-12T17:49:10.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.930+0000 7f92bc724800 2 removed watcher, disabling cache 2024-09-12T17:49:10.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.931+0000 7f92bc724800 20 remove_watcher() i=1 2024-09-12T17:49:10.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.932+0000 7f92bc724800 20 remove_watcher() i=2 2024-09-12T17:49:10.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.933+0000 7f92bc724800 20 remove_watcher() i=3 2024-09-12T17:49:10.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.934+0000 7f92bc724800 20 remove_watcher() i=4 2024-09-12T17:49:10.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.935+0000 7f92bc724800 20 remove_watcher() i=5 2024-09-12T17:49:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.936+0000 7f92bc724800 20 remove_watcher() i=6 2024-09-12T17:49:10.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:10.937+0000 7f92bc724800 20 remove_watcher() i=7 2024-09-12T17:49:10.949 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:11.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.042+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.044+0000 7fd86f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:11.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.044+0000 7fd86f335800 20 realm 2024-09-12T17:49:11.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.044+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.044+0000 7fd86f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:11.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.044+0000 7fd86f335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:11.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.044+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.045+0000 7fd86f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:11.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.045+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.045+0000 7fd86f335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.045+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.045+0000 7fd86f335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.045+0000 7fd86f335800 20 searching for the correct realm 2024-09-12T17:49:11.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.049+0000 7fd86a8e3640 0 -- 172.21.15.63:0/2920851273 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fd860025210 msgr2=0x7fd860041910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:11.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.253+0000 7fd86b8e5640 0 -- 172.21.15.63:0/2920851273 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56140a1eb0d0 msgr2=0x56140a1ed550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.257+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:11.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 zone default found 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 4 Realm: () 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 zonegroup default 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.258+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.259+0000 7fd86f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.259+0000 7fd86f335800 20 rados->read ofs=0 len=0 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.260+0000 7fd86f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.260+0000 7fd86f335800 20 started sync module instance, tier type = 2024-09-12T17:49:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.260+0000 7fd86f335800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.268+0000 7fd86f335800 20 add_watcher() i=0 2024-09-12T17:49:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.268+0000 7fd86f335800 20 add_watcher() i=1 2024-09-12T17:49:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.268+0000 7fd86f335800 20 add_watcher() i=2 2024-09-12T17:49:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.268+0000 7fd86f335800 20 add_watcher() i=3 2024-09-12T17:49:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.268+0000 7fd86f335800 20 add_watcher() i=4 2024-09-12T17:49:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.268+0000 7fd86f335800 20 add_watcher() i=5 2024-09-12T17:49:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.268+0000 7fd86f335800 20 add_watcher() i=6 2024-09-12T17:49:11.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.269+0000 7fd86f335800 20 add_watcher() i=7 2024-09-12T17:49:11.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.269+0000 7fd86f335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:11.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.271+0000 7fd721fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:11.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.271+0000 7fd86f335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:11.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.271+0000 7fd86f335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:11.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.306+0000 7fd720fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:11.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.306+0000 7fd86f335800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:11.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.306+0000 7fd86f335800 20 Filter name: none 2024-09-12T17:49:11.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.306+0000 7fd69a7fc640 20 reqs_thread_entry: start 2024-09-12T17:49:11.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.306+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:11.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.307+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.308+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.308+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.309+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:11.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.311+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.311+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.312+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.312+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:11.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.314+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.315+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.315+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.316+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.317+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.318+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.318+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.319+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.320+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.321+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.321+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.322+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.323+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.324+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.324+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.325+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:11.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.326+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.327+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.327+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.328+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.330+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.330+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.330+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.331+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.332+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.333+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.333+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.334+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.335+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.336+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.336+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.337+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:11.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.339+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.339+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.339+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.340+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:11.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.342+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.342+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.343+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.344+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:11.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.345+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.345+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.345+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.346+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:11.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.347+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.348+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.348+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.349+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:11.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.350+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.351+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.351+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.352+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:11.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.354+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.354+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.355+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.356+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:11.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.357+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.357+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.358+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.359+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:11.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.360+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.360+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.360+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.361+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:11.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.363+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.363+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.363+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.364+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:11.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.365+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.366+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.366+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.367+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:11.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.368+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.369+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.369+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.370+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:11.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.371+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.372+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.372+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.373+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.375+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.375+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.375+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.376+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.378+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.378+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.378+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.379+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.381+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.381+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.381+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.382+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:11.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.383+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.384+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.384+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.385+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:11.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.386+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.387+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.387+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.388+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.389+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.390+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.390+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.391+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:11.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.392+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.392+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.393+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.394+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:11.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.395+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.396+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.396+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.397+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.398+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.398+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.399+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.400+0000 7fd86f335800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:11.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.401+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.401+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:11.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.402+0000 7fd86f335800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.404+0000 7fd721fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.406+0000 7fd86f335800 20 remove_watcher() i=0 2024-09-12T17:49:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.406+0000 7fd86f335800 2 removed watcher, disabling cache 2024-09-12T17:49:11.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.407+0000 7fd86f335800 20 remove_watcher() i=1 2024-09-12T17:49:11.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.408+0000 7fd86f335800 20 remove_watcher() i=2 2024-09-12T17:49:11.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.409+0000 7fd86f335800 20 remove_watcher() i=3 2024-09-12T17:49:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.410+0000 7fd86f335800 20 remove_watcher() i=4 2024-09-12T17:49:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.411+0000 7fd86f335800 20 remove_watcher() i=5 2024-09-12T17:49:11.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.412+0000 7fd86f335800 20 remove_watcher() i=6 2024-09-12T17:49:11.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:11.413+0000 7fd86f335800 20 remove_watcher() i=7 2024-09-12T17:49:11.425 DEBUG:teuthology.orchestra.run.smithi063:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T17:49:11.928 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :clean 2024-09-12T17:49:12.824 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :compileJava 2024-09-12T17:49:12.824 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :processResources 2024-09-12T17:49:12.824 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :classes 2024-09-12T17:49:13.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:13.324 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :compileTestJava 2024-09-12T17:49:13.324 INFO:teuthology.orchestra.run.smithi063.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:49:13.324 INFO:teuthology.orchestra.run.smithi063.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:49:13.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:13.325 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:49:13.326 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :testClasses 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :test 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12 17:49:14,612 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T17:49:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.424 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T17:49:15.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.524 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T17:49:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.624 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T17:49:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.624 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T17:49:15.823 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.823 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T17:49:15.923 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:15.923 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T17:49:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.024 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T17:49:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.024 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T17:49:16.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.424 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T17:49:16.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.424 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T17:49:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.624 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T17:49:16.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.724 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T17:49:16.785 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.785 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------- 2024-09-12T17:49:16.785 INFO:teuthology.orchestra.run.smithi063.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T17:49:16.785 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------- 2024-09-12T17:49:16.785 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.785 INFO:teuthology.orchestra.run.smithi063.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:49:16.786 INFO:teuthology.orchestra.run.smithi063.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:49:16.786 INFO:teuthology.orchestra.run.smithi063.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:49:16.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:16.786 INFO:teuthology.orchestra.run.smithi063.stdout:BUILD SUCCESSFUL in 5s 2024-09-12T17:49:16.786 INFO:teuthology.orchestra.run.smithi063.stdout:5 actionable tasks: 5 executed 2024-09-12T17:49:16.790 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:16.843 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:16.844 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:16.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.883+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 20 realm 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.885+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.886+0000 7ffb9a50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.886+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.886+0000 7ffb9a50c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:16.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.886+0000 7ffb9a50c800 20 searching for the correct realm 2024-09-12T17:49:16.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:16.890+0000 7ffb977f5640 0 -- 172.21.15.63:0/4237143583 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7ffb8c03dba0 msgr2=0x7ffb8c02f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:17.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.097+0000 7ffb977f5640 0 -- 172.21.15.63:0/4237143583 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55b88a3df290 msgr2=0x55b88a3e1680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:17.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.101+0000 7ffb9a50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.101+0000 7ffb9a50c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.101+0000 7ffb9a50c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.101+0000 7ffb9a50c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.101+0000 7ffb9a50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.101+0000 7ffb9a50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.101+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.102+0000 7ffb9a50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.102+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.102+0000 7ffb9a50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.102+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 zone default found 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 4 Realm: () 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 zonegroup default 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.103+0000 7ffb9a50c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.104+0000 7ffb9a50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.104+0000 7ffb9a50c800 20 started sync module instance, tier type = 2024-09-12T17:49:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.104+0000 7ffb9a50c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.113+0000 7ffb9a50c800 20 add_watcher() i=0 2024-09-12T17:49:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.113+0000 7ffb9a50c800 20 add_watcher() i=1 2024-09-12T17:49:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.113+0000 7ffb9a50c800 20 add_watcher() i=2 2024-09-12T17:49:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.113+0000 7ffb9a50c800 20 add_watcher() i=3 2024-09-12T17:49:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.113+0000 7ffb9a50c800 20 add_watcher() i=4 2024-09-12T17:49:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.113+0000 7ffb9a50c800 20 add_watcher() i=5 2024-09-12T17:49:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.113+0000 7ffb9a50c800 20 add_watcher() i=6 2024-09-12T17:49:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.114+0000 7ffb9a50c800 20 add_watcher() i=7 2024-09-12T17:49:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.114+0000 7ffb9a50c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.116+0000 7ffa4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.117+0000 7ffb9a50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.117+0000 7ffb9a50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.155+0000 7ffa4cfe1640 20 reqs_thread_entry: start 2024-09-12T17:49:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.155+0000 7ffb9a50c800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.155+0000 7ffb9a50c800 20 Filter name: none 2024-09-12T17:49:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.155+0000 7ff9c67fc640 20 reqs_thread_entry: start 2024-09-12T17:49:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.155+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:17.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.156+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.157+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.157+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.158+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:17.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.159+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.160+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.160+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.161+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.162+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.163+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.163+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.164+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:17.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.166+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.166+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.166+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.167+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:17.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.169+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.169+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.169+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.170+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:17.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.171+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.172+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.172+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.173+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:17.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.175+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.175+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.175+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.176+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:17.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.178+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.178+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.179+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.179+0000 7ffb9a50c800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1849647244890766027', time=2024-09-12T19:49:15.687133+0000, chain.objs.size()=1 2024-09-12T17:49:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.179+0000 7ffb9a50c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.72__shadow_.J4hT8LD0w_7mX-cBiPYHmkVcQLe21NC_0 2024-09-12T17:49:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.180+0000 7ffb9a50c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:17.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.183+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:17.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.184+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.184+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.185+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.186+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:17.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.187+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.187+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.188+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.189+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:17.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.190+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.191+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.191+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.192+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:17.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.194+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.194+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.195+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.195+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:17.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.197+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.197+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.198+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.199+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:17.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.200+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.200+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.201+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.202+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:17.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.203+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.203+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.204+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.205+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:17.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.206+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.207+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.207+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.208+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:17.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.209+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.210+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.210+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.211+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:17.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.212+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.213+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.213+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.214+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.215+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.216+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.216+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.217+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:17.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.219+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.219+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.220+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.221+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:17.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.223+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.223+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.223+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.225+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:17.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.226+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.226+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.227+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.228+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:17.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.229+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.230+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.230+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.231+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:17.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.232+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.233+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.233+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.234+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:17.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.236+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.236+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.237+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.238+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:17.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.239+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.240+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.240+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.241+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:17.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.242+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.243+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.243+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.244+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:17.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.245+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.246+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.246+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.246+0000 7ffb9a50c800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9679282289918878410', time=2024-09-12T19:49:16.102575+0000, chain.objs.size()=1 2024-09-12T17:49:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.246+0000 7ffb9a50c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.73__shadow_.nUhErdj2LVFuNlngQ8PGJR-mvXbBQgZ_0 2024-09-12T17:49:17.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.247+0000 7ffb9a50c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:17.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.250+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:17.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.251+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.251+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.252+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.253+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.254+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.254+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.255+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.256+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.257+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.257+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.258+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.259+0000 7ffb9a50c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.260+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.261+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.261+0000 7ffb9a50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.263+0000 7ffa4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.265+0000 7ffb9a50c800 20 remove_watcher() i=0 2024-09-12T17:49:17.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.265+0000 7ffb9a50c800 2 removed watcher, disabling cache 2024-09-12T17:49:17.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.266+0000 7ffb9a50c800 20 remove_watcher() i=1 2024-09-12T17:49:17.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.267+0000 7ffb9a50c800 20 remove_watcher() i=2 2024-09-12T17:49:17.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.268+0000 7ffb9a50c800 20 remove_watcher() i=3 2024-09-12T17:49:17.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.269+0000 7ffb9a50c800 20 remove_watcher() i=4 2024-09-12T17:49:17.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.270+0000 7ffb9a50c800 20 remove_watcher() i=5 2024-09-12T17:49:17.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.271+0000 7ffb9a50c800 20 remove_watcher() i=6 2024-09-12T17:49:17.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.272+0000 7ffb9a50c800 20 remove_watcher() i=7 2024-09-12T17:49:17.284 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:17.338 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:17.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.376+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.377+0000 7fbdf453d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.377+0000 7fbdf453d800 20 realm 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.377+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.377+0000 7fbdf453d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.377+0000 7fbdf453d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.378+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.378+0000 7fbdf453d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.378+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.378+0000 7fbdf453d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.378+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.379+0000 7fbdf453d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.379+0000 7fbdf453d800 20 searching for the correct realm 2024-09-12T17:49:17.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.382+0000 7fbdefa29640 0 -- 172.21.15.63:0/3700493143 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fbde4099290 msgr2=0x7fbde40821d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:17.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.586+0000 7fbdf0a2b640 0 -- 172.21.15.63:0/3700493143 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55bec89c55a0 msgr2=0x55bec89c7990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:17.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.590+0000 7fbdf453d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.590+0000 7fbdf453d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.590+0000 7fbdf453d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.590+0000 7fbdf453d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.590+0000 7fbdf453d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.590+0000 7fbdf453d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.590+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 zone default found 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 4 Realm: () 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 zonegroup default 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.591+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.592+0000 7fbdf453d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.592+0000 7fbdf453d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.592+0000 7fbdf453d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.592+0000 7fbdf453d800 20 started sync module instance, tier type = 2024-09-12T17:49:17.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.592+0000 7fbdf453d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:17.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.600+0000 7fbdf453d800 20 add_watcher() i=0 2024-09-12T17:49:17.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.600+0000 7fbdf453d800 20 add_watcher() i=1 2024-09-12T17:49:17.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.600+0000 7fbdf453d800 20 add_watcher() i=2 2024-09-12T17:49:17.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.600+0000 7fbdf453d800 20 add_watcher() i=3 2024-09-12T17:49:17.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.600+0000 7fbdf453d800 20 add_watcher() i=4 2024-09-12T17:49:17.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.600+0000 7fbdf453d800 20 add_watcher() i=5 2024-09-12T17:49:17.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.600+0000 7fbdf453d800 20 add_watcher() i=6 2024-09-12T17:49:17.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.601+0000 7fbdf453d800 20 add_watcher() i=7 2024-09-12T17:49:17.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.601+0000 7fbdf453d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:17.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.603+0000 7fbca6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.603+0000 7fbdf453d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:17.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.603+0000 7fbdf453d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:17.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.637+0000 7fbca5fdb640 20 reqs_thread_entry: start 2024-09-12T17:49:17.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.637+0000 7fbdf453d800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:17.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.637+0000 7fbdf453d800 20 Filter name: none 2024-09-12T17:49:17.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.637+0000 7fbc177fe640 20 reqs_thread_entry: start 2024-09-12T17:49:17.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.637+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:17.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.639+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.639+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.639+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.640+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:17.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.642+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.643+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.643+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.644+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:17.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.645+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.646+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.646+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.647+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:17.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.648+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.649+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.649+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.650+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.652+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.652+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.652+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.654+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:17.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.655+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.656+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.656+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.657+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:17.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.658+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.658+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.659+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.660+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:17.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.661+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.662+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.662+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.663+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:17.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.664+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.665+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.665+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.667+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:17.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.668+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.669+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.669+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.670+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:17.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.671+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.672+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.672+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.673+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:17.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.674+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.675+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.675+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.676+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:17.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.677+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.678+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.678+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.679+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:17.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.681+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.681+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.681+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.682+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:17.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.683+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.684+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.684+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.685+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:17.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.687+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.687+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.687+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.688+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:17.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.690+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.690+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.691+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.692+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:17.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.693+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.694+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.694+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.695+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:17.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.696+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.697+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.697+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.698+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.700+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.700+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.701+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.702+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:17.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.703+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.703+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.703+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.704+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:17.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.706+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.706+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.706+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.707+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:17.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.709+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.709+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.710+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.711+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:17.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.712+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.713+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.713+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.714+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:17.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.715+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.715+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.716+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.717+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:17.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.718+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.719+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.719+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.720+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:17.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.721+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.721+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.722+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.723+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:17.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.724+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.724+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.725+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.726+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:17.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.727+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.728+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.728+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.729+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:17.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.730+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.731+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.731+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.732+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:17.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.733+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.734+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.734+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.735+0000 7fbdf453d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:17.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.736+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.737+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.737+0000 7fbdf453d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.739+0000 7fbca6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.741+0000 7fbdf453d800 20 remove_watcher() i=0 2024-09-12T17:49:17.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.741+0000 7fbdf453d800 2 removed watcher, disabling cache 2024-09-12T17:49:17.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.742+0000 7fbdf453d800 20 remove_watcher() i=1 2024-09-12T17:49:17.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.743+0000 7fbdf453d800 20 remove_watcher() i=2 2024-09-12T17:49:17.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.744+0000 7fbdf453d800 20 remove_watcher() i=3 2024-09-12T17:49:17.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.745+0000 7fbdf453d800 20 remove_watcher() i=4 2024-09-12T17:49:17.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.746+0000 7fbdf453d800 20 remove_watcher() i=5 2024-09-12T17:49:17.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.747+0000 7fbdf453d800 20 remove_watcher() i=6 2024-09-12T17:49:17.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.748+0000 7fbdf453d800 20 remove_watcher() i=7 2024-09-12T17:49:17.761 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:17.815 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:17.815 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:17.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.853+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 20 realm 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.855+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.856+0000 7fb83c942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.856+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.856+0000 7fb83c942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:17.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.856+0000 7fb83c942800 20 searching for the correct realm 2024-09-12T17:49:17.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:17.859+0000 7fb837eec640 0 -- 172.21.15.63:0/310271658 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb82c0b60c0 msgr2=0x7fb82c0b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:18.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.065+0000 7fb838eee640 0 -- 172.21.15.63:0/310271658 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55c97c24d7a0 msgr2=0x55c97c24fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:18.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:18.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:18.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.069+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:18.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 zone default found 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 4 Realm: () 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 zonegroup default 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.070+0000 7fb83c942800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.071+0000 7fb83c942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.071+0000 7fb83c942800 20 started sync module instance, tier type = 2024-09-12T17:49:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.071+0000 7fb83c942800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.079+0000 7fb83c942800 20 add_watcher() i=0 2024-09-12T17:49:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.079+0000 7fb83c942800 20 add_watcher() i=1 2024-09-12T17:49:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.079+0000 7fb83c942800 20 add_watcher() i=2 2024-09-12T17:49:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.079+0000 7fb83c942800 20 add_watcher() i=3 2024-09-12T17:49:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.079+0000 7fb83c942800 20 add_watcher() i=4 2024-09-12T17:49:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.079+0000 7fb83c942800 20 add_watcher() i=5 2024-09-12T17:49:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.079+0000 7fb83c942800 20 add_watcher() i=6 2024-09-12T17:49:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.080+0000 7fb83c942800 20 add_watcher() i=7 2024-09-12T17:49:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.080+0000 7fb83c942800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:18.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.082+0000 7fb6ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.082+0000 7fb83c942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:18.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.082+0000 7fb83c942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:18.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.117+0000 7fb6ed7e2640 20 reqs_thread_entry: start 2024-09-12T17:49:18.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.117+0000 7fb83c942800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:18.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.117+0000 7fb83c942800 20 Filter name: none 2024-09-12T17:49:18.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.117+0000 7fb666ffd640 20 reqs_thread_entry: start 2024-09-12T17:49:18.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.117+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:18.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.118+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.119+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.119+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.120+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:18.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.121+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.122+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.122+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.123+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:18.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.124+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.125+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.125+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.126+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:18.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.127+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.128+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.128+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.129+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:18.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.130+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.131+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.131+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.132+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:18.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.133+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.134+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.134+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.135+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:18.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.136+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.137+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.137+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.138+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:18.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.139+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.140+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.140+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.141+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:18.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.142+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.143+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.143+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.144+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:18.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.145+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.145+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.146+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.147+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:18.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.148+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.149+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.149+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.150+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.152+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.152+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.152+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.153+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.154+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.155+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.155+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.156+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.158+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.158+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.158+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.159+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.161+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.161+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.161+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.162+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.163+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.164+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.164+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.165+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.167+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.167+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.167+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.168+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.169+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.170+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.170+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.171+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:18.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.172+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.173+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.173+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.174+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:18.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.175+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.175+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.176+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.177+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:18.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.178+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.178+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.178+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.179+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:18.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.181+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.181+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.181+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.182+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.184+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.184+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.184+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.185+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:18.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.186+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.187+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.187+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.188+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.190+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.190+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.191+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.192+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:18.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.193+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.194+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.194+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.195+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:18.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.196+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.197+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.197+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.198+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:18.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.200+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.200+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.200+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.202+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:18.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.203+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.204+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.204+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.205+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.206+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.206+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.207+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.207+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.210+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.210+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.210+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.211+0000 7fb83c942800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.213+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.213+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.213+0000 7fb83c942800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.215+0000 7fb6ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.217+0000 7fb83c942800 20 remove_watcher() i=0 2024-09-12T17:49:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.217+0000 7fb83c942800 2 removed watcher, disabling cache 2024-09-12T17:49:18.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.218+0000 7fb83c942800 20 remove_watcher() i=1 2024-09-12T17:49:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.219+0000 7fb83c942800 20 remove_watcher() i=2 2024-09-12T17:49:18.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.220+0000 7fb83c942800 20 remove_watcher() i=3 2024-09-12T17:49:18.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.221+0000 7fb83c942800 20 remove_watcher() i=4 2024-09-12T17:49:18.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.222+0000 7fb83c942800 20 remove_watcher() i=5 2024-09-12T17:49:18.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.223+0000 7fb83c942800 20 remove_watcher() i=6 2024-09-12T17:49:18.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.224+0000 7fb83c942800 20 remove_watcher() i=7 2024-09-12T17:49:18.236 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:18.289 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:18.289 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:18.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.327+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 20 realm 2024-09-12T17:49:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.328+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.329+0000 7fb6aa020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:18.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.329+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.330+0000 7fb6aa020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:18.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.330+0000 7fb6aa020800 20 searching for the correct realm 2024-09-12T17:49:18.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.333+0000 7fb6a7309640 0 -- 172.21.15.63:0/3589346003 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb69c0688a0 msgr2=0x7fb69c07a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.538+0000 7fb6a830b640 0 -- 172.21.15.63:0/3589346003 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5571bc00c1e0 msgr2=0x5571bc00e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:18.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.542+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:18.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 zone default found 2024-09-12T17:49:18.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 4 Realm: () 2024-09-12T17:49:18.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:18.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 zonegroup default 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 started sync module instance, tier type = 2024-09-12T17:49:18.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.543+0000 7fb6aa020800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.552+0000 7fb6aa020800 20 add_watcher() i=0 2024-09-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.552+0000 7fb6aa020800 20 add_watcher() i=1 2024-09-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.552+0000 7fb6aa020800 20 add_watcher() i=2 2024-09-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.552+0000 7fb6aa020800 20 add_watcher() i=3 2024-09-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.552+0000 7fb6aa020800 20 add_watcher() i=4 2024-09-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.552+0000 7fb6aa020800 20 add_watcher() i=5 2024-09-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.552+0000 7fb6aa020800 20 add_watcher() i=6 2024-09-12T17:49:18.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.553+0000 7fb6aa020800 20 add_watcher() i=7 2024-09-12T17:49:18.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.553+0000 7fb6aa020800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:18.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.555+0000 7fb55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.555+0000 7fb6aa020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:18.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.555+0000 7fb6aa020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:18.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.590+0000 7fb55cfe1640 20 reqs_thread_entry: start 2024-09-12T17:49:18.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.590+0000 7fb6aa020800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:18.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.590+0000 7fb6aa020800 20 Filter name: none 2024-09-12T17:49:18.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.590+0000 7fb4d67fc640 20 reqs_thread_entry: start 2024-09-12T17:49:18.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.590+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:18.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.591+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.592+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.592+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.593+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:18.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.595+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.596+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.596+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.597+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:18.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.598+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.599+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.599+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.600+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:18.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.602+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.602+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.602+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.603+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:18.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.605+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.605+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.605+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.606+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:18.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.608+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.609+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.609+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.610+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:18.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.611+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.612+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.613+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.614+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:18.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.615+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.615+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.616+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.617+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:18.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.618+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.618+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.619+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.619+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:18.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.621+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.621+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.622+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.622+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:18.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.624+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.624+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.624+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.625+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:18.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.627+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.627+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.627+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.628+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:18.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.630+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.630+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.630+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.631+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.632+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.633+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.633+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.634+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.636+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.637+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.637+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.638+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.639+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.639+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.639+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.640+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.642+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.642+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.643+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.644+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.645+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.645+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.646+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.646+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.648+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.648+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.649+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.649+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:18.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.651+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.651+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.652+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.653+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:18.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.654+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.654+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.655+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.655+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:18.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.657+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.657+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.658+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.659+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:18.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.660+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.660+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.661+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.661+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:18.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.663+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.663+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.664+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.664+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:18.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.666+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.666+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.667+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.667+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.669+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.669+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.670+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.670+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.672+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.672+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.672+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.673+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.675+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.675+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.675+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.676+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:18.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.677+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.678+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.678+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.679+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.680+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.681+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.681+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.682+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.684+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.684+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.685+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.686+0000 7fb6aa020800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.687+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.688+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:18.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.688+0000 7fb6aa020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:18.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.690+0000 7fb55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.692+0000 7fb6aa020800 20 remove_watcher() i=0 2024-09-12T17:49:18.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.692+0000 7fb6aa020800 2 removed watcher, disabling cache 2024-09-12T17:49:18.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.693+0000 7fb6aa020800 20 remove_watcher() i=1 2024-09-12T17:49:18.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.694+0000 7fb6aa020800 20 remove_watcher() i=2 2024-09-12T17:49:18.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.695+0000 7fb6aa020800 20 remove_watcher() i=3 2024-09-12T17:49:18.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.696+0000 7fb6aa020800 20 remove_watcher() i=4 2024-09-12T17:49:18.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.697+0000 7fb6aa020800 20 remove_watcher() i=5 2024-09-12T17:49:18.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.698+0000 7fb6aa020800 20 remove_watcher() i=6 2024-09-12T17:49:18.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:18.699+0000 7fb6aa020800 20 remove_watcher() i=7 2024-09-12T17:49:18.711 DEBUG:teuthology.orchestra.run.smithi063:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T17:49:19.350 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :clean 2024-09-12T17:49:20.148 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :compileJava 2024-09-12T17:49:20.148 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :processResources 2024-09-12T17:49:20.148 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :classes 2024-09-12T17:49:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :compileTestJava 2024-09-12T17:49:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:49:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :testClasses 2024-09-12T17:49:20.549 INFO:teuthology.orchestra.run.smithi063.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:49:20.549 INFO:teuthology.orchestra.run.smithi063.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:49:22.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.548 INFO:teuthology.orchestra.run.smithi063.stdout:> Task :test 2024-09-12T17:49:22.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12 17:49:21,793 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T17:49:22.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.550 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T17:49:22.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T17:49:22.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.649 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T17:49:22.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:22.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T17:49:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:23.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T17:49:23.449 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:23.449 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T17:49:23.449 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:23.449 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T17:49:23.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:23.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T17:49:23.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:23.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T17:49:23.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:23.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T17:49:23.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:23.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T17:49:24.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.049 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T17:49:24.049 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.049 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T17:49:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T17:49:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T17:49:24.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T17:49:24.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T17:49:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T17:49:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:24.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T17:49:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T17:49:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T17:49:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T17:49:25.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T17:49:25.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T17:49:25.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T17:49:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T17:49:25.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:25.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T17:49:26.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:26.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T17:49:26.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:26.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T17:49:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:26.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T17:49:26.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:26.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T17:49:27.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:27.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T17:49:31.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:31.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T17:49:31.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:31.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T17:49:31.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:31.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T17:49:31.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:31.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T17:49:31.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:31.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T17:49:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:32.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T17:49:32.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:32.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T17:49:32.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:32.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T17:49:32.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:32.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T17:49:32.947 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:32.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T17:49:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:33.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T17:49:33.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:33.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:49:34.347 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:34.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:49:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T17:49:34.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:34.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T17:49:35.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:35.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T17:49:36.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:36.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T17:49:37.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:37.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T17:49:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:37.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T17:49:38.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:38.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T17:49:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:39.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T17:49:39.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:39.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T17:49:39.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:39.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T17:49:40.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T17:49:40.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T17:49:40.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T17:49:40.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T17:49:40.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T17:49:40.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T17:49:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T17:49:40.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:40.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T17:49:41.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T17:49:41.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T17:49:41.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T17:49:41.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T17:49:41.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T17:49:41.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T17:49:41.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:41.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T17:49:42.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:42.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T17:49:42.147 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:42.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T17:49:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:42.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T17:49:42.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:42.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T17:49:42.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:42.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T17:49:42.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:42.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T17:49:42.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:42.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T17:49:43.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:43.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T17:49:43.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:43.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T17:49:43.347 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T17:49:43.547 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:43.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T17:49:43.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:43.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T17:49:43.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:43.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T17:49:43.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:43.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T17:49:44.147 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:44.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T17:49:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:44.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T17:49:44.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T17:49:44.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:44.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T17:49:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:44.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T17:49:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:44.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T17:49:45.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T17:49:45.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T17:49:45.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T17:49:45.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T17:49:45.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T17:49:45.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T17:49:45.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T17:49:45.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:45.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T17:49:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:46.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T17:49:46.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:46.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T17:49:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:46.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T17:49:46.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:46.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T17:49:46.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:46.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T17:49:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:46.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T17:49:47.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:47.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T17:49:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:47.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T17:49:47.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:47.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T17:49:47.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:47.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T17:49:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:47.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T17:49:47.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:47.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T17:49:47.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:47.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T17:49:48.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T17:49:48.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T17:49:48.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T17:49:48.447 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T17:49:48.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T17:49:48.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T17:49:48.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.748 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T17:49:48.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T17:49:48.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:48.948 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T17:49:49.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T17:49:49.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.248 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T17:49:49.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T17:49:49.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T17:49:49.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.548 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T17:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T17:49:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T17:49:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T17:49:50.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:50.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T17:49:50.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:50.148 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T17:49:50.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:50.348 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T17:49:50.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:50.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T17:49:50.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:50.648 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T17:49:50.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:50.848 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T17:49:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:51.048 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T17:49:51.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:51.448 INFO:teuthology.orchestra.run.smithi063.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T17:49:51.614 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:---------------------------------------------------------------------- 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:---------------------------------------------------------------------- 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:BUILD SUCCESSFUL in 32s 2024-09-12T17:49:51.615 INFO:teuthology.orchestra.run.smithi063.stdout:5 actionable tasks: 5 executed 2024-09-12T17:49:51.629 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:51.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.720+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 20 realm 2024-09-12T17:49:51.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.722+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.723+0000 7fd5653af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.723+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.723+0000 7fd5653af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:51.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.723+0000 7fd5653af800 20 searching for the correct realm 2024-09-12T17:49:51.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.726+0000 7fd55a69f640 0 -- 172.21.15.63:0/3846666407 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x55d097afed10 msgr2=0x55d097b011d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:51.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.729+0000 7fd562ea0640 0 -- 172.21.15.63:0/3846666407 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fd55c029030 msgr2=0x7fd55c04a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:51.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.937+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 zone default found 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 4 Realm: () 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 zonegroup default 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 started sync module instance, tier type = 2024-09-12T17:49:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.938+0000 7fd5653af800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.947+0000 7fd5653af800 20 add_watcher() i=0 2024-09-12T17:49:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.947+0000 7fd5653af800 20 add_watcher() i=1 2024-09-12T17:49:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.947+0000 7fd5653af800 20 add_watcher() i=2 2024-09-12T17:49:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.947+0000 7fd5653af800 20 add_watcher() i=3 2024-09-12T17:49:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.947+0000 7fd5653af800 20 add_watcher() i=4 2024-09-12T17:49:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.947+0000 7fd5653af800 20 add_watcher() i=5 2024-09-12T17:49:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.947+0000 7fd5653af800 20 add_watcher() i=6 2024-09-12T17:49:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.948+0000 7fd5653af800 20 add_watcher() i=7 2024-09-12T17:49:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.948+0000 7fd5653af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.950+0000 7fd4197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.950+0000 7fd5653af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.950+0000 7fd5653af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:51.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.985+0000 7fd393fff640 20 reqs_thread_entry: start 2024-09-12T17:49:51.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.985+0000 7fd5653af800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:51.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.985+0000 7fd5653af800 20 Filter name: none 2024-09-12T17:49:51.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.985+0000 7fd391ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:51.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.985+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:51.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.986+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:51.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:51.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:51.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16974510627404928594', time=2024-09-12T19:49:38.036485+0000, chain.objs.size()=9 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__multipart_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.1 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__shadow_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.1_1 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__multipart_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.2 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__shadow_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.2_1 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__multipart_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.3 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__shadow_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.3_1 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__multipart_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.4 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.987+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__shadow_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.4_1 2024-09-12T17:49:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.988+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__multipart_key1.2~XI03J5cRM4dsLBO6lq_-ICgI-JUbYWh.5 2024-09-12T17:49:51.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.989+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6539031659382920015', time=2024-09-12T19:49:42.780643+0000, chain.objs.size()=1 2024-09-12T17:49:51.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.989+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.116__shadow_.XxvwfjNYe3I7qLXXmmzOq5sv2dehTjp_0 2024-09-12T17:49:51.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.989+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16345782873850762596', time=2024-09-12T19:49:44.245021+0000, chain.objs.size()=1 2024-09-12T17:49:51.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.989+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.121__shadow_.PBdxF11pvnhJ-hHoTqv_awp6c0UY8fn_0 2024-09-12T17:49:51.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.989+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1403475113954090732', time=2024-09-12T19:49:46.021845+0000, chain.objs.size()=1 2024-09-12T17:49:51.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.989+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.127__shadow_.9w1kJjVFvJX_9C2XtbDbtD9tGv3fadc_0 2024-09-12T17:49:51.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.995+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:51.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.997+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:51.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.998+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:51.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:52.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14310648139938864562', time=2024-09-12T19:49:28.947238+0000, chain.objs.size()=9 2024-09-12T17:49:52.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.1 2024-09-12T17:49:52.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.1_1 2024-09-12T17:49:52.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.2 2024-09-12T17:49:52.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.2_1 2024-09-12T17:49:52.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.3 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.3_1 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.4 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:51.999+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.4_1 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.000+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~kRaTeR4pD-s3ycIO6AV7qUD9oKCUtQl.5 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.000+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15693989399902117851', time=2024-09-12T19:49:42.770066+0000, chain.objs.size()=1 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.000+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.116__shadow_.cqKEdFT0NfjIoAC2ynWchnNUd9wcjZ3_0 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.000+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10291948260513950384', time=2024-09-12T19:49:44.251183+0000, chain.objs.size()=1 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.000+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.121__shadow_.O-6LXoGhoODpDoCXcZw_-VJJMO00d7H_0 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.000+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17507956841746797529', time=2024-09-12T19:49:44.844047+0000, chain.objs.size()=1 2024-09-12T17:49:52.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.000+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.123__shadow_.L2TWEYvjlHZ9PMnD7CHsh-zQ__ZMWJW_0 2024-09-12T17:49:52.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.006+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.008+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:52.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.009+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:52.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2838129621629669467', time=2024-09-12T19:49:29.923601+0000, chain.objs.size()=9 2024-09-12T17:49:52.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.1 2024-09-12T17:49:52.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.1_1 2024-09-12T17:49:52.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.2 2024-09-12T17:49:52.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.2_1 2024-09-12T17:49:52.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.3 2024-09-12T17:49:52.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.3_1 2024-09-12T17:49:52.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.4 2024-09-12T17:49:52.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.4_1 2024-09-12T17:49:52.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.010+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Oa9sNO3PXWzlZ0cdk68k_2T9-w__iqG.5 2024-09-12T17:49:52.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.017+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.019+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:52.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.021+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.021+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:49:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9707864045617245023', time=2024-09-12T19:49:34.396810+0000, chain.objs.size()=1 2024-09-12T17:49:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_.AOmrkqR9kKkQXSTJipFGIZpaHncHESy_0 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu', time=2024-09-12T19:49:35.019847+0000, chain.objs.size()=9 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__multipart_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.7 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__shadow_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.7_1 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__multipart_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.8 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__shadow_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.8_1 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__multipart_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.9 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__shadow_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.9_1 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__multipart_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.10 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__shadow_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.10_1 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.102__multipart_key1.2~uXIihPQJAi2W_FVvkZDXQKeHhEpaOYu.11 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo', time=2024-09-12T19:49:40.027261+0000, chain.objs.size()=77 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.1 2024-09-12T17:49:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.022+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.2 2024-09-12T17:49:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.025+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.3 2024-09-12T17:49:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.025+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.4 2024-09-12T17:49:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.025+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.5 2024-09-12T17:49:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.026+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.6 2024-09-12T17:49:52.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.026+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.7 2024-09-12T17:49:52.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.027+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.8 2024-09-12T17:49:52.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.027+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.9 2024-09-12T17:49:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.029+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.10 2024-09-12T17:49:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.029+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.11 2024-09-12T17:49:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.029+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.12 2024-09-12T17:49:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.030+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.13 2024-09-12T17:49:52.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.030+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.14 2024-09-12T17:49:52.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.030+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.15 2024-09-12T17:49:52.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.032+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.16 2024-09-12T17:49:52.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.032+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.17 2024-09-12T17:49:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.033+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.18 2024-09-12T17:49:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.033+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.19 2024-09-12T17:49:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.033+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.20 2024-09-12T17:49:52.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.035+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.21 2024-09-12T17:49:52.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.035+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.22 2024-09-12T17:49:52.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.036+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.23 2024-09-12T17:49:52.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.036+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.24 2024-09-12T17:49:52.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.036+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.25 2024-09-12T17:49:52.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.036+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.26 2024-09-12T17:49:52.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.037+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.27 2024-09-12T17:49:52.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.037+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.28 2024-09-12T17:49:52.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.038+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.29 2024-09-12T17:49:52.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.038+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.30 2024-09-12T17:49:52.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.038+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.31 2024-09-12T17:49:52.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.038+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.32 2024-09-12T17:49:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.039+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.33 2024-09-12T17:49:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.041+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.34 2024-09-12T17:49:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.041+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.35 2024-09-12T17:49:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.042+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.36 2024-09-12T17:49:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.042+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.37 2024-09-12T17:49:52.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.043+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.38 2024-09-12T17:49:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.043+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.39 2024-09-12T17:49:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.043+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.40 2024-09-12T17:49:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.043+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.41 2024-09-12T17:49:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.043+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.42 2024-09-12T17:49:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.043+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.43 2024-09-12T17:49:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.045+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.44 2024-09-12T17:49:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.045+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.45 2024-09-12T17:49:52.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.047+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.46 2024-09-12T17:49:52.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.047+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.47 2024-09-12T17:49:52.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.048+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.48 2024-09-12T17:49:52.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.048+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.49 2024-09-12T17:49:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.050+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.50 2024-09-12T17:49:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.050+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.51 2024-09-12T17:49:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.051+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.52 2024-09-12T17:49:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.051+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.53 2024-09-12T17:49:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.051+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.54 2024-09-12T17:49:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.051+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.55 2024-09-12T17:49:52.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.051+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.56 2024-09-12T17:49:52.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.051+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.57 2024-09-12T17:49:52.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.054+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.58 2024-09-12T17:49:52.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.054+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.59 2024-09-12T17:49:52.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.056+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.60 2024-09-12T17:49:52.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.056+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.61 2024-09-12T17:49:52.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.056+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.62 2024-09-12T17:49:52.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.059+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.63 2024-09-12T17:49:52.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.059+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.64 2024-09-12T17:49:52.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.059+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.65 2024-09-12T17:49:52.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.059+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.66 2024-09-12T17:49:52.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.059+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.67 2024-09-12T17:49:52.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.059+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.68 2024-09-12T17:49:52.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.060+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.69 2024-09-12T17:49:52.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.060+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.70 2024-09-12T17:49:52.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.061+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.71 2024-09-12T17:49:52.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.061+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.72 2024-09-12T17:49:52.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.061+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.73 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.74 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.75 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.76 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.106__multipart_key1.2~Xq0l6vBF7YrR9rc0cRkKYPwOs3WBFMo.77 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2251381660055914370', time=2024-09-12T19:49:42.189423+0000, chain.objs.size()=1 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.114__shadow_.5FXTDinOKWdMp-S76kg-uAI3thxHzAu_0 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4057901677704142130', time=2024-09-12T19:49:47.758092+0000, chain.objs.size()=1 2024-09-12T17:49:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.064+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.133__shadow_.FY2aZxYxrTKPSg3YLvJc6Wz-nEtVS-z_0 2024-09-12T17:49:52.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.065+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13402659914942056080', time=2024-09-12T19:49:49.662175+0000, chain.objs.size()=1 2024-09-12T17:49:52.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.065+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.140__shadow_.Q20c0q1GK-H2uWxaL3CW8_BPGkjg0M3_0 2024-09-12T17:49:52.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.070+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.072+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:52.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.073+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7588927184625239599', time=2024-09-12T19:49:29.493547+0000, chain.objs.size()=9 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.1 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.1_1 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.2 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.2_1 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.3 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.3_1 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.4 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.4_1 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~TDfHwTX7FDk9L5A4JvdvpjanFSSBe7p.5 2024-09-12T17:49:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14448136212819418884', time=2024-09-12T19:49:34.391181+0000, chain.objs.size()=1 2024-09-12T17:49:52.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_.3EHWm7Y1xTi_GLnRqfWe-LTYJggHw-P_0 2024-09-12T17:49:52.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12009326296715363815', time=2024-09-12T19:49:37.489906+0000, chain.objs.size()=1 2024-09-12T17:49:52.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.104__shadow_.uvMcWmUtNlHUG9Eyw80CgULBl-HLLjg_0 2024-09-12T17:49:52.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12515468191708399505', time=2024-09-12T19:49:43.954558+0000, chain.objs.size()=1 2024-09-12T17:49:52.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.074+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.120__shadow_.IchXQZsxiee6qF1jKDVGOLYNES2XXDa_0 2024-09-12T17:49:52.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.079+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4269520310871550358', time=2024-09-12T19:49:46.598769+0000, chain.objs.size()=1 2024-09-12T17:49:52.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.079+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.129__shadow_.eX4S-aiFPkSoAT4qHKLbOwdswQ5EDiG_0 2024-09-12T17:49:52.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.081+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.084+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:52.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.085+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:49:52.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2460107786207983878', time=2024-09-12T19:49:42.184028+0000, chain.objs.size()=1 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.114__shadow_.2RQhS9A_SkAUjlTwt6HAtNOpDVgNUue_0 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9641962378499221988', time=2024-09-12T19:49:46.001433+0000, chain.objs.size()=1 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.127__shadow_.TYI4LjKeL_H7BYsYD6-IiSKV_L-2SJ5_0 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14201844608570858792', time=2024-09-12T19:49:46.895865+0000, chain.objs.size()=1 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.130__shadow_.xXQlOJ81jBzv1BDYGDVIYqqgDj4Hcef_0 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13766777505274882609', time=2024-09-12T19:49:47.194608+0000, chain.objs.size()=1 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.131__shadow_.NrGk8jl-x27Wwe2gdBzLLjHEGmRBIRj_0 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7946487575599468054', time=2024-09-12T19:49:48.914135+0000, chain.objs.size()=1 2024-09-12T17:49:52.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.086+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.138__shadow_.bHUXAyKEKOxCl9yeTdEfKv8-vBmnlsm_0 2024-09-12T17:49:52.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.088+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.091+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:52.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.092+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.092+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1420800372362306783', time=2024-09-12T19:49:23.818150+0000, chain.objs.size()=1 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.82__shadow_.BJVGsUHGjXVr5K3mhsvOJjepUbEQITu_0 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11992632860857976671', time=2024-09-12T19:49:43.358593+0000, chain.objs.size()=1 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.118__shadow_.dIHhe2lj-sNMxZUVnY0dSyjGdBj-l4z_0 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13284024791489540626', time=2024-09-12T19:49:46.609375+0000, chain.objs.size()=1 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.129__shadow_.5KOJIoXa2kxRS3C7otOo_c6oy1buisf_0 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16815744316869569982', time=2024-09-12T19:49:47.467938+0000, chain.objs.size()=1 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.132__shadow_.nluUnsOY-drgiWQUNHXsr-USz6IJuLJ_0 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9685598548316634890', time=2024-09-12T19:49:51.439552+0000, chain.objs.size()=9 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__multipart_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.1 2024-09-12T17:49:52.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__shadow_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.1_1 2024-09-12T17:49:52.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__multipart_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.2 2024-09-12T17:49:52.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__shadow_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.2_1 2024-09-12T17:49:52.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__multipart_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.3 2024-09-12T17:49:52.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__shadow_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.3_1 2024-09-12T17:49:52.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__multipart_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.4 2024-09-12T17:49:52.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.093+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__shadow_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.4_1 2024-09-12T17:49:52.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.097+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__multipart_key1/data/file.mpg.2~jA5mINCWkzI8t6RqkH5oVJ5r_PxfQwh.5 2024-09-12T17:49:52.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.101+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.103+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.104+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:52.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q', time=2024-09-12T19:49:23.169752+0000, chain.objs.size()=9 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__multipart_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.1 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__shadow_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.1_1 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__multipart_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.2 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__shadow_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.2_1 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__multipart_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.3 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__shadow_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.3_1 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__multipart_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.4 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__shadow_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.4_1 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.80__multipart_key1.2~fSYouwNFGwz1b4YtgQSsjP0WFEivV8q.5 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13265544719007674313', time=2024-09-12T19:49:47.763308+0000, chain.objs.size()=1 2024-09-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.105+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.133__shadow_.9CEXJDPSaKIP_Z1CCwBxCa6_JF6oPwv_0 2024-09-12T17:49:52.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.110+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.114+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:52.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.115+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.115+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.116+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:52.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.116+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16297812663716345711', time=2024-09-12T19:49:46.890553+0000, chain.objs.size()=1 2024-09-12T17:49:52.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.116+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.130__shadow_.ABmckeLHg-90HzJHinJ5CY33adm3saq_0 2024-09-12T17:49:52.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.117+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.119+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:52.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.120+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.121+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.121+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:52.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.121+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8077299479743828555', time=2024-09-12T19:49:44.542061+0000, chain.objs.size()=1 2024-09-12T17:49:52.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.121+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.122__shadow_.GqkqFn0mU2Hqa01U0G8ayytLDTo6zsL_0 2024-09-12T17:49:52.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.121+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13841611764952727333', time=2024-09-12T19:49:45.721933+0000, chain.objs.size()=1 2024-09-12T17:49:52.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.121+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.126__shadow_.dkMQXzbo-Ir2mCvFdMQSYntGL8rh5Td_0 2024-09-12T17:49:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.123+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.125+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:52.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.126+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17277886556118517990', time=2024-09-12T19:49:36.602055+0000, chain.objs.size()=7 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~ArjvSo8lntLI2-OEYopfyEyGRdGsV5i.1 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~ArjvSo8lntLI2-OEYopfyEyGRdGsV5i.1_1 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~ArjvSo8lntLI2-OEYopfyEyGRdGsV5i.1_2 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~ArjvSo8lntLI2-OEYopfyEyGRdGsV5i.2 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~ArjvSo8lntLI2-OEYopfyEyGRdGsV5i.2_1 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~ArjvSo8lntLI2-OEYopfyEyGRdGsV5i.2_2 2024-09-12T17:49:52.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~ArjvSo8lntLI2-OEYopfyEyGRdGsV5i.3 2024-09-12T17:49:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7908925481963708204', time=2024-09-12T19:49:42.178836+0000, chain.objs.size()=1 2024-09-12T17:49:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.114__shadow_.eAN8Y5BlqzvS_8JoBTA9vP3dkJ3GzwH_0 2024-09-12T17:49:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17465489642326037871', time=2024-09-12T19:49:46.006669+0000, chain.objs.size()=1 2024-09-12T17:49:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.127__shadow_.7CoHhDZIjQx8peWoaSv1bRgU_9QWsJS_0 2024-09-12T17:49:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15803844220789452918', time=2024-09-12T19:49:46.901486+0000, chain.objs.size()=1 2024-09-12T17:49:52.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.127+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.130__shadow_.qSen5jkb_pxsVPdTe_O2mUwscGg0UXi_0 2024-09-12T17:49:52.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.131+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.134+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:52.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.135+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13336213654594104545', time=2024-09-12T19:49:24.700798+0000, chain.objs.size()=1 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.85__shadow_.sbu_Gj3FO7AJxhLzXBdiinkEd3hBltO_0 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14221072878800602535', time=2024-09-12T19:49:35.739365+0000, chain.objs.size()=9 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.1 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.1_1 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.2 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.2_1 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.3 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.3_1 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.4 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.4_1 2024-09-12T17:49:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.136+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~cu5e4YZu1XVkt8ZqJdYDYiiLwBdY4dM.5 2024-09-12T17:49:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.141+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.144+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.145+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.145+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.146+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.146+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8443971040825548366', time=2024-09-12T19:49:41.892058+0000, chain.objs.size()=1 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.146+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.113__shadow_.CFm32bg-bpg4aaiDXN6BQHiPS4d57CQ_0 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.146+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12630604667552681565', time=2024-09-12T19:49:44.554025+0000, chain.objs.size()=1 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.146+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.122__shadow_.jDX-SJ002lKabFX-WH77hwU3D9q3qw__0 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.146+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16834293936153623506', time=2024-09-12T19:49:45.412892+0000, chain.objs.size()=1 2024-09-12T17:49:52.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.146+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.125__shadow_._VPrcWE99YbZvxixh9VGjPspxHW1B6O_0 2024-09-12T17:49:52.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.147+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.150+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:52.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.151+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.151+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.152+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:49:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.152+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6362892699399365354', time=2024-09-12T19:49:43.072157+0000, chain.objs.size()=1 2024-09-12T17:49:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.152+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.117__shadow_.GBEH79OjVSOLwWedOlwsIHfwJlauM3K_0 2024-09-12T17:49:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.152+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14571427658424421390', time=2024-09-12T19:49:43.363739+0000, chain.objs.size()=1 2024-09-12T17:49:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.152+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.118__shadow_.ZaJFwcAzN8OHOOMzfJzxzJidSfQF1Tr_0 2024-09-12T17:49:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.152+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5794004358771546298', time=2024-09-12T19:49:48.048944+0000, chain.objs.size()=1 2024-09-12T17:49:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.152+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.134__shadow_.NGXfNr8cdqVQZIwnnc5ClRDxHAwLgaz_0 2024-09-12T17:49:52.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.154+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.156+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:52.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.157+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:49:52.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13115427372057291061', time=2024-09-12T19:49:26.099601+0000, chain.objs.size()=1 2024-09-12T17:49:52.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.91__shadow_.ooyPUEDUgSnGryl53dZBdYUMfQ7kr8x_0 2024-09-12T17:49:52.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9076979364082939100', time=2024-09-12T19:49:39.204200+0000, chain.objs.size()=9 2024-09-12T17:49:52.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__multipart_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.1 2024-09-12T17:49:52.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__shadow_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.1_1 2024-09-12T17:49:52.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__multipart_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.2 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__shadow_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.2_1 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__multipart_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.3 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__shadow_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.3_1 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__multipart_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.4 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__shadow_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.4_1 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.105__multipart_key1.2~WJoa5BqwW0IwiJEqxx30AXtiWbw_Hbi.5 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7367721280499876303', time=2024-09-12T19:49:41.881727+0000, chain.objs.size()=1 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.113__shadow_.nixnAVSNaOTw2OBREfhSXYDYNnOX1sS_0 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6047528216261135908', time=2024-09-12T19:49:42.764449+0000, chain.objs.size()=1 2024-09-12T17:49:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.158+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.116__shadow_.1kfCi2B5b618uPKNSdKb9QOlwTXWRnY_0 2024-09-12T17:49:52.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.163+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14885282324189064726', time=2024-09-12T19:49:44.261736+0000, chain.objs.size()=1 2024-09-12T17:49:52.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.163+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.121__shadow_.HbqFQfzrEse1LfxanqZl7tFaQSusxJP_0 2024-09-12T17:49:52.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.163+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15756853453399192956', time=2024-09-12T19:49:44.854296+0000, chain.objs.size()=1 2024-09-12T17:49:52.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.163+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.123__shadow_.R_KnQDv3l9a9tmOVfGKSYelSi5l5IOw_0 2024-09-12T17:49:52.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.166+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.169+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:52.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.170+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1948439949491437021', time=2024-09-12T19:49:36.334990+0000, chain.objs.size()=9 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.1 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.1_1 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.2 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.2_1 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.3 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.3_1 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.4 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.4_1 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~LmCrndLSQRiz-eHYLU-pPcn_t8bfuca.5 2024-09-12T17:49:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15383647518741190008', time=2024-09-12T19:49:44.548275+0000, chain.objs.size()=1 2024-09-12T17:49:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.122__shadow_.GE13fc4eKAf9_s0cXPSAJfG4XaT_OgR_0 2024-09-12T17:49:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2724799135683965818', time=2024-09-12T19:49:45.129601+0000, chain.objs.size()=1 2024-09-12T17:49:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.124__shadow_.WgwAkJoaud4p6E_Np_OQFkR7d_254m5_0 2024-09-12T17:49:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1660365034521445969', time=2024-09-12T19:49:45.715957+0000, chain.objs.size()=1 2024-09-12T17:49:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.171+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.126__shadow_.wgYKTkgddlX2ws48h4E7zWlFj1WhKya_0 2024-09-12T17:49:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.175+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5279215662726491419', time=2024-09-12T19:49:50.922353+0000, chain.objs.size()=9 2024-09-12T17:49:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.175+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__multipart_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.1 2024-09-12T17:49:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.175+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__shadow_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.1_1 2024-09-12T17:49:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.175+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__multipart_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.2 2024-09-12T17:49:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.175+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__shadow_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.2_1 2024-09-12T17:49:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.175+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__multipart_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.3 2024-09-12T17:49:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.175+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__shadow_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.3_1 2024-09-12T17:49:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.176+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__multipart_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.4 2024-09-12T17:49:52.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.177+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__shadow_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.4_1 2024-09-12T17:49:52.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.177+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.144__multipart_key1.2~dEWKt6pEUemTH_d8xEGf2d5uPprRBaD.5 2024-09-12T17:49:52.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.181+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.185+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.186+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.186+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.187+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.187+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7462285017685707698', time=2024-09-12T19:49:41.876259+0000, chain.objs.size()=1 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.187+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.113__shadow_.lwhPmBYDwJg0OadHez_Yb6lLbbEDKiH_0 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.187+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10529842489445622684', time=2024-09-12T19:49:41.886920+0000, chain.objs.size()=1 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.187+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.113__shadow_.SEVC3HWRWgaXplJftTe4uVtpy5sAB4T_0 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.187+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17741142431119929985', time=2024-09-12T19:49:43.653660+0000, chain.objs.size()=1 2024-09-12T17:49:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.187+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.119__shadow_.tRZf7DF5_AyJV_2Ff45p8GCDLTEkaE0_0 2024-09-12T17:49:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.189+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.191+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.192+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:49:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10539210973057409306', time=2024-09-12T19:49:26.834498+0000, chain.objs.size()=9 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.1 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.1_1 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.2 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.2_1 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.3 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.3_1 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.4 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.4_1 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.5 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11127439060663487335', time=2024-09-12T19:49:31.309863+0000, chain.objs.size()=7 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Bt3k6fO6TkswP4rZnNXI6PfpxbaEMP-.1 2024-09-12T17:49:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Bt3k6fO6TkswP4rZnNXI6PfpxbaEMP-.1_1 2024-09-12T17:49:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.193+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Bt3k6fO6TkswP4rZnNXI6PfpxbaEMP-.1_2 2024-09-12T17:49:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.196+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Bt3k6fO6TkswP4rZnNXI6PfpxbaEMP-.2 2024-09-12T17:49:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.197+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Bt3k6fO6TkswP4rZnNXI6PfpxbaEMP-.2_1 2024-09-12T17:49:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.197+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~Bt3k6fO6TkswP4rZnNXI6PfpxbaEMP-.2_2 2024-09-12T17:49:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.199+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~Bt3k6fO6TkswP4rZnNXI6PfpxbaEMP-.3 2024-09-12T17:49:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.199+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13417463561138187847', time=2024-09-12T19:49:42.471116+0000, chain.objs.size()=1 2024-09-12T17:49:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.199+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.115__shadow_._7OZ0Zakl0KWi36J9F-0fBprifZ3KHi_0 2024-09-12T17:49:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.199+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14682719258047418778', time=2024-09-12T19:49:46.593631+0000, chain.objs.size()=1 2024-09-12T17:49:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.199+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.129__shadow_.7FNCqp4sLKBGtNu18nxU5LqpEJ4nUUQ_0 2024-09-12T17:49:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.199+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14637167586545826730', time=2024-09-12T19:49:47.473212+0000, chain.objs.size()=1 2024-09-12T17:49:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.199+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.132__shadow_.NOz49rtSScvEBZ7wVDRJWQVHsL2k2iF_0 2024-09-12T17:49:52.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.203+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.205+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:52.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.206+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17016518259581212187', time=2024-09-12T19:49:42.482310+0000, chain.objs.size()=1 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.115__shadow_.hKC6xk6s2yZp7HnrIN5EW12eYaGfDgI_0 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3757983815282725787', time=2024-09-12T19:49:44.839059+0000, chain.objs.size()=1 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.123__shadow_.yPaQgGxWqsKpkWI0EBYgPtUhbbs4PiO_0 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2970418155675598610', time=2024-09-12T19:49:44.849287+0000, chain.objs.size()=1 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.123__shadow_.ZwRWjxaffs1rBucf4XBfV85oI0LDsIL_0 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10116976501386675695', time=2024-09-12T19:49:45.705434+0000, chain.objs.size()=1 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.126__shadow_.030OHaHNW2ZQW2O7TOvaBlXTCfrwta2_0 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11445584277713444145', time=2024-09-12T19:49:45.710651+0000, chain.objs.size()=1 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.126__shadow_._dy0oeaBV0w9vEMwoxrRr87Kug6L28J_0 2024-09-12T17:49:52.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14281119452505682187', time=2024-09-12T19:49:46.316472+0000, chain.objs.size()=1 2024-09-12T17:49:52.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.128__shadow_.yody_lNPPT5Aw2ze4kQqxwiZVO_J-EQ_0 2024-09-12T17:49:52.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10958972417566324111', time=2024-09-12T19:49:49.144462+0000, chain.objs.size()=1 2024-09-12T17:49:52.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.207+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.139__shadow_.B-h-ctOsKcxR83IpyJ_nj1HQTnVggc2_0 2024-09-12T17:49:52.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.211+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.213+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:52.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.214+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10963929699022330007', time=2024-09-12T19:49:30.896524+0000, chain.objs.size()=7 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~EoDgCuk4LAwXtiLF9uvVKCE_fcoZXGf.1 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~EoDgCuk4LAwXtiLF9uvVKCE_fcoZXGf.1_1 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~EoDgCuk4LAwXtiLF9uvVKCE_fcoZXGf.1_2 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~EoDgCuk4LAwXtiLF9uvVKCE_fcoZXGf.2 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~EoDgCuk4LAwXtiLF9uvVKCE_fcoZXGf.2_1 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~EoDgCuk4LAwXtiLF9uvVKCE_fcoZXGf.2_2 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~EoDgCuk4LAwXtiLF9uvVKCE_fcoZXGf.3 2024-09-12T17:49:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13222427937207356244', time=2024-09-12T19:49:42.775181+0000, chain.objs.size()=1 2024-09-12T17:49:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.116__shadow_._iTNPjl0nzjhNmG_ln6LsCXJvdZ0XXW_0 2024-09-12T17:49:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14273998283020585000', time=2024-09-12T19:49:44.256514+0000, chain.objs.size()=1 2024-09-12T17:49:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.215+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.121__shadow_._zj_EZd7O0fCuMMYwKqhbEkCsy-aynG_0 2024-09-12T17:49:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.216+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15606630307691492206', time=2024-09-12T19:49:51.445520+0000, chain.objs.size()=1 2024-09-12T17:49:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.216+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145__shadow_.kr7RGAl5CZ8hlVYFSSdHC7rfAuGsO96_0 2024-09-12T17:49:52.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.220+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.223+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:52.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.224+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.224+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:49:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7060673665034052132', time=2024-09-12T19:49:34.385724+0000, chain.objs.size()=9 2024-09-12T17:49:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.1 2024-09-12T17:49:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.1_1 2024-09-12T17:49:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.2 2024-09-12T17:49:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.2_1 2024-09-12T17:49:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.3 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.3_1 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.4 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.4_1 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file2.mpg.2~1xje0kc_v9V5TUr88P1zkSM_UD5lENX.5 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14751477745018235773', time=2024-09-12T19:49:45.418928+0000, chain.objs.size()=1 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.125__shadow_.ntxh0BU91iUjUe09g-2hzm3zuri1d-Y_0 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15669868623272532051', time=2024-09-12T19:49:47.189372+0000, chain.objs.size()=1 2024-09-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.225+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.131__shadow_.ThdDxd9RIHin2auMiZVcviCkHMZ3iRK_0 2024-09-12T17:49:52.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.231+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.233+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:52.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.234+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:52.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10875907473704270715', time=2024-09-12T19:49:36.060730+0000, chain.objs.size()=9 2024-09-12T17:49:52.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.1 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.1_1 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.2 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.2_1 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.3 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.3_1 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.4 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.4_1 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~OhZ-ykI6bKGD8wkiIBrXxN4TbhjGL0H.5 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9026170104661976830', time=2024-09-12T19:49:43.658879+0000, chain.objs.size()=1 2024-09-12T17:49:52.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.119__shadow_.JJTU_buP6eJloR6m-JdOGU2OIESjNW5_0 2024-09-12T17:49:52.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15757493178751688903', time=2024-09-12T19:49:44.558996+0000, chain.objs.size()=1 2024-09-12T17:49:52.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.122__shadow_.9r_OtwLX6ZU2vT_epvKw4aICUxdciLH_0 2024-09-12T17:49:52.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5303220356219090304', time=2024-09-12T19:49:47.183933+0000, chain.objs.size()=1 2024-09-12T17:49:52.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.235+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.131__shadow_.q_g4NvBsABXoQz6kA0qPx0hPmT_880y_0 2024-09-12T17:49:52.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.242+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.244+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:52.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.245+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.245+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5090893801674800661', time=2024-09-12T19:49:22.425869+0000, chain.objs.size()=1 2024-09-12T17:49:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.78__shadow_.vNtAJu-_V058YBtpawywlC0m8wikQqm_0 2024-09-12T17:49:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8885278361675723945', time=2024-09-12T19:49:31.569367+0000, chain.objs.size()=6 2024-09-12T17:49:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.94__shadow_.zILI5b8JfTE-2l3JtdS8HrIxEk08JMX_0 2024-09-12T17:49:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.94__shadow_.zILI5b8JfTE-2l3JtdS8HrIxEk08JMX_1 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.94__shadow_.zILI5b8JfTE-2l3JtdS8HrIxEk08JMX_2 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.94__shadow_.zILI5b8JfTE-2l3JtdS8HrIxEk08JMX_3 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.94__shadow_.zILI5b8JfTE-2l3JtdS8HrIxEk08JMX_4 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.94__shadow_.zILI5b8JfTE-2l3JtdS8HrIxEk08JMX_5 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10913115895490409189', time=2024-09-12T19:49:37.003088+0000, chain.objs.size()=7 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~Xnyy4OshGkvwgrb8e2WldOBJGuKntTl.1 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~Xnyy4OshGkvwgrb8e2WldOBJGuKntTl.1_1 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~Xnyy4OshGkvwgrb8e2WldOBJGuKntTl.1_2 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~Xnyy4OshGkvwgrb8e2WldOBJGuKntTl.2 2024-09-12T17:49:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.246+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~Xnyy4OshGkvwgrb8e2WldOBJGuKntTl.2_1 2024-09-12T17:49:52.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.249+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~Xnyy4OshGkvwgrb8e2WldOBJGuKntTl.2_2 2024-09-12T17:49:52.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.250+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~Xnyy4OshGkvwgrb8e2WldOBJGuKntTl.3 2024-09-12T17:49:52.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.250+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3950572063944649669', time=2024-09-12T19:49:40.356311+0000, chain.objs.size()=1 2024-09-12T17:49:52.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.250+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.107__shadow_.GDAZ34_oi272bM02fXXl7T32e_JmXkQ_0 2024-09-12T17:49:52.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.255+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.258+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:52.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.259+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:49:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15260362058219950013', time=2024-09-12T19:49:31.448072+0000, chain.objs.size()=7 2024-09-12T17:49:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~FeKRddn12W-sRsRDrTT3ZBomkRkRqJo.1 2024-09-12T17:49:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~FeKRddn12W-sRsRDrTT3ZBomkRkRqJo.1_1 2024-09-12T17:49:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~FeKRddn12W-sRsRDrTT3ZBomkRkRqJo.1_2 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~FeKRddn12W-sRsRDrTT3ZBomkRkRqJo.2 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~FeKRddn12W-sRsRDrTT3ZBomkRkRqJo.2_1 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__shadow_key1.2~FeKRddn12W-sRsRDrTT3ZBomkRkRqJo.2_2 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.95__multipart_key1.2~FeKRddn12W-sRsRDrTT3ZBomkRkRqJo.3 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14628909961968435172', time=2024-09-12T19:49:33.813815+0000, chain.objs.size()=9 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__multipart_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.1 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__shadow_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.1_1 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__multipart_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.2 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__shadow_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.2_1 2024-09-12T17:49:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.260+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__multipart_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.3 2024-09-12T17:49:52.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.265+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__shadow_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.3_1 2024-09-12T17:49:52.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.265+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__multipart_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.4 2024-09-12T17:49:52.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.265+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__shadow_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.4_1 2024-09-12T17:49:52.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.267+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.100__multipart_key1.2~SFlKR0A9Neu16CUBbyNT6zFpC7lr-vt.5 2024-09-12T17:49:52.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.267+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16723225536990225479', time=2024-09-12T19:49:43.949184+0000, chain.objs.size()=1 2024-09-12T17:49:52.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.267+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.120__shadow_._kqXD3OGzP6Ay9D5LdLMdjORrr_W71B_0 2024-09-12T17:49:52.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.267+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18046766021855282202', time=2024-09-12T19:49:46.311292+0000, chain.objs.size()=1 2024-09-12T17:49:52.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.267+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.128__shadow_.gUKrICH9YFtD_dOikAknSzxNlr8hRJF_0 2024-09-12T17:49:52.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.267+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12744472748024320581', time=2024-09-12T19:49:47.752488+0000, chain.objs.size()=1 2024-09-12T17:49:52.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.267+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.133__shadow_.l1Ys4WIEVecMEp2MwnalQH0lVqaqJbJ_0 2024-09-12T17:49:52.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.269+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4741991915630043439', time=2024-09-12T19:49:48.038032+0000, chain.objs.size()=1 2024-09-12T17:49:52.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.269+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.134__shadow_.Yz8rUbnXMdNwWIenBD57X7NxKCUCUn9_0 2024-09-12T17:49:52.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.272+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.274+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:52.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.276+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.276+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.276+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:52.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.276+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17116396650215968179', time=2024-09-12T19:49:48.733995+0000, chain.objs.size()=1 2024-09-12T17:49:52.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.276+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.137__shadow_.zXkL1mobYBi5k3V0N_3OeYYSixNRC0h_0 2024-09-12T17:49:52.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.278+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.280+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:52.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.281+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.282+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.282+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:52.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.282+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4780510054992541583', time=2024-09-12T19:49:43.670413+0000, chain.objs.size()=1 2024-09-12T17:49:52.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.282+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.119__shadow_.PF6WzoOV4GLfcNEn8EuO8LL-Das7sKY_0 2024-09-12T17:49:52.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.282+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16426930346770704639', time=2024-09-12T19:49:46.301103+0000, chain.objs.size()=1 2024-09-12T17:49:52.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.282+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.128__shadow_.H6R_kpFg_JDAQOX2RzTRmrSDAYEeV6Z_0 2024-09-12T17:49:52.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.284+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.286+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:52.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.287+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.288+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.288+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:49:52.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.288+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1963256162860219744', time=2024-09-12T19:49:43.664144+0000, chain.objs.size()=1 2024-09-12T17:49:52.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.288+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.119__shadow_.UI8Z5jN3F1sOcNYPFOMn43L515m7QgP_0 2024-09-12T17:49:52.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.288+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13313643755546766215', time=2024-09-12T19:49:45.139715+0000, chain.objs.size()=1 2024-09-12T17:49:52.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.288+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.124__shadow_.PH2ma9bt63ZIWNHvm3zihKaylnSLLcn_0 2024-09-12T17:49:52.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.294+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.296+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:52.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.297+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5316652460448320984', time=2024-09-12T19:49:34.380234+0000, chain.objs.size()=1 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_.5owKpt9vnbAJbzHtp6D00y88JkO406a_0 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12523900493972654889', time=2024-09-12T19:49:42.477039+0000, chain.objs.size()=1 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.115__shadow_.MdqhjHLY0rJU9fUEviF80Qwh4NqvkNw_0 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6245724393918865591', time=2024-09-12T19:49:42.487184+0000, chain.objs.size()=1 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.115__shadow_.kj_SkEVZtYqNO_bE6acZOLMOXZvdDpR_0 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6993068203269008050', time=2024-09-12T19:49:43.067251+0000, chain.objs.size()=1 2024-09-12T17:49:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.117__shadow_.Qx6LsiV81XncyMqwqOQx85zhevLHUh2_0 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8269631787154246638', time=2024-09-12T19:49:43.369377+0000, chain.objs.size()=1 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.118__shadow_.qKJMm8Yw9MOv5nZ5_Zqo_uAo8k3ough_0 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3554240633217075525', time=2024-09-12T19:49:43.374602+0000, chain.objs.size()=1 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.118__shadow_.-E1Xk-VZVsh55FhOkrAF3MLbKuXfrtp_0 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6160785837516469267', time=2024-09-12T19:49:46.906982+0000, chain.objs.size()=1 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.130__shadow_.LSg9Ibwxa-rdkvR4m1T2xwa9Xqd9nPq_0 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17820411682963573768', time=2024-09-12T19:49:47.478608+0000, chain.objs.size()=1 2024-09-12T17:49:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.298+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.132__shadow_.40uENRI-soCd2OBznBLO9CoObAjDI7G_0 2024-09-12T17:49:52.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.302+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.305+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:52.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.306+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.306+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:49:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14646822093595464775', time=2024-09-12T19:49:24.931811+0000, chain.objs.size()=1 2024-09-12T17:49:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.86__shadow_.LWbkOjFnp3SudYHi6WOFQuLkJSP3Hru_0 2024-09-12T17:49:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10694227060601449674', time=2024-09-12T19:49:26.954623+0000, chain.objs.size()=9 2024-09-12T17:49:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.1 2024-09-12T17:49:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.1_1 2024-09-12T17:49:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.2 2024-09-12T17:49:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.2_1 2024-09-12T17:49:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.3 2024-09-12T17:49:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.3_1 2024-09-12T17:49:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.4 2024-09-12T17:49:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__shadow_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.4_1 2024-09-12T17:49:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.92__multipart_key1.2~fu8QBHdDVX7A2XIb5SMRRjfpY9KcsV3.5 2024-09-12T17:49:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7375912117813179561', time=2024-09-12T19:49:43.061825+0000, chain.objs.size()=1 2024-09-12T17:49:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.117__shadow_.KZ_IhyyyJSRi-sm1ATYpcB7-7_pNaUb_0 2024-09-12T17:49:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15820462474803464179', time=2024-09-12T19:49:43.960018+0000, chain.objs.size()=1 2024-09-12T17:49:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.307+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.120__shadow_.2yXaHjcFTQ3ZlEW8p4lN1-onMq1Q5Y2_0 2024-09-12T17:49:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.311+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12135885389747355058', time=2024-09-12T19:49:46.604278+0000, chain.objs.size()=1 2024-09-12T17:49:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.311+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.129__shadow_.63ZehRu0pI2ttTFrlv-BNjLWYngnmlG_0 2024-09-12T17:49:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.311+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5073340802991044413', time=2024-09-12T19:49:48.043471+0000, chain.objs.size()=1 2024-09-12T17:49:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.311+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.134__shadow_.rwIx8WhtpR6217JgL_5u6iPCane_4fX_0 2024-09-12T17:49:52.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.315+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.317+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:52.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12600570950290433115', time=2024-09-12T19:49:32.647327+0000, chain.objs.size()=9 2024-09-12T17:49:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__multipart_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.1 2024-09-12T17:49:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__shadow_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.1_1 2024-09-12T17:49:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__multipart_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.2 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__shadow_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.2_1 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__multipart_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.3 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__shadow_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.3_1 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__multipart_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.4 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__shadow_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.4_1 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.99__multipart_key1.2~RoztHWslMoLz3OyQis2PoBAcJGADK04.5 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10854727058990118287', time=2024-09-12T19:49:42.173499+0000, chain.objs.size()=1 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.319+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.114__shadow_.1kSbE1mG4Mqg9CtbXSwIq_dTVHnlVtO_0 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.320+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9808963206507097878', time=2024-09-12T19:49:45.424512+0000, chain.objs.size()=1 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.320+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.125__shadow_.9jUIfkhy9vRmcfj0ZSjxJ658H4GKwbU_0 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.320+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13671782696028069200', time=2024-09-12T19:49:49.924864+0000, chain.objs.size()=1 2024-09-12T17:49:52.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.320+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.141__shadow_.ZTe8Jd-sMAXabTNzVoWohxN3wf5nwg7_0 2024-09-12T17:49:52.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.329+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.331+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:52.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.332+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2579240429680464460', time=2024-09-12T19:49:24.468105+0000, chain.objs.size()=3 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.84__shadow_._dJjffmwKCrNosG7ngAwkuG94FXiBaq_0 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.84__shadow_._dJjffmwKCrNosG7ngAwkuG94FXiBaq_1 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.84__shadow_._dJjffmwKCrNosG7ngAwkuG94FXiBaq_2 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3840228817701767929', time=2024-09-12T19:49:34.374562+0000, chain.objs.size()=9 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.1 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.1_1 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.2 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.2_1 2024-09-12T17:49:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.3 2024-09-12T17:49:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.3_1 2024-09-12T17:49:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.4 2024-09-12T17:49:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__shadow_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.4_1 2024-09-12T17:49:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.333+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101__multipart_file.mpg.2~gi8-hPYOCagjg1eWVIdF4-9wIUgWCA5.5 2024-09-12T17:49:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.336+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14983021518754938021', time=2024-09-12T19:49:43.077588+0000, chain.objs.size()=1 2024-09-12T17:49:52.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.336+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.117__shadow_.hn8n-r-LUHwOCYpBzq5yLu_FJObsW1R_0 2024-09-12T17:49:52.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.337+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5952699930641983090', time=2024-09-12T19:49:45.134688+0000, chain.objs.size()=1 2024-09-12T17:49:52.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.337+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.124__shadow_.UF7-06IPBooiMwXfQMv3F-iTjq0NWZ7_0 2024-09-12T17:49:52.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.337+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15219682191213833102', time=2024-09-12T19:49:49.096001+0000, chain.objs.size()=1 2024-09-12T17:49:52.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.337+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.139__shadow_.-yo0udQz6hEnG7dZwXEinZBcaxJiZPt_0 2024-09-12T17:49:52.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.342+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.344+0000 7fd5653af800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:52.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.345+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:49:52.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15930358175509422554', time=2024-09-12T19:49:36.864765+0000, chain.objs.size()=7 2024-09-12T17:49:52.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~C8FE_1L2rr33xsht0ga9y_LvnFBhfbq.1 2024-09-12T17:49:52.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~C8FE_1L2rr33xsht0ga9y_LvnFBhfbq.1_1 2024-09-12T17:49:52.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~C8FE_1L2rr33xsht0ga9y_LvnFBhfbq.1_2 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~C8FE_1L2rr33xsht0ga9y_LvnFBhfbq.2 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~C8FE_1L2rr33xsht0ga9y_LvnFBhfbq.2_1 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__shadow_key1.2~C8FE_1L2rr33xsht0ga9y_LvnFBhfbq.2_2 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.103__multipart_key1.2~C8FE_1L2rr33xsht0ga9y_LvnFBhfbq.3 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8735404219151659749', time=2024-09-12T19:49:43.965214+0000, chain.objs.size()=1 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.120__shadow_.ktjGGpjd-dkYorba3jqgV5PLFHSWX3W_0 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16689424670138105045', time=2024-09-12T19:49:46.016597+0000, chain.objs.size()=1 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.127__shadow_.RHy-WZvCGGEOtZ5ksjVVbTUSanWLmtK_0 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5083072800447028510', time=2024-09-12T19:49:46.306389+0000, chain.objs.size()=1 2024-09-12T17:49:52.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.346+0000 7fd5653af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.128__shadow_.mHP0-ZpTT7hplxsdjRpnN3xfVW-0SsK_0 2024-09-12T17:49:52.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.351+0000 7fd5653af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.354+0000 7fd4197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.356+0000 7fd5653af800 20 remove_watcher() i=0 2024-09-12T17:49:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.356+0000 7fd5653af800 2 removed watcher, disabling cache 2024-09-12T17:49:52.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.357+0000 7fd5653af800 20 remove_watcher() i=1 2024-09-12T17:49:52.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.358+0000 7fd5653af800 20 remove_watcher() i=2 2024-09-12T17:49:52.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.359+0000 7fd5653af800 20 remove_watcher() i=3 2024-09-12T17:49:52.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.360+0000 7fd5653af800 20 remove_watcher() i=4 2024-09-12T17:49:52.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.361+0000 7fd5653af800 20 remove_watcher() i=5 2024-09-12T17:49:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.362+0000 7fd5653af800 20 remove_watcher() i=6 2024-09-12T17:49:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.363+0000 7fd5653af800 20 remove_watcher() i=7 2024-09-12T17:49:52.375 DEBUG:teuthology.orchestra.run.smithi063:> radosgw-admin gc process --include-all 2024-09-12T17:49:52.428 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:52.428 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:52.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.466+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 20 realm 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.468+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.469+0000 7fd72d440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:52.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.469+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.469+0000 7fd72d440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:52.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.469+0000 7fd72d440800 20 searching for the correct realm 2024-09-12T17:49:52.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.472+0000 7fd72a729640 0 -- 172.21.15.63:0/4256100819 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fd72008f160 msgr2=0x7fd720099210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.678+0000 7fd72a729640 0 -- 172.21.15.63:0/4256100819 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56396d328fd0 msgr2=0x56396d32b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.682+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 zone default found 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 4 Realm: () 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 zonegroup default 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 started sync module instance, tier type = 2024-09-12T17:49:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.683+0000 7fd72d440800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.692+0000 7fd72d440800 20 add_watcher() i=0 2024-09-12T17:49:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.692+0000 7fd72d440800 20 add_watcher() i=1 2024-09-12T17:49:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.692+0000 7fd72d440800 20 add_watcher() i=2 2024-09-12T17:49:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.692+0000 7fd72d440800 20 add_watcher() i=3 2024-09-12T17:49:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.692+0000 7fd72d440800 20 add_watcher() i=4 2024-09-12T17:49:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.692+0000 7fd72d440800 20 add_watcher() i=5 2024-09-12T17:49:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.692+0000 7fd72d440800 20 add_watcher() i=6 2024-09-12T17:49:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.693+0000 7fd72d440800 20 add_watcher() i=7 2024-09-12T17:49:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.693+0000 7fd72d440800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.695+0000 7fd5e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.695+0000 7fd72d440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.695+0000 7fd72d440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:52.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.728+0000 7fd55bfff640 20 reqs_thread_entry: start 2024-09-12T17:49:52.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.728+0000 7fd72d440800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:52.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.728+0000 7fd72d440800 20 Filter name: none 2024-09-12T17:49:52.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.728+0000 7fd559ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:52.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.728+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:52.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.729+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.730+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.730+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.731+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:52.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.732+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.733+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.733+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.734+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:52.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.735+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.736+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.736+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.737+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:52.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.738+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.739+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.739+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.740+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:52.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.742+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.742+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.742+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.743+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:52.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.744+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.745+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.745+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.746+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:52.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.747+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.748+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.748+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.749+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:52.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.751+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.751+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.751+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.752+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:52.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.754+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.754+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.755+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.755+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:52.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.757+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.758+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.758+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.760+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:52.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.761+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.761+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.762+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.763+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:52.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.764+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.764+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.765+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.766+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:52.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.767+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.767+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.768+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.769+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:52.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.770+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.770+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.771+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.772+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:52.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.774+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.774+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.774+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.775+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:52.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.777+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.777+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.777+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.778+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:52.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.780+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.780+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.780+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.781+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:52.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.782+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.783+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.783+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.784+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:52.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.785+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.786+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.786+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.787+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:52.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.788+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.789+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.789+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.791+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:52.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.793+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.793+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.793+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.795+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:52.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.797+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.797+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.797+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.798+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:52.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.800+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.800+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.800+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.802+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:52.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.803+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.804+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.804+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.805+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:52.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.806+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.807+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.807+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.808+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.809+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.810+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.810+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.811+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.812+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.812+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.813+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.814+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:52.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.815+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.816+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.816+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.817+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:52.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.818+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.819+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.819+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.820+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:52.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.821+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.822+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.822+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.823+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:52.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.825+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.825+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.825+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.826+0000 7fd72d440800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:52.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.827+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.828+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.828+0000 7fd72d440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.830+0000 7fd5e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.832+0000 7fd72d440800 20 remove_watcher() i=0 2024-09-12T17:49:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.832+0000 7fd72d440800 2 removed watcher, disabling cache 2024-09-12T17:49:52.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.833+0000 7fd72d440800 20 remove_watcher() i=1 2024-09-12T17:49:52.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.834+0000 7fd72d440800 20 remove_watcher() i=2 2024-09-12T17:49:52.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.835+0000 7fd72d440800 20 remove_watcher() i=3 2024-09-12T17:49:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.836+0000 7fd72d440800 20 remove_watcher() i=4 2024-09-12T17:49:52.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.838+0000 7fd72d440800 20 remove_watcher() i=5 2024-09-12T17:49:52.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.839+0000 7fd72d440800 20 remove_watcher() i=6 2024-09-12T17:49:52.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:52.840+0000 7fd72d440800 20 remove_watcher() i=7 2024-09-12T17:49:52.852 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T17:49:52.870 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T17:49:52.870 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T17:49:52.871 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T17:49:52.871 DEBUG:teuthology.orchestra.run.smithi063:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:49:52.901 INFO:teuthology.orchestra.run.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T17:49:53.656 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T17:49:53.656 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T17:49:53.656 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key JZWDJCRRYIUYQXFDRIMW --secret uKnkp0hJrEse+CXq3CGxf+SHgAh5nGXFFzgNkUbBZ0fA/wfjqRBriw== --cluster ceph 2024-09-12T17:49:53.763 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:53.763 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:53.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.798+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.800+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.800+0000 7fdab622f800 20 realm 2024-09-12T17:49:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.800+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.800+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.800+0000 7fdab622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.800+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.801+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.801+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.801+0000 7fdab622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.801+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.802+0000 7fdab622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:53.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.802+0000 7fdab622f800 20 searching for the correct realm 2024-09-12T17:49:53.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:53.805+0000 7fdab0d8a640 0 -- 172.21.15.63:0/514773135 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fdaa80b9b60 msgr2=0x7fdaa80c65e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:54.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.212+0000 7fdab158b640 0 -- 172.21.15.63:0/514773135 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fdaac029040 msgr2=0x7fdaac018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:54.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:54.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:54.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:54.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:54.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:54.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:54.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.420+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:54.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:54.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 zone default found 2024-09-12T17:49:54.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 4 Realm: () 2024-09-12T17:49:54.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:54.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 zonegroup default 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.421+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.422+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.422+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.422+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.422+0000 7fdab622f800 20 started sync module instance, tier type = 2024-09-12T17:49:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.422+0000 7fdab622f800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.433+0000 7fdab622f800 20 add_watcher() i=0 2024-09-12T17:49:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.433+0000 7fdab622f800 20 add_watcher() i=1 2024-09-12T17:49:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.433+0000 7fdab622f800 20 add_watcher() i=2 2024-09-12T17:49:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.433+0000 7fdab622f800 20 add_watcher() i=3 2024-09-12T17:49:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.433+0000 7fdab622f800 20 add_watcher() i=4 2024-09-12T17:49:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.433+0000 7fdab622f800 20 add_watcher() i=5 2024-09-12T17:49:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.433+0000 7fdab622f800 20 add_watcher() i=6 2024-09-12T17:49:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.435+0000 7fdab622f800 20 add_watcher() i=7 2024-09-12T17:49:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.435+0000 7fdab622f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.436+0000 7fd967fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.436+0000 7fdab622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.436+0000 7fdab622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.437+0000 7fdab622f800 5 note: GC not initialized 2024-09-12T17:49:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.437+0000 7fd966fe5640 20 reqs_thread_entry: start 2024-09-12T17:49:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.437+0000 7fdab622f800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.437+0000 7fdab622f800 20 Filter name: none 2024-09-12T17:49:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.437+0000 7fd964fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.437+0000 7fdab622f800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:49:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.437+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 cache get: name=default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW : miss 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 cache put: name=default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW info.flags=0x0 2024-09-12T17:49:54.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 adding default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW to cache LRU end 2024-09-12T17:49:54.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 cache get: name=default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW : hit (negative entry) 2024-09-12T17:49:54.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.438+0000 7fdab622f800 10 cache get: name=default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW : hit (negative entry) 2024-09-12T17:49:54.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.440+0000 7fdab622f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:49:54.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.440+0000 7fdab622f800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:49:54.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.440+0000 7fdab622f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:49:54.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.440+0000 7fd994ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431697 cookie 93998757810992 notifier 9069 bl.length()=645 2024-09-12T17:49:54.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.440+0000 7fd994ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:49:54.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.440+0000 7fd994ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:49:54.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.442+0000 7fdab622f800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:49:54.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.442+0000 7fdab622f800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:49:54.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.442+0000 7fdab622f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T17:49:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.443+0000 7fd994ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431751 cookie 93998757823040 notifier 9069 bl.length()=185 2024-09-12T17:49:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.443+0000 7fd994ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:49:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.443+0000 7fd994ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:49:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.444+0000 7fdab622f800 10 cache put: name=default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW info.flags=0x7 2024-09-12T17:49:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.444+0000 7fdab622f800 10 moving default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW to cache LRU end 2024-09-12T17:49:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.444+0000 7fdab622f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:JZWDJCRRYIUYQXFDRIMW, ofs0, ns] 2024-09-12T17:49:54.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.445+0000 7fd983fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 93998757817184 notifier 9069 bl.length()=186 2024-09-12T17:49:54.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.445+0000 7fd983fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW info.flags=0x7 2024-09-12T17:49:54.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.445+0000 7fd983fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JZWDJCRRYIUYQXFDRIMW to cache LRU end 2024-09-12T17:49:54.446 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "foo.client.0", 2024-09-12T17:49:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "foo+test@test.test", 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "foo.client.0", 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "JZWDJCRRYIUYQXFDRIMW", 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "uKnkp0hJrEse+CXq3CGxf+SHgAh5nGXFFzgNkUbBZ0fA/wfjqRBriw==", 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:54.439598Z" 2024-09-12T17:49:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:49:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:54.439588Z", 2024-09-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.446+0000 7fd967fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.449+0000 7fdab622f800 20 remove_watcher() i=0 2024-09-12T17:49:54.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.449+0000 7fdab622f800 2 removed watcher, disabling cache 2024-09-12T17:49:54.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.450+0000 7fdab622f800 20 remove_watcher() i=1 2024-09-12T17:49:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.451+0000 7fdab622f800 20 remove_watcher() i=2 2024-09-12T17:49:54.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.452+0000 7fdab622f800 20 remove_watcher() i=3 2024-09-12T17:49:54.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.453+0000 7fdab622f800 20 remove_watcher() i=4 2024-09-12T17:49:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.455+0000 7fdab622f800 20 remove_watcher() i=5 2024-09-12T17:49:54.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.456+0000 7fdab622f800 20 remove_watcher() i=6 2024-09-12T17:49:54.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.457+0000 7fdab622f800 20 remove_watcher() i=7 2024-09-12T17:49:54.469 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9220391553 --totp-seed FZNXYCTQQ5FTJLSBIWOFX4NLYMLBIDGMTYYVD6SGDKXEZYXRHSG2SSI7EGSM4TXH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:49:54.539 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:54.539 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.574+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.575+0000 7f5452b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.575+0000 7f5452b2e800 20 realm 2024-09-12T17:49:54.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.575+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.575+0000 7f5452b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.575+0000 7f5452b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:54.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.576+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.576+0000 7f5452b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.576+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.576+0000 7f5452b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:54.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.576+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.577+0000 7f5452b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:54.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.577+0000 7f5452b2e800 20 searching for the correct realm 2024-09-12T17:49:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.581+0000 7f54460dc640 0 -- 172.21.15.63:0/2444354898 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5438070e90 msgr2=0x7f5438016a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.787+0000 7f544f0de640 0 -- 172.21.15.63:0/2444354898 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x56188f339e60 msgr2=0x56188f33c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:54.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:54.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:54.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:54.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:54.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:54.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:54.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.791+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 20 zone default found 2024-09-12T17:49:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 4 Realm: () 2024-09-12T17:49:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 20 zonegroup default 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.792+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.793+0000 7f5452b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.793+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.793+0000 7f5452b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.793+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.793+0000 7f5452b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.793+0000 7f5452b2e800 20 started sync module instance, tier type = 2024-09-12T17:49:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.793+0000 7f5452b2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.803+0000 7f5452b2e800 20 add_watcher() i=0 2024-09-12T17:49:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.803+0000 7f5452b2e800 20 add_watcher() i=1 2024-09-12T17:49:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.803+0000 7f5452b2e800 20 add_watcher() i=2 2024-09-12T17:49:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.803+0000 7f5452b2e800 20 add_watcher() i=3 2024-09-12T17:49:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.803+0000 7f5452b2e800 20 add_watcher() i=4 2024-09-12T17:49:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.803+0000 7f5452b2e800 20 add_watcher() i=5 2024-09-12T17:49:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.803+0000 7f5452b2e800 20 add_watcher() i=6 2024-09-12T17:49:54.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.804+0000 7f5452b2e800 20 add_watcher() i=7 2024-09-12T17:49:54.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.804+0000 7f5452b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:54.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.806+0000 7f5452b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:54.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.806+0000 7f5452b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:54.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.806+0000 7f5452b2e800 5 note: GC not initialized 2024-09-12T17:49:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.806+0000 7f53057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.806+0000 7f5277fff640 20 reqs_thread_entry: start 2024-09-12T17:49:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.806+0000 7f5452b2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f5452b2e800 20 Filter name: none 2024-09-12T17:49:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f527e7fc640 20 reqs_thread_entry: start 2024-09-12T17:49:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f5452b2e800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:49:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f5452b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f5452b2e800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:49:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f5452b2e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T17:49:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f5452b2e800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:49:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:54.807+0000 7f5452b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:56.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.047+0000 7f5452b2e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:49:56.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.048+0000 7f5452b2e800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:49:56.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.048+0000 7f5452b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:49:56.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.048+0000 7f5331ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366290 cookie 94663481737008 notifier 9087 bl.length()=659 2024-09-12T17:49:56.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.048+0000 7f5331ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:49:56.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.048+0000 7f5331ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:49:56.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.050+0000 7f53057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:56.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.053+0000 7f5452b2e800 20 remove_watcher() i=0 2024-09-12T17:49:56.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.053+0000 7f5452b2e800 2 removed watcher, disabling cache 2024-09-12T17:49:56.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.054+0000 7f5452b2e800 20 remove_watcher() i=1 2024-09-12T17:49:56.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.055+0000 7f5452b2e800 20 remove_watcher() i=2 2024-09-12T17:49:56.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.057+0000 7f5452b2e800 20 remove_watcher() i=3 2024-09-12T17:49:56.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.058+0000 7f5452b2e800 20 remove_watcher() i=4 2024-09-12T17:49:56.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.059+0000 7f5452b2e800 20 remove_watcher() i=5 2024-09-12T17:49:56.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.060+0000 7f5452b2e800 20 remove_watcher() i=6 2024-09-12T17:49:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.062+0000 7f5452b2e800 20 remove_watcher() i=7 2024-09-12T17:49:56.075 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T17:49:56.075 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key ZFWYBISXZMFKBUZLQLYD --secret xSXkwUrV9S3WtWoh+GzBZqnvDeuDLzCL91hX6jW30Hd0CnIVEsDGPw== --cluster ceph 2024-09-12T17:49:56.146 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:56.147 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:56.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.182+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.184+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.184+0000 7f9b6ad2e800 20 realm 2024-09-12T17:49:56.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.184+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.184+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.184+0000 7f9b6ad2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:56.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.184+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.185+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.185+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.185+0000 7f9b6ad2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:56.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.185+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.186+0000 7f9b6ad2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:56.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.186+0000 7f9b6ad2e800 20 searching for the correct realm 2024-09-12T17:49:56.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.190+0000 7f9b66163640 0 -- 172.21.15.63:0/1942396449 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f9b5c09a0b0 msgr2=0x7f9b5c09a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.193+0000 7f9b66964640 0 -- 172.21.15.63:0/1942396449 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f9b6000e040 msgr2=0x7f9b60031440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.197+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 zone default found 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 4 Realm: () 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 zonegroup default 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.198+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.199+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.199+0000 7f9b6ad2e800 20 started sync module instance, tier type = 2024-09-12T17:49:56.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.199+0000 7f9b6ad2e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.208+0000 7f9b6ad2e800 20 add_watcher() i=0 2024-09-12T17:49:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.208+0000 7f9b6ad2e800 20 add_watcher() i=1 2024-09-12T17:49:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.208+0000 7f9b6ad2e800 20 add_watcher() i=2 2024-09-12T17:49:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.208+0000 7f9b6ad2e800 20 add_watcher() i=3 2024-09-12T17:49:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.208+0000 7f9b6ad2e800 20 add_watcher() i=4 2024-09-12T17:49:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.208+0000 7f9b6ad2e800 20 add_watcher() i=5 2024-09-12T17:49:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.208+0000 7f9b6ad2e800 20 add_watcher() i=6 2024-09-12T17:49:56.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.209+0000 7f9b6ad2e800 20 add_watcher() i=7 2024-09-12T17:49:56.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.209+0000 7f9b6ad2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:56.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.210+0000 7f9a1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:56.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:56.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 5 note: GC not initialized 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9a1cfe1640 20 reqs_thread_entry: start 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 20 Filter name: none 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9a15ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T17:49:56.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.211+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 10 cache get: name=default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD : miss 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 10 cache put: name=default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD info.flags=0x0 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 10 adding default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD to cache LRU end 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 10 cache get: name=default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD : hit (negative entry) 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.212+0000 7f9b6ad2e800 10 cache get: name=default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD : hit (negative entry) 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.213+0000 7f9b6ad2e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.213+0000 7f9b6ad2e800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.213+0000 7f9b6ad2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.213+0000 7f9a4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366344 cookie 94800645709984 notifier 9105 bl.length()=645 2024-09-12T17:49:56.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.213+0000 7f9a4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:49:56.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.213+0000 7f9a4a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:49:56.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.215+0000 7f9b6ad2e800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:49:56.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.215+0000 7f9b6ad2e800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:49:56.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.215+0000 7f9b6ad2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T17:49:56.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.215+0000 7f9a4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366418 cookie 94800645722592 notifier 9105 bl.length()=185 2024-09-12T17:49:56.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.215+0000 7f9a4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:49:56.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.215+0000 7f9a4a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:49:56.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.217+0000 7f9b6ad2e800 10 cache put: name=default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD info.flags=0x7 2024-09-12T17:49:56.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.217+0000 7f9b6ad2e800 10 moving default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD to cache LRU end 2024-09-12T17:49:56.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.217+0000 7f9b6ad2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:ZFWYBISXZMFKBUZLQLYD, ofs0, ns] 2024-09-12T17:49:56.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.217+0000 7f9a49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366419 cookie 94800645722592 notifier 9105 bl.length()=186 2024-09-12T17:49:56.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.217+0000 7f9a49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD info.flags=0x7 2024-09-12T17:49:56.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.217+0000 7f9a49ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZFWYBISXZMFKBUZLQLYD to cache LRU end 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "bar.client.0", 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "bar+test@test.test", 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "bar.client.0", 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "ZFWYBISXZMFKBUZLQLYD", 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "xSXkwUrV9S3WtWoh+GzBZqnvDeuDLzCL91hX6jW30Hd0CnIVEsDGPw==", 2024-09-12T17:49:56.219 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:56.213368Z" 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:56.220 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:49:56.221 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:49:56.222 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:49:56.222 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:56.213353Z", 2024-09-12T17:49:56.222 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:49:56.222 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:49:56.222 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:56.222 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:56.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.219+0000 7f9a1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:56.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.221+0000 7f9b6ad2e800 20 remove_watcher() i=0 2024-09-12T17:49:56.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.221+0000 7f9b6ad2e800 2 removed watcher, disabling cache 2024-09-12T17:49:56.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.222+0000 7f9b6ad2e800 20 remove_watcher() i=1 2024-09-12T17:49:56.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.223+0000 7f9b6ad2e800 20 remove_watcher() i=2 2024-09-12T17:49:56.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.224+0000 7f9b6ad2e800 20 remove_watcher() i=3 2024-09-12T17:49:56.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.225+0000 7f9b6ad2e800 20 remove_watcher() i=4 2024-09-12T17:49:56.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.226+0000 7f9b6ad2e800 20 remove_watcher() i=5 2024-09-12T17:49:56.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.227+0000 7f9b6ad2e800 20 remove_watcher() i=6 2024-09-12T17:49:56.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.228+0000 7f9b6ad2e800 20 remove_watcher() i=7 2024-09-12T17:49:56.240 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4802971202 --totp-seed EBT3KVNNFG3JFFLHUD2IZUTFMOP2LK26KSBHUJWU2D4NGYKQ2JSGDHXSOPZXB7WM --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:49:56.307 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:56.308 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:56.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.342+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 20 realm 2024-09-12T17:49:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.344+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.345+0000 7f5f2a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:56.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.345+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.345+0000 7f5f2a00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:56.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.345+0000 7f5f2a00e800 20 searching for the correct realm 2024-09-12T17:49:56.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.349+0000 7f5f1cfbb640 0 -- 172.21.15.63:0/2074970505 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f5f10069810 msgr2=0x7f5f1009f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:56.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.554+0000 7f5f1cfbb640 0 -- 172.21.15.63:0/2074970505 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x564253f2e7a0 msgr2=0x564253f30c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.559+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 zone default found 2024-09-12T17:49:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 4 Realm: () 2024-09-12T17:49:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 zonegroup default 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.560+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.561+0000 7f5f2a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.561+0000 7f5f2a00e800 20 started sync module instance, tier type = 2024-09-12T17:49:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.561+0000 7f5f2a00e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.570+0000 7f5f2a00e800 20 add_watcher() i=0 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.570+0000 7f5f2a00e800 20 add_watcher() i=1 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.570+0000 7f5f2a00e800 20 add_watcher() i=2 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.570+0000 7f5f2a00e800 20 add_watcher() i=3 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.570+0000 7f5f2a00e800 20 add_watcher() i=4 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.570+0000 7f5f2a00e800 20 add_watcher() i=5 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.570+0000 7f5f2a00e800 20 add_watcher() i=6 2024-09-12T17:49:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.571+0000 7f5f2a00e800 20 add_watcher() i=7 2024-09-12T17:49:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.571+0000 7f5f2a00e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.572+0000 7f5ddbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.572+0000 7f5f2a00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.572+0000 7f5f2a00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.573+0000 7f5f2a00e800 5 note: GC not initialized 2024-09-12T17:49:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.573+0000 7f5ddafe5640 20 reqs_thread_entry: start 2024-09-12T17:49:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.573+0000 7f5f2a00e800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.573+0000 7f5f2a00e800 20 Filter name: none 2024-09-12T17:49:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.573+0000 7f5dd8fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.573+0000 7f5f2a00e800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:49:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.573+0000 7f5f2a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.574+0000 7f5f2a00e800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:49:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.574+0000 7f5f2a00e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T17:49:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.574+0000 7f5f2a00e800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:49:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.574+0000 7f5f2a00e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.576+0000 7f5f2a00e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:49:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.576+0000 7f5f2a00e800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:49:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.576+0000 7f5f2a00e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:49:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.577+0000 7f5e08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366345 cookie 94842876266336 notifier 8525 bl.length()=659 2024-09-12T17:49:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.577+0000 7f5e08ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:49:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.577+0000 7f5e08ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:49:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.578+0000 7f5ddbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:56.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.580+0000 7f5f2a00e800 20 remove_watcher() i=0 2024-09-12T17:49:56.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.580+0000 7f5f2a00e800 2 removed watcher, disabling cache 2024-09-12T17:49:56.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.582+0000 7f5f2a00e800 20 remove_watcher() i=1 2024-09-12T17:49:56.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.583+0000 7f5f2a00e800 20 remove_watcher() i=2 2024-09-12T17:49:56.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.584+0000 7f5f2a00e800 20 remove_watcher() i=3 2024-09-12T17:49:56.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.585+0000 7f5f2a00e800 20 remove_watcher() i=4 2024-09-12T17:49:56.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.586+0000 7f5f2a00e800 20 remove_watcher() i=5 2024-09-12T17:49:56.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.587+0000 7f5f2a00e800 20 remove_watcher() i=6 2024-09-12T17:49:56.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.588+0000 7f5f2a00e800 20 remove_watcher() i=7 2024-09-12T17:49:56.600 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T17:49:56.601 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key LEGFALZVKGGBBXNXNGYH --secret gVW7WENwyF3dKkw5K+RBaMtM+yGngb/ZfpO+asAbgZMcBqNea3niaw== --cluster ceph 2024-09-12T17:49:56.668 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:56.669 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:56.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.705+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.706+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.706+0000 7ff73f346800 20 realm 2024-09-12T17:49:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.706+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.707+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.707+0000 7ff73f346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.707+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.707+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.707+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.707+0000 7ff73f346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:56.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.707+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.708+0000 7ff73f346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:56.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.708+0000 7ff73f346800 20 searching for the correct realm 2024-09-12T17:49:56.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.710+0000 7ff73ce30640 0 -- 172.21.15.63:0/1625607703 >> [v2:172.21.15.63:6800/101797795,v1:172.21.15.63:6801/101797795] conn(0x5640cbc6efc0 msgr2=0x5640cbc713f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:56.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.713+0000 7ff73d631640 0 -- 172.21.15.63:0/1625607703 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x5640cbc6efc0 msgr2=0x7ff72c03b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:56.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:56.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:56.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:56.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:56.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:56.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:56.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.921+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:56.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:56.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 zone default found 2024-09-12T17:49:56.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 4 Realm: () 2024-09-12T17:49:56.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 zonegroup default 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.922+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.923+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.923+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.923+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.923+0000 7ff73f346800 20 started sync module instance, tier type = 2024-09-12T17:49:56.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.923+0000 7ff73f346800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:56.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.933+0000 7ff73f346800 20 add_watcher() i=0 2024-09-12T17:49:56.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.933+0000 7ff73f346800 20 add_watcher() i=1 2024-09-12T17:49:56.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.933+0000 7ff73f346800 20 add_watcher() i=2 2024-09-12T17:49:56.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.933+0000 7ff73f346800 20 add_watcher() i=3 2024-09-12T17:49:56.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.933+0000 7ff73f346800 20 add_watcher() i=4 2024-09-12T17:49:56.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.933+0000 7ff73f346800 20 add_watcher() i=5 2024-09-12T17:49:56.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.933+0000 7ff73f346800 20 add_watcher() i=6 2024-09-12T17:49:56.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.934+0000 7ff73f346800 20 add_watcher() i=7 2024-09-12T17:49:56.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.934+0000 7ff73f346800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.936+0000 7ff5f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.936+0000 7ff73f346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.936+0000 7ff73f346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.936+0000 7ff73f346800 5 note: GC not initialized 2024-09-12T17:49:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff5f27e4640 20 reqs_thread_entry: start 2024-09-12T17:49:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 20 Filter name: none 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff5ebfff640 20 reqs_thread_entry: start 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T17:49:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.937+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 10 cache get: name=default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH : miss 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 20 rados->read ofs=0 len=0 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 10 cache put: name=default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH info.flags=0x0 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 10 adding default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH to cache LRU end 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 10 cache get: name=default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH : hit (negative entry) 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.938+0000 7ff73f346800 10 cache get: name=default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH : hit (negative entry) 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.939+0000 7ff73f346800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.939+0000 7ff73f346800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:49:56.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.939+0000 7ff73f346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:49:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.940+0000 7ff613fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366420 cookie 94836296755040 notifier 9141 bl.length()=719 2024-09-12T17:49:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.940+0000 7ff613fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:49:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.940+0000 7ff613fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:49:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.941+0000 7ff73f346800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:49:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.941+0000 7ff73f346800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:49:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.941+0000 7ff73f346800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T17:49:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.942+0000 7ff613fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366421 cookie 94836296762608 notifier 9141 bl.length()=215 2024-09-12T17:49:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.942+0000 7ff613fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:49:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.942+0000 7ff613fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:49:56.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.944+0000 7ff73f346800 10 cache put: name=default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH info.flags=0x7 2024-09-12T17:49:56.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.944+0000 7ff73f346800 10 moving default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH to cache LRU end 2024-09-12T17:49:56.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.944+0000 7ff73f346800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:LEGFALZVKGGBBXNXNGYH, ofs0, ns] 2024-09-12T17:49:56.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.944+0000 7ff6137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366291 cookie 94836296716288 notifier 9141 bl.length()=201 2024-09-12T17:49:56.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.944+0000 7ff6137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH info.flags=0x7 2024-09-12T17:49:56.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.944+0000 7ff6137fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LEGFALZVKGGBBXNXNGYH to cache LRU end 2024-09-12T17:49:56.945 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "LEGFALZVKGGBBXNXNGYH", 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "gVW7WENwyF3dKkw5K+RBaMtM+yGngb/ZfpO+asAbgZMcBqNea3niaw==", 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:56.939192Z" 2024-09-12T17:49:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:49:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:56.939179Z", 2024-09-12T17:49:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:49:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:49:56.949 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:56.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.945+0000 7ff5f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:56.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.948+0000 7ff73f346800 20 remove_watcher() i=0 2024-09-12T17:49:56.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.948+0000 7ff73f346800 2 removed watcher, disabling cache 2024-09-12T17:49:56.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.949+0000 7ff73f346800 20 remove_watcher() i=1 2024-09-12T17:49:56.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.950+0000 7ff73f346800 20 remove_watcher() i=2 2024-09-12T17:49:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.951+0000 7ff73f346800 20 remove_watcher() i=3 2024-09-12T17:49:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.952+0000 7ff73f346800 20 remove_watcher() i=4 2024-09-12T17:49:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.953+0000 7ff73f346800 20 remove_watcher() i=5 2024-09-12T17:49:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.954+0000 7ff73f346800 20 remove_watcher() i=6 2024-09-12T17:49:56.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:56.955+0000 7ff73f346800 20 remove_watcher() i=7 2024-09-12T17:49:56.967 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 7797621711 --totp-seed MOWBEPGBPU55WKPUQSC545466FIHM2RQJ5ERGINN4UDWHMLX3JV5XU664DPTR5Y5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:49:57.036 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:57.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.079+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 20 realm 2024-09-12T17:49:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.081+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.082+0000 7f7800013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.082+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.082+0000 7f7800013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.083+0000 7f7800013800 20 searching for the correct realm 2024-09-12T17:49:57.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.094+0000 7f77faf47640 0 -- 172.21.15.63:0/2375248138 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f77f0084400 msgr2=0x7f77f0084880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:57.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.300+0000 7f77fbf49640 0 -- 172.21.15.63:0/2375248138 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5606140e0690 msgr2=0x5606140e2b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:57.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:57.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:57.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:57.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:57.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:57.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.304+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 zone default found 2024-09-12T17:49:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 4 Realm: () 2024-09-12T17:49:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 zonegroup default 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.305+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.306+0000 7f7800013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.306+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.306+0000 7f7800013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.306+0000 7f7800013800 20 started sync module instance, tier type = 2024-09-12T17:49:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.306+0000 7f7800013800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:57.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.315+0000 7f7800013800 20 add_watcher() i=0 2024-09-12T17:49:57.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.315+0000 7f7800013800 20 add_watcher() i=1 2024-09-12T17:49:57.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.315+0000 7f7800013800 20 add_watcher() i=2 2024-09-12T17:49:57.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.315+0000 7f7800013800 20 add_watcher() i=3 2024-09-12T17:49:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.315+0000 7f7800013800 20 add_watcher() i=4 2024-09-12T17:49:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.315+0000 7f7800013800 20 add_watcher() i=5 2024-09-12T17:49:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.315+0000 7f7800013800 20 add_watcher() i=6 2024-09-12T17:49:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.317+0000 7f7800013800 20 add_watcher() i=7 2024-09-12T17:49:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.317+0000 7f7800013800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f76b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f7800013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f7800013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f7800013800 5 note: GC not initialized 2024-09-12T17:49:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f76b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:57.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f7800013800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:57.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f7800013800 20 Filter name: none 2024-09-12T17:49:57.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f762a7fc640 20 reqs_thread_entry: start 2024-09-12T17:49:57.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f7800013800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:49:57.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.319+0000 7f7800013800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.320+0000 7f7800013800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T17:49:57.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.320+0000 7f7800013800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T17:49:57.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.320+0000 7f7800013800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:49:57.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.320+0000 7f7800013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:57.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.323+0000 7f7800013800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:49:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.323+0000 7f7800013800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:49:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.323+0000 7f7800013800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:49:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.323+0000 7f76deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333718 cookie 94584106262032 notifier 8558 bl.length()=733 2024-09-12T17:49:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.323+0000 7f76deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:49:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.323+0000 7f76deffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:49:57.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.324+0000 7f76b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:57.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.327+0000 7f7800013800 20 remove_watcher() i=0 2024-09-12T17:49:57.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.327+0000 7f7800013800 2 removed watcher, disabling cache 2024-09-12T17:49:57.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.328+0000 7f7800013800 20 remove_watcher() i=1 2024-09-12T17:49:57.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.329+0000 7f7800013800 20 remove_watcher() i=2 2024-09-12T17:49:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.330+0000 7f7800013800 20 remove_watcher() i=3 2024-09-12T17:49:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.331+0000 7f7800013800 20 remove_watcher() i=4 2024-09-12T17:49:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.332+0000 7f7800013800 20 remove_watcher() i=5 2024-09-12T17:49:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.333+0000 7f7800013800 20 remove_watcher() i=6 2024-09-12T17:49:57.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.334+0000 7f7800013800 20 remove_watcher() i=7 2024-09-12T17:49:57.347 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T17:49:57.347 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key MAGGXRIKPDHOPKVOXFAN --secret pkwqHETXT8uXnAWJsvgW7pHWhLPiN3zpnWSLIV/pBVnI4IjM7IRTig== --cluster ceph 2024-09-12T17:49:57.413 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:57.413 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:57.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.448+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.449+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.449+0000 7f940d142800 20 realm 2024-09-12T17:49:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.449+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.450+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.450+0000 7f940d142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.450+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.450+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.450+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.451+0000 7f940d142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.451+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.451+0000 7f940d142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.451+0000 7f940d142800 20 searching for the correct realm 2024-09-12T17:49:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.454+0000 7f9403fff640 0 -- 172.21.15.63:0/3343322801 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f93f40a1120 msgr2=0x7f93f40d49f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:57.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.458+0000 7f9403fff640 0 -- 172.21.15.63:0/3343322801 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x561e069fb140 msgr2=0x561e069fd530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.462+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 zone default found 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 4 Realm: () 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 zonegroup default 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.463+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.464+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.464+0000 7f940d142800 20 started sync module instance, tier type = 2024-09-12T17:49:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.464+0000 7f940d142800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:57.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.472+0000 7f940d142800 20 add_watcher() i=0 2024-09-12T17:49:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.472+0000 7f940d142800 20 add_watcher() i=1 2024-09-12T17:49:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.472+0000 7f940d142800 20 add_watcher() i=2 2024-09-12T17:49:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.472+0000 7f940d142800 20 add_watcher() i=3 2024-09-12T17:49:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.472+0000 7f940d142800 20 add_watcher() i=4 2024-09-12T17:49:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.472+0000 7f940d142800 20 add_watcher() i=5 2024-09-12T17:49:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.472+0000 7f940d142800 20 add_watcher() i=6 2024-09-12T17:49:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.473+0000 7f940d142800 20 add_watcher() i=7 2024-09-12T17:49:57.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.473+0000 7f940d142800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.474+0000 7f92befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.474+0000 7f940d142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.474+0000 7f940d142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.474+0000 7f940d142800 5 note: GC not initialized 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f92bdfe3640 20 reqs_thread_entry: start 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 20 Filter name: none 2024-09-12T17:49:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f922f7fe640 20 reqs_thread_entry: start 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.475+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 10 cache get: name=default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN : miss 2024-09-12T17:49:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 10 cache put: name=default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN info.flags=0x0 2024-09-12T17:49:57.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 10 adding default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN to cache LRU end 2024-09-12T17:49:57.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 10 cache get: name=default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN : hit (negative entry) 2024-09-12T17:49:57.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.476+0000 7f940d142800 10 cache get: name=default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN : hit (negative entry) 2024-09-12T17:49:57.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.477+0000 7f940d142800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:49:57.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.477+0000 7f940d142800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:57.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.477+0000 7f940d142800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:49:57.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.477+0000 7f92dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333719 cookie 94686960205344 notifier 9180 bl.length()=660 2024-09-12T17:49:57.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.477+0000 7f92dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:49:57.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.477+0000 7f92dffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:57.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.479+0000 7f940d142800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:49:57.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.479+0000 7f940d142800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:49:57.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.479+0000 7f940d142800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T17:49:57.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.479+0000 7f92dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333642 cookie 94686960142624 notifier 9180 bl.length()=191 2024-09-12T17:49:57.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.479+0000 7f92dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:49:57.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.479+0000 7f92dffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:49:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.481+0000 7f940d142800 10 cache put: name=default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN info.flags=0x7 2024-09-12T17:49:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.481+0000 7f940d142800 10 moving default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN to cache LRU end 2024-09-12T17:49:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.481+0000 7f940d142800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:MAGGXRIKPDHOPKVOXFAN, ofs0, ns] 2024-09-12T17:49:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.481+0000 7f92df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333720 cookie 94686960201376 notifier 9180 bl.length()=189 2024-09-12T17:49:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.481+0000 7f92df7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN info.flags=0x7 2024-09-12T17:49:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.481+0000 7f92df7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MAGGXRIKPDHOPKVOXFAN to cache LRU end 2024-09-12T17:49:57.482 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "foobar.client.0", 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "foobar+test@test.test", 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "foobar.client.0", 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "MAGGXRIKPDHOPKVOXFAN", 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "pkwqHETXT8uXnAWJsvgW7pHWhLPiN3zpnWSLIV/pBVnI4IjM7IRTig==", 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:57.477261Z" 2024-09-12T17:49:57.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:57.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:49:57.485 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:57.477250Z", 2024-09-12T17:49:57.486 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:49:57.486 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:49:57.486 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:57.486 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.482+0000 7f92befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.484+0000 7f940d142800 20 remove_watcher() i=0 2024-09-12T17:49:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.484+0000 7f940d142800 2 removed watcher, disabling cache 2024-09-12T17:49:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.485+0000 7f940d142800 20 remove_watcher() i=1 2024-09-12T17:49:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.486+0000 7f940d142800 20 remove_watcher() i=2 2024-09-12T17:49:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.487+0000 7f940d142800 20 remove_watcher() i=3 2024-09-12T17:49:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.488+0000 7f940d142800 20 remove_watcher() i=4 2024-09-12T17:49:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.489+0000 7f940d142800 20 remove_watcher() i=5 2024-09-12T17:49:57.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.490+0000 7f940d142800 20 remove_watcher() i=6 2024-09-12T17:49:57.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.491+0000 7f940d142800 20 remove_watcher() i=7 2024-09-12T17:49:57.503 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 1562311942 --totp-seed WK6Z25TNJMAVTQZDLQ3DWHI5DJ4HDC5SI5HWI6Q4G6FZISWXGW3XL2R7G2FRYJQT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:49:57.572 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:57.573 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.607+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.608+0000 7f774133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.608+0000 7f774133d800 20 realm 2024-09-12T17:49:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.608+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.608+0000 7f774133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.608+0000 7f774133d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.608+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.609+0000 7f774133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.609+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.609+0000 7f774133d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.609+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.610+0000 7f774133d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.610+0000 7f774133d800 20 searching for the correct realm 2024-09-12T17:49:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.613+0000 7f773c829640 0 -- 172.21.15.63:0/1810230546 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f773406d400 msgr2=0x7f773406d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:57.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.819+0000 7f773d82b640 0 -- 172.21.15.63:0/1810230546 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55aeff3bd450 msgr2=0x55aeff3bf8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:57.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:57.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:57.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:57.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:57.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:57.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:57.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:57.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.823+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:57.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 zone default found 2024-09-12T17:49:57.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 4 Realm: () 2024-09-12T17:49:57.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:57.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 zonegroup default 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.824+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.825+0000 7f774133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.825+0000 7f774133d800 20 started sync module instance, tier type = 2024-09-12T17:49:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.825+0000 7f774133d800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:57.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=0 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=1 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=2 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=3 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=4 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=5 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=6 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 20 add_watcher() i=7 2024-09-12T17:49:57.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.834+0000 7f774133d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:57.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.836+0000 7f75f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:57.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.836+0000 7f774133d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:57.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.836+0000 7f774133d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:57.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.836+0000 7f774133d800 5 note: GC not initialized 2024-09-12T17:49:57.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.836+0000 7f75f2fe5640 20 reqs_thread_entry: start 2024-09-12T17:49:57.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.836+0000 7f774133d800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:57.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.836+0000 7f774133d800 20 Filter name: none 2024-09-12T17:49:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.837+0000 7f75f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.837+0000 7f774133d800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:49:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.837+0000 7f774133d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.837+0000 7f774133d800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T17:49:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.837+0000 7f774133d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:49:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.837+0000 7f774133d800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.837+0000 7f774133d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:57.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.840+0000 7f774133d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:49:57.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.840+0000 7f774133d800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:57.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.840+0000 7f774133d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:49:57.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.840+0000 7f7620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333721 cookie 94210094853600 notifier 8591 bl.length()=674 2024-09-12T17:49:57.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.840+0000 7f7620ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:49:57.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.840+0000 7f7620ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:57.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.841+0000 7f75f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.843+0000 7f774133d800 20 remove_watcher() i=0 2024-09-12T17:49:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.843+0000 7f774133d800 2 removed watcher, disabling cache 2024-09-12T17:49:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.844+0000 7f774133d800 20 remove_watcher() i=1 2024-09-12T17:49:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.845+0000 7f774133d800 20 remove_watcher() i=2 2024-09-12T17:49:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.846+0000 7f774133d800 20 remove_watcher() i=3 2024-09-12T17:49:57.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.847+0000 7f774133d800 20 remove_watcher() i=4 2024-09-12T17:49:57.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.848+0000 7f774133d800 20 remove_watcher() i=5 2024-09-12T17:49:57.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.849+0000 7f774133d800 20 remove_watcher() i=6 2024-09-12T17:49:57.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.850+0000 7f774133d800 20 remove_watcher() i=7 2024-09-12T17:49:57.863 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T17:49:57.922 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:57.923 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.957+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.958+0000 7f118dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.958+0000 7f118dcbb800 20 realm 2024-09-12T17:49:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.958+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.959+0000 7f118dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.959+0000 7f118dcbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.959+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.959+0000 7f118dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.959+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.960+0000 7f118dcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.960+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.960+0000 7f118dcbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.960+0000 7f118dcbb800 20 searching for the correct realm 2024-09-12T17:49:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:57.963+0000 7f118afa4640 0 -- 172.21.15.63:0/2364494596 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f117406c920 msgr2=0x7f1174087400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:58.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.169+0000 7f118bfa6640 0 -- 172.21.15.63:0/2364494596 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x556bc59f8b60 msgr2=0x556bc59fb020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.173+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:58.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 zone default found 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 4 Realm: () 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 zonegroup default 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.174+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.175+0000 7f118dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.175+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.175+0000 7f118dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.175+0000 7f118dcbb800 20 started sync module instance, tier type = 2024-09-12T17:49:58.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.175+0000 7f118dcbb800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=0 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=1 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=2 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=3 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=4 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=5 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=6 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 20 add_watcher() i=7 2024-09-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.184+0000 7f118dcbb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:58.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f1041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f118dcbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f118dcbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f118dcbb800 5 note: GC not initialized 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f1040fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f118dcbb800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f118dcbb800 20 Filter name: none 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.186+0000 7f0fba7fc640 20 reqs_thread_entry: start 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.187+0000 7f118dcbb800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:49:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.187+0000 7f118dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.187+0000 7f118dcbb800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:49:58.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.187+0000 7f118dcbb800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:49:58.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.187+0000 7f118dcbb800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:58.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.187+0000 7f118dcbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.188+0000 7f118dcbb800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.188+0000 7f118dcbb800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.188+0000 7f118dcbb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.189+0000 7f106effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333722 cookie 93921365501296 notifier 9216 bl.length()=727 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.189+0000 7f106effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.189+0000 7f106effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "foobar.client.0", 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:49:58.190 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "foobar+test@test.test", 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "foobar.client.0", 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "MAGGXRIKPDHOPKVOXFAN", 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "pkwqHETXT8uXnAWJsvgW7pHWhLPiN3zpnWSLIV/pBVnI4IjM7IRTig==", 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:57.477261Z" 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:58.191 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [ 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "oidc-provider", 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: "perm": "*" 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "roles", 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: "perm": "*" 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "user-policy", 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: "perm": "*" 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:58.192 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:49:58.193 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "rgw", 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [ 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "1562311942" 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "", 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:49:58.194 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:57.477250Z", 2024-09-12T17:49:58.195 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:49:58.195 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:49:58.195 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:58.195 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:58.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.190+0000 7f1041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.192+0000 7f118dcbb800 20 remove_watcher() i=0 2024-09-12T17:49:58.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.192+0000 7f118dcbb800 2 removed watcher, disabling cache 2024-09-12T17:49:58.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.193+0000 7f118dcbb800 20 remove_watcher() i=1 2024-09-12T17:49:58.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.194+0000 7f118dcbb800 20 remove_watcher() i=2 2024-09-12T17:49:58.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.195+0000 7f118dcbb800 20 remove_watcher() i=3 2024-09-12T17:49:58.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.196+0000 7f118dcbb800 20 remove_watcher() i=4 2024-09-12T17:49:58.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.197+0000 7f118dcbb800 20 remove_watcher() i=5 2024-09-12T17:49:58.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.198+0000 7f118dcbb800 20 remove_watcher() i=6 2024-09-12T17:49:58.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.199+0000 7f118dcbb800 20 remove_watcher() i=7 2024-09-12T17:49:58.211 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T17:49:58.272 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:58.272 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:58.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.307+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 20 realm 2024-09-12T17:49:58.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:58.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.309+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.310+0000 7f223e715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.310+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.310+0000 7f223e715800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:58.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.310+0000 7f223e715800 20 searching for the correct realm 2024-09-12T17:49:58.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.313+0000 7f223b9fe640 0 -- 172.21.15.63:0/1653063373 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f22300ad150 msgr2=0x7f2230071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:58.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.519+0000 7f223ca00640 0 -- 172.21.15.63:0/1653063373 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55dfbc2a67a0 msgr2=0x55dfbc2a8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:58.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.523+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:58.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 zone default found 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 4 Realm: () 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 zonegroup default 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.524+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.525+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.525+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.525+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.525+0000 7f223e715800 20 started sync module instance, tier type = 2024-09-12T17:49:58.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.525+0000 7f223e715800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=0 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=1 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=2 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=3 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=4 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=5 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=6 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 20 add_watcher() i=7 2024-09-12T17:49:58.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.534+0000 7f223e715800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:58.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.536+0000 7f20f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.536+0000 7f223e715800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:58.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.536+0000 7f223e715800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:58.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.536+0000 7f223e715800 5 note: GC not initialized 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.536+0000 7f20f1fdb640 20 reqs_thread_entry: start 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.536+0000 7f223e715800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 20 Filter name: none 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f20637fe640 20 reqs_thread_entry: start 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T17:49:58.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:49:58.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.537+0000 7f223e715800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T17:49:58.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.539+0000 7f223e715800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:49:58.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.539+0000 7f223e715800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:49:58.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.539+0000 7f223e715800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T17:49:58.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.539+0000 7f21137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333643 cookie 94419422970272 notifier 8624 bl.length()=384 2024-09-12T17:49:58.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.539+0000 7f21137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:49:58.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.539+0000 7f21137fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:49:58.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.541+0000 7f223e715800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:49:58.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.541+0000 7f223e715800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:49:58.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.541+0000 7f223e715800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T17:49:58.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.541+0000 7f21137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333644 cookie 94419423026384 notifier 8624 bl.length()=225 2024-09-12T17:49:58.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.541+0000 7f21137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:49:58.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.541+0000 7f21137fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:49:58.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.543+0000 7f223e715800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:49:58.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.543+0000 7f223e715800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:49:58.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.543+0000 7f223e715800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T17:49:58.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.543+0000 7f2112ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333573 cookie 94419423022304 notifier 8624 bl.length()=234 2024-09-12T17:49:58.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.543+0000 7f2112ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:49:58.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.543+0000 7f2112ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:49:58.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.544+0000 7f20f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.546+0000 7f223e715800 20 remove_watcher() i=0 2024-09-12T17:49:58.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.546+0000 7f223e715800 2 removed watcher, disabling cache 2024-09-12T17:49:58.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.548+0000 7f223e715800 20 remove_watcher() i=1 2024-09-12T17:49:58.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.549+0000 7f223e715800 20 remove_watcher() i=2 2024-09-12T17:49:58.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.550+0000 7f223e715800 20 remove_watcher() i=3 2024-09-12T17:49:58.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.551+0000 7f223e715800 20 remove_watcher() i=4 2024-09-12T17:49:58.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.552+0000 7f223e715800 20 remove_watcher() i=5 2024-09-12T17:49:58.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.552+0000 7f223e715800 20 remove_watcher() i=6 2024-09-12T17:49:58.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.553+0000 7f223e715800 20 remove_watcher() i=7 2024-09-12T17:49:58.564 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: "id": "RGW88888888888888888", 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "tenant": "", 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_users": 1000, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_roles": 1000, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_groups": 1000, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_access_keys": 4 2024-09-12T17:49:58.566 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:58.567 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T17:49:58.568 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key FYZGKVKEUQWTEQMSZGFV --secret bGQTVgYogxFrNUiGg644w2H3cC4c0VAz9r8CUJ5A9iO2bLOz9yEzog== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T17:49:58.636 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:58.636 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:58.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.671+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.673+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.673+0000 7f308b575800 20 realm 2024-09-12T17:49:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.673+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.673+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.673+0000 7f308b575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.673+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.674+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.674+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.674+0000 7f308b575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.674+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.675+0000 7f308b575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.675+0000 7f308b575800 20 searching for the correct realm 2024-09-12T17:49:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.678+0000 7f3088865640 0 -- 172.21.15.63:0/316940075 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f308006b020 msgr2=0x7f30800a3c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:58.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.682+0000 7f3089867640 0 -- 172.21.15.63:0/316940075 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x564e891b3a80 msgr2=0x564e891b5f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.686+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:58.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 20 zone default found 2024-09-12T17:49:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 4 Realm: () 2024-09-12T17:49:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 20 zonegroup default 2024-09-12T17:49:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.687+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.688+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.688+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.688+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.688+0000 7f308b575800 20 started sync module instance, tier type = 2024-09-12T17:49:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.688+0000 7f308b575800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.696+0000 7f308b575800 20 add_watcher() i=0 2024-09-12T17:49:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.696+0000 7f308b575800 20 add_watcher() i=1 2024-09-12T17:49:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.696+0000 7f308b575800 20 add_watcher() i=2 2024-09-12T17:49:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.696+0000 7f308b575800 20 add_watcher() i=3 2024-09-12T17:49:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.696+0000 7f308b575800 20 add_watcher() i=4 2024-09-12T17:49:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.696+0000 7f308b575800 20 add_watcher() i=5 2024-09-12T17:49:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.696+0000 7f308b575800 20 add_watcher() i=6 2024-09-12T17:49:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.697+0000 7f308b575800 20 add_watcher() i=7 2024-09-12T17:49:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.697+0000 7f308b575800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f2f3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f308b575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f308b575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f308b575800 5 note: GC not initialized 2024-09-12T17:49:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f2f3efe5640 20 reqs_thread_entry: start 2024-09-12T17:49:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f308b575800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f308b575800 20 Filter name: none 2024-09-12T17:49:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f2f3cfe1640 20 reqs_thread_entry: start 2024-09-12T17:49:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f308b575800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:49:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.699+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T17:49:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:49:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 cache get: name=default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV : miss 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 cache put: name=default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV info.flags=0x0 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 adding default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV to cache LRU end 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.700+0000 7f308b575800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.701+0000 7f308b575800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:49:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.701+0000 7f308b575800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:49:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.701+0000 7f308b575800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:49:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.701+0000 7f308b575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.701+0000 7f308b575800 10 cache get: name=default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV : hit (negative entry) 2024-09-12T17:49:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.701+0000 7f308b575800 10 cache get: name=default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV : hit (negative entry) 2024-09-12T17:49:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.702+0000 7f308b575800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:49:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.702+0000 7f308b575800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:49:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.702+0000 7f308b575800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:49:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.703+0000 7f2f6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333645 cookie 94895307754096 notifier 9252 bl.length()=681 2024-09-12T17:49:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.703+0000 7f2f6cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:49:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.703+0000 7f2f6cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:49:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.704+0000 7f308b575800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:49:58.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.704+0000 7f308b575800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:49:58.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.704+0000 7f308b575800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T17:49:58.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.705+0000 7f2f5bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333723 cookie 94895307761744 notifier 9252 bl.length()=189 2024-09-12T17:49:58.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.705+0000 7f2f5bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:49:58.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.705+0000 7f2f5bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:49:58.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.706+0000 7f308b575800 10 cache put: name=default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV info.flags=0x7 2024-09-12T17:49:58.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.706+0000 7f308b575800 10 moving default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV to cache LRU end 2024-09-12T17:49:58.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.706+0000 7f308b575800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:FYZGKVKEUQWTEQMSZGFV, ofs0, ns] 2024-09-12T17:49:58.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.706+0000 7f2f5bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333724 cookie 94895307769392 notifier 9252 bl.length()=188 2024-09-12T17:49:58.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.706+0000 7f2f5bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV info.flags=0x7 2024-09-12T17:49:58.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.706+0000 7f2f5bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FYZGKVKEUQWTEQMSZGFV to cache LRU end 2024-09-12T17:49:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.708+0000 7f308b575800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T17:49:58.709 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "root1.client.0", 2024-09-12T17:49:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T17:49:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "root1+test@test.test", 2024-09-12T17:49:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "root1.client.0", 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "FYZGKVKEUQWTEQMSZGFV", 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "bGQTVgYogxFrNUiGg644w2H3cC4c0VAz9r8CUJ5A9iO2bLOz9yEzog==", 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:58.702239Z" 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:49:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "root", 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "RGW88888888888888888", 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:49:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:58.702224Z", 2024-09-12T17:49:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:49:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:49:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:58.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.709+0000 7f2f3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.711+0000 7f308b575800 20 remove_watcher() i=0 2024-09-12T17:49:58.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.711+0000 7f308b575800 2 removed watcher, disabling cache 2024-09-12T17:49:58.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.712+0000 7f308b575800 20 remove_watcher() i=1 2024-09-12T17:49:58.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.713+0000 7f308b575800 20 remove_watcher() i=2 2024-09-12T17:49:58.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.714+0000 7f308b575800 20 remove_watcher() i=3 2024-09-12T17:49:58.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.715+0000 7f308b575800 20 remove_watcher() i=4 2024-09-12T17:49:58.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.716+0000 7f308b575800 20 remove_watcher() i=5 2024-09-12T17:49:58.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.717+0000 7f308b575800 20 remove_watcher() i=6 2024-09-12T17:49:58.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.718+0000 7f308b575800 20 remove_watcher() i=7 2024-09-12T17:49:58.729 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 4806790636 --totp-seed H7CVHTS7UU5O26G4PFTYZM5CZKHAK5NRZNOGPVCTUNX65CNC2XP5JO4TXYIC24Z5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:49:58.797 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:58.798 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:58.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.837+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 20 realm 2024-09-12T17:49:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.839+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.840+0000 7f1efd40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.840+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.840+0000 7f1efd40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.840+0000 7f1efd40e800 20 searching for the correct realm 2024-09-12T17:49:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.844+0000 7f1ef036a640 0 -- 172.21.15.63:0/2421837163 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f1ee009a620 msgr2=0x7f1ee00e75f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:58.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.847+0000 7f1ef8b6b640 0 -- 172.21.15.63:0/2421837163 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f1ef4027040 msgr2=0x7f1ef4027420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.851+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 zone default found 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 4 Realm: () 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 zonegroup default 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 started sync module instance, tier type = 2024-09-12T17:49:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.852+0000 7f1efd40e800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.861+0000 7f1efd40e800 20 add_watcher() i=0 2024-09-12T17:49:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.861+0000 7f1efd40e800 20 add_watcher() i=1 2024-09-12T17:49:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.861+0000 7f1efd40e800 20 add_watcher() i=2 2024-09-12T17:49:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.861+0000 7f1efd40e800 20 add_watcher() i=3 2024-09-12T17:49:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.861+0000 7f1efd40e800 20 add_watcher() i=4 2024-09-12T17:49:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.861+0000 7f1efd40e800 20 add_watcher() i=5 2024-09-12T17:49:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.861+0000 7f1efd40e800 20 add_watcher() i=6 2024-09-12T17:49:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.862+0000 7f1efd40e800 20 add_watcher() i=7 2024-09-12T17:49:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.862+0000 7f1efd40e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.863+0000 7f1daf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1efd40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1efd40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1efd40e800 5 note: GC not initialized 2024-09-12T17:49:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1dae7e4640 20 reqs_thread_entry: start 2024-09-12T17:49:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1efd40e800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1efd40e800 20 Filter name: none 2024-09-12T17:49:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1da77fe640 20 reqs_thread_entry: start 2024-09-12T17:49:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1efd40e800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:49:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.864+0000 7f1efd40e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.865+0000 7f1efd40e800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:49:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.865+0000 7f1efd40e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T17:49:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.865+0000 7f1efd40e800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:49:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.865+0000 7f1efd40e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:58.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.867+0000 7f1efd40e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:49:58.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.867+0000 7f1efd40e800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:49:58.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.867+0000 7f1efd40e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:49:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.868+0000 7f1dcffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333646 cookie 94901902372176 notifier 9270 bl.length()=695 2024-09-12T17:49:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.868+0000 7f1dcffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:49:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.868+0000 7f1dcffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:49:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.869+0000 7f1daf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:58.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.871+0000 7f1efd40e800 20 remove_watcher() i=0 2024-09-12T17:49:58.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.871+0000 7f1efd40e800 2 removed watcher, disabling cache 2024-09-12T17:49:58.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.872+0000 7f1efd40e800 20 remove_watcher() i=1 2024-09-12T17:49:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.873+0000 7f1efd40e800 20 remove_watcher() i=2 2024-09-12T17:49:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.874+0000 7f1efd40e800 20 remove_watcher() i=3 2024-09-12T17:49:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.876+0000 7f1efd40e800 20 remove_watcher() i=4 2024-09-12T17:49:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.877+0000 7f1efd40e800 20 remove_watcher() i=5 2024-09-12T17:49:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.877+0000 7f1efd40e800 20 remove_watcher() i=6 2024-09-12T17:49:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.878+0000 7f1efd40e800 20 remove_watcher() i=7 2024-09-12T17:49:58.891 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T17:49:58.953 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:58.953 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:58.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.988+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.989+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.989+0000 7fae5e611800 20 realm 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.989+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.989+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.989+0000 7fae5e611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.989+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.990+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.990+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.990+0000 7fae5e611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:58.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.990+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:58.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.991+0000 7fae5e611800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:58.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.991+0000 7fae5e611800 20 searching for the correct realm 2024-09-12T17:49:58.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:58.994+0000 7fae59591640 0 -- 172.21.15.63:0/181993772 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fae5004c2a0 msgr2=0x7fae50048980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:59.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.200+0000 7fae5a593640 0 -- 172.21.15.63:0/181993772 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5617a2c48760 msgr2=0x5617a2c4abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:59.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:59.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:59.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.204+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:59.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 zone default found 2024-09-12T17:49:59.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 4 Realm: () 2024-09-12T17:49:59.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:59.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 zonegroup default 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.205+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.206+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.206+0000 7fae5e611800 20 started sync module instance, tier type = 2024-09-12T17:49:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.206+0000 7fae5e611800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.214+0000 7fae5e611800 20 add_watcher() i=0 2024-09-12T17:49:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.214+0000 7fae5e611800 20 add_watcher() i=1 2024-09-12T17:49:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.214+0000 7fae5e611800 20 add_watcher() i=2 2024-09-12T17:49:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.214+0000 7fae5e611800 20 add_watcher() i=3 2024-09-12T17:49:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.214+0000 7fae5e611800 20 add_watcher() i=4 2024-09-12T17:49:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.214+0000 7fae5e611800 20 add_watcher() i=5 2024-09-12T17:49:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.214+0000 7fae5e611800 20 add_watcher() i=6 2024-09-12T17:49:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.215+0000 7fae5e611800 20 add_watcher() i=7 2024-09-12T17:49:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.215+0000 7fae5e611800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.217+0000 7fad0bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.217+0000 7fae5e611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.217+0000 7fae5e611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.217+0000 7fae5e611800 5 note: GC not initialized 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.217+0000 7fad0affd640 20 reqs_thread_entry: start 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 20 Filter name: none 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fad08ff9640 20 reqs_thread_entry: start 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T17:49:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T17:49:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:49:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T17:49:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T17:49:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.218+0000 7fae5e611800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.219+0000 7fae5e611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.219+0000 7fae5e611800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T17:49:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.219+0000 7fae5e611800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:49:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.219+0000 7fae5e611800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T17:49:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.220+0000 7fae5e611800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.220+0000 7fae5e611800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.220+0000 7fae5e611800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.220+0000 7fad3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333647 cookie 94659515077168 notifier 9288 bl.length()=384 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.220+0000 7fad3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.220+0000 7fad3d7fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.222+0000 7fae5e611800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.222+0000 7fae5e611800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.222+0000 7fae5e611800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T17:49:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.222+0000 7fad3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333648 cookie 94659515086224 notifier 9288 bl.length()=225 2024-09-12T17:49:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.222+0000 7fad3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:49:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.222+0000 7fad3d7fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:49:59.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.223+0000 7fae5e611800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:49:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.223+0000 7fae5e611800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:49:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.223+0000 7fae5e611800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T17:49:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.224+0000 7fad3cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333574 cookie 94659515082208 notifier 9288 bl.length()=234 2024-09-12T17:49:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.224+0000 7fad3cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:49:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.224+0000 7fad3cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:49:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.225+0000 7fad0bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.227+0000 7fae5e611800 20 remove_watcher() i=0 2024-09-12T17:49:59.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.227+0000 7fae5e611800 2 removed watcher, disabling cache 2024-09-12T17:49:59.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.229+0000 7fae5e611800 20 remove_watcher() i=1 2024-09-12T17:49:59.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.230+0000 7fae5e611800 20 remove_watcher() i=2 2024-09-12T17:49:59.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.231+0000 7fae5e611800 20 remove_watcher() i=3 2024-09-12T17:49:59.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.232+0000 7fae5e611800 20 remove_watcher() i=4 2024-09-12T17:49:59.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.233+0000 7fae5e611800 20 remove_watcher() i=5 2024-09-12T17:49:59.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.235+0000 7fae5e611800 20 remove_watcher() i=6 2024-09-12T17:49:59.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.236+0000 7fae5e611800 20 remove_watcher() i=7 2024-09-12T17:49:59.246 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: "id": "RGW99999999999999999", 2024-09-12T17:49:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: "tenant": "", 2024-09-12T17:49:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T17:49:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T17:49:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2024-09-12T17:49:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_users": 1000, 2024-09-12T17:49:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max_roles": 1000, 2024-09-12T17:49:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max_groups": 1000, 2024-09-12T17:49:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max_access_keys": 4 2024-09-12T17:49:59.248 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:59.249 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T17:49:59.249 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key CFGMHTREYHCLWXLPMHVO --secret VvVutEvZ+yihI/tNrKdYWLR40A1XRQ5AacTbAfx5gRYZu7I3S7eU+w== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T17:49:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.353+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 20 realm 2024-09-12T17:49:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.354+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.355+0000 7ff177614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.355+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.355+0000 7ff177614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.355+0000 7ff177614800 20 searching for the correct realm 2024-09-12T17:49:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.358+0000 7ff1724ca640 0 -- 172.21.15.63:0/2558696478 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7ff15c037060 msgr2=0x7ff15c06a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:59.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.563+0000 7ff1734cc640 0 -- 172.21.15.63:0/2558696478 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x5622838a7dc0 msgr2=0x5622838aa210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.567+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:59.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 zone default found 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 4 Realm: () 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 zonegroup default 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.568+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.569+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.569+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.569+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.569+0000 7ff177614800 20 started sync module instance, tier type = 2024-09-12T17:49:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.569+0000 7ff177614800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:59.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=0 2024-09-12T17:49:59.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=1 2024-09-12T17:49:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=2 2024-09-12T17:49:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=3 2024-09-12T17:49:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=4 2024-09-12T17:49:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=5 2024-09-12T17:49:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=6 2024-09-12T17:49:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 20 add_watcher() i=7 2024-09-12T17:49:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.580+0000 7ff177614800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:59.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.583+0000 7ff0297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.583+0000 7ff177614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:59.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.583+0000 7ff177614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:59.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.583+0000 7ff177614800 5 note: GC not initialized 2024-09-12T17:49:59.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.583+0000 7fefa3fff640 20 reqs_thread_entry: start 2024-09-12T17:49:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.583+0000 7ff177614800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.583+0000 7ff177614800 20 Filter name: none 2024-09-12T17:49:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7fefa1ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:49:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 10 cache get: name=default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO : miss 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.584+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 cache put: name=default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO info.flags=0x0 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 adding default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO to cache LRU end 2024-09-12T17:49:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 cache get: name=default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO : hit (negative entry) 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.585+0000 7ff177614800 10 cache get: name=default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO : hit (negative entry) 2024-09-12T17:49:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.587+0000 7ff177614800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:49:59.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.587+0000 7ff177614800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:49:59.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.587+0000 7ff177614800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:49:59.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.587+0000 7ff0567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333649 cookie 94706235819136 notifier 8693 bl.length()=681 2024-09-12T17:49:59.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.587+0000 7ff0567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:49:59.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.587+0000 7ff0567fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:49:59.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.589+0000 7ff177614800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:49:59.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.589+0000 7ff177614800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:49:59.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.589+0000 7ff177614800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T17:49:59.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.590+0000 7ff0567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333725 cookie 94706235831712 notifier 8693 bl.length()=189 2024-09-12T17:49:59.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.590+0000 7ff0567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:49:59.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.590+0000 7ff0567fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:49:59.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.591+0000 7ff177614800 10 cache put: name=default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO info.flags=0x7 2024-09-12T17:49:59.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.591+0000 7ff177614800 10 moving default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO to cache LRU end 2024-09-12T17:49:59.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.591+0000 7ff177614800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:CFGMHTREYHCLWXLPMHVO, ofs0, ns] 2024-09-12T17:49:59.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.592+0000 7ff0567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333543 cookie 94706235823200 notifier 8693 bl.length()=188 2024-09-12T17:49:59.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.592+0000 7ff0567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO info.flags=0x7 2024-09-12T17:49:59.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.592+0000 7ff0567fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CFGMHTREYHCLWXLPMHVO to cache LRU end 2024-09-12T17:49:59.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.593+0000 7ff177614800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T17:49:59.594 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T17:49:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "user_id": "root2.client.0", 2024-09-12T17:49:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T17:49:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "email": "root2+test@test.test", 2024-09-12T17:49:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "suspended": 0, 2024-09-12T17:49:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "max_buckets": 1000, 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "subusers": [], 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "keys": [ 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "user": "root2.client.0", 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "access_key": "CFGMHTREYHCLWXLPMHVO", 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "secret_key": "VvVutEvZ+yihI/tNrKdYWLR40A1XRQ5AacTbAfx5gRYZu7I3S7eU+w==", 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "active": true, 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:59.586626Z" 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "swift_keys": [], 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": [], 2024-09-12T17:49:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "default_placement": "", 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "default_storage_class": "", 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "placement_tags": [], 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "bucket_quota": { 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "user_quota": { 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": false, 2024-09-12T17:49:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "check_on_raw": false, 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size": -1, 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_kb": 0, 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "max_objects": -1 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "temp_url_keys": [], 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "root", 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "mfa_ids": [], 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "account_id": "RGW99999999999999999", 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "create_date": "2024-09-12T17:49:59.586612Z", 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "group_ids": [] 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T17:49:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:49:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.594+0000 7ff0297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.596+0000 7ff177614800 20 remove_watcher() i=0 2024-09-12T17:49:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.596+0000 7ff177614800 2 removed watcher, disabling cache 2024-09-12T17:49:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.597+0000 7ff177614800 20 remove_watcher() i=1 2024-09-12T17:49:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.598+0000 7ff177614800 20 remove_watcher() i=2 2024-09-12T17:49:59.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.599+0000 7ff177614800 20 remove_watcher() i=3 2024-09-12T17:49:59.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.600+0000 7ff177614800 20 remove_watcher() i=4 2024-09-12T17:49:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.601+0000 7ff177614800 20 remove_watcher() i=5 2024-09-12T17:49:59.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.602+0000 7ff177614800 20 remove_watcher() i=6 2024-09-12T17:49:59.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.603+0000 7ff177614800 20 remove_watcher() i=7 2024-09-12T17:49:59.615 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1940585574 --totp-seed ANQO5S42UZ3XW2CUI2PP7COPHILAIJSI3K23ED2W2HQZUZK47HFTNJXTGMHKXBSL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:49:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:59.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.717+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 20 realm 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.719+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.720+0000 7f046c32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.720+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.720+0000 7f046c32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.720+0000 7f046c32c800 20 searching for the correct realm 2024-09-12T17:49:59.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.723+0000 7f0467855640 0 -- 172.21.15.63:0/908984272 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f045c04b400 msgr2=0x7f045c04b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:59.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.929+0000 7f0467855640 0 -- 172.21.15.63:0/908984272 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x559a821af9d0 msgr2=0x559a821b1e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:59.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:59.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T17:49:59.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:59.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T17:49:59.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:59.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:59.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:59.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.933+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 zone default found 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 4 Realm: () 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 zonegroup default 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.934+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.935+0000 7f046c32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.935+0000 7f046c32c800 20 started sync module instance, tier type = 2024-09-12T17:49:59.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.935+0000 7f046c32c800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=0 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=1 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=2 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=3 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=4 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=5 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=6 2024-09-12T17:49:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 20 add_watcher() i=7 2024-09-12T17:49:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.945+0000 7f046c32c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.947+0000 7f031efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.947+0000 7f046c32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.947+0000 7f046c32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.947+0000 7f046c32c800 5 note: GC not initialized 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.947+0000 7f031dfdb640 20 reqs_thread_entry: start 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 20 Filter name: none 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f028f7fe640 20 reqs_thread_entry: start 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:49:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:49:59.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T17:49:59.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:49:59.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.948+0000 7f046c32c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.951+0000 7f046c32c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:49:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.951+0000 7f046c32c800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:49:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.951+0000 7f046c32c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:49:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.952+0000 7f033f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333650 cookie 94122096182016 notifier 9324 bl.length()=695 2024-09-12T17:49:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.952+0000 7f033f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:49:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.952+0000 7f033f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:49:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.953+0000 7f031efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.955+0000 7f046c32c800 20 remove_watcher() i=0 2024-09-12T17:49:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.955+0000 7f046c32c800 2 removed watcher, disabling cache 2024-09-12T17:49:59.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.956+0000 7f046c32c800 20 remove_watcher() i=1 2024-09-12T17:49:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.957+0000 7f046c32c800 20 remove_watcher() i=2 2024-09-12T17:49:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.958+0000 7f046c32c800 20 remove_watcher() i=3 2024-09-12T17:49:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.959+0000 7f046c32c800 20 remove_watcher() i=4 2024-09-12T17:49:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.960+0000 7f046c32c800 20 remove_watcher() i=5 2024-09-12T17:49:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.961+0000 7f046c32c800 20 remove_watcher() i=6 2024-09-12T17:49:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T17:49:59.962+0000 7f046c32c800 20 remove_watcher() i=7 2024-09-12T17:49:59.975 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T17:49:59.976 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:49:59.976 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T17:50:00.005 INFO:tasks.s3tests:Configuring boto... 2024-09-12T17:50:00.005 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T17:50:00.005 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:50:00.076 DEBUG:teuthology.orchestra.run.smithi063:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:50:00.261 INFO:teuthology.orchestra.run.smithi063.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T17:50:00.446 INFO:teuthology.orchestra.run.smithi063.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T17:50:00.721 INFO:teuthology.orchestra.run.smithi063.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:51:48.811 INFO:teuthology.orchestra.run.smithi063.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T17:51:50.283 INFO:teuthology.orchestra.run.smithi063.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=bad10a75892db89f5f04f1b88c955a008304e701534c6a455e794206cdf34a70,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:51:50.283 INFO:teuthology.orchestra.run.smithi063.stdout:py run-test-pre: PYTHONHASHSEED='4223281894' 2024-09-12T17:51:50.283 INFO:teuthology.orchestra.run.smithi063.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:51:50.423 INFO:teuthology.orchestra.run.smithi063.stdout:============================= test session starts ============================== 2024-09-12T17:51:50.423 INFO:teuthology.orchestra.run.smithi063.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T17:51:50.423 INFO:teuthology.orchestra.run.smithi063.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:51:50.423 INFO:teuthology.orchestra.run.smithi063.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:51:50.423 INFO:teuthology.orchestra.run.smithi063.stdout:configfile: pytest.ini 2024-09-12T17:51:52.249 INFO:teuthology.orchestra.run.smithi063.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T17:51:52.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:51:52.383 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T17:51:52.513 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T17:51:52.686 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T17:51:52.858 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T17:51:52.983 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T17:51:53.109 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T17:51:53.284 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T17:51:53.405 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T17:51:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T17:51:53.577 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T17:51:53.701 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T17:51:53.825 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T17:51:53.947 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T17:51:54.069 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T17:51:54.154 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T17:51:54.240 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T17:51:54.285 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T17:51:54.330 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T17:51:54.375 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T17:51:54.420 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T17:51:54.465 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T17:51:54.510 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T17:51:54.555 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:51:54.600 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:51:54.645 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:51:54.690 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:51:54.735 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:51:54.780 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:51:54.825 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T17:51:54.870 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T17:51:54.915 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:51:54.960 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:51:55.005 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:51:55.050 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:51:55.095 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:51:55.140 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:51:55.185 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T17:51:55.233 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T17:51:55.277 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:51:55.322 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:51:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T17:51:55.412 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:51:55.458 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:51:55.503 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:51:55.548 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.594 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.641 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.685 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.776 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T17:51:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T17:51:56.202 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T17:51:56.715 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T17:51:57.710 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T17:51:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T17:52:00.091 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T17:52:00.544 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T17:52:01.145 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T17:52:01.370 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T17:52:01.455 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T17:52:01.613 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T17:52:01.772 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T17:52:01.971 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T17:52:02.111 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T17:52:02.193 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T17:52:02.194 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:52:02.195 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:52:02.196 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:52:02.197 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:52:02.201 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:52:02.201 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:52:02.202 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T17:52:02.202 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:52:02.202 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:52:02.202 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:52:02.202 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:02.203 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T17:52:02.204 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:02.205 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:02.206 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:02.206 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:02.207 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:02.208 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:02.209 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:02.210 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T17:52:02.210 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T17:52:02.211 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T17:52:02.212 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T17:52:02.213 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T17:52:02.214 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T17:52:02.214 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T17:52:02.215 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T17:52:02.306 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T17:52:02.317 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T17:52:02.538 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T17:52:10.997 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T17:52:11.131 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T17:52:11.321 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T17:52:11.506 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T17:52:11.692 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T17:52:11.877 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T17:52:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T17:52:12.224 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T17:52:12.397 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T17:52:12.571 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T17:52:12.698 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T17:52:12.818 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T17:52:12.937 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T17:52:12.977 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T17:52:13.142 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T17:52:13.323 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T17:52:13.536 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T17:52:13.664 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T17:52:13.791 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T17:52:13.921 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T17:52:14.046 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T17:52:14.173 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T17:52:14.294 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T17:52:14.412 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T17:52:14.452 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T17:52:14.526 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T17:52:14.565 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T17:52:14.604 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T17:52:14.644 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T17:52:14.756 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T17:52:14.796 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:52:14.849 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T17:52:14.989 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T17:52:15.125 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T17:52:15.199 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:52:15.336 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T17:52:15.473 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:52:15.704 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:52:15.797 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T17:52:15.933 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T17:52:16.071 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T17:52:16.403 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:52:16.561 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:52:16.777 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:52:16.940 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:52:17.262 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:52:17.477 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:52:17.785 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:52:17.994 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:52:18.278 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:52:18.495 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T17:52:18.774 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T17:52:18.917 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T17:52:19.633 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T17:52:20.079 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T17:52:20.668 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T17:52:22.099 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T17:52:24.098 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T17:52:25.141 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T17:52:26.049 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T17:52:26.652 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T17:52:26.979 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T17:52:27.758 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T17:52:28.264 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T17:52:28.997 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T17:52:29.455 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T17:52:30.504 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T17:52:31.112 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T17:52:33.325 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T17:52:33.992 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T17:52:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T17:52:35.063 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T17:52:36.473 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T17:52:37.446 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T17:52:38.600 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T17:52:39.675 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T17:52:40.623 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T17:52:41.570 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T17:52:42.273 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T17:52:42.738 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T17:52:43.305 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T17:52:44.553 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T17:52:46.266 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T17:52:46.867 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T17:52:47.901 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T17:52:48.932 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T17:52:49.789 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:52:50.627 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:52:51.542 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T17:52:52.405 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T17:52:53.203 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T17:52:53.755 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T17:52:54.201 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:52:54.645 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:52:55.135 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T17:52:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:52:56.627 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:52:57.375 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:52:58.126 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:52:58.873 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:52:59.665 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:53:00.417 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T17:53:01.165 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T17:53:01.920 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T17:53:02.665 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:53:03.454 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T17:53:04.200 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T17:53:04.575 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T17:53:04.950 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T17:53:05.283 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:53:05.664 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T17:53:05.859 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T17:53:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T17:53:06.409 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T17:53:06.655 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T17:53:06.885 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T17:53:07.089 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T17:53:07.331 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T17:53:07.533 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T17:53:07.738 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T17:53:07.996 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T17:53:08.259 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T17:53:08.439 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:53:08.655 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:53:08.861 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T17:53:09.063 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T17:53:09.323 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:53:09.585 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:53:09.826 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T17:53:10.031 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T17:53:10.232 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:53:10.436 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:53:10.642 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T17:53:10.851 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T17:53:11.056 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:53:11.299 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:53:11.502 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T17:53:11.709 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T17:53:11.916 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T17:53:12.120 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T17:53:12.317 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T17:53:12.513 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T17:53:12.748 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T17:53:12.955 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:53:13.163 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:53:22.737 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T17:53:22.936 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T17:53:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T17:53:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T17:53:23.524 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T17:53:23.761 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T17:53:23.958 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T17:53:24.157 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T17:53:24.353 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T17:53:24.550 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T17:53:24.747 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T17:53:24.944 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T17:53:25.179 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T17:53:25.385 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:53:25.592 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:53:25.796 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:53:25.999 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:53:26.203 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T17:53:26.409 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T17:53:26.653 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:53:26.863 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:53:27.067 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:53:27.272 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:53:27.523 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T17:53:27.769 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T17:53:28.015 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T17:53:28.221 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T17:53:28.431 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T17:53:28.632 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T17:53:28.674 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T17:53:28.854 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T17:53:29.460 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T17:53:30.018 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T17:53:30.226 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T17:53:30.457 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T17:53:30.663 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T17:53:30.869 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T17:53:31.157 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T17:53:31.406 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T17:53:31.656 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T17:53:31.862 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T17:53:32.068 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T17:53:32.272 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T17:53:32.478 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T17:53:32.721 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T17:53:33.095 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T17:53:33.559 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T17:53:33.696 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T17:53:33.832 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T17:53:33.974 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:53:34.098 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:53:34.167 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T17:53:34.208 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T17:53:34.248 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T17:53:34.436 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T17:53:34.627 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T17:53:34.668 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T17:53:34.850 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T17:53:34.972 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T17:53:35.099 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T17:53:35.266 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T17:53:35.676 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T17:53:36.005 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T17:53:36.330 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T17:53:46.300 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T17:53:56.256 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T17:53:56.432 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T17:53:56.607 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T17:53:56.784 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T17:53:56.961 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T17:53:57.200 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T17:53:57.381 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T17:53:57.566 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T17:53:57.801 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T17:53:57.991 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T17:53:58.212 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T17:53:58.428 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T17:53:58.611 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T17:53:58.833 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T17:53:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T17:53:59.132 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T17:53:59.305 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T17:53:59.536 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T17:53:59.716 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T17:53:59.894 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T17:54:00.071 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T17:54:00.252 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T17:54:00.472 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T17:54:00.600 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T17:54:00.730 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T17:54:00.858 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T17:54:01.023 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T17:54:01.151 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T17:54:01.284 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T17:54:01.466 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T17:54:01.594 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T17:54:01.725 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T17:54:01.852 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T17:54:01.982 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T17:54:02.197 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T17:54:02.363 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T17:54:02.491 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T17:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T17:54:02.754 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T17:54:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T17:54:03.216 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T17:54:03.348 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T17:54:03.552 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T17:54:03.680 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T17:54:03.937 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T17:54:04.160 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T17:54:04.338 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T17:54:04.559 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T17:54:04.780 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T17:54:05.979 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T17:54:06.210 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T17:54:06.437 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T17:54:06.747 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T17:54:07.062 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T17:54:07.336 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T17:54:07.554 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T17:54:07.826 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T17:54:08.140 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T17:54:08.363 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T17:54:08.671 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T17:54:08.851 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T17:54:08.985 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T17:54:09.084 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T17:54:09.228 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T17:54:09.356 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T17:54:09.397 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T17:54:09.619 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T17:54:09.798 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T17:54:10.016 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T17:54:12.460 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T17:54:12.642 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T17:54:12.823 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T17:54:13.004 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T17:54:13.183 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T17:54:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T17:54:13.505 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T17:54:13.723 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T17:54:13.902 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T17:54:14.080 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T17:54:14.259 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T17:54:14.436 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T17:54:14.617 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T17:54:14.806 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T17:54:14.987 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T17:54:15.165 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T17:54:15.341 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T17:54:15.555 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T17:54:15.597 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T17:54:15.638 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T17:54:15.679 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T17:54:15.799 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T17:54:15.921 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T17:54:16.043 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T17:54:16.166 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T17:54:16.337 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T17:54:16.379 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T17:54:16.420 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T17:54:16.543 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T17:54:16.623 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T17:54:16.663 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T17:54:16.704 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T17:54:16.745 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T17:54:16.878 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T17:54:17.044 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T17:54:17.173 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T17:54:17.337 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T17:54:17.504 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T17:54:17.670 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T17:54:17.831 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T17:54:18.043 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T17:54:18.210 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:54:18.375 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:54:18.596 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T17:54:18.815 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T17:54:19.083 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T17:54:19.304 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:54:19.527 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:54:19.836 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T17:54:20.105 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T17:54:20.337 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T17:54:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T17:54:20.662 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T17:54:20.934 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T17:54:21.204 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T17:54:21.472 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T17:54:21.743 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T17:54:22.052 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T17:54:22.308 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T17:54:22.513 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T17:54:22.715 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T17:54:22.976 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T17:54:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T17:54:23.356 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T17:54:23.575 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T17:54:23.802 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T17:54:23.978 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T17:54:24.116 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T17:54:24.386 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T17:54:24.731 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T17:54:25.118 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T17:54:25.467 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T17:54:25.816 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T17:54:26.167 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:54:26.514 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T17:54:26.902 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T17:54:27.256 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T17:54:27.604 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:54:27.922 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T17:54:28.244 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T17:54:28.564 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T17:54:29.101 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T17:54:29.586 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T17:54:29.624 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T17:54:29.666 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T17:54:29.706 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T17:54:29.842 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T17:54:29.973 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T17:54:30.094 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T17:54:30.216 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T17:54:30.472 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T17:54:31.298 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T17:54:31.519 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T17:54:31.763 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T17:54:32.143 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T17:54:32.416 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T17:54:32.693 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T17:54:32.957 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T17:54:33.187 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T17:54:33.588 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T17:54:33.851 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T17:54:34.108 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T17:54:34.396 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T17:54:34.914 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T17:54:35.359 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T17:54:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T17:54:35.620 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T17:54:36.566 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T17:54:36.858 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T17:54:38.204 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T17:54:38.346 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T17:54:38.557 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T17:54:39.074 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T17:54:39.314 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T17:54:39.789 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T17:54:41.020 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T17:54:41.909 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T17:54:43.979 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T17:54:49.529 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T17:54:50.612 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T17:54:52.267 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T17:54:52.518 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T17:54:52.986 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T17:54:53.544 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T17:54:53.873 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T17:54:54.094 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T17:54:54.483 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T17:54:54.732 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T17:54:54.938 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T17:54:55.133 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T17:55:08.959 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T17:55:10.808 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T17:55:11.082 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T17:55:11.211 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T17:55:11.434 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T17:55:14.650 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T17:55:17.810 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T17:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T17:55:21.155 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T17:55:21.337 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T17:55:21.557 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T17:55:21.736 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T17:55:21.916 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T17:55:22.095 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T17:55:22.322 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T17:55:22.617 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T17:55:22.927 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T17:55:24.199 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T17:55:24.741 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T17:55:25.058 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T17:55:25.522 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T17:55:26.066 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T17:55:26.501 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T17:55:26.821 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T17:55:27.238 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T17:55:27.459 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T17:55:31.728 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T17:55:31.987 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T17:55:32.210 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T17:55:32.433 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T17:55:32.657 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T17:55:32.987 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T17:55:39.226 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T17:55:39.556 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T17:55:39.893 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T17:55:40.304 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T17:55:40.744 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T17:55:43.273 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T17:55:43.642 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T17:55:46.936 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T17:55:59.686 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T17:56:01.299 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T17:56:02.216 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T17:56:03.270 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T17:56:03.643 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T17:56:04.029 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T17:56:04.301 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T17:56:04.710 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T17:56:05.029 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T17:56:05.460 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T17:56:05.595 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T17:56:05.774 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T17:56:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T17:56:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T17:56:06.215 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T17:56:06.435 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T17:56:06.571 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T17:56:06.701 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T17:56:06.938 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T17:56:07.077 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T17:56:07.212 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T17:56:07.348 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T17:56:07.485 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T17:56:07.614 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T17:56:07.841 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T17:56:08.063 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T17:56:08.261 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T17:56:08.522 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T17:56:08.709 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T17:56:08.931 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T17:56:09.153 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T17:56:09.327 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T17:56:09.497 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T17:56:09.671 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T17:56:09.841 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T17:56:11.475 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T17:56:12.923 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T17:56:13.711 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T17:56:13.892 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T17:57:14.839 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T17:58:15.989 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T17:58:16.182 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T17:58:16.401 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T17:58:16.611 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T17:58:16.737 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T17:58:17.886 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T17:58:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T17:58:19.158 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T17:58:19.341 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T17:58:19.559 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T17:58:19.779 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T17:58:20.058 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T17:58:20.280 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T17:58:20.500 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T17:58:20.687 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T17:58:20.876 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T17:58:21.079 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T17:58:21.281 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T17:58:21.473 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T17:58:21.657 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T17:58:22.033 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T17:58:22.406 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T17:58:22.715 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T17:58:22.980 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T17:58:23.317 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T17:58:23.615 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T17:58:23.990 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T17:58:24.292 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T17:58:24.596 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T17:58:24.954 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T17:58:25.338 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T17:58:25.597 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T17:58:25.774 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T17:58:26.039 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T17:58:26.354 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T17:58:26.698 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T17:58:27.044 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T17:58:27.639 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T17:58:29.538 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T17:58:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T17:58:30.205 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T17:58:30.522 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T17:58:31.049 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T17:58:31.473 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T17:58:31.703 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T17:58:32.156 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T17:58:32.286 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T17:58:32.413 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T17:58:32.540 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T17:58:32.671 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T17:58:32.896 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T17:58:33.070 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T17:58:33.425 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T17:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T17:58:33.801 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T17:58:33.968 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T17:58:34.131 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T17:58:34.298 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T17:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T17:58:34.677 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T17:58:34.844 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T17:58:35.013 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T17:58:35.179 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T17:58:35.383 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T17:58:35.640 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T17:58:35.907 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T17:58:36.106 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T17:58:36.269 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T17:58:36.486 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T17:58:36.740 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T17:58:36.948 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T17:58:37.157 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T17:58:37.361 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T17:58:37.609 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T17:58:37.812 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T17:58:38.109 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T17:58:38.370 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T17:58:38.612 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T17:58:38.802 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T17:58:39.023 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T17:58:39.247 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T17:58:39.526 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T17:58:39.745 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T17:58:40.018 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T17:58:40.363 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T17:58:40.519 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T17:58:40.694 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T17:58:40.856 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T17:58:50.986 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T17:58:51.220 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T17:59:01.113 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T17:59:01.388 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T17:59:01.700 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T17:59:01.828 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:01.999 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:02.171 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:02.346 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:02.519 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T17:59:02.694 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T17:59:02.820 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T17:59:02.999 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T17:59:03.258 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T17:59:03.431 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T17:59:03.730 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T17:59:03.990 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T17:59:04.169 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T17:59:04.303 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T17:59:04.633 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T17:59:05.766 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T17:59:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:59:06.113 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:59:06.302 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:59:06.528 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T17:59:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T17:59:07.013 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T17:59:07.474 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T17:59:07.960 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T17:59:08.211 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T17:59:09.070 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T17:59:09.822 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T17:59:09.952 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T17:59:10.079 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T17:59:10.776 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T17:59:11.519 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T17:59:11.908 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T17:59:12.149 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T17:59:12.429 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T17:59:12.704 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T17:59:12.786 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T17:59:13.097 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T17:59:13.464 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T17:59:14.736 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T17:59:15.022 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T17:59:15.281 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T17:59:15.525 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T17:59:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T17:59:15.942 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T17:59:16.157 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T17:59:16.278 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T17:59:16.507 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T17:59:16.843 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T17:59:17.087 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T17:59:17.411 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T17:59:17.631 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T17:59:17.666 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T17:59:17.996 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T17:59:18.367 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T17:59:18.663 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T17:59:18.903 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T17:59:19.102 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T17:59:33.166 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T17:59:33.240 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T17:59:33.774 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T17:59:34.213 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T17:59:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T17:59:35.015 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout:=============================== warnings summary =============================== 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: import imp 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py:120 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T17:59:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: if boto_type is 'S3Connection': 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_headers.py:124 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3.py:359 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: if k is 'BucketName': 2024-09-12T17:59:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: @pytest.mark.timeout(10) 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.044 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T17:59:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T17:59:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:59:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T17:59:35.048 INFO:teuthology.orchestra.run.smithi063.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:59:35.048 INFO:teuthology.orchestra.run.smithi063.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 464.61s (0:07:44) = 2024-09-12T17:59:35.159 INFO:teuthology.orchestra.run.smithi063.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:59:35.159 INFO:teuthology.orchestra.run.smithi063.stdout: py: commands succeeded 2024-09-12T17:59:35.159 INFO:teuthology.orchestra.run.smithi063.stdout: congratulations :) 2024-09-12T17:59:35.177 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T17:59:35.178 DEBUG:teuthology.orchestra.run.smithi063:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T17:59:35.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:59:35.294 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T17:59:35.294 DEBUG:teuthology.orchestra.run.smithi063:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:59:35.324 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T17:59:35.329 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:59:35.528 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:59:35.989 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:59:35.989 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:59:35.990 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:59:36.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:59:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:59:36.024 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:59:36.096 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:59:36.096 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:59:36.166 INFO:tasks.workunit:timeout=3h 2024-09-12T17:59:36.167 INFO:tasks.workunit:cleanup=True 2024-09-12T17:59:36.167 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:59:36.238 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:00:36.589 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 91% (11671/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-12T18:00:37.368 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:37.369 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-12T18:00:37.369 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:37.369 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-12T18:00:37.369 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:37.369 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:00:37.369 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:37.369 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:00:37.373 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:00:37.443 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:00:37.446 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:00:37.446 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:00:37.496 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:00:37.546 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:00:37.586 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:00:37.587 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:00:37.587 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:00:37.627 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:00:37.630 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T18:00:37.630 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:00:37.702 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:00:37.703 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:00:37.703 DEBUG:teuthology.orchestra.run.smithi063:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:00:37.776 INFO:tasks.workunit.client.0.smithi063.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:00:37.777 INFO:tasks.workunit.client.0.smithi063.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:00:37.777 INFO:tasks.workunit.client.0.smithi063.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:00:40.190 INFO:tasks.workunit.client.0.smithi063.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:00:40.190 INFO:tasks.workunit.client.0.smithi063.stderr:++ deactivate nondestructive 2024-09-12T18:00:40.190 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T18:00:40.190 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T18:00:40.190 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:00:40.190 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T18:00:40.191 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T18:00:40.191 INFO:tasks.workunit.client.0.smithi063.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:00:40.191 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:00:40.191 INFO:tasks.workunit.client.0.smithi063.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:00:40.191 INFO:tasks.workunit.client.0.smithi063.stderr:++ export VIRTUAL_ENV 2024-09-12T18:00:40.191 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PATH 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n '' ']' 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -z '' ']' 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ PS1='(rgw) ' 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ export PS1 2024-09-12T18:00:40.192 INFO:tasks.workunit.client.0.smithi063.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:00:40.193 INFO:tasks.workunit.client.0.smithi063.stderr:++ hash -r 2024-09-12T18:00:40.193 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install pip --upgrade 2024-09-12T18:00:40.430 INFO:tasks.workunit.client.0.smithi063.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T18:00:40.619 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting pip 2024-09-12T18:00:40.625 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:00:40.671 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: pip 2024-09-12T18:00:40.671 INFO:tasks.workunit.client.0.smithi063.stdout: Attempting uninstall: pip 2024-09-12T18:00:40.671 INFO:tasks.workunit.client.0.smithi063.stdout: Found existing installation: pip 21.3.1 2024-09-12T18:00:40.835 INFO:tasks.workunit.client.0.smithi063.stdout: Uninstalling pip-21.3.1: 2024-09-12T18:00:40.841 INFO:tasks.workunit.client.0.smithi063.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T18:00:41.615 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed pip-24.2 2024-09-12T18:00:41.664 INFO:tasks.workunit.client.0.smithi063.stderr:+ pip install boto3 2024-09-12T18:00:42.481 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting boto3 2024-09-12T18:00:42.483 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:00:43.091 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:00:43.092 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:00:43.151 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:00:43.152 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:00:43.206 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:00:43.207 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:00:43.257 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:00:43.258 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:00:43.335 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:00:43.336 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T18:00:43.513 INFO:tasks.workunit.client.0.smithi063.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:00:43.514 INFO:tasks.workunit.client.0.smithi063.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:00:43.518 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:00:43.520 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:00:43.529 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:00:43.530 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:00:43.532 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:00:43.533 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T18:00:43.534 INFO:tasks.workunit.client.0.smithi063.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:00:43.611 INFO:tasks.workunit.client.0.smithi063.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:00:44.791 INFO:tasks.workunit.client.0.smithi063.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T18:00:44.910 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:00:45.037 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:00:45.072 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:45.073 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:45.113 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.112+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.113+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.113+0000 7fad3f326800 20 realm 2024-09-12T18:00:45.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.113+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.115 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.114+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.114+0000 7fad3f326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.114+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.114+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.116 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.114+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.115+0000 7fad3f326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.115+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.115+0000 7fad3f326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:45.117 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.115+0000 7fad3f326800 20 searching for the correct realm 2024-09-12T18:00:45.120 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.119+0000 7fad3b04b640 0 -- 172.21.15.63:0/1630198091 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fad2c03f070 msgr2=0x7fad2c088270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:45.124 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.123+0000 7fad3b04b640 0 -- 172.21.15.63:0/1630198091 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fad3400e070 msgr2=0x7fad3405fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:45.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:45.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T18:00:45.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:45.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T18:00:45.130 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:45.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:45.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:45.131 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.127+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:45.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 zone default found 2024-09-12T18:00:45.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 4 Realm: () 2024-09-12T18:00:45.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T18:00:45.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T18:00:45.132 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:45.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 zonegroup default 2024-09-12T18:00:45.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.133 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.128+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.129+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.129+0000 7fad3f326800 20 started sync module instance, tier type = 2024-09-12T18:00:45.134 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.129+0000 7fad3f326800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T18:00:45.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.138+0000 7fad3f326800 20 add_watcher() i=0 2024-09-12T18:00:45.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.138+0000 7fad3f326800 20 add_watcher() i=1 2024-09-12T18:00:45.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.138+0000 7fad3f326800 20 add_watcher() i=2 2024-09-12T18:00:45.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.138+0000 7fad3f326800 20 add_watcher() i=3 2024-09-12T18:00:45.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.138+0000 7fad3f326800 20 add_watcher() i=4 2024-09-12T18:00:45.140 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.138+0000 7fad3f326800 20 add_watcher() i=5 2024-09-12T18:00:45.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.138+0000 7fad3f326800 20 add_watcher() i=6 2024-09-12T18:00:45.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.139+0000 7fad3f326800 20 add_watcher() i=7 2024-09-12T18:00:45.141 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.139+0000 7fad3f326800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:45.142 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fabf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:45.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fad3f326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:45.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fad3f326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:45.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fad3f326800 5 note: GC not initialized 2024-09-12T18:00:45.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fabf0fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:45.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fad3f326800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:45.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fad3f326800 20 Filter name: none 2024-09-12T18:00:45.144 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.141+0000 7fab6a7fc640 20 reqs_thread_entry: start 2024-09-12T18:00:45.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:00:45.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:00:45.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:00:45.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:00:45.145 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:00:45.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.142+0000 7fad3f326800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:00:45.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.143+0000 7fad3f326800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:00:45.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.143+0000 7fad3f326800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:00:45.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.144+0000 7fad3f326800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:00:45.146 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.144+0000 7fad3f326800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:00:45.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.144+0000 7fad3f326800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:00:45.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.144+0000 7fac1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166336204 cookie 94397428515376 notifier 8726 bl.length()=613 2024-09-12T18:00:45.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.144+0000 7fac1effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:00:45.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.144+0000 7fac1effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:00:45.147 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.146+0000 7fad3f326800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:00:45.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.146+0000 7fad3f326800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:00:45.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.146+0000 7fad3f326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:00:45.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.146+0000 7fac1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166336205 cookie 94397428517952 notifier 8726 bl.length()=191 2024-09-12T18:00:45.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.146+0000 7fac1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:00:45.148 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.146+0000 7fac1e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:00:45.149 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.147+0000 7fabf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:45.151 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.149+0000 7fad3f326800 20 remove_watcher() i=0 2024-09-12T18:00:45.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.149+0000 7fad3f326800 2 removed watcher, disabling cache 2024-09-12T18:00:45.152 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.150+0000 7fad3f326800 20 remove_watcher() i=1 2024-09-12T18:00:45.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.152+0000 7fad3f326800 20 remove_watcher() i=2 2024-09-12T18:00:45.154 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.153+0000 7fad3f326800 20 remove_watcher() i=3 2024-09-12T18:00:45.156 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.154+0000 7fad3f326800 20 remove_watcher() i=4 2024-09-12T18:00:45.157 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.155+0000 7fad3f326800 20 remove_watcher() i=5 2024-09-12T18:00:45.158 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.156+0000 7fad3f326800 20 remove_watcher() i=6 2024-09-12T18:00:45.159 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.157+0000 7fad3f326800 20 remove_watcher() i=7 2024-09-12T18:00:45.345 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:00:45.345 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:45.376 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:00:45.405 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:45.405 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:45.445 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.443+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.447 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.444+0000 7f55d3333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.444+0000 7f55d3333800 20 realm 2024-09-12T18:00:45.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.444+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.445+0000 7f55d3333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.445+0000 7f55d3333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:45.448 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.445+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.445+0000 7f55d3333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:45.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.445+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.445+0000 7f55d3333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:45.449 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.445+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:45.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.446+0000 7f55d3333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:45.450 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.446+0000 7f55d3333800 20 searching for the correct realm 2024-09-12T18:00:45.451 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.449+0000 7f55c6819640 0 -- 172.21.15.63:0/952669980 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7f55b80b4960 msgr2=0x7f55b80e1210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:45.856 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:45.854+0000 7f55cf01a640 0 -- 172.21.15.63:0/952669980 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f55c8060690 msgr2=0x7f55c808c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:46.264 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.262+0000 7f55d3333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:46.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.262+0000 7f55d3333800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T18:00:46.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.262+0000 7f55d3333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:46.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.262+0000 7f55d3333800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T18:00:46.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.263+0000 7f55d3333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:46.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.263+0000 7f55d3333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:46.265 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.263+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.263+0000 7f55d3333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:46.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.263+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.263+0000 7f55d3333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:46.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.263+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:46.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 zone default found 2024-09-12T18:00:46.266 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 4 Realm: () 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 zonegroup default 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:46.267 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.264+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.265+0000 7f55d3333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:46.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.265+0000 7f55d3333800 20 started sync module instance, tier type = 2024-09-12T18:00:46.268 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.265+0000 7f55d3333800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T18:00:46.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.276+0000 7f55d3333800 20 add_watcher() i=0 2024-09-12T18:00:46.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.276+0000 7f55d3333800 20 add_watcher() i=1 2024-09-12T18:00:46.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.276+0000 7f55d3333800 20 add_watcher() i=2 2024-09-12T18:00:46.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.276+0000 7f55d3333800 20 add_watcher() i=3 2024-09-12T18:00:46.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.276+0000 7f55d3333800 20 add_watcher() i=4 2024-09-12T18:00:46.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.276+0000 7f55d3333800 20 add_watcher() i=5 2024-09-12T18:00:46.278 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.276+0000 7f55d3333800 20 add_watcher() i=6 2024-09-12T18:00:46.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.277+0000 7f55d3333800 20 add_watcher() i=7 2024-09-12T18:00:46.279 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.277+0000 7f55d3333800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:46.281 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.279+0000 7f5485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:46.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.280+0000 7f55d3333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:46.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.280+0000 7f55d3333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:46.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.280+0000 7f55d3333800 5 note: GC not initialized 2024-09-12T18:00:46.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.280+0000 7f5484fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:46.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.280+0000 7f55d3333800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:46.282 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.280+0000 7f55d3333800 20 Filter name: none 2024-09-12T18:00:46.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.280+0000 7f53fe7fc640 20 reqs_thread_entry: start 2024-09-12T18:00:46.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.281+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.281+0000 7f55d3333800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:00:46.283 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.281+0000 7f55d3333800 20 rados->read ofs=0 len=0 2024-09-12T18:00:46.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.282+0000 7f55d3333800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:00:46.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.282+0000 7f55d3333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:46.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.282+0000 7f55d3333800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:00:46.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.282+0000 7f55d3333800 20 INFO: main: starting shard=0 2024-09-12T18:00:46.284 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.282+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.0 2024-09-12T18:00:46.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.283+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.283+0000 7f55d3333800 20 INFO: main: starting shard=1 2024-09-12T18:00:46.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.283+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.1 2024-09-12T18:00:46.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.283+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.283+0000 7f55d3333800 20 INFO: main: starting shard=2 2024-09-12T18:00:46.285 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.283+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.2 2024-09-12T18:00:46.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.284+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.284+0000 7f55d3333800 20 INFO: main: starting shard=3 2024-09-12T18:00:46.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.284+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.3 2024-09-12T18:00:46.286 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.285+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.285+0000 7f55d3333800 20 INFO: main: starting shard=4 2024-09-12T18:00:46.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.285+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.4 2024-09-12T18:00:46.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.285+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.285+0000 7f55d3333800 20 INFO: main: starting shard=5 2024-09-12T18:00:46.287 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.285+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.5 2024-09-12T18:00:46.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.286+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.286+0000 7f55d3333800 20 INFO: main: starting shard=6 2024-09-12T18:00:46.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.286+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.6 2024-09-12T18:00:46.288 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.286+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.286+0000 7f55d3333800 20 INFO: main: starting shard=7 2024-09-12T18:00:46.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.286+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.7 2024-09-12T18:00:46.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.287+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.287+0000 7f55d3333800 20 INFO: main: starting shard=8 2024-09-12T18:00:46.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.287+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.8 2024-09-12T18:00:46.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.287+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.289 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.287+0000 7f55d3333800 20 INFO: main: starting shard=9 2024-09-12T18:00:46.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.287+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.9 2024-09-12T18:00:46.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.288+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.288+0000 7f55d3333800 20 INFO: main: starting shard=10 2024-09-12T18:00:46.290 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.288+0000 7f55d3333800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.10 2024-09-12T18:00:46.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.289+0000 7f55d3333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:46.291 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.289+0000 7f55d3333800 20 INFO: main: done 2024-09-12T18:00:46.292 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.290+0000 7f5485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:46.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.292+0000 7f55d3333800 20 remove_watcher() i=0 2024-09-12T18:00:46.294 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.292+0000 7f55d3333800 2 removed watcher, disabling cache 2024-09-12T18:00:46.295 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.294+0000 7f55d3333800 20 remove_watcher() i=1 2024-09-12T18:00:46.297 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.295+0000 7f55d3333800 20 remove_watcher() i=2 2024-09-12T18:00:46.298 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.296+0000 7f55d3333800 20 remove_watcher() i=3 2024-09-12T18:00:46.299 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.297+0000 7f55d3333800 20 remove_watcher() i=4 2024-09-12T18:00:46.300 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.299+0000 7f55d3333800 20 remove_watcher() i=5 2024-09-12T18:00:46.302 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.300+0000 7f55d3333800 20 remove_watcher() i=6 2024-09-12T18:00:46.303 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.301+0000 7f55d3333800 20 remove_watcher() i=7 2024-09-12T18:00:46.318 INFO:tasks.workunit.client.0.smithi063.stderr:rados -p default.rgw.buckets.data ls | grep 1177a7fe-ccfa-457e-967c-5a1879b45299 2024-09-12T18:00:46.344 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:46.344 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:46.636 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:46.634+0000 7f18cfb1f640 0 -- 172.21.15.63:0/1420677245 >> [v2:172.21.15.82:6824/3370836524,v1:172.21.15.82:6825/3370836524] conn(0x7f18c8061e70 msgr2=0x7f18c8016950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:46.650 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:00:46.651 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:46.652 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:00:48.086 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:00:48.501 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:00:48.531 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:48.531 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:48.570 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.568+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.570+0000 7fb805936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.570+0000 7fb805936800 20 realm 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.570+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.571+0000 7fb805936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.571+0000 7fb805936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.571+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.571+0000 7fb805936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:48.573 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.571+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.572+0000 7fb805936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:48.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.572+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.572+0000 7fb805936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:48.574 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.572+0000 7fb805936800 20 searching for the correct realm 2024-09-12T18:00:48.577 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.576+0000 7fb800eb6640 0 -- 172.21.15.63:0/2770206750 >> [v2:172.21.15.82:6816/4151406223,v1:172.21.15.82:6817/4151406223] conn(0x7fb7f801e900 msgr2=0x7fb7f8078780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:48.782 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.780+0000 7fb800eb6640 0 -- 172.21.15.63:0/2770206750 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x55f7878d8c50 msgr2=0x55f7878db0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.787 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:48.788 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.785+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 zone default found 2024-09-12T18:00:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 4 Realm: () 2024-09-12T18:00:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T18:00:48.789 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 zonegroup default 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.786+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.790 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.787+0000 7fb805936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:48.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.787+0000 7fb805936800 20 started sync module instance, tier type = 2024-09-12T18:00:48.791 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.787+0000 7fb805936800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T18:00:48.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.797+0000 7fb805936800 20 add_watcher() i=0 2024-09-12T18:00:48.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.797+0000 7fb805936800 20 add_watcher() i=1 2024-09-12T18:00:48.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.797+0000 7fb805936800 20 add_watcher() i=2 2024-09-12T18:00:48.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.797+0000 7fb805936800 20 add_watcher() i=3 2024-09-12T18:00:48.799 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.797+0000 7fb805936800 20 add_watcher() i=4 2024-09-12T18:00:48.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.797+0000 7fb805936800 20 add_watcher() i=5 2024-09-12T18:00:48.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.797+0000 7fb805936800 20 add_watcher() i=6 2024-09-12T18:00:48.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.798+0000 7fb805936800 20 add_watcher() i=7 2024-09-12T18:00:48.800 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.798+0000 7fb805936800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:48.802 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.800+0000 7fb6b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:48.807 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.800+0000 7fb805936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.800+0000 7fb805936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.800+0000 7fb805936800 5 note: GC not initialized 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.801+0000 7fb6b6fe5640 20 reqs_thread_entry: start 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.801+0000 7fb805936800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.801+0000 7fb805936800 20 Filter name: none 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.801+0000 7fb6b4fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.801+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.801+0000 7fb805936800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.801+0000 7fb805936800 20 rados->read ofs=0 len=0 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:00:48.808 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 INFO: main: starting shard=0 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.0 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 INFO: main: starting shard=1 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.802+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.1 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.803+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.803+0000 7fb805936800 20 INFO: main: starting shard=2 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.803+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.2 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.803+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.803+0000 7fb805936800 20 INFO: main: starting shard=3 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.803+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.3 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.804+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.809 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.804+0000 7fb805936800 20 INFO: main: starting shard=4 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.804+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.4 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.804+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.804+0000 7fb805936800 20 INFO: main: starting shard=5 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.804+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.5 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.805+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.805+0000 7fb805936800 20 INFO: main: starting shard=6 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.805+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.6 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.805+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.805+0000 7fb805936800 20 INFO: main: starting shard=7 2024-09-12T18:00:48.810 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.805+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.7 2024-09-12T18:00:48.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.806+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.806+0000 7fb805936800 20 INFO: main: starting shard=8 2024-09-12T18:00:48.811 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.806+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.8 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.806+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.806+0000 7fb805936800 20 INFO: main: starting shard=9 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.806+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.9 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.807+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.807+0000 7fb805936800 20 INFO: main: starting shard=10 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.807+0000 7fb805936800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.10 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.807+0000 7fb805936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:00:48.812 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.807+0000 7fb805936800 20 INFO: main: done 2024-09-12T18:00:48.813 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.808+0000 7fb6b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:48.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.811+0000 7fb805936800 20 remove_watcher() i=0 2024-09-12T18:00:48.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.811+0000 7fb805936800 2 removed watcher, disabling cache 2024-09-12T18:00:48.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.812+0000 7fb805936800 20 remove_watcher() i=1 2024-09-12T18:00:48.814 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.813+0000 7fb805936800 20 remove_watcher() i=2 2024-09-12T18:00:48.816 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.814+0000 7fb805936800 20 remove_watcher() i=3 2024-09-12T18:00:48.818 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.816+0000 7fb805936800 20 remove_watcher() i=4 2024-09-12T18:00:48.819 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.818+0000 7fb805936800 20 remove_watcher() i=5 2024-09-12T18:00:48.821 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.819+0000 7fb805936800 20 remove_watcher() i=6 2024-09-12T18:00:48.822 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.820+0000 7fb805936800 20 remove_watcher() i=7 2024-09-12T18:00:48.834 INFO:tasks.workunit.client.0.smithi063.stderr:rados -p default.rgw.buckets.data ls | grep ed7d5a58-4a53-49dd-8a4c-a65c93767e47 2024-09-12T18:00:48.859 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:48.859 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:48.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:48.937+0000 7fe691226640 0 -- 172.21.15.63:0/2955185796 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fe68c030a80 msgr2=0x7fe68c032e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:48.951 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:00:48.951 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:48.990 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:00:50.460 INFO:tasks.workunit.client.0.smithi063.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:00:50.461 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:00:50.888 INFO:tasks.workunit.client.0.smithi063.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:00:50.888 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T18:00:50.989 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:00:54.422 INFO:tasks.workunit.client.0.smithi063.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:00:54.847 INFO:tasks.workunit.client.0.smithi063.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:00:54.878 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:54.878 INFO:tasks.workunit.client.0.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:54.918 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.916+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 20 realm 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:54.921 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.919+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.920+0000 7fbc7c810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:54.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.920+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.922 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.920+0000 7fbc7c810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:54.923 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.920+0000 7fbc7c810800 20 searching for the correct realm 2024-09-12T18:00:54.927 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.925+0000 7fbc7877b640 0 -- 172.21.15.63:0/3943967892 >> [v2:172.21.15.63:6824/1777922010,v1:172.21.15.63:6825/1777922010] conn(0x7fbc6c03c040 msgr2=0x7fbc6c00d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:54.930 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.928+0000 7fbc77f7a640 0 -- 172.21.15.63:0/3943967892 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7fbc7007d040 msgr2=0x7fbc70095a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.932+0000 7fbc7c810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.932+0000 7fbc7c810800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.932+0000 7fbc7c810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.932+0000 7fbc7c810800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.932+0000 7fbc7c810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.932+0000 7fbc7c810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.932+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.937 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 zone default found 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 4 Realm: () 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 zonegroup default 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.933+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.934+0000 7fbc7c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:54.938 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.934+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.934+0000 7fbc7c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:54.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.934+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.934+0000 7fbc7c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:54.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.934+0000 7fbc7c810800 20 started sync module instance, tier type = 2024-09-12T18:00:54.939 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.934+0000 7fbc7c810800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T18:00:54.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.944+0000 7fbc7c810800 20 add_watcher() i=0 2024-09-12T18:00:54.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.944+0000 7fbc7c810800 20 add_watcher() i=1 2024-09-12T18:00:54.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.944+0000 7fbc7c810800 20 add_watcher() i=2 2024-09-12T18:00:54.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.944+0000 7fbc7c810800 20 add_watcher() i=3 2024-09-12T18:00:54.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.944+0000 7fbc7c810800 20 add_watcher() i=4 2024-09-12T18:00:54.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.944+0000 7fbc7c810800 20 add_watcher() i=5 2024-09-12T18:00:54.946 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.944+0000 7fbc7c810800 20 add_watcher() i=6 2024-09-12T18:00:54.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.945+0000 7fbc7c810800 20 add_watcher() i=7 2024-09-12T18:00:54.948 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.945+0000 7fbc7c810800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.947+0000 7fbb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.947+0000 7fbc7c810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.947+0000 7fbc7c810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.947+0000 7fbc7c810800 5 note: GC not initialized 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.947+0000 7fbb2cfe1640 20 reqs_thread_entry: start 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.947+0000 7fbc7c810800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 20 Filter name: none 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbaa67fc640 20 reqs_thread_entry: start 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:00:54.950 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:00:54.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:00:54.951 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783 : miss 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.948+0000 7fbc7c810800 20 rados->read ofs=0 len=0 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783 info.flags=0x17 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783 to cache LRU end 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.0 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:00:54.952 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.949+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.1 2024-09-12T18:00:54.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.950+0000 7fbc7c810800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:00:54.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.950+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.2 2024-09-12T18:00:54.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.950+0000 7fbc7c810800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:00:54.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.950+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.3 2024-09-12T18:00:54.953 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.951+0000 7fbc7c810800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:00:54.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.951+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.4 2024-09-12T18:00:54.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.951+0000 7fbc7c810800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:00:54.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.951+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.5 2024-09-12T18:00:54.954 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.952+0000 7fbc7c810800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:00:54.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.952+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.6 2024-09-12T18:00:54.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.952+0000 7fbc7c810800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:00:54.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.952+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.7 2024-09-12T18:00:54.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.953+0000 7fbc7c810800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:00:54.955 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.953+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.8 2024-09-12T18:00:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.953+0000 7fbc7c810800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:00:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.953+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.9 2024-09-12T18:00:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.953+0000 7fbc7c810800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:00:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.953+0000 7fbc7c810800 20 bucket index object: :.dir.44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783.10 2024-09-12T18:00:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.954+0000 7fbc7c810800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:00:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.954+0000 7fbc7c810800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:00:54.956 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.955+0000 7fbb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:54.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.957+0000 7fbc7c810800 20 remove_watcher() i=0 2024-09-12T18:00:54.959 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.957+0000 7fbc7c810800 2 removed watcher, disabling cache 2024-09-12T18:00:54.960 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.958+0000 7fbc7c810800 20 remove_watcher() i=1 2024-09-12T18:00:54.961 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.959+0000 7fbc7c810800 20 remove_watcher() i=2 2024-09-12T18:00:54.962 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.960+0000 7fbc7c810800 20 remove_watcher() i=3 2024-09-12T18:00:54.963 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.961+0000 7fbc7c810800 20 remove_watcher() i=4 2024-09-12T18:00:54.964 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.962+0000 7fbc7c810800 20 remove_watcher() i=5 2024-09-12T18:00:54.965 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.963+0000 7fbc7c810800 20 remove_watcher() i=6 2024-09-12T18:00:54.966 INFO:tasks.workunit.client.0.smithi063.stderr:2024-09-12T18:00:54.964+0000 7fbc7c810800 20 remove_watcher() i=7 2024-09-12T18:00:54.978 INFO:tasks.workunit.client.0.smithi063.stderr:Deleting bucket versioning-bucket 2024-09-12T18:00:55.012 INFO:tasks.workunit.client.0.smithi063.stderr:Completed bucket versioning tests 2024-09-12T18:00:55.012 INFO:tasks.workunit.client.0.smithi063.stdout:connected to http://localhost:80 2024-09-12T18:00:55.072 INFO:tasks.workunit.client.0.smithi063.stderr:+ deactivate 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ export PATH 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ hash -r 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' -n '' ']' 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ unset -f deactivate 2024-09-12T18:00:55.073 INFO:tasks.workunit.client.0.smithi063.stderr:+ echo OK. 2024-09-12T18:00:55.074 INFO:tasks.workunit.client.0.smithi063.stdout:OK. 2024-09-12T18:00:55.075 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:00:55.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:00:55.156 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:00:55.156 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:00:55.534 DEBUG:teuthology.parallel:result is None 2024-09-12T18:00:55.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:00:55.574 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:00:55.575 DEBUG:teuthology.orchestra.run.smithi063:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:55.644 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:00:55.644 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:00:55.654 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:00:55.663 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:00:55.663 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:00:55.663 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:00:55.749 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:00:55.749 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:00:55.807 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:55.807 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:55.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.842+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.843+0000 7f3e1c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.843+0000 7f3e1c546800 20 realm 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.844+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.844+0000 7f3e1c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.844+0000 7f3e1c546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.844+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.844+0000 7f3e1c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:55.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.844+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.845+0000 7f3e1c546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:55.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.845+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.845+0000 7f3e1c546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:55.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.845+0000 7f3e1c546800 20 searching for the correct realm 2024-09-12T18:00:55.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.847+0000 7f3e1a030640 0 -- 172.21.15.63:0/1739295694 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7f3e0c03d070 msgr2=0x7f3e0c04a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:55.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:55.852+0000 7f3e1a030640 0 -- 172.21.15.63:0/1739295694 >> [v2:172.21.15.63:6816/1632744678,v1:172.21.15.63:6817/1632744678] conn(0x7f3e14061040 msgr2=0x7f3e14061420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.059+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 zone default found 2024-09-12T18:00:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 4 Realm: () 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 zonegroup default 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.060+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.061+0000 7f3e1c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.061+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.061+0000 7f3e1c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.061+0000 7f3e1c546800 20 started sync module instance, tier type = 2024-09-12T18:00:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.061+0000 7f3e1c546800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T18:00:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.071+0000 7f3e1c546800 20 add_watcher() i=0 2024-09-12T18:00:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.071+0000 7f3e1c546800 20 add_watcher() i=1 2024-09-12T18:00:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.071+0000 7f3e1c546800 20 add_watcher() i=2 2024-09-12T18:00:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.071+0000 7f3e1c546800 20 add_watcher() i=3 2024-09-12T18:00:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.071+0000 7f3e1c546800 20 add_watcher() i=4 2024-09-12T18:00:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.071+0000 7f3e1c546800 20 add_watcher() i=5 2024-09-12T18:00:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.071+0000 7f3e1c546800 20 add_watcher() i=6 2024-09-12T18:00:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.072+0000 7f3e1c546800 20 add_watcher() i=7 2024-09-12T18:00:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.073+0000 7f3e1c546800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:56.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.075+0000 7f3cd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:56.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.075+0000 7f3e1c546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:56.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.075+0000 7f3e1c546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.115+0000 7f3c4b7fe640 20 reqs_thread_entry: start 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.115+0000 7f3e1c546800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.115+0000 7f3e1c546800 20 Filter name: none 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.115+0000 7f3c497fa640 20 reqs_thread_entry: start 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.115+0000 7f3e1c546800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.115+0000 7f3e1c546800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.116+0000 7f3e1c546800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.116+0000 7f3e1c546800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.116+0000 7f3e1c546800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:00:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.116+0000 7f3e1c546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.116+0000 7f3e1c546800 10 removing key index: HBZHCBNWWPPGDWBJNMJZ 2024-09-12T18:00:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.117+0000 7f3e1c546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:HBZHCBNWWPPGDWBJNMJZ, ofs0, ns] 2024-09-12T18:00:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.117+0000 7f3cfdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166334026 cookie 94438050158192 notifier 8837 bl.length()=170 2024-09-12T18:00:56.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.118+0000 7f3e1c546800 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:00:56.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.119+0000 7f3e1c546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:00:56.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.119+0000 7f3cfd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333691 cookie 94438050155552 notifier 8837 bl.length()=181 2024-09-12T18:00:56.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.120+0000 7f3e1c546800 10 removing user buckets index 2024-09-12T18:00:56.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.121+0000 7f3e1c546800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:00:56.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.121+0000 7f3cfd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166336213 cookie 94438050166272 notifier 8837 bl.length()=172 2024-09-12T18:00:56.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.121+0000 7f3e1c546800 10 removing user index: tester.client.0 2024-09-12T18:00:56.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.123+0000 7f3e1c546800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:00:56.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.123+0000 7f3e1c546800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:00:56.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.124+0000 7f3cfd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166336214 cookie 94438050164736 notifier 8837 bl.length()=164 2024-09-12T18:00:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.125+0000 7f3cd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.128+0000 7f3e1c546800 20 remove_watcher() i=0 2024-09-12T18:00:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.128+0000 7f3e1c546800 2 removed watcher, disabling cache 2024-09-12T18:00:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.129+0000 7f3e1c546800 20 remove_watcher() i=1 2024-09-12T18:00:56.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.130+0000 7f3e1c546800 20 remove_watcher() i=2 2024-09-12T18:00:56.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.131+0000 7f3e1c546800 20 remove_watcher() i=3 2024-09-12T18:00:56.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.132+0000 7f3e1c546800 20 remove_watcher() i=4 2024-09-12T18:00:56.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.133+0000 7f3e1c546800 20 remove_watcher() i=5 2024-09-12T18:00:56.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.134+0000 7f3e1c546800 20 remove_watcher() i=6 2024-09-12T18:00:56.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:00:56.135+0000 7f3e1c546800 20 remove_watcher() i=7 2024-09-12T18:00:56.149 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:00:56.159 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:00:56.168 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:00:56.226 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:00:56.236 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:00:56.236 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:00:56.237 INFO:tasks.rgw.client.0.smithi063.stdout:2024-09-12T18:00:56.235+0000 7f7296fa1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45888) UID: 0 2024-09-12T18:00:56.237 INFO:tasks.rgw.client.0.smithi063.stdout:2024-09-12T18:00:56.235+0000 7f729c726880 -1 shutting down 2024-09-12T18:01:02.337 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:01:02.338 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:01:02.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:01:02.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:01:02.539 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:01:02.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:01:02.539 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:01:02.640 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:02.640 INFO:teuthology.orchestra.run.smithi063.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:02.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.676+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.678+0000 7fe4cd498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.678+0000 7fe4cd498800 20 realm 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.678+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.679+0000 7fe4cd498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.679+0000 7fe4cd498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.679+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.679+0000 7fe4cd498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.679+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.680+0000 7fe4cd498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.680+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.680+0000 7fe4cd498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.680+0000 7fe4cd498800 20 searching for the correct realm 2024-09-12T18:01:02.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.682+0000 7fe4cb783640 0 -- 172.21.15.63:0/1810345191 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x556a489007f0 msgr2=0x556a48902c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.685+0000 7fe4cb783640 0 -- 172.21.15.63:0/1810345191 >> [v2:172.21.15.82:6800/1774933818,v1:172.21.15.82:6801/1774933818] conn(0x7fe4b40022f0 msgr2=0x7fe4bc068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 RGWRados::pool_iterate: got zone_info.44b5948e-036f-4ba3-a922-c18ae061c84d 2024-09-12T18:01:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 RGWRados::pool_iterate: got zonegroup_info.6407f60f-cc4e-4187-a2e3-44c9358e5992 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.894+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:02.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 20 zone default found 2024-09-12T18:01:02.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 4 Realm: () 2024-09-12T18:01:02.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 4 ZoneGroup: default (6407f60f-cc4e-4187-a2e3-44c9358e5992) 2024-09-12T18:01:02.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 4 Zone: default (44b5948e-036f-4ba3-a922-c18ae061c84d) 2024-09-12T18:01:02.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 20 zonegroup default 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.895+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.896+0000 7fe4cd498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.896+0000 7fe4cd498800 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.896+0000 7fe4cd498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.896+0000 7fe4cd498800 20 started sync module instance, tier type = 2024-09-12T18:01:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.896+0000 7fe4cd498800 20 started zone id=44b5948e-036f-4ba3-a922-c18ae061c84d (name=default) with tier type = 2024-09-12T18:01:02.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.906+0000 7fe4cd498800 20 add_watcher() i=0 2024-09-12T18:01:02.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.906+0000 7fe4cd498800 20 add_watcher() i=1 2024-09-12T18:01:02.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.906+0000 7fe4cd498800 20 add_watcher() i=2 2024-09-12T18:01:02.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.906+0000 7fe4cd498800 20 add_watcher() i=3 2024-09-12T18:01:02.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.906+0000 7fe4cd498800 20 add_watcher() i=4 2024-09-12T18:01:02.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.906+0000 7fe4cd498800 20 add_watcher() i=5 2024-09-12T18:01:02.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.906+0000 7fe4cd498800 20 add_watcher() i=6 2024-09-12T18:01:02.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.907+0000 7fe4cd498800 20 add_watcher() i=7 2024-09-12T18:01:02.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.907+0000 7fe4cd498800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:02.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.909+0000 7fe3817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.909+0000 7fe4cd498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:02.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.909+0000 7fe4cd498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.948+0000 7fe2fbfff640 20 reqs_thread_entry: start 2024-09-12T18:01:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.948+0000 7fe4cd498800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.948+0000 7fe4cd498800 20 Filter name: none 2024-09-12T18:01:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.948+0000 7fe2f9ffb640 20 reqs_thread_entry: start 2024-09-12T18:01:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.948+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:01:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.950+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.950+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53152' 2024-09-12T18:01:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13672277746422530184', time=2024-09-12T19:51:58.900103+0000, chain.objs.size()=3 2024-09-12T18:01:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-STANDARD.2~-7UocuVQwh1QFhCxa2cL64NHd5bfT1Z.1 2024-09-12T18:01:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-STANDARD.2~-7UocuVQwh1QFhCxa2cL64NHd5bfT1Z.2 2024-09-12T18:01:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-STANDARD.2~-7UocuVQwh1QFhCxa2cL64NHd5bfT1Z.3 2024-09-12T18:01:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4809647564480674131', time=2024-09-12T19:53:08.773555+0000, chain.objs.size()=1 2024-09-12T18:01:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.242__shadow_.eeuF2Yk8ZpEccH1ISH91iEvxZKF4EF8_0 2024-09-12T18:01:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13731059833205791252', time=2024-09-12T19:53:11.621701+0000, chain.objs.size()=1 2024-09-12T18:01:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.255__shadow_.5TlUrullcugt2CNZiZRv_1gt5P0_cRh_0 2024-09-12T18:01:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6734908053363639713', time=2024-09-12T19:53:21.188591+0000, chain.objs.size()=1 2024-09-12T18:01:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BEjwLKUOoWsoV_E07krFkoDL8mtzr4Q_0 2024-09-12T18:01:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10712472679721342906', time=2024-09-12T19:53:21.216968+0000, chain.objs.size()=1 2024-09-12T18:01:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jJkURs3Unczpd1vHfpkg8CJe9Lx1p66_0 2024-09-12T18:01:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3155742486202296683', time=2024-09-12T19:53:21.246498+0000, chain.objs.size()=1 2024-09-12T18:01:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.sDo3vm6IqzPYcCBuyFMK3n_48lU9LQQ_0 2024-09-12T18:01:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.830950080093935342', time=2024-09-12T19:53:21.275020+0000, chain.objs.size()=1 2024-09-12T18:01:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QO2Agn6CjSs5ri_jF_XVeyWiVEDSC1p_0 2024-09-12T18:01:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16094475616936383615', time=2024-09-12T19:53:21.388464+0000, chain.objs.size()=1 2024-09-12T18:01:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TPLJmVkrj3MzfA8_n7B8p2hd3M80BOW_0 2024-09-12T18:01:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15288913723141969190', time=2024-09-12T19:53:21.424171+0000, chain.objs.size()=1 2024-09-12T18:01:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.asNZamUkH2ck7bnXT0mMJyQtzKwivNf_0 2024-09-12T18:01:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3446816039807530974', time=2024-09-12T19:53:21.427522+0000, chain.objs.size()=1 2024-09-12T18:01:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.d35V3xYB-ioDarDmUV67UMCSlMBP7Ua_0 2024-09-12T18:01:02.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17437302693848486655', time=2024-09-12T19:53:21.456065+0000, chain.objs.size()=1 2024-09-12T18:01:02.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jt3jDhmWb634CU0rKWu786MeH7hbSew_0 2024-09-12T18:01:02.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2209945123412632944', time=2024-09-12T19:53:21.609363+0000, chain.objs.size()=1 2024-09-12T18:01:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._SA2778oif_ThZnx3iPDUJvawI7ABoj_0 2024-09-12T18:01:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11653347033014746982', time=2024-09-12T19:53:21.650647+0000, chain.objs.size()=1 2024-09-12T18:01:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bGBTYz58kuEaCs_e8g6iiZg2McFwO_3_0 2024-09-12T18:01:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14775732414006082023', time=2024-09-12T19:53:21.651619+0000, chain.objs.size()=1 2024-09-12T18:01:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.moHgBgTxlk_SNNt7Zx_J0olHHJbqrYH_0 2024-09-12T18:01:02.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6968769828351959150', time=2024-09-12T19:53:21.659891+0000, chain.objs.size()=1 2024-09-12T18:01:02.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jutcUK16PrESzyl6GhZsJ1_1tRAnydS_0 2024-09-12T18:01:02.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2649466039568361472', time=2024-09-12T19:53:21.681108+0000, chain.objs.size()=1 2024-09-12T18:01:02.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CFW-P-0-hn-y2RtG7T5FgmzNmXRZtUm_0 2024-09-12T18:01:02.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16314578141771429646', time=2024-09-12T19:53:21.695112+0000, chain.objs.size()=1 2024-09-12T18:01:02.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.5gTrbXJ7TaGUAzqnt0YPJEbGTlTDEsk_0 2024-09-12T18:01:02.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13578349877678364342', time=2024-09-12T19:53:21.778040+0000, chain.objs.size()=1 2024-09-12T18:01:02.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.f1S-um8izUq0-17fWbKeRmEULa7m2Jr_0 2024-09-12T18:01:02.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4650260518939342257', time=2024-09-12T19:53:21.791301+0000, chain.objs.size()=1 2024-09-12T18:01:02.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BBQgkLRRQ_B7_pP9olSKT0X8jcdeHXs_0 2024-09-12T18:01:02.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.327729150792224722', time=2024-09-12T19:53:21.834464+0000, chain.objs.size()=1 2024-09-12T18:01:02.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ttb05Z7nxlwlgnqtBu7IJgy8rtMW_vN_0 2024-09-12T18:01:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4340074076008703006', time=2024-09-12T19:53:21.839339+0000, chain.objs.size()=1 2024-09-12T18:01:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rC1oGLQz6fKtRgVZDHVepJ0ioDhpRoW_0 2024-09-12T18:01:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.960+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7678258457499500419', time=2024-09-12T19:53:21.880907+0000, chain.objs.size()=1 2024-09-12T18:01:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.960+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kDy6Xei93hyd817bP5fQzTEoCJWwQ4q_0 2024-09-12T18:01:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.960+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10284759412552076902', time=2024-09-12T19:53:22.024209+0000, chain.objs.size()=1 2024-09-12T18:01:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.960+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hcMQKcR-KqVYyzZqpzn27iQ6yH03-eq_0 2024-09-12T18:01:02.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.960+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10130836555211212921', time=2024-09-12T19:53:22.064927+0000, chain.objs.size()=1 2024-09-12T18:01:02.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.960+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZHljUcTWeFTv01t-GSlmqze3p13esyo_0 2024-09-12T18:01:02.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.961+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6229875428254663867', time=2024-09-12T19:53:22.071803+0000, chain.objs.size()=1 2024-09-12T18:01:02.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.961+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mo9WczB391cjYaz8FAOwZqybgxG3k1F_0 2024-09-12T18:01:02.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.961+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4707706793868239252', time=2024-09-12T19:53:22.082689+0000, chain.objs.size()=1 2024-09-12T18:01:02.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.961+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WiQyjeHSckAJBupZGx2LTbOqxLVSBtx_0 2024-09-12T18:01:02.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4281135326919878329', time=2024-09-12T19:53:22.189385+0000, chain.objs.size()=1 2024-09-12T18:01:02.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aMDLOBgcdMeMbPu3PN-RHBd8wXCulsF_0 2024-09-12T18:01:02.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15494924781651163168', time=2024-09-12T19:53:22.209168+0000, chain.objs.size()=1 2024-09-12T18:01:02.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gHfV97FVMCtqOAhe3tMl46KL7LB5J0A_0 2024-09-12T18:01:02.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4099932043320221181', time=2024-09-12T19:53:22.221171+0000, chain.objs.size()=1 2024-09-12T18:01:02.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.5NX61zNKvu6zAewQq1WXaKdfpo78hxp_0 2024-09-12T18:01:02.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17038670690982971870', time=2024-09-12T19:53:22.238807+0000, chain.objs.size()=1 2024-09-12T18:01:02.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ydARDvTBKS7f3pzYBLtskfTgAy3vpkr_0 2024-09-12T18:01:02.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11163997902217551045', time=2024-09-12T19:53:22.278758+0000, chain.objs.size()=1 2024-09-12T18:01:02.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.apsvswSjKq3InyNFbfJQC7WGvONa4aQ_0 2024-09-12T18:01:02.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18176381143324605850', time=2024-09-12T19:53:22.290740+0000, chain.objs.size()=1 2024-09-12T18:01:02.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mFCa59dW3nI3KCisSLek12JrpC33TKi_0 2024-09-12T18:01:02.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.224097605828032141', time=2024-09-12T19:53:22.410094+0000, chain.objs.size()=1 2024-09-12T18:01:02.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lYsYfX4tVw758Ycp0BxZJr_CIsut9ZH_0 2024-09-12T18:01:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.968+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10723922991074910783', time=2024-09-12T19:53:22.480207+0000, chain.objs.size()=1 2024-09-12T18:01:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.968+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0BVW95FOA8yJwuW0SBcv1RdmHWPLYKR_0 2024-09-12T18:01:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.968+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3442573225309787237', time=2024-09-12T19:53:22.600204+0000, chain.objs.size()=1 2024-09-12T18:01:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.968+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Js3zYJngVEzZfvpJRbC8wg5Y1QHW4s-_0 2024-09-12T18:01:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.968+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16723290181048861685', time=2024-09-12T19:53:26.119300+0000, chain.objs.size()=1 2024-09-12T18:01:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.968+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.280__shadow_.bVzNJbNZTL_WzmzhiPM5ZIbQZ1URWKN_0 2024-09-12T18:01:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.968+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15178283156370962415', time=2024-09-12T19:53:27.683041+0000, chain.objs.size()=1 2024-09-12T18:01:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.969+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.287__shadow_.RJgF99XTpx7atye0XqBYCf9hcokypuV_0 2024-09-12T18:01:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.969+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16537711075363403792', time=2024-09-12T19:53:29.940797+0000, chain.objs.size()=1 2024-09-12T18:01:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.z7nt2ue5_VgeSdaRYOjL0Oyz_ZDY-UU_0 2024-09-12T18:01:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.970+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8100451400806473916', time=2024-09-12T19:53:30.782577+0000, chain.objs.size()=1 2024-09-12T18:01:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.298__shadow_.KQIDC7I-tAc6QILwJGpra6QMZt_i4tW_0 2024-09-12T18:01:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.970+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7295641931040828425', time=2024-09-12T19:53:31.775022+0000, chain.objs.size()=1 2024-09-12T18:01:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.302__shadow_.ugDtFF8njL5EuwvjBCeO0g5hF54TcVq_0 2024-09-12T18:01:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.971+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15402730351650254779', time=2024-09-12T19:53:31.980863+0000, chain.objs.size()=1 2024-09-12T18:01:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.971+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.303__shadow_.dI4GJpTwETz2och7EZihtwtXZVOn5UX_0 2024-09-12T18:01:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.971+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10153254578731497379', time=2024-09-12T19:53:32.392863+0000, chain.objs.size()=1 2024-09-12T18:01:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.971+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.305__shadow_.dQCtdUAgNL1mAoCZcGXYNP4HdVHsZeu_0 2024-09-12T18:01:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.972+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2096326569608629810', time=2024-09-12T19:53:34.348314+0000, chain.objs.size()=1 2024-09-12T18:01:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.972+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.314__shadow_.muayc0-QZHjCRnG5HZVloCg4Jd3AXM4_0 2024-09-12T18:01:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.972+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3653436342047774211', time=2024-09-12T19:53:44.587694+0000, chain.objs.size()=1 2024-09-12T18:01:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.972+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Hhvvte90-KuVh9rXyXEgBKOJhsKnZDC_0 2024-09-12T18:01:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.972+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5628967836543161238', time=2024-09-12T19:53:44.945013+0000, chain.objs.size()=1 2024-09-12T18:01:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.972+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.E4w-XWXVVcjHlUmdSJKcEDDVwgChfq2_0 2024-09-12T18:01:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.973+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14503356536956132888', time=2024-09-12T19:53:44.950462+0000, chain.objs.size()=1 2024-09-12T18:01:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.973+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.W3Z64Mn1ddXO4h_BRtiPob-CuWw51fO_0 2024-09-12T18:01:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.973+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4128613810262201263', time=2024-09-12T19:53:44.954454+0000, chain.objs.size()=1 2024-09-12T18:01:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.973+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iTanBVmwDfQfuXBa9sxgzNqFAFbKLG9_0 2024-09-12T18:01:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.974+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6378107319199705896', time=2024-09-12T19:53:44.977789+0000, chain.objs.size()=1 2024-09-12T18:01:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.e448WAMPRUFs9AjK-kRIti095VifHDi_0 2024-09-12T18:01:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11514697308419083240', time=2024-09-12T19:53:44.980017+0000, chain.objs.size()=1 2024-09-12T18:01:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.X94lER-NBXnmCAyIRg_qsnbWpESC3f1_0 2024-09-12T18:01:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.203405614321942739', time=2024-09-12T19:53:45.014724+0000, chain.objs.size()=1 2024-09-12T18:01:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.t_cSIwwBqIifO7twRYB3CZT7RXY746s_0 2024-09-12T18:01:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16956815202196128480', time=2024-09-12T19:53:45.017098+0000, chain.objs.size()=1 2024-09-12T18:01:02.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.siothSd_mFqFU0leLIKYAIFOBF-Ssk4_0 2024-09-12T18:01:02.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.977+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11311854420820894133', time=2024-09-12T19:53:45.049477+0000, chain.objs.size()=1 2024-09-12T18:01:02.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.977+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.SHDKjo1nxfYNKZjsaXi0Avm_Tgp_Rma_0 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.977+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9411790853257069864', time=2024-09-12T19:53:45.130658+0000, chain.objs.size()=1 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.977+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5HnlXdbm4guBAVt34cWIW3qMRCdcBHA_0 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6775124816192051274', time=2024-09-12T19:53:45.144232+0000, chain.objs.size()=1 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.btNLD81M5BnASaeZlKFqrjych14WBbD_0 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15492999541052429667', time=2024-09-12T19:53:45.180185+0000, chain.objs.size()=1 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JFWtp0SAa_5Lmpw1N5I50XtjTqOeK0Q_0 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3763493302857749262', time=2024-09-12T19:53:45.200974+0000, chain.objs.size()=1 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pfgvMjSXLdwk91AoYXLL3y-Pw_r5EjI_0 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13042778960748170007', time=2024-09-12T19:53:45.216325+0000, chain.objs.size()=1 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zKNvlvkVo0m0x3M9YdSevyQmm7ldxXG_0 2024-09-12T18:01:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.979+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8620617455166180539', time=2024-09-12T19:53:45.257257+0000, chain.objs.size()=1 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.979+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cvMEHCpCf5n6WtNwf1pe-Eg3FQfhQIL_0 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5809219667919549059', time=2024-09-12T19:53:45.334381+0000, chain.objs.size()=1 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fKzi7xuF-UYB0COTqBzTHYhKKBSqdYE_0 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14740685698388574592', time=2024-09-12T19:53:45.336085+0000, chain.objs.size()=1 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9q8p9LM6VeEbu-h9yJ4ZpzqSL8jCiXo_0 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12534700039673897946', time=2024-09-12T19:53:45.359875+0000, chain.objs.size()=1 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sNodGiMNusOscVZ8Lc-g5-LMfGr0uMq_0 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5946475190123531658', time=2024-09-12T19:53:45.387726+0000, chain.objs.size()=1 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.981+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Y39iDr-LIRsENpXNBrSiCChTyDnfKoN_0 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9940826582708309375', time=2024-09-12T19:53:45.410244+0000, chain.objs.size()=1 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jEMh5rYoZqBl-5kw7o4k_RlO-osiInc_0 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15356934994682242203', time=2024-09-12T19:53:45.427020+0000, chain.objs.size()=1 2024-09-12T18:01:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7raJVJjmf_VaPIGPEo4J6RAGVXcwjls_0 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18423074169095359773', time=2024-09-12T19:53:45.451490+0000, chain.objs.size()=1 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Me6c6pr53w4uOz_rZpxjNqj4oL5F0Sh_0 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2883868170768198834', time=2024-09-12T19:53:45.458132+0000, chain.objs.size()=1 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tbR-B9jvnFWAYATDWnZARyteQURmt0h_0 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.973730704348735179', time=2024-09-12T19:53:45.589413+0000, chain.objs.size()=1 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2-D2rvX8Vhj3Ix4pfgdhpCQjc5UVgk2_0 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.820460614130618214', time=2024-09-12T19:53:45.649735+0000, chain.objs.size()=1 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Yk6jXqEwZgCl9tNpdeOV8uOAkLH47JZ_0 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10180774494240825912', time=2024-09-12T19:53:45.777884+0000, chain.objs.size()=1 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gQvMY-McJ-rt5tbdI5sCzRd3tijlaej_0 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.985+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8625613447465352213', time=2024-09-12T19:53:45.783547+0000, chain.objs.size()=1 2024-09-12T18:01:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.985+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FQgPhnRKd1bAkcLWrl_Ybh_aIgeakuN_0 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.985+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16805358682553172210', time=2024-09-12T19:53:45.805673+0000, chain.objs.size()=1 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.985+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RLgAD0kFdRSze-emkUVeAcgclrkCwRT_0 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.987+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2177213207123550473', time=2024-09-12T19:53:45.827461+0000, chain.objs.size()=1 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.987+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.c4T8eDEFowbAzk3ZVMsRu_u2ahxLl9z_0 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.987+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10966324662395181810', time=2024-09-12T19:53:45.831337+0000, chain.objs.size()=1 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.987+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TWug8WD1oKXH1bI9sXs5eU5m5wyYMsZ_0 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18186727121897655330', time=2024-09-12T19:53:45.850624+0000, chain.objs.size()=1 2024-09-12T18:01:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BF47jYWHqFEdDy_YJeUnECMu6yHZ3Iu_0 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12576997346038819868', time=2024-09-12T19:53:45.985642+0000, chain.objs.size()=1 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xDzq3fNQvzEvgYi9W14mvfZWsGkqNqN_0 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8421907069262465465', time=2024-09-12T19:53:45.988458+0000, chain.objs.size()=1 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FnMMDqJ6YBeegBPfmVYveJ4cAPupuUT_0 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8960162535706597747', time=2024-09-12T19:53:46.142033+0000, chain.objs.size()=1 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.raY8ADS9CHek7z06BavmeMb4tuEcDX4_0 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15612718789306183982', time=2024-09-12T19:53:46.168434+0000, chain.objs.size()=1 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BSOXhu5z0VrYuPPSY2qwq20xt4zkysJ_0 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6527477471284923269', time=2024-09-12T19:53:46.180771+0000, chain.objs.size()=1 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bKxF3Tl1q-rmFZW_zSxiY20eDutaxu9_0 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8316959480185578676', time=2024-09-12T19:53:46.184471+0000, chain.objs.size()=1 2024-09-12T18:01:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.QFFK4AUNsYN8DWZNEDS4SQUIXiNNKnX_0 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12691245188343083757', time=2024-09-12T19:53:46.228575+0000, chain.objs.size()=1 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.V12Tf7f2MeJ2cSDr0m9bJ3c46dleI-l_0 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7434303574264006317', time=2024-09-12T19:53:46.237370+0000, chain.objs.size()=1 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OZcFNAMfT74hktXUEqmbG21depMCXky_0 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14336163393840189489', time=2024-09-12T19:53:46.240211+0000, chain.objs.size()=1 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.076piXAdh4W_UpUHmosmeJQXAFWCKhk_0 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10585146170959920336', time=2024-09-12T19:53:54.661011+0000, chain.objs.size()=1 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GjmVwdBfEDUEeeGPgfZ37hQPYeRf4Le_0 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.994+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12902477290756439256', time=2024-09-12T19:53:54.663761+0000, chain.objs.size()=1 2024-09-12T18:01:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.994+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Zes2b_-moKFon7crUnoJNwXNKpk4KwS_0 2024-09-12T18:01:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8758427627344696231', time=2024-09-12T19:53:54.727288+0000, chain.objs.size()=1 2024-09-12T18:01:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rRBkZhE80CMIvmi8ZqCOdIubWpbkZT6_0 2024-09-12T18:01:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14764998446526172227', time=2024-09-12T19:53:54.855530+0000, chain.objs.size()=1 2024-09-12T18:01:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cgK45Sf72fh8yJVAw2QNO5FPz9aKIFD_0 2024-09-12T18:01:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5335979721858946215', time=2024-09-12T19:53:54.884472+0000, chain.objs.size()=1 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EEA1qPeFWg3As4Igryd0j0gc1rw78mO_0 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.780973273453623504', time=2024-09-12T19:53:54.904205+0000, chain.objs.size()=1 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.dy66SvUfWJxHqOvRt7PBjGfT_d_qvs2_0 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2737268324332509057', time=2024-09-12T19:53:54.908098+0000, chain.objs.size()=1 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.995+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.S_cGfqdmHbgVeqTKb3I_BEya1dqnibZ_0 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11080732332420677030', time=2024-09-12T19:53:54.908878+0000, chain.objs.size()=1 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mAkBIrYLYI7P_BKw_6pGfogrrMeJRAD_0 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4328204516731664139', time=2024-09-12T19:53:54.912248+0000, chain.objs.size()=1 2024-09-12T18:01:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._XLVzVDBlTSntqYC02CmgDMD205ZDnD_0 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15262558897495992136', time=2024-09-12T19:53:54.969666+0000, chain.objs.size()=1 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fJAn7nNGjNmTYz99uDOXWDp6ulwfjWe_0 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3252732901047686591', time=2024-09-12T19:53:55.150418+0000, chain.objs.size()=1 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.76GFWVi0EuG-XGp59hotqxUH08sC_Nh_0 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8916619496541346902', time=2024-09-12T19:53:55.154215+0000, chain.objs.size()=1 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.v3SW0CHb7vNrmgAK0rNr3tbDAphPCAB_0 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5754245612692283736', time=2024-09-12T19:53:55.157623+0000, chain.objs.size()=1 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.f-qRx8Qi1eL7I3dMC3eig07OpnD2cTh_0 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7611467922763926642', time=2024-09-12T19:53:55.165763+0000, chain.objs.size()=1 2024-09-12T18:01:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:02.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3iJbPzY7YsIiZ8FKjMuye91K3tKmbaz_0 2024-09-12T18:01:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.000+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2131160631141262563', time=2024-09-12T19:53:55.169982+0000, chain.objs.size()=1 2024-09-12T18:01:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.000+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.KqJSQOx3Qqn0gcKZA1PfLtJ5NXbxDTS_0 2024-09-12T18:01:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.000+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4389578018081733803', time=2024-09-12T19:53:55.283467+0000, chain.objs.size()=1 2024-09-12T18:01:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.000+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZyHkZYFtyw8l5NX2kUO5dVtYz6YhzzJ_0 2024-09-12T18:01:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.001+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6864798649748606454', time=2024-09-12T19:53:55.304736+0000, chain.objs.size()=1 2024-09-12T18:01:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.001+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BwBW0DzgtnVTQ9vFC2fhfQlUc7NFmDl_0 2024-09-12T18:01:03.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.007+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/53152 2024-09-12T18:01:03.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16399805678719801174', time=2024-09-12T19:53:55.536222+0000, chain.objs.size()=1 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CnknT0ol3QwhpyLogI2ujFpKnHVo-LV_0 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7452555487707744098', time=2024-09-12T19:53:55.614434+0000, chain.objs.size()=1 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LdgmFLK33gbiaOcC9KSxh55wtPWUmMZ_0 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.154450633494728232', time=2024-09-12T19:53:55.769538+0000, chain.objs.size()=1 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gr7x9tivJLx-ouCBp8K20vABCvNQRN2_0 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.708471976663035215', time=2024-09-12T19:53:55.778731+0000, chain.objs.size()=1 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nLbCedQ_Tl4aWLEVTRTklZ87h3Xuhi7_0 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2083310996714797075', time=2024-09-12T19:53:55.782326+0000, chain.objs.size()=1 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.c90kMrTonKPdG_K07nLVdkbiH1559hv_0 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9478935119972294507', time=2024-09-12T19:53:55.796412+0000, chain.objs.size()=1 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6TIZCxre_Oivq9B0U4_ODY_DyUo6bB3_0 2024-09-12T18:01:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2301329653682648307', time=2024-09-12T19:53:55.800949+0000, chain.objs.size()=1 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uLInnWO5fUrtMR4XZyHtRLiLtaPPSqv_0 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7820313503628711081', time=2024-09-12T19:53:55.806136+0000, chain.objs.size()=1 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ipvbbN0WHR5lZlFssZ1sDVIHkLHl6ZT_0 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17768478030960361628', time=2024-09-12T19:53:55.902761+0000, chain.objs.size()=1 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Vg0cTLVSrgc5kYuPkN4dbUdy8NJXGxP_0 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14954207386327536378', time=2024-09-12T19:53:55.927404+0000, chain.objs.size()=1 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zkK_A1GPW9J6ZsnwiMDrzQYVjbmzh_U_0 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10233410177027176888', time=2024-09-12T19:53:55.955892+0000, chain.objs.size()=1 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.16XuUvsNfqwiGuqHKMkAnxdLRAsY2uR_0 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6487860687870623531', time=2024-09-12T19:53:56.119405+0000, chain.objs.size()=1 2024-09-12T18:01:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.009+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.m_zhy7IWrS8pQK9jBxkvC6GNINITX3__0 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8607421281779234604', time=2024-09-12T19:53:56.175745+0000, chain.objs.size()=1 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jnWUSRHMICYJO8yVKbuOAACISkQplJM_0 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11550742173657193677', time=2024-09-12T19:53:58.341424+0000, chain.objs.size()=1 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.336__shadow_.gfxTYyZFk7H1o2A4MEiozH8IwiPwuUu_0 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11643725595324584684', time=2024-09-12T19:54:00.384525+0000, chain.objs.size()=1 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.347__shadow_.ekP4-wheMj5SUa1j2xs5FJGBN01ErdQ_0 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11391569285451053581', time=2024-09-12T19:54:04.471737+0000, chain.objs.size()=1 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.373__shadow_.HnWz13wqiI-I5C87MqSWJBc1FQEd5pF_0 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6994601366120018723', time=2024-09-12T19:54:07.631090+0000, chain.objs.size()=1 2024-09-12T18:01:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.382__shadow_.s-hbQOsYNFQWCdHlohYD2fckfvxUiy7_0 2024-09-12T18:01:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13713674736844969615', time=2024-09-12T19:54:15.077502+0000, chain.objs.size()=1 2024-09-12T18:01:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.410__shadow_.FrGvGhq2LbjK00XJ5d17vLYEzwKRJPA_0 2024-09-12T18:01:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7006180452338250745', time=2024-09-12T19:54:31.212112+0000, chain.objs.size()=1 2024-09-12T18:01:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.013+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.MtgbHgtYCaoZ0-TZWB49ww8oPB_CTy4_0 2024-09-12T18:01:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13532693710952229767', time=2024-09-12T19:54:33.500804+0000, chain.objs.size()=1 2024-09-12T18:01:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.492__shadow_.ZOkOKe-kPJtoEZO0Tb-LBbqR5neOAor_0 2024-09-12T18:01:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3023640443243223319', time=2024-09-12T19:54:39.701425+0000, chain.objs.size()=1 2024-09-12T18:01:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.517__multipart_mymultipartcopy.2~JLyrL7vb_hdppyzpQutcQpw7kPa6eTU.1 2024-09-12T18:01:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7507426366275728230', time=2024-09-12T19:55:25.860251+0000, chain.objs.size()=3 2024-09-12T18:01:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.lbRXM9hsbeYHM4EVkAwNK1qiRsTpZue_0 2024-09-12T18:01:03.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.lbRXM9hsbeYHM4EVkAwNK1qiRsTpZue_1 2024-09-12T18:01:03.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.lbRXM9hsbeYHM4EVkAwNK1qiRsTpZue_2 2024-09-12T18:01:03.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6907487917896209936', time=2024-09-12T19:55:38.220290+0000, chain.objs.size()=1 2024-09-12T18:01:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:OrtLgGHTolAVHUB4j182zHFMEb8cv-p_.N1k-ntwtvhI8955XiUQm08DBe3b4etG_0 2024-09-12T18:01:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.680552207306860347', time=2024-09-12T19:55:46.809018+0000, chain.objs.size()=1 2024-09-12T18:01:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:Uap1VgIMNDdYKiHSUKY5UNm.0J5mtJQ_.KcSsw4-CDS97WEVa6pIBkZdBKM2962X_0 2024-09-12T18:01:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2255654582510009167', time=2024-09-12T19:55:49.550132+0000, chain.objs.size()=1 2024-09-12T18:01:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:OClxTXDCn8KB.Ka.C4tUmgq0nI4zJao_.nta_Coni0yNrv1cVbBXhEzfwV339bQP_0 2024-09-12T18:01:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17866802264779678419', time=2024-09-12T19:55:54.457804+0000, chain.objs.size()=1 2024-09-12T18:01:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.018+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:cs8taIqYSasH787afa-gXcrajFwYlR5_.IGwfaRZ5vQcnpB8ExNZOF40Ci5sBJBg_0 2024-09-12T18:01:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.019+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11081194745103236514', time=2024-09-12T19:56:03.377024+0000, chain.objs.size()=1 2024-09-12T18:01:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.019+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.583__shadow:4PK4FLUkRFEJ-ZfvwAfK7wyHPFUch1L_.HzUDli7dv_hoQpu5hR8VfSvX5i5XeTd_0 2024-09-12T18:01:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.019+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2417860042006033549', time=2024-09-12T19:58:31.270144+0000, chain.objs.size()=1 2024-09-12T18:01:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.019+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.669__shadow_.XLmQgNpVXr_NAP7BWNCsQZkbPCry0HI_0 2024-09-12T18:01:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18241537739455427829', time=2024-09-12T19:58:32.069134+0000, chain.objs.size()=1 2024-09-12T18:01:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.673__shadow_.dj9LfQ-pOxQYtVwRq01iKvQySSpl7XL_0 2024-09-12T18:01:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8150019297590512312', time=2024-09-12T19:58:39.440870+0000, chain.objs.size()=1 2024-09-12T18:01:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.709__shadow:w7D1hjHvwsV-.0rfi8uc6E1zOR2Wv6j_.eitmosiIM43TdZ-YLEO1MCsuSDgDtBD_0 2024-09-12T18:01:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5716834058838295992', time=2024-09-12T20:00:50.943731+0000, chain.objs.size()=1 2024-09-12T18:01:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.783__shadow_.ei0QmaJx9C3S8Ygt1ZLT5vz0uiKYIi9_0 2024-09-12T18:01:03.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.025+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.027+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:01:03.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.029+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.029+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52030' 2024-09-12T18:01:03.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9384038339826176448', time=2024-09-12T19:52:11.605552+0000, chain.objs.size()=1 2024-09-12T18:01:03.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.179__shadow_.xPAKKEgOekGwQVcE-awoLQT15OevOr3_0 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8364929890037537690', time=2024-09-12T19:52:13.451739+0000, chain.objs.size()=1 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.190__shadow_.D2iueK_22MlDhglyG6954pqdLlEmU5M_0 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12171603493464020662', time=2024-09-12T19:53:07.449080+0000, chain.objs.size()=1 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.236__shadow_.v6mTxW2R5MMxsDhqJ_qQeEXAuIrpnC5_0 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12825906916549772642', time=2024-09-12T19:53:08.771795+0000, chain.objs.size()=1 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.242__shadow_.4eV-4f6ljCGXF25d5JjTlTeNMAq6xvt_0 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.348774550005396587', time=2024-09-12T19:53:08.977446+0000, chain.objs.size()=1 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.243__shadow_.uRPXW2pehUvGFaodww3tKL5vjQSKsGI_0 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9366411192246779016', time=2024-09-12T19:53:09.237166+0000, chain.objs.size()=1 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.244__shadow_.3B04Y3Jg20q80QNglTPcfthDvAr9MJ__0 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10009829345708188279', time=2024-09-12T19:53:10.760537+0000, chain.objs.size()=1 2024-09-12T18:01:03.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.251__shadow_.ERdvdHS9JZ-ZMNEaq3ZAoGIsYFHN2U4_0 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7011082789995166636', time=2024-09-12T19:53:11.415896+0000, chain.objs.size()=1 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.254__shadow_.2MXARH4DIiPdVRHNb7uB6Ihn4_XF2xv_0 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13245578138122138752', time=2024-09-12T19:53:11.830394+0000, chain.objs.size()=1 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.256__shadow_.yreES3tLib4FfO9DJ0imHA0rg3Pl0PE_0 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15796978082015669458', time=2024-09-12T19:53:12.660413+0000, chain.objs.size()=1 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.260__shadow_.5ZeWhnvddcTGcLqloAUv5LvbgEV_ldZ_0 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16503854098619447374', time=2024-09-12T19:53:13.076856+0000, chain.objs.size()=1 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.262__shadow_.ZH_HEtQBxuZy6OzhYyCXHdA63GuxNkT_0 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16818998791528780017', time=2024-09-12T19:53:21.172998+0000, chain.objs.size()=1 2024-09-12T18:01:03.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.v9tb7nCxbvv2jKxyHNNguSK3FgCmKQ0_0 2024-09-12T18:01:03.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.033+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6682766037981457989', time=2024-09-12T19:53:21.190228+0000, chain.objs.size()=1 2024-09-12T18:01:03.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.033+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XvkpG6Y-mQLVmEMJ6QZm3Vy0bLQRuKJ_0 2024-09-12T18:01:03.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.033+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11264676829481224983', time=2024-09-12T19:53:21.203416+0000, chain.objs.size()=1 2024-09-12T18:01:03.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.033+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7ClcBOTvmbVGkkSxnsEcZtQXE_PgJo9_0 2024-09-12T18:01:03.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.034+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17449894266400362717', time=2024-09-12T19:53:21.270874+0000, chain.objs.size()=1 2024-09-12T18:01:03.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.034+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.R2Zp-2DhjgV5_pOIN1TfwpLATLeoEbN_0 2024-09-12T18:01:03.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.036+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10665262592404818960', time=2024-09-12T19:53:21.417237+0000, chain.objs.size()=1 2024-09-12T18:01:03.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.036+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zria0UUZaVgaCWYOq63ASpECeb2-YYW_0 2024-09-12T18:01:03.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.036+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2607791196947294283', time=2024-09-12T19:53:21.421329+0000, chain.objs.size()=1 2024-09-12T18:01:03.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.036+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ajZKzmth9wn93j1g1G6Ag3Us6_9QY6b_0 2024-09-12T18:01:03.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.036+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12805018136692155326', time=2024-09-12T19:53:21.434921+0000, chain.objs.size()=1 2024-09-12T18:01:03.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.036+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.k9XknGFoj99OEiJHBfs8K-k7Q_eFqYp_0 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8415131892165369726', time=2024-09-12T19:53:21.482623+0000, chain.objs.size()=1 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3IKJatY8kSlF6JgYY4Rh0Hw3D4iqXYw_0 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13607458288535358740', time=2024-09-12T19:53:21.486240+0000, chain.objs.size()=1 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LCgFTrIQNKLM2ueRXsItcEu-mlfSAuM_0 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16063120890540410427', time=2024-09-12T19:53:21.641054+0000, chain.objs.size()=1 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qvJN8F3DGHpCvLfCXQdVVt0q11tnhRi_0 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7003686972382117567', time=2024-09-12T19:53:21.661417+0000, chain.objs.size()=1 2024-09-12T18:01:03.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oLBy3NjPDWvtwnpnOEvATGDovmhz93z_0 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17529767526368951345', time=2024-09-12T19:53:21.686793+0000, chain.objs.size()=1 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yqCIPhJFm957yHlJkjjoZOfzNbE4p1w_0 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15099148707425754348', time=2024-09-12T19:53:21.782209+0000, chain.objs.size()=1 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ktUe2GfFjDQxv9-BtBXLirav8MaE2IR_0 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579232264042918209', time=2024-09-12T19:53:21.821833+0000, chain.objs.size()=1 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.eQUCgbsCakJngXBe5JwPLhW97ckdq6v_0 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8567159786516387053', time=2024-09-12T19:53:21.850821+0000, chain.objs.size()=1 2024-09-12T18:01:03.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nrVSlPQyjxHlHcGSayCycSRhcVdQ0k1_0 2024-09-12T18:01:03.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.040+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14163359343145311978', time=2024-09-12T19:53:22.007596+0000, chain.objs.size()=1 2024-09-12T18:01:03.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.040+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jbs9IE_PevSNFBSfPoa4dlSXQPFTJlT_0 2024-09-12T18:01:03.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.040+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14661134299345397051', time=2024-09-12T19:53:22.015569+0000, chain.objs.size()=1 2024-09-12T18:01:03.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.040+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0zajJjQQe1iqKDTrFGPBAqjGKaaEEYf_0 2024-09-12T18:01:03.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.041+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17034907849278991798', time=2024-09-12T19:53:22.020753+0000, chain.objs.size()=1 2024-09-12T18:01:03.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.041+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZujlXPiIhW2uM_VWwGTYFjzb3n-hKkj_0 2024-09-12T18:01:03.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13984962666542873550', time=2024-09-12T19:53:22.049338+0000, chain.objs.size()=1 2024-09-12T18:01:03.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Dke53NYyXRax-YJ6jMlqXh5NEquSS7v_0 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7696467289936650567', time=2024-09-12T19:53:22.071726+0000, chain.objs.size()=1 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wBkQqTJEzSBrKUKzsS8MzRKoBz61AXA_0 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.546545509688379134', time=2024-09-12T19:53:22.185927+0000, chain.objs.size()=1 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.P0P6YZATYgKFgNQzEhX1_EzU-LGCnwi_0 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9580976097250867272', time=2024-09-12T19:53:22.275770+0000, chain.objs.size()=1 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.coB-q4LlY7NoSkdqmHOP2nRFQTIqU9w_0 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16561342425902215015', time=2024-09-12T19:53:22.383291+0000, chain.objs.size()=1 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Z29Efz7JV3J6AAXxKnZ2UBZ7WHp5bgJ_0 2024-09-12T18:01:03.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12447669635292623475', time=2024-09-12T19:53:22.428080+0000, chain.objs.size()=1 2024-09-12T18:01:03.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.A1b18uhZm4EWiueDIC8_-_KvyHByphO_0 2024-09-12T18:01:03.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.043+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6088675437348371462', time=2024-09-12T19:53:22.431224+0000, chain.objs.size()=1 2024-09-12T18:01:03.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.043+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-3VOUHazb33JtBdZzULdI-EZ0dzNFmk_0 2024-09-12T18:01:03.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.043+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15404894508116902695', time=2024-09-12T19:53:22.445649+0000, chain.objs.size()=1 2024-09-12T18:01:03.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.043+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MZqCuE4GkI4VahMX5gCn3mxtHtGg65r_0 2024-09-12T18:01:03.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.044+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15540624939924077448', time=2024-09-12T19:53:22.483331+0000, chain.objs.size()=1 2024-09-12T18:01:03.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.044+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.T352TWTC3nA48kGbgJsOndQdUNV7A9Z_0 2024-09-12T18:01:03.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.046+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11154337210366608360', time=2024-09-12T19:53:22.585438+0000, chain.objs.size()=1 2024-09-12T18:01:03.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.046+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rSN62c1__n_BOlDXIdpQZafuy7Wj3xX_0 2024-09-12T18:01:03.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.046+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16346936433784165112', time=2024-09-12T19:53:22.595291+0000, chain.objs.size()=1 2024-09-12T18:01:03.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.046+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dpAtcgV61LOlJQZlHQHUutiW0qskrbq_0 2024-09-12T18:01:03.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.047+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9273036764434391228', time=2024-09-12T19:53:22.616986+0000, chain.objs.size()=1 2024-09-12T18:01:03.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.047+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.uxVzV7vr16G4jShUB-a2MtQDkP40NL9_0 2024-09-12T18:01:03.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15892358556573836231', time=2024-09-12T19:53:22.655203+0000, chain.objs.size()=1 2024-09-12T18:01:03.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rZ8QLhoUmKHdORo7CtyBAqqAYtL_1Ee_0 2024-09-12T18:01:03.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11700177334876141072', time=2024-09-12T19:53:22.672283+0000, chain.objs.size()=1 2024-09-12T18:01:03.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.eIVmbEIvcCUN33ETD5o1wrmwVI-AdUw_0 2024-09-12T18:01:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8003328077158047838', time=2024-09-12T19:53:22.846858+0000, chain.objs.size()=1 2024-09-12T18:01:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.264__shadow_._TFbSrrEuE4i1m3krRQaYczwQbFUTIG_0 2024-09-12T18:01:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15396679728321048940', time=2024-09-12T19:53:28.136098+0000, chain.objs.size()=1 2024-09-12T18:01:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.289__shadow_.M5-Z7zPh5i6k1gKTiWpjBj7_SrQo5zR_0 2024-09-12T18:01:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6703697454313085973', time=2024-09-12T19:53:28.546428+0000, chain.objs.size()=1 2024-09-12T18:01:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.291__shadow_.E4icDG4cVNrR2KQQ6PJtbXTyS2VgTt-_0 2024-09-12T18:01:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10223528784407162134', time=2024-09-12T19:53:29.354319+0000, chain.objs.size()=1 2024-09-12T18:01:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.050+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.w6WhGzr4WDGhnwKCwGkuxh2Bi-hIQAV_0 2024-09-12T18:01:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8586397344685590021', time=2024-09-12T19:53:29.943294+0000, chain.objs.size()=1 2024-09-12T18:01:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.SfbkkN_Bt2V5rMnk1v1DGgwqqJ6b2Ay_0 2024-09-12T18:01:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18073725884278921088', time=2024-09-12T19:53:29.955068+0000, chain.objs.size()=1 2024-09-12T18:01:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.IAlIzoqI5TcnFRiq1e8vmDyNEJIbz1S_0 2024-09-12T18:01:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10214053196357765784', time=2024-09-12T19:53:30.576907+0000, chain.objs.size()=1 2024-09-12T18:01:03.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.297__shadow_.7Z4vM_C0JSRz7olhNZPqFSjtVxo12nS_0 2024-09-12T18:01:03.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16170962696042979718', time=2024-09-12T19:53:35.451903+0000, chain.objs.size()=1 2024-09-12T18:01:03.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.320__shadow:mzMwGWKz9viu5AliJ-Q3oiINfo2uVky_.qnLQvI2ktHNQYXlPfXfn6-tdP22jBam_0 2024-09-12T18:01:03.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17106876422074655318', time=2024-09-12T19:53:44.553098+0000, chain.objs.size()=1 2024-09-12T18:01:03.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3gw4mhqhLCRl4DFfIBhnG8_GNprNQct_0 2024-09-12T18:01:03.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12546581667903482673', time=2024-09-12T19:53:44.563935+0000, chain.objs.size()=1 2024-09-12T18:01:03.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.051+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.L1BTP8rW4RfDxCTivXDIAKgnQ8A13ZN_0 2024-09-12T18:01:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.054+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7350272285263058845', time=2024-09-12T19:53:44.606017+0000, chain.objs.size()=1 2024-09-12T18:01:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.054+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mrO6dWx_yHvI6BjEn6vMRTrcJs9W1-x_0 2024-09-12T18:01:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.054+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13526461658194735870', time=2024-09-12T19:53:44.634929+0000, chain.objs.size()=1 2024-09-12T18:01:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.054+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ms-5NLn5xf8V3lb7ZUbKFGvJUN5pLHm_0 2024-09-12T18:01:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.055+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14465453879813516774', time=2024-09-12T19:53:44.642653+0000, chain.objs.size()=1 2024-09-12T18:01:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.055+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kSg4b8k-WpqpT-jkGB-8VTeIcDmnIHJ_0 2024-09-12T18:01:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.055+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4397646003336605484', time=2024-09-12T19:53:44.948189+0000, chain.objs.size()=1 2024-09-12T18:01:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.055+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cKJpHc2QXigTrUE2K302A4Wdua6YKLa_0 2024-09-12T18:01:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.055+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18041841324423649675', time=2024-09-12T19:53:44.962907+0000, chain.objs.size()=1 2024-09-12T18:01:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.055+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tJYSIL9JXNvpG-2yoDQQPz8c_18Ljif_0 2024-09-12T18:01:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.056+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2677293442782569163', time=2024-09-12T19:53:44.963573+0000, chain.objs.size()=1 2024-09-12T18:01:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.056+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UMpJDKWgYl3Gr1D1CO6gHlY-C3xBKsF_0 2024-09-12T18:01:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.056+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13494514874513821976', time=2024-09-12T19:53:45.023431+0000, chain.objs.size()=1 2024-09-12T18:01:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.056+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CbIgJXS58C3QcCMBnuz3DmqMrnGwjWI_0 2024-09-12T18:01:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3316404882870238868', time=2024-09-12T19:53:45.025827+0000, chain.objs.size()=1 2024-09-12T18:01:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.A6xiqI9nrM1SrvOzla-0Zl-RieUP3YR_0 2024-09-12T18:01:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4051964455283874215', time=2024-09-12T19:53:45.045722+0000, chain.objs.size()=1 2024-09-12T18:01:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Nb71PQNoE2p4dKvIAbsSuutP3i7fOm__0 2024-09-12T18:01:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17103558587562079971', time=2024-09-12T19:53:45.129084+0000, chain.objs.size()=1 2024-09-12T18:01:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7y0icbz_6k0b6CpWOvjxa0MvQNu8rtT_0 2024-09-12T18:01:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9513217978268621232', time=2024-09-12T19:53:45.131038+0000, chain.objs.size()=1 2024-09-12T18:01:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.057+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xF8FToS4nqvVViQQ2sYgbvYyE3MhRFY_0 2024-09-12T18:01:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13076412852997568332', time=2024-09-12T19:53:45.216401+0000, chain.objs.size()=1 2024-09-12T18:01:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8Azx526bjxP_ZU7_ILgj2gYR30ooYUT_0 2024-09-12T18:01:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17051980235213832581', time=2024-09-12T19:53:45.355581+0000, chain.objs.size()=1 2024-09-12T18:01:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pGZMRSs9rfedwbN8WgIn5WCJkYbZqJV_0 2024-09-12T18:01:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.061+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9291019892426397011', time=2024-09-12T19:53:45.402404+0000, chain.objs.size()=1 2024-09-12T18:01:03.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.061+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.v_EtUFHU1ahx1SUBQRPKcP7U7iI1vBv_0 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.062+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13516043087663873631', time=2024-09-12T19:53:45.434325+0000, chain.objs.size()=1 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.062+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.X09wv1stm5cCrjfq3RrtfishMC8eYCa_0 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.062+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4242196414908604371', time=2024-09-12T19:53:45.591309+0000, chain.objs.size()=1 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wtLk9BDTGsnAkbzFM4XqWTw5cdACwdU_0 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13237096782652535942', time=2024-09-12T19:53:45.656430+0000, chain.objs.size()=1 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iDFnT1zjbEkwbLNU0c3GfNCNDeScCgS_0 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15110552085156921910', time=2024-09-12T19:53:45.660658+0000, chain.objs.size()=1 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fE-ajG75FI1gMOYcd2YEi7kHbS776x-_0 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8195460499521284781', time=2024-09-12T19:53:45.758792+0000, chain.objs.size()=1 2024-09-12T18:01:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.glIuiXM2j8D60wXZBPBDqyrZ366TDTK_0 2024-09-12T18:01:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12732825897429277338', time=2024-09-12T19:53:45.781602+0000, chain.objs.size()=1 2024-09-12T18:01:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XBkFHvrEeK9j0-KMvMfKNa4R01sL_DK_0 2024-09-12T18:01:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14134308575495477006', time=2024-09-12T19:53:45.794370+0000, chain.objs.size()=1 2024-09-12T18:01:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.o9AoFKmpCsOjdKXe7STO4APAXRyWz1g_0 2024-09-12T18:01:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16759816436431068379', time=2024-09-12T19:53:45.821521+0000, chain.objs.size()=1 2024-09-12T18:01:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8-ZhDQu4E5a0pNovqLKXTJWc1JNIQo9_0 2024-09-12T18:01:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.065+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5881014123525966986', time=2024-09-12T19:53:45.824933+0000, chain.objs.size()=1 2024-09-12T18:01:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.065+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6x4wHy6WnpwD54QWl02gfM5CBNhAKw7_0 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7712277321417622595', time=2024-09-12T19:53:45.851976+0000, chain.objs.size()=1 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TOj-Bg76KEL5MWetll5vu3CAaab5z2-_0 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3340819345219292395', time=2024-09-12T19:53:45.952135+0000, chain.objs.size()=1 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pVm9dpvbGBhv1Pww39t5MHeWiZbPcV8_0 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1149856461499504796', time=2024-09-12T19:53:45.968613+0000, chain.objs.size()=1 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dG20A_0MyGS9Lhk2YD6StAp0z1awycE_0 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.311763434118395200', time=2024-09-12T19:53:45.969476+0000, chain.objs.size()=1 2024-09-12T18:01:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.h6cx_1V2MPXBHd6JmR03MuyL2Sp0635_0 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4889407041285261007', time=2024-09-12T19:53:46.026507+0000, chain.objs.size()=1 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DNq7bFSFJ7psvWzcqcMzGxD9mh2Fmlr_0 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13672589290755765059', time=2024-09-12T19:53:46.033507+0000, chain.objs.size()=1 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Gsf7JDAXXNF3Y8cfw_1A9YuzotCHA5v_0 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1995873436985102457', time=2024-09-12T19:53:46.039665+0000, chain.objs.size()=1 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kQm-hD8NULbCdeQzy50arlLzFU7K7Pr_0 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11482488585517915124', time=2024-09-12T19:53:46.062850+0000, chain.objs.size()=1 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5AyFHH0qFzNBZFQcvc7tG_EKnuhePzo_0 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9171139272398568851', time=2024-09-12T19:53:46.164003+0000, chain.objs.size()=1 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.us6YuRTY9H6fAJldZ6gss4oSMWWDwEB_0 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3963320236524576203', time=2024-09-12T19:53:46.209070+0000, chain.objs.size()=1 2024-09-12T18:01:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WATdEDFXfCZADLaEournon21nCbE6Kf_0 2024-09-12T18:01:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.070+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14880363180193603657', time=2024-09-12T19:53:46.223628+0000, chain.objs.size()=1 2024-09-12T18:01:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.070+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dcUhz6dA336YgWgSb98WONKHKZieFnC_0 2024-09-12T18:01:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16390587887362302015', time=2024-09-12T19:53:54.683328+0000, chain.objs.size()=1 2024-09-12T18:01:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9BtN9KsHbBRBlCIFnku0lqLiolF1zzG_0 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16244711222441712671', time=2024-09-12T19:53:54.711280+0000, chain.objs.size()=1 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8wPoswvXEaKh5v8ej-ez9r3uQDc0HMI_0 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16101242592729232541', time=2024-09-12T19:53:54.717479+0000, chain.objs.size()=1 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rIU6kSmOSb-2zsT5BfmSJ1vWVSSOddR_0 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6734002205460007100', time=2024-09-12T19:53:54.741433+0000, chain.objs.size()=1 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.koaNC-slCWhcmPYmvqrf-sOcKKti1zj_0 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.587821752602847734', time=2024-09-12T19:53:54.920451+0000, chain.objs.size()=1 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.h71eCOfxxtaUES1zzN81aYsD9Y1PCjf_0 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5442604495904724122', time=2024-09-12T19:53:55.137751+0000, chain.objs.size()=1 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tDN6pA5d_-eQu_uei8bq67S_fnCzxBu_0 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4231647594180249970', time=2024-09-12T19:53:55.151812+0000, chain.objs.size()=1 2024-09-12T18:01:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HEa_xoMCQSxO_xPk6AFUALCRG67d9yC_0 2024-09-12T18:01:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3469886231297936061', time=2024-09-12T19:53:55.260030+0000, chain.objs.size()=1 2024-09-12T18:01:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vauK5VMTNBmUi5FnkFET2kl1OzBq908_0 2024-09-12T18:01:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12168033415695719582', time=2024-09-12T19:53:55.269726+0000, chain.objs.size()=1 2024-09-12T18:01:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8wY3eFuOFES9qt6W9U9YA0y1DhDypZd_0 2024-09-12T18:01:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12179105047556874092', time=2024-09-12T19:53:55.274941+0000, chain.objs.size()=1 2024-09-12T18:01:03.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4sZdjDoefb3uPxr1hg74YGM7zCHWHlg_0 2024-09-12T18:01:03.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2064447825184585121', time=2024-09-12T19:53:55.361446+0000, chain.objs.size()=1 2024-09-12T18:01:03.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.075+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aULpufL2RCq-7PzV6zp5dRRDEnjB1wx_0 2024-09-12T18:01:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18446224181030119223', time=2024-09-12T19:53:55.362192+0000, chain.objs.size()=1 2024-09-12T18:01:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nILwN8CS6jZy31zYACxqxHcuvP3t_RR_0 2024-09-12T18:01:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13991276435987605003', time=2024-09-12T19:53:55.375504+0000, chain.objs.size()=1 2024-09-12T18:01:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.u-O4TSaiLSc6Pn04Uz_10Khg-Dfm-RO_0 2024-09-12T18:01:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/52030 2024-09-12T18:01:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T18:01:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.555033266856832337', time=2024-09-12T19:53:55.376214+0000, chain.objs.size()=1 2024-09-12T18:01:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.thsgkv3EejRDwGS14Wgr4lgZlMDxrFj_0 2024-09-12T18:01:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7407474279867926637', time=2024-09-12T19:53:55.502538+0000, chain.objs.size()=1 2024-09-12T18:01:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.50SaisC5J_YiPIQ1II4Ex2INxfdAZPk_0 2024-09-12T18:01:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11552566765204695974', time=2024-09-12T19:53:55.583351+0000, chain.objs.size()=1 2024-09-12T18:01:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.32Rp0tBPrdGIT7qHjJk-n7B-gmSgkmK_0 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14472554508456781016', time=2024-09-12T19:53:55.584040+0000, chain.objs.size()=1 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.owjJjST44D22q9DvOhwtONhjj3eptfb_0 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9990225574286701609', time=2024-09-12T19:53:55.590019+0000, chain.objs.size()=1 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QdI0ih1WmMDOgDFz54GEUa5Yc1Vs7dr_0 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15307133116986330386', time=2024-09-12T19:53:55.703041+0000, chain.objs.size()=1 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lDxrPU8JEQGdJEJ4IImOow-lSq1O6g3_0 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3670283861062680911', time=2024-09-12T19:53:55.721535+0000, chain.objs.size()=1 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xoTmRwmWP4ilUqVs8W_AR1yf86131rz_0 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9522437416758951036', time=2024-09-12T19:53:55.760369+0000, chain.objs.size()=1 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aaE3mnmr0O3TxtDtlO7_NT5daR39e9G_0 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10446382594480240346', time=2024-09-12T19:53:55.776024+0000, chain.objs.size()=1 2024-09-12T18:01:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GtM-GoRjse6kPIIZeE8V-JJF3GkBttL_0 2024-09-12T18:01:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14068130061209038217', time=2024-09-12T19:53:55.825797+0000, chain.objs.size()=1 2024-09-12T18:01:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.H_km9qJ9KTEZuOBi036xvKfocmytiH1_0 2024-09-12T18:01:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13343287366466690885', time=2024-09-12T19:53:55.944157+0000, chain.objs.size()=1 2024-09-12T18:01:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-wb8Krlk9mKbl3tWJ_jtd3F653gT9qW_0 2024-09-12T18:01:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2759095901193226171', time=2024-09-12T19:53:55.963554+0000, chain.objs.size()=1 2024-09-12T18:01:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LW8MboNT5FcMWxeW9Pto9Z07H-Ca7UP_0 2024-09-12T18:01:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14717400359565268894', time=2024-09-12T19:53:55.973994+0000, chain.objs.size()=1 2024-09-12T18:01:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.UJ6njLH0CI7PcUjp3nTjHt9jOHeZ0f0_0 2024-09-12T18:01:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6596500764405233', time=2024-09-12T19:53:56.151709+0000, chain.objs.size()=1 2024-09-12T18:01:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mSR6YvjxkE0zJ_r0IeQTC74D8LVOcU6_0 2024-09-12T18:01:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5153989203248193809', time=2024-09-12T19:53:56.183062+0000, chain.objs.size()=1 2024-09-12T18:01:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MfmORZypT58RkAIqx1bj5f2Ik9ZrPPD_0 2024-09-12T18:01:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17010019906030027219', time=2024-09-12T19:53:56.192040+0000, chain.objs.size()=1 2024-09-12T18:01:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SbF8ObrpJNMg9KWSBJXrsxPO59Lk3sA_0 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.088+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14394646015980263807', time=2024-09-12T19:53:57.039558+0000, chain.objs.size()=1 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.088+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.330__shadow_.0fe9RFv6pvCy0e5Kf4tPcsR9C-1461k_0 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.088+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2459113214323135570', time=2024-09-12T19:53:58.740118+0000, chain.objs.size()=1 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.088+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.338__shadow_.65mt7q1p4mYbwjfnKMKY7o8NU6udGUf_0 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.088+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6331461805457308356', time=2024-09-12T19:54:09.532216+0000, chain.objs.size()=1 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.088+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.391__shadow_.-a1b78L7qg0Fx8aaohyol9lSSsQ-vwe_0 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.088+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14909624226792812289', time=2024-09-12T19:54:28.478405+0000, chain.objs.size()=1 2024-09-12T18:01:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.089+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.467__shadow_.PiGZvTf3WGM-XqUdpAW8TDWU0CFJ-UI_0 2024-09-12T18:01:03.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.089+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8765318189641131660', time=2024-09-12T19:54:28.479172+0000, chain.objs.size()=1 2024-09-12T18:01:03.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.089+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.467__shadow_.kgwXWOjZ1ibn0i56fvZT1xqvhiaRzO3_0 2024-09-12T18:01:03.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.089+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9789154292957321124', time=2024-09-12T19:54:30.384348+0000, chain.objs.size()=1 2024-09-12T18:01:03.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.089+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.482__shadow_.ZvJ5FgwFc3qNLSvdnEtGqrVoK5_Inwg_0 2024-09-12T18:01:03.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.089+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14747202267038601906', time=2024-09-12T19:54:31.212599+0000, chain.objs.size()=1 2024-09-12T18:01:03.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.089+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.-zPp4h3HIJgP9su-GLR-TSzis_aOVE4_0 2024-09-12T18:01:03.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15540022907499549363', time=2024-09-12T19:54:32.052910+0000, chain.objs.size()=1 2024-09-12T18:01:03.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.487__shadow_.Ener0fpf7FHC39Opu_zCqnCqQ9OrnDt_0 2024-09-12T18:01:03.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14775751189602542602', time=2024-09-12T19:54:34.711690+0000, chain.objs.size()=1 2024-09-12T18:01:03.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.498__shadow_.eTARI9fRv4hTIsPGY7GgsE0nvhwRJQL_0 2024-09-12T18:01:03.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14873643088630644627', time=2024-09-12T19:54:51.767394+0000, chain.objs.size()=3 2024-09-12T18:01:03.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~opq_0x3eGBt4Ct4XyrNzqu0OiJVsslo.1 2024-09-12T18:01:03.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~opq_0x3eGBt4Ct4XyrNzqu0OiJVsslo.2 2024-09-12T18:01:03.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~opq_0x3eGBt4Ct4XyrNzqu0OiJVsslo.3 2024-09-12T18:01:03.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12210164821208129089', time=2024-09-12T19:55:33.639003+0000, chain.objs.size()=1 2024-09-12T18:01:03.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:y43OXo76GNpwiktm3NkS.LQqrenICaO_.hTvApGj8w8bqHhs9t08_PZ3qdtLdhS1_0 2024-09-12T18:01:03.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2278421924896513576', time=2024-09-12T19:55:45.248284+0000, chain.objs.size()=1 2024-09-12T18:01:03.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.092+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:YnCNehrlteGxzk56oS09235oGMYytXL_.5hZXGGGqvn0oA7ce0ioqJ3rS8qiYqYl_0 2024-09-12T18:01:03.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3979038022123589616', time=2024-09-12T19:55:48.939587+0000, chain.objs.size()=1 2024-09-12T18:01:03.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:E4zDBYxdA4.Cm.rw5cJ1uGMopc25o0w_.NddeCEq9tXACyCMC_S3fyRGAzdAApoj_0 2024-09-12T18:01:03.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12707722684439903133', time=2024-09-12T19:55:56.283939+0000, chain.objs.size()=1 2024-09-12T18:01:03.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:wdGdt6dpYCDxe78BI-meY4-fNL2512g_.PTCCb_aDxIfHGAvbB5rw4vu6ZF4xyV4_0 2024-09-12T18:01:03.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.096+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16257431026540655075', time=2024-09-12T19:56:04.948188+0000, chain.objs.size()=1 2024-09-12T18:01:03.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.096+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.587__shadow:gJtuFdRCFurUaC5Fa9XdmLOl4-kaAtJ_.jGJOdduurdSioRLbkPYRSZPfomwFGy7_0 2024-09-12T18:01:03.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.096+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8811160037846451233', time=2024-09-12T19:58:23.229238+0000, chain.objs.size()=1 2024-09-12T18:01:03.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.096+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.645__shadow_.TWEpjypAafth90Vd8qHyiSFJhm-goUI_0 2024-09-12T18:01:03.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.098+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14382227053072315332', time=2024-09-12T19:58:39.656715+0000, chain.objs.size()=1 2024-09-12T18:01:03.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.098+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.710__shadow_.nlOE1XPdC3RMNfLSsd2VU6ywpeDatHH_0 2024-09-12T18:01:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.103+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:01:03.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.104+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49037' 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10958866715446510192', time=2024-09-12T19:51:56.686158+0000, chain.objs.size()=1 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159__shadow_.QoGBxslcq4716caET2yxybQgbcovxqR_0 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14775509649489074621', time=2024-09-12T19:51:57.676871+0000, chain.objs.size()=5 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-LUKEWARM.2~889Kru3cT9YGTPSCLcGShy-DkfKUAM5.1 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__shadow_mymultipart-LUKEWARM.2~889Kru3cT9YGTPSCLcGShy-DkfKUAM5.1_1 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-LUKEWARM.2~889Kru3cT9YGTPSCLcGShy-DkfKUAM5.2 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__shadow_mymultipart-LUKEWARM.2~889Kru3cT9YGTPSCLcGShy-DkfKUAM5.2_1 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-LUKEWARM.2~889Kru3cT9YGTPSCLcGShy-DkfKUAM5.3 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1234445007540535303', time=2024-09-12T19:52:01.190678+0000, chain.objs.size()=1 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.167__shadow_.xgng0TJ2lQJ0BuRAPdoQqyokLebL1Dv_0 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2314232515015205337', time=2024-09-12T19:52:01.340785+0000, chain.objs.size()=1 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.167__shadow_.pE-DLMDhLalcqEChbGJaBgsEFDeOV9c_0 2024-09-12T18:01:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2511600549925676953', time=2024-09-12T19:53:07.448812+0000, chain.objs.size()=1 2024-09-12T18:01:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.236__shadow_.bVn3jUCn0NkCl7WJoO2rWnloTzY4KtY_0 2024-09-12T18:01:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.106+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17805928862597634742', time=2024-09-12T19:53:09.944699+0000, chain.objs.size()=1 2024-09-12T18:01:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.247__shadow_.m7Ku1abisanceW8Rxi4W2w1PBSjYtB8_0 2024-09-12T18:01:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.106+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3260251010221532198', time=2024-09-12T19:53:11.621649+0000, chain.objs.size()=1 2024-09-12T18:01:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.255__shadow_.AzWaXAntm4OP8BHrZMhdM8dkC00UpVH_0 2024-09-12T18:01:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.106+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12038195622051908011', time=2024-09-12T19:53:12.868296+0000, chain.objs.size()=1 2024-09-12T18:01:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.261__shadow_.EGx6ldXTXOiwsETDwUwtdlaOjuxku3e_0 2024-09-12T18:01:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.108+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5625387023420095611', time=2024-09-12T19:53:21.176372+0000, chain.objs.size()=1 2024-09-12T18:01:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.108+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JkpiqcnR68vL7Lrt2W-qz0sFjHpleyM_0 2024-09-12T18:01:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.109+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15238069798768694594', time=2024-09-12T19:53:21.260474+0000, chain.objs.size()=1 2024-09-12T18:01:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.109+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DvTYq8ak1B19vNvsK-PzU9KbjX7n3li_0 2024-09-12T18:01:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.109+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11882866145471743641', time=2024-09-12T19:53:21.285628+0000, chain.objs.size()=1 2024-09-12T18:01:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.109+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZyBSBbuDYxe43FiuAxYQcRPGdX-A4TX_0 2024-09-12T18:01:03.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.109+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8888026958243188970', time=2024-09-12T19:53:21.381389+0000, chain.objs.size()=1 2024-09-12T18:01:03.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.109+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.t4A3Ijl5bol5b29P8sd_aaXtqLbVE1x_0 2024-09-12T18:01:03.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4555523429074409730', time=2024-09-12T19:53:21.445611+0000, chain.objs.size()=1 2024-09-12T18:01:03.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dPz4W2L3pkyEUyy_-bZqK9whlN5DyxC_0 2024-09-12T18:01:03.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9916180278357833615', time=2024-09-12T19:53:21.458100+0000, chain.objs.size()=1 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yw136gzQqRsuLCJdDFZOWf3IxxH-8hK_0 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9334665236365745129', time=2024-09-12T19:53:21.471925+0000, chain.objs.size()=1 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4MAVPTeVp6L7XU9XnTIRFNH7YDtY_WH_0 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.941882922586221844', time=2024-09-12T19:53:21.486499+0000, chain.objs.size()=1 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WoJsAPVR6EPNidbZQpQZpQldAsRV8KQ_0 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6902487892591187528', time=2024-09-12T19:53:21.594187+0000, chain.objs.size()=1 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.E-GRW1gnhab-rfU0wAkIsc_87cvhn_6_0 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4024258351485270582', time=2024-09-12T19:53:21.821369+0000, chain.objs.size()=1 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.V97sTfNOK35Wtv1foKcQHtoDDkNJwch_0 2024-09-12T18:01:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11312065247382883308', time=2024-09-12T19:53:21.887475+0000, chain.objs.size()=1 2024-09-12T18:01:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.V0PzBOsBDWxvkcU_pkKcOPSVtuqCedF_0 2024-09-12T18:01:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.112+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13400559092558768040', time=2024-09-12T19:53:21.996148+0000, chain.objs.size()=1 2024-09-12T18:01:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.112+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pClCzx9VEE66rJ-oRiTBpczzVFTwpcx_0 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1465816762195951345', time=2024-09-12T19:53:22.002896+0000, chain.objs.size()=1 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.sQdb1DMrfynYEE_rzV71oeK1rvvd8KO_0 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18173141503598525139', time=2024-09-12T19:53:22.010041+0000, chain.objs.size()=1 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7pPTXdIth2unHHTXPXziblZUvmmP2RU_0 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7420480433824772514', time=2024-09-12T19:53:22.024893+0000, chain.objs.size()=1 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1O7wnMkGeZYHmAbqougOSjbOsEgVzG8_0 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10085606794027542379', time=2024-09-12T19:53:22.079583+0000, chain.objs.size()=1 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Hdw4v20YNAuE9pODGOXQmqWGk-t6tHX_0 2024-09-12T18:01:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10642307790408771275', time=2024-09-12T19:53:22.254158+0000, chain.objs.size()=1 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YH4KSEomXx5kKrcF0P_fPOJbzuuegla_0 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11336873552725032029', time=2024-09-12T19:53:22.259101+0000, chain.objs.size()=1 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gPbu8Kg0chqRwWHYSzDmOoEUuKeVacY_0 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14690853843733839348', time=2024-09-12T19:53:22.283542+0000, chain.objs.size()=1 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HhKFDKP-mgQ0npHVdNHMTOffd897SVm_0 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12365347647129841736', time=2024-09-12T19:53:22.299127+0000, chain.objs.size()=1 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RpCF1QC8t1YHgzMXPeXpUMR06wq2CGA_0 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9135537258261391521', time=2024-09-12T19:53:22.452189+0000, chain.objs.size()=1 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.x2q-v0lHiV05u5rPbH-ZPnE4F_dzpP3_0 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6982346927516775484', time=2024-09-12T19:53:22.496034+0000, chain.objs.size()=1 2024-09-12T18:01:03.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xf2uM0rBZg1WFcrXS-SdVB2U7b_RNWs_0 2024-09-12T18:01:03.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17523107590588664945', time=2024-09-12T19:53:22.588013+0000, chain.objs.size()=1 2024-09-12T18:01:03.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.115+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.O2iiWyZPWEAw75amluOQ_ZlfH7PkJ10_0 2024-09-12T18:01:03.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.118+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.780623256649756328', time=2024-09-12T19:53:22.594840+0000, chain.objs.size()=1 2024-09-12T18:01:03.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.118+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CUZW_Z16bIhBeVtTfiPZOMz3VWzIMeO_0 2024-09-12T18:01:03.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.118+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6348404374989765289', time=2024-09-12T19:53:22.615564+0000, chain.objs.size()=1 2024-09-12T18:01:03.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.118+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XGvIUIFEZ5E8G87IDJYxukfS1mli7Vu_0 2024-09-12T18:01:03.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.118+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1873846914244510494', time=2024-09-12T19:53:22.621136+0000, chain.objs.size()=1 2024-09-12T18:01:03.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.118+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.73gKgSV3AvsaTo_IbnFrsqpaA9uNF1Z_0 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3931520541592206444', time=2024-09-12T19:53:22.626671+0000, chain.objs.size()=1 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kH_nvivpwSzrhITe5R1aH0yryhPq0S7_0 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5501109192201954827', time=2024-09-12T19:53:22.631535+0000, chain.objs.size()=1 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Xl2auatJ40Zo5rT2c0fufdfDU53U_Sh_0 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6868396007215161993', time=2024-09-12T19:53:22.683859+0000, chain.objs.size()=1 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.eUaQtKUxvFkYHXRslkCq8OAA_mRLg6w_0 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17614282546289472038', time=2024-09-12T19:53:24.070754+0000, chain.objs.size()=1 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.270__shadow_.JruPAw6Im17dR1r1HDdb9hDh0_3-aji_0 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1985087480666725984', time=2024-09-12T19:53:29.954544+0000, chain.objs.size()=1 2024-09-12T18:01:03.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.kPyp6_6ZZF27cEOCl7pXj1sNMPvrUcw_0 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7149093160755929606', time=2024-09-12T19:53:44.527770+0000, chain.objs.size()=1 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.P7o1YU9AoTzIHhs7cRWoFUOfyXwRK-x_0 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17433428306675976857', time=2024-09-12T19:53:44.954812+0000, chain.objs.size()=1 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lp5F8vDj6SznquE_UAonT5eptuqBznJ_0 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15871758755114693666', time=2024-09-12T19:53:44.995935+0000, chain.objs.size()=1 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.122+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.rD1He5h4mFrL_c5dN6b-VntrhV9e3nd_0 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.123+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17680847434562430487', time=2024-09-12T19:53:45.019440+0000, chain.objs.size()=1 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.123+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bBYkAXfh5PB6oW7zPnPet64HbfSik_Y_0 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.124+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6539511881286736228', time=2024-09-12T19:53:45.036674+0000, chain.objs.size()=1 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.124+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DXxWY5ICStgYCINkdjzDQDii39jbE4Y_0 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.124+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18353978344163350114', time=2024-09-12T19:53:45.042389+0000, chain.objs.size()=1 2024-09-12T18:01:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.124+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7sdSoQAwYYqh2Ao-fMbyy4dpTeKtbON_0 2024-09-12T18:01:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.126+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18144695098411226563', time=2024-09-12T19:53:45.338277+0000, chain.objs.size()=1 2024-09-12T18:01:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.126+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4zMV8mQ7yauENpanLQDfjjqWf-YvLoA_0 2024-09-12T18:01:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.126+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7465330162590744299', time=2024-09-12T19:53:45.364291+0000, chain.objs.size()=1 2024-09-12T18:01:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.126+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.c4NoAmyvEXxKMyYqaHPFOVSmsBDBjmk_0 2024-09-12T18:01:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7288511460731269295', time=2024-09-12T19:53:45.394171+0000, chain.objs.size()=1 2024-09-12T18:01:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MVd5DLNEwq5sEkwHZA0Xi41KP3DxLQc_0 2024-09-12T18:01:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4748385692351668666', time=2024-09-12T19:53:45.408310+0000, chain.objs.size()=1 2024-09-12T18:01:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.A0k2es1gfi4VLbKRyAinEYKLeQdpGg5_0 2024-09-12T18:01:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9498116220354588105', time=2024-09-12T19:53:45.558807+0000, chain.objs.size()=1 2024-09-12T18:01:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RRT6aSZBTjMjxwMdwtz0OHF3ii9e1_U_0 2024-09-12T18:01:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17711241077195619449', time=2024-09-12T19:53:45.570500+0000, chain.objs.size()=1 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hokWSwGV8D0y2aynVuPkYxU1EIBDBK8_0 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.781187394281290775', time=2024-09-12T19:53:45.572870+0000, chain.objs.size()=1 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GMlqLeKs3kN18x4zrSDRBasTnHDqI5K_0 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12610188352827261032', time=2024-09-12T19:53:45.645581+0000, chain.objs.size()=1 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gCVYlFnL56L5NTkhfIgwqOgHYd3F5Sv_0 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7527801657299995104', time=2024-09-12T19:53:45.661285+0000, chain.objs.size()=1 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9O_ndAoK5s186nPo443KvhOq8wCEKyK_0 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4960357567868607670', time=2024-09-12T19:53:45.762823+0000, chain.objs.size()=1 2024-09-12T18:01:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.128+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._JBtHDVHYBrqrpoVX3jbwKD32tCzjUe_0 2024-09-12T18:01:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10778502988559018806', time=2024-09-12T19:53:45.864055+0000, chain.objs.size()=1 2024-09-12T18:01:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.QTIJnpxmSg5Krnk9Ps7pfSMkPQlarqK_0 2024-09-12T18:01:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13131543942047958827', time=2024-09-12T19:53:45.942994+0000, chain.objs.size()=1 2024-09-12T18:01:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AmNTU256Dr0VgMpCjqcUeEWna88mguw_0 2024-09-12T18:01:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.131+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2928571197335708024', time=2024-09-12T19:53:45.997827+0000, chain.objs.size()=1 2024-09-12T18:01:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.131+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.F9Xkw8FGEkXXpXvSO2_YiWHGtaSV9lf_0 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10913584492974273313', time=2024-09-12T19:53:46.141303+0000, chain.objs.size()=1 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NXPfo72cnNNeRBAmOyTNMdxlUoPkerT_0 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17287204122494563982', time=2024-09-12T19:53:46.199784+0000, chain.objs.size()=1 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._E7yuAbqUMiJ_ygCAukNRE5TD0MMfEZ_0 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16882880921303178321', time=2024-09-12T19:53:54.652987+0000, chain.objs.size()=1 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0iJQPZO0RKFVFmBBYfWsbvNatUEJ10R_0 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10519437072355035070', time=2024-09-12T19:53:54.677186+0000, chain.objs.size()=1 2024-09-12T18:01:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.k6qSZtq_Y4-qC9DAQjmDnFqEr5R6KRX_0 2024-09-12T18:01:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17045712817418895486', time=2024-09-12T19:53:54.677987+0000, chain.objs.size()=1 2024-09-12T18:01:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DSoxbcfJM8uImXu3XDXtqa0PbpTIohT_0 2024-09-12T18:01:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1971764765815570218', time=2024-09-12T19:53:54.683047+0000, chain.objs.size()=1 2024-09-12T18:01:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Khxq-bcqynJgH-bbA7kHbvbPaEomcB0_0 2024-09-12T18:01:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13158034143974992548', time=2024-09-12T19:53:54.709217+0000, chain.objs.size()=1 2024-09-12T18:01:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JLy-5IiEnJOgUkT0_obHUPHP3s3Uo-1_0 2024-09-12T18:01:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12912724574503652956', time=2024-09-12T19:53:54.729829+0000, chain.objs.size()=1 2024-09-12T18:01:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.n6Fgs_6F-ztA2YWIKlBveY7yvCRtTsT_0 2024-09-12T18:01:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13365272855478218448', time=2024-09-12T19:53:54.751273+0000, chain.objs.size()=1 2024-09-12T18:01:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nXCKPDvxiHJ-3_OI5458icne94ObQP8_0 2024-09-12T18:01:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16761017952197086838', time=2024-09-12T19:53:54.886948+0000, chain.objs.size()=1 2024-09-12T18:01:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.AdCVwWD0iWHsrhiam2FJaXAYMUpJt_s_0 2024-09-12T18:01:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1477451545985932375', time=2024-09-12T19:53:54.893169+0000, chain.objs.size()=1 2024-09-12T18:01:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.135+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JIL8M-hQjJcuZRsbFz96MFKvXynmp0q_0 2024-09-12T18:01:03.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.137+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8949282793748437858', time=2024-09-12T19:53:54.931647+0000, chain.objs.size()=1 2024-09-12T18:01:03.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.137+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ycXmiI2m-CkuRF0ND8RXpINrl7MticE_0 2024-09-12T18:01:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.138+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12067744893276932391', time=2024-09-12T19:53:54.940046+0000, chain.objs.size()=1 2024-09-12T18:01:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.138+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sH-_di6vF9dbrICgchKNSZSTe1M-Obu_0 2024-09-12T18:01:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18436690176673400367', time=2024-09-12T19:53:54.944092+0000, chain.objs.size()=1 2024-09-12T18:01:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uvcM5po0T5NyqhpkvltITqj7PRT7qJ-_0 2024-09-12T18:01:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5391205681036848891', time=2024-09-12T19:53:54.946439+0000, chain.objs.size()=1 2024-09-12T18:01:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1eezZPLNgjb7qn2GT2_oaPLFZKnY6TF_0 2024-09-12T18:01:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13994427534269991718', time=2024-09-12T19:53:55.058024+0000, chain.objs.size()=1 2024-09-12T18:01:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DiwCDsyuQ3u4QS_f2pv0auqSK9mHdXI_0 2024-09-12T18:01:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3678162842655166803', time=2024-09-12T19:53:55.175275+0000, chain.objs.size()=1 2024-09-12T18:01:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.b26E1iLwFWnPlxuQMFp16v812VyKHIJ_0 2024-09-12T18:01:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7703555351407263853', time=2024-09-12T19:53:55.262773+0000, chain.objs.size()=1 2024-09-12T18:01:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Hh7o47hQckAKWPQWgDrPJNvX8SNeu33_0 2024-09-12T18:01:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11693460690051409107', time=2024-09-12T19:53:55.345042+0000, chain.objs.size()=1 2024-09-12T18:01:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.G_Vvh_sXzxePW9GwbvpMomHkvjIlSWG_0 2024-09-12T18:01:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.463868339983157560', time=2024-09-12T19:53:55.356874+0000, chain.objs.size()=1 2024-09-12T18:01:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gzsL4Vkolt_A8q97H3DRVqgt6wOzGoh_0 2024-09-12T18:01:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9884532845502599268', time=2024-09-12T19:53:55.382441+0000, chain.objs.size()=1 2024-09-12T18:01:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jE03NHPtUaUnwWQXBP9gArLRYccrngA_0 2024-09-12T18:01:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12821146913075381138', time=2024-09-12T19:53:55.540532+0000, chain.objs.size()=1 2024-09-12T18:01:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.53zAPt2-Lsf8Bst8Wai_LPsDHZsxJ73_0 2024-09-12T18:01:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17630671769380154043', time=2024-09-12T19:53:55.553135+0000, chain.objs.size()=1 2024-09-12T18:01:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.683148s-6PsLcx37gEhoWT3rqiQToQn_0 2024-09-12T18:01:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8373752612179166186', time=2024-09-12T19:53:55.582472+0000, chain.objs.size()=1 2024-09-12T18:01:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NdTuSOaIgSggmGfU7T7hWU8VIyTPhdp_0 2024-09-12T18:01:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12346919612878952519', time=2024-09-12T19:53:55.619246+0000, chain.objs.size()=1 2024-09-12T18:01:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0-5QyBot0BeH4wulEyn-DiLvGhuB-12_0 2024-09-12T18:01:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1894502625877946914', time=2024-09-12T19:53:55.742523+0000, chain.objs.size()=1 2024-09-12T18:01:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uFSdVm9V8NLI17h3Z4ckOB9F4TezD_X_0 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17868626925047195212', time=2024-09-12T19:53:55.773084+0000, chain.objs.size()=1 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.iWcOzja1aaAw1BC2RSrYcb1kr1N1reC_0 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1124452297796613559', time=2024-09-12T19:53:55.905283+0000, chain.objs.size()=1 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aaq6bX-SPs_xEpPOxFV0-epBVqxRzrB_0 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15888489175224882376', time=2024-09-12T19:53:55.974048+0000, chain.objs.size()=1 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fCdO8WhqRRFQp8vdqchGIfi80AeOEvK_0 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13598699860409792611', time=2024-09-12T19:53:55.978804+0000, chain.objs.size()=1 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._Fs7seq2ByO_paOOVCcEuMMZ7dugj7a_0 2024-09-12T18:01:03.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1430233635325258150', time=2024-09-12T19:53:55.987191+0000, chain.objs.size()=1 2024-09-12T18:01:03.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lAafs2GbQyigdV4fP6En_d1fOYxfGdZ_0 2024-09-12T18:01:03.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3856706388961103160', time=2024-09-12T19:53:55.996328+0000, chain.objs.size()=1 2024-09-12T18:01:03.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.grzowt0ChNQVNllcCA1aXp3ucbd0xhG_0 2024-09-12T18:01:03.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.147+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3928784778487448547', time=2024-09-12T19:53:56.143595+0000, chain.objs.size()=1 2024-09-12T18:01:03.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.147+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CMVgTgJ_Ay42hTTYqtGinxDZsaORuH1_0 2024-09-12T18:01:03.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.148+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5572499402323083228', time=2024-09-12T19:53:56.158765+0000, chain.objs.size()=1 2024-09-12T18:01:03.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.148+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CePmL0w_gUuR7d4HTYXIXBooJq72lsc_0 2024-09-12T18:01:03.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.148+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11708452339174698759', time=2024-09-12T19:53:56.698567+0000, chain.objs.size()=1 2024-09-12T18:01:03.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.148+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.328__shadow_.Wa1aI4aJ9TbyIgV9P1xRfnIbajB37r8_0 2024-09-12T18:01:03.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2198283429294458565', time=2024-09-12T19:54:18.729654+0000, chain.objs.size()=1 2024-09-12T18:01:03.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.431__shadow_.ujo3VqtczsiIo5fsHTQqs3ZaDxmfZYb_0 2024-09-12T18:01:03.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15243118153571411767', time=2024-09-12T19:54:34.308463+0000, chain.objs.size()=1 2024-09-12T18:01:03.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.497__shadow_.INZaSBlZf8mcPQAvkQOgdtPjCsd9O0V_0 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15153812957795151726', time=2024-09-12T19:54:43.795376+0000, chain.objs.size()=1 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.521__shadow:pF9gbfsj3NrIhvhq6q5mWcNh8cQJH7G_.X4sPrfraAZXN2AHLosQmXqW0cxhHaVp_0 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~jtoUFj4kJb6-_BgsF3DJMfRx-kHSVpT', time=2024-09-12T19:54:44.443068+0000, chain.objs.size()=1 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.150+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~jtoUFj4kJb6-_BgsF3DJMfRx-kHSVpT.1 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.151+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8693364365878579344', time=2024-09-12T19:54:52.898905+0000, chain.objs.size()=4 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.151+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.528__multipart_mymultipart.2~Xvm7BNVRPb8SEbuCYAr0y2JVsFYr2dl.1 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.151+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.528__multipart_mymultipart.2~Xvm7BNVRPb8SEbuCYAr0y2JVsFYr2dl.2 2024-09-12T18:01:03.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.151+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.528__multipart_mymultipart.2~Xvm7BNVRPb8SEbuCYAr0y2JVsFYr2dl.3 2024-09-12T18:01:03.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.528__multipart_mymultipart.2~Xvm7BNVRPb8SEbuCYAr0y2JVsFYr2dl.4 2024-09-12T18:01:03.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13978560903267063616', time=2024-09-12T19:55:24.833463+0000, chain.objs.size()=1 2024-09-12T18:01:03.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.557__shadow_.WJdnPzRRCXkRQJyIDzLOoYBialVba_T_0 2024-09-12T18:01:03.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9518614775757356726', time=2024-09-12T19:55:25.754768+0000, chain.objs.size()=1 2024-09-12T18:01:03.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.MXAkgcETWwRoFBiod94O1Tbehkte4DO_0 2024-09-12T18:01:03.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.156+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/49037 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11288498946780293908', time=2024-09-12T19:55:34.415175+0000, chain.objs.size()=1 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:cnLij7X4MZzXPV4d.lZ1Paktqqkwvxa_.vLyQhrHUfHTf1o6WOo5SWTHF9dqx0UU_0 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5711082837874763766', time=2024-09-12T19:55:35.858436+0000, chain.objs.size()=1 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:ocX8kaG1p1BsMX6mhDv05Ywndt4jJPF_.PSnHx8IlhtI-vzHPEzGOCJhOQ6TlS0-_0 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7591362224651545288', time=2024-09-12T19:55:37.198667+0000, chain.objs.size()=1 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:NfTcmeUvU9lFssW-BcqkghqpvxiO0WB_._MKMXkO7m0y2WHvSf0dXUM-vncDb3j5_0 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1326226294961777387', time=2024-09-12T19:55:42.761230+0000, chain.objs.size()=1 2024-09-12T18:01:03.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:ZQn7kjcuqU8DpW2v1xZeEW1uoJzT431_.w-Afz_afoO5pm6wHMmpVpGG_D1ZzMUJ_0 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9007128209554047598', time=2024-09-12T19:55:48.155054+0000, chain.objs.size()=1 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:LOd-nfK4cfbfsMKI2LoVtxub6W9B05D_.K5MDPkBfoYARmRPUvOeQA6FUXBVhhgL_0 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2523862779660563676', time=2024-09-12T19:55:50.339984+0000, chain.objs.size()=1 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:tqM7mkdVVygmn8I7PI5Yu73Nn70uDqM_.T1lpwAxFmFosAuwQFrt1l60D4WKBQQQ_0 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10002082388148535115', time=2024-09-12T19:55:57.583413+0000, chain.objs.size()=1 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:SDj10ZnZEiiBbWMnJccSxY7XGSIEZIe_.UUuRu6Gi448zjPcuJ94oNW-2R1mvm_D_0 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11019335672425722214', time=2024-09-12T19:56:03.076511+0000, chain.objs.size()=1 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:tg7WJJmIE6b3HFbv7b64VutpKfaHd6O_.Jph1oohUmMPdZs5ctTkO5sEPruwdOdr_0 2024-09-12T18:01:03.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.213617041254092698', time=2024-09-12T19:56:04.640899+0000, chain.objs.size()=1 2024-09-12T18:01:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.586__shadow:l2G413Oysk.KBJ7aCg.d1d1gS9MQzMp_.E95k9c_WB7TA5nR64FXt7zEX-otndhT_0 2024-09-12T18:01:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14117116580227888676', time=2024-09-12T19:58:50.896857+0000, chain.objs.size()=1 2024-09-12T18:01:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.716__shadow:9GhXPvax9v2KWhE0LK.Z6lseUmf-V6a_.VnX5xE9U_-m4vG5WlGwJ1RoRGqTs4W2_0 2024-09-12T18:01:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.163+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.166+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:01:03.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.167+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.167+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50539' 2024-09-12T18:01:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13843620921279179068', time=2024-09-12T19:53:09.500986+0000, chain.objs.size()=1 2024-09-12T18:01:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.245__shadow_.pGWbOfApzZ0pj81HenTqguVGpA7RyQy_0 2024-09-12T18:01:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4516704534420952583', time=2024-09-12T19:53:12.868646+0000, chain.objs.size()=1 2024-09-12T18:01:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.261__shadow_.zvER4dPKAz_UM2oDWpL9EAArMSWmNSU_0 2024-09-12T18:01:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4192615371126792709', time=2024-09-12T19:53:21.177535+0000, chain.objs.size()=1 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iFU2Y1P_VaANOSVwOvj3LsEf_iDIoqP_0 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6536342076127903430', time=2024-09-12T19:53:21.212174+0000, chain.objs.size()=1 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OaQ_M8YBJ-TcTQhmAi80uJ5Cgmr9XaT_0 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2778035360529530497', time=2024-09-12T19:53:21.226964+0000, chain.objs.size()=1 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kCD8vOQQh-dfSlutR3Mld7TAbf2Xu0z_0 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13614284052153125347', time=2024-09-12T19:53:21.261555+0000, chain.objs.size()=1 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FZRZfvtgnq-2fUCDnMfjMEMx2Cd00RJ_0 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4563975086760248003', time=2024-09-12T19:53:21.265957+0000, chain.objs.size()=1 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6YN5iZwfHg2i_DSdfU8rZfS4zc--kUT_0 2024-09-12T18:01:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16829308597604199165', time=2024-09-12T19:53:21.386073+0000, chain.objs.size()=1 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DMrIzr-uGKFR_B0dHYz1xTmZNySAAqq_0 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17025544852530862591', time=2024-09-12T19:53:21.395288+0000, chain.objs.size()=1 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mip0z4P06A7ZtefnsQBWkz4nMJBZKRM_0 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8898938459585565082', time=2024-09-12T19:53:21.404347+0000, chain.objs.size()=1 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pu6sR3BcDDByvMx7CdCtKHo3o_GzPEW_0 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3933021545623916636', time=2024-09-12T19:53:21.410559+0000, chain.objs.size()=1 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Zyd0nRNxbyqCBYzi0aRDp2gjwdYxhDD_0 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1852330258941896885', time=2024-09-12T19:53:21.417486+0000, chain.objs.size()=1 2024-09-12T18:01:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zGkdU7BQXuHjeXQR5VJe8MIaDADRxl9_0 2024-09-12T18:01:03.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.172+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8910667389795422438', time=2024-09-12T19:53:21.428933+0000, chain.objs.size()=1 2024-09-12T18:01:03.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.172+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jZr4iO6dpERB7G25DmTuaeWLpsyB2DX_0 2024-09-12T18:01:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6710535572500958689', time=2024-09-12T19:53:21.458426+0000, chain.objs.size()=1 2024-09-12T18:01:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Br04dfZwFqITVlydJylSJQXDTzpsJsq_0 2024-09-12T18:01:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11923245987337055569', time=2024-09-12T19:53:21.477318+0000, chain.objs.size()=1 2024-09-12T18:01:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.uQZwBmIqc4uDJ6pafaOj3m_4Nkc1uxP_0 2024-09-12T18:01:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6796169068639981237', time=2024-09-12T19:53:21.486947+0000, chain.objs.size()=1 2024-09-12T18:01:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9480rBCvXinlwB2vUMOpldBktXAwfiX_0 2024-09-12T18:01:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1284272927974440651', time=2024-09-12T19:53:21.615595+0000, chain.objs.size()=1 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.173+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.t_1a2rcBZPC1rGHv0h6BbD8zGW1nlM8_0 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8453551772644624049', time=2024-09-12T19:53:21.688910+0000, chain.objs.size()=1 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QpCbKP5yEu4_pGKktYPQroxfe5WCA6M_0 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14453225335770735809', time=2024-09-12T19:53:21.990063+0000, chain.objs.size()=1 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.98LwealQLU-c2YGfVHH05NYMG2cLsAY_0 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6699175711718970719', time=2024-09-12T19:53:21.993487+0000, chain.objs.size()=1 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3x5aABquc5fVj7TuYc30ilTygSrDjEa_0 2024-09-12T18:01:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17096650720706994268', time=2024-09-12T19:53:22.013835+0000, chain.objs.size()=1 2024-09-12T18:01:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.V06QlgyIETtiV5mtRliVODPI27gegrQ_0 2024-09-12T18:01:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2686352400711546730', time=2024-09-12T19:53:22.098189+0000, chain.objs.size()=1 2024-09-12T18:01:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LdtCCuB4AOJUBrb7t7ZyMYYyGbd45gW_0 2024-09-12T18:01:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18304462781965368134', time=2024-09-12T19:53:22.188060+0000, chain.objs.size()=1 2024-09-12T18:01:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rA9_e5PWncmgknuCFAdTWqiwlBM9F1Y_0 2024-09-12T18:01:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.176+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15358848677433537658', time=2024-09-12T19:53:22.220780+0000, chain.objs.size()=1 2024-09-12T18:01:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.176+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0Ppptz6HXvMh_KFEdfxZPqsHroLzqe3_0 2024-09-12T18:01:03.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12239057734689649037', time=2024-09-12T19:53:22.429809+0000, chain.objs.size()=1 2024-09-12T18:01:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-bCRiNClKS-H7xFcLiTbiEEfyfJKr6i_0 2024-09-12T18:01:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5891247727695311882', time=2024-09-12T19:53:22.450152+0000, chain.objs.size()=1 2024-09-12T18:01:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wlvbUYH7hESl843CWLBe4zhO3B57zkz_0 2024-09-12T18:01:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6320712721721709893', time=2024-09-12T19:53:22.494136+0000, chain.objs.size()=1 2024-09-12T18:01:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lP953eOym4UBWeY_bU_9iEKtoJQyVrL_0 2024-09-12T18:01:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17692237622345815723', time=2024-09-12T19:53:22.500335+0000, chain.objs.size()=1 2024-09-12T18:01:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qcx9VBVNzEA4lwGfEWRCVwabFHtMhty_0 2024-09-12T18:01:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.178+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6325741708217841459', time=2024-09-12T19:53:22.606957+0000, chain.objs.size()=1 2024-09-12T18:01:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yTpJ_AwBqyD37xoOpd9-VeCcOcvnbUJ_0 2024-09-12T18:01:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.179+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9270774355527000850', time=2024-09-12T19:53:22.653570+0000, chain.objs.size()=1 2024-09-12T18:01:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4MAi7VlJ-NlJlUgbaiwBKdXgTUv8j0v_0 2024-09-12T18:01:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.179+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17127560476419087238', time=2024-09-12T19:53:23.672718+0000, chain.objs.size()=1 2024-09-12T18:01:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.268__shadow_.2LcUpsRjAJx4DBp_F9MEAEI1xJkLgKW_0 2024-09-12T18:01:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.180+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6337624384427647250', time=2024-09-12T19:53:25.710297+0000, chain.objs.size()=1 2024-09-12T18:01:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.180+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.278__shadow_.iptZi6UqrqN6OXsoOM50PbLaKeGaSSt_0 2024-09-12T18:01:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.180+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7349650042711767577', time=2024-09-12T19:53:26.567048+0000, chain.objs.size()=1 2024-09-12T18:01:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.180+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.282__shadow_.ENFxMw6HL6Bojb12MsGEsRWOJ2ojMR-_0 2024-09-12T18:01:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.180+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15498790222336785768', time=2024-09-12T19:53:27.682980+0000, chain.objs.size()=1 2024-09-12T18:01:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.180+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.287__shadow_.XpCRSEMD_ZCwc-gukMZNT45lQXYROYG_0 2024-09-12T18:01:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14501473348711270033', time=2024-09-12T19:53:27.683809+0000, chain.objs.size()=1 2024-09-12T18:01:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.287__shadow_.NFUQL1uABNYe4sozJveGHLyhLXUOWFw_0 2024-09-12T18:01:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16914399598621252600', time=2024-09-12T19:53:35.450509+0000, chain.objs.size()=1 2024-09-12T18:01:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.320__shadow:E9C55bUFBNMjDC19Jc64iVkbhgczJJw_.4OeI2pUfCO1K8V93hLw5K0quwoQgAOu_0 2024-09-12T18:01:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6704083136804459767', time=2024-09-12T19:53:44.523672+0000, chain.objs.size()=1 2024-09-12T18:01:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.b33nOG77ZzohGd8L9jnD7OVJ6SDfUJd_0 2024-09-12T18:01:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13581139880202063660', time=2024-09-12T19:53:44.527883+0000, chain.objs.size()=1 2024-09-12T18:01:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.183+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MBQecJtvzhF3puzRDzuGk1dsDRnY17H_0 2024-09-12T18:01:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4750392675407645159', time=2024-09-12T19:53:44.538752+0000, chain.objs.size()=1 2024-09-12T18:01:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5qd1t2bfk56G0cg1sdJPHMYZcvJ03wm_0 2024-09-12T18:01:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12201439668602082195', time=2024-09-12T19:53:44.547203+0000, chain.objs.size()=1 2024-09-12T18:01:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2oYbND2MdlRH-qlE5pHL7GzqIgDCUML_0 2024-09-12T18:01:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18040618335800584863', time=2024-09-12T19:53:45.148858+0000, chain.objs.size()=1 2024-09-12T18:01:03.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oxLS5ccSHjEd6n4XPPMEzMBf7t_n9CM_0 2024-09-12T18:01:03.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.185+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14818147184350765333', time=2024-09-12T19:53:45.189172+0000, chain.objs.size()=1 2024-09-12T18:01:03.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.185+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.d9jg2ldfeb8bmjsNMeW3ma7crpG2QsF_0 2024-09-12T18:01:03.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.186+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1217486409064713984', time=2024-09-12T19:53:45.226533+0000, chain.objs.size()=1 2024-09-12T18:01:03.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.186+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.11Q7ROKCAYteoNLsPPe09SkOnMJ1Suu_0 2024-09-12T18:01:03.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.186+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14779133225788660837', time=2024-09-12T19:53:45.235122+0000, chain.objs.size()=1 2024-09-12T18:01:03.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.186+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.frCMnfMmCqx3r71XMYQQOSxW0Gy0_nH_0 2024-09-12T18:01:03.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.186+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11435906418743880178', time=2024-09-12T19:53:45.376265+0000, chain.objs.size()=1 2024-09-12T18:01:03.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.186+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.F4VG9ivyzJW8wYjzn-WPHDdRSRaru2e_0 2024-09-12T18:01:03.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.230713588716530184', time=2024-09-12T19:53:45.393576+0000, chain.objs.size()=1 2024-09-12T18:01:03.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.69WV9erG5nJF7G6nCIxfyMAyxyT7KEm_0 2024-09-12T18:01:03.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9803095509413979032', time=2024-09-12T19:53:45.536142+0000, chain.objs.size()=1 2024-09-12T18:01:03.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yNmniYVqHCG5h3TZTGw7AapKo4Z7tl7_0 2024-09-12T18:01:03.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8026355318639392925', time=2024-09-12T19:53:45.551539+0000, chain.objs.size()=1 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7JjXSNh_Prh2t205rpfmHFu5F2RCNdB_0 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.314326226799149406', time=2024-09-12T19:53:45.561629+0000, chain.objs.size()=1 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lYSPktcOE6jcZLAyskL3Q4UY93ZMtHp_0 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6017878944530017130', time=2024-09-12T19:53:45.586198+0000, chain.objs.size()=1 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XkZeWoaPPO4942rP8EhIAFJWQHPiMYH_0 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1571172868136528677', time=2024-09-12T19:53:45.613953+0000, chain.objs.size()=1 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XPi7jq7BwADwCklgk2t-gJFoIObKGLQ_0 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8935869284725629705', time=2024-09-12T19:53:45.617733+0000, chain.objs.size()=1 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bOeJL1OC2AhT1NrOM8Ag71xegh98cWW_0 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3229765796021526863', time=2024-09-12T19:53:45.800774+0000, chain.objs.size()=1 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DUt1RKRIi0i1erA4SR9mmIHSir0F-8s_0 2024-09-12T18:01:03.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7327170869116067138', time=2024-09-12T19:53:45.837652+0000, chain.objs.size()=1 2024-09-12T18:01:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3v0-aB-CMPzywOY4mVkfsJSO43F_Ct2_0 2024-09-12T18:01:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4736639857018245294', time=2024-09-12T19:53:45.866382+0000, chain.objs.size()=1 2024-09-12T18:01:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cN6sdRszIgWbW4Izv6odyUjvFhpr48S_0 2024-09-12T18:01:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.194648345846621230', time=2024-09-12T19:53:45.941088+0000, chain.objs.size()=1 2024-09-12T18:01:03.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Wb3koqa-Fq8HDZbDK886peCB8S2F4YO_0 2024-09-12T18:01:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.194+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9787312656698740172', time=2024-09-12T19:53:45.966787+0000, chain.objs.size()=1 2024-09-12T18:01:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.194+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VTF_MM6R9-JRl9vL7YtaeuHm73Rr1RC_0 2024-09-12T18:01:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.194+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7291155744611730298', time=2024-09-12T19:53:45.984499+0000, chain.objs.size()=1 2024-09-12T18:01:03.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.194+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KL1cVhNKs-ryHmO85Qfas-JqkgJjy1t_0 2024-09-12T18:01:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13461188746996878052', time=2024-09-12T19:53:46.055015+0000, chain.objs.size()=1 2024-09-12T18:01:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0-MXqJ5zwrBw7pnEIig7tU8YPoQe3K0_0 2024-09-12T18:01:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12096009692940922569', time=2024-09-12T19:53:46.146280+0000, chain.objs.size()=1 2024-09-12T18:01:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DpT-Esui_Lc7wEksOSe-hbl--Dtwd5-_0 2024-09-12T18:01:03.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1141135086346754729', time=2024-09-12T19:53:46.157039+0000, chain.objs.size()=1 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0vlo71sAmU8lm7W8RjXdMINAJo-nfUS_0 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2224241800586789577', time=2024-09-12T19:53:46.208987+0000, chain.objs.size()=1 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iFU0aK4qCXTfsFW4xyFqmHwu2IDfeBp_0 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6255366920063476349', time=2024-09-12T19:53:54.669207+0000, chain.objs.size()=1 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MyRwyjCwdD5rR5UogQP-i6BBnRwwbQD_0 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5444808666747312787', time=2024-09-12T19:53:54.690305+0000, chain.objs.size()=1 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vfxx9-ldEwoUm7947JpbFCvNJxIXFFi_0 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7007101429382574743', time=2024-09-12T19:53:54.845447+0000, chain.objs.size()=1 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.T0y3_st3XI4IHx5R7vEYNgWlVKGrgEV_0 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18262732048497511167', time=2024-09-12T19:53:54.871342+0000, chain.objs.size()=1 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.b40WqMy6jYREHUpLIplR62jQUct5bNy_0 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14430413460667337539', time=2024-09-12T19:53:54.906978+0000, chain.objs.size()=1 2024-09-12T18:01:03.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DYmNLRLL16LwGEvkpZfwWOOH9wmfLNq_0 2024-09-12T18:01:03.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.200+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5946158751636764396', time=2024-09-12T19:53:54.924673+0000, chain.objs.size()=1 2024-09-12T18:01:03.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.200+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8bnnf4vE9wtH-w3WHK9_2XulVVcfLdZ_0 2024-09-12T18:01:03.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.200+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15258522986076893137', time=2024-09-12T19:53:54.940418+0000, chain.objs.size()=1 2024-09-12T18:01:03.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.200+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.R2313PubJ7p8IjWvS9khqkoy7kkLgSP_0 2024-09-12T18:01:03.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.200+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7410324549844338947', time=2024-09-12T19:53:55.054901+0000, chain.objs.size()=1 2024-09-12T18:01:03.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.200+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.K5JsfpLn2m6RddEPKqqIZUlkuvhrd5N_0 2024-09-12T18:01:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13640952704925318815', time=2024-09-12T19:53:55.058008+0000, chain.objs.size()=1 2024-09-12T18:01:03.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.f7mJae6OnfkCIgPvUjNvqHoTWHWajpa_0 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11432219334413397393', time=2024-09-12T19:53:55.151281+0000, chain.objs.size()=1 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0nyjSR_o7otDRgz97HgIGwR67G2Ph3i_0 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5537065657731417972', time=2024-09-12T19:53:55.172858+0000, chain.objs.size()=1 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vzQqmN-zoYPH5ejd9m9oFoNwdJwAwyR_0 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11366261778596068227', time=2024-09-12T19:53:55.175846+0000, chain.objs.size()=1 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qdzcIKDpOjOp_1fcffXbxVF0MJ7WNVI_0 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10824945417478560236', time=2024-09-12T19:53:55.296692+0000, chain.objs.size()=1 2024-09-12T18:01:03.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.U9QrxoBj7ZS2LfOyckngphcFqhvlwZq_0 2024-09-12T18:01:03.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11667281130507403195', time=2024-09-12T19:53:55.316826+0000, chain.objs.size()=1 2024-09-12T18:01:03.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.F29J1ppteVr-dSW138aySSITKf9dSc5_0 2024-09-12T18:01:03.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10553511279507331509', time=2024-09-12T19:53:55.369059+0000, chain.objs.size()=1 2024-09-12T18:01:03.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rOl9imXv2fZS87QcIfMRUuFOxm6HlmR_0 2024-09-12T18:01:03.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16373306444405845329', time=2024-09-12T19:53:55.385881+0000, chain.objs.size()=1 2024-09-12T18:01:03.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.202+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QOQdYGtXn02zm2ZtbGtzBa5JfO9SnCE_0 2024-09-12T18:01:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.204+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10395952265809227638', time=2024-09-12T19:53:55.507259+0000, chain.objs.size()=1 2024-09-12T18:01:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.204+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1JmOAp5S8QXaDchWYQ0R-3fDAFtvdsS_0 2024-09-12T18:01:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.205+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11425621742718762036', time=2024-09-12T19:53:55.516944+0000, chain.objs.size()=1 2024-09-12T18:01:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.205+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.x3XR3vmJX5cL65dYbkF19vsk_jg3oIA_0 2024-09-12T18:01:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.205+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6500427924947366197', time=2024-09-12T19:53:55.597740+0000, chain.objs.size()=1 2024-09-12T18:01:03.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.205+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qyHEbJe8agfup98W-7cmjFW3nG-a0h5_0 2024-09-12T18:01:03.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.206+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11627327812297097021', time=2024-09-12T19:53:55.613967+0000, chain.objs.size()=1 2024-09-12T18:01:03.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.206+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tdWrjPZ_SVDz6VFgJyWS4BgGsOw3q8c_0 2024-09-12T18:01:03.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.206+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16317844923755735824', time=2024-09-12T19:53:55.733554+0000, chain.objs.size()=1 2024-09-12T18:01:03.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.206+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6lSW0v6FW6C-zY40cMN1gngIUNNBNyr_0 2024-09-12T18:01:03.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.207+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2587756724982437580', time=2024-09-12T19:53:55.818337+0000, chain.objs.size()=1 2024-09-12T18:01:03.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.207+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Qsp0n_CO2ZICVGIGuhjjpjfJ0D_zOxy_0 2024-09-12T18:01:03.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.207+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13646628879338020503', time=2024-09-12T19:53:55.904990+0000, chain.objs.size()=1 2024-09-12T18:01:03.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.207+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NtO5-u9Vje5K-74HVKKD3A1g9vP57_B_0 2024-09-12T18:01:03.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17872119520999135246', time=2024-09-12T19:53:55.909369+0000, chain.objs.size()=1 2024-09-12T18:01:03.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wLaFvCNJImgCwYLIs1gMf28E_bThHcg_0 2024-09-12T18:01:03.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7508924359511803316', time=2024-09-12T19:53:55.933818+0000, chain.objs.size()=1 2024-09-12T18:01:03.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JAj-gjXv7-qmL_JcYsRNaUhoXRjEWn6_0 2024-09-12T18:01:03.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6877068977707701440', time=2024-09-12T19:53:55.988885+0000, chain.objs.size()=1 2024-09-12T18:01:03.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Tt-8llws_-P-CRcFrV-JZ8kt5iJrQR1_0 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16258929910989418156', time=2024-09-12T19:53:55.995064+0000, chain.objs.size()=1 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MzhiGBdMcE6Tobj2ZCzmFsYOl0H0clj_0 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13337698311852383307', time=2024-09-12T19:53:56.011865+0000, chain.objs.size()=1 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.pYqBEY5VniUXNNWEDORfwVfkdT12zeR_0 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12132839952782256849', time=2024-09-12T19:53:56.101772+0000, chain.objs.size()=1 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tftI79vinAoXiugKISOiNrAT5g-Kk76_0 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10932084947382955855', time=2024-09-12T19:53:56.106510+0000, chain.objs.size()=1 2024-09-12T18:01:03.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YNLmxqG4d4vMd6p044NEsmuBu8v58Db_0 2024-09-12T18:01:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13923991800052770468', time=2024-09-12T19:53:56.168993+0000, chain.objs.size()=1 2024-09-12T18:01:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6NlZY9kqH0fuG28w5D8M8iI5x_Apdpb_0 2024-09-12T18:01:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6282332469068314779', time=2024-09-12T19:53:56.193966+0000, chain.objs.size()=1 2024-09-12T18:01:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EarwTBmJSG3l4AWzRachBRxd4uwCIij_0 2024-09-12T18:01:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9892700586448530511', time=2024-09-12T19:53:56.196306+0000, chain.objs.size()=1 2024-09-12T18:01:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FunIBfZOvHji4VUgocGixAYszyq8eH9_0 2024-09-12T18:01:03.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5567903759943379338', time=2024-09-12T19:54:18.507512+0000, chain.objs.size()=1 2024-09-12T18:01:03.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.430__shadow_.sN__fxTfJhRlHFo6va45AcAshCQYVXD_0 2024-09-12T18:01:03.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3571796960526533923', time=2024-09-12T19:54:30.384090+0000, chain.objs.size()=1 2024-09-12T18:01:03.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.482__shadow_.sSHTSu0aUdooXMWQpPMTeTgcXyHAR9B_0 2024-09-12T18:01:03.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.214+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6850180508936622539', time=2024-09-12T19:54:32.989989+0000, chain.objs.size()=1 2024-09-12T18:01:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.214+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.491__shadow_.JtrCZ1fpXYynMxfQF8rVPxk-hYTjK0y_0 2024-09-12T18:01:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.214+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6850180508936622539', time=2024-09-12T19:54:33.099199+0000, chain.objs.size()=1 2024-09-12T18:01:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.214+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.491__shadow_.JtrCZ1fpXYynMxfQF8rVPxk-hYTjK0y_0 2024-09-12T18:01:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.214+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.898551622670635893', time=2024-09-12T19:54:36.259469+0000, chain.objs.size()=1 2024-09-12T18:01:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.214+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.504__shadow:YnY3RpnWdxNL2AAWGjaSqYdBVkxd.2r_.0H8-qd5wL1YloYv9-TjdMVbSrLkSqV7_0 2024-09-12T18:01:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.219+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/50539 2024-09-12T18:01:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:01:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11174002054553461091', time=2024-09-12T19:54:37.853892+0000, chain.objs.size()=6 2024-09-12T18:01:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.1 2024-09-12T18:01:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.2 2024-09-12T18:01:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.3 2024-09-12T18:01:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.4 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.5 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.6 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10977712215195494409', time=2024-09-12T19:54:38.871176+0000, chain.objs.size()=1 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.513__shadow_.S3NRqKLnigm0dN_qooBMRriH-ObPJMV_0 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.771048488439455432', time=2024-09-12T19:54:43.891627+0000, chain.objs.size()=6 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~VMwz1CRxXt_a52qphWLWis8QZGrcVLd.1 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__shadow_mymultipart.2~VMwz1CRxXt_a52qphWLWis8QZGrcVLd.1_1 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~VMwz1CRxXt_a52qphWLWis8QZGrcVLd.2 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__shadow_mymultipart.2~VMwz1CRxXt_a52qphWLWis8QZGrcVLd.2_1 2024-09-12T18:01:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~VMwz1CRxXt_a52qphWLWis8QZGrcVLd.3 2024-09-12T18:01:03.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.226+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__shadow_mymultipart.2~VMwz1CRxXt_a52qphWLWis8QZGrcVLd.3_1 2024-09-12T18:01:03.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.227+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12284654737778303462', time=2024-09-12T19:54:47.400937+0000, chain.objs.size()=6 2024-09-12T18:01:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.227+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~1N2UnwyzfXGhvH9GSbd6WxfqUTd-swK.1 2024-09-12T18:01:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.227+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~1N2UnwyzfXGhvH9GSbd6WxfqUTd-swK.2 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.BjU67yVbae2TwPBZjHyDUDnkDfutfxiT.3 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~1N2UnwyzfXGhvH9GSbd6WxfqUTd-swK.4 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~1N2UnwyzfXGhvH9GSbd6WxfqUTd-swK.5 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~1N2UnwyzfXGhvH9GSbd6WxfqUTd-swK.6 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7549048745460728629', time=2024-09-12T19:54:51.960983+0000, chain.objs.size()=3 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~VosukcQ8oFkKHceQ2WhxP0daeW3PavS.1 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~VosukcQ8oFkKHceQ2WhxP0daeW3PavS.2 2024-09-12T18:01:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~VosukcQ8oFkKHceQ2WhxP0daeW3PavS.3 2024-09-12T18:01:03.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6926269415689193394', time=2024-09-12T19:55:10.674129+0000, chain.objs.size()=1 2024-09-12T18:01:03.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.537__multipart_mymultipart.2~O0X1chSCar5xjDqRKl4sganmH-xcpE5.1 2024-09-12T18:01:03.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.231+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10657825925038152925', time=2024-09-12T19:55:24.805249+0000, chain.objs.size()=1 2024-09-12T18:01:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.231+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.557__shadow_.LaeiHvNARJrNCsAdNCoXuyk4I7OtEbw_0 2024-09-12T18:01:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.231+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8579443628695832768', time=2024-09-12T19:55:34.986705+0000, chain.objs.size()=1 2024-09-12T18:01:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.231+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:xyO1lQX6OoQtpZssKtkWQiqksQF5ini_.BAFGOX_ziTFYQF3Vjw6ae0zDY7pTjdb_0 2024-09-12T18:01:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.231+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13800097205322970704', time=2024-09-12T19:55:50.836998+0000, chain.objs.size()=1 2024-09-12T18:01:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.231+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:FMgL8H8uwta5PjS55yUuDcaWuJV7SUe_.52D3uAnQLsRDtXqx-6eYtY4VbbTXiBO_0 2024-09-12T18:01:03.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.232+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7467446724004852376', time=2024-09-12T19:55:55.244971+0000, chain.objs.size()=1 2024-09-12T18:01:03.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.232+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:fS.vSzraIdMzW.EhoOXJFXCTCJD43Ig_.KV90P_h8erdKIwbMTtZpQF4hvptoWID_0 2024-09-12T18:01:03.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16481256773843806975', time=2024-09-12T19:56:04.944523+0000, chain.objs.size()=1 2024-09-12T18:01:03.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.234+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.587__shadow:JVC81rsRiB--L9.WJcl.2IavyhP8DwJ_.X3E_X8ce5bQ3TYXhRhf_AQBAiajZ2Te_0 2024-09-12T18:01:03.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7307933871444482403', time=2024-09-12T19:58:20.599426+0000, chain.objs.size()=1 2024-09-12T18:01:03.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.234+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.633__shadow_.M6fbGvfx3EgKbBrYwlXWUsv0WGOmKO-_0 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16254568659694174210', time=2024-09-12T19:58:22.320005+0000, chain.objs.size()=1 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.235+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.642__shadow_.Zdzxs4GHTlGpZ0fmsIASh2oOyVYZx_h_0 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.235+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12182657777816515838', time=2024-09-12T19:58:25.509417+0000, chain.objs.size()=1 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.235+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.652__shadow_.FwHIrMbuZsl2JW4wLEE_itGGAI9w0-a_0 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.235+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6014531287678650972', time=2024-09-12T19:58:30.433809+0000, chain.objs.size()=1 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.235+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.666__shadow_.lxmLjjw-Asfabl68rVO3RMvLVtEQfO8_0 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.235+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.45352106431995211', time=2024-09-12T19:58:37.697316+0000, chain.objs.size()=1 2024-09-12T18:01:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.235+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.702__shadow:uGwHetGqOO-rGdCp-jY01Z9DL7kDDZI_.uDbh-ZfwGlLREbEsxtey_WpdxJQX3j__0 2024-09-12T18:01:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.239+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.241+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:01:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.243+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.243+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.244+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48923' 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.244+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14065468691814973146', time=2024-09-12T19:51:56.680933+0000, chain.objs.size()=3 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.244+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159__shadow_.-hm9dCH8QICsxJ7dDLrggTVoMkUiT-L_0 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.244+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159__shadow_.-hm9dCH8QICsxJ7dDLrggTVoMkUiT-L_1 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159__shadow_.-hm9dCH8QICsxJ7dDLrggTVoMkUiT-L_2 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_79xUHBMbeLNO55RvhjNf1C_Tq4Ul_aW', time=2024-09-12T19:52:01.117983+0000, chain.objs.size()=1 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.166__shadow_.7ttOqDaRvb3FXY2t3j4pOvOqu-lyhQA_0 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17516269216848238322', time=2024-09-12T19:53:07.246232+0000, chain.objs.size()=1 2024-09-12T18:01:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.235__shadow_.bmc9v0oRz30XXqDgKe9bw1ViIN-aCoj_0 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1585684658283561867', time=2024-09-12T19:53:09.237118+0000, chain.objs.size()=1 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.244__shadow_.oZcV7np7xODCo-cRB92vAAP160BkEOL_0 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18271931289746080506', time=2024-09-12T19:53:09.943044+0000, chain.objs.size()=1 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.247__shadow_.r2a__EJdhaBfbpYZV8JyLZfCMFVj98-_0 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15097727568935891226', time=2024-09-12T19:53:10.554189+0000, chain.objs.size()=1 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.250__shadow_.m81nlhDsTDMEOGWJn9K9szZRRH3nmkW_0 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4690749859705269008', time=2024-09-12T19:53:10.971273+0000, chain.objs.size()=1 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.252__shadow_.ghcZuDR8o51SP08_3qp-yMe8jXjslHa_0 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6059129954314162980', time=2024-09-12T19:53:11.211629+0000, chain.objs.size()=1 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.253__shadow_.a_Z8c5aGKrsxApU7kXSUFjKqOFwW5ad_0 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5420923084367356353', time=2024-09-12T19:53:13.076915+0000, chain.objs.size()=1 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.262__shadow_.i3TZbmu1WqyJ3A6ebs7m6kohBB50vpu_0 2024-09-12T18:01:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1501854757580112635', time=2024-09-12T19:53:21.244830+0000, chain.objs.size()=1 2024-09-12T18:01:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ByRC6O9jPX7aRNAfBWry5Eh-sn2zIIg_0 2024-09-12T18:01:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14777034778540873815', time=2024-09-12T19:53:21.245502+0000, chain.objs.size()=1 2024-09-12T18:01:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2tjTXM3LMFwZdv_JdDt6PxxNONfeacV_0 2024-09-12T18:01:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10980603916898163254', time=2024-09-12T19:53:21.251992+0000, chain.objs.size()=1 2024-09-12T18:01:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Ijd-UK1y6jpE7paQmchFUi_P8LIUrfC_0 2024-09-12T18:01:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2225807573232162249', time=2024-09-12T19:53:21.373701+0000, chain.objs.size()=1 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PrGIPGtx4ww6wci5PdvTOOBS1Y0VC_S_0 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8130758812706473116', time=2024-09-12T19:53:21.376771+0000, chain.objs.size()=1 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MCWhESPG9f9n7g2UoV7SYHbFJNCTwpr_0 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5545835250711839248', time=2024-09-12T19:53:21.439697+0000, chain.objs.size()=1 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.liO8HkHj3D6eVFcv3QCwWFqlVaYWOJJ_0 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6784609000685760983', time=2024-09-12T19:53:21.465964+0000, chain.objs.size()=1 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.IsWnzMRk1CEXNGoQdrSxw5XA-G_-KMT_0 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17737789817837518303', time=2024-09-12T19:53:21.580565+0000, chain.objs.size()=1 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aFCeoS0fm7NA3YRrWRQBd_G82bI3asy_0 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1551896133116544824', time=2024-09-12T19:53:21.581256+0000, chain.objs.size()=1 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0OgasiUjid-_YLffXryJJKMix60eGnO_0 2024-09-12T18:01:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17023204837252118505', time=2024-09-12T19:53:21.589517+0000, chain.objs.size()=1 2024-09-12T18:01:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.E4xD0kf8P1NiRo_MJXb03mKNB7qfJyi_0 2024-09-12T18:01:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14085458811452974040', time=2024-09-12T19:53:21.624918+0000, chain.objs.size()=1 2024-09-12T18:01:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fP-hJNoQQQaPIc5DtXR57V7Y72vHw97_0 2024-09-12T18:01:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6863452059589468774', time=2024-09-12T19:53:21.636881+0000, chain.objs.size()=1 2024-09-12T18:01:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.250+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YWRI5VJLYqqX0TRiChVzJuobECuNkUm_0 2024-09-12T18:01:03.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7869522052719414016', time=2024-09-12T19:53:21.654344+0000, chain.objs.size()=1 2024-09-12T18:01:03.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.VqO9PV_L2sAgKXkRVfT4Gnky14f-ET__0 2024-09-12T18:01:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.254+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4585940902520125633', time=2024-09-12T19:53:21.665753+0000, chain.objs.size()=1 2024-09-12T18:01:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.254+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.K_UQV9WafvdYL3meg3sYTBsvpSOUp_r_0 2024-09-12T18:01:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.254+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6687699718407485415', time=2024-09-12T19:53:21.813263+0000, chain.objs.size()=1 2024-09-12T18:01:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.254+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oizYiYQT6zcAuIZBo9pdJc1OcZ0FMVW_0 2024-09-12T18:01:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10371654498634790131', time=2024-09-12T19:53:21.832752+0000, chain.objs.size()=1 2024-09-12T18:01:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.44DCi8Uod0vlJznw3c6zYSC91Ih7xh-_0 2024-09-12T18:01:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16917985673120428077', time=2024-09-12T19:53:21.895841+0000, chain.objs.size()=1 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FGHzwMc7COkf6mGy-YHnIpr5gBK0nw8_0 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13640092474226308828', time=2024-09-12T19:53:21.993333+0000, chain.objs.size()=1 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RSllMk7k1loZ_LyjNJmkgqTKXS7trih_0 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8301762321711421477', time=2024-09-12T19:53:22.015880+0000, chain.objs.size()=1 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mKmZSs2q06z8Hu_syVETemRN7AVcHTe_0 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1711888763048154045', time=2024-09-12T19:53:22.041235+0000, chain.objs.size()=1 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Z4eVnEWbEsuRC15otgs8Dvs9h3ZoqVc_0 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7134690362699370719', time=2024-09-12T19:53:22.051889+0000, chain.objs.size()=1 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.V7XFHpZZHsrg9h7L7t8IJbx3lCkDE2Q_0 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12777682274856668417', time=2024-09-12T19:53:22.094817+0000, chain.objs.size()=1 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.cgTHV3CBTKwCwnd38nslUN4Mno0kVQi_0 2024-09-12T18:01:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.879832602108348370', time=2024-09-12T19:53:22.277287+0000, chain.objs.size()=1 2024-09-12T18:01:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.255+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.SsSyLoAWdso8kfgOB2i6_WwR-huCNHq_0 2024-09-12T18:01:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.257+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6989928780946584296', time=2024-09-12T19:53:22.303175+0000, chain.objs.size()=1 2024-09-12T18:01:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.257+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.azN2veV6DK_e8c_W1_TiuTI5yqnN55e_0 2024-09-12T18:01:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.259+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7979446609388959352', time=2024-09-12T19:53:22.386741+0000, chain.objs.size()=1 2024-09-12T18:01:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.259+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.h8G6VXZT4us10Bq8MDKGwQYew8xDwlA_0 2024-09-12T18:01:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14172501540339348278', time=2024-09-12T19:53:22.408123+0000, chain.objs.size()=1 2024-09-12T18:01:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.skjOcp1SqLFefCz4mBktT8MZbOfVVib_0 2024-09-12T18:01:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18282720385710136071', time=2024-09-12T19:53:22.424298+0000, chain.objs.size()=1 2024-09-12T18:01:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.H8t57jE-cRZnoRqEX8C6kKVNapXcll5_0 2024-09-12T18:01:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6626315260510121351', time=2024-09-12T19:53:22.440305+0000, chain.objs.size()=1 2024-09-12T18:01:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iHwHDC-i9hNgWMNiY96cIY8_KqbV08u_0 2024-09-12T18:01:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16768964455498832762', time=2024-09-12T19:53:22.445836+0000, chain.objs.size()=1 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rnwWPJE0C27lIk5Prik_p4m9vD2B6V1_0 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10235214105325303613', time=2024-09-12T19:53:22.462827+0000, chain.objs.size()=1 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dvNt_IySWRqbE6XDWpQ0lyRZOmg9BOi_0 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6477980716895908663', time=2024-09-12T19:53:22.480367+0000, chain.objs.size()=1 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3vUxqJqhdi3SxfIAbWQSNFTK5h6G2TS_0 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18156435612238510595', time=2024-09-12T19:53:22.494456+0000, chain.objs.size()=1 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qMAzmrU7PTYGWEVmjM1itGCoSuwLI4Q_0 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1049017914822160274', time=2024-09-12T19:53:22.579536+0000, chain.objs.size()=1 2024-09-12T18:01:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.actnZv8cucIB0SEmqv78ZucMPHQA6mt_0 2024-09-12T18:01:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2159688914078349476', time=2024-09-12T19:53:22.610362+0000, chain.objs.size()=1 2024-09-12T18:01:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.M_V8iGjEeGMZ61Cuk-oG2HuNWEzpbn3_0 2024-09-12T18:01:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.263+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.705744408420022772', time=2024-09-12T19:53:22.624510+0000, chain.objs.size()=1 2024-09-12T18:01:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.263+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1_jR8iF7o1_tVlVAvZkZthEtPR6Hji3_0 2024-09-12T18:01:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.263+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11962062551952504405', time=2024-09-12T19:53:22.633839+0000, chain.objs.size()=1 2024-09-12T18:01:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.263+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qhMczj-SiAXhUjTXUZDBQm0Bau33pEk_0 2024-09-12T18:01:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.265+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9924549721136329236', time=2024-09-12T19:53:25.092039+0000, chain.objs.size()=1 2024-09-12T18:01:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.265+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.275__shadow_.-1DTit0fHTQ--DP0kEknaGSCXonPFeP_0 2024-09-12T18:01:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.265+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9580018099446217201', time=2024-09-12T19:53:27.435153+0000, chain.objs.size()=1 2024-09-12T18:01:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.265+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.286__shadow_.WmUFs7YlKcQ530akWXHaVZmtDBjP6j__0 2024-09-12T18:01:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.265+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14823910654656881471', time=2024-09-12T19:53:27.683017+0000, chain.objs.size()=1 2024-09-12T18:01:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.265+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.287__shadow_.UjYEjTUV9zrDYNiXRTeB8Iza0AspQ_2_0 2024-09-12T18:01:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15873699154919124894', time=2024-09-12T19:53:27.928396+0000, chain.objs.size()=1 2024-09-12T18:01:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.288__shadow_._ZCojblUnnnqbenFPYuQSns_RCyi3qH_0 2024-09-12T18:01:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3951329837397047026', time=2024-09-12T19:53:29.338128+0000, chain.objs.size()=1 2024-09-12T18:01:03.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.5UYNjfYGSbzU0xfkdEJ_sgLGrsfljU8_0 2024-09-12T18:01:03.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.267+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9946606298855352458', time=2024-09-12T19:53:29.353802+0000, chain.objs.size()=1 2024-09-12T18:01:03.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.267+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.t6l1Bkb5WRSAXPRx_-2n0FuTPWcJsf7_0 2024-09-12T18:01:03.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.267+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17592389414829926646', time=2024-09-12T19:53:30.137328+0000, chain.objs.size()=1 2024-09-12T18:01:03.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.267+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.295__shadow_.gGOKVxliCCla5RueJDnaD4qvJicH1hX_0 2024-09-12T18:01:03.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.268+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3441763213908870655', time=2024-09-12T19:53:31.775017+0000, chain.objs.size()=1 2024-09-12T18:01:03.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.302__shadow_.HtXmBw1-fvBwEo1seuAcaZJ__Qfl2bs_0 2024-09-12T18:01:03.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3224775700758599127', time=2024-09-12T19:53:32.185806+0000, chain.objs.size()=1 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.304__shadow_.LPsvgVtQPRh29vC3_RodPPuK8p6vrAR_0 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14475948538432929256', time=2024-09-12T19:53:32.186991+0000, chain.objs.size()=1 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.304__shadow_.Ng6uNuzVcNZZtuJGRF_4VG0fc086qUo_0 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17264245470030187262', time=2024-09-12T19:53:34.756252+0000, chain.objs.size()=1 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.316__shadow_.QvrFgY1Qk_0G9ZbHYb8-9bN3bYyPZPz_0 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5952268407605922752', time=2024-09-12T19:53:44.542721+0000, chain.objs.size()=1 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dAQMuaBjXdcWhhpiNt1qpfVnRnx7THg_0 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8795945050823533228', time=2024-09-12T19:53:44.596710+0000, chain.objs.size()=1 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Jk3Uu5K9196T64Be54FXOT0jE7k_SKd_0 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18256830154607178749', time=2024-09-12T19:53:44.625101+0000, chain.objs.size()=1 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fLVvIDcIkm-PG5T3_YC2pzkCyoEGB8F_0 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.270+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4597948260458715345', time=2024-09-12T19:53:44.647523+0000, chain.objs.size()=1 2024-09-12T18:01:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.270+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kOxMnr5YvhfirEsbngdWECwWs-tzYzc_0 2024-09-12T18:01:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.273+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10967782673467822942', time=2024-09-12T19:53:44.979636+0000, chain.objs.size()=1 2024-09-12T18:01:03.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.273+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pR32RbSQcp2MfaHWswdzid7Nw7DXnis_0 2024-09-12T18:01:03.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.273+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1956603058278891143', time=2024-09-12T19:53:45.132970+0000, chain.objs.size()=1 2024-09-12T18:01:03.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.273+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ONeVfP5GCgQC2Efa5x7ltjd0sX-xy-9_0 2024-09-12T18:01:03.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16117641775927032366', time=2024-09-12T19:53:45.135205+0000, chain.objs.size()=1 2024-09-12T18:01:03.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zAZifHfsoEbDajvby06lxOdmYgF1Myc_0 2024-09-12T18:01:03.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9256090748163707230', time=2024-09-12T19:53:45.148159+0000, chain.objs.size()=1 2024-09-12T18:01:03.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.63AwjpjcJ04EG0rX4j4ht9jVVLktVsb_0 2024-09-12T18:01:03.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14263363972446697122', time=2024-09-12T19:53:45.180192+0000, chain.objs.size()=1 2024-09-12T18:01:03.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.na2838tr-_gtO4DvlfAjoSQEeSVMIQJ_0 2024-09-12T18:01:03.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11432740268630801580', time=2024-09-12T19:53:45.236880+0000, chain.objs.size()=1 2024-09-12T18:01:03.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HypBuSeJabQ8kp1UZtgpKy3iJm8dJXd_0 2024-09-12T18:01:03.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2583440253366656396', time=2024-09-12T19:53:45.416049+0000, chain.objs.size()=1 2024-09-12T18:01:03.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UFBRBqka5-9xFNRwYXKVhe71MLl5vcb_0 2024-09-12T18:01:03.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15482653175929298647', time=2024-09-12T19:53:45.443016+0000, chain.objs.size()=1 2024-09-12T18:01:03.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wtqvw_qDIxOI7543BTFwZsUqcbCN7ph_0 2024-09-12T18:01:03.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.276+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15038214825188452832', time=2024-09-12T19:53:45.455534+0000, chain.objs.size()=1 2024-09-12T18:01:03.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.276+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._TVegSrM3VK5QqnrPse7Nrt7XGf1tGs_0 2024-09-12T18:01:03.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.278+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9864270895257240828', time=2024-09-12T19:53:45.457547+0000, chain.objs.size()=1 2024-09-12T18:01:03.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.278+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hqoX-kUn7_sw4bCzskB_duRN0iVy37t_0 2024-09-12T18:01:03.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.278+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.619759935544430557', time=2024-09-12T19:53:45.535660+0000, chain.objs.size()=1 2024-09-12T18:01:03.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.278+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9aY_p__tCsja_PKhBfj85i7bDHRqBKz_0 2024-09-12T18:01:03.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.278+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5478619115746454507', time=2024-09-12T19:53:45.536672+0000, chain.objs.size()=1 2024-09-12T18:01:03.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.278+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MVNlUnLvcZ_w_rpKxVZpQ3H9bLb0cVU_0 2024-09-12T18:01:03.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.280+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1689912594188592502', time=2024-09-12T19:53:45.562779+0000, chain.objs.size()=1 2024-09-12T18:01:03.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.280+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TSHknJFX3g4I4DTx-j4bMRnugzJHFwC_0 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15493608013830816299', time=2024-09-12T19:53:45.638929+0000, chain.objs.size()=1 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7ztGyjqtfr7oLM6tvHg5YURTyutYYGm_0 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8852122318342174880', time=2024-09-12T19:53:45.768996+0000, chain.objs.size()=1 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3Otu9EZvQJinsdeSerGCvCyyzEBn6x8_0 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9564260885738886708', time=2024-09-12T19:53:45.958083+0000, chain.objs.size()=1 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oPBmv56IK11ltOBUA1m9xIdwsFntcXp_0 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16180966730266364849', time=2024-09-12T19:53:45.968553+0000, chain.objs.size()=1 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bNxgqmnGmNys7zHckylb4I3xNDpcCEv_0 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11068981877813779255', time=2024-09-12T19:53:46.006977+0000, chain.objs.size()=1 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wwQ4LvNBxzG6sE0YIxQV6KVln1IDVEP_0 2024-09-12T18:01:03.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1925159732456728534', time=2024-09-12T19:53:46.010218+0000, chain.objs.size()=1 2024-09-12T18:01:03.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9FyYS4TENvg8MnvFApsFysc29LeK0e-_0 2024-09-12T18:01:03.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12289048697652947051', time=2024-09-12T19:53:46.014816+0000, chain.objs.size()=1 2024-09-12T18:01:03.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.281+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pAmb1yf5_sf2roW5IFsRpu8XttGEA3A_0 2024-09-12T18:01:03.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.282+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11256042838269407939', time=2024-09-12T19:53:46.051041+0000, chain.objs.size()=1 2024-09-12T18:01:03.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.282+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4JpmvFaoIhr6ZJEOR1d3Wm2XU7jCOnN_0 2024-09-12T18:01:03.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.282+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1903857189391797190', time=2024-09-12T19:53:46.147283+0000, chain.objs.size()=1 2024-09-12T18:01:03.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.282+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dtreFoysPLLaZi_-Ii_MPa2aAVM5ldS_0 2024-09-12T18:01:03.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.284+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1287948997775099999', time=2024-09-12T19:53:46.157305+0000, chain.objs.size()=1 2024-09-12T18:01:03.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.284+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qYUhLEWGxfmBP9VBdCWgvu0n4CbmS8F_0 2024-09-12T18:01:03.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.285+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9370843899472096084', time=2024-09-12T19:53:46.238517+0000, chain.objs.size()=1 2024-09-12T18:01:03.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.285+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TjYmuzglq_2UmlZ0vHPU2G-0bmFXdfb_0 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4221708564795577149', time=2024-09-12T19:53:54.702206+0000, chain.objs.size()=1 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HhY-2qQ4G22yuoxuwW2baC44mpzL1hi_0 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15432887801446103730', time=2024-09-12T19:53:54.745545+0000, chain.objs.size()=1 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.V3WZpgHum6z-XDGJoAygOIhcwm146y0_0 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18217781904757840749', time=2024-09-12T19:53:54.861835+0000, chain.objs.size()=1 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Q-p8xRFRnpnrLIAaKHFaCD9ysHGDogj_0 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15952585361401951167', time=2024-09-12T19:53:54.951712+0000, chain.objs.size()=1 2024-09-12T18:01:03.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.286+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Lo8cEf9GSPw40vW3JNlgGnensmFQdKr_0 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9186885069993508002', time=2024-09-12T19:53:54.959710+0000, chain.objs.size()=1 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.287+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zCEC18meCSOwQaON3r2ds7R_ekD3Xni_0 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12758176221148311412', time=2024-09-12T19:53:54.967809+0000, chain.objs.size()=1 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Tr7N_SOCey68Xj1Vyn9d5qETLvU3VgC_0 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12574078534290432351', time=2024-09-12T19:53:55.050090+0000, chain.objs.size()=1 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ryTA_mw5a1n3Y8EunXSWvrS0wcGSj1X_0 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.451079074982062871', time=2024-09-12T19:53:55.071195+0000, chain.objs.size()=1 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lNYK2kjrjrCWws1fndF0-shs0oo21LN_0 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10993295614511159988', time=2024-09-12T19:53:55.091716+0000, chain.objs.size()=1 2024-09-12T18:01:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.dcf-x85OX68fNA9_BSJP7wRt2nf13p8_0 2024-09-12T18:01:03.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11963817712662860759', time=2024-09-12T19:53:55.126976+0000, chain.objs.size()=1 2024-09-12T18:01:03.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.288+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9teQI4CdemUCsvTXRjDWTvWxWB7wFwD_0 2024-09-12T18:01:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.290+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11829043352352412930', time=2024-09-12T19:53:55.162215+0000, chain.objs.size()=1 2024-09-12T18:01:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.290+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4Ui4dye7-bUZrZQHw-Oyuc4rgDK1DEn_0 2024-09-12T18:01:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.290+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.412345953644215803', time=2024-09-12T19:53:55.279610+0000, chain.objs.size()=1 2024-09-12T18:01:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.290+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.WTMOE9Q5t3VAuu0x6MqtX3Fci4A6g5T_0 2024-09-12T18:01:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13270531354647372266', time=2024-09-12T19:53:55.301323+0000, chain.objs.size()=1 2024-09-12T18:01:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ihfglPpSCpHeWsOooUuz8Fjs73_favE_0 2024-09-12T18:01:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.294+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16891946001755947391', time=2024-09-12T19:53:55.373024+0000, chain.objs.size()=1 2024-09-12T18:01:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.294+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qocYR2ZwG4yjhRyANAxn4XxzCgy_Wi0_0 2024-09-12T18:01:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.294+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9349299217141070372', time=2024-09-12T19:53:55.506164+0000, chain.objs.size()=1 2024-09-12T18:01:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.294+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.oTuVJdTKD8rdjfNA_neQBVxGu3Fg0Pv_0 2024-09-12T18:01:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.294+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11886714642378792071', time=2024-09-12T19:53:55.611306+0000, chain.objs.size()=1 2024-09-12T18:01:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.294+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GjaGlvxTxcnASeifNCRmfvN2WzaSgfK_0 2024-09-12T18:01:03.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.297+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/48923 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17043426506831463218', time=2024-09-12T19:53:55.613856+0000, chain.objs.size()=1 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MuKwnc1X9woghIaNoY7fPfuNt44W9UY_0 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10890854132693086823', time=2024-09-12T19:53:55.729476+0000, chain.objs.size()=1 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EOyuGR970vArHNAC6IkjkLyzT4TX7Pi_0 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11244171180884443297', time=2024-09-12T19:53:55.738062+0000, chain.objs.size()=1 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QI0VjMuQchj_0-MuuGwn3TOsrid4IYY_0 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16561121263420545551', time=2024-09-12T19:53:55.790241+0000, chain.objs.size()=1 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EBEBaU9rqNi6ENH34_Oi8DgdMXbadQu_0 2024-09-12T18:01:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12142664550457791112', time=2024-09-12T19:53:55.818846+0000, chain.objs.size()=1 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-wKnUhs-4D_KaTcytKwrGy2A-KgpliR_0 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17603428881429296122', time=2024-09-12T19:53:55.905017+0000, chain.objs.size()=1 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-Osv6CVtZSzi1ww6_E7rSlXtXz1vf_z_0 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2633104555741030868', time=2024-09-12T19:53:55.946131+0000, chain.objs.size()=1 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2MwFkx9rwx0KFgVHFyX-4dRQ2tjxUgB_0 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17734668917706484868', time=2024-09-12T19:53:55.965712+0000, chain.objs.size()=1 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.V2ujAzVnNjmtYrupMgI7qGJvl4jH8V1_0 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.953206960913136515', time=2024-09-12T19:53:56.104602+0000, chain.objs.size()=1 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Wa6yUPP72_jpyKtMcofk3zrsxHostKf_0 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6946943666694040563', time=2024-09-12T19:53:56.131985+0000, chain.objs.size()=1 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TSNKLhNhXJ1DMQhsLnJKFn7MtU1fTK-_0 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2614437723734752151', time=2024-09-12T19:54:08.585495+0000, chain.objs.size()=1 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.385__shadow_.z1yHRLHv2TozyKiu9wXvCev0jTpTD1W_0 2024-09-12T18:01:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1245060366422925456', time=2024-09-12T19:54:27.166862+0000, chain.objs.size()=1 2024-09-12T18:01:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.463__shadow_.0Uff9y2_PPeGS8dKRz8_IYxm-sttsoG_0 2024-09-12T18:01:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.573520816935292802', time=2024-09-12T19:55:25.436913+0000, chain.objs.size()=2 2024-09-12T18:01:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.558__shadow_.YMt0dk3Fl0sUGwiLt-52lbjsx3ABZb1_0 2024-09-12T18:01:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.558__shadow_.YMt0dk3Fl0sUGwiLt-52lbjsx3ABZb1_1 2024-09-12T18:01:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16467342203572786697', time=2024-09-12T19:55:38.916854+0000, chain.objs.size()=1 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:8iFUghOhd6Egsi4d6EhBNOjL6-s1r0z_._nTvZjH4HO6zbiOTgT4DW-3NpM-Up30_0 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12810669453787096733', time=2024-09-12T19:55:43.484995+0000, chain.objs.size()=1 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.576__shadow_.32jbbGqOlDAverTzCFeIJb8QCUDB6q8_0 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18177091901549585678', time=2024-09-12T19:56:02.134597+0000, chain.objs.size()=1 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:eu-l6LZR4NZu3ibYDgOuht5-BHXToRa_.pF-dZ6yJ5aazbZK4zCyY4Dsp6AKnCy7_0 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8661989124410778647', time=2024-09-12T19:56:05.288999+0000, chain.objs.size()=1 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:Q2tjK20KOAy3Rk66RBthHmD1hqCcBHu_.sbPZ8Oup6TC75C6MyQcLN2dIS7FYYFc_0 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9033965836251901724', time=2024-09-12T19:56:05.301527+0000, chain.objs.size()=1 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:OJMCpv5oM-tHb6MpXQtdeh8z.W2KEzw_.OxYVBUP0i-0-rG75g7bwU7L8ekvDzQw_0 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12245918612087322647', time=2024-09-12T19:58:29.722379+0000, chain.objs.size()=1 2024-09-12T18:01:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.664__shadow_.C0O2HkV-BJN-HQ32sTYQtc3HSUJld-R_0 2024-09-12T18:01:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8656463137589757967', time=2024-09-12T19:58:30.115659+0000, chain.objs.size()=1 2024-09-12T18:01:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.665__shadow_.oHa5h2buznOw95tEW6vdFdnryvo9Oip_0 2024-09-12T18:01:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5390380802490296190', time=2024-09-12T19:58:35.822551+0000, chain.objs.size()=1 2024-09-12T18:01:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.693__shadow:Ht5wlXvukFVLSpNFGb2.6Gb1kvjGthz_.reHBmz2qHqr--Zfi3wsSjPzqP3R-N7j_0 2024-09-12T18:01:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~gqH1X-Uzx53n1YF-nZxBUmwJT3kjGfC', time=2024-09-12T19:59:07.426787+0000, chain.objs.size()=1 2024-09-12T18:01:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743__multipart_mymultipart.2~gqH1X-Uzx53n1YF-nZxBUmwJT3kjGfC.1 2024-09-12T18:01:03.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.313+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:01:03.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53329' 2024-09-12T18:01:03.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_v387W-bAr2bL0I3JHRnZF8H7PeZhT1o', time=2024-09-12T19:52:00.515706+0000, chain.objs.size()=1 2024-09-12T18:01:03.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.164__shadow_.MOCkjywW9-H5xyCkzc1DMkAjooHVnin_0 2024-09-12T18:01:03.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17211423839474595116', time=2024-09-12T19:53:12.035381+0000, chain.objs.size()=1 2024-09-12T18:01:03.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.257__shadow_.prqCnd6SZx1Lceh5pbB0gI_gsSuXzDt_0 2024-09-12T18:01:03.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10985753507019735300', time=2024-09-12T19:53:13.076995+0000, chain.objs.size()=1 2024-09-12T18:01:03.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.262__shadow_.uGcoRB8Z-Rl3qQPg93-hjKiJ9dTKzwS_0 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9153187955330773357', time=2024-09-12T19:53:21.255305+0000, chain.objs.size()=1 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nsyjqCcXKoggWUaQ9FHkzOiYPXL0xt0_0 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1363277238392180112', time=2024-09-12T19:53:21.371673+0000, chain.objs.size()=1 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xqMq-3BJYhcPVfW73TeTG84bqcvU55W_0 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4246124753734994888', time=2024-09-12T19:53:21.415495+0000, chain.objs.size()=1 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GlBDi-WEs0TOVOkUCR3GPt0pg2sCKkt_0 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11351803368867778452', time=2024-09-12T19:53:21.420558+0000, chain.objs.size()=1 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Yq-6zI5xdMS9agZ_GoNw_3sBbaLKBt2_0 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9137624553539326114', time=2024-09-12T19:53:21.423307+0000, chain.objs.size()=1 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TAPJrnkcNupBQx2aA9_VjmRgYX23oaV_0 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1347197210269220594', time=2024-09-12T19:53:21.430805+0000, chain.objs.size()=1 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.R0gK0pgda4zQ2k-MClSV2RSpMJr05Pd_0 2024-09-12T18:01:03.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16394034720079605425', time=2024-09-12T19:53:21.443648+0000, chain.objs.size()=1 2024-09-12T18:01:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HjbgVLOmXLBCCtwLEKdXpFjWi6mMDmX_0 2024-09-12T18:01:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10045197391818494906', time=2024-09-12T19:53:21.476917+0000, chain.objs.size()=1 2024-09-12T18:01:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.idFuoDQOIJH14woINl-Knboy2oPHWfi_0 2024-09-12T18:01:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3809773767293125432', time=2024-09-12T19:53:21.575941+0000, chain.objs.size()=1 2024-09-12T18:01:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.315+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.eBMWLB-zyiEUNMGgTpmssh9Hicrgcj7_0 2024-09-12T18:01:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.318+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2759232374847014321', time=2024-09-12T19:53:21.584521+0000, chain.objs.size()=1 2024-09-12T18:01:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.318+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FxbP4DMe_W4t9Q1SCJyyMSfesL3ACqh_0 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3530046235976959979', time=2024-09-12T19:53:21.657691+0000, chain.objs.size()=1 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QOeFQ-1A-qXU7uQphcuFb8r_z294kX-_0 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14648033427733554350', time=2024-09-12T19:53:21.682579+0000, chain.objs.size()=1 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.R9jwcCCskR_8dss3LckQouIaUja-YU__0 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8080184058187477993', time=2024-09-12T19:53:21.692089+0000, chain.objs.size()=1 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fqJFVDTfPFv5rMR778wsdBdM4v_aq1z_0 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1492940614196682670', time=2024-09-12T19:53:21.697055+0000, chain.objs.size()=1 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DknyPF8USwACa9NbgTcZJVeN_MOSqzK_0 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6485967676958688654', time=2024-09-12T19:53:21.781320+0000, chain.objs.size()=1 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WHxupPHkTWs0B2GsNzvQZk7-bLx2x2F_0 2024-09-12T18:01:03.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16195207411366209507', time=2024-09-12T19:53:21.821906+0000, chain.objs.size()=1 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.UYLJSpqdVoyaoFV4FkVx8HonT0YZa8E_0 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18046863378788318957', time=2024-09-12T19:53:21.979225+0000, chain.objs.size()=1 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7aArfA0Iylbf42wsPzP80pBQ2nw69md_0 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7426671518716124530', time=2024-09-12T19:53:22.022816+0000, chain.objs.size()=1 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.320+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jPJgo_qWaDtB5bJqkRfZC-lSq9ngMqX_0 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.321+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11525374867504594085', time=2024-09-12T19:53:22.025941+0000, chain.objs.size()=1 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.321+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.C7vlYaK6fhVsNPLkKEsvGT44wfDe0-B_0 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.321+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11720130564751360332', time=2024-09-12T19:53:22.184268+0000, chain.objs.size()=1 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.321+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.N4L4RrRbmv-a42NkzKDIWPYcT-VCuhW_0 2024-09-12T18:01:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3771752516585476040', time=2024-09-12T19:53:22.206477+0000, chain.objs.size()=1 2024-09-12T18:01:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FuUWRg5rTZ7oberQ1FOKkKav_QhZ1V2_0 2024-09-12T18:01:03.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.325+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16982001121870449074', time=2024-09-12T19:53:22.485071+0000, chain.objs.size()=1 2024-09-12T18:01:03.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.325+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aV1Ut6poB61Sn8yZzRmFJpvClEeP--K_0 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10345108079440897776', time=2024-09-12T19:53:22.622749+0000, chain.objs.size()=1 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.m4oOitq8OsIQfAT7up49FW2JIExLPPn_0 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8503224826083344496', time=2024-09-12T19:53:22.628336+0000, chain.objs.size()=1 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.5rTGIYRJoyiokpeMl0RiY0vGHHiK4CP_0 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5613827185248423828', time=2024-09-12T19:53:22.652254+0000, chain.objs.size()=1 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.22STIyl69dmdsB0PBXlBhxnIxlON6ji_0 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12993849367671327672', time=2024-09-12T19:53:22.652956+0000, chain.objs.size()=1 2024-09-12T18:01:03.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.SkUppjduBkRhNwlWCc0AQelivG3d_sp_0 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16687885249470774330', time=2024-09-12T19:53:22.659467+0000, chain.objs.size()=1 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zKi7aCzKnDqFvWTUP9CcczwZtcxQzsA_0 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11626386957988563249', time=2024-09-12T19:53:22.682328+0000, chain.objs.size()=1 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mBTTVVf_supbfI1_PGMcvJIn3ZNQs_d_0 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8454341187368695908', time=2024-09-12T19:53:23.045880+0000, chain.objs.size()=1 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.265__shadow_.ul-S24cMUumW6VcQGcrDaYGe01UO1TU_0 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8752091964132846443', time=2024-09-12T19:53:27.185577+0000, chain.objs.size()=1 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.285__shadow_.CWcwneFzfqEUxCos8--bEFRRMtL0LAs_0 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8349391603263888282', time=2024-09-12T19:53:27.927961+0000, chain.objs.size()=1 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.288__shadow_.YGJla3RzWPV4ypIV87hyFeNhAwQPtb3_0 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17373804550040104275', time=2024-09-12T19:53:29.341246+0000, chain.objs.size()=1 2024-09-12T18:01:03.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.QXcZOyT7_ClxGEZAzrUYS4iGC87H719_0 2024-09-12T18:01:03.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.330+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10388062439339437290', time=2024-09-12T19:53:29.937485+0000, chain.objs.size()=1 2024-09-12T18:01:03.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.330+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.zzUKBnVmbbO2nDvD6Np1B1IY9tpa7J7_0 2024-09-12T18:01:03.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10770711128912410671', time=2024-09-12T19:53:30.407800+0000, chain.objs.size()=1 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.296__shadow_.YXWTrTZLbhuExsLTfUhON4CDUAMMstG_0 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6765545886125855658', time=2024-09-12T19:53:36.058910+0000, chain.objs.size()=1 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.323__shadow_.-K5MSi9lAAzjP-cmoqKtdSsoEX3C3u1_0 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1514378763325235958', time=2024-09-12T19:53:44.524816+0000, chain.objs.size()=1 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ef2NWUoW_tWJqt2HD9F_KJqhEZSNU7K_0 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2913596685266033312', time=2024-09-12T19:53:44.542658+0000, chain.objs.size()=1 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.g_M9oq_riGqqzC-nBoN0cS5FNpNyzvU_0 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.332+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16271942084390050598', time=2024-09-12T19:53:44.580781+0000, chain.objs.size()=1 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hEWt_ohr2PVbZoQvB9V-f0euBzCVJDc_0 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3226837655531188320', time=2024-09-12T19:53:44.618916+0000, chain.objs.size()=1 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hD4WxfYhucG8tlE19TAPK80AtReFMax_0 2024-09-12T18:01:03.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11828302666561120094', time=2024-09-12T19:53:44.937417+0000, chain.objs.size()=1 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fduQIwzBpawGojSazfAdOw0FjBwhaoN_0 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2940793588789691144', time=2024-09-12T19:53:44.941886+0000, chain.objs.size()=1 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IHA3IRkxt3uy8RpxFICzyniG9UZc46T_0 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8816782627827849665', time=2024-09-12T19:53:44.995036+0000, chain.objs.size()=1 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nDVAlzeEtfQjNEZt6PhTs2JQjFZ-Ixx_0 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17895443128280513404', time=2024-09-12T19:53:45.147420+0000, chain.objs.size()=1 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mhGulPf221koTGLl-1ixicD5Ay2Sg7j_0 2024-09-12T18:01:03.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.335+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11384648930880833683', time=2024-09-12T19:53:45.170955+0000, chain.objs.size()=1 2024-09-12T18:01:03.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.335+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dBA4V78pQofBHvq4h6lP4-H49M0ZXCF_0 2024-09-12T18:01:03.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.337+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12375883340187926948', time=2024-09-12T19:53:45.242133+0000, chain.objs.size()=1 2024-09-12T18:01:03.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.337+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.D877MTdr3VUnr7LnaxPxu8BxnJzn5Iw_0 2024-09-12T18:01:03.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.337+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5554874509619161446', time=2024-09-12T19:53:45.252487+0000, chain.objs.size()=1 2024-09-12T18:01:03.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.337+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FsKDnqlNVU0JVhxHHTyOuM8tFoIh-K3_0 2024-09-12T18:01:03.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5839784268768800445', time=2024-09-12T19:53:45.258591+0000, chain.objs.size()=1 2024-09-12T18:01:03.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fptWdeL2a3xKT8wrhKP8PqcISmrSLtk_0 2024-09-12T18:01:03.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3871954363738496504', time=2024-09-12T19:53:45.341211+0000, chain.objs.size()=1 2024-09-12T18:01:03.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FnaEf0BOlLdNlXBJ1kha8VMvy3wGFmg_0 2024-09-12T18:01:03.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5266053295291676610', time=2024-09-12T19:53:45.388655+0000, chain.objs.size()=1 2024-09-12T18:01:03.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mmBX9ZUxieCbdQsrIlv1k_XSxmFyOR0_0 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743026403571664220', time=2024-09-12T19:53:45.399553+0000, chain.objs.size()=1 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HaVQa-OclHIWah_WZ4HSc0H4ifleGuX_0 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17068163586026087288', time=2024-09-12T19:53:45.438511+0000, chain.objs.size()=1 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5r5H_njmCMejJkXEXkwpuOjP3Nd-VO7_0 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5806701639885737638', time=2024-09-12T19:53:45.449491+0000, chain.objs.size()=1 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qwJIYglBO1eY8XmAx6MYGUgheT-WlOy_0 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12411042528994159801', time=2024-09-12T19:53:45.573501+0000, chain.objs.size()=1 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.c1Jt96v2FXPDViY4Qqz5ZmwBvUktPyl_0 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10416497310301819609', time=2024-09-12T19:53:45.585104+0000, chain.objs.size()=1 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nur4pfkGu8mORIHgM7Ib-oR6kHLKuqs_0 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1070278512908226816', time=2024-09-12T19:53:45.610904+0000, chain.objs.size()=1 2024-09-12T18:01:03.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.339+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iw8LkPTMw1adUiqXbR42QKFx0YNkLgg_0 2024-09-12T18:01:03.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7542319086783234678', time=2024-09-12T19:53:45.632555+0000, chain.objs.size()=1 2024-09-12T18:01:03.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZScfpxuBQSXaAG0VC2u13-IeYlzdX3j_0 2024-09-12T18:01:03.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8266327305799488045', time=2024-09-12T19:53:45.738277+0000, chain.objs.size()=1 2024-09-12T18:01:03.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0_Ewfcu-6Ab6kaRVZl-_nP-4HpOBvtk_0 2024-09-12T18:01:03.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4317957026824406951', time=2024-09-12T19:53:45.769377+0000, chain.objs.size()=1 2024-09-12T18:01:03.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KSFGVZ8bqs_qElkJzrzgRwc9hnFDflW_0 2024-09-12T18:01:03.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13983651153656135172', time=2024-09-12T19:53:45.807910+0000, chain.objs.size()=1 2024-09-12T18:01:03.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.342+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.r34RalLkToYcPvyx8VOnNYia-abnlsE_0 2024-09-12T18:01:03.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.343+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6285220386875185438', time=2024-09-12T19:53:45.837380+0000, chain.objs.size()=1 2024-09-12T18:01:03.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.343+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dxIZgIIGCdC7MZhn39LuLHAlLHqJccM_0 2024-09-12T18:01:03.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.343+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4106183140111732282', time=2024-09-12T19:53:45.992256+0000, chain.objs.size()=1 2024-09-12T18:01:03.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.343+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ANwFpGYKJ2LnLeN6IHfYILoqF2dxDzA_0 2024-09-12T18:01:03.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14715424371383330550', time=2024-09-12T19:53:46.045126+0000, chain.objs.size()=1 2024-09-12T18:01:03.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Mka1r_tUTP2at8_YEvJpkqzfJ2B7_ZW_0 2024-09-12T18:01:03.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9402998707226891182', time=2024-09-12T19:53:46.069252+0000, chain.objs.size()=1 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OtRggm0eKCx7iE--yDkouskv4UzdQOq_0 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1878165486115734712', time=2024-09-12T19:53:46.154091+0000, chain.objs.size()=1 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nO0GQxq2EsQG0p4iWjCUeh38F_xEpe5_0 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15533453813135942122', time=2024-09-12T19:53:46.226559+0000, chain.objs.size()=1 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RJHae_rCdWQrDMk3yko5T6vHlWF5aLX_0 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13409296150907326366', time=2024-09-12T19:53:46.234831+0000, chain.objs.size()=1 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.344+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.aS-vvo3HqFZAe495tjiSluqHdf4tL8Q_0 2024-09-12T18:01:03.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15709718790593596082', time=2024-09-12T19:53:46.236344+0000, chain.objs.size()=1 2024-09-12T18:01:03.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hHtOrjnlk76ndccPhBmgSfsdtTH7NV2_0 2024-09-12T18:01:03.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5984638418528630239', time=2024-09-12T19:53:54.694678+0000, chain.objs.size()=1 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.oQX48hj42VH90RLMA20IgxylcxF4WrO_0 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15667096586737622531', time=2024-09-12T19:53:54.910757+0000, chain.objs.size()=1 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sm982tN9Aa6vozOjQ6my2hPCWypkxt0_0 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3106866365886734048', time=2024-09-12T19:53:54.952343+0000, chain.objs.size()=1 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HSMbcZ4DYpwyPw7b5AsOECIul20la33_0 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.329137603996911973', time=2024-09-12T19:53:54.970709+0000, chain.objs.size()=1 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mqmXkz6Z5dd1syaIe-EcVJZWFaye04i_0 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8983744626880018056', time=2024-09-12T19:53:55.113785+0000, chain.objs.size()=1 2024-09-12T18:01:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9c2FcKfyoDsZAHnOB3N1fq3-43K3SRF_0 2024-09-12T18:01:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.349+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11743209159411038008', time=2024-09-12T19:53:55.118909+0000, chain.objs.size()=1 2024-09-12T18:01:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.349+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uX9EAyIy1h865N0ZNgbyr7w_9DDE3Zs_0 2024-09-12T18:01:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.349+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8252180541336954436', time=2024-09-12T19:53:55.131832+0000, chain.objs.size()=1 2024-09-12T18:01:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.349+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vTRcyxknaAaqbfaNG9gPcsiDy00LRov_0 2024-09-12T18:01:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.351+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1711661825937783270', time=2024-09-12T19:53:55.154269+0000, chain.objs.size()=1 2024-09-12T18:01:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.351+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4qBSSWrP_KSEjSrG_B_JxQascwthtZX_0 2024-09-12T18:01:03.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2982360300467948877', time=2024-09-12T19:53:55.287475+0000, chain.objs.size()=1 2024-09-12T18:01:03.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zLaWiiXlmWTzyzXBdAP_w8w6v4rsk6y_0 2024-09-12T18:01:03.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6253205407169886076', time=2024-09-12T19:53:55.307459+0000, chain.objs.size()=1 2024-09-12T18:01:03.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.X8430ywfhig02NeWVDZw1WUtHMZoKzd_0 2024-09-12T18:01:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17723345042589604625', time=2024-09-12T19:53:55.319710+0000, chain.objs.size()=1 2024-09-12T18:01:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CllMwcrkDF-RVsW7ZbrqUU9MzxZRkwO_0 2024-09-12T18:01:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16658567186734555354', time=2024-09-12T19:53:55.359637+0000, chain.objs.size()=1 2024-09-12T18:01:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xfTCeu8xXnPf_jAociHVGeKeKr4SU6X_0 2024-09-12T18:01:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2918087703571150689', time=2024-09-12T19:53:55.504569+0000, chain.objs.size()=1 2024-09-12T18:01:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SuiF0BLBLdd5LrA6v-PhryczWQrZggZ_0 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.354+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1852120471770126962', time=2024-09-12T19:53:55.516185+0000, chain.objs.size()=1 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.354+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-er9tN-t6OXEGyQquDcJdT0-5RXPEax_0 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9771205058964965040', time=2024-09-12T19:53:55.520877+0000, chain.objs.size()=1 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.PH2TAJB1xys28YtTGvJKDVasHkO4Fk7_0 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7060819701507357491', time=2024-09-12T19:53:55.534668+0000, chain.objs.size()=1 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Ic88ht3dF89SXMgEkWq2x8BYo6GwFtc_0 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6850573477897033362', time=2024-09-12T19:53:55.538570+0000, chain.objs.size()=1 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EymQkB1uTU8ryyjEJMelJeF2ylts8lh_0 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8814638413050408307', time=2024-09-12T19:53:55.569500+0000, chain.objs.size()=1 2024-09-12T18:01:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kU49YtK7oKzDSLVXvUizp39IKilB9Dv_0 2024-09-12T18:01:03.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7043950013845291278', time=2024-09-12T19:53:55.570545+0000, chain.objs.size()=1 2024-09-12T18:01:03.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.355+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.iQETfxXppvssuIk8XczEVWtfPi7muJc_0 2024-09-12T18:01:03.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.356+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17674354713904950544', time=2024-09-12T19:53:55.595491+0000, chain.objs.size()=1 2024-09-12T18:01:03.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.356+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0d4SRV6IBCReub0pGsNsKudwOyWxy43_0 2024-09-12T18:01:03.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.357+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3323447657851299290', time=2024-09-12T19:53:55.720231+0000, chain.objs.size()=1 2024-09-12T18:01:03.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.357+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.AI-ahT-96yj9hkJjcjqOyT8M9PjEpCO_0 2024-09-12T18:01:03.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9253023879144088081', time=2024-09-12T19:53:55.725102+0000, chain.objs.size()=1 2024-09-12T18:01:03.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.flwGvflB2_2CcvZxzy9VAILzNKC-HCe_0 2024-09-12T18:01:03.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7650644397717829625', time=2024-09-12T19:53:55.762172+0000, chain.objs.size()=1 2024-09-12T18:01:03.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.A3PCShJJ50hk_XnF4Bis9to6m-7OkwY_0 2024-09-12T18:01:03.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14391122865391861683', time=2024-09-12T19:53:55.800220+0000, chain.objs.size()=1 2024-09-12T18:01:03.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vsIIGgl-MUxGkTFFRePo7poXSMIT8aU_0 2024-09-12T18:01:03.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9922098018654008720', time=2024-09-12T19:53:55.827607+0000, chain.objs.size()=1 2024-09-12T18:01:03.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.358+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.E5qbi-ASqYWVxjaWtq3Ijzc0kJeWkTs_0 2024-09-12T18:01:03.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6712691016558251978', time=2024-09-12T19:53:55.905281+0000, chain.objs.size()=1 2024-09-12T18:01:03.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8H4Z50bx5ZLFdEgg3OrflDG4tC2OPSv_0 2024-09-12T18:01:03.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2332110829952601549', time=2024-09-12T19:53:55.926773+0000, chain.objs.size()=1 2024-09-12T18:01:03.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ATvnIdSteyL7EOVOKZtzxJG-SnWn7E6_0 2024-09-12T18:01:03.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13259009132093635231', time=2024-09-12T19:53:55.927446+0000, chain.objs.size()=1 2024-09-12T18:01:03.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Yq1OfcG--l-Hb5vcMLkdT-SirWCx1I__0 2024-09-12T18:01:03.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10846433042870050191', time=2024-09-12T19:53:55.965142+0000, chain.objs.size()=1 2024-09-12T18:01:03.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.359+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.v6G8HUZY9-bLRO4XOpOCX8f9MmZW77m_0 2024-09-12T18:01:03.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.360+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11904116869350727289', time=2024-09-12T19:53:55.978972+0000, chain.objs.size()=1 2024-09-12T18:01:03.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.360+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.n-7cwVaedoxwn5odrEYcwwzWFN9E9od_0 2024-09-12T18:01:03.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.364+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/53329 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17283974618970621431', time=2024-09-12T19:53:55.979795+0000, chain.objs.size()=1 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Acns_4_3GLcJSXyYrjWC33nU6nkLKM7_0 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.255292369210262265', time=2024-09-12T19:53:55.997097+0000, chain.objs.size()=1 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wrPkLZmn5IYjpVzr6bdmYY4-e0yBm-S_0 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2144328554159749283', time=2024-09-12T19:53:56.001028+0000, chain.objs.size()=1 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rom-3FKJjY22XAsIVtbFNJz8MN0x-8I_0 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17269722150240790256', time=2024-09-12T19:53:56.014142+0000, chain.objs.size()=1 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.irEHeU31zxcaFDU3xe8YgsicK00C8Wa_0 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8150813756793148268', time=2024-09-12T19:53:56.121457+0000, chain.objs.size()=1 2024-09-12T18:01:03.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GmBce0JVoOC8un7ZojQsxMzKIPjbu3I_0 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4218954219369399443', time=2024-09-12T19:53:56.145752+0000, chain.objs.size()=1 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yR-gs14MuUjDksLJCsouvmtuLmKBhZy_0 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9685700917515728947', time=2024-09-12T19:53:56.177143+0000, chain.objs.size()=1 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.o21vcXTFLx61UZ1myy1rhsT6GpCFNb0_0 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16297814459026724419', time=2024-09-12T19:53:56.179811+0000, chain.objs.size()=1 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kGJ5oEtmbAW4M1-SM_tU2EHJ7OVS_tP_0 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16281326526077703463', time=2024-09-12T19:53:56.181120+0000, chain.objs.size()=1 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jTdGS3jbvQTYlPLRAQKefsOWZBBB5a__0 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9990696587708592164', time=2024-09-12T19:53:57.714088+0000, chain.objs.size()=1 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.333__shadow_.6POvvBUIfJPfzJNlcEvG74a0fpUqozc_0 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17234546092818499088', time=2024-09-12T19:54:06.513871+0000, chain.objs.size()=1 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.378__shadow_.EWW5TSjgvKNqp0hXeSTKs3aUWOQdnU-_0 2024-09-12T18:01:03.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11388948007742962373', time=2024-09-12T19:54:20.248458+0000, chain.objs.size()=1 2024-09-12T18:01:03.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.367+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.437__shadow_.5-UzmVFE9ydDh6a-ekKegOZS2rhrsRO_0 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7398186709778208149', time=2024-09-12T19:54:20.843331+0000, chain.objs.size()=1 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.440__shadow_.hzD8gmwyYvXEu4dGFXUr20_XH4BkzLX_0 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2499328370821191481', time=2024-09-12T19:54:26.425862+0000, chain.objs.size()=1 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.461__shadow_.CWJS2Ns0uw5i8dN4QIrFGO6iD7uzGT2_0 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16410671071079934117', time=2024-09-12T19:54:40.818984+0000, chain.objs.size()=1 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.518__shadow_.5ExutKD5pzfAz9kQRalvYMQ_4-y1wpx_0 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~g4jX6CdMy5CWki8Meo6pQ5ThGkG-W2o', time=2024-09-12T19:54:55.436816+0000, chain.objs.size()=1 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.536__multipart_mymultipart.2~g4jX6CdMy5CWki8Meo6pQ5ThGkG-W2o.3 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7025491581725473040', time=2024-09-12T19:55:36.456758+0000, chain.objs.size()=1 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:LfHDfAbmZXMLsufIpABskm400xLFqGZ_.ot8MeCX0s2-WHpPJk6HHtCz-Y8rbjcw_0 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2522368454355245508', time=2024-09-12T19:55:43.893073+0000, chain.objs.size()=1 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:S5H6GhmjIGsWWkttypVL9jTJX9QD2HP_.ja60KUrvYsIk2RL_YYrvPIoMLYVrn8B_0 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8206492950236691112', time=2024-09-12T19:55:52.434684+0000, chain.objs.size()=1 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:-eVyTf3uLY2Za2YqH39fmlQqzgWibVE_.6egMHO9qgLsb9eZ_F9h9rCBR8sQgmBZ_0 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16186869367191854005', time=2024-09-12T19:56:02.126941+0000, chain.objs.size()=1 2024-09-12T18:01:03.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:INPZv-EKFmfy5o-66iC1mpkdjACF71P_.QSfDuoVgCdxkYkPfHmiFbFx7nmhW646_0 2024-09-12T18:01:03.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9267572795278969541', time=2024-09-12T19:58:38.258187+0000, chain.objs.size()=1 2024-09-12T18:01:03.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.704__shadow:asrQ1pXOfL9m0nhiwQMI6-xy-1lSD4M_.Zs1O2OpY5LEk39tMgkXFlSLqXK-lyu2_0 2024-09-12T18:01:03.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7306923219076225225', time=2024-09-12T19:59:06.696688+0000, chain.objs.size()=2 2024-09-12T18:01:03.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.741__shadow_.fFio-Y9jSGwbxyuLWLSQy2THClzk_OQ_0 2024-09-12T18:01:03.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.741__shadow_.fFio-Y9jSGwbxyuLWLSQy2THClzk_OQ_1 2024-09-12T18:01:03.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.378+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.381+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:01:03.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.382+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.383+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49426' 2024-09-12T18:01:03.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3875155786546498821', time=2024-09-12T19:53:07.652369+0000, chain.objs.size()=1 2024-09-12T18:01:03.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.237__shadow_.wMM718K7vNJ2Wog2_2zVQYch2AmACYr_0 2024-09-12T18:01:03.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12746573688520133536', time=2024-09-12T19:53:07.912526+0000, chain.objs.size()=1 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.238__shadow_.7jufkDQHtaAEKoM5uOoQGY0z9rFX0M1_0 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7521865246634881617', time=2024-09-12T19:53:08.174244+0000, chain.objs.size()=1 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.239__shadow_.222MzyRysYga_u0O5VLPuiZ1ovOpvWr_0 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14521090254245527251', time=2024-09-12T19:53:10.146541+0000, chain.objs.size()=1 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.248__shadow_.0cLt_v8Jb5HVfSbLMm5g3bvuNDGJXa7_0 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3883367748821758240', time=2024-09-12T19:53:21.168100+0000, chain.objs.size()=1 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hYPSR5I6Hxem4kvLi7H_6qPBn3MzTmH_0 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14224966166124599186', time=2024-09-12T19:53:21.237871+0000, chain.objs.size()=1 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.c7mjiu52TQZ2n7dQnaW6IBqNgdcK4h9_0 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15228135453082492960', time=2024-09-12T19:53:21.275731+0000, chain.objs.size()=1 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ok2zBPosGdCkm795FbVLkaXC7vFS83g_0 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.243055198658161599', time=2024-09-12T19:53:21.375281+0000, chain.objs.size()=1 2024-09-12T18:01:03.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.e4HbJy8MYqv2f1sn_Kcvc-LAKHr7fKM_0 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17740219134775116747', time=2024-09-12T19:53:21.391406+0000, chain.objs.size()=1 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xLs5eCPdM72vgsh057fUTwVqF9DxTbc_0 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17769226256625728141', time=2024-09-12T19:53:21.399354+0000, chain.objs.size()=1 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.e2wE_sOPVq5bY2pK1ux6TwAb3I8KQd2_0 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10750712874542693813', time=2024-09-12T19:53:21.400397+0000, chain.objs.size()=1 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CwZgoNJ_Btl7Ke8HLfVKAD0dJad3nEw_0 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.733584636506918973', time=2024-09-12T19:53:21.457741+0000, chain.objs.size()=1 2024-09-12T18:01:03.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XYYAG4tCfWsMIvYh6COS5MMMuMepCxy_0 2024-09-12T18:01:03.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.387+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14363135187776345243', time=2024-09-12T19:53:21.598548+0000, chain.objs.size()=1 2024-09-12T18:01:03.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.387+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.a8N_RV_wP156l22TwELtv6Eea9mwu7U_0 2024-09-12T18:01:03.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.387+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17726417907430488550', time=2024-09-12T19:53:21.607662+0000, chain.objs.size()=1 2024-09-12T18:01:03.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.387+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kFOARIsumntgRHGXmZKzd-c125Ljvje_0 2024-09-12T18:01:03.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.387+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17673756991513814824', time=2024-09-12T19:53:21.818408+0000, chain.objs.size()=1 2024-09-12T18:01:03.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.387+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.KzCXEUibT8FoDngGBECncZVAwC-pqUz_0 2024-09-12T18:01:03.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3251731392736358287', time=2024-09-12T19:53:21.826275+0000, chain.objs.size()=1 2024-09-12T18:01:03.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oXl7dQvPSN19yivE5S56wPFrwIW34-z_0 2024-09-12T18:01:03.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6292817420985679701', time=2024-09-12T19:53:21.844263+0000, chain.objs.size()=1 2024-09-12T18:01:03.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DNWsRraS8aS-3m-gjjJ2WAfgqXNyOCk_0 2024-09-12T18:01:03.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15249450412995043550', time=2024-09-12T19:53:21.848942+0000, chain.objs.size()=1 2024-09-12T18:01:03.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RPzm3V_oW2-o-vnhmMFXG7gnudkTj3M_0 2024-09-12T18:01:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9418660745861645168', time=2024-09-12T19:53:21.856225+0000, chain.objs.size()=1 2024-09-12T18:01:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DN7asKXj7DmY9h5IlXnlB7lBjf3EMo5_0 2024-09-12T18:01:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16683980498789359565', time=2024-09-12T19:53:21.870506+0000, chain.objs.size()=1 2024-09-12T18:01:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.SW5H6XiukqY0Gj04OhUkrrlw5kN7ECb_0 2024-09-12T18:01:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4782251265539938443', time=2024-09-12T19:53:21.995550+0000, chain.objs.size()=1 2024-09-12T18:01:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pUSbRwf7e-qztOApilSzxXPBLocZ_88_0 2024-09-12T18:01:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.342818403811120030', time=2024-09-12T19:53:22.001147+0000, chain.objs.size()=1 2024-09-12T18:01:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.390+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aaxtYBlCbBUFuBqU87xkBwFlkv0Vhdn_0 2024-09-12T18:01:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3455618090109798892', time=2024-09-12T19:53:22.032677+0000, chain.objs.size()=1 2024-09-12T18:01:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.teQGRQs4_CCt6diQjvssc3V9WfkS949_0 2024-09-12T18:01:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15122462204274999782', time=2024-09-12T19:53:22.086283+0000, chain.objs.size()=1 2024-09-12T18:01:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jE0rfOlG0OdqjEThj8T5fn7glY7BOBs_0 2024-09-12T18:01:03.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.392+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13663541641564172990', time=2024-09-12T19:53:22.196033+0000, chain.objs.size()=1 2024-09-12T18:01:03.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.392+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.q2UVjhTDQcbbTTAC-_y7dWSFGgwuog-_0 2024-09-12T18:01:03.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.392+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17155676149356603384', time=2024-09-12T19:53:22.219148+0000, chain.objs.size()=1 2024-09-12T18:01:03.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.392+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3Mvn8_IiUNOBwfJT48vL6ChsIfwlFEr_0 2024-09-12T18:01:03.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16585337962452882308', time=2024-09-12T19:53:22.236648+0000, chain.objs.size()=1 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.L9pONMONDp4QijPXZY5AN_pRhy7MQ5k_0 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.44508508123993709', time=2024-09-12T19:53:22.388039+0000, chain.objs.size()=1 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RPKLrrfhRITQbE7hkVJR3-yEaLj_agm_0 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4159325965867595085', time=2024-09-12T19:53:22.412174+0000, chain.objs.size()=1 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tEnJrFD3_YPFFeJuQuLQ0paJ3015AY1_0 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1768312402556282928', time=2024-09-12T19:53:22.428953+0000, chain.objs.size()=1 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yqN2hhJn90qUazusfGcwrU-h3SgpCWN_0 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8512267458713878357', time=2024-09-12T19:53:22.672269+0000, chain.objs.size()=1 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.d93bci_lo9JkbxtSkoEzVkDWDOArvc4_0 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13940544836625524572', time=2024-09-12T19:53:24.857500+0000, chain.objs.size()=1 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.274__shadow_.PHKYb0E42jj8DZqA77tXudJv-6CneiI_0 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12290274834511675961', time=2024-09-12T19:53:25.504668+0000, chain.objs.size()=1 2024-09-12T18:01:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.277__shadow_.ZTAWuNeTtjEChU8n-53IiOE0h28cuZY_0 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18345596420112238463', time=2024-09-12T19:53:25.710464+0000, chain.objs.size()=1 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.278__shadow_.8em-2kingKS7RPqdUvM3B0SfIuva_6i_0 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6210438549830898898', time=2024-09-12T19:53:28.134859+0000, chain.objs.size()=1 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.289__shadow_.4GFmSWjDZrVw1FFJ1eD1dTjGQFAOLie_0 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3517719581228483256', time=2024-09-12T19:53:28.340102+0000, chain.objs.size()=1 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.290__shadow_.bXXaXMfRzGfM177dm-DU2et0fJOnU3m_0 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11210958151478856618', time=2024-09-12T19:53:28.767432+0000, chain.objs.size()=1 2024-09-12T18:01:03.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.396+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.292__shadow_.xwOu0zR1kw2dY0f8-TmP0UTIKIBJRUK_0 2024-09-12T18:01:03.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.401+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14677755555565058412', time=2024-09-12T19:53:29.351076+0000, chain.objs.size()=1 2024-09-12T18:01:03.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.401+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.jvmvI1ozVuF0PKf-SJXESD5DFj-yQ6o_0 2024-09-12T18:01:03.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.401+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5390557612645109845', time=2024-09-12T19:53:44.523712+0000, chain.objs.size()=1 2024-09-12T18:01:03.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.401+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8MN3yCI7Y3iCjZ-0Oh1K58-nknFpSYz_0 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15592179766404862223', time=2024-09-12T19:53:44.558997+0000, chain.objs.size()=1 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9mOhN8XMyJ714uRGmHfVqDks6ff3BNQ_0 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4961619479937383107', time=2024-09-12T19:53:44.559572+0000, chain.objs.size()=1 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NgvPx-YGw8FHqnOTR_BtiR7nVuH4aU__0 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17630202368731120497', time=2024-09-12T19:53:44.571402+0000, chain.objs.size()=1 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-BwjExd0klPl4h99-vTLuHQevlZCutM_0 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3718279735975011599', time=2024-09-12T19:53:44.586242+0000, chain.objs.size()=1 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kMLtCXAwwB9zBFD1uqi-8BXFXYvTFMw_0 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18114918679620770208', time=2024-09-12T19:53:44.611214+0000, chain.objs.size()=1 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CsIbingz9JkWEmsCMzwLRgX9t4uvETj_0 2024-09-12T18:01:03.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14399311213752139914', time=2024-09-12T19:53:44.643664+0000, chain.objs.size()=1 2024-09-12T18:01:03.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Apo6qqbex23mfRrWsnIOKiz68JBj3Az_0 2024-09-12T18:01:03.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5520624926842353956', time=2024-09-12T19:53:44.925698+0000, chain.objs.size()=1 2024-09-12T18:01:03.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dzywyUSM9-cpSWtk6tP2t9BDfWysZN__0 2024-09-12T18:01:03.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1074983538223504261', time=2024-09-12T19:53:44.932710+0000, chain.objs.size()=1 2024-09-12T18:01:03.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KX4jx7pR05BLxmx3_JFZiX1vIydHCPv_0 2024-09-12T18:01:03.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12315984093603924908', time=2024-09-12T19:53:44.942296+0000, chain.objs.size()=1 2024-09-12T18:01:03.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.M37NsPddhVsoD3OK_MY5p0zDC-6imHm_0 2024-09-12T18:01:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.406+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5162195386599734205', time=2024-09-12T19:53:44.947046+0000, chain.objs.size()=1 2024-09-12T18:01:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.406+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CWFUwwvqbhd6ee3Extn0zK5U8K_rNQL_0 2024-09-12T18:01:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.406+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12011797934444389530', time=2024-09-12T19:53:44.970031+0000, chain.objs.size()=1 2024-09-12T18:01:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.406+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xVJn4B5VCqHbe6_ep_byvBPnG6HAN1x_0 2024-09-12T18:01:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.406+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6955759443819204057', time=2024-09-12T19:53:44.982714+0000, chain.objs.size()=1 2024-09-12T18:01:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.406+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cTOfB7OWMWBPb_oXn8nz1wHY9CJ1-Tf_0 2024-09-12T18:01:03.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.407+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14719824166016704940', time=2024-09-12T19:53:45.007139+0000, chain.objs.size()=1 2024-09-12T18:01:03.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.407+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nFiH9DrtYQIHalVcqPppp7o7osvJCu7_0 2024-09-12T18:01:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615183773141335830', time=2024-09-12T19:53:45.040369+0000, chain.objs.size()=1 2024-09-12T18:01:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6VULeqAbhc5jDXGfzERzD_LC1EJeXar_0 2024-09-12T18:01:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3506640003615635840', time=2024-09-12T19:53:45.150127+0000, chain.objs.size()=1 2024-09-12T18:01:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.COM7iAC1N8UnhrRQsiyNxg244DsPzRc_0 2024-09-12T18:01:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7228004351259026081', time=2024-09-12T19:53:45.166114+0000, chain.objs.size()=1 2024-09-12T18:01:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hOaf9hNQ3H0fk6ld1hUyUFBCFzHQqdW_0 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16239744403936195002', time=2024-09-12T19:53:45.185659+0000, chain.objs.size()=1 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BgfXAmTYr5_0o53FCfM3K9I5Yde9EL0_0 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2504840869191850062', time=2024-09-12T19:53:45.211963+0000, chain.objs.size()=1 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OkaT7LpnJWT_As70wGVk2Du2rMD6voO_0 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14934424571350781739', time=2024-09-12T19:53:45.337697+0000, chain.objs.size()=1 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.k02-f7i174mkqN3ZKiGIYett3AmnSIi_0 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14291111048406460348', time=2024-09-12T19:53:45.352926+0000, chain.objs.size()=1 2024-09-12T18:01:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.409+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GjqB8Z8H1hOA-fHvU_jJFeJyGOEt7iO_0 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11465922790644952941', time=2024-09-12T19:53:45.359532+0000, chain.objs.size()=1 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5ff4J1zZOQz-8ReTVUS-Mq2R-xw9ZLL_0 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5763195076015664192', time=2024-09-12T19:53:45.369139+0000, chain.objs.size()=1 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.P0oBPR0AJNguu3_TgcxXiJsbI3cl-S8_0 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5979430345527204838', time=2024-09-12T19:53:45.382495+0000, chain.objs.size()=1 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3961Jmk_8wHHEzAApln96ajzzEhemVe_0 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2632550796979185770', time=2024-09-12T19:53:45.386136+0000, chain.objs.size()=1 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ij1_-fB6Lr0qfr8nMEOz0ALa2ShQ4OB_0 2024-09-12T18:01:03.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3279249594540325326', time=2024-09-12T19:53:45.439591+0000, chain.objs.size()=1 2024-09-12T18:01:03.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fQvLt8pu0XKgKNLtHJMK0Q4DVoUuff4_0 2024-09-12T18:01:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13923576428367617143', time=2024-09-12T19:53:45.549376+0000, chain.objs.size()=1 2024-09-12T18:01:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CmhH4axm5sBdyrlWM9TSRicvinMpz-V_0 2024-09-12T18:01:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17422474922632265886', time=2024-09-12T19:53:45.627479+0000, chain.objs.size()=1 2024-09-12T18:01:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Gu_Wr-9jvawoDgrSN3YawKSVSX_njSI_0 2024-09-12T18:01:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13820889077075145942', time=2024-09-12T19:53:45.639394+0000, chain.objs.size()=1 2024-09-12T18:01:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.e0vvh-_qqxrU-x5A-DLS00tOerfelY0_0 2024-09-12T18:01:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9672681373893558615', time=2024-09-12T19:53:45.640848+0000, chain.objs.size()=1 2024-09-12T18:01:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cEZx3VDEaSHrnJKBKrPyDC671-It-8y_0 2024-09-12T18:01:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14052858723774216686', time=2024-09-12T19:53:45.655778+0000, chain.objs.size()=1 2024-09-12T18:01:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IefesLTrC84UAUgw01G7XXwjiOUM2WE_0 2024-09-12T18:01:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8364357168846692602', time=2024-09-12T19:53:45.738158+0000, chain.objs.size()=1 2024-09-12T18:01:03.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.415+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-BHHqttLHT8OOTqO94YBfRvXn9aSdUP_0 2024-09-12T18:01:03.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12252935249840369606', time=2024-09-12T19:53:45.807493+0000, chain.objs.size()=1 2024-09-12T18:01:03.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6WmRM6ZssoWph69m_LS_kvu3VMATBSL_0 2024-09-12T18:01:03.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2155131812889292383', time=2024-09-12T19:53:45.861458+0000, chain.objs.size()=1 2024-09-12T18:01:03.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YfBHn-26PswLjHHfhOQXStl6GMGzlKK_0 2024-09-12T18:01:03.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17307411854795968725', time=2024-09-12T19:53:46.013491+0000, chain.objs.size()=1 2024-09-12T18:01:03.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ouQlowqG2VW4DYYfqWsh59TtXyQUDvL_0 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7450248202483387379', time=2024-09-12T19:53:46.065293+0000, chain.objs.size()=1 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ESiENr0qQJQiXoCQPKoNy86UiPHyPZi_0 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14400162150069189317', time=2024-09-12T19:53:46.195848+0000, chain.objs.size()=1 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hMMdmHzFWeyZmGNBo-ydlmlb9ZNoPvm_0 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15505492786001047412', time=2024-09-12T19:53:46.201436+0000, chain.objs.size()=1 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.00cfPBHzoDE3I14Fooivhk-IXTncWEU_0 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.420+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13716103080964862850', time=2024-09-12T19:53:54.677142+0000, chain.objs.size()=1 2024-09-12T18:01:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.420+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.njF6MMIUxkJHkFa7kPN6V5kzWWv6oyN_0 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8368852456382710543', time=2024-09-12T19:53:54.718055+0000, chain.objs.size()=1 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RrJ8F7nmAARw_riSNvTg9FQDEqpNA09_0 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12531897134967477004', time=2024-09-12T19:53:54.722415+0000, chain.objs.size()=1 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.20wIPDOtubYwzqWL9JHsmpdnkmSUpOO_0 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8619976625998451750', time=2024-09-12T19:53:54.759635+0000, chain.objs.size()=1 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bayHcUwDqntc1Zw7YwmUgjwfm3RRiLw_0 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17063378252783869455', time=2024-09-12T19:53:54.885386+0000, chain.objs.size()=1 2024-09-12T18:01:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.421+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.83Nv6joan0ZRAFBsItU9ZXROoIYXdxU_0 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6124310727005068027', time=2024-09-12T19:53:55.117749+0000, chain.objs.size()=1 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rxr8qTtlnHtVqxJwQXRHTMJ6MRTQvzi_0 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11912499321686967184', time=2024-09-12T19:53:55.125269+0000, chain.objs.size()=1 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7kqVv_lL8qbarRIbg3PXOiINregJfBt_0 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3989789693597233944', time=2024-09-12T19:53:55.310933+0000, chain.objs.size()=1 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.F520bRPdHJgUb9S5oG-Iq217bi-Oz0W_0 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1650668539542934062', time=2024-09-12T19:53:55.311721+0000, chain.objs.size()=1 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Dwz8Bz7yh2RDIOCuYv4go8XBXFZ2rnM_0 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1109337416507312149', time=2024-09-12T19:53:55.500236+0000, chain.objs.size()=1 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Vw3TQFeLxOM_65qg9iFUSxeFhryTOIw_0 2024-09-12T18:01:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17953442324446095633', time=2024-09-12T19:53:55.532284+0000, chain.objs.size()=1 2024-09-12T18:01:03.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.69P_imo7yBSkpvI39Sv5_HMe5xxqy14_0 2024-09-12T18:01:03.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8558050884169374065', time=2024-09-12T19:53:55.550313+0000, chain.objs.size()=1 2024-09-12T18:01:03.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.424+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BuVGS15KzKziMdddmFfxPBfw80uR_tg_0 2024-09-12T18:01:03.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8074616210140143790', time=2024-09-12T19:53:55.763563+0000, chain.objs.size()=1 2024-09-12T18:01:03.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.40upLLnsF9IBNObjo1Nf9zTFqxrA6ch_0 2024-09-12T18:01:03.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.426+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8280226914434852272', time=2024-09-12T19:53:55.777140+0000, chain.objs.size()=1 2024-09-12T18:01:03.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.426+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6oZFNQp8TBKehvaiFOrs7GgHFV0mryF_0 2024-09-12T18:01:03.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.426+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5166653447215399391', time=2024-09-12T19:53:55.906666+0000, chain.objs.size()=1 2024-09-12T18:01:03.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.426+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.S4uTdAMSns0_iw-r-lpDPdifxcgF9fi_0 2024-09-12T18:01:03.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.426+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9928067387008574398', time=2024-09-12T19:53:55.970717+0000, chain.objs.size()=1 2024-09-12T18:01:03.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.426+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VEri_-GvV-S4l3MiNrp6cKB5qSj-0Zt_0 2024-09-12T18:01:03.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9372207895122405329', time=2024-09-12T19:53:55.984808+0000, chain.objs.size()=1 2024-09-12T18:01:03.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vEL-WTqIJC8jS1Idd1vzmtr2SfTCG4a_0 2024-09-12T18:01:03.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18023597476991613362', time=2024-09-12T19:53:56.027198+0000, chain.objs.size()=1 2024-09-12T18:01:03.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vMn4hJM1LfbNKIB0DZzYfI42TU6sLYO_0 2024-09-12T18:01:03.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2226238192170531874', time=2024-09-12T19:53:56.032238+0000, chain.objs.size()=1 2024-09-12T18:01:03.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.I6JLHIQq2WDQSZjVAy9xjaSIW20oqsc_0 2024-09-12T18:01:03.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4502061196986153619', time=2024-09-12T19:53:56.106600+0000, chain.objs.size()=1 2024-09-12T18:01:03.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CB1R4LaNonhyDdjG38Xi1bIjpGAMlpD_0 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.744594068164952791', time=2024-09-12T19:53:56.150603+0000, chain.objs.size()=1 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qWCAkXETZV6f275sPknSvG-VoPvmXnu_0 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.430+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1836085051526593966', time=2024-09-12T19:53:56.161308+0000, chain.objs.size()=1 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.430+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IWSBmbdZVEX0jKBnZ5_cR3jm9B-VMnS_0 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.430+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13552438132915885672', time=2024-09-12T19:53:56.162008+0000, chain.objs.size()=1 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.430+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.I15Y2E3jxffB7Tk8oGj6BGWN4Lxv_gZ_0 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.430+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2162065088969737982', time=2024-09-12T19:53:56.167461+0000, chain.objs.size()=1 2024-09-12T18:01:03.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.430+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nptZAYHe_0yUY-1ppc3VB2Dw2ICLFUq_0 2024-09-12T18:01:03.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.435+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/49426 2024-09-12T18:01:03.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2294880514399344740', time=2024-09-12T19:53:56.193419+0000, chain.objs.size()=1 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QjqwlBeyTLQC8VHQ_tJ2SBgbXmiuy-j_0 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3446118331942820833', time=2024-09-12T19:53:56.199976+0000, chain.objs.size()=1 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kaOO09mBf8MggjPp5BUH8rneeMiWywF_0 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4501728358038426796', time=2024-09-12T19:54:04.692739+0000, chain.objs.size()=1 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.374__shadow_.hDV9DWWE1iGEyzek27hL6Bhy4P1bxdS_0 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11519904464437815210', time=2024-09-12T19:54:31.215874+0000, chain.objs.size()=1 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.YIeOhyONxTBdfflPKgZG0GM0iqSjXOp_0 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.963022582036777238', time=2024-09-12T19:54:31.216695+0000, chain.objs.size()=1 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.437+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.UkgHXBo06I74iRTLX9NaFwc-xhC7mBi_0 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6898464876912325600', time=2024-09-12T19:54:36.258529+0000, chain.objs.size()=1 2024-09-12T18:01:03.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.504__shadow:YnY3RpnWdxNL2AAWGjaSqYdBVkxd.2r_.0H8-qd5wL1YloYv9-TjdMVbSrLkSqV7_0 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2509083294992028612', time=2024-09-12T19:54:40.419741+0000, chain.objs.size()=1 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.519__multipart_mymultipart.2~eFYUxYh5fJPVr-uXZD0f6QEDYx3Y7eP.1 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11548012917478825176', time=2024-09-12T19:55:22.839522+0000, chain.objs.size()=2 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.552__shadow_.eDcoQrlEEEQ5lBBB-Dvihuknn3LDNjO_0 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.552__shadow_.eDcoQrlEEEQ5lBBB-Dvihuknn3LDNjO_1 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.221181901512816921', time=2024-09-12T19:55:26.729879+0000, chain.objs.size()=1 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.561__shadow_.o8aoCHYNfwTn67U282IEVxxzX2uq2vU_0 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11420664598702785132', time=2024-09-12T19:55:40.987200+0000, chain.objs.size()=1 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow_.-AQMt_1iV4FyomWmerUCrimiZ6XURVp_0 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2358634451281684856', time=2024-09-12T19:55:43.105732+0000, chain.objs.size()=1 2024-09-12T18:01:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.438+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:W9xE-wZynpeFC9ytA3YrEEflppcXSIM_.6S-QyDK26xIXhxcOfL38GvkvkMb60A3_0 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3563318965895140058', time=2024-09-12T19:55:44.388468+0000, chain.objs.size()=1 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:p9UnxP4BKCHZQZdJR9BVvktyXhhf7xT_.3I1jtXcuj5T2fmohRS1MZ7ruhlkHkWL_0 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10781450095773375051', time=2024-09-12T19:56:03.182294+0000, chain.objs.size()=1 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:fibYK8hvuwLnQQKjFMcPOEcFL533Om0_.wPq5CRPeaxdr5e2qh3cws0wvkyHZBqr_0 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2526945993306130608', time=2024-09-12T19:57:14.744098+0000, chain.objs.size()=1 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.618__shadow_.2IgKa7S-0gsF45NmZBkd-7_7jfb-po6_0 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15025058859452488416', time=2024-09-12T19:58:20.413078+0000, chain.objs.size()=1 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.632__shadow_.BnKwmtqvmsL4lHhnP7mhyWyqzk-lXan_0 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6975990936065637598', time=2024-09-12T19:58:39.936719+0000, chain.objs.size()=1 2024-09-12T18:01:03.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.711__shadow:-SYcOsJVLF0dNAO03nfAebsALN6-yNI_.4-CRgCeCMUABrjS48Fqcev1YU3krLg3_0 2024-09-12T18:01:03.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11120988587782402455', time=2024-09-12T19:58:51.132308+0000, chain.objs.size()=1 2024-09-12T18:01:03.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.442+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.717__shadow:UPSgWeMikJQvyxvvye53EHnVG7Ruri5_.MejdoREuo-NsrSDx2FDVvSnFwu4gTlm_0 2024-09-12T18:01:03.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.447+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.450+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:01:03.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.452+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.452+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42596' 2024-09-12T18:01:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7944428350299954624', time=2024-09-12T19:51:53.255790+0000, chain.objs.size()=1 2024-09-12T18:01:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.152__shadow_.2ytb2GtrciDVA37F_pAW0DzytK8reaF_0 2024-09-12T18:01:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2033154493679062750', time=2024-09-12T19:53:10.970619+0000, chain.objs.size()=1 2024-09-12T18:01:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.252__shadow_._CzvZCIpqAmaUTrupZo5X2jDpPD4KJy_0 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3990363993200911987', time=2024-09-12T19:53:11.417027+0000, chain.objs.size()=1 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.254__shadow_.3sD8Eiv4b_Z6e0AMPEcIUPu9RGAMgC1_0 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4540924126136399531', time=2024-09-12T19:53:21.187697+0000, chain.objs.size()=1 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CRz-52Wb2V1yKbNpphRSRql6oG4508Y_0 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1313278993254845975', time=2024-09-12T19:53:21.236941+0000, chain.objs.size()=1 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0GJeyGE75IPSIcdCj41xqRf28Jwr0bk_0 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3751596474619975007', time=2024-09-12T19:53:21.269329+0000, chain.objs.size()=1 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gZhTvaACxbMqlGj25r-5BE0ikUo_hWA_0 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16780006252136193743', time=2024-09-12T19:53:21.368474+0000, chain.objs.size()=1 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RiTeUPYcdZLkyMsVvDBSRGfCo-71JyV_0 2024-09-12T18:01:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.914515717981623400', time=2024-09-12T19:53:21.445750+0000, chain.objs.size()=1 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mOIOZgDmP0tnQQD9RkhL9quxVvclHiO_0 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7951127776466071241', time=2024-09-12T19:53:21.448966+0000, chain.objs.size()=1 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2qJUNIPXoakybNRxzW_yUJyFcP_k61d_0 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8516317457735949036', time=2024-09-12T19:53:21.472730+0000, chain.objs.size()=1 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ypnp1Gz-BiYzd0TvBDMTToRtu_8CYsQ_0 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10358012499858783684', time=2024-09-12T19:53:21.482157+0000, chain.objs.size()=1 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ao4m8lZKS9BJIGJr5HtRsC_i_8RWpj7_0 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18388963626235398574', time=2024-09-12T19:53:21.490008+0000, chain.objs.size()=1 2024-09-12T18:01:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.453+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.w38BTV9wlANTnyiZPSCRH4Dgj48K8uJ_0 2024-09-12T18:01:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6039390931166645917', time=2024-09-12T19:53:21.611814+0000, chain.objs.size()=1 2024-09-12T18:01:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fIlXYfU2QiIXIr1ZEBHVBc5a0vZYw7V_0 2024-09-12T18:01:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10117770896164298061', time=2024-09-12T19:53:21.631532+0000, chain.objs.size()=1 2024-09-12T18:01:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.11D1-x8kOkY27_qQqeH1AQkPaHK0gwP_0 2024-09-12T18:01:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.634404125536926168', time=2024-09-12T19:53:21.656698+0000, chain.objs.size()=1 2024-09-12T18:01:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JLG-nSTUi_TQ82IfyOX4nyMR_X_PXcj_0 2024-09-12T18:01:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8616422890708614806', time=2024-09-12T19:53:21.689576+0000, chain.objs.size()=1 2024-09-12T18:01:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.456+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.h6d6IYrb2VknpSvXD8tjYNpKQ6x2XA0_0 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2420991127731715563', time=2024-09-12T19:53:21.859412+0000, chain.objs.size()=1 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.M2sRBrVMWggHVQ3T4RD71BeiT0-TFvr_0 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6376760011775416914', time=2024-09-12T19:53:21.871489+0000, chain.objs.size()=1 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jqJ1v4UHomExAXAnDJYo5GwgEEtVyV5_0 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9973506480093902021', time=2024-09-12T19:53:21.896776+0000, chain.objs.size()=1 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.feguOWDU-cLTzWueJGKfZVxJ2ZRmy5I_0 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3527214769514497331', time=2024-09-12T19:53:22.034621+0000, chain.objs.size()=1 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.UOF3N2bdZDWAA9BWHmAJkHI1GBA9tYw_0 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17599823320511010123', time=2024-09-12T19:53:22.102340+0000, chain.objs.size()=1 2024-09-12T18:01:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.38zSv4LdNsYdCgmULw2NiRcVNsBtSBi_0 2024-09-12T18:01:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5711493233801367490', time=2024-09-12T19:53:22.198208+0000, chain.objs.size()=1 2024-09-12T18:01:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yU3UwgBT7G8Dh2XwHLE7zZbOlIBpWZE_0 2024-09-12T18:01:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16943053252634785653', time=2024-09-12T19:53:22.210995+0000, chain.objs.size()=1 2024-09-12T18:01:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.458+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.I8-5I3NDpR3sfkBsm0lPmM3NDFNddVI_0 2024-09-12T18:01:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.460+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3867898697462730358', time=2024-09-12T19:53:22.258637+0000, chain.objs.size()=1 2024-09-12T18:01:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.460+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.N9U2C1j5wb76cdmpy5iu2gBPdSMUvbq_0 2024-09-12T18:01:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11072878369208451782', time=2024-09-12T19:53:22.266594+0000, chain.objs.size()=1 2024-09-12T18:01:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fG95MXF6D4m-AWp2AmnV8wofHZHOjzw_0 2024-09-12T18:01:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11738931413670908967', time=2024-09-12T19:53:22.272824+0000, chain.objs.size()=1 2024-09-12T18:01:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._UnJhNYRdN5lmDV-y_jKzfnZnW80RO9_0 2024-09-12T18:01:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10397076989106547270', time=2024-09-12T19:53:22.276264+0000, chain.objs.size()=1 2024-09-12T18:01:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.J38zszBl-9ebVOIweE5uWSqX-r81Eih_0 2024-09-12T18:01:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.462+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13028351157196353194', time=2024-09-12T19:53:22.300783+0000, chain.objs.size()=1 2024-09-12T18:01:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.462+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yjLmLONW4eSYcJgU81qG1Fb94O5GI-L_0 2024-09-12T18:01:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.726601166898385405', time=2024-09-12T19:53:22.386580+0000, chain.objs.size()=1 2024-09-12T18:01:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.upQT1yWb12bmivzI3t2EOmKne7djLAE_0 2024-09-12T18:01:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14316664577208359094', time=2024-09-12T19:53:22.421572+0000, chain.objs.size()=1 2024-09-12T18:01:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RoK_Gr-MODqw4BDU3ZnS_OdPnc-M0gb_0 2024-09-12T18:01:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2355112432426038269', time=2024-09-12T19:53:22.460517+0000, chain.objs.size()=1 2024-09-12T18:01:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ldCcMac4VHy7mlAR_D-CGpG7TXP30AH_0 2024-09-12T18:01:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5968061512488341040', time=2024-09-12T19:53:22.463553+0000, chain.objs.size()=1 2024-09-12T18:01:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mtVWUnAv_PkjvHj9MZfzUeD2bekE5NM_0 2024-09-12T18:01:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12330615235383668091', time=2024-09-12T19:53:22.494686+0000, chain.objs.size()=1 2024-09-12T18:01:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BdCCSCD8En5D9m1UJ9TTj-jnmslPz0c_0 2024-09-12T18:01:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3127385191546295342', time=2024-09-12T19:53:24.660870+0000, chain.objs.size()=1 2024-09-12T18:01:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.273__shadow_.wk6osGCc7sdq5ftxX5pE0D9-6wfg71g_0 2024-09-12T18:01:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16886282231305862231', time=2024-09-12T19:53:29.356129+0000, chain.objs.size()=1 2024-09-12T18:01:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.3jbmpz6N5Nhpi0wcSGpFLIu52_ekDXB_0 2024-09-12T18:01:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13881493805475514790', time=2024-09-12T19:53:32.185818+0000, chain.objs.size()=1 2024-09-12T18:01:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.304__shadow_.wLX5rtS3MypsVWhZ-jVWi6ILkmDC4kn_0 2024-09-12T18:01:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7221749608011745786', time=2024-09-12T19:53:44.525543+0000, chain.objs.size()=1 2024-09-12T18:01:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.h1BC0jJdrDSQHfDjm8I5uqvdYKuBjF7_0 2024-09-12T18:01:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2012314187201670550', time=2024-09-12T19:53:44.529606+0000, chain.objs.size()=1 2024-09-12T18:01:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3Msr9Z53BnpjYF9vyoP7m6hc0w-yTC6_0 2024-09-12T18:01:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10266192974044475482', time=2024-09-12T19:53:44.604535+0000, chain.objs.size()=1 2024-09-12T18:01:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zohDPBFBfXQRYN4xZ1ur6jHSALHhD7w_0 2024-09-12T18:01:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.467+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9772321035492939603', time=2024-09-12T19:53:44.607532+0000, chain.objs.size()=1 2024-09-12T18:01:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.467+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.p8xemUjXX3xPezR34Zg1dBvf6mQDkzP_0 2024-09-12T18:01:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.467+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10483271942796538921', time=2024-09-12T19:53:44.623069+0000, chain.objs.size()=1 2024-09-12T18:01:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.467+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sBvZFmcFmUBYR2EoQ1Mh_RtsZGGYubB_0 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11300226526212349521', time=2024-09-12T19:53:44.645105+0000, chain.objs.size()=1 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ev3NrWc3RAkGwPbykbJLDDOeCmeFWCz_0 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4310186779622357808', time=2024-09-12T19:53:44.647866+0000, chain.objs.size()=1 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.k21IDuAo3efEjx6fC_09-TLG7k5CqG2_0 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18164318912454424276', time=2024-09-12T19:53:45.008087+0000, chain.objs.size()=1 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yHVH_Td1HybWOyGMcAGAGDJKp6FAwfc_0 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6048707606330003914', time=2024-09-12T19:53:45.038087+0000, chain.objs.size()=1 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Zw3S5AKtfeKrQONsUBtkzOa3U38DL9H_0 2024-09-12T18:01:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13427691339138786948', time=2024-09-12T19:53:45.038900+0000, chain.objs.size()=1 2024-09-12T18:01:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kQBTt-9aGr8ZJ9hk-CzR8jfxZjTxf8r_0 2024-09-12T18:01:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5837328571935637349', time=2024-09-12T19:53:45.195640+0000, chain.objs.size()=1 2024-09-12T18:01:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oUd1LdYdTEEvQTUbA2zKTwlflfoa4k5_0 2024-09-12T18:01:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.470+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17620023719098384677', time=2024-09-12T19:53:45.201747+0000, chain.objs.size()=1 2024-09-12T18:01:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.470+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9lQBZkr2KB9wObJ6zJIJH1f7vWfIZBi_0 2024-09-12T18:01:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16965465658293901869', time=2024-09-12T19:53:45.246229+0000, chain.objs.size()=1 2024-09-12T18:01:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qIcp2UlrGKgICRW9cfBcxa8EtOImZ8y_0 2024-09-12T18:01:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10629488883458923827', time=2024-09-12T19:53:45.459676+0000, chain.objs.size()=1 2024-09-12T18:01:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6y67rjK3U7Mw-1MBBB-HCd619--tp3J_0 2024-09-12T18:01:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3318003224507498544', time=2024-09-12T19:53:45.544481+0000, chain.objs.size()=1 2024-09-12T18:01:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wgseUIBCIi-VUCcpKJHJns3h90409MM_0 2024-09-12T18:01:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14237937614326640936', time=2024-09-12T19:53:45.592718+0000, chain.objs.size()=1 2024-09-12T18:01:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.O-1KXK_K9Eo1RTLipAeT6k9tSPfH0-S_0 2024-09-12T18:01:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2648082029213830267', time=2024-09-12T19:53:45.644476+0000, chain.objs.size()=1 2024-09-12T18:01:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vvAw3oUqXsMeh9OzCLhRbLW4nyNdBSs_0 2024-09-12T18:01:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.668464960203901776', time=2024-09-12T19:53:45.776510+0000, chain.objs.size()=1 2024-09-12T18:01:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VXaTnctNpEOo_QL9Gn3ucHoUd-3d7de_0 2024-09-12T18:01:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15687561254583259618', time=2024-09-12T19:53:45.817102+0000, chain.objs.size()=1 2024-09-12T18:01:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._uJD_4xqcz_GgAnlMB4wqzKXslwHT3R_0 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2771527843593912578', time=2024-09-12T19:53:45.845791+0000, chain.objs.size()=1 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4aBaVUPwrUhpx1TlbyGxF8T-PNINxeZ_0 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5267784088314392773', time=2024-09-12T19:53:45.958397+0000, chain.objs.size()=1 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VjfQ-flvLNgu4okB548MIQm-r5NNHfj_0 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3658789233889764926', time=2024-09-12T19:53:45.980592+0000, chain.objs.size()=1 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NlPjm8-CYIH5xCh91DNauxrftPyzX5V_0 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6344787350714061176', time=2024-09-12T19:53:45.989899+0000, chain.objs.size()=1 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.475+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MgxA80_gyDIjxvOALSsyK85WOftHjPj_0 2024-09-12T18:01:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.476+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.917786736984323347', time=2024-09-12T19:53:45.994664+0000, chain.objs.size()=1 2024-09-12T18:01:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.476+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FSqDLq9WdUEZEIQgvytn9uEk6lU5IMK_0 2024-09-12T18:01:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6445971578391841461', time=2024-09-12T19:53:46.052789+0000, chain.objs.size()=1 2024-09-12T18:01:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vT6AhbNK_zztfhqrYynmonoXPYl2wCT_0 2024-09-12T18:01:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1450491539679763138', time=2024-09-12T19:53:46.155122+0000, chain.objs.size()=1 2024-09-12T18:01:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xAsJEr6kkIZWcyQyLX5usqKoVcmh4vc_0 2024-09-12T18:01:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1779149724937994708', time=2024-09-12T19:53:46.169644+0000, chain.objs.size()=1 2024-09-12T18:01:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.p_pqeCQldviCLLOSooUx_ub9VLDXQrS_0 2024-09-12T18:01:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.479+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6972911008095763756', time=2024-09-12T19:53:46.176208+0000, chain.objs.size()=1 2024-09-12T18:01:03.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.479+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hIxPZcKMFe_wQRGqVm7Tlp6kpDu-NBc_0 2024-09-12T18:01:03.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10662633923000168526', time=2024-09-12T19:53:46.185093+0000, chain.objs.size()=1 2024-09-12T18:01:03.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.n-mT8QrcDUL2n2WrM5ncsqZkda8pj6Y_0 2024-09-12T18:01:03.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15266235952999359411', time=2024-09-12T19:53:54.640139+0000, chain.objs.size()=1 2024-09-12T18:01:03.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5EkaoZY8mh0q23KfrsmMkQQN0LBPjB2_0 2024-09-12T18:01:03.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6083700140511065349', time=2024-09-12T19:53:54.643870+0000, chain.objs.size()=1 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hujp8XQZ1QgKNflQ9NUTq0x7vbod8Jl_0 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13009139974627697166', time=2024-09-12T19:53:54.697254+0000, chain.objs.size()=1 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-euRkHB_e5M-DPA0kY-xyRsOl1t4SLS_0 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9453769030317140109', time=2024-09-12T19:53:54.748675+0000, chain.objs.size()=1 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nA91a9Yqpb3sAtYZQ1HPlcCSEqMygf3_0 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8346984495775991570', time=2024-09-12T19:53:55.096531+0000, chain.objs.size()=1 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.pw8NoDNv7KccwQPWobZOKbS6vAkzr5S_0 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15914593533598008328', time=2024-09-12T19:53:55.116492+0000, chain.objs.size()=1 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.H1fazBwamtt-PQGsE1kN8g-eZfFIDS9_0 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9532021414926215732', time=2024-09-12T19:53:55.135116+0000, chain.objs.size()=1 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GXOSrPBsZcKn21zpAj19JzZY5XVfV57_0 2024-09-12T18:01:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10791779358202881573', time=2024-09-12T19:53:55.501924+0000, chain.objs.size()=1 2024-09-12T18:01:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ehE8kyFVEky3j9sKyZF_1sohUEMMoVE_0 2024-09-12T18:01:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17470306410679903524', time=2024-09-12T19:53:55.551859+0000, chain.objs.size()=1 2024-09-12T18:01:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HXX3SURW-nsd-XY1ulD0QvcZ3R5X9Ol_0 2024-09-12T18:01:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3750853394365677076', time=2024-09-12T19:53:55.569379+0000, chain.objs.size()=1 2024-09-12T18:01:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.482+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.a5GoHnc6ssmUxj7iQFoWx4bMlovAiIG_0 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2900922354489199989', time=2024-09-12T19:53:55.701617+0000, chain.objs.size()=1 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.z-sI4N7Ua_4RugEcK7Xa1LwG53uZulN_0 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12845920892770305913', time=2024-09-12T19:53:55.744092+0000, chain.objs.size()=1 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fEYw5JrvafOX_vVdiFj-ddX5ZmEOKZJ_0 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11769948177183074474', time=2024-09-12T19:53:55.745778+0000, chain.objs.size()=1 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xtLL_sBr166FFjZA4BAgqr_GghqFuqC_0 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15268091006840787513', time=2024-09-12T19:53:55.755943+0000, chain.objs.size()=1 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ha43x0OEo7z0ElC6VKeI4JPSZm7j8YB_0 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2326932517012453822', time=2024-09-12T19:53:55.782011+0000, chain.objs.size()=1 2024-09-12T18:01:03.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.UaLD2tnjvwUY_hV162brVUz-ntuZDRC_0 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14497556224132245082', time=2024-09-12T19:53:55.789218+0000, chain.objs.size()=1 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.l1xM4EYsEP5Erf-FVLY9QGWWUIjPD94_0 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9042648013078883182', time=2024-09-12T19:53:55.793123+0000, chain.objs.size()=1 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.AQmilgPo2k6GY0fASTSyrbx6zbW-wv9_0 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9938261028341972611', time=2024-09-12T19:53:55.797099+0000, chain.objs.size()=1 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.WzIWyKNTctMjyP6HhQLG9nXXmnGF-Q__0 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.488+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9951019414434036807', time=2024-09-12T19:53:55.921803+0000, chain.objs.size()=1 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.488+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Y5B-2UtwcT_re5tjwhDp7BnIKTBOdqP_0 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.488+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10278806807586047342', time=2024-09-12T19:53:55.983987+0000, chain.objs.size()=1 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.488+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.03m9vTYKLLZcd7c2kLDLgcxXLjlmwJP_0 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.488+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5737247068560536164', time=2024-09-12T19:53:56.008296+0000, chain.objs.size()=1 2024-09-12T18:01:03.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.488+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vfK2s9xjP62oFBtqd4qEqAm4V9gVUvb_0 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1598508214571890060', time=2024-09-12T19:53:56.013014+0000, chain.objs.size()=1 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yTYJSSYi5AhBXyTK9Vb2NU3AYo6-onC_0 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9306724917577718698', time=2024-09-12T19:53:56.112342+0000, chain.objs.size()=1 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0fzV-prCo0AjBz4gOxaw9DGQdvm1Pgr_0 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12528313366883788049', time=2024-09-12T19:53:56.132377+0000, chain.objs.size()=1 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.OI66Nd3zuo0A_I5yDb0wcN3diQKkZ9A_0 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16359110341120404045', time=2024-09-12T19:53:56.140075+0000, chain.objs.size()=1 2024-09-12T18:01:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JOtXLWBKtG6hs-MaJbZTx1O0HfSx0z5_0 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6897092186032682158', time=2024-09-12T19:53:56.146382+0000, chain.objs.size()=1 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.493+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Mz14gRODA3Z6BoviLlEwuVsYmD4jYqj_0 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5415412093542015778', time=2024-09-12T19:53:56.198647+0000, chain.objs.size()=1 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RKstFmNTgklWrU3fFIg7VzOggK18mOA_0 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1141802233132535033', time=2024-09-12T19:53:56.876115+0000, chain.objs.size()=1 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.329__shadow_.K3GWdRa1zODBznQoXbnrX6GRLEItEwu_0 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8191749352448226131', time=2024-09-12T19:54:21.116561+0000, chain.objs.size()=1 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.441__shadow_.jL_pQDF1F2y0fnWhGYicfASf04QOI-u_0 2024-09-12T18:01:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17598072920809174876', time=2024-09-12T19:54:28.306293+0000, chain.objs.size()=1 2024-09-12T18:01:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.467__shadow_.dq04uu01PGE5fBlRMwl-LxzkPBGmk4C_0 2024-09-12T18:01:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15105447386384802570', time=2024-09-12T19:54:28.476890+0000, chain.objs.size()=1 2024-09-12T18:01:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.494+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.467__shadow_.jSNQxByQs8Hc-nKW14rRJyNCpeKIZPD_0 2024-09-12T18:01:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.495+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.503261688860325366', time=2024-09-12T19:54:31.432456+0000, chain.objs.size()=1 2024-09-12T18:01:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.495+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.485__shadow_.HNZe_wiikNPjrX1hc-yM4TlMDis1BU7_0 2024-09-12T18:01:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.497+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13837248269519510002', time=2024-09-12T19:54:32.604515+0000, chain.objs.size()=1 2024-09-12T18:01:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.497+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.489__shadow_.NNeITAalRJdE9nSRlp2rvVg4Z_ByqO6_0 2024-09-12T18:01:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.498+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7117185373535758545', time=2024-09-12T19:54:35.153860+0000, chain.objs.size()=1 2024-09-12T18:01:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.498+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.500__shadow_.DDvLoqsWkVWJFwCVgFJJvcFTeLdyjLd_0 2024-09-12T18:01:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.498+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7798035052605368452', time=2024-09-12T19:54:35.270505+0000, chain.objs.size()=1 2024-09-12T18:01:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.498+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.501__shadow_.KhM8ewWMbwxF8hLbOxfaVOKh40aQ6jq_0 2024-09-12T18:01:03.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.503+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/42596 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8057220223804524990', time=2024-09-12T19:54:43.634790+0000, chain.objs.size()=6 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~WlgkoaAG1QhBx0yAQzYvLw8vA6fwXqY.1 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__shadow_mymultipart.2~WlgkoaAG1QhBx0yAQzYvLw8vA6fwXqY.1_1 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~WlgkoaAG1QhBx0yAQzYvLw8vA6fwXqY.2 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__shadow_mymultipart.2~WlgkoaAG1QhBx0yAQzYvLw8vA6fwXqY.2_1 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~WlgkoaAG1QhBx0yAQzYvLw8vA6fwXqY.3 2024-09-12T18:01:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__shadow_mymultipart.2~WlgkoaAG1QhBx0yAQzYvLw8vA6fwXqY.3_1 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2249685033765405437', time=2024-09-12T19:55:24.967980+0000, chain.objs.size()=1 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.557__shadow_.COR37VxDoXbYG97zJYHbWVIR4lKvXHN_0 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16178715196301285269', time=2024-09-12T19:55:27.150627+0000, chain.objs.size()=1 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.562__multipart_mymultipart.KgV2lqMmvxWZVvc_9EUFqnXuyHLwjvj9.1 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16044553934485199834', time=2024-09-12T19:55:41.161586+0000, chain.objs.size()=1 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:kQ3I2AiRtPzBWczQHfeocLcsuHxO-04_.SVUyHRJ-aNySvzxQQNgZeMtfiphbW1P_0 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16058568752224883411', time=2024-09-12T19:56:03.758129+0000, chain.objs.size()=1 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.584__shadow:wHTbKYYXyBObWjqHPhBUdA5mADCjmja_.Moul7ptVH-vRZ-RuzwSQb8yJRi8_WdF_0 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2662107431983246681', time=2024-09-12T19:56:13.802926+0000, chain.objs.size()=1 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.617__shadow_._jidBMZ5i0j6PbAaBKZI1OBBA9I_sEu_0 2024-09-12T18:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4178403402108004661', time=2024-09-12T19:58:25.951181+0000, chain.objs.size()=1 2024-09-12T18:01:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.654__shadow_.piuhrhD6tflWnSJfdzyNQiyjZwLMYt7_0 2024-09-12T18:01:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.510+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13827081628709290551', time=2024-09-12T19:58:38.934148+0000, chain.objs.size()=1 2024-09-12T18:01:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.510+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.707__shadow_.IJcljXGCDmOcz5WVynCONQcnJwQh0T8_0 2024-09-12T18:01:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.510+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3199089632523725321', time=2024-09-12T19:58:40.581326+0000, chain.objs.size()=1 2024-09-12T18:01:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.510+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.714__shadow:1vSuUcOM6fgD.H9FqxltzQnKWUOnbZx_.MMqrN8NcDKHSHxRWuSIDvRYyKYe1DO8_0 2024-09-12T18:01:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.513+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.516+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:01:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.517+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.517+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46309' 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_Y4S8iRv7qsXESDnbgtEfEkJvROiZO1A', time=2024-09-12T19:51:58.522998+0000, chain.objs.size()=3 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.GCLr19doEOk_A-XY2JbBgyLPC0M048s_0 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.GCLr19doEOk_A-XY2JbBgyLPC0M048s_1 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.GCLr19doEOk_A-XY2JbBgyLPC0M048s_2 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7359706508158712703', time=2024-09-12T19:53:09.502273+0000, chain.objs.size()=1 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.245__shadow_.rOSDMWy93tC_lCzhkLqEkI8w-b4X8t1_0 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3380822818302695190', time=2024-09-12T19:53:11.416546+0000, chain.objs.size()=1 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.254__shadow_.mCpU7P8-g7STbAnLbwZYrrPCkCLKLah_0 2024-09-12T18:01:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6382431661404664131', time=2024-09-12T19:53:12.232278+0000, chain.objs.size()=1 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.258__shadow_.jMCBgCIRXTUtRrnLdnYdPefP0Zau-Ty_0 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14388149015354364229', time=2024-09-12T19:53:12.661056+0000, chain.objs.size()=1 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.260__shadow_.6kj2xwDojZsnNyHpA6LZpv2Af2vf56U_0 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2510569844198189661', time=2024-09-12T19:53:21.172501+0000, chain.objs.size()=1 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.avjgC33TQw5XBaNlkCQxo83IUTCeUQW_0 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12393318243526755014', time=2024-09-12T19:53:21.199234+0000, chain.objs.size()=1 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.b5AUFiEeOY-Qmd86Nr9ePh_F5LSeWDr_0 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6393297378037365477', time=2024-09-12T19:53:21.274298+0000, chain.objs.size()=1 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8hZPo-yvhPKBSTqSRB7Wpvd3BbbKNlA_0 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12587748188577289338', time=2024-09-12T19:53:21.431804+0000, chain.objs.size()=1 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZaphBII8s7KpAIOfKE1QuVdc6fPAQrA_0 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17917715819707641087', time=2024-09-12T19:53:21.476600+0000, chain.objs.size()=1 2024-09-12T18:01:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.518+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.cjOYGFyCwSeabP5fYhvf3mLsmEiX2T1_0 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.522+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9867086953403936395', time=2024-09-12T19:53:21.494371+0000, chain.objs.size()=1 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.522+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CdD4ucITuvfrDvqBzXYNbI5QV596kWr_0 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15036619560919359111', time=2024-09-12T19:53:21.574273+0000, chain.objs.size()=1 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Ocxe2rdZ0oYJkVYpT2SqqlCf6daMrBW_0 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8229043680694985964', time=2024-09-12T19:53:21.607148+0000, chain.objs.size()=1 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.r2k0DKTUjX9vJ1GJRNZUQ8xzRV-3HMH_0 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7315026839953630794', time=2024-09-12T19:53:21.643222+0000, chain.objs.size()=1 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RCwgQyLyAQvoRgcAEv2Tw3AbRsrS8oT_0 2024-09-12T18:01:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16679336514026958192', time=2024-09-12T19:53:21.673423+0000, chain.objs.size()=1 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pKIJ1aUxNuL8pNvCEWbs8Mu6enPgdRT_0 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12057991704287352', time=2024-09-12T19:53:21.678338+0000, chain.objs.size()=1 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DTqVrXzrGhK7xCvrlZz1jcIxV1wBg-B_0 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14087342547310452410', time=2024-09-12T19:53:21.776470+0000, chain.objs.size()=1 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JyDhmdO08i213tENVj_iE_jUf3i36tT_0 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.309534734525632369', time=2024-09-12T19:53:21.796892+0000, chain.objs.size()=1 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hHTkARNfh07ZySnjCVV2aS3bKBtQUCg_0 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10866010490230967181', time=2024-09-12T19:53:21.799565+0000, chain.objs.size()=1 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jP7C-zGHP5XeotkYEnHEp9woJzHil60_0 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3300713945321888861', time=2024-09-12T19:53:21.811297+0000, chain.objs.size()=1 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2mp5dPCQ4MPx0LlO955C8JhQ4B6fw58_0 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3248396515660187932', time=2024-09-12T19:53:21.860404+0000, chain.objs.size()=1 2024-09-12T18:01:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.523+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZP5Ie0t-cpVuWjhZgC6vwk_D9c9kaZa_0 2024-09-12T18:01:03.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5367854096119569049', time=2024-09-12T19:53:21.862970+0000, chain.objs.size()=1 2024-09-12T18:01:03.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XetAwosAG-ZzMqy0q-9EhvbmpUWmmLp_0 2024-09-12T18:01:03.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10139598479467516534', time=2024-09-12T19:53:21.979192+0000, chain.objs.size()=1 2024-09-12T18:01:03.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.c8_Q1lZtJUUGo1cfThaNCMcwGrHzYDT_0 2024-09-12T18:01:03.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12181402540179165131', time=2024-09-12T19:53:22.053808+0000, chain.objs.size()=1 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CkFGz0Z72sXWVrnZ9A20k9mO0nWzRZj_0 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7886389985873626934', time=2024-09-12T19:53:22.210991+0000, chain.objs.size()=1 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.a35lpCElAeVN6Z0NqAtJfeRGPg4Mez4_0 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577838186206263340', time=2024-09-12T19:53:22.229792+0000, chain.objs.size()=1 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3EsVrMypp58fmBfNSLqR3yiM83cvAlM_0 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1752952203700216710', time=2024-09-12T19:53:22.280613+0000, chain.objs.size()=1 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AkVDSkpsUCbgBOWjxBqPRL_ayCDx3nF_0 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14490907532664347396', time=2024-09-12T19:53:22.287687+0000, chain.objs.size()=1 2024-09-12T18:01:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YtRSzjmLBNG2q9W89s3M_O5oBgU0aN3_0 2024-09-12T18:01:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.529+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18061214782864019842', time=2024-09-12T19:53:22.291652+0000, chain.objs.size()=1 2024-09-12T18:01:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.529+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yVv3GE3mqWNNqGl9-NfLTN-Owp3vCq9_0 2024-09-12T18:01:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.529+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15467572948854807298', time=2024-09-12T19:53:22.400573+0000, chain.objs.size()=1 2024-09-12T18:01:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.529+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PDv4y9YTjxwCxkw2N6_Dk0MHuQqkqay_0 2024-09-12T18:01:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.529+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10775514159705861677', time=2024-09-12T19:53:22.435814+0000, chain.objs.size()=1 2024-09-12T18:01:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.529+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LdHNlqICgQvPPl6EisXmpV6-CjeBSIn_0 2024-09-12T18:01:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.532+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9580438988060034283', time=2024-09-12T19:53:22.446304+0000, chain.objs.size()=1 2024-09-12T18:01:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.532+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.k7OFgrPnv4Rc59SLo1IOtDcqt_UOuzD_0 2024-09-12T18:01:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4022716729629975542', time=2024-09-12T19:53:22.487130+0000, chain.objs.size()=1 2024-09-12T18:01:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XitOL3WnVqEj7xYs0LZJCZu06jd36O__0 2024-09-12T18:01:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7209930993887970244', time=2024-09-12T19:53:22.490032+0000, chain.objs.size()=1 2024-09-12T18:01:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ci-ytnkngi4x6AFaHRk35UIvqmiZA-v_0 2024-09-12T18:01:03.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.534+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5305435429921478850', time=2024-09-12T19:53:22.648242+0000, chain.objs.size()=1 2024-09-12T18:01:03.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.534+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OJR7xDfXgrZCGA8270jbrGaTMzzzlXC_0 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4632967150912870062', time=2024-09-12T19:53:22.674502+0000, chain.objs.size()=1 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.UQQi4WsrLB6f5lwR9pf-dAnc-9sbjjq_0 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5185861277535831480', time=2024-09-12T19:53:22.681521+0000, chain.objs.size()=1 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.sRXpT-1eRdnI6QNrSWarGZiAMGQ0WWs_0 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1395206474846875737', time=2024-09-12T19:53:23.672717+0000, chain.objs.size()=1 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.268__shadow_.kqko6K8p5a_N69UDSZBA0iI3YrR3g5P_0 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17204243686742055831', time=2024-09-12T19:53:25.296563+0000, chain.objs.size()=1 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.276__shadow_.yvOdf-KCozTDHsziWfpu2VcIIQfN6ki_0 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16335654548743642378', time=2024-09-12T19:53:25.710070+0000, chain.objs.size()=1 2024-09-12T18:01:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.278__shadow_.Ys4Mu_nrHoKdRUVWL0PvFZdDm9NfUwG_0 2024-09-12T18:01:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10881795030881578905', time=2024-09-12T19:53:27.185609+0000, chain.objs.size()=1 2024-09-12T18:01:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.285__shadow_.yD6-7z32bOQGTFMrt0aPvcrE5ehFszh_0 2024-09-12T18:01:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15085974807913506929', time=2024-09-12T19:53:27.435698+0000, chain.objs.size()=1 2024-09-12T18:01:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.286__shadow_.ybla4M_WLcxXczV0VUEFuf1JvzN37Js_0 2024-09-12T18:01:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14769679181466666', time=2024-09-12T19:53:29.344197+0000, chain.objs.size()=1 2024-09-12T18:01:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.536+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.XdLY38GlS3uL_Oeu86NYqLgVHNlaiCv_0 2024-09-12T18:01:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7343736865854055097', time=2024-09-12T19:53:29.345754+0000, chain.objs.size()=1 2024-09-12T18:01:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.vsMDi3sQcKzB6AZOfxd2kiDgwxwevRF_0 2024-09-12T18:01:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.539+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.973702365932757391', time=2024-09-12T19:53:29.939151+0000, chain.objs.size()=1 2024-09-12T18:01:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.539+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.BRbPiumchl8P8_Tfy1zFrYmmGzwYi0A_0 2024-09-12T18:01:03.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.539+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12880384222709701852', time=2024-09-12T19:53:30.344787+0000, chain.objs.size()=1 2024-09-12T18:01:03.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.539+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.296__shadow_.YKPYuyTDaqBcx3twPewJbsCbQzTp9wf_0 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12805027381681605491', time=2024-09-12T19:53:44.576615+0000, chain.objs.size()=1 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uFTvsq-KyOzETgQauKhkGMVksUdI0op_0 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10728096286687990004', time=2024-09-12T19:53:45.034661+0000, chain.objs.size()=1 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.y987TfbiIhp5RXi4PaZp13C_zO_fo7l_0 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16127845592117576893', time=2024-09-12T19:53:45.134690+0000, chain.objs.size()=1 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CThapfmojNzYIqVJbsk4MEyIQSnouUm_0 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17775671199693146546', time=2024-09-12T19:53:45.192452+0000, chain.objs.size()=1 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.SNJcevElJtP-5jw0oQUc-fIMxgsr4XB_0 2024-09-12T18:01:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5172668432774587695', time=2024-09-12T19:53:45.239310+0000, chain.objs.size()=1 2024-09-12T18:01:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.t1hnZlSPLXkpyDF6yRhioX5f3XxGtc5_0 2024-09-12T18:01:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2565379338613225241', time=2024-09-12T19:53:45.422859+0000, chain.objs.size()=1 2024-09-12T18:01:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.H-7y2KLge80v-BOSJJvDQ5gL-wZfRaT_0 2024-09-12T18:01:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1691095692990742839', time=2024-09-12T19:53:45.431109+0000, chain.objs.size()=1 2024-09-12T18:01:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LPaxvp3BO2kRHXdTrnk_MKZ3-vm80LO_0 2024-09-12T18:01:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8921677807156164183', time=2024-09-12T19:53:45.457238+0000, chain.objs.size()=1 2024-09-12T18:01:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.542+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NwZnx2CV3pAkZUVXws0sra9WY6UlNdG_0 2024-09-12T18:01:03.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10091835088659243526', time=2024-09-12T19:53:45.609288+0000, chain.objs.size()=1 2024-09-12T18:01:03.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TuRgj-aOUERC3EKqBF-RpEHcWEoXQSM_0 2024-09-12T18:01:03.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1892268052871445128', time=2024-09-12T19:53:45.637276+0000, chain.objs.size()=1 2024-09-12T18:01:03.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0wiaAorRrjtCxYiCpbB85NnoqyaHzWR_0 2024-09-12T18:01:03.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8600219731352164821', time=2024-09-12T19:53:45.659883+0000, chain.objs.size()=1 2024-09-12T18:01:03.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gxZQok5Fw1FWP1RdflyxKKPlpjaSnFc_0 2024-09-12T18:01:03.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3793981248678330813', time=2024-09-12T19:53:45.741084+0000, chain.objs.size()=1 2024-09-12T18:01:03.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iefko8ao5LNxJ5iamm1XkpWaov__Op9_0 2024-09-12T18:01:03.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8504797067000098410', time=2024-09-12T19:53:45.744012+0000, chain.objs.size()=1 2024-09-12T18:01:03.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.McCOhScuKoa6eltmpdG_ETbZAnEtro7_0 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6810460716368076944', time=2024-09-12T19:53:45.746015+0000, chain.objs.size()=1 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GOOClBHcbSF8O-9lTS5r4mPnGtcb5WJ_0 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8625125067207298247', time=2024-09-12T19:53:45.961273+0000, chain.objs.size()=1 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OAUeT3rVK9Qqcd6J0XaLL03m71Rb1E-_0 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10173181800228730356', time=2024-09-12T19:53:46.017815+0000, chain.objs.size()=1 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Rx4yM8IO6ia0ZWwufXRYop3pvNEOqYj_0 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10567351211252624125', time=2024-09-12T19:53:46.033083+0000, chain.objs.size()=1 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MQO4v_4FwTVYl8vCO3QGOGI9z9e1onn_0 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3148053755969942967', time=2024-09-12T19:53:46.048298+0000, chain.objs.size()=1 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ERaZI9vlU3zQL5Qzp33SEeC5sU0dnIm_0 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16570612410110723886', time=2024-09-12T19:53:46.064655+0000, chain.objs.size()=1 2024-09-12T18:01:03.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.547+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sqx1MtkVRZjGBHN71gbSSFcMmTtdA84_0 2024-09-12T18:01:03.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15512594636572069411', time=2024-09-12T19:53:46.145263+0000, chain.objs.size()=1 2024-09-12T18:01:03.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.__S02wzQ4JglXQJJHxjc536brAt2AGi_0 2024-09-12T18:01:03.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.549+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2790690385277291350', time=2024-09-12T19:53:46.161799+0000, chain.objs.size()=1 2024-09-12T18:01:03.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.549+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qR49PAdOLSiHIJnO8aEIzbWi5z-YBkD_0 2024-09-12T18:01:03.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.549+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14273904465168294789', time=2024-09-12T19:53:46.192975+0000, chain.objs.size()=1 2024-09-12T18:01:03.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.549+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jn3CB6xf0APr2UTlu3-38foLU94aXh7_0 2024-09-12T18:01:03.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.551+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18390210598143505684', time=2024-09-12T19:53:46.234551+0000, chain.objs.size()=1 2024-09-12T18:01:03.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.551+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.C6zBw08ZrnzoTk-GNuvYYfIXDfPordN_0 2024-09-12T18:01:03.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6343041765708224749', time=2024-09-12T19:53:54.634856+0000, chain.objs.size()=1 2024-09-12T18:01:03.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tYq4ON1MEcbzv5VJ9gqA1VSQAI1qPb4_0 2024-09-12T18:01:03.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8721949381482633611', time=2024-09-12T19:53:54.672161+0000, chain.objs.size()=1 2024-09-12T18:01:03.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lXI3spxB5RVynZtXl9J8WxbW8ARy9s1_0 2024-09-12T18:01:03.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15300833136642007646', time=2024-09-12T19:53:54.679241+0000, chain.objs.size()=1 2024-09-12T18:01:03.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.p2S_76M8OYcsMny4oxoOfGywaIEv07n_0 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3379801918062276296', time=2024-09-12T19:53:54.733875+0000, chain.objs.size()=1 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.S_3fGQjstlgeIsDLSHcJHDwUKgY3T9A_0 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16666978048354271180', time=2024-09-12T19:53:54.749411+0000, chain.objs.size()=1 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.s799xY2wWe3fw7kXJt9Oplb1SBrMmz-_0 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12842767204602356074', time=2024-09-12T19:53:54.898063+0000, chain.objs.size()=1 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DwY70WjF5IZOhfYryQezdv1jtyyRO4s_0 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9166444589445473054', time=2024-09-12T19:53:54.907842+0000, chain.objs.size()=1 2024-09-12T18:01:03.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.552+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.dIjYucMP6hFEgeGvPa1kCk4NQzcG7Wl_0 2024-09-12T18:01:03.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9595908045861563524', time=2024-09-12T19:53:54.911272+0000, chain.objs.size()=1 2024-09-12T18:01:03.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.50-PvgDSaZZCqcD6BDdKMYAcDW9wZKq_0 2024-09-12T18:01:03.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13075041328210670869', time=2024-09-12T19:53:54.920247+0000, chain.objs.size()=1 2024-09-12T18:01:03.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uKWpQ_z7aTIdHI_vD8_VdYkvu_dqnVo_0 2024-09-12T18:01:03.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9507387944038463906', time=2024-09-12T19:53:54.921997+0000, chain.objs.size()=1 2024-09-12T18:01:03.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JA-_-rlAxr6BwKECd6Lu16tQfGX5zQD_0 2024-09-12T18:01:03.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11645709771925767123', time=2024-09-12T19:53:54.972805+0000, chain.objs.size()=1 2024-09-12T18:01:03.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.554+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2duLOKRLOYTc5zFbVGPKWJZaPZRdkW9_0 2024-09-12T18:01:03.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.556+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.546712108478538774', time=2024-09-12T19:53:55.095265+0000, chain.objs.size()=1 2024-09-12T18:01:03.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.556+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TTZw2R4gSfFGfiyiAyclYPrv1hgCrjw_0 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10105522311647289700', time=2024-09-12T19:53:55.096463+0000, chain.objs.size()=1 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ya5Sc6o9tVt8FrBLmo3eKUs-RU_kDQP_0 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10347681830816463641', time=2024-09-12T19:53:55.169114+0000, chain.objs.size()=1 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QNPdVhnwY77gUlJ7wtOF_68cb_Bbrr8_0 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11886621747951696650', time=2024-09-12T19:53:55.291229+0000, chain.objs.size()=1 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gxA7-WNxwpEWAZAHv3E0n3qDtE3OL7d_0 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13944714056282743999', time=2024-09-12T19:53:55.324518+0000, chain.objs.size()=1 2024-09-12T18:01:03.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.557+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.PiylU7UbzmHfstPejwO7S34ZxSukMzf_0 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8129081541837547072', time=2024-09-12T19:53:55.552822+0000, chain.objs.size()=1 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.F27z2U45TQtW_D-B80owtEbFesDRKVd_0 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2060515584349871503', time=2024-09-12T19:53:55.554053+0000, chain.objs.size()=1 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RQ4Ei-pW2SmQgw2yZj-aCZkxC6BV3rV_0 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17803607043090228925', time=2024-09-12T19:53:55.554817+0000, chain.objs.size()=1 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.S3p_H9_uiFLF4Yo7GSl4Z_YB9WrBIei_0 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17219502381841710551', time=2024-09-12T19:53:55.559173+0000, chain.objs.size()=1 2024-09-12T18:01:03.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.559+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.oK-tbriYkuIpM6esaH14jUtp60V22t0_0 2024-09-12T18:01:03.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.560+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16630699820684417786', time=2024-09-12T19:53:55.563913+0000, chain.objs.size()=1 2024-09-12T18:01:03.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.560+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IgeqswiAfvOfpUhkVgJupPnIZFTDwSd_0 2024-09-12T18:01:03.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.562+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14243806191894928706', time=2024-09-12T19:53:55.602629+0000, chain.objs.size()=1 2024-09-12T18:01:03.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.562+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.D0dX8SJgXsN6tvWDLqasdVpNsil0xxw_0 2024-09-12T18:01:03.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.562+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5709097598260873898', time=2024-09-12T19:53:55.614082+0000, chain.objs.size()=1 2024-09-12T18:01:03.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.562+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YoRp9nsj42StO3DNVxe1YR7862wD1N3_0 2024-09-12T18:01:03.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.562+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9385567637176371721', time=2024-09-12T19:53:55.770992+0000, chain.objs.size()=1 2024-09-12T18:01:03.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zCzaPh-ijxaHDQnEcnZv-EZWti38RAp_0 2024-09-12T18:01:03.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16294950434309893838', time=2024-09-12T19:53:55.906086+0000, chain.objs.size()=1 2024-09-12T18:01:03.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.70_Az-wcpSpCVIv0Gu7W6tlozDX3ZPg_0 2024-09-12T18:01:03.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7267211181131815413', time=2024-09-12T19:53:56.029971+0000, chain.objs.size()=1 2024-09-12T18:01:03.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7ef214XAxDvUz9CJ3Z0n-23Q29rfC5T_0 2024-09-12T18:01:03.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14438494296564936778', time=2024-09-12T19:53:56.107071+0000, chain.objs.size()=1 2024-09-12T18:01:03.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LBgvtkuv82z-IKCI6ZBSedx60dVfQn1_0 2024-09-12T18:01:03.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2142770634923533232', time=2024-09-12T19:53:56.134896+0000, chain.objs.size()=1 2024-09-12T18:01:03.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._rQVc5kw3CmRqA2dJGK5c56Ia-f24MR_0 2024-09-12T18:01:03.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13228090380502144644', time=2024-09-12T19:53:56.164265+0000, chain.objs.size()=1 2024-09-12T18:01:03.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Z-4xAXFvV-0xHAPD-WZdUe8BkqpB-v1_0 2024-09-12T18:01:03.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12673638006075397866', time=2024-09-12T19:53:56.175482+0000, chain.objs.size()=1 2024-09-12T18:01:03.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5zUlDMHeo2BnNpDwMuWA-NiW7YNPb11_0 2024-09-12T18:01:03.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.564+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8736203533852819938', time=2024-09-12T19:54:03.459752+0000, chain.objs.size()=1 2024-09-12T18:01:03.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.564+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.368__shadow_.gLusU8pSVWSC-1CkZvSSdCNsw0rjNqU_0 2024-09-12T18:01:03.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.569+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/46309 2024-09-12T18:01:03.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:01:03.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6009390738533969250', time=2024-09-12T19:54:21.652865+0000, chain.objs.size()=1 2024-09-12T18:01:03.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.443__shadow_.7wuilQgrjHrKkim5Ju0sFsleXmp2Xm6_0 2024-09-12T18:01:03.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10984229494668171666', time=2024-09-12T19:54:28.155411+0000, chain.objs.size()=1 2024-09-12T18:01:03.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.466__shadow_.E5ZtIml3p91oRmVgXlINb9CZEuNIanQ_0 2024-09-12T18:01:03.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12904011845187726667', time=2024-09-12T19:54:33.690284+0000, chain.objs.size()=1 2024-09-12T18:01:03.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.494__shadow_.1Kgb4zeUcTrdaj8ICPbkKGZ2qmcJg6v_0 2024-09-12T18:01:03.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15605664600360215865', time=2024-09-12T19:54:39.221645+0000, chain.objs.size()=1 2024-09-12T18:01:03.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.515__shadow_.IxAD8ljX4X8m2Ub9fZD5_z-2fkxlHa3_0 2024-09-12T18:01:03.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~PD1vpwmb54gmq50YvarYvq1jQsk8Xkm', time=2024-09-12T19:54:45.422911+0000, chain.objs.size()=1 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~PD1vpwmb54gmq50YvarYvq1jQsk8Xkm.2 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15415918937918100265', time=2024-09-12T19:54:52.062136+0000, chain.objs.size()=1 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.525__shadow_.8xsWoFzuptccLxnWHp9t86TEAKtxbt-_0 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17397544357941810616', time=2024-09-12T19:54:52.178539+0000, chain.objs.size()=2 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~LEF0d0T3tCKQeSMAWPTxgqFXkG4-0Cr.1 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~LEF0d0T3tCKQeSMAWPTxgqFXkG4-0Cr.2 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17521043071700551676', time=2024-09-12T19:55:43.566642+0000, chain.objs.size()=1 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.576__shadow:6iMbpON49V0EvPv-Fce6CrG0SDwfxs5_.H0mYnB9zeOL3ld-Lj97TFUArYkc8Jfp_0 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17608670023790197270', time=2024-09-12T19:55:56.089300+0000, chain.objs.size()=1 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:cQKqSiSvSDZH30hTZj2BqWFZCS41Tji_.s9WUXsjqdyHEq6rFZeIqbnk6X2_J54p_0 2024-09-12T18:01:03.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11844168082078791798', time=2024-09-12T19:56:02.122752+0000, chain.objs.size()=1 2024-09-12T18:01:03.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:0bcDHf6AWS1m5j4BTKlMKacSEtArP1l_.jG_N5Glnx1-gGgHNo6zBXOHi55jfnO-_0 2024-09-12T18:01:03.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6822832060600980597', time=2024-09-12T19:56:12.836738+0000, chain.objs.size()=12 2024-09-12T18:01:03.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.572+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__multipart_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.1 2024-09-12T18:01:03.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.575+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__shadow_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.1_1 2024-09-12T18:01:03.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.575+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__multipart_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.2 2024-09-12T18:01:03.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__shadow_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.2_1 2024-09-12T18:01:03.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__multipart_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.3 2024-09-12T18:01:03.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__shadow_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.3_1 2024-09-12T18:01:03.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__multipart_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.4 2024-09-12T18:01:03.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__shadow_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.4_1 2024-09-12T18:01:03.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__multipart_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.5 2024-09-12T18:01:03.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__shadow_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.5_1 2024-09-12T18:01:03.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__multipart_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.6 2024-09-12T18:01:03.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.576+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.615__shadow_multipart_enc.2~hiTnOw7AIyeepEWy7zX2RdWC2eB2ByV.6_1 2024-09-12T18:01:03.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.580+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13129139229023050404', time=2024-09-12T19:58:30.115559+0000, chain.objs.size()=1 2024-09-12T18:01:03.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.580+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.665__shadow_.XVbeNj9PW1dg_TXI0BEP0uFDydZOLsp_0 2024-09-12T18:01:03.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.580+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3344745403400201826', time=2024-09-12T19:59:01.611765+0000, chain.objs.size()=1 2024-09-12T18:01:03.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.580+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.720__shadow_.OKHSV-QbdM_JE9MChbGiAHj2F39oclC_0 2024-09-12T18:01:03.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.580+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14983588224797014256', time=2024-09-12T19:59:06.922653+0000, chain.objs.size()=1 2024-09-12T18:01:03.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.580+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.742__shadow_.C0PppcNm8RPP4s6Cmb-cChdLqEsdutc_0 2024-09-12T18:01:03.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.585+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.589+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:01:03.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.590+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.591+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46038' 2024-09-12T18:01:03.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_d4drLnFWXibtpg99E8wLb8Xwf-ek5sE', time=2024-09-12T19:51:58.389370+0000, chain.objs.size()=3 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.u6WW-SvwIhxIyZAm3XThL0nH5DXveeI_0 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.u6WW-SvwIhxIyZAm3XThL0nH5DXveeI_1 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.u6WW-SvwIhxIyZAm3XThL0nH5DXveeI_2 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_SFH3ue6gii_Wplqm5MneeaIE8qMoeZr', time=2024-09-12T19:51:58.517489+0000, chain.objs.size()=3 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.-AOqMwDDnhAoIA2XEzgOjm3b2Q9zGdv_0 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.-AOqMwDDnhAoIA2XEzgOjm3b2Q9zGdv_1 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.-AOqMwDDnhAoIA2XEzgOjm3b2Q9zGdv_2 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11559601504239061270', time=2024-09-12T19:52:17.177388+0000, chain.objs.size()=1 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.201__shadow_._v7R6Z0CcRCC4RUUf4-WPpe8MRcWPPe_0 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1841743154722983659', time=2024-09-12T19:53:10.146228+0000, chain.objs.size()=1 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.248__shadow_.2ROdbKNXx6M-blocFLg5_DrNXwEDZ11_0 2024-09-12T18:01:03.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2277831667216969290', time=2024-09-12T19:53:12.660551+0000, chain.objs.size()=1 2024-09-12T18:01:03.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.260__shadow_.xi3QujWk9IikyZhUM8ljRDzvn325VNG_0 2024-09-12T18:01:03.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12588275361283526296', time=2024-09-12T19:53:12.868262+0000, chain.objs.size()=1 2024-09-12T18:01:03.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.261__shadow_.lGbmr-PIig9WogU3geZ1A2qo28RGj45_0 2024-09-12T18:01:03.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14277307763756398177', time=2024-09-12T19:53:21.207268+0000, chain.objs.size()=1 2024-09-12T18:01:03.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1b0JBv0ntSYiCKir3NXdOzP1KuYo8Rd_0 2024-09-12T18:01:03.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12175022138090377994', time=2024-09-12T19:53:21.218846+0000, chain.objs.size()=1 2024-09-12T18:01:03.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dIvvMLp-4t4pcH7_fwQCt1aUrPo2Bah_0 2024-09-12T18:01:03.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12218806058086457749', time=2024-09-12T19:53:21.253301+0000, chain.objs.size()=1 2024-09-12T18:01:03.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mVZHNN5971xQp-V550RFiQXNwyfbdx1_0 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6256499896205036860', time=2024-09-12T19:53:21.261649+0000, chain.objs.size()=1 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xW0Z0IkwJrsIb3lZKXFaB_sUv4lmL4V_0 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17925681682725987612', time=2024-09-12T19:53:21.275736+0000, chain.objs.size()=1 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EQw4IPzgr0eqgZXtUNB0cvv5MQVi92k_0 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8509192654680085373', time=2024-09-12T19:53:21.281683+0000, chain.objs.size()=1 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.33ii_wBmMc9_PPUURvlEBOeQLxmGLsf_0 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1611845976958719997', time=2024-09-12T19:53:21.285635+0000, chain.objs.size()=1 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.595+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-H8AYXKWcktLG-rh8i6f7KCr4-lLj_f_0 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2151302501751291055', time=2024-09-12T19:53:21.369397+0000, chain.objs.size()=1 2024-09-12T18:01:03.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.uNDuIULLn2kR-7neTsxqScrQVX1J0Fj_0 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15633955313912172394', time=2024-09-12T19:53:21.387341+0000, chain.objs.size()=1 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6YMtnG7KNW_ENE0nGctTHN10EprOZh4_0 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16725048863659960959', time=2024-09-12T19:53:21.414283+0000, chain.objs.size()=1 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xC18SaQpqBtt4VRsgeqp2_2vk3f1osl_0 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13816693432424852350', time=2024-09-12T19:53:21.426711+0000, chain.objs.size()=1 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XBPFezGpKK9k5jqK95ZUgSJSyGZHc8O_0 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8703612809276037664', time=2024-09-12T19:53:21.474779+0000, chain.objs.size()=1 2024-09-12T18:01:03.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.596+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tkru4TG6pEEa_IOApHJ-Ge4pYq4n3Fl_0 2024-09-12T18:01:03.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.599+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8527982787572373538', time=2024-09-12T19:53:21.571328+0000, chain.objs.size()=1 2024-09-12T18:01:03.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.599+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Q5m4iWHF5H2dOhGLJhQBp2B0FeLmFLh_0 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3070640588767944726', time=2024-09-12T19:53:21.592306+0000, chain.objs.size()=1 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.o2d56dPyBdsIfoiFiKdKf27zWZ9fy9M_0 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7884222513666279586', time=2024-09-12T19:53:21.624034+0000, chain.objs.size()=1 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.t1uVNu2k46IJAgpVMgXPyfM3Ex3U0WF_0 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2251274405293272932', time=2024-09-12T19:53:21.626809+0000, chain.objs.size()=1 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.StEYyCHuga9lMYPi71JCtFi-R9uAgjm_0 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17576874585203725357', time=2024-09-12T19:53:21.665926+0000, chain.objs.size()=1 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lBI1Ese2zsbwBW9k33o6N9vdsbLBxOw_0 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2561284630779223555', time=2024-09-12T19:53:21.778792+0000, chain.objs.size()=1 2024-09-12T18:01:03.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.600+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qhH4QnwCKW-fU5GBKIJL-PnyQxBqaNb_0 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11319925079713829799', time=2024-09-12T19:53:21.810017+0000, chain.objs.size()=1 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Mxsk1KGm8oFhuY9Ht-SYTyyjhrzmfPH_0 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5937661618481333395', time=2024-09-12T19:53:21.880866+0000, chain.objs.size()=1 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8SQwmK3syk8S_ayzwyZLCD_-x7dqZHr_0 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3458983904077511971', time=2024-09-12T19:53:21.881926+0000, chain.objs.size()=1 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qt2o7RsT0wOtGtYcb8YbT7CJ3OICMob_0 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17026255610755842419', time=2024-09-12T19:53:22.011474+0000, chain.objs.size()=1 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RndUPDFTkVrK5PD5BmctKGedtpAzWI9_0 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3779825673021455351', time=2024-09-12T19:53:22.060821+0000, chain.objs.size()=1 2024-09-12T18:01:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.602+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FXN8HvHpdKoYXBVuvVqMD0XrONMbeN3_0 2024-09-12T18:01:03.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.604+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12598598982229342787', time=2024-09-12T19:53:22.070001+0000, chain.objs.size()=1 2024-09-12T18:01:03.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.604+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Bp0VtVgdmMc9EpoEUXErg4aK_5yiGBf_0 2024-09-12T18:01:03.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16142585144015188422', time=2024-09-12T19:53:22.084927+0000, chain.objs.size()=1 2024-09-12T18:01:03.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XDyH06Z31PzuzlWGxKRwsFW1uRHJbKe_0 2024-09-12T18:01:03.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1758956685834689391', time=2024-09-12T19:53:22.183223+0000, chain.objs.size()=1 2024-09-12T18:01:03.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WbYeB5uiyU8RbfFAdAbsBP6O6xjkSfO_0 2024-09-12T18:01:03.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8700955176532777619', time=2024-09-12T19:53:22.193715+0000, chain.objs.size()=1 2024-09-12T18:01:03.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jZZQ8J1n4NEn6F5VTLx8A39RBjuEmaZ_0 2024-09-12T18:01:03.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1442420708986774426', time=2024-09-12T19:53:22.216494+0000, chain.objs.size()=1 2024-09-12T18:01:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Em5uA0wFzkidoSsSkaBSqiB56Y_PDq3_0 2024-09-12T18:01:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3623360845164229452', time=2024-09-12T19:53:22.389968+0000, chain.objs.size()=1 2024-09-12T18:01:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Y5m6_eoDYK0vUiaEED6WOSBqYPFpACX_0 2024-09-12T18:01:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9968180348255072945', time=2024-09-12T19:53:22.457749+0000, chain.objs.size()=1 2024-09-12T18:01:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ApF8uQ_LKYj14JA9F5Q4tj3zTW7Tql4_0 2024-09-12T18:01:03.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.607+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3603185617429664511', time=2024-09-12T19:53:22.578230+0000, chain.objs.size()=1 2024-09-12T18:01:03.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.607+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bYio3ykPm7R_fzjE0m83MQqGNObQY3z_0 2024-09-12T18:01:03.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15113580436608416051', time=2024-09-12T19:53:22.655843+0000, chain.objs.size()=1 2024-09-12T18:01:03.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tizYSb2EGr4Iae2PEF2hqAviNiTJsdE_0 2024-09-12T18:01:03.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.449535861828948964', time=2024-09-12T19:53:22.659085+0000, chain.objs.size()=1 2024-09-12T18:01:03.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4v17IIDjzobMze3Rb0q0ebh8WkYWS9Y_0 2024-09-12T18:01:03.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17246711465987937799', time=2024-09-12T19:53:22.666237+0000, chain.objs.size()=1 2024-09-12T18:01:03.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rqE8snUM1Ke1vMs9STRmPLRaCzlRUgL_0 2024-09-12T18:01:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.395330231656327878', time=2024-09-12T19:53:22.674443+0000, chain.objs.size()=1 2024-09-12T18:01:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qtXtS2I1RnqZwqiJVh9Z6v-4MdiVGEb_0 2024-09-12T18:01:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14172261956598792980', time=2024-09-12T19:53:22.679229+0000, chain.objs.size()=1 2024-09-12T18:01:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.609+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zrzMa10qOu7rDg1Z2TILnZ8wHddmshV_0 2024-09-12T18:01:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.611+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4310638525670167241', time=2024-09-12T19:53:29.937125+0000, chain.objs.size()=1 2024-09-12T18:01:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.611+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.aS4ojRtQtNa-zQanFimZal-BlPNDcVZ_0 2024-09-12T18:01:03.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10930441224766123383', time=2024-09-12T19:53:32.634514+0000, chain.objs.size()=1 2024-09-12T18:01:03.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.306__shadow_.iNDGas5p8hDnj8ecpOPa7H9Ai24HhrQ_0 2024-09-12T18:01:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14314576702105302191', time=2024-09-12T19:53:44.524875+0000, chain.objs.size()=1 2024-09-12T18:01:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.s2H3eZjs19q_YFiJpbG6ygxzHWSAKAa_0 2024-09-12T18:01:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.61394727244547116', time=2024-09-12T19:53:44.540273+0000, chain.objs.size()=1 2024-09-12T18:01:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5KDsKFvC1gq2o-rNxq_ZyiLXcYHfF9i_0 2024-09-12T18:01:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13591958280957300863', time=2024-09-12T19:53:44.623467+0000, chain.objs.size()=1 2024-09-12T18:01:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CNdsvsIBn6MrZ7vAixnO13r1HYnTJCx_0 2024-09-12T18:01:03.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4673758118854939734', time=2024-09-12T19:53:44.925403+0000, chain.objs.size()=1 2024-09-12T18:01:03.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Lalrlnt4ITOxuGjaBq_SZYwHNee9ymy_0 2024-09-12T18:01:03.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13391557932456982515', time=2024-09-12T19:53:44.929224+0000, chain.objs.size()=1 2024-09-12T18:01:03.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.612+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tVoP-Nd0o3Zete5TbL6m6_drmZlf24P_0 2024-09-12T18:01:03.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.613+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14900372494190653465', time=2024-09-12T19:53:44.973563+0000, chain.objs.size()=1 2024-09-12T18:01:03.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.613+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.rc6EZlhSV14mdizyeOP54U5NaJ1AndD_0 2024-09-12T18:01:03.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.614+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13923490328631955014', time=2024-09-12T19:53:44.987711+0000, chain.objs.size()=1 2024-09-12T18:01:03.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.614+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-85MoKb6b6rPPxpbreGvc8a8SDDMvu4_0 2024-09-12T18:01:03.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.615+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2133113630330851542', time=2024-09-12T19:53:44.991232+0000, chain.objs.size()=1 2024-09-12T18:01:03.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.615+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ueVnFj6CGRMwvh9eOA1mvQtCPz7675w_0 2024-09-12T18:01:03.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.615+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10844526964417858809', time=2024-09-12T19:53:45.045688+0000, chain.objs.size()=1 2024-09-12T18:01:03.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.615+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dogIeo0hMAPCnsIyudRE-1VM0suGn_a_0 2024-09-12T18:01:03.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.615+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7189696926788493556', time=2024-09-12T19:53:45.130505+0000, chain.objs.size()=1 2024-09-12T18:01:03.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.615+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VM8JH-sy8PHYy4nNIthffo9tfzGesYU_0 2024-09-12T18:01:03.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3426414366740198995', time=2024-09-12T19:53:45.146231+0000, chain.objs.size()=1 2024-09-12T18:01:03.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.B0dwmo7tMW_Q4LW1KS0rSkHvvWfhPTt_0 2024-09-12T18:01:03.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1287642079157840886', time=2024-09-12T19:53:45.182263+0000, chain.objs.size()=1 2024-09-12T18:01:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.R8um9H_CVp1boOgJUazxy76Z89VdJyI_0 2024-09-12T18:01:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10988945777180823737', time=2024-09-12T19:53:45.188089+0000, chain.objs.size()=1 2024-09-12T18:01:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GSnkKgJlfjJb1J-wf_DiM9aDSSNfYj6_0 2024-09-12T18:01:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1967986513648356224', time=2024-09-12T19:53:45.342604+0000, chain.objs.size()=1 2024-09-12T18:01:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9Hx8DyvsfjPXRBZ0fPd1UdSIE7z7geA_0 2024-09-12T18:01:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11332055120058315301', time=2024-09-12T19:53:45.343966+0000, chain.objs.size()=1 2024-09-12T18:01:03.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.618+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lQ3jH4wB54lYonD43nXhweJxGIVY47W_0 2024-09-12T18:01:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7800404812912903847', time=2024-09-12T19:53:45.373022+0000, chain.objs.size()=1 2024-09-12T18:01:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7FieZfhrbgaNo0xQ0nfudD13ZjJ4yTo_0 2024-09-12T18:01:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1739163229993190137', time=2024-09-12T19:53:45.405069+0000, chain.objs.size()=1 2024-09-12T18:01:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mbUY8C9vTlfHf7FfMDJG5skSwF6rYFj_0 2024-09-12T18:01:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7607041971575034712', time=2024-09-12T19:53:45.418126+0000, chain.objs.size()=1 2024-09-12T18:01:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.m-lTga-4R_xIIHvmrVKVPmoCb1x-2uQ_0 2024-09-12T18:01:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13163126507504509856', time=2024-09-12T19:53:45.426615+0000, chain.objs.size()=1 2024-09-12T18:01:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iaBOEPGStICqlk20GufBBrpBm4bVt7x_0 2024-09-12T18:01:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2112448263535378434', time=2024-09-12T19:53:45.539495+0000, chain.objs.size()=1 2024-09-12T18:01:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tBZLDWGKYF-i0n7L8nebDvTOJifIb3z_0 2024-09-12T18:01:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6447448854691063262', time=2024-09-12T19:53:45.545134+0000, chain.objs.size()=1 2024-09-12T18:01:03.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.620+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.K7n_qG7AdnI4JAkeo7bFlF6ssjtDe_D_0 2024-09-12T18:01:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11388128403457522240', time=2024-09-12T19:53:45.572484+0000, chain.objs.size()=1 2024-09-12T18:01:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iQKR2QrE4r4ScdJuVvleYhsjDZ5vOf2_0 2024-09-12T18:01:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15013945630507559296', time=2024-09-12T19:53:45.592276+0000, chain.objs.size()=1 2024-09-12T18:01:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.eHJWeRKf6Wdm00ZF9VwuAUrUiVaMVas_0 2024-09-12T18:01:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11387520804711819979', time=2024-09-12T19:53:45.753966+0000, chain.objs.size()=1 2024-09-12T18:01:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.89maz2FP16VCSGr3ADx8d1Ygn9URQMo_0 2024-09-12T18:01:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14636119026499573196', time=2024-09-12T19:53:45.809247+0000, chain.objs.size()=1 2024-09-12T18:01:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5-EZmq9rOb6B9ETZSxV2dQemH5ShVtP_0 2024-09-12T18:01:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12161394143164808754', time=2024-09-12T19:53:45.819574+0000, chain.objs.size()=1 2024-09-12T18:01:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5VjyJwNZRLIbTGcjo3nN22pswO37ETz_0 2024-09-12T18:01:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3550599928453859375', time=2024-09-12T19:53:45.840512+0000, chain.objs.size()=1 2024-09-12T18:01:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cruHbEb7AejWdnlQfUoDutetBrmOLhL_0 2024-09-12T18:01:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2754104502397523464', time=2024-09-12T19:53:45.852415+0000, chain.objs.size()=1 2024-09-12T18:01:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FRLc5vLJAMa7krN-KKKeAu1oj3UkgMT_0 2024-09-12T18:01:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8334436571170822733', time=2024-09-12T19:53:45.951645+0000, chain.objs.size()=1 2024-09-12T18:01:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5gY6AxaTH_Tfk7zMrJNznP5ahfJ436d_0 2024-09-12T18:01:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15341457991129020056', time=2024-09-12T19:53:46.052935+0000, chain.objs.size()=1 2024-09-12T18:01:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hzKwQIPGTXXwWR0k62IBo8iXqYKj9gk_0 2024-09-12T18:01:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5942171418825412710', time=2024-09-12T19:53:46.062105+0000, chain.objs.size()=1 2024-09-12T18:01:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Wj7-dsknhTJvTLgrvL4QJPSpPMmE8_W_0 2024-09-12T18:01:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3888718868975875230', time=2024-09-12T19:53:46.186006+0000, chain.objs.size()=1 2024-09-12T18:01:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uQjYeZdYWXj3z-GxoyCJC9-5wJXiMWd_0 2024-09-12T18:01:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13085076836200695168', time=2024-09-12T19:53:54.685700+0000, chain.objs.size()=1 2024-09-12T18:01:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.626+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5t2eOsuFK0T2vydwP9N702xzLHlwrdq_0 2024-09-12T18:01:03.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.629+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5432964974113247111', time=2024-09-12T19:53:54.846741+0000, chain.objs.size()=1 2024-09-12T18:01:03.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.629+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wpH8ESKRHlmOqe-I8ZeojujNx4sTVc1_0 2024-09-12T18:01:03.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.629+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15306345881975235128', time=2024-09-12T19:53:54.892946+0000, chain.objs.size()=1 2024-09-12T18:01:03.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.629+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lnE7X27Ehj_GG85vzuXTmcYM_YYw1pn_0 2024-09-12T18:01:03.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.629+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.659444801165608560', time=2024-09-12T19:53:54.913406+0000, chain.objs.size()=1 2024-09-12T18:01:03.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.629+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wSuZvm5x6BaOa9WPFckmPDZej3vIipo_0 2024-09-12T18:01:03.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.630+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16415270216032876850', time=2024-09-12T19:53:55.086503+0000, chain.objs.size()=1 2024-09-12T18:01:03.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.630+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-wgQd0ZFa5e3uhuQpJVmGTn5n8P9Sr1_0 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9012037653289962466', time=2024-09-12T19:53:55.123774+0000, chain.objs.size()=1 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FXiYNlNpltHed71MEI0Jv1_GJ_A7P7t_0 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1019038417651349168', time=2024-09-12T19:53:55.131958+0000, chain.objs.size()=1 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.g9_F9U8GrtNtf8MzMWOEHzyKSQ8xz-v_0 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.327545457898459202', time=2024-09-12T19:53:55.141144+0000, chain.objs.size()=1 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.PTqRZNaUCaloPAkL-5--R7NHKfwrkq9_0 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15424531406880360537', time=2024-09-12T19:53:55.273923+0000, chain.objs.size()=1 2024-09-12T18:01:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.G8M-f5aMeGIdxpUDZDvPpj5W9OAzVJO_0 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11370095309572459700', time=2024-09-12T19:53:55.299337+0000, chain.objs.size()=1 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-c3-qhLWO345nKQw6yVwNVMnOaxyTr-_0 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2749391307990506001', time=2024-09-12T19:53:55.352986+0000, chain.objs.size()=1 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LrvEKBNjjzynrXCLEb-lJzGDTS1osco_0 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13689704457047146861', time=2024-09-12T19:53:55.547884+0000, chain.objs.size()=1 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9-5ECIl4Gy4_r-nFhjqO9w1Dh6E-i7C_0 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9111660396880774720', time=2024-09-12T19:53:55.586604+0000, chain.objs.size()=1 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cr-worIDueUEM_NSywGcz504m8qXoZj_0 2024-09-12T18:01:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16128717077866477859', time=2024-09-12T19:53:55.594800+0000, chain.objs.size()=1 2024-09-12T18:01:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7rry7FE6MZEyDGw2rYhDxA-y7afmOz2_0 2024-09-12T18:01:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12307905093819229790', time=2024-09-12T19:53:55.597625+0000, chain.objs.size()=1 2024-09-12T18:01:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.N1B7we-q8EYC54T7Dqg2vx_gA8vPiTX_0 2024-09-12T18:01:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.633+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6163440861046695723', time=2024-09-12T19:53:55.727168+0000, chain.objs.size()=1 2024-09-12T18:01:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.633+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YuSXM0b8BGj7pXcibUR0Ielp87EcR3e_0 2024-09-12T18:01:03.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14110800160767598221', time=2024-09-12T19:53:55.736166+0000, chain.objs.size()=1 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VMQeaS1C4VM3GAk5a9V8Zl7RTG1TUCO_0 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7999635338458872304', time=2024-09-12T19:53:55.741112+0000, chain.objs.size()=1 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8lCsT-18faJirQmA9ScXinJzOLCu9Gr_0 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11461451769864053900', time=2024-09-12T19:53:55.799168+0000, chain.objs.size()=1 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.b10Nwdbq3rFx3bnFZ6c1D5_Yk_DVp2d_0 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14140863749761147901', time=2024-09-12T19:53:55.807957+0000, chain.objs.size()=1 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NeUkPb7Y2Hc-b71RduLL8Qpa7nUqeV6_0 2024-09-12T18:01:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18073554840162823738', time=2024-09-12T19:53:55.812518+0000, chain.objs.size()=1 2024-09-12T18:01:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SXA23MUvv6dqNE0FJdGSjwHnVXjlFgO_0 2024-09-12T18:01:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7774725614531979188', time=2024-09-12T19:53:55.911907+0000, chain.objs.size()=1 2024-09-12T18:01:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rBp0qJiDMir8JCpszfMaa8iX_KLjgqj_0 2024-09-12T18:01:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9625218431283679831', time=2024-09-12T19:53:55.918908+0000, chain.objs.size()=1 2024-09-12T18:01:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sBgVb70lM05r5Uj6SKRLzb-YBTwoQUS_0 2024-09-12T18:01:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16317321908610375874', time=2024-09-12T19:53:55.987406+0000, chain.objs.size()=1 2024-09-12T18:01:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9fXUBtupnPxoDQkOirznVEM_VRAuRxY_0 2024-09-12T18:01:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.642+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/46038 2024-09-12T18:01:03.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:01:03.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5488260825840893125', time=2024-09-12T19:53:56.002086+0000, chain.objs.size()=1 2024-09-12T18:01:03.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lnzE7Mkp_WKauTiD7W6tqx151-LIqXd_0 2024-09-12T18:01:03.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15391393499188120251', time=2024-09-12T19:53:56.008158+0000, chain.objs.size()=1 2024-09-12T18:01:03.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.g0QBACY2WQyZ2Dx9vy0tFHrTtzBXob-_0 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5866719540164752028', time=2024-09-12T19:53:56.106668+0000, chain.objs.size()=1 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Zwli_vYc6-_i10_pxJlIkZBoudbvQxa_0 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6721019278868060871', time=2024-09-12T19:53:56.149491+0000, chain.objs.size()=1 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4DEyAZNqVTp4XrKrvrJpY1oVTS7I0kJ_0 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12654464617367230991', time=2024-09-12T19:53:56.181861+0000, chain.objs.size()=1 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ONVjOiGR6kyoWnZ3p04xe8RhlVn-F9Y_0 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11431559542816668614', time=2024-09-12T19:53:58.525420+0000, chain.objs.size()=1 2024-09-12T18:01:03.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.337__shadow_._aLZyTGw95DPEQt6aeiezCArUHPK5lQ_0 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17540124429276788430', time=2024-09-12T19:54:31.219558+0000, chain.objs.size()=1 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.H-6c0HXeEPYlK6gA5A6Y2MtK5OsBCic_0 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17619205566523250772', time=2024-09-12T19:54:31.220330+0000, chain.objs.size()=1 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.LAr9IqOJ0CIUIZ7jI-FtmVJLZX6slhZ_0 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5528281770987981528', time=2024-09-12T19:54:37.965524+0000, chain.objs.size()=6 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.1 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.2 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.3 2024-09-12T18:01:03.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.645+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.4 2024-09-12T18:01:03.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.648+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.5 2024-09-12T18:01:03.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.648+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.6 2024-09-12T18:01:03.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.649+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~OYsPX-bnGr00oX4ONOb_8BxpRESF82F', time=2024-09-12T19:54:53.720532+0000, chain.objs.size()=4 2024-09-12T18:01:03.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.649+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.530__multipart_mymultipart.2~OYsPX-bnGr00oX4ONOb_8BxpRESF82F.1 2024-09-12T18:01:03.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.650+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.530__shadow_mymultipart.2~OYsPX-bnGr00oX4ONOb_8BxpRESF82F.1_1 2024-09-12T18:01:03.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.650+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.530__multipart_mymultipart.2~OYsPX-bnGr00oX4ONOb_8BxpRESF82F.2 2024-09-12T18:01:03.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.530__shadow_mymultipart.2~OYsPX-bnGr00oX4ONOb_8BxpRESF82F.2_1 2024-09-12T18:01:03.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~u6l6AIDtDVtni1M1G-98l48w_OZUVUI', time=2024-09-12T19:54:54.363470+0000, chain.objs.size()=2 2024-09-12T18:01:03.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.532__multipart_mymultipart.2~u6l6AIDtDVtni1M1G-98l48w_OZUVUI.1 2024-09-12T18:01:03.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.532__multipart_mymultipart.2~u6l6AIDtDVtni1M1G-98l48w_OZUVUI.2 2024-09-12T18:01:03.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8383417261873443750', time=2024-09-12T19:55:22.391197+0000, chain.objs.size()=1 2024-09-12T18:01:03.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.551__shadow_.VxaYWxCI4k8bdF3KQtmdN7fzQmbO-DH_0 2024-09-12T18:01:03.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~dNhgKjoBoENA0rBZ65oQP0awjHhAypn', time=2024-09-12T19:55:26.987259+0000, chain.objs.size()=1 2024-09-12T18:01:03.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.562__multipart_mymultipart.2~dNhgKjoBoENA0rBZ65oQP0awjHhAypn.1 2024-09-12T18:01:03.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3763814983393122297', time=2024-09-12T19:55:49.789194+0000, chain.objs.size()=1 2024-09-12T18:01:03.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:7Bs3MtE64xxVUIzX8khbIKCq-.s8UZ9_.mJRyNg6RQcG1bdaK4MIg5i_Fs_zuPqH_0 2024-09-12T18:01:03.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14184146782456552224', time=2024-09-12T19:55:51.738937+0000, chain.objs.size()=1 2024-09-12T18:01:03.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:o2vAYwZy-nCg6TuD2sOvuK57ffeP1aG_.wGqkY0KFHblhtg1Yj8wY518Mf_sFl8X_0 2024-09-12T18:01:03.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.652+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.764449249611972624', time=2024-09-12T19:55:52.105316+0000, chain.objs.size()=1 2024-09-12T18:01:03.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.652+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:G5IqkUx15gi26hOv8ATx0ZKWzJCqCt9_.VRxHNWpmVuXKqI07rLpofgFou3Fypv2_0 2024-09-12T18:01:03.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6940442605144801168', time=2024-09-12T19:56:01.179671+0000, chain.objs.size()=4 2024-09-12T18:01:03.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~bzD36VAniIQ5hsvoiwP3fYn3Qw4ncNM.1 2024-09-12T18:01:03.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~bzD36VAniIQ5hsvoiwP3fYn3Qw4ncNM.2 2024-09-12T18:01:03.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~bzD36VAniIQ5hsvoiwP3fYn3Qw4ncNM.3 2024-09-12T18:01:03.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.655+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~bzD36VAniIQ5hsvoiwP3fYn3Qw4ncNM.4 2024-09-12T18:01:03.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.656+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.878109606659793856', time=2024-09-12T19:56:02.102699+0000, chain.objs.size()=1 2024-09-12T18:01:03.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.656+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:P9u0vTt.PmAoWZfX8tNQFBdIS-Nx26l_.jJBU7Ib05VluKaMJ5gLmI685Y2A-0fZ_0 2024-09-12T18:01:03.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2018585930062536793', time=2024-09-12T19:56:03.373468+0000, chain.objs.size()=1 2024-09-12T18:01:03.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.583__shadow:3F.DH5KM1ajOGgDdjftn0zIEYzTXIC8_.g5QbgHlc4IJxwJK82FdoEc5YX31ibaK_0 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4784667510642279476', time=2024-09-12T19:56:06.847412+0000, chain.objs.size()=1 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.597__shadow_.b2O7kW82Tvoe1OUPAWXNq6RJGyTU6wq_0 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8071465582160339476', time=2024-09-12T19:58:19.472678+0000, chain.objs.size()=1 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.628__shadow_.wzKasLP3ItVhT9UMjwIVjP9JEu95smD_0 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11824705571089619821', time=2024-09-12T19:58:30.849159+0000, chain.objs.size()=1 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.667__shadow_.QWHafeUWICzjOQkFwo6jU60npEVbaVa_0 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13577978115284926894', time=2024-09-12T19:59:01.021171+0000, chain.objs.size()=1 2024-09-12T18:01:03.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.657+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.718__shadow:lS-kmJ.rqyDPsrhSfPwtnWU3RnwqhUO_.DNVpJcaOTYG0qRsK5Tz9FWt86iudgXp_0 2024-09-12T18:01:03.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.662+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.664+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:01:03.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.666+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.666+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49588' 2024-09-12T18:01:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18134839905296738409', time=2024-09-12T19:51:57.671566+0000, chain.objs.size()=5 2024-09-12T18:01:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-FROZEN.2~ITgLqt0-z3zXYLZV5NE89JGag5wr6ht.1 2024-09-12T18:01:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__shadow_mymultipart-FROZEN.2~ITgLqt0-z3zXYLZV5NE89JGag5wr6ht.1_1 2024-09-12T18:01:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-FROZEN.2~ITgLqt0-z3zXYLZV5NE89JGag5wr6ht.2 2024-09-12T18:01:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__shadow_mymultipart-FROZEN.2~ITgLqt0-z3zXYLZV5NE89JGag5wr6ht.2_1 2024-09-12T18:01:03.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-FROZEN.2~ITgLqt0-z3zXYLZV5NE89JGag5wr6ht.3 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4701020574829925391', time=2024-09-12T19:51:57.830286+0000, chain.objs.size()=1 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.A9xZV3h1HJzilJoAZ79_Hwpf0pRlh8C_0 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13531671582341551757', time=2024-09-12T19:52:00.435455+0000, chain.objs.size()=1 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.163__shadow_.H9qpvMFHpYqVyoFX5YCKjd7-VubBze7_0 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8074195471851358418', time=2024-09-12T19:53:06.007642+0000, chain.objs.size()=1 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.229__shadow_.WcL6vj-Cxmy9-jTRhrcxXa_BZHtQ-iI_0 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17638533918864106127', time=2024-09-12T19:53:06.322933+0000, chain.objs.size()=1 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.231__shadow_.XTIRlmqL7wKTShINNDR8LVdRZ6exjDr_0 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15246881063995406335', time=2024-09-12T19:53:08.172954+0000, chain.objs.size()=1 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.239__shadow_.MnbCcUF2hT80mgCNtzgF5DedtNPxajD_0 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11031751450590498890', time=2024-09-12T19:53:10.350569+0000, chain.objs.size()=1 2024-09-12T18:01:03.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.249__shadow_.WOdThJmQnR95nMCIzUwYAfiiZUiTG1n_0 2024-09-12T18:01:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11211307429542551156', time=2024-09-12T19:53:10.352020+0000, chain.objs.size()=1 2024-09-12T18:01:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.667+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.249__shadow_.hXyReRrVgLqT2gAHMD5zCF5SXvdp8Ai_0 2024-09-12T18:01:03.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.670+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7046845602523763247', time=2024-09-12T19:53:10.970901+0000, chain.objs.size()=1 2024-09-12T18:01:03.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.670+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.252__shadow_.e8R59GL55i2VpkOG4KO1kP-mAPulFkI_0 2024-09-12T18:01:03.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.670+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7404541305354051585', time=2024-09-12T19:53:12.036297+0000, chain.objs.size()=1 2024-09-12T18:01:03.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.670+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.257__shadow_.jhi2pCRlowDDNpypjpBTJP56d3r3vJK_0 2024-09-12T18:01:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.145793868040623929', time=2024-09-12T19:53:21.168852+0000, chain.objs.size()=1 2024-09-12T18:01:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YY9jalzoH2gYl5zL3LOVh_XCJupmGCv_0 2024-09-12T18:01:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15612073587827549691', time=2024-09-12T19:53:21.198000+0000, chain.objs.size()=1 2024-09-12T18:01:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.F-K8ZO3tmqA2L-s64hvt6ksGlAwzrAO_0 2024-09-12T18:01:03.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18027369200757467042', time=2024-09-12T19:53:21.228858+0000, chain.objs.size()=1 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OvlPA4RT5HTdHRVOi76KUqNADp1oZKp_0 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4612038867784419811', time=2024-09-12T19:53:21.247027+0000, chain.objs.size()=1 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gBNt9YHuf4t0UJCk_Pj4aPZ_EHGX4mR_0 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4871895246692696470', time=2024-09-12T19:53:21.256061+0000, chain.objs.size()=1 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FK0luPcEPaiWz_YiCqXCZImUJTlHyFJ_0 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9937928182951744429', time=2024-09-12T19:53:21.275970+0000, chain.objs.size()=1 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8M_7Yr6Flb-IhzxorQl0eSqnivlYEcD_0 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1680254346193165331', time=2024-09-12T19:53:21.370977+0000, chain.objs.size()=1 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FWUG4aoJmKWfzdp8FZKyq7QOVW_KmVf_0 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11657419859966633051', time=2024-09-12T19:53:21.371738+0000, chain.objs.size()=1 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zrDEFATx1ix4fd2hYc3EBcB5fG5PjeW_0 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.978586451983323235', time=2024-09-12T19:53:21.407626+0000, chain.objs.size()=1 2024-09-12T18:01:03.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GXHsftwDW57JuUSF7Yw5zsm7HCJTSuw_0 2024-09-12T18:01:03.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.673+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16699302403417347887', time=2024-09-12T19:53:21.580873+0000, chain.objs.size()=1 2024-09-12T18:01:03.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.673+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZEKe16c_NhzT5a4eRiXt5se0HNmFzvy_0 2024-09-12T18:01:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.674+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16707364553913488767', time=2024-09-12T19:53:21.635513+0000, chain.objs.size()=1 2024-09-12T18:01:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.674+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HvNEGntfjtenJX9bCQjZL1NZMqKEJb6_0 2024-09-12T18:01:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.674+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4072140157616022463', time=2024-09-12T19:53:21.679820+0000, chain.objs.size()=1 2024-09-12T18:01:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.674+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dUMtjPdxdsaZ7ItckClkvo3UBwxXNGR_0 2024-09-12T18:01:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11575600900162495191', time=2024-09-12T19:53:21.689957+0000, chain.objs.size()=1 2024-09-12T18:01:03.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.z0ElceWEmtc17PboNL0wEl0bPIhmwE1_0 2024-09-12T18:01:03.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8891716310334166929', time=2024-09-12T19:53:22.043848+0000, chain.objs.size()=1 2024-09-12T18:01:03.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pY2Dz7w-ZgutVdy4xTArgBssVBZJgCz_0 2024-09-12T18:01:03.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10832114093968678689', time=2024-09-12T19:53:22.044562+0000, chain.objs.size()=1 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9DdxLcxMfomro_LSC0H3SVwi8WZOUJN_0 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8149234938082506815', time=2024-09-12T19:53:22.075279+0000, chain.objs.size()=1 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.z2sn6sdg1_BfJdoVXQiUduUPVvyIOLi_0 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5085917525577287980', time=2024-09-12T19:53:22.092837+0000, chain.objs.size()=1 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PveNin4pR28GLlmb6Su96OBqJxKQX-4_0 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16809024884589250023', time=2024-09-12T19:53:22.183664+0000, chain.objs.size()=1 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.675+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4jvhax_wvewQlUO2mHWSFEPM-1GsIml_0 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.676+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16590391722514239682', time=2024-09-12T19:53:22.206952+0000, chain.objs.size()=1 2024-09-12T18:01:03.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.676+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1Bh1gfGSaCjAGlwvf157WQfERe0gQ1g_0 2024-09-12T18:01:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.678+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16417657779119167615', time=2024-09-12T19:53:22.231424+0000, chain.objs.size()=1 2024-09-12T18:01:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.678+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wialaUpvgYng-BhvFM_Qoi1hXhre_V8_0 2024-09-12T18:01:03.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.679+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8206968303756980374', time=2024-09-12T19:53:22.253604+0000, chain.objs.size()=1 2024-09-12T18:01:03.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.679+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yHqAR8rRZ5z0BpQ_4da7E6NBg_yYYHy_0 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.681+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.319838226949702891', time=2024-09-12T19:53:22.386747+0000, chain.objs.size()=1 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.681+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LQSJDrl9IGN7ngwBP1_SaRiJUJycxTp_0 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6146851851693836610', time=2024-09-12T19:53:22.424864+0000, chain.objs.size()=1 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wzpJKN3e9nJquTQQw-5DdjjFUsPMCFp_0 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8659894441731285734', time=2024-09-12T19:53:22.427858+0000, chain.objs.size()=1 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.81PCQz6TpwGmpUKaAHUH3qZrARdNJc8_0 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8951831709281264778', time=2024-09-12T19:53:22.428637+0000, chain.objs.size()=1 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZNB6sCoTZT4McsJjpx1JO-gjddDHdod_0 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15373561900975578601', time=2024-09-12T19:53:22.440628+0000, chain.objs.size()=1 2024-09-12T18:01:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.S4fplqBduFngirVoQ1j8QSG0rVoSshC_0 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9123378754945901957', time=2024-09-12T19:53:22.442512+0000, chain.objs.size()=1 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.La59olHYcQgk70JeRDV4qnhqDxvIlWM_0 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9000305467469435168', time=2024-09-12T19:53:22.464973+0000, chain.objs.size()=1 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hpC2eazqU03ktawwdQvsfq9zN75GjPm_0 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15801040358297813132', time=2024-09-12T19:53:22.467172+0000, chain.objs.size()=1 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.K8Ojzz5urOXL1NzrWovLqWfM83aPjPR_0 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17260082392224263415', time=2024-09-12T19:53:22.583700+0000, chain.objs.size()=1 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Lr8JOHZKRlfYW6MlulJyNW96vkY4rlr_0 2024-09-12T18:01:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16380517323574866138', time=2024-09-12T19:53:22.621808+0000, chain.objs.size()=1 2024-09-12T18:01:03.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6zZe8r25R78N9UHUzITXl4mz5cdvelS_0 2024-09-12T18:01:03.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16048449721499723777', time=2024-09-12T19:53:22.627944+0000, chain.objs.size()=1 2024-09-12T18:01:03.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.w0HoWmrdE9AEv8TDrx_hzyepkg3npFh_0 2024-09-12T18:01:03.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12873467772295305508', time=2024-09-12T19:53:22.669493+0000, chain.objs.size()=1 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RFHFOHAgDQhXKs-3r2OCBDOl4P4ZdoI_0 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13981656039835162410', time=2024-09-12T19:53:23.242605+0000, chain.objs.size()=1 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.266__shadow_.S04SyTjOnfWLOk7noGomHw-bDiz0t3K_0 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4905674906977843529', time=2024-09-12T19:53:23.872006+0000, chain.objs.size()=1 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.269__shadow_.imcPaNFPr9EVPgw9g4EzUZdkY2OG8no_0 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4162100901528116155', time=2024-09-12T19:53:29.354570+0000, chain.objs.size()=1 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.Vq4u-NNeDw3YHQ02h4VExAJFjX1cw-h_0 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11363430683651200754', time=2024-09-12T19:53:30.782464+0000, chain.objs.size()=1 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.298__shadow_.n9N9gxe0d4AeGmdN1s78uoYrobviSR4_0 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5253195434831112195', time=2024-09-12T19:53:31.074191+0000, chain.objs.size()=1 2024-09-12T18:01:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.686+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.299__shadow_.7EN5nGJhnzIbMSIy_86Wgm17i_ql22c_0 2024-09-12T18:01:03.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.422502967209887648', time=2024-09-12T19:53:31.318791+0000, chain.objs.size()=1 2024-09-12T18:01:03.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.300__shadow_.rUBCmXf9tUvwUGu2jVqMQLnIUmhi6Ey_0 2024-09-12T18:01:03.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5255174375826190220', time=2024-09-12T19:53:31.320317+0000, chain.objs.size()=1 2024-09-12T18:01:03.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.300__shadow_.ryIY8QHx3OkqGgWhZcv4djOC2hXq5Jg_0 2024-09-12T18:01:03.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8205869114240046912', time=2024-09-12T19:53:44.588707+0000, chain.objs.size()=1 2024-09-12T18:01:03.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3h-lOnlOaMYfZPZJvlkD3egDe1Y4fwt_0 2024-09-12T18:01:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11365033208619342874', time=2024-09-12T19:53:44.634342+0000, chain.objs.size()=1 2024-09-12T18:01:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7BboUWItu11f-fGKyeGFUSLwTcPAXMj_0 2024-09-12T18:01:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9063275467901359028', time=2024-09-12T19:53:44.928481+0000, chain.objs.size()=1 2024-09-12T18:01:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.688+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VAjA5rj-KMZWRVEyBGushhjrtMi_4y-_0 2024-09-12T18:01:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15139015320305287453', time=2024-09-12T19:53:44.957397+0000, chain.objs.size()=1 2024-09-12T18:01:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NX87msLk_-_P3O81zB9O2l5KnP2Dhr6_0 2024-09-12T18:01:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6088279575704850448', time=2024-09-12T19:53:44.961503+0000, chain.objs.size()=1 2024-09-12T18:01:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Wl3KerJofOuqm4xszJJiNAgaPTN1F1S_0 2024-09-12T18:01:03.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3324444336434091991', time=2024-09-12T19:53:44.977168+0000, chain.objs.size()=1 2024-09-12T18:01:03.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GAHaxAkG2MEAia0r0_wflxSbNgRLCvy_0 2024-09-12T18:01:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4990897867602749714', time=2024-09-12T19:53:44.995397+0000, chain.objs.size()=1 2024-09-12T18:01:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yx09g3WrF_hsCxbgRQqWRgT8Aot1H5d_0 2024-09-12T18:01:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6733512422884157325', time=2024-09-12T19:53:45.019446+0000, chain.objs.size()=1 2024-09-12T18:01:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fI1kw7JCq5y8AmW6vjvd7dlhi-M4XF2_0 2024-09-12T18:01:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16731914534278645665', time=2024-09-12T19:53:45.043486+0000, chain.objs.size()=1 2024-09-12T18:01:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AFBIfmI3O0U0ihEkRrvwzky6XjclEA5_0 2024-09-12T18:01:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18274474076312631370', time=2024-09-12T19:53:45.146131+0000, chain.objs.size()=1 2024-09-12T18:01:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.692+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GB5fYqaMcxwLxe6tz5iU5facmSvDisp_0 2024-09-12T18:01:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.693+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12817764584829201295', time=2024-09-12T19:53:45.147975+0000, chain.objs.size()=1 2024-09-12T18:01:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.693+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yP3Y48BVplwOlrys9HPLY_yxGLe5cCx_0 2024-09-12T18:01:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.694+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17194346709711253656', time=2024-09-12T19:53:45.163613+0000, chain.objs.size()=1 2024-09-12T18:01:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.694+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tB8uxzdWWV_7SUgEPC20_FNog9He67Y_0 2024-09-12T18:01:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.694+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14924544885993627120', time=2024-09-12T19:53:45.172680+0000, chain.objs.size()=1 2024-09-12T18:01:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.694+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2ojPnaRS1FfkKSTOWg37caUlqhoze6D_0 2024-09-12T18:01:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.694+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16916720288543420139', time=2024-09-12T19:53:45.206455+0000, chain.objs.size()=1 2024-09-12T18:01:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.694+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nHfvETA_dct_LYsD45cBoj0-cE3HZda_0 2024-09-12T18:01:03.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.696+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9260860840595210122', time=2024-09-12T19:53:45.223085+0000, chain.objs.size()=1 2024-09-12T18:01:03.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.696+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KAbtuNJsrv_9SgBC7E00et59kf7Nm_F_0 2024-09-12T18:01:03.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.696+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4406506555846230834', time=2024-09-12T19:53:45.233434+0000, chain.objs.size()=1 2024-09-12T18:01:03.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.696+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.PTwkQrcOXFAox_0g4uc7HSCLxhr7Kvg_0 2024-09-12T18:01:03.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.696+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4533384456057988998', time=2024-09-12T19:53:45.251331+0000, chain.objs.size()=1 2024-09-12T18:01:03.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.696+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.22JUyi4mgAi8QC4XDkdbYDk8IHQzE_R_0 2024-09-12T18:01:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7893695359357597455', time=2024-09-12T19:53:45.335638+0000, chain.objs.size()=1 2024-09-12T18:01:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ic-P3cCLQazx50VYah-Q6PtDUTxzv_v_0 2024-09-12T18:01:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15136254062075151540', time=2024-09-12T19:53:45.368928+0000, chain.objs.size()=1 2024-09-12T18:01:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.c7MH_ghLpmtaZhNwILchNabERrUJWBd_0 2024-09-12T18:01:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5109700498238082815', time=2024-09-12T19:53:45.388394+0000, chain.objs.size()=1 2024-09-12T18:01:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Gz-uGqTFjEcFH6yx-xk8Yuy2ZFYhiB4_0 2024-09-12T18:01:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5797250612799022249', time=2024-09-12T19:53:45.597445+0000, chain.objs.size()=1 2024-09-12T18:01:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NbvxxSVj11Y9wXkhv-yrvXEOFqP4G67_0 2024-09-12T18:01:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10624713941971398061', time=2024-09-12T19:53:45.658900+0000, chain.objs.size()=1 2024-09-12T18:01:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dF3RG2JRJZsgydc2CV-vGcopsQjdn5f_0 2024-09-12T18:01:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.943494299551231230', time=2024-09-12T19:53:45.790093+0000, chain.objs.size()=1 2024-09-12T18:01:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ksDH2OAKlKVUeqcierbqXCxFvOujdo0_0 2024-09-12T18:01:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.699+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15673018291319633874', time=2024-09-12T19:53:45.832336+0000, chain.objs.size()=1 2024-09-12T18:01:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.699+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iaxEiuTs_ZjEDCMcYG9u0LT9F5LpQJk_0 2024-09-12T18:01:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6150712368160920481', time=2024-09-12T19:53:45.834726+0000, chain.objs.size()=1 2024-09-12T18:01:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jXGv4Hy699ApA88TS9JvCr_FumToEN4_0 2024-09-12T18:01:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15880862009535515264', time=2024-09-12T19:53:45.855519+0000, chain.objs.size()=1 2024-09-12T18:01:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fhbljbXEbAfD0kkikx5c8MGVACrrkLv_0 2024-09-12T18:01:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10200052335223526254', time=2024-09-12T19:53:45.866206+0000, chain.objs.size()=1 2024-09-12T18:01:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3DeYQZGIfL2w-RA8mNAYh6FS72T3WQ5_0 2024-09-12T18:01:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8231652608127971969', time=2024-09-12T19:53:45.960391+0000, chain.objs.size()=1 2024-09-12T18:01:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.702+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.T-gfaDJF3tEYc5WWCkBYseanc7_n0r1_0 2024-09-12T18:01:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5082309340413448415', time=2024-09-12T19:53:45.988251+0000, chain.objs.size()=1 2024-09-12T18:01:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.EbQzsurAy82vJyJSyR-bcBt8NFhcfR8_0 2024-09-12T18:01:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17726454000470602121', time=2024-09-12T19:53:46.064811+0000, chain.objs.size()=1 2024-09-12T18:01:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NhyZ_bjoEc2qdPGvBhKZbDqml30NgQw_0 2024-09-12T18:01:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2288044584514433631', time=2024-09-12T19:53:46.068971+0000, chain.objs.size()=1 2024-09-12T18:01:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5Xu0D-By0kHCnWpIpjw0tUzAHHe-JX0_0 2024-09-12T18:01:03.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15047223241694269044', time=2024-09-12T19:53:46.142846+0000, chain.objs.size()=1 2024-09-12T18:01:03.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.704+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5AqNi1p8CQbZaEb95nCmUSaGtGr7udR_0 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14294786806819554011', time=2024-09-12T19:53:46.177844+0000, chain.objs.size()=1 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ubgGClMEg0L_pEaAoKKHWdKT6o-4udE_0 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.332750831491815182', time=2024-09-12T19:53:46.191126+0000, chain.objs.size()=1 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HTjTejnJoNKl_mSG514AaG1N4MW0YBV_0 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8611663192179287628', time=2024-09-12T19:53:46.225570+0000, chain.objs.size()=1 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pg18GipKNNsLj6JL35Bm3uGW9D9d7ML_0 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1001998708083401233', time=2024-09-12T19:53:54.633846+0000, chain.objs.size()=1 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.705+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.30Cb7Zj--sE86vUDivIfbndwSIgPHP7_0 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.707+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17350203745547736524', time=2024-09-12T19:53:54.655855+0000, chain.objs.size()=1 2024-09-12T18:01:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.707+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Lv8Td2FGKgZBkEHtl7PcZ8ROEr5322u_0 2024-09-12T18:01:03.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.707+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9669962996952468206', time=2024-09-12T19:53:54.700613+0000, chain.objs.size()=1 2024-09-12T18:01:03.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.707+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.m_XYHwPcFWE-0WEgbS_ARVT9AiIgiNt_0 2024-09-12T18:01:03.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.707+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1620387232658458336', time=2024-09-12T19:53:54.704927+0000, chain.objs.size()=1 2024-09-12T18:01:03.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.707+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.XXZSVsQX2YBgMNbfEgtLn5oGzDZTH04_0 2024-09-12T18:01:03.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6652548501122934098', time=2024-09-12T19:53:54.728998+0000, chain.objs.size()=1 2024-09-12T18:01:03.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.o-SneYt84QEXrKDIpooFb93pxjZKfXA_0 2024-09-12T18:01:03.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11624056125421756191', time=2024-09-12T19:53:54.760925+0000, chain.objs.size()=1 2024-09-12T18:01:03.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Qq24KU_48aakvNdU6rFHc7RpDS9utAN_0 2024-09-12T18:01:03.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.709+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11318665809070628358', time=2024-09-12T19:53:54.864967+0000, chain.objs.size()=1 2024-09-12T18:01:03.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.710+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6K0aV8jZWtatPJEvrtNX8Crl1JyvcUL_0 2024-09-12T18:01:03.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.711+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10786221727962702744', time=2024-09-12T19:53:54.896179+0000, chain.objs.size()=1 2024-09-12T18:01:03.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.711+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cetj9E4xLy8cUfQG_FFm5tKxhvR0U--_0 2024-09-12T18:01:03.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.711+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6714170189100373778', time=2024-09-12T19:53:54.962183+0000, chain.objs.size()=1 2024-09-12T18:01:03.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.711+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.q_kMlpljNiQp5sK8Vq0KmnY7Qm--T8y_0 2024-09-12T18:01:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18328392175502066221', time=2024-09-12T19:53:55.111885+0000, chain.objs.size()=1 2024-09-12T18:01:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lRlOU-7cIoLe45AoX3Tzb3cAkZoFsFb_0 2024-09-12T18:01:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8298457477429086327', time=2024-09-12T19:53:55.142611+0000, chain.objs.size()=1 2024-09-12T18:01:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vV8n1f5MVZYD0aAJZUb_g3KxUWGdqtb_0 2024-09-12T18:01:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9635524489970808494', time=2024-09-12T19:53:55.175263+0000, chain.objs.size()=1 2024-09-12T18:01:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Q3BhUz1VPiE-3rJR8Zhgax32UYSAp2K_0 2024-09-12T18:01:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16477392660313464329', time=2024-09-12T19:53:55.261596+0000, chain.objs.size()=1 2024-09-12T18:01:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8y8StTsu1_sfRSwS2O_oLA6ud1LfT8k_0 2024-09-12T18:01:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1169074215419530198', time=2024-09-12T19:53:55.262759+0000, chain.objs.size()=1 2024-09-12T18:01:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lo305hPfG32bKOb7l4rmnqt0CEPUxU8_0 2024-09-12T18:01:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4778095542923066121', time=2024-09-12T19:53:55.279378+0000, chain.objs.size()=1 2024-09-12T18:01:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.713+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kkzyFj4eCBtbxr9_2PTDA7Oybipu4Yi_0 2024-09-12T18:01:03.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.717+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/49588 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7066770635718034617', time=2024-09-12T19:53:55.313699+0000, chain.objs.size()=1 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QUtpNu2SMMbdG12kzeDNvuWcjU4FEGD_0 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8691164902356983655', time=2024-09-12T19:53:55.335391+0000, chain.objs.size()=1 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9roC1IQvT3lSjJa61kgaHMboUZdOm-C_0 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14493380759543708331', time=2024-09-12T19:53:55.498711+0000, chain.objs.size()=1 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2Oq6fqStUaoz2VnPY2mrO38PxLSTe6W_0 2024-09-12T18:01:03.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13593224913232055188', time=2024-09-12T19:53:55.566746+0000, chain.objs.size()=1 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RgHclpZ68AcbsGPx2ltJDqfuVOc3Kwn_0 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12721360435460030352', time=2024-09-12T19:53:55.585511+0000, chain.objs.size()=1 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YNw640JtNeM26QughAPEMpGxeyjdQKD_0 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6273472219356270108', time=2024-09-12T19:53:55.609269+0000, chain.objs.size()=1 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.719+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lOmMzyuo1-Npa9KsEptcV4O91-9_kLL_0 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14033508198491184106', time=2024-09-12T19:53:55.623227+0000, chain.objs.size()=1 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.dCZoqv1w-rA8GJpeuAsy7SV3euLP0Qc_0 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9899848603984291104', time=2024-09-12T19:53:55.700163+0000, chain.objs.size()=1 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7qPSZ8vlQ4D5u68Dx8N4XdRMeOMsfwE_0 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9033750925144050943', time=2024-09-12T19:53:55.705165+0000, chain.objs.size()=1 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.g49gEPM67fJi8mg4HxwDsH4HO8jPI_w_0 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2458234373385183079', time=2024-09-12T19:53:55.735324+0000, chain.objs.size()=1 2024-09-12T18:01:03.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Le5cmrV4Jd8iaNMh5wUb53YBIQ-I1_o_0 2024-09-12T18:01:03.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15611897170665318935', time=2024-09-12T19:53:55.740821+0000, chain.objs.size()=1 2024-09-12T18:01:03.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3Jm1ELWrwELF4LmTtG67aSg9jA_gU-B_0 2024-09-12T18:01:03.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16394976169245747872', time=2024-09-12T19:53:55.767940+0000, chain.objs.size()=1 2024-09-12T18:01:03.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.720+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cLr_Eg0MXbcMsJkg77Vv3Z8ZRAckzZR_0 2024-09-12T18:01:03.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.723+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7535088416250039021', time=2024-09-12T19:53:55.908882+0000, chain.objs.size()=1 2024-09-12T18:01:03.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.723+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QL3f2J5EZ45wP6W4rp29OFRriZswgo__0 2024-09-12T18:01:03.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11014310783360438166', time=2024-09-12T19:53:55.939260+0000, chain.objs.size()=1 2024-09-12T18:01:03.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SdtLlOtY9bS2y-y8iLsyAUMVxMf30G9_0 2024-09-12T18:01:03.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.135939155966237247', time=2024-09-12T19:53:55.944220+0000, chain.objs.size()=1 2024-09-12T18:01:03.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cEzoDOYBINLv5JYmrt7WuEwVWqKbPff_0 2024-09-12T18:01:03.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8002388386794776398', time=2024-09-12T19:53:55.955940+0000, chain.objs.size()=1 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8k9x62badf0piW8URlnPiC9HWRoQd6F_0 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8193927658795358864', time=2024-09-12T19:53:56.012502+0000, chain.objs.size()=1 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CkxkqA6orBgMLxleGHj1iR4deAKDce1_0 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6325872862513024334', time=2024-09-12T19:53:56.017012+0000, chain.objs.size()=1 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.WYTcqLRHFAyr6o9x4PjEE-qjM2EHtcg_0 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8965758415077361765', time=2024-09-12T19:53:56.109698+0000, chain.objs.size()=1 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ENGIx8pvvdsA6DI4DBQftmQyIAljf88_0 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18275943432630165701', time=2024-09-12T19:53:56.195901+0000, chain.objs.size()=1 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NNrsek4sDWNu7JpVXS0pEQcGyG6x8mD_0 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16597342352545845974', time=2024-09-12T19:54:03.849175+0000, chain.objs.size()=1 2024-09-12T18:01:03.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.370__shadow_.irRTHj59q-xuWZjfHjwrfz-et7Q5H3K_0 2024-09-12T18:01:03.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16393083624341411296', time=2024-09-12T19:54:04.071861+0000, chain.objs.size()=1 2024-09-12T18:01:03.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.371__shadow_.mw4nM6rsaP6P9edcVxiZuCJalobEvCk_0 2024-09-12T18:01:03.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10679623095439956012', time=2024-09-12T19:54:05.884634+0000, chain.objs.size()=1 2024-09-12T18:01:03.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.725+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.375__shadow_.Ez8RKmctmNYDs1girATluDImU4fxn77_0 2024-09-12T18:01:03.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.726+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5126414724047355452', time=2024-09-12T19:54:19.910675+0000, chain.objs.size()=1 2024-09-12T18:01:03.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.726+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.436__shadow_.0ZoPySibcs9XcHqTbWY2rqcoE-U-Ok-_0 2024-09-12T18:01:03.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.728+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15550100777083526346', time=2024-09-12T19:54:27.983029+0000, chain.objs.size()=1 2024-09-12T18:01:03.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.728+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.466__shadow_.-QPeFatx8_eH16X20WRM0twj8ukS_iL_0 2024-09-12T18:01:03.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17752735637153640482', time=2024-09-12T19:54:31.220868+0000, chain.objs.size()=1 2024-09-12T18:01:03.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.HhGdwwAYApKtKZMyuPe1O1UHddWOw7H_0 2024-09-12T18:01:03.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4578936071724569268', time=2024-09-12T19:54:36.258651+0000, chain.objs.size()=1 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.504__shadow:YnY3RpnWdxNL2AAWGjaSqYdBVkxd.2r_.0H8-qd5wL1YloYv9-TjdMVbSrLkSqV7_0 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12942009688140438359', time=2024-09-12T19:54:36.367508+0000, chain.objs.size()=1 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.504__shadow:YnY3RpnWdxNL2AAWGjaSqYdBVkxd.2r_.0H8-qd5wL1YloYv9-TjdMVbSrLkSqV7_0 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7680983609804520043', time=2024-09-12T19:54:40.200697+0000, chain.objs.size()=1 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.519__multipart_mymultipart.2~Tgdc_pxC4aV_FO7ICMUh4AmtIN0lJ-F.1 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5612522941650718855', time=2024-09-12T19:54:45.429203+0000, chain.objs.size()=6 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart._D-HIDrEyJPptPcR4AXiWWufiji1mumJ.1 2024-09-12T18:01:03.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~jtoUFj4kJb6-_BgsF3DJMfRx-kHSVpT.2 2024-09-12T18:01:03.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.731+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~jtoUFj4kJb6-_BgsF3DJMfRx-kHSVpT.3 2024-09-12T18:01:03.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.731+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~jtoUFj4kJb6-_BgsF3DJMfRx-kHSVpT.4 2024-09-12T18:01:03.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.731+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~jtoUFj4kJb6-_BgsF3DJMfRx-kHSVpT.5 2024-09-12T18:01:03.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.731+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~jtoUFj4kJb6-_BgsF3DJMfRx-kHSVpT.6 2024-09-12T18:01:03.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.734+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~1N2UnwyzfXGhvH9GSbd6WxfqUTd-swK', time=2024-09-12T19:54:46.438153+0000, chain.objs.size()=1 2024-09-12T18:01:03.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.734+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~1N2UnwyzfXGhvH9GSbd6WxfqUTd-swK.3 2024-09-12T18:01:03.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.734+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16074800396027325182', time=2024-09-12T19:54:53.412884+0000, chain.objs.size()=2 2024-09-12T18:01:03.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.734+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.529__multipart_mymultipart.2~79Qs0LBrLUJ1Pg7lveuBhCETxAUfFKa.1 2024-09-12T18:01:03.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.734+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.529__multipart_mymultipart.2~79Qs0LBrLUJ1Pg7lveuBhCETxAUfFKa.2 2024-09-12T18:01:03.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.734+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6621371338654433568', time=2024-09-12T19:55:10.992815+0000, chain.objs.size()=1 2024-09-12T18:01:03.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.734+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.538__shadow_.mfdc9_eGhfQ36CaGzE332JWEuuTkfjg_0 2024-09-12T18:01:03.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11268992811466919689', time=2024-09-12T19:55:23.763010+0000, chain.objs.size()=1 2024-09-12T18:01:03.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.554__shadow_.KFhhK67Qy0ABMWULOP1EnqbZrvVecWQ_0 2024-09-12T18:01:03.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15829365895717132315', time=2024-09-12T19:55:36.004801+0000, chain.objs.size()=1 2024-09-12T18:01:03.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:Titk3lwPqcgE7mZ0RfKgJE3Myt.cEan_.V0WW5sEzNdfk-dCx7HJaP97XUmhovNi_0 2024-09-12T18:01:03.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2180703382842496782', time=2024-09-12T19:55:59.559208+0000, chain.objs.size()=1 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:ya13r2s4gXQDUFxyLsX0xik0pdA3KhP_.JuHAZQv82UTIpdWTMZJH8UYiP9TvkiX_0 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.612331490956999059', time=2024-09-12T19:56:02.116595+0000, chain.objs.size()=1 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:lvK8nJoEjgtImrsbriC28AZuC7Apa1p_._u8v2ZFRemcr21DWEEjAHF2Cy-OuUeM_0 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14986125159424813889', time=2024-09-12T19:56:06.847105+0000, chain.objs.size()=1 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.597__shadow_.cqPkKp9WHBEl3qZzJg-zAzH39ev7Pkr_0 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12424951477108994125', time=2024-09-12T19:58:21.947436+0000, chain.objs.size()=1 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.640__shadow_.j_GrOujgjtcQ3f4eCW4DK2-KP8z8RCJ_0 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16130722875502204296', time=2024-09-12T19:58:36.399966+0000, chain.objs.size()=1 2024-09-12T18:01:03.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.696__shadow_.LbnGpML04r-7ZDJVg6llpjAaeAtNVQT_0 2024-09-12T18:01:03.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.739+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2705067399005485784', time=2024-09-12T19:58:40.406490+0000, chain.objs.size()=1 2024-09-12T18:01:03.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.739+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.713__shadow:0cRRLd2ba3K0E0mSD2FatAoHLIv2NrT_.kIIYNPGODXq5L4-SUGefuxxnRcLooTf_0 2024-09-12T18:01:03.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.743+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.745+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:01:03.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48942' 2024-09-12T18:01:03.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7679291849750054414', time=2024-09-12T19:53:06.321431+0000, chain.objs.size()=1 2024-09-12T18:01:03.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.231__shadow_.-YbnBe_7s_VUzBzeIPMYHO6spbxb7gM_0 2024-09-12T18:01:03.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5856959365355324118', time=2024-09-12T19:53:08.977612+0000, chain.objs.size()=1 2024-09-12T18:01:03.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.243__shadow_.JsweJbOlQJ6yZvQhyEkNPoAZST6dHhY_0 2024-09-12T18:01:03.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.375120349706969682', time=2024-09-12T19:53:21.195709+0000, chain.objs.size()=1 2024-09-12T18:01:03.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.e32iG1dd07fSWyqe4koNEcDRngPI_fH_0 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10886872522970442382', time=2024-09-12T19:53:21.207272+0000, chain.objs.size()=1 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.UdZO18sMmbbpw_IMujN7-INIsSdo6tt_0 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.132392902567961749', time=2024-09-12T19:53:21.215128+0000, chain.objs.size()=1 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fi53Jj_YAe2rXyZIPmoIAnrBvA9q3_A_0 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14001852089734102833', time=2024-09-12T19:53:21.236969+0000, chain.objs.size()=1 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1dWVX0amC302B_g2FEja-g6KUIf9XJJ_0 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10945606709756099285', time=2024-09-12T19:53:21.277807+0000, chain.objs.size()=1 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ytHCuezxz5yKG4se2kaG3BlfNuJKVGY_0 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7102250491439426689', time=2024-09-12T19:53:21.285681+0000, chain.objs.size()=1 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-Mimz1zuCBNOUPAFZk29RHDEuL7B0Yj_0 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10057735195254011948', time=2024-09-12T19:53:21.286497+0000, chain.objs.size()=1 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.C3LCmAs5hHkKUcfdJqP074oyKYP6rfb_0 2024-09-12T18:01:03.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.747+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12657401401546909665', time=2024-09-12T19:53:21.383709+0000, chain.objs.size()=1 2024-09-12T18:01:03.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.748+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.A4RjsjOEPL0_psRFCVFyIiibHThbem7_0 2024-09-12T18:01:03.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.748+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17261360762736493838', time=2024-09-12T19:53:21.398442+0000, chain.objs.size()=1 2024-09-12T18:01:03.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.748+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LNCmYjGk1M0mze8C1rffiEOmTRRzDmk_0 2024-09-12T18:01:03.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.748+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17560510676848383316', time=2024-09-12T19:53:21.424835+0000, chain.objs.size()=1 2024-09-12T18:01:03.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.748+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hNGjUuz7WdAYHAM_RT4GtoTqCRqjXcZ_0 2024-09-12T18:01:03.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16590552093553085622', time=2024-09-12T19:53:21.454631+0000, chain.objs.size()=1 2024-09-12T18:01:03.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LhbBYf_ixwzGWLLYAURXA-JwYtKCrAH_0 2024-09-12T18:01:03.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15853243362692876862', time=2024-09-12T19:53:21.486910+0000, chain.objs.size()=1 2024-09-12T18:01:03.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zLHHsMZ57xUdA69sAa4T4G2cI84dlVl_0 2024-09-12T18:01:03.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1833058433107965396', time=2024-09-12T19:53:21.587608+0000, chain.objs.size()=1 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dwVtLXBXo_YrMtGIzho_yRElNlGZPUa_0 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6573454244796221185', time=2024-09-12T19:53:21.599696+0000, chain.objs.size()=1 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.M3LY61V862bMJ-R1nbQ75tlh8PGDgvs_0 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8481120281794186260', time=2024-09-12T19:53:21.832724+0000, chain.objs.size()=1 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gfFUgJRu-3IcDUNgjqVM-HC4BbC1GcR_0 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10665621392485538906', time=2024-09-12T19:53:21.867131+0000, chain.objs.size()=1 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Y1XXrp5kmMEXUWtMuVjRjozOwu9xHPZ_0 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13994942221408594934', time=2024-09-12T19:53:21.870155+0000, chain.objs.size()=1 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.L_CIhvDfMmKrpl2Yqx5nSFX16WYchf__0 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9724228308310178615', time=2024-09-12T19:53:21.871914+0000, chain.objs.size()=1 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vfo4vO93wWlGy4PmUZRGGfrndUspjtb_0 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9068725897066424550', time=2024-09-12T19:53:21.889384+0000, chain.objs.size()=1 2024-09-12T18:01:03.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._ZxpEMtRneCdMt2mFzo746VLJtydQsr_0 2024-09-12T18:01:03.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7273604721628390810', time=2024-09-12T19:53:21.899667+0000, chain.objs.size()=1 2024-09-12T18:01:03.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hQrEbKlVYZfy-v3FLdc5ydlyPSBMg_U_0 2024-09-12T18:01:03.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.754+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15063811284671924307', time=2024-09-12T19:53:21.998567+0000, chain.objs.size()=1 2024-09-12T18:01:03.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.754+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qdRmHkp5iMyY29dcaNP2xtLB94zrUbi_0 2024-09-12T18:01:03.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12958401565541697078', time=2024-09-12T19:53:22.080660+0000, chain.objs.size()=1 2024-09-12T18:01:03.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kF4MFYMOYO0whZBFyHN702ZkjE7dYi3_0 2024-09-12T18:01:03.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1520121216044401779', time=2024-09-12T19:53:22.098790+0000, chain.objs.size()=1 2024-09-12T18:01:03.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.s0Yl30V1Won0ftBcsgytURBtk97-tzR_0 2024-09-12T18:01:03.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17230798891360318215', time=2024-09-12T19:53:22.199298+0000, chain.objs.size()=1 2024-09-12T18:01:03.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oubATrgIhdf_vwzAIbcRIjgIeN2gMay_0 2024-09-12T18:01:03.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8911531739400301279', time=2024-09-12T19:53:22.213053+0000, chain.objs.size()=1 2024-09-12T18:01:03.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fDsAplJzneDbhgpmyhrsMve9XzXTQfN_0 2024-09-12T18:01:03.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3827588715934654973', time=2024-09-12T19:53:22.241049+0000, chain.objs.size()=1 2024-09-12T18:01:03.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kaGwwmlMYKhr2J6RHjXbJfERt1NVUpY_0 2024-09-12T18:01:03.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12660846402446309860', time=2024-09-12T19:53:22.241902+0000, chain.objs.size()=1 2024-09-12T18:01:03.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GK1TSwGjUnYXhxsPm7K8A8HDVbLz5Hk_0 2024-09-12T18:01:03.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16667961764624346379', time=2024-09-12T19:53:22.245561+0000, chain.objs.size()=1 2024-09-12T18:01:03.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6USO9PWgMpH-fjnpafHCYWjHbsQ0fTp_0 2024-09-12T18:01:03.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15755633928694375639', time=2024-09-12T19:53:22.269148+0000, chain.objs.size()=1 2024-09-12T18:01:03.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WzxITdGuRDVzmd0QiuyL2t9KOSitkg1_0 2024-09-12T18:01:03.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1588455271025687854', time=2024-09-12T19:53:22.421035+0000, chain.objs.size()=1 2024-09-12T18:01:03.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OBcrqLDHUrl-OBntxK-eQJcZJVquUnU_0 2024-09-12T18:01:03.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8330749482545322236', time=2024-09-12T19:53:22.644976+0000, chain.objs.size()=1 2024-09-12T18:01:03.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QeHzUvW62mxVM4neMR-WA4ogkQxsdoG_0 2024-09-12T18:01:03.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12628649256720083867', time=2024-09-12T19:53:22.666756+0000, chain.objs.size()=1 2024-09-12T18:01:03.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.759+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MFdHQaSBfcMFSwtiMMhRNGxSWemQMCH_0 2024-09-12T18:01:03.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15095254597609084198', time=2024-09-12T19:53:22.683260+0000, chain.objs.size()=1 2024-09-12T18:01:03.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.eRUE4Ot8OiLouPaZcT6y0lGSy_InOyA_0 2024-09-12T18:01:03.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5089836982341804889', time=2024-09-12T19:53:22.847038+0000, chain.objs.size()=1 2024-09-12T18:01:03.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.264__shadow_.LTrT0opQt7EzdFuslzlxqMKhXUzH2oY_0 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11751693519233774565', time=2024-09-12T19:53:26.771408+0000, chain.objs.size()=1 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.283__shadow_.t11G34EXQGNs6xj6m07PanG3fLpUZmD_0 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7277297728765122969', time=2024-09-12T19:53:26.772395+0000, chain.objs.size()=1 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.283__shadow_.qd69LvZZIoltus_iVNCJ9aiBUYXf829_0 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11713073669954821435', time=2024-09-12T19:53:27.186925+0000, chain.objs.size()=1 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.285__shadow_.QGw_29G6s7KdryEt0t95XL245gKwhlZ_0 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1300961308615761433', time=2024-09-12T19:53:29.346713+0000, chain.objs.size()=1 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.U3DZ8FcY8Q1ADxD7pxFvSV_ep7rgJMj_0 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14493349341612080941', time=2024-09-12T19:53:29.939551+0000, chain.objs.size()=1 2024-09-12T18:01:03.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.HU9-LSGeXzeI1M8WhH1olAts3vGXrbL_0 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14604141011719571323', time=2024-09-12T19:53:29.944685+0000, chain.objs.size()=1 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.764+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.zO753wUaitNhviy8E1MtkpLaRm2RA-L_0 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.765+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16097562975257824837', time=2024-09-12T19:53:29.950721+0000, chain.objs.size()=1 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.765+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.tgiSmUO57NVA179Y-oOt0NY_of8OPNF_0 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.765+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9807107353795501260', time=2024-09-12T19:53:29.951980+0000, chain.objs.size()=1 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.765+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.pmKR8D7dFYwlHJbh576tyyNrEVnP8v8_0 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.765+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17351586684299541682', time=2024-09-12T19:53:31.073707+0000, chain.objs.size()=1 2024-09-12T18:01:03.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.765+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.299__shadow_.0K1Zx8A4Sxv11PEXU8DH-xsJuSmL-Mw_0 2024-09-12T18:01:03.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.767+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13671267446244364104', time=2024-09-12T19:53:31.981583+0000, chain.objs.size()=1 2024-09-12T18:01:03.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.767+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.303__shadow_.42jjUhPQwpYa82q90acfBSx3jgeZlma_0 2024-09-12T18:01:03.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.769+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1400584258366617175', time=2024-09-12T19:53:44.570444+0000, chain.objs.size()=1 2024-09-12T18:01:03.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.769+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.A2QsBE35OWCWk6zJlXOQagPjhOtfnlF_0 2024-09-12T18:01:03.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.769+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9211719020786066449', time=2024-09-12T19:53:44.577584+0000, chain.objs.size()=1 2024-09-12T18:01:03.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.769+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.470EDMJ2g_KVavTjtjDlSS-qp5YYhp5_0 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6323481528415938101', time=2024-09-12T19:53:44.925839+0000, chain.objs.size()=1 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mBnwPeItsba6Y7vJm5aWQBSMs6HVejL_0 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6381428095787901853', time=2024-09-12T19:53:44.982685+0000, chain.objs.size()=1 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WgRIECaBcYVjtkzwkjEu09EIxMonUR__0 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18106427862264171480', time=2024-09-12T19:53:45.008172+0000, chain.objs.size()=1 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7iiouReoROpZIW9xEuCUCuf1_1syIiX_0 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11580365095557754145', time=2024-09-12T19:53:45.209557+0000, chain.objs.size()=1 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZCxFpsA60iRorKSRHfj8KLPl9LiuTyB_0 2024-09-12T18:01:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9039000943124341146', time=2024-09-12T19:53:45.445085+0000, chain.objs.size()=1 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gKu7pwArNQkTu6aB9sXpn8E04Mom5Gw_0 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16216624798460366385', time=2024-09-12T19:53:45.456253+0000, chain.objs.size()=1 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5zh6zqirZmOgFEKNV5wxjLULKBiCW2b_0 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16965476380763663698', time=2024-09-12T19:53:45.457577+0000, chain.objs.size()=1 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xj5rGucpAa-6DOWfZZdfXzA6cW1gRfP_0 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12648342941838037194', time=2024-09-12T19:53:45.562926+0000, chain.objs.size()=1 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.770+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-i4KZ3I4MKBKRaoZtHYB6TldKSHpRU9_0 2024-09-12T18:01:03.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.772+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1519080801467383280', time=2024-09-12T19:53:45.576334+0000, chain.objs.size()=1 2024-09-12T18:01:03.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.772+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IXw8VNTI5t1S_EO5F1NtgwImAgAj5y6_0 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1517256566404956181', time=2024-09-12T19:53:45.595261+0000, chain.objs.size()=1 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8j-pXzX85-tlaCMWs40CgDgwLZiTWVu_0 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12401744380317209835', time=2024-09-12T19:53:45.625626+0000, chain.objs.size()=1 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oo4PJtrlE01wJGCEn6s8PRXXOQ7zWT9_0 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8156006730718888626', time=2024-09-12T19:53:45.810407+0000, chain.objs.size()=1 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6T31Fu4JFsBxPUzFl70AGs_9J0Diaql_0 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15034271999324006377', time=2024-09-12T19:53:45.838551+0000, chain.objs.size()=1 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.W32Jv_JbYrd3Z3q9Rz4tQm16R6nkFgs_0 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9583825119529516389', time=2024-09-12T19:53:45.839564+0000, chain.objs.size()=1 2024-09-12T18:01:03.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ht4w581wNyk_Fh2DzIwc27dO2QdGfQY_0 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11875407118330360970', time=2024-09-12T19:53:45.840417+0000, chain.objs.size()=1 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pardO80k-86sgqdIU8rBMZFPxng2DRR_0 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16425132839498932384', time=2024-09-12T19:53:45.863193+0000, chain.objs.size()=1 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Fv9H_2phnnwl4rbV7ZkZk86db2jNpLm_0 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12612520063721753367', time=2024-09-12T19:53:45.944613+0000, chain.objs.size()=1 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WyLeFBy3GK8Mf791FO3lNnm6Y2LAgoD_0 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9226875308031618959', time=2024-09-12T19:53:45.945626+0000, chain.objs.size()=1 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YGy7DZzN5Yo368BZJutL_ETuFaO2-aZ_0 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6222881594808927315', time=2024-09-12T19:53:45.998991+0000, chain.objs.size()=1 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.QF1L4QLAIWc2OHe-wx3snmQCNSOnOUo_0 2024-09-12T18:01:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17830390065294047814', time=2024-09-12T19:53:46.006401+0000, chain.objs.size()=1 2024-09-12T18:01:03.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.775+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OeNPnv-jExTHt78IEVZi-D5S7gqAjyY_0 2024-09-12T18:01:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14256122087666135899', time=2024-09-12T19:53:46.014153+0000, chain.objs.size()=1 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wHPC1n3ni8X84O7OPiPi5PpwPH_lXlN_0 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17072612618549864868', time=2024-09-12T19:53:46.062188+0000, chain.objs.size()=1 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IaebcoQHoC19DnSTmaoFD5xhRzFadw0_0 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16399277402198331374', time=2024-09-12T19:53:46.201852+0000, chain.objs.size()=1 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.J69VChr1XVdwURL8Q-Ueclbv3Csuyjp_0 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.780205664449151407', time=2024-09-12T19:53:54.640462+0000, chain.objs.size()=1 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.M_w4-aqGzNjIla2mseaGXsLQyLPv0uK_0 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9307970265975500146', time=2024-09-12T19:53:54.710573+0000, chain.objs.size()=1 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Xbg8TOMVO7Y2Eu2GYVWw-fFASm60x2h_0 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16401269262556117841', time=2024-09-12T19:53:54.749149+0000, chain.objs.size()=1 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.paabNXXhqxuE4lKlan7bGeJyyfMG8sJ_0 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13014052255211710447', time=2024-09-12T19:53:54.861683+0000, chain.objs.size()=1 2024-09-12T18:01:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6MgF5J9drZjijOllxlMUUjmqejj896R_0 2024-09-12T18:01:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12801140298486400751', time=2024-09-12T19:53:54.865402+0000, chain.objs.size()=1 2024-09-12T18:01:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hF_YwNOnH-G3N4xgXMheD7tvWHseZvK_0 2024-09-12T18:01:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.782+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16961631279054831461', time=2024-09-12T19:53:54.921319+0000, chain.objs.size()=1 2024-09-12T18:01:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.782+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.890qWxgkHszY1jSwBCUdYguoFuUXrQp_0 2024-09-12T18:01:03.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.784+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1052354275821143652', time=2024-09-12T19:53:54.964337+0000, chain.objs.size()=1 2024-09-12T18:01:03.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.784+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HSgNUrDIcg9zQ3e3Uf28XzphZcOBF6I_0 2024-09-12T18:01:03.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.784+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6082270549459419219', time=2024-09-12T19:53:55.055052+0000, chain.objs.size()=1 2024-09-12T18:01:03.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.784+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HA_cAuBWJPhoze9NrvxRNcsc70of1Im_0 2024-09-12T18:01:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.785+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9700825176939525414', time=2024-09-12T19:53:55.055946+0000, chain.objs.size()=1 2024-09-12T18:01:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.785+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qySWF1T2y3iT-PEvTkbg1QbRpLrvrUx_0 2024-09-12T18:01:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.786+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10998504316730218118', time=2024-09-12T19:53:55.070998+0000, chain.objs.size()=1 2024-09-12T18:01:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.786+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IzF1cp77SUDBSFAgohE02XyKMfl_F8y_0 2024-09-12T18:01:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.786+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12236377944036698132', time=2024-09-12T19:53:55.075816+0000, chain.objs.size()=1 2024-09-12T18:01:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.786+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Z7m2qPm5jVr9ZsY1cFXWfacscqZ4X4C_0 2024-09-12T18:01:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4043624274346551172', time=2024-09-12T19:53:55.102988+0000, chain.objs.size()=1 2024-09-12T18:01:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.x_D1Brpr5j39Hx5nlTQaz6cVqePBt4t_0 2024-09-12T18:01:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7809546591344351812', time=2024-09-12T19:53:55.127961+0000, chain.objs.size()=1 2024-09-12T18:01:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7gDSBvHEIDk1YHgk0cm0xPOQLknbV9p_0 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.592615177626772471', time=2024-09-12T19:53:55.129599+0000, chain.objs.size()=1 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.a0eXI9lMHpo1JznI1E3mxk12ff0Wd0v_0 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9750223477022771782', time=2024-09-12T19:53:55.144506+0000, chain.objs.size()=1 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fs9a5GI9PVZ7UqRekTzvAc5AECjQmoG_0 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18227879423970962682', time=2024-09-12T19:53:55.156348+0000, chain.objs.size()=1 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.oRV7k-lnXNNBR6XazcEpmDg8VdJ3d_C_0 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.997129920826062561', time=2024-09-12T19:53:55.176558+0000, chain.objs.size()=1 2024-09-12T18:01:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yRWGPPgnLxMhnR3Xjg10zF2gX5rdLsI_0 2024-09-12T18:01:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.788+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6100317700882447097', time=2024-09-12T19:53:55.265043+0000, chain.objs.size()=1 2024-09-12T18:01:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.788+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SirbsbEJbm7i2iJVS4ZyxKZ7ggyHfIb_0 2024-09-12T18:01:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.789+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14825316870166096696', time=2024-09-12T19:53:55.324848+0000, chain.objs.size()=1 2024-09-12T18:01:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.789+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GXUEKigQT9_jcIDZn918PEzg2EfxneV_0 2024-09-12T18:01:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.790+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2664081734377346226', time=2024-09-12T19:53:55.341372+0000, chain.objs.size()=1 2024-09-12T18:01:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.790+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1F4H4Ybm_GPovO3fP79facEPHxHLq-I_0 2024-09-12T18:01:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.790+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4860590147172276806', time=2024-09-12T19:53:55.356630+0000, chain.objs.size()=1 2024-09-12T18:01:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.790+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gH2O2JzR2KM-gD-dK0OrYu4ILwJ_zHM_0 2024-09-12T18:01:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.791+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11061321043612310009', time=2024-09-12T19:53:55.373518+0000, chain.objs.size()=1 2024-09-12T18:01:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.791+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Iv1slCTd-dunKO5gmVHa9M6Is7XWH77_0 2024-09-12T18:01:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.791+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10575786891542722', time=2024-09-12T19:53:55.504316+0000, chain.objs.size()=1 2024-09-12T18:01:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.791+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.C7N7484WS3Traqm3zlL4l-5zCCYwsOU_0 2024-09-12T18:01:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.792+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1528941298907990344', time=2024-09-12T19:53:55.521376+0000, chain.objs.size()=1 2024-09-12T18:01:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.792+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.L_ZxDg-rdN5Cp6Yzvjvy98e5V98kDoj_0 2024-09-12T18:01:03.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12968312662387977728', time=2024-09-12T19:53:55.534696+0000, chain.objs.size()=1 2024-09-12T18:01:03.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._GYQrB0F_lM0m4waBy-kc3qo2OouikI_0 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8053078771328146047', time=2024-09-12T19:53:55.595649+0000, chain.objs.size()=1 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ULmGf_gQsoOS2Qt2NfrRqI5iusZFWyG_0 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13924494463336320531', time=2024-09-12T19:53:55.607361+0000, chain.objs.size()=1 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0ML4smKdSaN8xZZ0qAEuHbGQdmJl3lI_0 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1070206215157976118', time=2024-09-12T19:53:55.613278+0000, chain.objs.size()=1 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3LuX2RXg7TujPuGPcUvpFKPrgb00RFa_0 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12868900779719145091', time=2024-09-12T19:53:55.708315+0000, chain.objs.size()=1 2024-09-12T18:01:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.793+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.e4FKk3lseDwHx7chaDSVltVJ58MwNCJ_0 2024-09-12T18:01:03.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.798+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/48942 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15113757053488188936', time=2024-09-12T19:53:55.743042+0000, chain.objs.size()=1 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._OZ1LaHG7vZ8PNj8_GPFJYon9nyZItQ_0 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10888142157450846807', time=2024-09-12T19:53:55.751860+0000, chain.objs.size()=1 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ktlxOWU4YEFXAaoZJPY-7rY62EJiSza_0 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1030738043070024886', time=2024-09-12T19:53:55.753446+0000, chain.objs.size()=1 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uXvDu_TWdnhE5f0vofErgIpr3rBad7p_0 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17292866329564302552', time=2024-09-12T19:53:55.774780+0000, chain.objs.size()=1 2024-09-12T18:01:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qMeAmXlaSilTmFe2c7EU6Aq5mkg6kv8_0 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15629160722795501678', time=2024-09-12T19:53:55.783178+0000, chain.objs.size()=1 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.e9HoMS_fXJqO5zM4doXn0VCnFqrblW2_0 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13469238779147962653', time=2024-09-12T19:53:55.819083+0000, chain.objs.size()=1 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.dHAqN3PLSob33uQMGnrEiahMUUgCXHE_0 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2714771433858071368', time=2024-09-12T19:53:55.912159+0000, chain.objs.size()=1 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xyY1igLzx3TDPZLvthAyf59sY0e-0tB_0 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2519520067736730479', time=2024-09-12T19:53:55.959773+0000, chain.objs.size()=1 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.UcUdBFmihJNQIfZaNznwUuFoYLjFrPZ_0 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18437388582475757733', time=2024-09-12T19:53:55.962988+0000, chain.objs.size()=1 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yMoilNaWQn8UV2FHnq8c2txvmK8RxRu_0 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14771797089360701091', time=2024-09-12T19:53:55.994166+0000, chain.objs.size()=1 2024-09-12T18:01:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.OIi-BZNpUVwbf9pP6-1gshWdtZCZU93_0 2024-09-12T18:01:03.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2920035864442219059', time=2024-09-12T19:53:56.013833+0000, chain.objs.size()=1 2024-09-12T18:01:03.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4s4hjX3UBE59NVCXBg2EiZ_nWOJAFh5_0 2024-09-12T18:01:03.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9574559018001826542', time=2024-09-12T19:53:56.021510+0000, chain.objs.size()=1 2024-09-12T18:01:03.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.800+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fkzDJ1khlv9QsvV5pNBlBAY2vlS7Vw-_0 2024-09-12T18:01:03.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.804+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14239283057720536714', time=2024-09-12T19:53:56.028215+0000, chain.objs.size()=1 2024-09-12T18:01:03.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.804+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1RbU0UOLDM-gyYzWBRnCAFdRt-WrhCH_0 2024-09-12T18:01:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3541582709343703122', time=2024-09-12T19:53:56.031244+0000, chain.objs.size()=1 2024-09-12T18:01:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.puF_a_m8DCfQEiUmIUhysmtPXPX47xQ_0 2024-09-12T18:01:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4722632912015222415', time=2024-09-12T19:53:56.128581+0000, chain.objs.size()=1 2024-09-12T18:01:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EjHhtM9dtKmKFlkxTtSQhjUsiLR2bPv_0 2024-09-12T18:01:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11244910863793024582', time=2024-09-12T19:53:56.199163+0000, chain.objs.size()=1 2024-09-12T18:01:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.XbA3XH6KIvFhgpQTVNKeot_rKSiZKwj_0 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17279742099590032570', time=2024-09-12T19:54:22.888773+0000, chain.objs.size()=1 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.448__shadow_.m4UAO2XY800mpjfjMTbEanpC5w8mgyI_0 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13652390062556154196', time=2024-09-12T19:54:31.434540+0000, chain.objs.size()=1 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.485__shadow_.52Sy8CPt7LWjWnQXB7ngYswliGIk_6o_0 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7168842775375680865', time=2024-09-12T19:54:32.328327+0000, chain.objs.size()=1 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.488__shadow_.HnTOqjha6UJw0EUWR048Kq9kCHpSuHU_0 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2697178620515916500', time=2024-09-12T19:54:37.853224+0000, chain.objs.size()=6 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.1 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.2 2024-09-12T18:01:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.3 2024-09-12T18:01:03.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.4 2024-09-12T18:01:03.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.5 2024-09-12T18:01:03.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.809+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.6 2024-09-12T18:01:03.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8416402374908453086', time=2024-09-12T19:54:46.444092+0000, chain.objs.size()=6 2024-09-12T18:01:03.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~PD1vpwmb54gmq50YvarYvq1jQsk8Xkm.1 2024-09-12T18:01:03.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.ld7z4LS2AD2O3cnfEjykdQ_YWOJMtobz.2 2024-09-12T18:01:03.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~PD1vpwmb54gmq50YvarYvq1jQsk8Xkm.3 2024-09-12T18:01:03.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~PD1vpwmb54gmq50YvarYvq1jQsk8Xkm.4 2024-09-12T18:01:03.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~PD1vpwmb54gmq50YvarYvq1jQsk8Xkm.5 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~PD1vpwmb54gmq50YvarYvq1jQsk8Xkm.6 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10897335102228087950', time=2024-09-12T19:55:26.916342+0000, chain.objs.size()=1 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.562__multipart_mymultipart.2~kD9llUazxXPoP-kVzpmMFj94okcGyfv.1 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3710743656517358482', time=2024-09-12T19:55:34.137387+0000, chain.objs.size()=1 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:aM0tkUUKD1EOu7j12-0IkIccrPJWgWj_.e-mkPFcPbC-8blEKPNgwNjqrD0620ci_0 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6971776112088798263', time=2024-09-12T19:55:39.327249+0000, chain.objs.size()=1 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.571__shadow:ImCSv7TTDpDgh-ZSAMl23049gtFSV6J_.kep5gbttYKzWoOMQcjHKa4BIfcXHz6p_0 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13601780187814750711', time=2024-09-12T19:58:20.191150+0000, chain.objs.size()=1 2024-09-12T18:01:03.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.813+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.631__shadow_.IQXYF7P5rTNYn6iEmSDdGPf1jCRz1uh_0 2024-09-12T18:01:03.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.818+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.821+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:01:03.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.822+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48937' 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6530263792992862951', time=2024-09-12T19:52:13.237100+0000, chain.objs.size()=1 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.189__shadow_.UdvIYU_HTrJ9h4AY5_2T2PtUo5ka9Pd_0 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3978888740777082968', time=2024-09-12T19:53:07.001850+0000, chain.objs.size()=1 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.234__shadow_.ouNXi_qkzlwncVIJ7tMTRNYZJUJ6n2y_0 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3874247082467263718', time=2024-09-12T19:53:07.246677+0000, chain.objs.size()=1 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.235__shadow_.vIfB-ax26LETuvzo8dnkIeasBIrIKQf_0 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13103112704656342984', time=2024-09-12T19:53:12.036065+0000, chain.objs.size()=1 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.257__shadow_.fJvK0-_hvheiyd3VSpySEHJqsy2lcim_0 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2818012788727439308', time=2024-09-12T19:53:21.166614+0000, chain.objs.size()=1 2024-09-12T18:01:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Va5k-p6OwlwyxsFF57S0Y-SprhtfzBQ_0 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10744602288705839308', time=2024-09-12T19:53:21.189501+0000, chain.objs.size()=1 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TVuzuzL986swG97N8InAyhvmJ9ywGrR_0 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8640219433424772148', time=2024-09-12T19:53:21.247172+0000, chain.objs.size()=1 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.y51iT4of51icOjQMIP0cyWIGEf_PN3S_0 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10872750091835558522', time=2024-09-12T19:53:21.260922+0000, chain.objs.size()=1 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.t01YseyTBbrE87YMPEd0rMV-lVfx2Zn_0 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3845319753143483992', time=2024-09-12T19:53:21.262800+0000, chain.objs.size()=1 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.823+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YoLJ1IaKrAxe4Zs3aENKttGWjkc7pOa_0 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.824+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.951466534203405000', time=2024-09-12T19:53:21.267797+0000, chain.objs.size()=1 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.824+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MaaX3mES1fRKAGo-CfQZdecOVEIsugP_0 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.824+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15012492500703447833', time=2024-09-12T19:53:21.436802+0000, chain.objs.size()=1 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.824+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Yzyx0cfbr6PMyuhzHtrqFoxDXLNwwUI_0 2024-09-12T18:01:03.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.824+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5813440620862681256', time=2024-09-12T19:53:21.489167+0000, chain.objs.size()=1 2024-09-12T18:01:03.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.824+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HHLnGZPOzfl28YbFsE6a9suY9UnjfhI_0 2024-09-12T18:01:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7668243644971341681', time=2024-09-12T19:53:21.598099+0000, chain.objs.size()=1 2024-09-12T18:01:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ASP01BkDO8vK_7FDygNirTnIcJpxe3b_0 2024-09-12T18:01:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15024539797855462439', time=2024-09-12T19:53:21.617712+0000, chain.objs.size()=1 2024-09-12T18:01:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.26ogqzwlqcGI939MnzOaXCvb2IK6fI0_0 2024-09-12T18:01:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17990951553063187176', time=2024-09-12T19:53:21.647593+0000, chain.objs.size()=1 2024-09-12T18:01:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Y7dRJ1V4BwKXyoK0ecgwcjsb80P2_FU_0 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11083120752359631736', time=2024-09-12T19:53:21.672902+0000, chain.objs.size()=1 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DD6SxfWQ8oNacMRMQ2lZJYCRvBkqLot_0 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10185253456478400147', time=2024-09-12T19:53:21.802122+0000, chain.objs.size()=1 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gj5oECYkUjvs05w_2p65W7RdHNG4zZ9_0 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15874264035585816079', time=2024-09-12T19:53:21.810140+0000, chain.objs.size()=1 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ovYNvJcyl-DKTwu7460Qk5jCRtV0C-m_0 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10278084235961075561', time=2024-09-12T19:53:21.888086+0000, chain.objs.size()=1 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9V3sxUT5qb4393I4G2p1cBp5WygHHuT_0 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18188199826168395888', time=2024-09-12T19:53:21.997217+0000, chain.objs.size()=1 2024-09-12T18:01:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OXI2LvSdjeuikfOIhHjgYiBwxUwMrp1_0 2024-09-12T18:01:03.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10617742586412903060', time=2024-09-12T19:53:22.020739+0000, chain.objs.size()=1 2024-09-12T18:01:03.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jKRwrZaD-99_LztOAZsY-ePH0ugkKvD_0 2024-09-12T18:01:03.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10974568366874637022', time=2024-09-12T19:53:22.095106+0000, chain.objs.size()=1 2024-09-12T18:01:03.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.h6WCCeRjwgWUI70e3wFVaySPjTKyoMH_0 2024-09-12T18:01:03.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12757944703419457582', time=2024-09-12T19:53:22.201486+0000, chain.objs.size()=1 2024-09-12T18:01:03.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.829+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qIk6GT4GqhmoE8AgcWtXsolaWJ71Nui_0 2024-09-12T18:01:03.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.833+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6557940199007702047', time=2024-09-12T19:53:22.225445+0000, chain.objs.size()=1 2024-09-12T18:01:03.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.833+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._L53sWInl9s6DTZpXq0_WFNA06VpBpd_0 2024-09-12T18:01:03.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.833+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1786857576514398742', time=2024-09-12T19:53:22.255808+0000, chain.objs.size()=1 2024-09-12T18:01:03.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.833+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2_WOmjy5et6nkF3lzqmqNJ7kOhNDPol_0 2024-09-12T18:01:03.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.833+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12139557750814732075', time=2024-09-12T19:53:22.267726+0000, chain.objs.size()=1 2024-09-12T18:01:03.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.833+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BK2fHK319hzinem44tyTVMTq16DUKHG_0 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.834+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11548270804365724587', time=2024-09-12T19:53:22.269565+0000, chain.objs.size()=1 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.834+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Fhq5CxBcji9e47unLR7t_89EtMP6dU5_0 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.834+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15719381651419996297', time=2024-09-12T19:53:22.292146+0000, chain.objs.size()=1 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.834+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1u_G27yzIgTCUWAbeA2GTTOUsPAuLYV_0 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5909989612694922496', time=2024-09-12T19:53:22.488366+0000, chain.objs.size()=1 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._9aV4mNHyuCS5mMzRnLdvyD0-7-C87L_0 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11948734062472647328', time=2024-09-12T19:53:22.505782+0000, chain.objs.size()=1 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4fj2LcaJeWY49MQMVGbQhV57s760oV1_0 2024-09-12T18:01:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8321571005478632954', time=2024-09-12T19:53:22.615872+0000, chain.objs.size()=1 2024-09-12T18:01:03.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WfQNsX66W9pHwlpeNKC6a59Nq-JP_la_0 2024-09-12T18:01:03.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16611041187068858325', time=2024-09-12T19:53:22.618713+0000, chain.objs.size()=1 2024-09-12T18:01:03.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BRZZKpg6ES3cUu8QRO1sJKIpieNOwgL_0 2024-09-12T18:01:03.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12299448922087439311', time=2024-09-12T19:53:22.677079+0000, chain.objs.size()=1 2024-09-12T18:01:03.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.835+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.VKtCDU8_5_wN4RRo6BCIcWr7-KQAtbh_0 2024-09-12T18:01:03.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.836+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8849696847577887759', time=2024-09-12T19:53:23.242191+0000, chain.objs.size()=1 2024-09-12T18:01:03.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.836+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.266__shadow_.H-fRaZLWaRZssqvmlJWCcKhdNeeQCEr_0 2024-09-12T18:01:03.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13745822855135853618', time=2024-09-12T19:53:24.661119+0000, chain.objs.size()=1 2024-09-12T18:01:03.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.273__shadow_.96hfbIBlEJjuUnpgiRUAmkLj2V7pt92_0 2024-09-12T18:01:03.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9775067115189873712', time=2024-09-12T19:53:25.914449+0000, chain.objs.size()=1 2024-09-12T18:01:03.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.279__shadow_.o0Zn6ZKU02kaQpngwgvdvmHK9x7sj9U_0 2024-09-12T18:01:03.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16620179529499598296', time=2024-09-12T19:53:26.321700+0000, chain.objs.size()=1 2024-09-12T18:01:03.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.281__shadow_.zy7Ly70pnnw_SN2VP2g2boFCTJ80Ty0_0 2024-09-12T18:01:03.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.839+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9334817753995434448', time=2024-09-12T19:53:29.341988+0000, chain.objs.size()=1 2024-09-12T18:01:03.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.839+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.PB88BGb_G-7buN1S0X9URFX4dKSaN8c_0 2024-09-12T18:01:03.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3108247303168117010', time=2024-09-12T19:53:29.940507+0000, chain.objs.size()=1 2024-09-12T18:01:03.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.QvU65wui_927zL_-DrN8SttsuFss9cQ_0 2024-09-12T18:01:03.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4477490757384180990', time=2024-09-12T19:53:44.527932+0000, chain.objs.size()=1 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JyR7cejdirga1HuJJqCZpMuf-Blcpx7_0 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9708918122592162314', time=2024-09-12T19:53:44.537170+0000, chain.objs.size()=1 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OmLhUIJvv3eOccQSSwKFIB-aHvEKrqb_0 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14706064035388262610', time=2024-09-12T19:53:44.569164+0000, chain.objs.size()=1 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ob6CsIhg0jvdUvbvmCyTAzXHw_ZDfnH_0 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12217728143856512158', time=2024-09-12T19:53:44.573315+0000, chain.objs.size()=1 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gt_xTZH-V69Wzn32akqJ0sXbFYEpAYV_0 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2249774024036694110', time=2024-09-12T19:53:44.928979+0000, chain.objs.size()=1 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.X5dpCt4sXsc1snPaGvang9WUPUutVYz_0 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10222395617138044500', time=2024-09-12T19:53:44.997402+0000, chain.objs.size()=1 2024-09-12T18:01:03.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DdKYldB3VehSiwIv02y0yiBQc7Y-dQV_0 2024-09-12T18:01:03.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6443744635454449184', time=2024-09-12T19:53:45.005736+0000, chain.objs.size()=1 2024-09-12T18:01:03.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.841+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AUDQ-sLmk20MnU2LZ4yH4b4ygW3hpt5_0 2024-09-12T18:01:03.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.843+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17655308143688535131', time=2024-09-12T19:53:45.009787+0000, chain.objs.size()=1 2024-09-12T18:01:03.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.843+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WEgfyuib960J9N8I4-nGeE9sRFQ1E2-_0 2024-09-12T18:01:03.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.843+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8570751938441844520', time=2024-09-12T19:53:45.010846+0000, chain.objs.size()=1 2024-09-12T18:01:03.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.843+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CdhzCr3KGXSF4j13IPyZZxeICzRhMM-_0 2024-09-12T18:01:03.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.843+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10311186273953249388', time=2024-09-12T19:53:45.031659+0000, chain.objs.size()=1 2024-09-12T18:01:03.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.843+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FUaTuf1EULTwwcztp5-_Sfed6cq0Fkp_0 2024-09-12T18:01:03.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.846+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16818759053168192103', time=2024-09-12T19:53:45.042503+0000, chain.objs.size()=1 2024-09-12T18:01:03.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.846+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1A0gZumE6KwJTDFqAbviGpzYbM_RCKQ_0 2024-09-12T18:01:03.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.847+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13662752529637681810', time=2024-09-12T19:53:45.168113+0000, chain.objs.size()=1 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fbwVwQYQFZILyCmcDEwNH7nHiN7Vcrs_0 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7684336375559480694', time=2024-09-12T19:53:45.217077+0000, chain.objs.size()=1 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MUuzQNeUdQ11IXStXjLehxLF_-2i6Yy_0 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12815845889811848538', time=2024-09-12T19:53:45.220632+0000, chain.objs.size()=1 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.v6uUxQao1yAPZXVXc1DCBI1AIxqXx-c_0 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16198523358225886667', time=2024-09-12T19:53:45.229509+0000, chain.objs.size()=1 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.axOjvmmvombmKCEBFenh4vkRLqXymRq_0 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10469911788422485553', time=2024-09-12T19:53:45.243110+0000, chain.objs.size()=1 2024-09-12T18:01:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.848+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.j0mymvI692SBBZnujZtm8V05qSH5KFz_0 2024-09-12T18:01:03.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6103103588795278467', time=2024-09-12T19:53:45.359125+0000, chain.objs.size()=1 2024-09-12T18:01:03.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2s8iBgawNX-9-MPk5thhXFvAOuHtE37_0 2024-09-12T18:01:03.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.940591394338699084', time=2024-09-12T19:53:45.426462+0000, chain.objs.size()=1 2024-09-12T18:01:03.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RnvNFpYmvF5YqIGozA4fgLga30RFOYT_0 2024-09-12T18:01:03.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5093526134715240719', time=2024-09-12T19:53:45.542598+0000, chain.objs.size()=1 2024-09-12T18:01:03.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vd24QmcFdmD8gV6Zosrb5bGAn4WHVHz_0 2024-09-12T18:01:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.851+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12171504528053144610', time=2024-09-12T19:53:45.555480+0000, chain.objs.size()=1 2024-09-12T18:01:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.851+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MH9o3eIN5Hs8FRYWN619qmuR0Du6x5v_0 2024-09-12T18:01:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.851+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14454371869082672915', time=2024-09-12T19:53:45.601695+0000, chain.objs.size()=1 2024-09-12T18:01:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.851+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1xfTxcMIYwRaEyaWWD8lw7r2z8-NMoT_0 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8659646100483883102', time=2024-09-12T19:53:45.610584+0000, chain.objs.size()=1 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.clfaeV_GWG2l4slEzusdKFtrSpNdCwq_0 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1108668983368777304', time=2024-09-12T19:53:45.616689+0000, chain.objs.size()=1 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._aB6Pkzk7X8hTfieN3moNr0_ZZRdhiT_0 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.270382234266786678', time=2024-09-12T19:53:45.625509+0000, chain.objs.size()=1 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HwbXlE-lqFszumZK-mX412layFsvIH5_0 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6735211853810257876', time=2024-09-12T19:53:45.815408+0000, chain.objs.size()=1 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.I4gou1zwNCcqWK4jKbHD8c8nNDRrrGx_0 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18184355074502137490', time=2024-09-12T19:53:45.861633+0000, chain.objs.size()=1 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OPbutAVWgm12lCnNTKf3ZjJ6MVRMchz_0 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16542638147930537337', time=2024-09-12T19:53:45.947192+0000, chain.objs.size()=1 2024-09-12T18:01:03.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JvT14_HHeqL7svVq0RnKfXZXbViY1CY_0 2024-09-12T18:01:03.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7967228019010794848', time=2024-09-12T19:53:45.953337+0000, chain.objs.size()=1 2024-09-12T18:01:03.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LfHGOqOW9rghJTOVR0h8inSBos7H3-N_0 2024-09-12T18:01:03.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8727419191839287458', time=2024-09-12T19:53:46.006211+0000, chain.objs.size()=1 2024-09-12T18:01:03.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yFZBcGvW8ATZ_8YO_KgHbVU5PNbPDNr_0 2024-09-12T18:01:03.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11525617249438239642', time=2024-09-12T19:53:46.024783+0000, chain.objs.size()=1 2024-09-12T18:01:03.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.853+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6y1cN7PJoGH230pnt53MlVGfhT_rexY_0 2024-09-12T18:01:03.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11896441691993732456', time=2024-09-12T19:53:46.039839+0000, chain.objs.size()=1 2024-09-12T18:01:03.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Pz1wJnWL1Su3bJEb8ZFENGjVb5vu55i_0 2024-09-12T18:01:03.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5039748174962867289', time=2024-09-12T19:53:54.634629+0000, chain.objs.size()=1 2024-09-12T18:01:03.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.g4IluYSdAy1AVPbEnDAKenfC8rQ-iZH_0 2024-09-12T18:01:03.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.858+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.456833463508763272', time=2024-09-12T19:53:54.668619+0000, chain.objs.size()=1 2024-09-12T18:01:03.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.858+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6vPC_nMop2RJhkV1Op53e4CdeCuntpy_0 2024-09-12T18:01:03.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.858+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11841084052383052726', time=2024-09-12T19:53:54.694433+0000, chain.objs.size()=1 2024-09-12T18:01:03.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.858+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gFmtB0md8f3Q6UyQCufkEFcoJ385YQS_0 2024-09-12T18:01:03.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.412946439868417728', time=2024-09-12T19:53:54.724439+0000, chain.objs.size()=1 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vuCvfR-L1gq7CQuaOQfdyaEaxu-IXef_0 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12344716758454141543', time=2024-09-12T19:53:54.731854+0000, chain.objs.size()=1 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7f5M0C5cyyVyja3j0V4AXmBMZw4zOCw_0 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14598777371637830149', time=2024-09-12T19:53:54.755661+0000, chain.objs.size()=1 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kwmJQatrT3HUQO4kjo1wyREXsztzHhd_0 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10541413896202234778', time=2024-09-12T19:53:54.760568+0000, chain.objs.size()=1 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wRjHV8V30Ur1RudrfPm1z4tEUHGjKJ2_0 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1690043499373722829', time=2024-09-12T19:53:54.843241+0000, chain.objs.size()=1 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Fls3VZF7EIzyGUP_5fC7uFpeg1w9ftz_0 2024-09-12T18:01:03.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.971646518651473336', time=2024-09-12T19:53:54.863011+0000, chain.objs.size()=1 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0H-0FrpKPuuii39OenQQf8Ma4lgIOIU_0 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12607008911833878817', time=2024-09-12T19:53:54.864918+0000, chain.objs.size()=1 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Qsx3J7uZfSUUo5-_6pUZ6-v05HlVo4u_0 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14181753496281554214', time=2024-09-12T19:53:54.869973+0000, chain.objs.size()=1 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lyjKLIJH-NYkHeugXX_qs2jBEo-59wN_0 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15540115277936534252', time=2024-09-12T19:53:54.878035+0000, chain.objs.size()=1 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vv1iieSMZdGpuxUiEZhRWnf5-xf6gkA_0 2024-09-12T18:01:03.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.862+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14763370220272608603', time=2024-09-12T19:53:54.902646+0000, chain.objs.size()=1 2024-09-12T18:01:03.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.862+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7sq4vFahvC2eQt_2GVokqRzaxHuD_FM_0 2024-09-12T18:01:03.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.863+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10742109590439854216', time=2024-09-12T19:53:54.913575+0000, chain.objs.size()=1 2024-09-12T18:01:03.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.863+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.WgZDEdGLnWgr4mhnxciuRkVRf65yMMB_0 2024-09-12T18:01:03.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.864+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6204722885032366993', time=2024-09-12T19:53:54.930950+0000, chain.objs.size()=1 2024-09-12T18:01:03.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.864+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zyDh5UPePdRbMs3cqwN-TdunfLGQX3d_0 2024-09-12T18:01:03.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.865+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1353684680288109758', time=2024-09-12T19:53:54.931599+0000, chain.objs.size()=1 2024-09-12T18:01:03.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.865+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4NxXjMI48ufdVOdchipOFf7RtNMkD3z_0 2024-09-12T18:01:03.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7102688577236871395', time=2024-09-12T19:53:54.936209+0000, chain.objs.size()=1 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7pemSyVUh-DMBPhzqkVxlXB5xdy6pF__0 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6773520472291025463', time=2024-09-12T19:53:55.051390+0000, chain.objs.size()=1 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vqu5MN8CcnYwBU719TwasB9eBPCifx__0 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4054970788413223747', time=2024-09-12T19:53:55.149312+0000, chain.objs.size()=1 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JHLhVyN9S2RTDTa9MWWUmpACrSvDGXc_0 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14680224805273580391', time=2024-09-12T19:53:55.165840+0000, chain.objs.size()=1 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.OlE1DmdybONnBAR1Rrdzru-Np-KMjCX_0 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6721808307042051190', time=2024-09-12T19:53:55.259715+0000, chain.objs.size()=1 2024-09-12T18:01:03.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.866+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.83SDLs_te9J3amN6AyViZPzkg8aNanz_0 2024-09-12T18:01:03.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.867+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4193158033753797156', time=2024-09-12T19:53:55.290206+0000, chain.objs.size()=1 2024-09-12T18:01:03.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.867+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.L7prnpc--rv3acS7jjuSDTxanPSdQfm_0 2024-09-12T18:01:03.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.867+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13505296179346234057', time=2024-09-12T19:53:55.373363+0000, chain.objs.size()=1 2024-09-12T18:01:03.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.867+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5DDuMyoHTUosqd_iJfVEC3ZCzGXaneT_0 2024-09-12T18:01:03.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.867+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.233016505924965501', time=2024-09-12T19:53:55.380839+0000, chain.objs.size()=1 2024-09-12T18:01:03.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.867+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9KQwUgrOAujiX8oQgzJio2pgdpohDxx_0 2024-09-12T18:01:03.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.867+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13156718005372278408', time=2024-09-12T19:53:55.515413+0000, chain.objs.size()=1 2024-09-12T18:01:03.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.868+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kxosqbT7ZBRUIQkIB5i6U4plXnXcC2k_0 2024-09-12T18:01:03.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.868+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10042244580842935493', time=2024-09-12T19:53:55.522063+0000, chain.objs.size()=1 2024-09-12T18:01:03.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.868+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uDJZASVuZIjd9MzkM3A22GWlGRJvC85_0 2024-09-12T18:01:03.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13410413643570620747', time=2024-09-12T19:53:55.546447+0000, chain.objs.size()=1 2024-09-12T18:01:03.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aLFUMJpxyipXPcYa1STaFhGCsLJl9f6_0 2024-09-12T18:01:03.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8793368484074856674', time=2024-09-12T19:53:55.555269+0000, chain.objs.size()=1 2024-09-12T18:01:03.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MfzY83tOyMHg-dO165Io84vX3u3Vgx6_0 2024-09-12T18:01:03.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5601733175666538760', time=2024-09-12T19:53:55.561559+0000, chain.objs.size()=1 2024-09-12T18:01:03.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vA54ztWKdO98qk0VRAefRgFUFDkUe4P_0 2024-09-12T18:01:03.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.455460117641481665', time=2024-09-12T19:53:55.578270+0000, chain.objs.size()=1 2024-09-12T18:01:03.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.870+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.XerHFk9IT3kRn1oLHEUH3doT-q-3Drh_0 2024-09-12T18:01:03.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.876+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/48937 2024-09-12T18:01:03.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.878+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:01:03.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.878+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1044176660668129515', time=2024-09-12T19:53:55.582886+0000, chain.objs.size()=1 2024-09-12T18:01:03.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.878+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7hR9AeHkz9o5PdP6RvAdwvJLd4MdkI4_0 2024-09-12T18:01:03.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16735790012381385587', time=2024-09-12T19:53:55.594551+0000, chain.objs.size()=1 2024-09-12T18:01:03.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ivFjMKnbu2TvfLYNd7XPe5lrPet50hg_0 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8794148499189445752', time=2024-09-12T19:53:55.702499+0000, chain.objs.size()=1 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Y6TbjGmEsScK9hPrijE_j1qGjIgqARX_0 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6914325308081429085', time=2024-09-12T19:53:55.705523+0000, chain.objs.size()=1 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uUBincCYqT3RVzQEBbPOOMaMofhOnBu_0 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4970841123910678142', time=2024-09-12T19:53:55.717930+0000, chain.objs.size()=1 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.R9cL_QRewJC0uNgE9Wx_dViq700lt2c_0 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4943129286285864999', time=2024-09-12T19:53:55.718982+0000, chain.objs.size()=1 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TX7R6S4QZj76-x_uEtlAs8YdnD0RMID_0 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10165232642616424524', time=2024-09-12T19:53:55.762558+0000, chain.objs.size()=1 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-WWCfkrncFcDt_To_gEHEm_bJXKCuzf_0 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10306524411249576790', time=2024-09-12T19:53:55.927534+0000, chain.objs.size()=1 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.OZFw2pKUf6DzBG94ZZTeKpdoILvmZ0r_0 2024-09-12T18:01:03.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13764369414231761617', time=2024-09-12T19:53:55.974255+0000, chain.objs.size()=1 2024-09-12T18:01:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.232zlgQ-biJG7w1pGHwaOhWZufZI1jV_0 2024-09-12T18:01:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3040744371664717766', time=2024-09-12T19:53:56.024125+0000, chain.objs.size()=1 2024-09-12T18:01:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NH7WIk3rtvk0GeNSNOjSUU2DAkIWrNI_0 2024-09-12T18:01:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8987103573141265635', time=2024-09-12T19:53:56.174413+0000, chain.objs.size()=1 2024-09-12T18:01:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TmsUlmXycKlm1iSk_teAnOCTCxaTPPg_0 2024-09-12T18:01:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4192852727909378246', time=2024-09-12T19:54:34.308052+0000, chain.objs.size()=1 2024-09-12T18:01:03.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.497__shadow_.INZaSBlZf8mcPQAvkQOgdtPjCsd9O0V_0 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17681556491967051539', time=2024-09-12T19:55:26.294012+0000, chain.objs.size()=1 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.560__shadow_.owdvl6CrhE3r1o0MY-eaJRnW5sVk-LJ_0 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8469945183361206210', time=2024-09-12T19:55:39.465775+0000, chain.objs.size()=1 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.571__shadow:xcLtFFCz62ShDjX0-qib.Ega7GNmDnR_.IBh85esExk25PUf2o-9HlY3aUIFgYv3_0 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9394952471856607485', time=2024-09-12T19:55:40.971952+0000, chain.objs.size()=1 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow_.jXjCPImthophxcuZ1ZzJUYQO9zawY2H_0 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9103970021663074006', time=2024-09-12T19:55:43.542131+0000, chain.objs.size()=1 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.576__shadow_.32jbbGqOlDAverTzCFeIJb8QCUDB6q8_0 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13128626513289863042', time=2024-09-12T19:55:58.369062+0000, chain.objs.size()=1 2024-09-12T18:01:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:76tUTRj45wLTQoH3yqOQXYHwLWcCmyk_.mH4iZxJ4iSO-QxMYkxF0CGBXdwDU106_0 2024-09-12T18:01:03.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17831252776356081016', time=2024-09-12T19:58:21.573443+0000, chain.objs.size()=1 2024-09-12T18:01:03.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.638__shadow_.Zu3mrvFKjhfTrwuw4gXhKO-jo-uYe2L_0 2024-09-12T18:01:03.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.884+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12392605251901320872', time=2024-09-12T19:58:22.891556+0000, chain.objs.size()=1 2024-09-12T18:01:03.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.884+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.644__shadow_.hHAUtU6QpGh8Fj8YbxkD2gm8snanovU_0 2024-09-12T18:01:03.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.884+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5655358748786750504', time=2024-09-12T19:58:31.270204+0000, chain.objs.size()=1 2024-09-12T18:01:03.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.884+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.669__shadow_.YruQdWc80NTZSnvp4Lh8hDUreilfU9__0 2024-09-12T18:01:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.888+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.891+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:01:03.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.892+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.893+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.893+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48355' 2024-09-12T18:01:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.893+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7124429365014264161', time=2024-09-12T19:51:52.827024+0000, chain.objs.size()=1 2024-09-12T18:01:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.149__shadow_.8k8FIAl4kui-i7wC0wL144EgLf5QF0L_0 2024-09-12T18:01:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_QiDnLbB5lFRTSF3KbCnI2fOvCJ82O-R', time=2024-09-12T19:52:00.051366+0000, chain.objs.size()=3 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.okY_ZLxBr1FTqfGr-CtbJVlr1QsMaq9_0 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.okY_ZLxBr1FTqfGr-CtbJVlr1QsMaq9_1 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.okY_ZLxBr1FTqfGr-CtbJVlr1QsMaq9_2 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1440077420917339968', time=2024-09-12T19:52:12.311686+0000, chain.objs.size()=1 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.183__shadow_.4yO8FOqBk3ceQSaj_5py_Tff85qXFMC_0 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5821186251267037660', time=2024-09-12T19:52:12.484460+0000, chain.objs.size()=1 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.184__shadow_.ThN8UIHkCdQk4Qlknjo8kXrYSqTZgyB_0 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15744655826920450638', time=2024-09-12T19:53:09.501577+0000, chain.objs.size()=1 2024-09-12T18:01:03.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.245__shadow_.4xKQAxU2bbm45vgmB28jSmPcKEiv3A8_0 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7471547535035141488', time=2024-09-12T19:53:09.703998+0000, chain.objs.size()=1 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.246__shadow_.HIFVMJ2XvyaI1VT-Jx_e7JsCLiIAEKK_0 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4210911181627290263', time=2024-09-12T19:53:10.145410+0000, chain.objs.size()=1 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.248__shadow_.w7IieKIMPqQWBwEZ-xg2EdVp8K_-c_u_0 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18330134281557168788', time=2024-09-12T19:53:11.211521+0000, chain.objs.size()=1 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.253__shadow_.C2mQJfwm1XRGCaksV29NHUfxPV_kLZ6_0 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3727291350108985522', time=2024-09-12T19:53:11.622420+0000, chain.objs.size()=1 2024-09-12T18:01:03.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.255__shadow_.MFdN1Nl-94cUMwO7QyKBQTFLaR7Jut2_0 2024-09-12T18:01:03.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3475989116198182914', time=2024-09-12T19:53:21.371090+0000, chain.objs.size()=1 2024-09-12T18:01:03.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.894+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ej0P4JkE7J3-dSlsPvaxzJKyQf39xwW_0 2024-09-12T18:01:03.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.897+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13177927417785064501', time=2024-09-12T19:53:21.372804+0000, chain.objs.size()=1 2024-09-12T18:01:03.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.897+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.NFMLIKjJ3zElLQSYVYPGsGH-ibz9Bsd_0 2024-09-12T18:01:03.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15140300491951452527', time=2024-09-12T19:53:21.641654+0000, chain.objs.size()=1 2024-09-12T18:01:03.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9FbSu4Zueh35IrOP1_oLDyBV9XfL6Ze_0 2024-09-12T18:01:03.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18178700697219050558', time=2024-09-12T19:53:21.671153+0000, chain.objs.size()=1 2024-09-12T18:01:03.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RcdlS4mbFq928w4emuqRG2PRYPVRMPd_0 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4671966379769367431', time=2024-09-12T19:53:21.686338+0000, chain.objs.size()=1 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tkPZ1qePaIqr4LiZa_QWO5eus2SHBOt_0 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5615060941438743176', time=2024-09-12T19:53:21.695195+0000, chain.objs.size()=1 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AfQVwwoh0rd4DWcwRH-p3GTQhwZSiSM_0 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5240762569005230998', time=2024-09-12T19:53:21.697719+0000, chain.objs.size()=1 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6yNThfsyGE95rNE7zztUIjTC11gxiOR_0 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.148573422974619402', time=2024-09-12T19:53:21.774342+0000, chain.objs.size()=1 2024-09-12T18:01:03.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oaBLEhiikBm9kPR2cifyVoVu_HpOQLP_0 2024-09-12T18:01:03.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10641551389209163385', time=2024-09-12T19:53:21.783518+0000, chain.objs.size()=1 2024-09-12T18:01:03.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6wizgVmeO5zua0BQt51K9jw_L3Urm5U_0 2024-09-12T18:01:03.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18207192345945892938', time=2024-09-12T19:53:21.803736+0000, chain.objs.size()=1 2024-09-12T18:01:03.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.SBqCNCCIo4ozoP5KGR3niR7w8cNQ5KZ_0 2024-09-12T18:01:03.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16425096877456346446', time=2024-09-12T19:53:21.839965+0000, chain.objs.size()=1 2024-09-12T18:01:03.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PFNhcxYOim23OLKPclAaocaoq5sl2u7_0 2024-09-12T18:01:03.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13856822005999661014', time=2024-09-12T19:53:21.842440+0000, chain.objs.size()=1 2024-09-12T18:01:03.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XwFCuzvM0dFxAm9I9WotogVEgL_Gzym_0 2024-09-12T18:01:03.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5399680353485041965', time=2024-09-12T19:53:21.861672+0000, chain.objs.size()=1 2024-09-12T18:01:03.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DuPFdsn6J6gVjpQD17Gu1vIWfVJ9gzU_0 2024-09-12T18:01:03.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2544452139972503755', time=2024-09-12T19:53:21.894904+0000, chain.objs.size()=1 2024-09-12T18:01:03.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.60IQN8LL8RIYW3Ezv9AFuklBPmTt2Zu_0 2024-09-12T18:01:03.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17756778156431633362', time=2024-09-12T19:53:22.049154+0000, chain.objs.size()=1 2024-09-12T18:01:03.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.b0cuHYfJg6vhXVHG2E7te9vbk0LaWFx_0 2024-09-12T18:01:03.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18203978811235335701', time=2024-09-12T19:53:22.058546+0000, chain.objs.size()=1 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4s_b7JHGWulqCnkniCCDx_UCFQQCsI4_0 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17941398675897333868', time=2024-09-12T19:53:22.068106+0000, chain.objs.size()=1 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4sl4nAaXpuRkmr45R0sEfYoS1ZFmzbV_0 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13422456997911820451', time=2024-09-12T19:53:22.247920+0000, chain.objs.size()=1 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.l39bUHt4VdbJdbltRIobhucYccia3q8_0 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6879700483960450287', time=2024-09-12T19:53:22.248704+0000, chain.objs.size()=1 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XlTLAV5NahOmyyUOLg2MPC4KNl5sciC_0 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.905+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15295283297533472301', time=2024-09-12T19:53:22.249616+0000, chain.objs.size()=1 2024-09-12T18:01:03.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.905+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QS49nqvJYk6XN_33uebA7IxQcQ9QydQ_0 2024-09-12T18:01:03.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.907+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6441556723337790182', time=2024-09-12T19:53:22.262248+0000, chain.objs.size()=1 2024-09-12T18:01:03.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.907+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hKAyzPWISBszlpSNM4mNyXxN2AotFYl_0 2024-09-12T18:01:03.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.907+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11204063206133996616', time=2024-09-12T19:53:22.396192+0000, chain.objs.size()=1 2024-09-12T18:01:03.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.907+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.K6bkP0656pKWB2JTU9XBsVh1iDyRvog_0 2024-09-12T18:01:03.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.907+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8946210180165090128', time=2024-09-12T19:53:22.397811+0000, chain.objs.size()=1 2024-09-12T18:01:03.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.907+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZwKL8kwtksxfJQZjC2sn6mO67f3c6rZ_0 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.909+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14174537145281379161', time=2024-09-12T19:53:22.419097+0000, chain.objs.size()=1 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.909+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qyR57B6g3bzeWP882w90TH4lufa2PUy_0 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.909+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11357652251709428565', time=2024-09-12T19:53:22.439493+0000, chain.objs.size()=1 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.909+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FRvl3Hogtvgk87E-s_TIiEuLkg2AzRB_0 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.909+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6681976464342369414', time=2024-09-12T19:53:22.477464+0000, chain.objs.size()=1 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6-1YpKWbtrVvz8gy8qICObPCjvjDgR2_0 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9991496568134892783', time=2024-09-12T19:53:22.500617+0000, chain.objs.size()=1 2024-09-12T18:01:03.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oXM0U8UMl3EpjmlJPA8IJLAdxnijhtb_0 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11313965534026352949', time=2024-09-12T19:53:22.583556+0000, chain.objs.size()=1 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.l2KcYgRqB_rFCVaxbfb5xpOskz1otPI_0 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7313288141981747138', time=2024-09-12T19:53:22.600254+0000, chain.objs.size()=1 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hNXdMcOulQZsP6pKqwTj3Q00tOgJ-D9_0 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5650607264446672857', time=2024-09-12T19:53:22.634684+0000, chain.objs.size()=1 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.u6IbWjJko3qOdAheJwH8g9iazqVf7d2_0 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7611688275637925325', time=2024-09-12T19:53:24.070788+0000, chain.objs.size()=1 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.270__shadow_.QBvtTwdu6S1-NKikYKR3DgfsKR23vxb_0 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15825565902255315343', time=2024-09-12T19:53:24.661780+0000, chain.objs.size()=1 2024-09-12T18:01:03.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.273__shadow_.GMTT0-Z2MVb3Qwv1vm9_9d6epGs7oF9_0 2024-09-12T18:01:03.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12173916003556979530', time=2024-09-12T19:53:26.568008+0000, chain.objs.size()=1 2024-09-12T18:01:03.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.910+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.282__shadow_.ZxygPyhFtojRyG9-FeSQUj0aR4z_oEU_0 2024-09-12T18:01:03.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.914+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6830724337368787818', time=2024-09-12T19:53:26.980764+0000, chain.objs.size()=1 2024-09-12T18:01:03.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.914+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.284__shadow_.MEVBrD_acBIn5_viUr4Vae8f0-c2IAN_0 2024-09-12T18:01:03.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9005285594035260078', time=2024-09-12T19:53:29.950725+0000, chain.objs.size()=1 2024-09-12T18:01:03.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.dNdqHfLfdn5SoXJs0V-jzP-dN14iMvO_0 2024-09-12T18:01:03.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10762230441315448744', time=2024-09-12T19:53:32.634537+0000, chain.objs.size()=1 2024-09-12T18:01:03.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.306__shadow_.Srpokhrvd13LKSzaXf5TmN_gxHMzoNH_0 2024-09-12T18:01:03.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8219165230150591820', time=2024-09-12T19:53:36.059231+0000, chain.objs.size()=1 2024-09-12T18:01:03.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.323__shadow_.nQ7lgaS7sludqrhJtQqRaOPoimVrWw__0 2024-09-12T18:01:03.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2493148579634738598', time=2024-09-12T19:53:44.531043+0000, chain.objs.size()=1 2024-09-12T18:01:03.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Da0rvTtNN6PeAq_7HeT3OdnCqQvQevc_0 2024-09-12T18:01:03.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13407089630699242119', time=2024-09-12T19:53:44.537299+0000, chain.objs.size()=1 2024-09-12T18:01:03.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-1zJ2Og68exhOEo5STwAgEKby-9Zwxl_0 2024-09-12T18:01:03.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7281076060389870530', time=2024-09-12T19:53:44.545138+0000, chain.objs.size()=1 2024-09-12T18:01:03.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nm2Xtq9mNHVUI57wdn98Mhn7HmqBq6O_0 2024-09-12T18:01:03.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14156736801790430473', time=2024-09-12T19:53:44.557608+0000, chain.objs.size()=1 2024-09-12T18:01:03.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.v4ifqJvSXo5XakSrr4ZfkggegYk4lFs_0 2024-09-12T18:01:03.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1319967256713591092', time=2024-09-12T19:53:44.619088+0000, chain.objs.size()=1 2024-09-12T18:01:03.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.p900TYP2AqJ-NOVpDyeSeI-5_8IjAQd_0 2024-09-12T18:01:03.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8962624479618578620', time=2024-09-12T19:53:44.636319+0000, chain.objs.size()=1 2024-09-12T18:01:03.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZD7zmmjsvsEh-FJvL7ReuQwZ_JavvgX_0 2024-09-12T18:01:03.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6925733279316065614', time=2024-09-12T19:53:44.637563+0000, chain.objs.size()=1 2024-09-12T18:01:03.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.916+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ATEBbNiLPcQlGeXzOdLZtQ-3-A0xc69_0 2024-09-12T18:01:03.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.918+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.51668575284796085', time=2024-09-12T19:53:44.964569+0000, chain.objs.size()=1 2024-09-12T18:01:03.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.918+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.aR9W5IdB0qaWrspbderiz3MbUJM0_qj_0 2024-09-12T18:01:03.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.972922520470704100', time=2024-09-12T19:53:44.992674+0000, chain.objs.size()=1 2024-09-12T18:01:03.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0Gi5MmVGPzBPHHR_S3ciZvf44miVdiW_0 2024-09-12T18:01:03.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17399254169885084163', time=2024-09-12T19:53:45.021109+0000, chain.objs.size()=1 2024-09-12T18:01:03.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qV4ZVnE-7ZcU8tiliJ8uFv6p7Ta08Sl_0 2024-09-12T18:01:03.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14042221877002293815', time=2024-09-12T19:53:45.146383+0000, chain.objs.size()=1 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LVsyA9T6wvXeXzMtcF9YDZ2jvhlOBFA_0 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3066752182712477744', time=2024-09-12T19:53:45.168043+0000, chain.objs.size()=1 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nzIEiNHsShFY73XShghJyfR-k2-l9Lg_0 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9554491575462514930', time=2024-09-12T19:53:45.197173+0000, chain.objs.size()=1 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.co23RUftsRPZFyKCEukiNsTsss5rLZE_0 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18298777388333221717', time=2024-09-12T19:53:45.198132+0000, chain.objs.size()=1 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TzGnULjUH5tnamfBuJ1stjX424J9pOb_0 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1712351049028203608', time=2024-09-12T19:53:45.204758+0000, chain.objs.size()=1 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zpB-kCGAof0fQC1xGu3ZnH-Z6MULBZd_0 2024-09-12T18:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1971405252764716682', time=2024-09-12T19:53:45.369219+0000, chain.objs.size()=1 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.aw9LauNlsJMdW7eoriZl8fsp2m5mRl4_0 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8252691019374669772', time=2024-09-12T19:53:45.375290+0000, chain.objs.size()=1 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.61eb6hyIxY-Nyij5oEHQovAQNq48OXS_0 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17979656750807439647', time=2024-09-12T19:53:45.378524+0000, chain.objs.size()=1 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.i6EB37WszTS6ZwsxrYXcnbD4u_xTTdT_0 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2393577799112387585', time=2024-09-12T19:53:45.379375+0000, chain.objs.size()=1 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DCNaMQi-hsKcyhDwzSW49VdzWfVa58a_0 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.925+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4353041401012127', time=2024-09-12T19:53:45.393611+0000, chain.objs.size()=1 2024-09-12T18:01:03.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.925+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.R0DOVabHSwULBsfQn27dDGA6S4t4YBY_0 2024-09-12T18:01:03.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.926+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18206740400180541376', time=2024-09-12T19:53:45.400572+0000, chain.objs.size()=1 2024-09-12T18:01:03.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.926+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VS0jyv5t4XHg3yyaX3xIPmgJvjA3P0f_0 2024-09-12T18:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1174581415906571228', time=2024-09-12T19:53:45.406427+0000, chain.objs.size()=1 2024-09-12T18:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1cNOvXoST7IMH-UEe7dsn46ynob3i-g_0 2024-09-12T18:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8498763512004493015', time=2024-09-12T19:53:45.437410+0000, chain.objs.size()=1 2024-09-12T18:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YFejUim0oPyhpbzZkxxBBCPfRdq4Z0r_0 2024-09-12T18:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4646042714231874158', time=2024-09-12T19:53:45.444353+0000, chain.objs.size()=1 2024-09-12T18:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pD9nmq8VTzjgUCK21maSTw3Ols9-njU_0 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17325837494583852847', time=2024-09-12T19:53:45.446222+0000, chain.objs.size()=1 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iIiuWJmGy8-u74jot39ZU-9FGbYpCA9_0 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8653650539066292183', time=2024-09-12T19:53:45.447633+0000, chain.objs.size()=1 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.grgHXVVJ1d_blf4x8nh-FvuRhFFZjjV_0 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17924730000720169814', time=2024-09-12T19:53:45.539807+0000, chain.objs.size()=1 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jcbsRiceBj7efMps9CXD-Pa7wxj3UK8_0 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8448954727947124350', time=2024-09-12T19:53:45.543762+0000, chain.objs.size()=1 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.D6n8UAVAzDJbFd6LqE_QigH4PMu_YSv_0 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7087667140134781374', time=2024-09-12T19:53:45.572621+0000, chain.objs.size()=1 2024-09-12T18:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ta08lxGjmNqp7AVEfqZXadyaPpQMNsN_0 2024-09-12T18:01:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8115921779320781752', time=2024-09-12T19:53:45.574781+0000, chain.objs.size()=1 2024-09-12T18:01:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KiVCxtgXU5Zopc5aYuwZ1FphTZdK9O2_0 2024-09-12T18:01:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7975268950054959635', time=2024-09-12T19:53:45.584615+0000, chain.objs.size()=1 2024-09-12T18:01:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YVJenuHSCAO1w-5lY_t_eS5dKsA8epx_0 2024-09-12T18:01:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16904776945445833904', time=2024-09-12T19:53:45.599921+0000, chain.objs.size()=1 2024-09-12T18:01:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.930+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.psveDcs7dEbyl2Jt9-lwFWDKoXd684o_0 2024-09-12T18:01:03.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12863405461352110510', time=2024-09-12T19:53:45.656013+0000, chain.objs.size()=1 2024-09-12T18:01:03.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Nt7swLQlvucKN-0jnj_H_pCSjQgRjlz_0 2024-09-12T18:01:03.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15468013727617820066', time=2024-09-12T19:53:45.759917+0000, chain.objs.size()=1 2024-09-12T18:01:03.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.X0xMHMqHSoiNtNTK0jWEH_dvLSX5U9i_0 2024-09-12T18:01:03.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12311094265137164548', time=2024-09-12T19:53:45.771861+0000, chain.objs.size()=1 2024-09-12T18:01:03.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IO7NVDkJq5i0rXFG0oLdndr0hWTAc5S_0 2024-09-12T18:01:03.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8633823689592748779', time=2024-09-12T19:53:45.774387+0000, chain.objs.size()=1 2024-09-12T18:01:03.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.936+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fobVecXpB6p85ztgpFDGz9BOte_NFWR_0 2024-09-12T18:01:03.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1070563546348369406', time=2024-09-12T19:53:45.820393+0000, chain.objs.size()=1 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RFtUzW8RE9ZLb3zwzVwW4R9Pn2XcQ4i_0 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8726883212233692747', time=2024-09-12T19:53:45.834144+0000, chain.objs.size()=1 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bpJagiOo3ffqL4-eoXdey33Nw5zMLcR_0 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15556789476484863422', time=2024-09-12T19:53:45.847413+0000, chain.objs.size()=1 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UJ83ySL_NngpTYX7cz-p9w2GyjCSGan_0 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6730669173086725872', time=2024-09-12T19:53:45.984361+0000, chain.objs.size()=1 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JmaMF6K8RmpuKqyUO1sL0RGVCRg0KhN_0 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6602171862110763649', time=2024-09-12T19:53:46.011665+0000, chain.objs.size()=1 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.937+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8F3TVH8Em5bZcPif6XFBc-MiFnEjFG9_0 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.938+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11522358254290576042', time=2024-09-12T19:53:46.142688+0000, chain.objs.size()=1 2024-09-12T18:01:03.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.938+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5p_OMcRVAAM6wws5QuJ6oPoMrwQu5oz_0 2024-09-12T18:01:03.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.938+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5915663512904644457', time=2024-09-12T19:53:46.173081+0000, chain.objs.size()=1 2024-09-12T18:01:03.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.938+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5Cj-QJloW_mC1JwF1imJ0jrcZF1IiDj_0 2024-09-12T18:01:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.304221938664599617', time=2024-09-12T19:53:46.208034+0000, chain.objs.size()=1 2024-09-12T18:01:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ou-zaYE7UIYJK7yI3Sm1BNB4zXW4RIL_0 2024-09-12T18:01:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15641169362791878637', time=2024-09-12T19:53:46.232504+0000, chain.objs.size()=1 2024-09-12T18:01:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Bx98m2tUYq_TtEoT8e1BTIBfZzK_vsd_0 2024-09-12T18:01:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16074110049794167925', time=2024-09-12T19:53:54.690372+0000, chain.objs.size()=1 2024-09-12T18:01:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LwbMDIoiKMfyBB86AkhdNEBAyEvNlgY_0 2024-09-12T18:01:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15837279512196924191', time=2024-09-12T19:53:54.695306+0000, chain.objs.size()=1 2024-09-12T18:01:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.941+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MuA5QXlLXHbtw1lzkRrJZi3LG7Sne_f_0 2024-09-12T18:01:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3761123795955284127', time=2024-09-12T19:53:54.705286+0000, chain.objs.size()=1 2024-09-12T18:01:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.R1T9BrUUAEqBm0x0BsCSxIZM0yoeIGp_0 2024-09-12T18:01:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18227041709814202400', time=2024-09-12T19:53:54.732901+0000, chain.objs.size()=1 2024-09-12T18:01:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9samThB1OmfJqXduE_tJNlRZfFuXzGM_0 2024-09-12T18:01:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15566491215659481555', time=2024-09-12T19:53:54.744904+0000, chain.objs.size()=1 2024-09-12T18:01:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.o5CqOzSLyPFYTl0E0yCCtYeBdftNS7t_0 2024-09-12T18:01:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2716623427511353945', time=2024-09-12T19:53:54.758598+0000, chain.objs.size()=1 2024-09-12T18:01:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.942+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FBVlmBqMzT0PYMcFAmkTDDoPsjw5IlU_0 2024-09-12T18:01:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.943+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10849175656501253158', time=2024-09-12T19:53:54.845164+0000, chain.objs.size()=1 2024-09-12T18:01:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.943+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-5gqYKHriOiocxHo9P3w6pX0EXrH_c4_0 2024-09-12T18:01:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.944+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8737641901738817479', time=2024-09-12T19:53:54.868804+0000, chain.objs.size()=1 2024-09-12T18:01:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.944+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aBvOesnEmMwk06xE92TMM4-ao8jalUn_0 2024-09-12T18:01:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.944+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9040372274636197839', time=2024-09-12T19:53:55.258181+0000, chain.objs.size()=1 2024-09-12T18:01:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.944+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ptrUzyByute2ysvNI8wneY1g8QeoBiZ_0 2024-09-12T18:01:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.949+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/48355 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8581191479314630304', time=2024-09-12T19:53:55.315559+0000, chain.objs.size()=1 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aeD8zLFyV15MfOKU1lbHALffo7YBODf_0 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.677094340732229423', time=2024-09-12T19:53:55.335538+0000, chain.objs.size()=1 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._epfxTZyCkP2KxspTbSTb3AD-ogV11q_0 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14401992239217851294', time=2024-09-12T19:53:55.354868+0000, chain.objs.size()=1 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6xPL6-DwW6NJKk1MwQist0TYHysfv0H_0 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16260076987618953065', time=2024-09-12T19:53:55.382407+0000, chain.objs.size()=1 2024-09-12T18:01:03.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.PKt61-1EI_OggHPwN1UNlcFWUOw_YXa_0 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17430012655665251007', time=2024-09-12T19:53:55.714331+0000, chain.objs.size()=1 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.224_BGWFck-XZUDIy7ajet1RcOSN7wK_0 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11617326784574329284', time=2024-09-12T19:53:55.750546+0000, chain.objs.size()=1 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.q4yvgwNJSv4F5jdrc3kUZis_Kn-PhzS_0 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13565769040481252827', time=2024-09-12T19:53:55.760687+0000, chain.objs.size()=1 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VystCACLhp6XO7ZG6Vy7PwkqFHtkn_1_0 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4876166167676369071', time=2024-09-12T19:53:55.773066+0000, chain.objs.size()=1 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.thhMSs3Br0AiDSFCkvTMZ0kyp511Fg7_0 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3679143518064600554', time=2024-09-12T19:53:55.910469+0000, chain.objs.size()=1 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.x27MA8sYM-v_CD7bdgHAPF_1ZNll4wZ_0 2024-09-12T18:01:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16665302065985633742', time=2024-09-12T19:53:55.920215+0000, chain.objs.size()=1 2024-09-12T18:01:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.B5VQIe4GKRqOelxDz_XepsRBM37zlhr_0 2024-09-12T18:01:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5654547970728172201', time=2024-09-12T19:53:55.994482+0000, chain.objs.size()=1 2024-09-12T18:01:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.o8ZdwxZK6QZDuObukYkEWI4rtCGLY4o_0 2024-09-12T18:01:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17253429903975564825', time=2024-09-12T19:53:56.149657+0000, chain.objs.size()=1 2024-09-12T18:01:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ntNKqLV_uel1a0rFGNJpdGyjbW9oNGt_0 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10637250255041600721', time=2024-09-12T19:53:56.150491+0000, chain.objs.size()=1 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GmNzZ9kOGfuhMWjhR8HwWYImj9FOjIc_0 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4709982923156023847', time=2024-09-12T19:54:19.216465+0000, chain.objs.size()=1 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.433__shadow_.yxA5oIfa4oPQdiTVXEd4j-V18yZqWRk_0 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10767441711945048662', time=2024-09-12T19:54:20.444593+0000, chain.objs.size()=1 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.438__shadow_.eDGcHZQACxAwG07yVEHKB7IIQRiyEwx_0 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3922985090586192564', time=2024-09-12T19:54:28.360435+0000, chain.objs.size()=1 2024-09-12T18:01:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.467__shadow_.YI7rYAioYa4lb83Ulho75WHzGdI-bEL_0 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15652809322057951397', time=2024-09-12T19:54:32.605283+0000, chain.objs.size()=1 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.489__shadow_.NNeITAalRJdE9nSRlp2rvVg4Z_ByqO6_0 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16396188892816630538', time=2024-09-12T19:54:34.020525+0000, chain.objs.size()=1 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.496__shadow_.Wmkq87Lc7WOZShO1DUogxOd8RcPPIBy_0 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.61265110559705395', time=2024-09-12T19:54:38.468491+0000, chain.objs.size()=1 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.512__multipart_mymultipart.2~vUATVGA8rUIN7lhFHXfC0_cK5B_6U2K.1 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14893036252535171522', time=2024-09-12T19:54:49.443844+0000, chain.objs.size()=12 2024-09-12T18:01:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.DzTn1p_0Dz0IkRh9zmwTXD8hKrkaAIXr.1 2024-09-12T18:01:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.DzTn1p_0Dz0IkRh9zmwTXD8hKrkaAIXr.1_1 2024-09-12T18:01:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.giYQwN-bhNaJWCnpePw_-1ICBOtLNH8g.2 2024-09-12T18:01:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.957+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.giYQwN-bhNaJWCnpePw_-1ICBOtLNH8g.2_1 2024-09-12T18:01:03.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.959+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.e16yuM_5_WhjJcD7Kd9Aoq0WfGI21fNe.3 2024-09-12T18:01:03.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.959+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.e16yuM_5_WhjJcD7Kd9Aoq0WfGI21fNe.3_1 2024-09-12T18:01:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.961+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.0-ke0Z_y6ZKimyl_lylEIL7fgSEnMWhp.4 2024-09-12T18:01:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.961+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.0-ke0Z_y6ZKimyl_lylEIL7fgSEnMWhp.4_1 2024-09-12T18:01:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.961+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.HYX74M8gJnsreJPvR7eFqUW2yjcEZavE.5 2024-09-12T18:01:03.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.HYX74M8gJnsreJPvR7eFqUW2yjcEZavE.5_1 2024-09-12T18:01:03.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.rgF6bTJUagia-fj53a8pUEGVovYf1TRN.6 2024-09-12T18:01:03.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.rgF6bTJUagia-fj53a8pUEGVovYf1TRN.6_1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16801557486491101558', time=2024-09-12T19:54:51.030066+0000, chain.objs.size()=1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~diW8SMropL3bBBzvZvnjb2GMQM6gZoW.1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZlgGAih3CnClORcnDcpv0DBWrCFVcyZ', time=2024-09-12T19:54:54.356445+0000, chain.objs.size()=1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.532__multipart_mymultipart.2~ZlgGAih3CnClORcnDcpv0DBWrCFVcyZ.1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1580781614099013745', time=2024-09-12T19:55:24.028516+0000, chain.objs.size()=1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.555__shadow_.UFB81ljKKp-2KWUH7pSW12HT8iDTxum_0 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7914938384447457098', time=2024-09-12T19:55:42.956184+0000, chain.objs.size()=1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:.VxqQ7K2IgIwaj2h7c9zHelevNgHN5o_.nR36-okWQTElWP3OrvuUl_0_6hvp8Ea_0 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12385819814047060699', time=2024-09-12T19:55:49.982953+0000, chain.objs.size()=1 2024-09-12T18:01:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:3QCkSRZVE30Ql-Wkq9r9osUsiQLp3J7_.btALrsGaxIqznuLo31X2wBEc6OmXDjj_0 2024-09-12T18:01:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.967+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7842158361425573486', time=2024-09-12T19:56:01.064946+0000, chain.objs.size()=4 2024-09-12T18:01:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.967+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~9zOZ8kXr3oTeEhlDPnjilAZ8PJI2IM3.1 2024-09-12T18:01:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.967+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~9zOZ8kXr3oTeEhlDPnjilAZ8PJI2IM3.2 2024-09-12T18:01:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.969+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~9zOZ8kXr3oTeEhlDPnjilAZ8PJI2IM3.3 2024-09-12T18:01:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~9zOZ8kXr3oTeEhlDPnjilAZ8PJI2IM3.4 2024-09-12T18:01:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.970+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3747246948677204441', time=2024-09-12T19:56:05.202473+0000, chain.objs.size()=1 2024-09-12T18:01:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:69rBcJrpOj6Ba4MvP6rq4Ppi8oloC6O_.eBTKKf-LrRjbKrkUcAiQoYqXQuIhJOs_0 2024-09-12T18:01:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.970+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14385413458409649820', time=2024-09-12T19:58:22.206111+0000, chain.objs.size()=1 2024-09-12T18:01:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.641__shadow_.4Q0l0Era6-IQMrrbpBpG5sreYokXEm3_0 2024-09-12T18:01:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.970+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12509496733835909864', time=2024-09-12T19:58:31.614214+0000, chain.objs.size()=1 2024-09-12T18:01:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.671__shadow_.9atV5eQOll_Q1o3z9nERSo956nU7xxu_0 2024-09-12T18:01:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.973+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.976+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:01:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.977+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54935' 2024-09-12T18:01:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_-L1kNBsn063M_zc0e9gqLJ8PaFj59NI', time=2024-09-12T19:51:58.528058+0000, chain.objs.size()=1 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.GxbsWSSSZe5rAWvw79yCShOPPV4hsAI_0 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15423854351527506897', time=2024-09-12T19:53:07.910810+0000, chain.objs.size()=1 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.238__shadow_.O8S9A8obQ6Q78tCoT1ltl6UPPpHuxhs_0 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9126590367643570565', time=2024-09-12T19:53:08.171928+0000, chain.objs.size()=1 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.239__shadow_.cTIl8pcNcQyEdVQe3GWaB5_fR73aIKC_0 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3361133277860616153', time=2024-09-12T19:53:11.212134+0000, chain.objs.size()=1 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.253__shadow_.EW6Ts_snk6uUSIeKYJ8gyJ5IPLDtH-v_0 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15058334136306222559', time=2024-09-12T19:53:21.190505+0000, chain.objs.size()=1 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.57phpCiNU-f129QFpKamZLxwOv5mYmN_0 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11987626801076681333', time=2024-09-12T19:53:21.226984+0000, chain.objs.size()=1 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HirS8Fr6OcTnxff50QFsVoV6ADpR41F_0 2024-09-12T18:01:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2541267119772944646', time=2024-09-12T19:53:21.286747+0000, chain.objs.size()=1 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2-Y5YZFMqJ7jfLlJ6dsFaeUX5aY_Drl_0 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7460359721251962419', time=2024-09-12T19:53:21.373427+0000, chain.objs.size()=1 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6rxg1pD2qyDzuKda5ZhsjD-PU2eGA8G_0 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8566398622160774409', time=2024-09-12T19:53:21.403099+0000, chain.objs.size()=1 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kEDXaWBQkbojkhRcotJihycIe8b4VWi_0 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.915100879642609523', time=2024-09-12T19:53:21.461908+0000, chain.objs.size()=1 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aMQdiPZOOJV4a9z9gOWkpemodYGA43b_0 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6129042593928507519', time=2024-09-12T19:53:21.632383+0000, chain.objs.size()=1 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.S8YE8Dq9JFYruKnUk509TWRN1olIZ8Q_0 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4024128593065382157', time=2024-09-12T19:53:21.633580+0000, chain.objs.size()=1 2024-09-12T18:01:03.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ABLUMlBPYjMFPuh-Mu-6MoZP-yG0sE4_0 2024-09-12T18:01:03.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.981+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14319738932414557401', time=2024-09-12T19:53:21.635543+0000, chain.objs.size()=1 2024-09-12T18:01:03.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.981+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.264WRAYQvG1pslVmutO3yM1Va17N-XR_0 2024-09-12T18:01:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9486704688564200502', time=2024-09-12T19:53:21.668525+0000, chain.objs.size()=1 2024-09-12T18:01:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zK3U1jGvGVckYtyr8kwMJfQcZBLmGyq_0 2024-09-12T18:01:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12125187846022628595', time=2024-09-12T19:53:21.673570+0000, chain.objs.size()=1 2024-09-12T18:01:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0QiJIrRZnAdH1oeip8sfdXyGpFkAFjY_0 2024-09-12T18:01:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11404201344828970052', time=2024-09-12T19:53:21.679207+0000, chain.objs.size()=1 2024-09-12T18:01:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ge8jYLWPzNOufmhjNBtd6-FILxXGGeb_0 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9235692038646983585', time=2024-09-12T19:53:21.779559+0000, chain.objs.size()=1 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iKHvxFzNSD7IdPV-64qXMegkbLxiAya_0 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12780690583686434709', time=2024-09-12T19:53:21.839815+0000, chain.objs.size()=1 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jrFz-ysyr4gk5fmzRDc-FpSOl25RQCp_0 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14646245113911221388', time=2024-09-12T19:53:21.870500+0000, chain.objs.size()=1 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tMeJpCSRyfl1B5lGFaYkLqtRfvM_FZa_0 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12830190561473629268', time=2024-09-12T19:53:21.978292+0000, chain.objs.size()=1 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.V3SQWV5wEn35mKXEwJo1hB5z6z9Os9a_0 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4953815753203254888', time=2024-09-12T19:53:21.982504+0000, chain.objs.size()=1 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hnLIMroJVmS9eRfxXDm9FBIcemNNqvt_0 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.89629773289760979', time=2024-09-12T19:53:21.985874+0000, chain.objs.size()=1 2024-09-12T18:01:03.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.z1SccFHhMIN2OAWw_69vEMhpo8bsSJH_0 2024-09-12T18:01:03.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13243711169948197406', time=2024-09-12T19:53:21.999110+0000, chain.objs.size()=1 2024-09-12T18:01:03.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AxBZPPYyAenihUsobaRLU4XFO9l65IO_0 2024-09-12T18:01:03.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3920948431221439258', time=2024-09-12T19:53:22.102767+0000, chain.objs.size()=1 2024-09-12T18:01:03.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fcu3ABBTgpu4RgNCKFLGzWxIrUtF262_0 2024-09-12T18:01:03.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5665270412573150746', time=2024-09-12T19:53:22.255085+0000, chain.objs.size()=1 2024-09-12T18:01:03.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3zMUNJbQVyCdgfCPlOICuWXh3bpQpAU_0 2024-09-12T18:01:03.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2142356205991078774', time=2024-09-12T19:53:22.274602+0000, chain.objs.size()=1 2024-09-12T18:01:03.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CAcAwWqcxLpOt50utHz8h1HktPtBNk-_0 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.415297617854533314', time=2024-09-12T19:53:22.301195+0000, chain.objs.size()=1 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.u_Df_tcnCGKUVRAQzuCD_wrG1uolQRi_0 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10213872445539620874', time=2024-09-12T19:53:22.459230+0000, chain.objs.size()=1 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oMZEirgqu2AtqFQ2KII63bQ8sEIJe6A_0 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16549578051197380894', time=2024-09-12T19:53:22.465525+0000, chain.objs.size()=1 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DZMKmUgB7kg09lNG3PBUuzcOLNV8BtL_0 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3359883041751803677', time=2024-09-12T19:53:22.471287+0000, chain.objs.size()=1 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RlokqkQdVgOdyYvKSlKizgMZAKFl1yL_0 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10891733600706247', time=2024-09-12T19:53:22.479098+0000, chain.objs.size()=1 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._yF1qEkUd1ZSVRazTuQD7dcufBCpJNa_0 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11931500624741317004', time=2024-09-12T19:53:22.479833+0000, chain.objs.size()=1 2024-09-12T18:01:03.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wd61CZsJonesi76SNCy7MJOHGxolxjO_0 2024-09-12T18:01:03.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15051175029078122674', time=2024-09-12T19:53:22.496601+0000, chain.objs.size()=1 2024-09-12T18:01:03.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wDTGncBKP_k0ksRe8phi_VpCs5zk1DU_0 2024-09-12T18:01:03.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3458985830385418312', time=2024-09-12T19:53:22.594274+0000, chain.objs.size()=1 2024-09-12T18:01:03.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6Rl2mwsBJovU55FzUTY1uo1YP2JJnWS_0 2024-09-12T18:01:03.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.323911951556778314', time=2024-09-12T19:53:22.595866+0000, chain.objs.size()=1 2024-09-12T18:01:03.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.990+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QqJU_CBAJ551erpz32vHfu4PW_0CMA9_0 2024-09-12T18:01:03.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7915326435631830551', time=2024-09-12T19:53:22.599353+0000, chain.objs.size()=1 2024-09-12T18:01:03.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JAyw4lK-2PUofDGQVUxRGqlGcv1vDwk_0 2024-09-12T18:01:03.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5774195393681775478', time=2024-09-12T19:53:22.654173+0000, chain.objs.size()=1 2024-09-12T18:01:03.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PwbykaBoQrXn75Dxmmg16KUdv9xH5jD_0 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6165145748771430541', time=2024-09-12T19:53:24.858098+0000, chain.objs.size()=1 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.274__shadow_.WaSjYy9R-2jx2JlJic53JEk6gHcSYKR_0 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.645572341230954353', time=2024-09-12T19:53:26.322511+0000, chain.objs.size()=1 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.281__shadow_.JABhMct6maTxngZG57Qn-unAL-JSZ2o_0 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13785743108281701757', time=2024-09-12T19:53:28.339159+0000, chain.objs.size()=1 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.290__shadow_.d45egD1T4Xr-6Q9TWYtEQbLPZUSAaOe_0 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.36152113558250516', time=2024-09-12T19:53:28.339894+0000, chain.objs.size()=1 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.290__shadow_.dtRi7Zu1IzMl0r3eCx26kvUp-Lw5LoH_0 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6677251001265263962', time=2024-09-12T19:53:29.936675+0000, chain.objs.size()=1 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.TDpVjaulhXjGcTC7kFQxb44-_XN0O_z_0 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17366714231546514886', time=2024-09-12T19:53:31.526050+0000, chain.objs.size()=1 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.301__shadow_.8XyaIhQXnb6ZvGx7EnqVOq0aOGM8enl_0 2024-09-12T18:01:03.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.650770939460381118', time=2024-09-12T19:53:33.479581+0000, chain.objs.size()=1 2024-09-12T18:01:04.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.308__shadow:YwDv0bKVyTi.zh3aJ4y15r4JPOfBJTQ_.G0Cb51BTqgcbzm2zBVgexr9EqW0vi-p_0 2024-09-12T18:01:04.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14604988170583323899', time=2024-09-12T19:53:44.526177+0000, chain.objs.size()=1 2024-09-12T18:01:04.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UNZq6oTkkKpkO23qzf5Y5MRIoKL33MG_0 2024-09-12T18:01:04.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17282318990611277527', time=2024-09-12T19:53:44.528188+0000, chain.objs.size()=1 2024-09-12T18:01:04.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:03.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JdxrdK27T2VOBr6EXMBt93SxBrL8QId_0 2024-09-12T18:01:04.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.000+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2036755373046361209', time=2024-09-12T19:53:44.573504+0000, chain.objs.size()=1 2024-09-12T18:01:04.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.000+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1bJOPJ1gnG_qTOP8ZKbEviSOeS7Hoo-_0 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.001+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159963531300471071', time=2024-09-12T19:53:44.581201+0000, chain.objs.size()=1 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.001+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KK2bzcTlU1D2aBGTmf4GAx-DAY-GLt7_0 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7867152041154342426', time=2024-09-12T19:53:44.592962+0000, chain.objs.size()=1 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Wu1g589mOtTUPYLYRHm-NgjiQ-d_MDn_0 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4011833405641043243', time=2024-09-12T19:53:44.613916+0000, chain.objs.size()=1 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.EHrVxbv0-yoAj7u0HE_yoES6JaBcyFP_0 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9323026973625030239', time=2024-09-12T19:53:44.614777+0000, chain.objs.size()=1 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zkqcQSw-Bry7KHQRPETrHDyDvWXhXj-_0 2024-09-12T18:01:04.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6339170140221297509', time=2024-09-12T19:53:44.616841+0000, chain.objs.size()=1 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.k6lbu1wweveBsByFIbmLeM3mLdEUZN2_0 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8685739699879739524', time=2024-09-12T19:53:44.625393+0000, chain.objs.size()=1 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wY2rZCdeBGBmgKBRU_MXaQtQW_umVI-_0 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11131659502501511718', time=2024-09-12T19:53:44.631454+0000, chain.objs.size()=1 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tYmhjsirbKRUMub_RgVZFJxulT59hzv_0 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2605459784555364915', time=2024-09-12T19:53:44.843448+0000, chain.objs.size()=1 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.P-eGfdpx06knJAZ-qM1IuHLLvzuL5m8_0 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9338221439133619376', time=2024-09-12T19:53:44.932841+0000, chain.objs.size()=1 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.SLL4dul5Zh__E3WrvK__iQgVnCzKbpU_0 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3595364783706944500', time=2024-09-12T19:53:44.980711+0000, chain.objs.size()=1 2024-09-12T18:01:04.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.X1LAfZn72a-dkfEe4Mz4BlJq-Pz73ft_0 2024-09-12T18:01:04.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.005+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1751453624196517955', time=2024-09-12T19:53:44.992231+0000, chain.objs.size()=1 2024-09-12T18:01:04.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.005+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hFW5XvHcwzo5lqWzsWqVaNHP-7fQtfO_0 2024-09-12T18:01:04.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.005+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4067750007407182496', time=2024-09-12T19:53:45.008503+0000, chain.objs.size()=1 2024-09-12T18:01:04.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.005+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LbUBe2E2DjoMehlpBUL4hOLuoY5CxAR_0 2024-09-12T18:01:04.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.006+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12236849606003725493', time=2024-09-12T19:53:45.021847+0000, chain.objs.size()=1 2024-09-12T18:01:04.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.006+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MHoE3Vgv7nRpo5uP0Z8bR67xFIcuDIb_0 2024-09-12T18:01:04.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.006+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10645677164932218622', time=2024-09-12T19:53:45.129934+0000, chain.objs.size()=1 2024-09-12T18:01:04.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.006+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-H28hLo03njQ_3GbrdHoVGzYqi73k2C_0 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15370634602305417634', time=2024-09-12T19:53:45.132487+0000, chain.objs.size()=1 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JG6D5cARE68oKVUtyRdDejyzKM7tHU9_0 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3088631368304081354', time=2024-09-12T19:53:45.137966+0000, chain.objs.size()=1 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jzGK6hM5apoibDbLgXBYAwMZp8G5bZF_0 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1344246280504074815', time=2024-09-12T19:53:45.181943+0000, chain.objs.size()=1 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sbDb0OL6vxOzBopO83MpJfJDkFzfIy1_0 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12225066423489923998', time=2024-09-12T19:53:45.205535+0000, chain.objs.size()=1 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Q-4ohyoe-VDDIlE0vbAS48jAyjFoGQM_0 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2101236668332182843', time=2024-09-12T19:53:45.216034+0000, chain.objs.size()=1 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gOyQ-LP9p6h18iozefj1K6X62vlXTBc_0 2024-09-12T18:01:04.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17173945567076533568', time=2024-09-12T19:53:45.357195+0000, chain.objs.size()=1 2024-09-12T18:01:04.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sCNs7TyWAyKMwQUz0l52XCqYWacy9hP_0 2024-09-12T18:01:04.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17339123854399839776', time=2024-09-12T19:53:45.364267+0000, chain.objs.size()=1 2024-09-12T18:01:04.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RQz5_-9x4KCXsQccahSe1fk-0nTtsVA_0 2024-09-12T18:01:04.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.010+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14044214899157842161', time=2024-09-12T19:53:45.387191+0000, chain.objs.size()=1 2024-09-12T18:01:04.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.010+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.SeHzIJVMalCdGac_aM09apWPKJMQX-6_0 2024-09-12T18:01:04.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.010+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15691948138443910572', time=2024-09-12T19:53:45.448392+0000, chain.objs.size()=1 2024-09-12T18:01:04.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.010+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5B-yNSXMkkyNnHkhRVL0dBYvllcnpSv_0 2024-09-12T18:01:04.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.011+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15616723912011288320', time=2024-09-12T19:53:45.554586+0000, chain.objs.size()=1 2024-09-12T18:01:04.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.011+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.N1joQxvm0y8SCDWUCFwdb0HQGngJLvX_0 2024-09-12T18:01:04.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.011+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16519127239954632619', time=2024-09-12T19:53:45.583684+0000, chain.objs.size()=1 2024-09-12T18:01:04.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.011+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-ikCAJ7qizl-p6ptb6atHRb7ceNtGYR_0 2024-09-12T18:01:04.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.012+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3797239133568260212', time=2024-09-12T19:53:45.626954+0000, chain.objs.size()=1 2024-09-12T18:01:04.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.012+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VgJ-OME5TdL73Em-9CEsFeZU22TF8iM_0 2024-09-12T18:01:04.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.012+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10747573359877733774', time=2024-09-12T19:53:45.643519+0000, chain.objs.size()=1 2024-09-12T18:01:04.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.012+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gnXGNs3_cu6NaJAAv3G4bjLzGDcb-F7_0 2024-09-12T18:01:04.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.012+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10523278987173195055', time=2024-09-12T19:53:45.739992+0000, chain.objs.size()=1 2024-09-12T18:01:04.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.012+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Tfn8k2ilu-9_REFOp1K-9nPBnSgF9f4_0 2024-09-12T18:01:04.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16710765455891103413', time=2024-09-12T19:53:45.743235+0000, chain.objs.size()=1 2024-09-12T18:01:04.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pKsgupsFXUOJbi4npLTepuqGS-pVMB7_0 2024-09-12T18:01:04.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6889559254810693139', time=2024-09-12T19:53:45.745016+0000, chain.objs.size()=1 2024-09-12T18:01:04.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TWTtbTXp1137XAGs03bI2j4fA9XQXgb_0 2024-09-12T18:01:04.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10669022964483278082', time=2024-09-12T19:53:45.857471+0000, chain.objs.size()=1 2024-09-12T18:01:04.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.U5n6efiNDnTXb1O0qpyV-A4oiysyV2F_0 2024-09-12T18:01:04.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2346253157679182454', time=2024-09-12T19:53:45.863412+0000, chain.objs.size()=1 2024-09-12T18:01:04.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._RkNgwaSGqaPl1NpVtm3TmySlC_Vb-1_0 2024-09-12T18:01:04.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5270308200216987543', time=2024-09-12T19:53:45.940859+0000, chain.objs.size()=1 2024-09-12T18:01:04.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cvOaYyKOFDL6prS1grs5E0-VG0YydHD_0 2024-09-12T18:01:04.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18404723215078230085', time=2024-09-12T19:53:46.002155+0000, chain.objs.size()=1 2024-09-12T18:01:04.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uh2GCyN9wRXdDzIHRt0BuDrQ6XJj37b_0 2024-09-12T18:01:04.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7173412965580015799', time=2024-09-12T19:53:46.032508+0000, chain.objs.size()=1 2024-09-12T18:01:04.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.g2Tx-i0FseXmx--0JCL1vnmjZFYfEzU_0 2024-09-12T18:01:04.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2902001988867008433', time=2024-09-12T19:53:46.034763+0000, chain.objs.size()=1 2024-09-12T18:01:04.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7UYwLwxbt_mgNfv1o4oy8_gk1U_8hAI_0 2024-09-12T18:01:04.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8698367090591671173', time=2024-09-12T19:53:46.191761+0000, chain.objs.size()=1 2024-09-12T18:01:04.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.N__v2NXX5H-wDki9xy_M80JKOznx5_b_0 2024-09-12T18:01:04.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3465379035871906235', time=2024-09-12T19:53:46.206432+0000, chain.objs.size()=1 2024-09-12T18:01:04.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jnKt4J4_GbZ444vIJLOgDdmkDAimCj0_0 2024-09-12T18:01:04.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16162893042180239250', time=2024-09-12T19:53:46.210889+0000, chain.objs.size()=1 2024-09-12T18:01:04.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.017+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xQugbwLQe4cZmdlJKhfUmunC5nx6t0k_0 2024-09-12T18:01:04.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10340363217992200375', time=2024-09-12T19:53:54.655586+0000, chain.objs.size()=1 2024-09-12T18:01:04.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.arYgdMqttqNGvzXnO5JcyBhyerCHQL__0 2024-09-12T18:01:04.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5231964974766403055', time=2024-09-12T19:53:54.713722+0000, chain.objs.size()=1 2024-09-12T18:01:04.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HHd10OzyQSBB4yenzjgQOOi-m6f2xrT_0 2024-09-12T18:01:04.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15521043564784831921', time=2024-09-12T19:53:54.844657+0000, chain.objs.size()=1 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YwUCy3hTSevEydYv4hK9Hrwzu580Tkc_0 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9981442722638483511', time=2024-09-12T19:53:54.891836+0000, chain.objs.size()=1 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DCWTYjg7FWSLfS4DgQ1r-Y0OnXQ4rpF_0 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6326438771832432506', time=2024-09-12T19:53:54.931411+0000, chain.objs.size()=1 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LydHoySHer6Dglc-b-En416p5dffi3x_0 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15707108512382808334', time=2024-09-12T19:53:54.960938+0000, chain.objs.size()=1 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._uFa2AEu2xTJUMilOanals5C3Jrf33g_0 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.021+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12603713368376005610', time=2024-09-12T19:53:55.086972+0000, chain.objs.size()=1 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.021+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YxTqOomP7SJ6CiMGRMXSkzRFU0gpMVa_0 2024-09-12T18:01:04.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7437804715120265644', time=2024-09-12T19:53:55.096053+0000, chain.objs.size()=1 2024-09-12T18:01:04.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.iZiOr4nN0_ZGt_sJHdy_Bw-yyryyIf5_0 2024-09-12T18:01:04.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8112525730694207692', time=2024-09-12T19:53:55.100758+0000, chain.objs.size()=1 2024-09-12T18:01:04.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5geh44M9leEgP3pJ-rcQfaIUJ7Fh33m_0 2024-09-12T18:01:04.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.322563158076024', time=2024-09-12T19:53:55.117827+0000, chain.objs.size()=1 2024-09-12T18:01:04.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0TENrIVdWrtPPi3JvLYeJdRmU1Jzzul_0 2024-09-12T18:01:04.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1049314667172274885', time=2024-09-12T19:53:55.132744+0000, chain.objs.size()=1 2024-09-12T18:01:04.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.022+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.OEMdpMR2DUZElA8uhxMD6AHWH0ah9c0_0 2024-09-12T18:01:04.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.025+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15687000632409966732', time=2024-09-12T19:53:55.264576+0000, chain.objs.size()=1 2024-09-12T18:01:04.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.025+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1bm29B_IFdz5Y5Y6-NEL6-rFFh0ky-I_0 2024-09-12T18:01:04.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.025+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2086997222045098660', time=2024-09-12T19:53:55.277629+0000, chain.objs.size()=1 2024-09-12T18:01:04.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.025+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qyDk2GKiS24SBxnFgupOyXUpdDjO9NJ_0 2024-09-12T18:01:04.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.025+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.913778152508505579', time=2024-09-12T19:53:55.284555+0000, chain.objs.size()=1 2024-09-12T18:01:04.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.025+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._CO0qu8AY9DsHa7_mh3t0G_6DRFWKZc_0 2024-09-12T18:01:04.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.029+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/54935 2024-09-12T18:01:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-12T18:01:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11956354315358056233', time=2024-09-12T19:53:55.289438+0000, chain.objs.size()=1 2024-09-12T18:01:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.o5rydXVJKaV06P1KXKmYjsy8EDqYRLG_0 2024-09-12T18:01:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17614355853364935646', time=2024-09-12T19:53:55.306352+0000, chain.objs.size()=1 2024-09-12T18:01:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mBmTWf1SQ7s6aiS7BLaeMEruSOA6ZA0_0 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14118688552707085965', time=2024-09-12T19:53:55.326033+0000, chain.objs.size()=1 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.S72keL7FSUcNuCcqq__5jiUDVcuE59N_0 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.332975230256667317', time=2024-09-12T19:53:55.358295+0000, chain.objs.size()=1 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wf8m-xhj0AXfiBJqdITUN_1BCWDu9MD_0 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4773668021911343048', time=2024-09-12T19:53:55.374009+0000, chain.objs.size()=1 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yeqO_Bwu2bj65hNWuI_ldGEc3upMcpK_0 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4052722273833764279', time=2024-09-12T19:53:55.374809+0000, chain.objs.size()=1 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9LrhQfL4prfhdo86b-GSj5jEAwmxR16_0 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9225445933877518582', time=2024-09-12T19:53:55.521209+0000, chain.objs.size()=1 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ahH_k3YH6j40mHL3jRrm7fPBvSj29oU_0 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13917446132771605004', time=2024-09-12T19:53:55.614430+0000, chain.objs.size()=1 2024-09-12T18:01:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vDEXmNqBz6Co2hzekxQ9OFLts4e3vcc_0 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3940636369628180357', time=2024-09-12T19:53:55.717146+0000, chain.objs.size()=1 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.K41gTULh04g2OHexGaargUUUofwY7-v_0 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.149761025085202874', time=2024-09-12T19:53:55.745551+0000, chain.objs.size()=1 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DSWRgX0fyYNybRimWpLKseHkmc8wAV1_0 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15010980900904485733', time=2024-09-12T19:53:55.747494+0000, chain.objs.size()=1 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IEHTrFS1cRpc6cUoKhfxDzPMV8AFk_K_0 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7931306038043605977', time=2024-09-12T19:53:55.794444+0000, chain.objs.size()=1 2024-09-12T18:01:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.031+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FMRKjBbVZ_6LOm-LaUDU7pZIa5e2Cjr_0 2024-09-12T18:01:04.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.034+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12772097502358264121', time=2024-09-12T19:53:55.822329+0000, chain.objs.size()=1 2024-09-12T18:01:04.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.034+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.eIEPTyh-R-ZPTPz7_LVyM-S8xntW1Xk_0 2024-09-12T18:01:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6842802333039794865', time=2024-09-12T19:53:55.827878+0000, chain.objs.size()=1 2024-09-12T18:01:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.pGdvFAgRIpPBLd1nVo5mj_GnxmRlIXe_0 2024-09-12T18:01:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9594356298541649395', time=2024-09-12T19:53:55.943002+0000, chain.objs.size()=1 2024-09-12T18:01:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.AsZZX0swLrUYnISE6KlnP2eUn9X0-MM_0 2024-09-12T18:01:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10343364158747912424', time=2024-09-12T19:53:55.963588+0000, chain.objs.size()=1 2024-09-12T18:01:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8D_FNHtyYuqV1lLpZSb51naJTM75bYp_0 2024-09-12T18:01:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8874432043414614548', time=2024-09-12T19:53:55.989719+0000, chain.objs.size()=1 2024-09-12T18:01:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._NiaT5_Kl-ONhPOb6CSt509YONV34R__0 2024-09-12T18:01:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12004976377780010350', time=2024-09-12T19:53:55.996276+0000, chain.objs.size()=1 2024-09-12T18:01:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.035+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5d-VQN0drPlvi9sts5RJKNN81wp-lkd_0 2024-09-12T18:01:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6983343636164591333', time=2024-09-12T19:53:56.118712+0000, chain.objs.size()=1 2024-09-12T18:01:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ETeVPIk3LvTbzh0n0VejwGVIHTxDNIR_0 2024-09-12T18:01:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18209748990332867011', time=2024-09-12T19:53:56.169759+0000, chain.objs.size()=1 2024-09-12T18:01:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.F3VB-XXejmEs_J6YMFf_ia23zswwar__0 2024-09-12T18:01:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13178646325774246658', time=2024-09-12T19:53:56.175046+0000, chain.objs.size()=1 2024-09-12T18:01:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yD4u8SqD2oUT_DSNYOVJfAH1PQw_9XC_0 2024-09-12T18:01:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15592075563240381304', time=2024-09-12T19:53:56.175743+0000, chain.objs.size()=1 2024-09-12T18:01:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5nfkDcg5C4RJvaa-ZocXatOjoT9WK1-_0 2024-09-12T18:01:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8209203555373625308', time=2024-09-12T19:53:56.190059+0000, chain.objs.size()=1 2024-09-12T18:01:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.037+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gxKmIYQwJD0a-EI1THa8cF66enRoLlp_0 2024-09-12T18:01:04.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.039+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17492192721678010188', time=2024-09-12T19:53:57.903109+0000, chain.objs.size()=1 2024-09-12T18:01:04.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.039+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.334__shadow_.LT7adcn4sIGCvHdmRDpUt7NFRPiyEG6_0 2024-09-12T18:01:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.040+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6280788023249924044', time=2024-09-12T19:54:06.119592+0000, chain.objs.size()=1 2024-09-12T18:01:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.040+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.376__shadow_.L8UZNfRPeRAEDGa0hQvDusTN7777Bn9_0 2024-09-12T18:01:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.040+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10907234542441909716', time=2024-09-12T19:54:25.379906+0000, chain.objs.size()=1 2024-09-12T18:01:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.040+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.458__shadow_.ve1F_2-5tWsS6FoA8cR1SCrNwDtrZb1_0 2024-09-12T18:01:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14251113596914327765', time=2024-09-12T19:54:26.813790+0000, chain.objs.size()=1 2024-09-12T18:01:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.462__shadow_.uQzJghOo7XeQsBSTWHWJ6CGCS_kd_6M_0 2024-09-12T18:01:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2778158457402996910', time=2024-09-12T19:54:31.432597+0000, chain.objs.size()=1 2024-09-12T18:01:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.485__shadow_.7hiszVuV5R6NOB4jpZ7BLOiQEyh2qcS_0 2024-09-12T18:01:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5670224932343574084', time=2024-09-12T19:54:41.820936+0000, chain.objs.size()=6 2024-09-12T18:01:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.520__multipart_mymultipart.2~KOYWbZd_z9k8-5H14msKgUNWp2VcR6Y.1 2024-09-12T18:01:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.520__multipart_mymultipart.2~KOYWbZd_z9k8-5H14msKgUNWp2VcR6Y.2 2024-09-12T18:01:04.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.041+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.520__multipart_mymultipart.2~KOYWbZd_z9k8-5H14msKgUNWp2VcR6Y.3 2024-09-12T18:01:04.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.520__multipart_mymultipart.2~KOYWbZd_z9k8-5H14msKgUNWp2VcR6Y.4 2024-09-12T18:01:04.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.520__multipart_mymultipart.2~KOYWbZd_z9k8-5H14msKgUNWp2VcR6Y.5 2024-09-12T18:01:04.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.520__multipart_mymultipart.2~KOYWbZd_z9k8-5H14msKgUNWp2VcR6Y.6 2024-09-12T18:01:04.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.044+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5', time=2024-09-12T19:54:47.393039+0000, chain.objs.size()=1 2024-09-12T18:01:04.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.044+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5.2 2024-09-12T18:01:04.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.045+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5', time=2024-09-12T19:54:47.394593+0000, chain.objs.size()=1 2024-09-12T18:01:04.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.045+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5.3 2024-09-12T18:01:04.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15035885014831861402', time=2024-09-12T19:54:50.525517+0000, chain.objs.size()=2 2024-09-12T18:01:04.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~ln8dRSCUgKCYJA-L9AXWOAGvWtdYShr.1 2024-09-12T18:01:04.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~ln8dRSCUgKCYJA-L9AXWOAGvWtdYShr.2 2024-09-12T18:01:04.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614661387213625415', time=2024-09-12T19:55:22.750154+0000, chain.objs.size()=1 2024-09-12T18:01:04.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.552__shadow_.oY-VjQo8eIxtLkUs0ikJy1nlGFIhpCA_0 2024-09-12T18:01:04.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13548943780308558278', time=2024-09-12T19:55:25.890712+0000, chain.objs.size()=3 2024-09-12T18:01:04.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.LsYIQwxreJ6bwjmMzN00QFHWupQncR3_0 2024-09-12T18:01:04.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.LsYIQwxreJ6bwjmMzN00QFHWupQncR3_1 2024-09-12T18:01:04.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.047+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.LsYIQwxreJ6bwjmMzN00QFHWupQncR3_2 2024-09-12T18:01:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.471483436719978812', time=2024-09-12T19:55:38.727402+0000, chain.objs.size()=1 2024-09-12T18:01:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:Bk5hyv0iqMUdpRQkduBqJFLFkBfBVpF_.qF8B5UvRL6EZKDeHN3ZhKXJn-Fjdwic_0 2024-09-12T18:01:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1826022678305885831', time=2024-09-12T19:55:41.014818+0000, chain.objs.size()=1 2024-09-12T18:01:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow_.louRlBJNymcBjpgjWWxEeQqDQ1CSu-e_0 2024-09-12T18:01:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12690710641120291197', time=2024-09-12T19:55:52.716206+0000, chain.objs.size()=1 2024-09-12T18:01:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:jwtoHe.PfMBan89VXprIz-b90GiKdOr_.l9JNPyvzy0v7FNlj9orVTIpAVDfbkGC_0 2024-09-12T18:01:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.049+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16044578121782801973', time=2024-09-12T19:56:00.938745+0000, chain.objs.size()=4 2024-09-12T18:01:04.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.049+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~nu68Ag_dnfdm7Gb44rxk5kvuRRB8NEP.1 2024-09-12T18:01:04.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.049+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~nu68Ag_dnfdm7Gb44rxk5kvuRRB8NEP.2 2024-09-12T18:01:04.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~nu68Ag_dnfdm7Gb44rxk5kvuRRB8NEP.3 2024-09-12T18:01:04.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.579__multipart_testobj.2~nu68Ag_dnfdm7Gb44rxk5kvuRRB8NEP.4 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17522080965112055159', time=2024-09-12T19:56:04.627521+0000, chain.objs.size()=1 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.586__shadow:LgSEJJU9Nd947fDaeIK9QOlLc.vuBWO_.qux1HDnGAfQ7chl7RoIhO2jPtwngG8G_0 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14431931586720176306', time=2024-09-12T19:58:19.971085+0000, chain.objs.size()=1 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.630__shadow_.IMlL5yMxRwdySBYcJvWWYdWPhME1TXO_0 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6433650674649594678', time=2024-09-12T19:58:30.116738+0000, chain.objs.size()=1 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.665__shadow_.NeVmNVRmwnnMrBIKcKBE8aS22Qn40so_0 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10051380357010617323', time=2024-09-12T19:58:30.961298+0000, chain.objs.size()=1 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.667__shadow_.QWHafeUWICzjOQkFwo6jU60npEVbaVa_0 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9825490148801847579', time=2024-09-12T19:59:10.026633+0000, chain.objs.size()=1 2024-09-12T18:01:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.053+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.746__shadow_.hLEML-6eEuJ98kVAto1tvurBU01u3H4_0 2024-09-12T18:01:04.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.058+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.060+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:01:04.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.062+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.062+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/62331' 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13218526053439046234', time=2024-09-12T19:53:09.236591+0000, chain.objs.size()=1 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.244__shadow_.ulNluldPEmFSYxJb6T-hfIT45mshZP3_0 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13844464961972273888', time=2024-09-12T19:53:13.077491+0000, chain.objs.size()=1 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.262__shadow_.5ZEvc6SdA_R1Ogmla49sH39KGe2h-L2_0 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12027966186180959194', time=2024-09-12T19:53:21.195599+0000, chain.objs.size()=1 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DIHABrq45e-Hm0oSbj5pVAttnDuu4i-_0 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13389148271591030380', time=2024-09-12T19:53:21.204146+0000, chain.objs.size()=1 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iikju_KHn6F9GnRR1K29X_kvTUVlQzV_0 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15431651154720157838', time=2024-09-12T19:53:21.205068+0000, chain.objs.size()=1 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xSqBNsYT7mRDk-i0YPl5o3GFEVKrLiC_0 2024-09-12T18:01:04.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12431914397285709742', time=2024-09-12T19:53:21.373662+0000, chain.objs.size()=1 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0-_RnXy0720KAqdt3JbIPx9N8GUfltF_0 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5247373709280207526', time=2024-09-12T19:53:21.405058+0000, chain.objs.size()=1 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PdWMlFNobYr5tVvCnFc66R2OxuMGHe5_0 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17759468892894393208', time=2024-09-12T19:53:21.491143+0000, chain.objs.size()=1 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2adfbG1lDehf8apqpniB8BlxNsj9xi8_0 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13690403292349594827', time=2024-09-12T19:53:21.577751+0000, chain.objs.size()=1 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.djfDijyIzmcMFlbtrjjOj1RDEo4DPtb_0 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8977731367911193964', time=2024-09-12T19:53:21.578427+0000, chain.objs.size()=1 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.o-V_mM0KAXC8psrTCbQsqmvdslnMpQJ_0 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6002461534114382539', time=2024-09-12T19:53:21.593744+0000, chain.objs.size()=1 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.UxvrVEWmepJl9Cb4LxjT-r1_5R4mkSz_0 2024-09-12T18:01:04.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4714702366789342734', time=2024-09-12T19:53:21.640161+0000, chain.objs.size()=1 2024-09-12T18:01:04.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ShvHMtaUXvvUgbe03feec8T0D8NPD4Q_0 2024-09-12T18:01:04.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1721231788042070352', time=2024-09-12T19:53:21.696055+0000, chain.objs.size()=1 2024-09-12T18:01:04.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XEb5xHbrxwd0XKXd_FQvc8rZYv-e361_0 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9887846820956860574', time=2024-09-12T19:53:21.789309+0000, chain.objs.size()=1 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aAvNbPe6xybGW9HBPwzi7nYJOOQARf2_0 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1646901082860497299', time=2024-09-12T19:53:21.818322+0000, chain.objs.size()=1 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.NOxwk6nQ-SytuZ3v_b3w81S2GmziWF3_0 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12098579716255702026', time=2024-09-12T19:53:21.890073+0000, chain.objs.size()=1 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.B60I9CKWj90OuBZ1KDFUk3LIFqnFzkg_0 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5554490152135550347', time=2024-09-12T19:53:21.898431+0000, chain.objs.size()=1 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xMS43QMhk7CEX2yqqF6qYsqXcjBBqS0_0 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13263027296568990638', time=2024-09-12T19:53:22.017389+0000, chain.objs.size()=1 2024-09-12T18:01:04.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.067+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.cVp7pvjL_wMEL47HHtki9g6vUGI-A2O_0 2024-09-12T18:01:04.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15747567719422378589', time=2024-09-12T19:53:22.028070+0000, chain.objs.size()=1 2024-09-12T18:01:04.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Q-6wXmF3zBeNwuFzzxAxk4lIFPEzKE7_0 2024-09-12T18:01:04.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.218745029668624823', time=2024-09-12T19:53:22.031184+0000, chain.objs.size()=1 2024-09-12T18:01:04.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9e3YxUr9AEtuZAP36lDgMQzrO6nEp2c_0 2024-09-12T18:01:04.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5233097134857791426', time=2024-09-12T19:53:22.073808+0000, chain.objs.size()=1 2024-09-12T18:01:04.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.I_P6CTvx71_j5qcyklzCqFdXRN1rLLF_0 2024-09-12T18:01:04.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13101075757526545782', time=2024-09-12T19:53:22.092481+0000, chain.objs.size()=1 2024-09-12T18:01:04.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vqQ6mPYzaWi5y50lV3SWeTCAKznGB80_0 2024-09-12T18:01:04.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.068+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7452338738339505549', time=2024-09-12T19:53:22.211732+0000, chain.objs.size()=1 2024-09-12T18:01:04.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.069+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AmJh7BFlZtIomLJNFk5GaRXrl6evGor_0 2024-09-12T18:01:04.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.072+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10438654766854639312', time=2024-09-12T19:53:22.227609+0000, chain.objs.size()=1 2024-09-12T18:01:04.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.072+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-iN-iBLKeBTUnTZmqKZA9d_6rw3S5Jv_0 2024-09-12T18:01:04.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11194120611898571815', time=2024-09-12T19:53:22.285950+0000, chain.objs.size()=1 2024-09-12T18:01:04.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Jbf0n89ht3b6UmU8laSgx8iOo99LK5l_0 2024-09-12T18:01:04.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14561881024617538441', time=2024-09-12T19:53:22.303099+0000, chain.objs.size()=1 2024-09-12T18:01:04.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vmpZdyMaupJ4rxN12dzrsP0qwamCMmp_0 2024-09-12T18:01:04.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6752015782860952776', time=2024-09-12T19:53:22.382540+0000, chain.objs.size()=1 2024-09-12T18:01:04.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.K_QMGDUZ2wPJj6-v3WINPeDgYh6nrAP_0 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17298610407941328100', time=2024-09-12T19:53:22.461121+0000, chain.objs.size()=1 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Hp2MI11_LwerB_cTWv2-djYfxtbO6Qc_0 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3200837654942575903', time=2024-09-12T19:53:22.489449+0000, chain.objs.size()=1 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.x3Qdc6OQeViYusjlxVKTF0C-jKoTCwB_0 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17574136161345906193', time=2024-09-12T19:53:22.577688+0000, chain.objs.size()=1 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZeF1Wxha02FuesZlg0fW2C0T5mnmS3u_0 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9336651055804757307', time=2024-09-12T19:53:22.642345+0000, chain.objs.size()=1 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EUOTw84pUFRMaS2dSgCwyZOvxY8Y8oQ_0 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5599876088142181667', time=2024-09-12T19:53:23.440729+0000, chain.objs.size()=1 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.267__shadow_.Oil3szEas3DhLNUiBQAUm-3ECGjZzoI_0 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16349893801755685791', time=2024-09-12T19:53:29.339937+0000, chain.objs.size()=1 2024-09-12T18:01:04.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.vm-QAbf1gKtV6qugI1vO8xyVH70beJn_0 2024-09-12T18:01:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15308764946745654144', time=2024-09-12T19:53:29.342423+0000, chain.objs.size()=1 2024-09-12T18:01:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.Tt1GNGzsy99PVNZPrOgEYVEdcbkShsp_0 2024-09-12T18:01:04.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11785100513027793463', time=2024-09-12T19:53:29.951823+0000, chain.objs.size()=1 2024-09-12T18:01:04.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.q_BINjkfIwLLqk9rmBkOT3yPfoW4oMS_0 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.97142320437450122', time=2024-09-12T19:53:30.344869+0000, chain.objs.size()=1 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.296__shadow_.tn1PdcSLgghIt3OKplyxYuEOR-s-kJI_0 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8380387782984211784', time=2024-09-12T19:53:33.480924+0000, chain.objs.size()=1 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.308__shadow:omHLvTJ6uhGfz-TwFgsYnRa5lBcGBjr_.nN2VZJet00VdMiwakWIK-V3yRobhhNH_0 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13352564551244218665', time=2024-09-12T19:53:44.544812+0000, chain.objs.size()=1 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cQvVOljKkQ6JbtXySs-XUrP5HGms3mN_0 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13386608257447581145', time=2024-09-12T19:53:44.557424+0000, chain.objs.size()=1 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.rCI7NdfdW-_i-oZz26LRFw8gxBBh22q_0 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2961570062963618372', time=2024-09-12T19:53:44.560692+0000, chain.objs.size()=1 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2jmkYnkPZ5AOIzZZkiIXOkJXkwbfdJP_0 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7685953645265716306', time=2024-09-12T19:53:44.579243+0000, chain.objs.size()=1 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0V78EaxjOA8icUqBD4AYibBQbcHsBHr_0 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1008187194499205119', time=2024-09-12T19:53:44.616206+0000, chain.objs.size()=1 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LxtnlJvKMxAngtcQoiUN--BrEq94FYl_0 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11693381524594692909', time=2024-09-12T19:53:44.632188+0000, chain.objs.size()=1 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.a21ds5lLHUIWSXGh7-rEDIiHk4K33zs_0 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14360072508530109897', time=2024-09-12T19:53:44.634695+0000, chain.objs.size()=1 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vH4f3yckO-UOtqh2fahatiZDQjB5GJP_0 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17552026235420629545', time=2024-09-12T19:53:44.843909+0000, chain.objs.size()=1 2024-09-12T18:01:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.079+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lBKSaMwLN3g2dEnh_bqjBPsj30vAXiQ_0 2024-09-12T18:01:04.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.082+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17864524449704055025', time=2024-09-12T19:53:44.940930+0000, chain.objs.size()=1 2024-09-12T18:01:04.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4phhA4rYglvT5YkRXCJIWnHUDzfnCEd_0 2024-09-12T18:01:04.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16013671114871288843', time=2024-09-12T19:53:44.969206+0000, chain.objs.size()=1 2024-09-12T18:01:04.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bLU52HIT5bJHdJbe3n3DwyZstOMEStd_0 2024-09-12T18:01:04.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10247896023221237385', time=2024-09-12T19:53:44.976616+0000, chain.objs.size()=1 2024-09-12T18:01:04.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._aa4XZ9j6YASGma6lfSdCTkNMB5Z4fN_0 2024-09-12T18:01:04.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5449396923872942004', time=2024-09-12T19:53:44.991789+0000, chain.objs.size()=1 2024-09-12T18:01:04.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oI2hQLzsdgDQ2ur38Xi0TjEKVS_kgje_0 2024-09-12T18:01:04.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2079060502755433410', time=2024-09-12T19:53:44.993058+0000, chain.objs.size()=1 2024-09-12T18:01:04.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6Gs9JN26cE2BzdfKwz06M0GSbRzWTpd_0 2024-09-12T18:01:04.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1303356143138569250', time=2024-09-12T19:53:45.021621+0000, chain.objs.size()=1 2024-09-12T18:01:04.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.083+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6ac_aHojn8sszzUnVeEvWuurCbm9h7u_0 2024-09-12T18:01:04.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13342908311161715049', time=2024-09-12T19:53:45.151788+0000, chain.objs.size()=1 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.QSj9brQoXJn99COhovgUTgENOH-8tqp_0 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16237247208804278134', time=2024-09-12T19:53:45.214501+0000, chain.objs.size()=1 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3TdM8JIQ0tCoqt7FI5b8jtigh4N0j0C_0 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9725068240834906846', time=2024-09-12T19:53:45.238353+0000, chain.objs.size()=1 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pXD99Bi0k2ySC-VBPGcaOlgJ3d0jtjg_0 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.918818434857019925', time=2024-09-12T19:53:45.239777+0000, chain.objs.size()=1 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7U9AQHOhaHgBUjUS4AHb-4Nr1ZA1ZRh_0 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3621953658984792665', time=2024-09-12T19:53:45.246865+0000, chain.objs.size()=1 2024-09-12T18:01:04.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bB_FeDr3nlAnToUosBBFlHkmMjS47J1_0 2024-09-12T18:01:04.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10205843708003028221', time=2024-09-12T19:53:45.388067+0000, chain.objs.size()=1 2024-09-12T18:01:04.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1u2vUERQcJVJTP1vwDXfPXA1-eQ7eOK_0 2024-09-12T18:01:04.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13232131491019840356', time=2024-09-12T19:53:45.397966+0000, chain.objs.size()=1 2024-09-12T18:01:04.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dxEmqdgA6YmdbQ9Ks2Tvw9D86A5K81u_0 2024-09-12T18:01:04.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14958075084036135081', time=2024-09-12T19:53:45.398952+0000, chain.objs.size()=1 2024-09-12T18:01:04.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0VGY5RAMiesfGz171EpyXkTUhzAR04y_0 2024-09-12T18:01:04.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3377794286461162997', time=2024-09-12T19:53:45.407633+0000, chain.objs.size()=1 2024-09-12T18:01:04.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.087+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7dXzBQZUDzpEkW8TY0BokxtIAa4CQN-_0 2024-09-12T18:01:04.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.088+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4765029123660990899', time=2024-09-12T19:53:45.412851+0000, chain.objs.size()=1 2024-09-12T18:01:04.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.088+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0YHnMvKJWgu59D7oZ-ncJgPE0pJYf8W_0 2024-09-12T18:01:04.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.088+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4489643292795928473', time=2024-09-12T19:53:45.414282+0000, chain.objs.size()=1 2024-09-12T18:01:04.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.088+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gp5SdQXeP8EAR8J3d5zZYvkM2C-sO83_0 2024-09-12T18:01:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.090+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8873166068274982035', time=2024-09-12T19:53:45.445881+0000, chain.objs.size()=1 2024-09-12T18:01:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.090+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.su7qHdBrBZvOlUKoTOMw7R29b2ajKC8_0 2024-09-12T18:01:04.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2158901612494723369', time=2024-09-12T19:53:45.447222+0000, chain.objs.size()=1 2024-09-12T18:01:04.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2Iosut5UJhOmTigFwBbMlVGzncQia4V_0 2024-09-12T18:01:04.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9703077945717365469', time=2024-09-12T19:53:45.535492+0000, chain.objs.size()=1 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OKSkdUk12oTDWEh4op7J8RnALrpDUFt_0 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9300856614889488912', time=2024-09-12T19:53:45.551291+0000, chain.objs.size()=1 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KncvvNUNk8mPUStTp4dtm2z7YpCEzlr_0 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3705552364084472823', time=2024-09-12T19:53:45.598032+0000, chain.objs.size()=1 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5Gey1iCP5LtOa3uJHOGbLcBsbo5hU43_0 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16526426409309794423', time=2024-09-12T19:53:45.641948+0000, chain.objs.size()=1 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AqATC7Y3k3EuBdTJ43ihBO7SoL_Zpbe_0 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13238927445183818870', time=2024-09-12T19:53:45.752838+0000, chain.objs.size()=1 2024-09-12T18:01:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.J6l9MFGnYDL5e4JhEHhHkiZBfVIn8ZP_0 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8985122405188234655', time=2024-09-12T19:53:45.781489+0000, chain.objs.size()=1 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.EyBNHdMVXtpFxDuXNzTgepHfIZRps5w_0 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.65770776965412685', time=2024-09-12T19:53:45.796909+0000, chain.objs.size()=1 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8nJhxcVnnhX28Cbruhe-Vep8NmlC6zn_0 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4204500639369645271', time=2024-09-12T19:53:45.806131+0000, chain.objs.size()=1 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lK76aSl8eXc9_UlR5_OrIsVbm4A8ti0_0 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14244270453575395029', time=2024-09-12T19:53:45.958125+0000, chain.objs.size()=1 2024-09-12T18:01:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TxncWLlG5VOYpRKc2Iq6M--v4Ww5RRT_0 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.095+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12999560331591367960', time=2024-09-12T19:53:45.977911+0000, chain.objs.size()=1 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.095+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Hqa-V7cFQ3K7mhrZrK39vcDzS8EEdDJ_0 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10874590338661346383', time=2024-09-12T19:53:45.978852+0000, chain.objs.size()=1 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FmXoM96nAhYkt9ZnuVnzhEaq6K0Iq1p_0 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15981564462666651817', time=2024-09-12T19:53:46.037309+0000, chain.objs.size()=1 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bb3K5thnldUZPQyv5qFIlIVN6kvRuW8_0 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5816940949963769349', time=2024-09-12T19:53:46.047903+0000, chain.objs.size()=1 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OLyLvJq864aI8V9lau7o0sFiewHRyfY_0 2024-09-12T18:01:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12734277085892996095', time=2024-09-12T19:53:46.053397+0000, chain.objs.size()=1 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HzJpPgiRrhscAaIU-F3rIci0XEe9kg-_0 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4503181992505144714', time=2024-09-12T19:53:54.668788+0000, chain.objs.size()=1 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.096+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.80JlOhLltgIOifAYXN7iUCmmLwxDTcE_0 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2619398277981448419', time=2024-09-12T19:53:54.684051+0000, chain.objs.size()=1 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zw8NhjTNX4oskq-f8BgHRwLABc-Dc6T_0 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7938519223628113308', time=2024-09-12T19:53:54.697860+0000, chain.objs.size()=1 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2-SyBQstGzrH4J0W9Llk2VobDsHjvtj_0 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6716727881467552109', time=2024-09-12T19:53:54.725794+0000, chain.objs.size()=1 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JwNEPyG64Z7X04Lp2nW5_mI9z7gWHe9_0 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13422845180093721537', time=2024-09-12T19:53:54.740275+0000, chain.objs.size()=1 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Fh1STpTWrsmTooHAus1rs8BWc0Qoapo_0 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.24084614869457733', time=2024-09-12T19:53:54.842058+0000, chain.objs.size()=1 2024-09-12T18:01:04.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.097+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Z4SLKAizNLfk_yIxevFAAmP1OJpr-tC_0 2024-09-12T18:01:04.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.099+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14592478387733717601', time=2024-09-12T19:53:54.845881+0000, chain.objs.size()=1 2024-09-12T18:01:04.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.099+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4p6BTD1zaOIEGJ7WsS897HSd65IWMLZ_0 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8457117849619581190', time=2024-09-12T19:53:54.855909+0000, chain.objs.size()=1 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.A9F_lOFDkYv8JEQwqVqQlb1ZB567vDj_0 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2458727491029236363', time=2024-09-12T19:53:54.886931+0000, chain.objs.size()=1 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wbnh8pFQ8LcpJ4HovCQtIgjQuTQxdD1_0 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6302589649715167106', time=2024-09-12T19:53:54.948459+0000, chain.objs.size()=1 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1LJ_ntWG7Mp_R1UdRVn-et9vG9dE5HE_0 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3184513350790571282', time=2024-09-12T19:53:54.958559+0000, chain.objs.size()=1 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._KbnpKoOAfCFUifoQPxFqmixymRNens_0 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1812323687015340411', time=2024-09-12T19:53:55.048572+0000, chain.objs.size()=1 2024-09-12T18:01:04.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.101+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Fs5wdftOyFNsmL66VciVEQyekvtV2bk_0 2024-09-12T18:01:04.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.102+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16015972122951821443', time=2024-09-12T19:53:55.052533+0000, chain.objs.size()=1 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZbO08pXrDF5oMbEQ4bExBMU_3Q-u7US_0 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11896108820833498838', time=2024-09-12T19:53:55.148520+0000, chain.objs.size()=1 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hxqGMOSwUk5jc0ZXLh-glHuw88ePPHV_0 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4225363393669272680', time=2024-09-12T19:53:55.332962+0000, chain.objs.size()=1 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.goDnU_k5DdwoRiKooMoQJOR9LyKzJp3_0 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18337367078115812915', time=2024-09-12T19:53:55.370337+0000, chain.objs.size()=1 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.WO-106WbaHtprGMEgucXCwkZcnY-6DM_0 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7848859310169494474', time=2024-09-12T19:53:55.498861+0000, chain.objs.size()=1 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kzJwLRMUyQmhLudDunapbiTD1gMbjY0_0 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6003701427861013367', time=2024-09-12T19:53:55.547682+0000, chain.objs.size()=1 2024-09-12T18:01:04.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.103+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.13ZROGWVgkn26-8owMmP-K5BK6MpuDQ_0 2024-09-12T18:01:04.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4238291339954621203', time=2024-09-12T19:53:55.568785+0000, chain.objs.size()=1 2024-09-12T18:01:04.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DjsgdEWAk_aHkBQlScnzpwVJ5S6aSbx_0 2024-09-12T18:01:04.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3808774391449746957', time=2024-09-12T19:53:55.582858+0000, chain.objs.size()=1 2024-09-12T18:01:04.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.f1762WoOfwC28GNuEpe2yImg2F16m05_0 2024-09-12T18:01:04.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4309817693014467992', time=2024-09-12T19:53:55.704419+0000, chain.objs.size()=1 2024-09-12T18:01:04.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TX5WcMg7u3kg0SEIEKT3nUdcy1hSsH8_0 2024-09-12T18:01:04.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18243075497957391116', time=2024-09-12T19:53:55.782195+0000, chain.objs.size()=1 2024-09-12T18:01:04.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.106+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.miFR_WimSZy-afm96xzzMJOTSJaPuVw_0 2024-09-12T18:01:04.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/62331 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5062004646319073463', time=2024-09-12T19:53:55.945714+0000, chain.objs.size()=1 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CbG4uxnceOnSKwou8pZonxaYVn3WIEi_0 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8940745281141972292', time=2024-09-12T19:53:55.946660+0000, chain.objs.size()=1 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7F7HGTpBc0egqlLaCvipzfPz-B_Aqec_0 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17202841298078647852', time=2024-09-12T19:53:56.003754+0000, chain.objs.size()=1 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rzarmkBbOYUTaodFMh35EkW4GeWgLSW_0 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17977972882817138793', time=2024-09-12T19:53:56.020667+0000, chain.objs.size()=1 2024-09-12T18:01:04.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FKu7VfhE8lZOQQQWAzyrhE1pZFdHj4I_0 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4710534345437376081', time=2024-09-12T19:53:56.105203+0000, chain.objs.size()=1 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Uo1EhvF5r1FN2Cq5Od5JBVYhgW-6gRh_0 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2340232156971225297', time=2024-09-12T19:53:56.136321+0000, chain.objs.size()=1 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tDFEHbHreDxCEqwCHrWR2ZBzzFjtr9F_0 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6495723790844776747', time=2024-09-12T19:53:56.137650+0000, chain.objs.size()=1 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.t2zKCiYYIdd4e971HL-_VFPgzJffGCO_0 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17155313563232601605', time=2024-09-12T19:53:57.835762+0000, chain.objs.size()=1 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.334__shadow_.2s3dJhIo6pDC-Xyz6NTcX_hMAORcD9R_0 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.641396421372321566', time=2024-09-12T19:53:58.125023+0000, chain.objs.size()=1 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.335__shadow_.K0vSWygCtRYv1e2ni4qTJe8hZ5OfU4S_0 2024-09-12T18:01:04.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10519945001309712695', time=2024-09-12T19:53:59.804481+0000, chain.objs.size()=1 2024-09-12T18:01:04.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.344__shadow_.9sXpUUdbq_M4clQTrZm80M7AH3YLh4j_0 2024-09-12T18:01:04.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4495228189849359043', time=2024-09-12T19:54:07.141975+0000, chain.objs.size()=1 2024-09-12T18:01:04.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.380__shadow_.myK5aqHRfj-bIup6dJwrS8O_vE6zUys_0 2024-09-12T18:01:04.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1678911458324808623', time=2024-09-12T19:54:26.813550+0000, chain.objs.size()=1 2024-09-12T18:01:04.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.113+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.462__shadow_.TZmxkPbezVTpdeSJY2uHUMjwJvcTVVx_0 2024-09-12T18:01:04.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9804041949371191057', time=2024-09-12T19:54:27.835112+0000, chain.objs.size()=1 2024-09-12T18:01:04.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.465__shadow_.bHNi1Q9xP2-r9Cjaz4RvWSeGeLbTeP6_0 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11147022611220691751', time=2024-09-12T19:54:34.826784+0000, chain.objs.size()=1 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.499__shadow_.xUa5zv6isgwcC6ejZVL3z_ju493cZLB_0 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6825681737867267879', time=2024-09-12T19:54:40.816610+0000, chain.objs.size()=1 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.518__shadow_.9OeQIosq6_6y5OovbVwPe8q03sj_SDr_0 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2830005603792961304', time=2024-09-12T19:54:50.049253+0000, chain.objs.size()=2 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~d5eM8CESnL3OeOIVWqyYkveQ3zKIdI3.1 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~d5eM8CESnL3OeOIVWqyYkveQ3zKIdI3.2 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12918190968187086080', time=2024-09-12T19:55:24.562319+0000, chain.objs.size()=1 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.556__shadow_.Mea8DSZG_lU0FH8gaTCOfrb7ssb9yot_0 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13781086906389223267', time=2024-09-12T19:55:25.308741+0000, chain.objs.size()=1 2024-09-12T18:01:04.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.558__shadow_.iuGUO4bw0LXBQsFqS0nSvXNCxKVd-Ga_0 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8249808755936491862', time=2024-09-12T19:55:37.708957+0000, chain.objs.size()=1 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:Ns6fCDNdqwxmZzmcJLGP7HYsKZFX4BN_.tDz9Hnwh07W_93nPqKHZ1iJ-yrf-7dg_0 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15065394660378510220', time=2024-09-12T19:55:38.494886+0000, chain.objs.size()=1 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:Bc2MuloItud9gPvWwvZVXr.QA6WMEdN_.YZGx4P07rXXq8ebOFa1T8hEYztOmru4_0 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13911705851175380360', time=2024-09-12T19:55:39.648604+0000, chain.objs.size()=1 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.572__shadow_.0WU75IrEbHaKk8FPe1eJ3zJzmd8zser_0 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8276741673671963763', time=2024-09-12T19:55:53.297781+0000, chain.objs.size()=1 2024-09-12T18:01:04.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:AsfAWM7-7jK-MGdPv.dAiZlRgbMu.nW_.3Gxj1iGKP7aY-yS8YsE8zN37UvZefQj_0 2024-09-12T18:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.124+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13981620314017626302', time=2024-09-12T19:55:56.430421+0000, chain.objs.size()=1 2024-09-12T18:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:awYABOb0lQjBGELm9KgHrIMrN23lde7_.Kdr65a-ZKzEG55lmZz3m-qP80eE9C-z_0 2024-09-12T18:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1608601930561709730', time=2024-09-12T19:56:05.268277+0000, chain.objs.size()=1 2024-09-12T18:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:YObJm7GsA2Rce7KS-A5d1frF1Wx6c0u_.eSBgsSfx0kfbLjGxxxQVJHiXG13pqj3_0 2024-09-12T18:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18291067451533894626', time=2024-09-12T19:57:14.674385+0000, chain.objs.size()=1 2024-09-12T18:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.618__shadow_.MlynAfjQD6_iEriDekxGNoyXrWVNWkc_0 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2535066373277054583', time=2024-09-12T19:58:15.821172+0000, chain.objs.size()=1 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.619__shadow_.QbZ7Gu07rQJHn43yt5ePMDA4yVYf6on_0 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.477872130308014982', time=2024-09-12T19:58:19.250550+0000, chain.objs.size()=1 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.627__shadow_.LSoBxZY0JG_b3x4XgxLRCzb0WTBi68a_0 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3624782887751783287', time=2024-09-12T19:58:30.961525+0000, chain.objs.size()=1 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.667__shadow_.OrCpwmvkY72nlNa_nys3Ks7ujsamV45_0 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2923129680297539258', time=2024-09-12T19:58:36.835060+0000, chain.objs.size()=1 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.698__shadow:1AEmtBbJZ8s2ukQs.gvKCZ-ba8h.sSr_.5EzcwvJaCBW1MCefqBpw0SvgWD9woBw_0 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9221879655037502052', time=2024-09-12T19:58:40.742159+0000, chain.objs.size()=1 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.715__shadow:YMJCAXAMNu3IXJ4DPnNuSXlqd1zE.jw_.LzmbzdEsfn4_yyPze5jwabiuHz1jIST_0 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1430590038795455742', time=2024-09-12T19:59:04.542975+0000, chain.objs.size()=1 2024-09-12T18:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.735__shadow_.GRx1gcz33c6I59ozddVlzz5ByLNrhV__0 2024-09-12T18:01:04.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.131+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.134+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:01:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.135+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54747' 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1337479893126333205', time=2024-09-12T19:51:56.159265+0000, chain.objs.size()=1 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.158__shadow:vQOQcpn55JOIKCz6.UA.faTgAs8tP2q_.JrQIcwX1oBRkdM60A5-ip1RfKOpXMg2_0 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_jfd0zievNyljmUy2qtJLPLC5-6cOTiZ', time=2024-09-12T19:51:57.870924+0000, chain.objs.size()=1 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.boQraH9-YVJ-5sLV5kZz79CdAG2b3Fn_0 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9972856229841702727', time=2024-09-12T19:51:59.821791+0000, chain.objs.size()=5 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-FROZEN.2~scDYn_HSX49HzLlAfZ0pAiZoJp4MyOA.1 2024-09-12T18:01:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_foo-FROZEN.2~scDYn_HSX49HzLlAfZ0pAiZoJp4MyOA.1_1 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-FROZEN.2~scDYn_HSX49HzLlAfZ0pAiZoJp4MyOA.2 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_foo-FROZEN.2~scDYn_HSX49HzLlAfZ0pAiZoJp4MyOA.2_1 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-FROZEN.2~scDYn_HSX49HzLlAfZ0pAiZoJp4MyOA.3 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_do6_QGBBihLwL3hqbFyqSWqAJv7YEQ8', time=2024-09-12T19:52:01.112785+0000, chain.objs.size()=1 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.166__shadow_.e8yS25JvOcFXz3TaBM1J-WkWat1H6t6_0 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3730220903654638945', time=2024-09-12T19:52:01.942103+0000, chain.objs.size()=1 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.171__shadow_.pnFdhm9tLGzmeIWP_rqBmlDLbCFr_p-_0 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5766879402955582131', time=2024-09-12T19:52:16.448048+0000, chain.objs.size()=1 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.198__shadow_.zblqpk4TI0u3n_4Hs9PpLGtgB604Als_0 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.137+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4171368903593706907', time=2024-09-12T19:53:08.978182+0000, chain.objs.size()=1 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.137+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.243__shadow_.ehTh6TXkSJYfzOZlYbG3zl4c2TNxWa2_0 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.137+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14655535396294012015', time=2024-09-12T19:53:10.553224+0000, chain.objs.size()=1 2024-09-12T18:01:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.137+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.250__shadow_.6BJ4SkKNHBk5imZIjt6Yn_AsL1ivIZF_0 2024-09-12T18:01:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.139+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13818589314544876082', time=2024-09-12T19:53:10.973063+0000, chain.objs.size()=1 2024-09-12T18:01:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.139+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.252__shadow_.z7wPDvypjrTO-cP-uJBP9n1NiTxNabG_0 2024-09-12T18:01:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.139+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12796664828084563094', time=2024-09-12T19:53:21.206802+0000, chain.objs.size()=1 2024-09-12T18:01:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.139+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2Z8dDE5Hgvgw2p0z2P1a-zuay24OFer_0 2024-09-12T18:01:04.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15209047700249907172', time=2024-09-12T19:53:21.227209+0000, chain.objs.size()=1 2024-09-12T18:01:04.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dVrn9m8ACi3xs_U4TXgkspjD7JgS1V9_0 2024-09-12T18:01:04.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13656764054971585791', time=2024-09-12T19:53:21.264519+0000, chain.objs.size()=1 2024-09-12T18:01:04.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iEuIwaz9IoPv6IX04C-eZzUGHMgMszW_0 2024-09-12T18:01:04.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3240260242038394498', time=2024-09-12T19:53:21.276155+0000, chain.objs.size()=1 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ctxJagdq2K_hk-I2Lq-SaGQPZCilC5g_0 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17007483083072251142', time=2024-09-12T19:53:21.389746+0000, chain.objs.size()=1 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QoNC_yr-taQaI5cFHxon0GdedOq8eGB_0 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9030531899274835385', time=2024-09-12T19:53:21.411596+0000, chain.objs.size()=1 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bemrcMedFD9qPsqbR7ENgwn8O2nPYqd_0 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11450024853380421005', time=2024-09-12T19:53:21.415504+0000, chain.objs.size()=1 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hLjy-0SsYcr0FcWoLvVg7bO9ik3mTlt_0 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.334126988437189766', time=2024-09-12T19:53:21.441780+0000, chain.objs.size()=1 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RUyrIKPVT9wH-bQW2AWbiWMtEgjfbHa_0 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7353778674610425304', time=2024-09-12T19:53:21.475022+0000, chain.objs.size()=1 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RwxGRugAplfY7KoFUUUL_oIgZVn-mOp_0 2024-09-12T18:01:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12464270844595556081', time=2024-09-12T19:53:21.492461+0000, chain.objs.size()=1 2024-09-12T18:01:04.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.140+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1mORNgkORT2yjnRr55cIbMRZem1itkt_0 2024-09-12T18:01:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8838401300139466233', time=2024-09-12T19:53:21.578841+0000, chain.objs.size()=1 2024-09-12T18:01:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8ZuBVYdvS6mhf14v2xHkQd7eipmHhOn_0 2024-09-12T18:01:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15263030071980416666', time=2024-09-12T19:53:21.588188+0000, chain.objs.size()=1 2024-09-12T18:01:04.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ta7IZp0m6gqiGWujHg_eg21qrBGoQOC_0 2024-09-12T18:01:04.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.145+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4582781471935964472', time=2024-09-12T19:53:21.638876+0000, chain.objs.size()=1 2024-09-12T18:01:04.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.145+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.m6SN7tdGgWKtSjJvUclRY6YeeB-qo1J_0 2024-09-12T18:01:04.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9575375044551511977', time=2024-09-12T19:53:21.776185+0000, chain.objs.size()=1 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MIg6s7tZRm_BkE14PWtMa7dr9A4DBGs_0 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5508391409188523843', time=2024-09-12T19:53:21.778855+0000, chain.objs.size()=1 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7xkf8yazfLM2498wtdIaI3zvRF7sqJQ_0 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7479979843741898231', time=2024-09-12T19:53:21.781154+0000, chain.objs.size()=1 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2GgmPZESlC_LtnOApAMUyk5SG6g1v58_0 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13183002528295925601', time=2024-09-12T19:53:21.796527+0000, chain.objs.size()=1 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1fPQjSEGYDrPxoxIgMZz3mFsG3gPHft_0 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.790436577800411888', time=2024-09-12T19:53:21.799112+0000, chain.objs.size()=1 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QQYj92S3Qao1maZuCmqSENgYLiTKkRi_0 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10586031613314265349', time=2024-09-12T19:53:21.802066+0000, chain.objs.size()=1 2024-09-12T18:01:04.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.147+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.UeBfPSZxGEuiOFT3z0LBEgFONzQgECl_0 2024-09-12T18:01:04.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.149+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2872738848454858126', time=2024-09-12T19:53:21.838949+0000, chain.objs.size()=1 2024-09-12T18:01:04.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.149+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-_0GJCUXkVOHnMgAg6fH_ZCaUS0CTkA_0 2024-09-12T18:01:04.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.149+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16240350563856593753', time=2024-09-12T19:53:21.841579+0000, chain.objs.size()=1 2024-09-12T18:01:04.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.149+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JZV6J-0cbEzpaSw3zG8roHiB_dytbBG_0 2024-09-12T18:01:04.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.150+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15162862509672145153', time=2024-09-12T19:53:21.848947+0000, chain.objs.size()=1 2024-09-12T18:01:04.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.150+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HkaWtpYnKY0nqr7yU-iJbal3GiEF-JA_0 2024-09-12T18:01:04.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.150+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18408382751272918592', time=2024-09-12T19:53:21.898020+0000, chain.objs.size()=1 2024-09-12T18:01:04.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.150+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.IvseUEPne4CEsI19bP094v3ffhnt55F_0 2024-09-12T18:01:04.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.150+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1474128512374760315', time=2024-09-12T19:53:22.001482+0000, chain.objs.size()=1 2024-09-12T18:01:04.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.150+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wo9ry-V4K5lBwi9c4InTwg3YMi2REAz_0 2024-09-12T18:01:04.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.151+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5550614487200271014', time=2024-09-12T19:53:22.055927+0000, chain.objs.size()=1 2024-09-12T18:01:04.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yM4rV7OsRr31eBGs6Tusn0_JYYwsKi3_0 2024-09-12T18:01:04.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11503154600858525038', time=2024-09-12T19:53:22.069851+0000, chain.objs.size()=1 2024-09-12T18:01:04.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Cka9cd6DbRI2rCtWzIKdX7dQaYpFZw3_0 2024-09-12T18:01:04.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14154657840961753973', time=2024-09-12T19:53:22.084090+0000, chain.objs.size()=1 2024-09-12T18:01:04.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WYWX0dFMvAXo8Um5hvmTMz24LUjn3RK_0 2024-09-12T18:01:04.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9675559301528305112', time=2024-09-12T19:53:22.103183+0000, chain.objs.size()=1 2024-09-12T18:01:04.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.cUFVCNA4W9KiQ42n7Sz-c3NPbyY_zsg_0 2024-09-12T18:01:04.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.20246602059620849', time=2024-09-12T19:53:22.217954+0000, chain.objs.size()=1 2024-09-12T18:01:04.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oQYhPaihOD-4ZgrjMpVXRWltP8Ho_hp_0 2024-09-12T18:01:04.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14134074092068497583', time=2024-09-12T19:53:22.225138+0000, chain.objs.size()=1 2024-09-12T18:01:04.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lI-W-l9nh0B81HEk5BlJ_NFn1G6LC_u_0 2024-09-12T18:01:04.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1621418412983545741', time=2024-09-12T19:53:22.264359+0000, chain.objs.size()=1 2024-09-12T18:01:04.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tgtI4l9YpQ_VoxY4UDZApWuIhJveTUV_0 2024-09-12T18:01:04.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.154+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7271708137275702141', time=2024-09-12T19:53:22.304119+0000, chain.objs.size()=1 2024-09-12T18:01:04.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.154+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wY3xVHqYVN3tUdZF3vqbV9Mff2Lwe52_0 2024-09-12T18:01:04.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.155+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12695134361056212460', time=2024-09-12T19:53:22.306338+0000, chain.objs.size()=1 2024-09-12T18:01:04.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.155+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Ch961P2Sb8beio14MQzS2IDzXetnWHO_0 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10630008108265984232', time=2024-09-12T19:53:22.390901+0000, chain.objs.size()=1 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jB_mEi6BH3qv8yFUcYLEKA6P-vMstYd_0 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15419690088301332994', time=2024-09-12T19:53:22.425163+0000, chain.objs.size()=1 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MNMHp9FKXdQHweN29M0n-4QrBJtRHOa_0 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5698347410710042593', time=2024-09-12T19:53:22.434117+0000, chain.objs.size()=1 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.44rL-Blvc8dNyybnXajidft2XNiBLcj_0 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12204461760089755841', time=2024-09-12T19:53:22.580624+0000, chain.objs.size()=1 2024-09-12T18:01:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.156+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jqzbkIzGkF2HrBn_fJB6XydaiN77E3N_0 2024-09-12T18:01:04.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.157+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7245509497190171324', time=2024-09-12T19:53:22.609428+0000, chain.objs.size()=1 2024-09-12T18:01:04.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.157+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xy3z8l2hrS8M_oXWp_fC0CGe9XFPJps_0 2024-09-12T18:01:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13666329932530028073', time=2024-09-12T19:53:22.645222+0000, chain.objs.size()=1 2024-09-12T18:01:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lWL3MAS8SvIlb5SubWyGZsE5Tgjzlop_0 2024-09-12T18:01:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1296153486748782978', time=2024-09-12T19:53:22.652236+0000, chain.objs.size()=1 2024-09-12T18:01:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.NvOajQK8CT662vrTj49x2Ym6ZNJ8b33_0 2024-09-12T18:01:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1365031104159746501', time=2024-09-12T19:53:23.672051+0000, chain.objs.size()=1 2024-09-12T18:01:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.268__shadow_.SbtatksoiZmEYmy8h--9RhK88p5q4QG_0 2024-09-12T18:01:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1292466612873344587', time=2024-09-12T19:53:24.266201+0000, chain.objs.size()=1 2024-09-12T18:01:04.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.271__shadow_.imIfWymbOOgF4Z6eeK4FmnYR9s54nil_0 2024-09-12T18:01:04.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1980352983055231567', time=2024-09-12T19:53:28.545666+0000, chain.objs.size()=1 2024-09-12T18:01:04.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.291__shadow_.tCL2ZjOG4o8BKOCQXn3zTKh4sAxpAm7_0 2024-09-12T18:01:04.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8204640793373374107', time=2024-09-12T19:53:35.447451+0000, chain.objs.size()=1 2024-09-12T18:01:04.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.320__shadow:Cr2WObAYC-1kvv4qfOcOLcPt701TmWt_.85NA18uDdvh02OeemlVtMV6MW1hUhie_0 2024-09-12T18:01:04.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.161+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2294881044831956631', time=2024-09-12T19:53:44.557822+0000, chain.objs.size()=1 2024-09-12T18:01:04.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.161+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WQ99551nXenWnJWXHtYDUq-y4TUNA08_0 2024-09-12T18:01:04.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.162+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13936712478184380437', time=2024-09-12T19:53:44.572245+0000, chain.objs.size()=1 2024-09-12T18:01:04.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.162+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dqzK6on4AyupuoQiITBxl4qYD6A6Com_0 2024-09-12T18:01:04.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.162+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6067118578689794046', time=2024-09-12T19:53:44.607868+0000, chain.objs.size()=1 2024-09-12T18:01:04.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.162+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WnjVSei4T5QIytvqvhANNp0qnnYAWoe_0 2024-09-12T18:01:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.163+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13201073261421427872', time=2024-09-12T19:53:44.951585+0000, chain.objs.size()=1 2024-09-12T18:01:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.163+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HT_WN6Ak7z0JGhyQLUAZkSGi6iwhQ8Q_0 2024-09-12T18:01:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.163+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7966392387929473976', time=2024-09-12T19:53:44.997105+0000, chain.objs.size()=1 2024-09-12T18:01:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.163+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XaFOPpzGiKm2fE_GNByjfVNTLMriAPn_0 2024-09-12T18:01:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.163+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10059334022226374002', time=2024-09-12T19:53:45.341064+0000, chain.objs.size()=1 2024-09-12T18:01:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.163+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.F1axrKXn1VQzgdP7B6pZeJKpi2jvUzH_0 2024-09-12T18:01:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8927371653350093608', time=2024-09-12T19:53:45.359739+0000, chain.objs.size()=1 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LM9TqsNXuTDNd4YTXIEMmqcZeaHbhuy_0 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16598427392182294619', time=2024-09-12T19:53:45.542788+0000, chain.objs.size()=1 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mqrIzL_RMsHa6bIXEIYFWtmsfl2IObZ_0 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3643483280895141488', time=2024-09-12T19:53:45.551057+0000, chain.objs.size()=1 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LHo1sOfVh7_PB_s9va7m5rnyT0_vj0y_0 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.887129054875437129', time=2024-09-12T19:53:45.588175+0000, chain.objs.size()=1 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.l2ybPluo2twi_E9GwpEz6Dddmh_gsLk_0 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1260078157069246283', time=2024-09-12T19:53:45.590543+0000, chain.objs.size()=1 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lRhUUxzlInI5jxui-dS4gW0uJT0s-t7_0 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5553100199647265691', time=2024-09-12T19:53:45.609175+0000, chain.objs.size()=1 2024-09-12T18:01:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.164+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.E20b54HM4gqFBu_xVoqmsU5hajdcNBz_0 2024-09-12T18:01:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.167+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.739296798732212035', time=2024-09-12T19:53:45.785473+0000, chain.objs.size()=1 2024-09-12T18:01:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.167+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.U_qzY20y7sleIURxA4BcW-w89C6ACbU_0 2024-09-12T18:01:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.167+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14217039016096952504', time=2024-09-12T19:53:45.818262+0000, chain.objs.size()=1 2024-09-12T18:01:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.167+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yGshoIoTEm6I6UqFFKaBbZdvDA2fItD_0 2024-09-12T18:01:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.168+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2337631089389897272', time=2024-09-12T19:53:45.972168+0000, chain.objs.size()=1 2024-09-12T18:01:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TxBp1saaUEvVoNXkN_ri4b7-0qjvfb2_0 2024-09-12T18:01:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9402973772599131399', time=2024-09-12T19:53:46.002041+0000, chain.objs.size()=1 2024-09-12T18:01:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZaAZyswtuUayQRdLwMlR-lk5-gWzKW9_0 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5410834230318562275', time=2024-09-12T19:53:46.004294+0000, chain.objs.size()=1 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.PWWbOMFixAwdAjb7YKUEroD3fBkZ1KA_0 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16504027769128581937', time=2024-09-12T19:53:46.036011+0000, chain.objs.size()=1 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WXyaCx5D-H4fie2poUhIiDKtL72zeie_0 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6294759435710451585', time=2024-09-12T19:53:46.160808+0000, chain.objs.size()=1 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.l2SJgWuI0BRWfBtkpfUYVbcOxcl-w2S_0 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6895023092968587193', time=2024-09-12T19:53:46.173601+0000, chain.objs.size()=1 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0v1fbkvYGsioMawT--TjA_mLAzvIczZ_0 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10620988715885352737', time=2024-09-12T19:53:46.175494+0000, chain.objs.size()=1 2024-09-12T18:01:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.169+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.R8Ei6VLyFo6CwNFG1GlDp_woYDClwzR_0 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2583246456483259511', time=2024-09-12T19:53:46.186873+0000, chain.objs.size()=1 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UinbjzMlslxHISuKLpvLaXhaMul4SGT_0 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11685807367806524455', time=2024-09-12T19:53:46.187756+0000, chain.objs.size()=1 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AnojM58Z285qlwxHWH2aGSchKg5uGos_0 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6512862976928708548', time=2024-09-12T19:53:46.191684+0000, chain.objs.size()=1 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7VqRCR5jJ8QGqTbDmPpz9xBc0Ncf4jX_0 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15671357126704122136', time=2024-09-12T19:53:46.206089+0000, chain.objs.size()=1 2024-09-12T18:01:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.s3iVQGywuzQ_fPziw_v2K41ArEN0PtH_0 2024-09-12T18:01:04.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.172+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17171414916035059413', time=2024-09-12T19:53:46.226760+0000, chain.objs.size()=1 2024-09-12T18:01:04.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.172+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9GbFWDJGg08EqkrePgFvX8gafMXVEqb_0 2024-09-12T18:01:04.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.173+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11337821328427509014', time=2024-09-12T19:53:46.227606+0000, chain.objs.size()=1 2024-09-12T18:01:04.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.173+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DQWxQYiTBkBt-Fh7x0iIjcrS6vPmVnW_0 2024-09-12T18:01:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12890698884283645233', time=2024-09-12T19:53:46.239553+0000, chain.objs.size()=1 2024-09-12T18:01:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uw1k9Hnm6-0lmMVlK-zBIXET8OYmZJE_0 2024-09-12T18:01:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10525752613487640248', time=2024-09-12T19:53:54.634013+0000, chain.objs.size()=1 2024-09-12T18:01:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4k5o4VMw3ArlSwh3GwR06ZNsXSDd-TE_0 2024-09-12T18:01:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.174+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15300509304311180705', time=2024-09-12T19:53:54.643277+0000, chain.objs.size()=1 2024-09-12T18:01:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.174+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.teVpJI0NM2Zrzz0cq5gPCP_VTTH_fWm_0 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.39994333321474827', time=2024-09-12T19:53:54.654129+0000, chain.objs.size()=1 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.St4kf_MTP35iDA_PR1UVMQ4YL-sWqG8_0 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6730384689406699250', time=2024-09-12T19:53:54.709048+0000, chain.objs.size()=1 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._haL8BFxwM6HqgYJ2m_QBUuiiJEMiwt_0 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.137257064109324659', time=2024-09-12T19:53:54.841089+0000, chain.objs.size()=1 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.H4CgHIhEsqus9cuGPiDHkf_2jvUJubN_0 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18891123396108202', time=2024-09-12T19:53:54.862063+0000, chain.objs.size()=1 2024-09-12T18:01:04.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.175+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.e1qB0gSY6pMW8Il2wdTkekvoVzSl1EJ_0 2024-09-12T18:01:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.176+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5861932922717263301', time=2024-09-12T19:53:54.925821+0000, chain.objs.size()=1 2024-09-12T18:01:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.176+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NKpgWIo_S-CzPqiawf9r3YV8-lbLb-Q_0 2024-09-12T18:01:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.176+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12609392186361764941', time=2024-09-12T19:53:54.950696+0000, chain.objs.size()=1 2024-09-12T18:01:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.176+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fokHssfpxY0hSuG72okGSPNYPHd33-n_0 2024-09-12T18:01:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.177+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2969261211281482166', time=2024-09-12T19:53:54.968040+0000, chain.objs.size()=1 2024-09-12T18:01:04.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.177+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.14oLNfGEnpyV3Ly6J4T1JeR9zheLhA9_0 2024-09-12T18:01:04.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.178+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4490571375919251448', time=2024-09-12T19:53:55.074988+0000, chain.objs.size()=1 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.W9y0TmXCwF3aA-6cAeaX37_kt3Wm2mr_0 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5303287549360764221', time=2024-09-12T19:53:55.081951+0000, chain.objs.size()=1 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.V6rFEVXlSA9_jYm55zeKivTbwEL-Zm-_0 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6915025045334084117', time=2024-09-12T19:53:55.159471+0000, chain.objs.size()=1 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gU0xUiaTpk5SWVLIFQrmpj4LELDX5aB_0 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9428402192319639271', time=2024-09-12T19:53:55.291320+0000, chain.objs.size()=1 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aWDbWbkjl_SA8hzkkwedZGn8cRx0cvi_0 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9858934502661247318', time=2024-09-12T19:53:55.351940+0000, chain.objs.size()=1 2024-09-12T18:01:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lw_DpYCi3b5WqICOy6rZALFgtLoUh-c_0 2024-09-12T18:01:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.180+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5808831582375151552', time=2024-09-12T19:53:55.503286+0000, chain.objs.size()=1 2024-09-12T18:01:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.180+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.n2Vq4EURfY7XMBDz_ES1oHKIiorzfYq_0 2024-09-12T18:01:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.180+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18410547176177123133', time=2024-09-12T19:53:55.528599+0000, chain.objs.size()=1 2024-09-12T18:01:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.180+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bjWp2wjwbr3fiCXg8akuav9natFSqIr_0 2024-09-12T18:01:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.182+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7959168943735285858', time=2024-09-12T19:53:55.550300+0000, chain.objs.size()=1 2024-09-12T18:01:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.182+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nzplsoIUOL2JM4aF41VLFFc6yz21w6u_0 2024-09-12T18:01:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.182+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1797055046841104654', time=2024-09-12T19:53:55.580677+0000, chain.objs.size()=1 2024-09-12T18:01:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.182+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2pdFSl-mrBUYVqSXax26OEeqcDbtgYg_0 2024-09-12T18:01:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.182+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10778699422572971975', time=2024-09-12T19:53:55.593830+0000, chain.objs.size()=1 2024-09-12T18:01:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.182+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._KgLTb1XiHYCAiNKaIKBlq1NRG2sMnH_0 2024-09-12T18:01:04.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.186+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/54747 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13426866086927155425', time=2024-09-12T19:53:55.718560+0000, chain.objs.size()=1 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.s9JpfVNcueNcXxHwicFuUz88KhI84N-_0 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7087085023629454411', time=2024-09-12T19:53:55.723748+0000, chain.objs.size()=1 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5ECoAJD-DQYfnWAHzs30Uoo2uHhqYfD_0 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.326082191892209579', time=2024-09-12T19:53:55.756585+0000, chain.objs.size()=1 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wpCLcHUjQEVQm9JQ9k4tGemRM74qTNt_0 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14228263801247930421', time=2024-09-12T19:53:55.819115+0000, chain.objs.size()=1 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.KYeZQ72KgxkFCapROlLfANqMTwiYXh8_0 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18335373647935195305', time=2024-09-12T19:53:55.913097+0000, chain.objs.size()=1 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.h6SYxfGRFOoUrCULt41rVTnk51wGdq6_0 2024-09-12T18:01:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11669193335778386986', time=2024-09-12T19:53:55.936603+0000, chain.objs.size()=1 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.188+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DpSBdWPtZKiqnKVeclGzSxvCk9rfOuC_0 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11653580457724003076', time=2024-09-12T19:53:56.133907+0000, chain.objs.size()=1 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QBz9JCBf7pRGj9PmOVWJSMCPRKH3iZR_0 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5673279863408175006', time=2024-09-12T19:53:57.607972+0000, chain.objs.size()=1 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.333__shadow_.rfVXaIHj2d_bPsj2p9u3NxpTYlzxCow_0 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13831391782378755815', time=2024-09-12T19:54:01.379062+0000, chain.objs.size()=1 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.354__shadow_.BT5VSSK2O_PlBS0GbVZpVcyz5A5H_UU_0 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6035942266631456098', time=2024-09-12T19:54:06.973001+0000, chain.objs.size()=1 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.379__shadow_.M0GbpHokWH-i2rj1vQ-Fq1TDE5SyFu0_0 2024-09-12T18:01:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1145749124215339017', time=2024-09-12T19:54:08.050323+0000, chain.objs.size()=1 2024-09-12T18:01:04.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.383__shadow_.VGT6293S2UxyPVJZqNGuIqKt9Pa9VCO_0 2024-09-12T18:01:04.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5842284045196261819', time=2024-09-12T19:54:21.385443+0000, chain.objs.size()=1 2024-09-12T18:01:04.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.442__shadow_.9Bqfe3xX-FTcQbZECqCTSXGUoy8MK6J_0 2024-09-12T18:01:04.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5452090565903814759', time=2024-09-12T19:54:21.965570+0000, chain.objs.size()=1 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.444__shadow_.qHXBMhSCZYq7ScjbxsYPzao7kNtHGP8_0 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.876898586056753613', time=2024-09-12T19:54:23.489165+0000, chain.objs.size()=1 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.451__shadow_.4WRMHkoSwm5X3U06wuv9QmY0WKgaxEs_0 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2850796365287402341', time=2024-09-12T19:54:24.643480+0000, chain.objs.size()=1 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.456__shadow_.F7x5mrv9JT0VUMN45MB983e5g9iC7b7_0 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7402689646710839676', time=2024-09-12T19:54:28.155700+0000, chain.objs.size()=1 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.466__shadow_.Vs96mZcctaIh8QHGjJN0-znJhqRftRt_0 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17673462781804236565', time=2024-09-12T19:55:23.240255+0000, chain.objs.size()=3 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.553__shadow_.EFfE5ictNgmLLtdpHnojBLfy7BtqXFK_0 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.553__shadow_.EFfE5ictNgmLLtdpHnojBLfy7BtqXFK_1 2024-09-12T18:01:04.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.553__shadow_.EFfE5ictNgmLLtdpHnojBLfy7BtqXFK_2 2024-09-12T18:01:04.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17668264022512275825', time=2024-09-12T19:55:34.840024+0000, chain.objs.size()=1 2024-09-12T18:01:04.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:7vi2ciTvvj9dLlNF2HhsRE7d5LzvSLL_.lguSOtUqEAvILLw--8Y2qVAv2n9lMbY_0 2024-09-12T18:01:04.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9408177531272146723', time=2024-09-12T19:55:49.268132+0000, chain.objs.size()=1 2024-09-12T18:01:04.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:MvXj8OnGfuOi7VWTLXiJeOlnzvAWSuO_.AWbBfnnBDBYGwYnx640eUZnwG8X_MJz_0 2024-09-12T18:01:04.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5550488373088668136', time=2024-09-12T19:56:13.624785+0000, chain.objs.size()=12 2024-09-12T18:01:04.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__multipart_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.1 2024-09-12T18:01:04.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__shadow_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.1_1 2024-09-12T18:01:04.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.197+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__multipart_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.2 2024-09-12T18:01:04.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__shadow_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.2_1 2024-09-12T18:01:04.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__multipart_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.3 2024-09-12T18:01:04.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__shadow_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.3_1 2024-09-12T18:01:04.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__multipart_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.4 2024-09-12T18:01:04.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__shadow_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.4_1 2024-09-12T18:01:04.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__multipart_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.5 2024-09-12T18:01:04.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__shadow_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.5_1 2024-09-12T18:01:04.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__multipart_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.6 2024-09-12T18:01:04.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.616__shadow_multipart_enc.2~OeI9h5rb-c2T2vH_uUUX88MeQ5nhg3p.6_1 2024-09-12T18:01:04.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9783537273592114580', time=2024-09-12T19:58:25.250664+0000, chain.objs.size()=1 2024-09-12T18:01:04.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.651__shadow_.OpAY8XUOdgYmiLB6SA5tBPdaiXqsv2c_0 2024-09-12T18:01:04.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3048360073996666764', time=2024-09-12T19:58:29.228024+0000, chain.objs.size()=6 2024-09-12T18:01:04.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.661__multipart_bar.2~sEpLHOe3eJurjolh7Um1ZYWKcqTXDxM.1 2024-09-12T18:01:04.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.206+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.661__multipart_bar.2~sEpLHOe3eJurjolh7Um1ZYWKcqTXDxM.2 2024-09-12T18:01:04.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.206+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.661__multipart_bar.2~sEpLHOe3eJurjolh7Um1ZYWKcqTXDxM.3 2024-09-12T18:01:04.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.661__multipart_bar.2~sEpLHOe3eJurjolh7Um1ZYWKcqTXDxM.4 2024-09-12T18:01:04.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.661__multipart_bar.2~sEpLHOe3eJurjolh7Um1ZYWKcqTXDxM.5 2024-09-12T18:01:04.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.661__multipart_bar.2~sEpLHOe3eJurjolh7Um1ZYWKcqTXDxM.6 2024-09-12T18:01:04.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8707367065273206642', time=2024-09-12T19:58:36.657212+0000, chain.objs.size()=1 2024-09-12T18:01:04.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.697__shadow:kmTJ0E.S9jQfton7MypNAUkf7eepQ3N_.NWpIFXU53jNnFffukq7HFddlWd5Bs9b_0 2024-09-12T18:01:04.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.211+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.214+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:01:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45053' 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_DuNWsXrpkbVHKyfMb-bCv8GSc912tCu', time=2024-09-12T19:52:00.056813+0000, chain.objs.size()=3 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.cXLh1vFtMB4vRTxwHDpNDAPTQadS2Px_0 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.cXLh1vFtMB4vRTxwHDpNDAPTQadS2Px_1 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.cXLh1vFtMB4vRTxwHDpNDAPTQadS2Px_2 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15957978430829900253', time=2024-09-12T19:53:08.771531+0000, chain.objs.size()=1 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.242__shadow_.NLoPOsc0coHMHzpbJXMGZ5vw8LJ8N3U_0 2024-09-12T18:01:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1136764478392037062', time=2024-09-12T19:53:09.502878+0000, chain.objs.size()=1 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.245__shadow_.Arnvpb_6NQIHIFdWFgKgF-33VmgK94R_0 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1692480751325495108', time=2024-09-12T19:53:21.165039+0000, chain.objs.size()=1 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WACS_S4WaB87EXhwulaOb7WWBQVk1BI_0 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.274884273544228851', time=2024-09-12T19:53:21.181461+0000, chain.objs.size()=1 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.d2PUYFTPmMIQsNQD1BeK3nYRfmAFOuw_0 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1353987866549581557', time=2024-09-12T19:53:21.183430+0000, chain.objs.size()=1 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EJi-vZBXejwo93gBcRbWn1IFdWP_-zf_0 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10548192477087548522', time=2024-09-12T19:53:21.186202+0000, chain.objs.size()=1 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2Lz_nT_EUWL6M2ZnS6YG68FNHSCb-n-_0 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3025254268358749125', time=2024-09-12T19:53:21.244880+0000, chain.objs.size()=1 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PR_y-IjyPtsWzLnqOM-tBSsHDi_4x-3_0 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6172368333965420653', time=2024-09-12T19:53:21.437905+0000, chain.objs.size()=1 2024-09-12T18:01:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.IkY-YGwuBwRjL65hM8yQVWyzHE8ZMGg_0 2024-09-12T18:01:04.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6343866637812276091', time=2024-09-12T19:53:21.461650+0000, chain.objs.size()=1 2024-09-12T18:01:04.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.29Cd1rRH8dAbc-VtNlTZLyzR-kleGrg_0 2024-09-12T18:01:04.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9108365751078090867', time=2024-09-12T19:53:21.575795+0000, chain.objs.size()=1 2024-09-12T18:01:04.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.f96Cav7CsrTk_ANgXM_BeuAvuI2NXFe_0 2024-09-12T18:01:04.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7075445489568471345', time=2024-09-12T19:53:21.615913+0000, chain.objs.size()=1 2024-09-12T18:01:04.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Huo0GwSFZvn7YJyIfuaCFSHWGQTtmqo_0 2024-09-12T18:01:04.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2457963060325434706', time=2024-09-12T19:53:21.629218+0000, chain.objs.size()=1 2024-09-12T18:01:04.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZwZ6lIG4bcBHPaICF2kRQZ32opuTo8S_0 2024-09-12T18:01:04.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6786275053012303749', time=2024-09-12T19:53:21.661743+0000, chain.objs.size()=1 2024-09-12T18:01:04.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Yj5juZcD85ErQAm4gbB7R2FcuQlo9Ud_0 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16213584017276250280', time=2024-09-12T19:53:21.801739+0000, chain.objs.size()=1 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.R_Y0mawdk1EI88yztl2rdrE-aOogPpC_0 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6436396840246546907', time=2024-09-12T19:53:21.809636+0000, chain.objs.size()=1 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.K2qn9fPZ9RlSlOe9Y2hE-c5UsxV6GgC_0 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4647747814559153823', time=2024-09-12T19:53:21.822146+0000, chain.objs.size()=1 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tM6fsuZlWytCeruTHDSz5dg5q3xw-UT_0 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6742340616856956871', time=2024-09-12T19:53:21.852582+0000, chain.objs.size()=1 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Etn0xS3G7wTb53BmTBjbbmBa9enW7_A_0 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4291791247790824746', time=2024-09-12T19:53:21.858054+0000, chain.objs.size()=1 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tM00HMyP3RmWbrLRWYgt5TsAc74v5gq_0 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4495425521518501566', time=2024-09-12T19:53:21.886223+0000, chain.objs.size()=1 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tSqFepBDX2ABJ7GIFZ7kbVu5_LezNER_0 2024-09-12T18:01:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4055129080671614377', time=2024-09-12T19:53:21.981509+0000, chain.objs.size()=1 2024-09-12T18:01:04.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.222+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XdO5fNVQhQwY4BF2b4w0nR69-88cbfd_0 2024-09-12T18:01:04.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.224+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3090562636936586426', time=2024-09-12T19:53:21.983747+0000, chain.objs.size()=1 2024-09-12T18:01:04.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.224+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vxCT4tLHH5dx50yCf52Qn5ImodEmeND_0 2024-09-12T18:01:04.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.225+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6191609295922841626', time=2024-09-12T19:53:22.011309+0000, chain.objs.size()=1 2024-09-12T18:01:04.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.225+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BbB4Uqg4CoaCDJgbrrKjWOOWEoNs-_4_0 2024-09-12T18:01:04.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.225+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15830012106520979516', time=2024-09-12T19:53:22.042060+0000, chain.objs.size()=1 2024-09-12T18:01:04.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.225+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tSlTNMe9tDsI6Ii1Lfu30sTqMnq348B_0 2024-09-12T18:01:04.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.225+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1338549528742032481', time=2024-09-12T19:53:22.068091+0000, chain.objs.size()=1 2024-09-12T18:01:04.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.225+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.f1dQ9qIiJigX1Pp3j6hySoYvhihzdBj_0 2024-09-12T18:01:04.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.227+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16988251713999353720', time=2024-09-12T19:53:22.096966+0000, chain.objs.size()=1 2024-09-12T18:01:04.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.227+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.72z07aFVlXwdP5itJPFMTYCCp4zZvIh_0 2024-09-12T18:01:04.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.227+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15421056053209557640', time=2024-09-12T19:53:22.186954+0000, chain.objs.size()=1 2024-09-12T18:01:04.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.227+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RNS8sDu2cPdHTU3syZ9rDNIBe9Qxa1x_0 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13928812141847373107', time=2024-09-12T19:53:22.270857+0000, chain.objs.size()=1 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MjG199YsGao9OSJEf_RWY6qi0mFRxKx_0 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2618649025810848566', time=2024-09-12T19:53:22.390913+0000, chain.objs.size()=1 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8ZA5bIhkqxmq009z4-ataXl5TkOHpgV_0 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10150618728085332113', time=2024-09-12T19:53:22.408628+0000, chain.objs.size()=1 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pR4l2n3xAwAAH0hKNKNksbztZdyGrGp_0 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14897605843586880069', time=2024-09-12T19:53:22.409635+0000, chain.objs.size()=1 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tb7zkLpeDgpwhXVV6gTVSY8rD1mzQP5_0 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9409614709442893302', time=2024-09-12T19:53:22.415067+0000, chain.objs.size()=1 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xs-DSS2Zn2oKBR_rHHx6D_lSySDz5lu_0 2024-09-12T18:01:04.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.704335134870145669', time=2024-09-12T19:53:22.456006+0000, chain.objs.size()=1 2024-09-12T18:01:04.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._-EYXy6HnkP4-9TsRl1hEG5cuCzOX28_0 2024-09-12T18:01:04.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.229+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6677125492748788830', time=2024-09-12T19:53:22.474468+0000, chain.objs.size()=1 2024-09-12T18:01:04.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.229+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vRk8yC1sRhrxomSSNqdL1KG7eXpXnOg_0 2024-09-12T18:01:04.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.229+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2324860917815330206', time=2024-09-12T19:53:22.601846+0000, chain.objs.size()=1 2024-09-12T18:01:04.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.229+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HWgS05c32KS3-3YZQnj9pFiqf41iQrG_0 2024-09-12T18:01:04.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.230+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10926320877924213330', time=2024-09-12T19:53:22.638779+0000, chain.objs.size()=1 2024-09-12T18:01:04.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.230+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PlpCd86KrYA_unUJ2t-9ND9-ezqx-OB_0 2024-09-12T18:01:04.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.231+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11873999107510767037', time=2024-09-12T19:53:22.663910+0000, chain.objs.size()=1 2024-09-12T18:01:04.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.231+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OZEpzxcSWGxUClNHboT2P7GLwczbqWz_0 2024-09-12T18:01:04.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.232+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16481095726342335146', time=2024-09-12T19:53:22.668118+0000, chain.objs.size()=1 2024-09-12T18:01:04.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.232+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8bLDu3T1kXXwYPp_LYlRcqWBA_xUj-__0 2024-09-12T18:01:04.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.232+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2324694939652818289', time=2024-09-12T19:53:25.297582+0000, chain.objs.size()=1 2024-09-12T18:01:04.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.232+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.276__shadow_.NeedZQ7fZaCGcck0aq-kpyeRtqhxJP5_0 2024-09-12T18:01:04.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.233+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2580305888407782651', time=2024-09-12T19:53:25.503942+0000, chain.objs.size()=1 2024-09-12T18:01:04.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.233+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.277__shadow_.8eJvFzjpyv7r2jeBoUoymRFrQXelOfR_0 2024-09-12T18:01:04.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.233+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10239002566709687975', time=2024-09-12T19:53:25.914478+0000, chain.objs.size()=1 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.233+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.279__shadow_.7Ynr0l6BmcbzvDAO_MbZc4-xWuMNig2_0 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4922300365855891411', time=2024-09-12T19:53:28.547469+0000, chain.objs.size()=1 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.291__shadow_.jvmiI0ytGMYYORaCZeCrfdiYVScOewa_0 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14585588330099888627', time=2024-09-12T19:53:29.342088+0000, chain.objs.size()=1 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.J3IVbcK157xJaHd7gzBQ14v7IYTKyto_0 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10770441299775475321', time=2024-09-12T19:53:29.354834+0000, chain.objs.size()=1 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.V7Mtt6phUdZdzvreDlYBcqHVuBMgrCj_0 2024-09-12T18:01:04.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10997718486184402316', time=2024-09-12T19:53:29.936690+0000, chain.objs.size()=1 2024-09-12T18:01:04.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.iRikv-DcfZHEMyQcV2YmPWVX7XqAD14_0 2024-09-12T18:01:04.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.964341581110094774', time=2024-09-12T19:53:29.940549+0000, chain.objs.size()=1 2024-09-12T18:01:04.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.234+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.OXsYT_w6EiE69cFOFoma3gqKJWpznpi_0 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12878398167045639844', time=2024-09-12T19:53:29.951762+0000, chain.objs.size()=1 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.fExOctjhlCuahXdPS68KTsrrFrVr-uF_0 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14822239261496712094', time=2024-09-12T19:53:31.526314+0000, chain.objs.size()=1 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.301__shadow_.kAERiu_u-p7iBTMbHknk-wC5RNwCK38_0 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2134616653013004360', time=2024-09-12T19:53:31.774448+0000, chain.objs.size()=1 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.302__shadow_.sgZypqAwS1Ta2FX7ZiwDkSuxMahtfco_0 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10626139051189598780', time=2024-09-12T19:53:44.543265+0000, chain.objs.size()=1 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.k0nads7XLX8rPgvjmojBjxGrM6sVIfB_0 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.845361863292372775', time=2024-09-12T19:53:44.553287+0000, chain.objs.size()=1 2024-09-12T18:01:04.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.237+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LuufA9o-szbk_7dH5tYZqi-m-m1IGsk_0 2024-09-12T18:01:04.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2614974177937946975', time=2024-09-12T19:53:44.598992+0000, chain.objs.size()=1 2024-09-12T18:01:04.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.e3eGtnktjINrpTnQeKk1SPoeVx10w9Y_0 2024-09-12T18:01:04.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6780764386459531577', time=2024-09-12T19:53:44.922394+0000, chain.objs.size()=1 2024-09-12T18:01:04.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0AVbBWkH-mGwqEOmIWYwfWEO1-E2OH3_0 2024-09-12T18:01:04.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16524819428278212328', time=2024-09-12T19:53:44.942926+0000, chain.objs.size()=1 2024-09-12T18:01:04.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fflWVM1d8uFxKXqjCOlRv1ZGsndpial_0 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2426395374899522514', time=2024-09-12T19:53:44.952982+0000, chain.objs.size()=1 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kiHsMBbdtu8HcTpdiv950XyrhZOPetg_0 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12602643558812769641', time=2024-09-12T19:53:44.995523+0000, chain.objs.size()=1 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MWQp2BPkHFQwPWnAbbzIIVPgtMl7UPO_0 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16490457383050181681', time=2024-09-12T19:53:45.129097+0000, chain.objs.size()=1 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.240+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5USP8ZQNdaBZGl0XIeTuUVJbZ8AyNgu_0 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.241+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8654409751343993050', time=2024-09-12T19:53:45.132888+0000, chain.objs.size()=1 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.241+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FEi58BYwcN5L5p5ATFMA4vngzRVS--9_0 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.241+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11783299423725248798', time=2024-09-12T19:53:45.152011+0000, chain.objs.size()=1 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.241+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.J-nCLR-AWosMEI8duDBy024bdn3u-cZ_0 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.241+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1451205598612922421', time=2024-09-12T19:53:45.153137+0000, chain.objs.size()=1 2024-09-12T18:01:04.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.241+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-ncnEFtT-2GUm4T-alLxTvK1VG8Pzqs_0 2024-09-12T18:01:04.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10585184044277926250', time=2024-09-12T19:53:45.162268+0000, chain.objs.size()=1 2024-09-12T18:01:04.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ErgaoVpqSHisAsPSp-2FV4hPhOj17z4_0 2024-09-12T18:01:04.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4881319732821296426', time=2024-09-12T19:53:45.164984+0000, chain.objs.size()=1 2024-09-12T18:01:04.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.C8v3B__lAy5aMEjlhaUXmOWDa6rWfm-_0 2024-09-12T18:01:04.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.243+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2968347872896252683', time=2024-09-12T19:53:45.197222+0000, chain.objs.size()=1 2024-09-12T18:01:04.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.243+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Qilar3tvq9XxrWjbbr_fY96YGLwgxwF_0 2024-09-12T18:01:04.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2564227773707743562', time=2024-09-12T19:53:45.242989+0000, chain.objs.size()=1 2024-09-12T18:01:04.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6aBfKo3i079aGDAFtX0KH8gf5TnhWiJ_0 2024-09-12T18:01:04.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12709099595157936720', time=2024-09-12T19:53:45.257524+0000, chain.objs.size()=1 2024-09-12T18:01:04.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.QnLbCm9t6XPyxZg5H2RVX1N8441Mx_2_0 2024-09-12T18:01:04.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13035245290786041962', time=2024-09-12T19:53:45.341539+0000, chain.objs.size()=1 2024-09-12T18:01:04.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-f3t8cUS7x7b2ooON3POUiD0405wECU_0 2024-09-12T18:01:04.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3739583664177718322', time=2024-09-12T19:53:45.409787+0000, chain.objs.size()=1 2024-09-12T18:01:04.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.245+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._GBmqLo12NPbvpPqEArxoOG8KEN9TIl_0 2024-09-12T18:01:04.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13505646952070243883', time=2024-09-12T19:53:45.542330+0000, chain.objs.size()=1 2024-09-12T18:01:04.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pnm9R7P4A0Tyo6cofgcL_4tikIRpB1U_0 2024-09-12T18:01:04.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12969822151193977723', time=2024-09-12T19:53:45.655020+0000, chain.objs.size()=1 2024-09-12T18:01:04.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.c4ayRWRUegL50AEkOe9wIX1nk4tnGOb_0 2024-09-12T18:01:04.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2748124669273250317', time=2024-09-12T19:53:45.776316+0000, chain.objs.size()=1 2024-09-12T18:01:04.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.eRHX5bsM6Z99pKv_Lf24m6ytgHK2aM__0 2024-09-12T18:01:04.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15272513461898941959', time=2024-09-12T19:53:45.777492+0000, chain.objs.size()=1 2024-09-12T18:01:04.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZiQaQmTg3fiQwk8V236Hv8j3jOMOhA7_0 2024-09-12T18:01:04.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3589216105507037875', time=2024-09-12T19:53:45.823460+0000, chain.objs.size()=1 2024-09-12T18:01:04.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VSVI3rtAzZe1AmCleB6UNnwGKXxwuXU_0 2024-09-12T18:01:04.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2510822162616431249', time=2024-09-12T19:53:45.856420+0000, chain.objs.size()=1 2024-09-12T18:01:04.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8VqXoZHC50gc4CoCiv8JAzxrlmXveT4_0 2024-09-12T18:01:04.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9065644117951160222', time=2024-09-12T19:53:45.865231+0000, chain.objs.size()=1 2024-09-12T18:01:04.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.247+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CS9VJYRjDsZlEoLhq8ezNH74Dgnjj0j_0 2024-09-12T18:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17561495741748726193', time=2024-09-12T19:53:45.984194+0000, chain.objs.size()=1 2024-09-12T18:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.J2YQXkPklEql0V6HNtmS-2SfiNgv4Us_0 2024-09-12T18:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5649053088303729579', time=2024-09-12T19:53:46.183156+0000, chain.objs.size()=1 2024-09-12T18:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cT6OUsvE0bcqpM-7wmSTb0Qc4Z7XMH9_0 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15626748162803937993', time=2024-09-12T19:53:46.189176+0000, chain.objs.size()=1 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wll5mmDmsWqVRGMpmOxL3MV2cuyMff8_0 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2034083435802583731', time=2024-09-12T19:53:46.213364+0000, chain.objs.size()=1 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Q7Vb31qD3OHuvmQKXJE4a44cBI0v63__0 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4694288040649341679', time=2024-09-12T19:53:54.637850+0000, chain.objs.size()=1 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rNryDOILv1PMZqgLcVhzvUD5BRsRYNy_0 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4846562115862289114', time=2024-09-12T19:53:54.655992+0000, chain.objs.size()=1 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8PzIV6aPHlagZpdPd08Mpj6kI4g9VQ8_0 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5266474531800567078', time=2024-09-12T19:53:54.693771+0000, chain.objs.size()=1 2024-09-12T18:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5JQOZGHK_kC7tBFpFlFAMF9ZDMEoNXZ_0 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.896380203357455931', time=2024-09-12T19:53:54.753218+0000, chain.objs.size()=1 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._xs8nlfLyxI1HlXyKbb0AQE13PWFgUj_0 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.737778384914312566', time=2024-09-12T19:53:54.757782+0000, chain.objs.size()=1 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xkUVJHK7M0nxVPPhZ4Lu_Yh463n8qrf_0 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4482747387518365980', time=2024-09-12T19:53:54.845744+0000, chain.objs.size()=1 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CQyngu2Hfv4isNI0fC9Skr9ccN7tAyB_0 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15278376445228566470', time=2024-09-12T19:53:54.849338+0000, chain.objs.size()=1 2024-09-12T18:01:04.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.254+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vpQ5CfRlt-075Qwr7kw-G81q0Bx12gu_0 2024-09-12T18:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.257+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.275418028339354254', time=2024-09-12T19:53:54.878409+0000, chain.objs.size()=1 2024-09-12T18:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.257+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Cv-5ojqA3jjZejUvdDT4CKaHlwZ34or_0 2024-09-12T18:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.258+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5711326808958744543', time=2024-09-12T19:53:54.946929+0000, chain.objs.size()=1 2024-09-12T18:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.258+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TzavTax6ar9pkcFlqhe8POhCPrDMaeJ_0 2024-09-12T18:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.258+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10008342330494412123', time=2024-09-12T19:53:55.099332+0000, chain.objs.size()=1 2024-09-12T18:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.258+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._Jyb96hFNXk-lM16K3YOljQGqEc_p_z_0 2024-09-12T18:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.258+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5129982508285172728', time=2024-09-12T19:53:55.118998+0000, chain.objs.size()=1 2024-09-12T18:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.258+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2dg3N1dJjzX4-BmXX0-P0l0fQiZ0_sW_0 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12710969842565069797', time=2024-09-12T19:53:55.137241+0000, chain.objs.size()=1 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.H0lHPd6KOhfGxNKiQypK1jlb72HO1B3_0 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14181613502874506791', time=2024-09-12T19:53:55.264594+0000, chain.objs.size()=1 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bia3yB_8Wy14AXCNnkln5bi-GnSGZci_0 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9709807282269774664', time=2024-09-12T19:53:55.284842+0000, chain.objs.size()=1 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sE_SPV3IQKiA0N5g1CvGHI0Lni3qUF7_0 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18079018847973253579', time=2024-09-12T19:53:55.295140+0000, chain.objs.size()=1 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.97YuZCR-ubMN3iwz3bfWLoyWAXg1x8B_0 2024-09-12T18:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5501894730687709021', time=2024-09-12T19:53:55.361193+0000, chain.objs.size()=1 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5JosOOcDiihlXLHfL_Qv9hR0DNLoDrm_0 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12483399110024187714', time=2024-09-12T19:53:55.365579+0000, chain.objs.size()=1 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gQr8r9hQFSmblV96Y_aHVuJmIBZZsNv_0 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5959382221901968414', time=2024-09-12T19:53:55.501067+0000, chain.objs.size()=1 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qab-qa7E8KOewyL__SDvYYQWh83Buco_0 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8196861689879439986', time=2024-09-12T19:53:55.519750+0000, chain.objs.size()=1 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.260+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NGnWiDyFWTxK_i_-SeBPOAZFstf4bhk_0 2024-09-12T18:01:04.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.261+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18174192638497821820', time=2024-09-12T19:53:55.582040+0000, chain.objs.size()=1 2024-09-12T18:01:04.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Lxm-8zcPQ-1PszRqOos9b8pyvgwkndA_0 2024-09-12T18:01:04.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.263+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3577187687031488786', time=2024-09-12T19:53:55.596185+0000, chain.objs.size()=1 2024-09-12T18:01:04.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.263+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.H6Zo3vUtwHHMQ8_j4LqSCjJNNEttKf6_0 2024-09-12T18:01:04.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.263+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11924682622190187539', time=2024-09-12T19:53:55.609384+0000, chain.objs.size()=1 2024-09-12T18:01:04.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.263+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.iEe3ZHa2IpPh40GrPSVRNN5AekH8Xpg_0 2024-09-12T18:01:04.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.267+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/45053 2024-09-12T18:01:04.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15698612876035193074', time=2024-09-12T19:53:55.740748+0000, chain.objs.size()=1 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wNZaW99Wr2PbhRDeKwj5zCDHrTNOB1o_0 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11281642787441115539', time=2024-09-12T19:53:55.748291+0000, chain.objs.size()=1 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nRTySks8OwJqaZLF47jrgW0CYxt0zI2_0 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3583898413344989089', time=2024-09-12T19:53:55.754362+0000, chain.objs.size()=1 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lYhTkyaABPQWJGQOYmbpW5MtKlVP2SA_0 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13734431050284644079', time=2024-09-12T19:53:55.787544+0000, chain.objs.size()=1 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wgUr9FikQBEtc6s2F1GES9i2Ac9RA6J_0 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3518495133837114194', time=2024-09-12T19:53:55.826461+0000, chain.objs.size()=1 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DlmyvkhoJ5RcYUxTfqdaGIZe-vuLf50_0 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9972986514399185331', time=2024-09-12T19:53:55.919244+0000, chain.objs.size()=1 2024-09-12T18:01:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4PeSLwQBaa4zZkbZeD5L64lsLf5X8dz_0 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9056703375627119399', time=2024-09-12T19:53:55.925056+0000, chain.objs.size()=1 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fcGJalxoINB-tRHVichvD5AP1suxa78_0 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16313266772767221619', time=2024-09-12T19:53:55.925903+0000, chain.objs.size()=1 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GIUv601r2fJjLSr-QuyAsROcmEfyiXu_0 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9936522759870196361', time=2024-09-12T19:53:55.934502+0000, chain.objs.size()=1 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FedNEehHoUMKDOl3Yb5wQeiE1Wpn9Ok_0 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10441326435660860165', time=2024-09-12T19:53:56.102619+0000, chain.objs.size()=1 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hc3U-WTqGqKUOfXUWQlRO7x6ulMc6ZA_0 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8787006116694873831', time=2024-09-12T19:53:56.152317+0000, chain.objs.size()=1 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xcAokRdVapGxIRdE1GWDjr-OmWc-x-T_0 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10288234061842731215', time=2024-09-12T19:53:56.156550+0000, chain.objs.size()=1 2024-09-12T18:01:04.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.269+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qjcxB7PLLhkv_lGPVpRY0PZ0SdruPpA_0 2024-09-12T18:01:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.272+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11176380404862808486', time=2024-09-12T19:53:59.629133+0000, chain.objs.size()=1 2024-09-12T18:01:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.272+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.343__shadow_.KnyJoFsVCoi9yPxA4fd_wtw1xu6fkNG_0 2024-09-12T18:01:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9363452677510016435', time=2024-09-12T19:54:27.717235+0000, chain.objs.size()=1 2024-09-12T18:01:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.465__shadow_.s5dW51u_ZMFe4wKVYgnT5blBqVmEKt6_0 2024-09-12T18:01:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4877778242579025682', time=2024-09-12T19:54:27.835472+0000, chain.objs.size()=1 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.465__shadow_.WlOyrzmoT8YXMsUWt2omAW6viQ0ENby_0 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6348211177258994791', time=2024-09-12T19:54:32.870311+0000, chain.objs.size()=1 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.490__shadow_.N2WhLR1eSUApO6fUj75HU8HiXCap3iK_0 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1283341365900383816', time=2024-09-12T19:54:38.075832+0000, chain.objs.size()=6 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.1 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.2 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.3 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.4 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.5 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.6 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12343363285556051998', time=2024-09-12T19:54:38.076759+0000, chain.objs.size()=6 2024-09-12T18:01:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.274+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.1 2024-09-12T18:01:04.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.276+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.2 2024-09-12T18:01:04.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.278+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.3 2024-09-12T18:01:04.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.278+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.4 2024-09-12T18:01:04.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.278+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.5 2024-09-12T18:01:04.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.278+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.6 2024-09-12T18:01:04.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.279+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6845590969753206075', time=2024-09-12T19:54:40.643098+0000, chain.objs.size()=1 2024-09-12T18:01:04.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.279+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.519__multipart_mymultipart.2~v1-qBsvK10kP3CLA1dHsNbd53vuCnM9.1 2024-09-12T18:01:04.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.279+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7790578456434498577', time=2024-09-12T19:55:36.879682+0000, chain.objs.size()=1 2024-09-12T18:01:04.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.279+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:Vgkym8mkamWQZv4tuwp3tuBOnn0PmM7_.l3xZZSegOx1jLEsLbmrT5yFpnMb3-K2_0 2024-09-12T18:01:04.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.279+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5388741050601801315', time=2024-09-12T19:55:46.227786+0000, chain.objs.size()=1 2024-09-12T18:01:04.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.279+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:NRB961OQ92drCiBFVOAG4oWQ2UzSiyD_.CA5UFAYZPJS9mglT6_-w4ugiRJkHwK2_0 2024-09-12T18:01:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2110887335651010924', time=2024-09-12T19:55:51.326496+0000, chain.objs.size()=1 2024-09-12T18:01:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:6bsylfOuO3ErC24xjqVoeoCMCLpSHE2_.4MyHjv-4RLV_xmOsHmRrVwuaA1RcNYf_0 2024-09-12T18:01:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18118489513309230744', time=2024-09-12T19:55:59.409163+0000, chain.objs.size()=1 2024-09-12T18:01:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:bz32L5KMSZs1I5oZpnb-nftqKt5B4zc_.OjPKRQBkmcmqNsvT8HidU3v-xlizrrH_0 2024-09-12T18:01:04.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9479814637372872887', time=2024-09-12T19:56:03.074814+0000, chain.objs.size()=1 2024-09-12T18:01:04.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:6OQFdRzGi.ynuCPaE4dP4RwUZjL9Sev_.HFzP5Z_2qQMprS5fGwgqifwSZ_OqWc7_0 2024-09-12T18:01:04.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.250437371053332306', time=2024-09-12T19:58:30.434159+0000, chain.objs.size()=1 2024-09-12T18:01:04.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.280+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.666__shadow_.VJOva-cQNnBd0oletsQCT6TSgVy9a2c_0 2024-09-12T18:01:04.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.282+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14496315157850366916', time=2024-09-12T19:58:33.339195+0000, chain.objs.size()=1 2024-09-12T18:01:04.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.282+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.680__shadow_.vDAefTZASKHYwu5K8dqTerlPVkqeTLJ_0 2024-09-12T18:01:04.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.282+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4046420397246541540', time=2024-09-12T19:58:35.551754+0000, chain.objs.size()=1 2024-09-12T18:01:04.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.282+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.692__shadow_.FujV0ovq5rLS7L4syVhOr5uVVuBU9hE_0 2024-09-12T18:01:04.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.282+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12187189188457670498', time=2024-09-12T19:58:37.248898+0000, chain.objs.size()=1 2024-09-12T18:01:04.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.282+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.700__shadow:sGCoyLmsHcEVAypoE946hRbbVr1hMdw_.K4iIeEEFfBgjRQexYhTIRbvwo-WNnjl_0 2024-09-12T18:01:04.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.283+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9124033231478992755', time=2024-09-12T19:58:38.429501+0000, chain.objs.size()=1 2024-09-12T18:01:04.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.283+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.705__shadow:.hWgMrkVQofFGp13G4cZvAui3mAJaDV_.sn6AkRhoAVc24etPzb4vacjrNeq6n5d_0 2024-09-12T18:01:04.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.286+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.289+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:01:04.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.291+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.291+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/68630' 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_K5g9vyJNGJhgJNDcvVE4uVWCxTaxC46', time=2024-09-12T19:52:00.062085+0000, chain.objs.size()=1 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.GBUQU9WRln87_C5X7SC1-aH73dLsnq8_0 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5445971776615229794', time=2024-09-12T19:53:21.173174+0000, chain.objs.size()=1 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bAn_Bun4cK6FgE9NhCrzxsh540qt2LX_0 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13114726288321851998', time=2024-09-12T19:53:21.183897+0000, chain.objs.size()=1 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nnxFDl9nf8cE3wURR1mFT3q_87u1HzU_0 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10819095759389263396', time=2024-09-12T19:53:21.209155+0000, chain.objs.size()=1 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fhsoJywEyxLBx5vu41IqNYiM0QpY62H_0 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17306752945821942935', time=2024-09-12T19:53:21.229124+0000, chain.objs.size()=1 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.njIAsfvLWfc9o0utLiMYJCt6MvTAHN6_0 2024-09-12T18:01:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14391483089265365162', time=2024-09-12T19:53:21.280908+0000, chain.objs.size()=1 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.UpCnkRcHrNCbsYCBUYOTevHU6tHChJ7_0 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10166414190923230989', time=2024-09-12T19:53:21.366756+0000, chain.objs.size()=1 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.q0fv1ah7VH7CsUzsVpVrf7m4IJ6InYD_0 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12836085903340079583', time=2024-09-12T19:53:21.389874+0000, chain.objs.size()=1 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.veWDO6_X-InrXFMWLh6pqvCCxLc2xcC_0 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2854633443934542170', time=2024-09-12T19:53:21.400273+0000, chain.objs.size()=1 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zOdoYPm_KzsDFya0P0-vL7Nq__ycsSj_0 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4786516525712433742', time=2024-09-12T19:53:21.472484+0000, chain.objs.size()=1 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JeXjqbwoiOGwwplytCcBQSoxbIiEAWm_0 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15294463474202985962', time=2024-09-12T19:53:21.642428+0000, chain.objs.size()=1 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yO28zzcfwYn5cJcq-Oaf0Jbn0MnFNGJ_0 2024-09-12T18:01:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11755675635766509108', time=2024-09-12T19:53:21.782404+0000, chain.objs.size()=1 2024-09-12T18:01:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.292+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.15QRYqn6mEggK4l-dp6zJO-eTc8i-hY_0 2024-09-12T18:01:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.295+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5153001458267268782', time=2024-09-12T19:53:21.833648+0000, chain.objs.size()=1 2024-09-12T18:01:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.295+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.d0GEZ2MZx2SHWJdUy0rDU5XCtqXt9wZ_0 2024-09-12T18:01:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.296+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1362575031514004130', time=2024-09-12T19:53:21.848696+0000, chain.objs.size()=1 2024-09-12T18:01:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.296+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.l8aTlXwIIStDYYxvH8eF7_1KSCsMZRY_0 2024-09-12T18:01:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.297+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1120113964626220835', time=2024-09-12T19:53:21.871892+0000, chain.objs.size()=1 2024-09-12T18:01:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.297+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Hdf3CeJlN5iMmTZJCsunCbEBYGlMmf0_0 2024-09-12T18:01:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.297+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7466449665314479494', time=2024-09-12T19:53:21.895692+0000, chain.objs.size()=1 2024-09-12T18:01:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.297+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PM1Vd8fW7eKGCTTKTAF02Ypli5kyKWC_0 2024-09-12T18:01:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.297+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4821466751987070624', time=2024-09-12T19:53:21.976419+0000, chain.objs.size()=1 2024-09-12T18:01:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.297+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dR8Rt2g6JVl1qwZttG5zcAyWvptokZk_0 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15969084259488285141', time=2024-09-12T19:53:21.979410+0000, chain.objs.size()=1 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HU5d51Vmoy93u-wcZR3DmUuu_7YQy7c_0 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9779069433259386432', time=2024-09-12T19:53:21.998736+0000, chain.objs.size()=1 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gyL9ZnGWN2vYJWzA6QCDNSw50TtIzQR_0 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16427690289198559526', time=2024-09-12T19:53:22.013696+0000, chain.objs.size()=1 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lAigKicP5vqC9F3olwq3hHSe2UD20zO_0 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9769214220817394201', time=2024-09-12T19:53:22.041955+0000, chain.objs.size()=1 2024-09-12T18:01:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GXbBFW2Ve0fReDALmD16HsXFK8I0As0_0 2024-09-12T18:01:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17054789060579019250', time=2024-09-12T19:53:22.382395+0000, chain.objs.size()=1 2024-09-12T18:01:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nL2_SdO8qTyV0IuzyHXbvbd7Pv9oQoR_0 2024-09-12T18:01:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17791506700529507960', time=2024-09-12T19:53:22.406954+0000, chain.objs.size()=1 2024-09-12T18:01:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.298+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WKv5M9Es1rY5Cdm4iQV75F5RsP4P2Rl_0 2024-09-12T18:01:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12897756084025248456', time=2024-09-12T19:53:22.462173+0000, chain.objs.size()=1 2024-09-12T18:01:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bVGp_Kv6mN73impnS41WaruxK_eM-wi_0 2024-09-12T18:01:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4761048422331054883', time=2024-09-12T19:53:22.497001+0000, chain.objs.size()=1 2024-09-12T18:01:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zHmz22elSxVY2N7xwtgw3KIxHi3Lnpz_0 2024-09-12T18:01:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18305580497968709627', time=2024-09-12T19:53:22.499729+0000, chain.objs.size()=1 2024-09-12T18:01:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EK4IbmEkvviscCXHIociSIAS6Mwk8dY_0 2024-09-12T18:01:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13506880832815589505', time=2024-09-12T19:53:22.579067+0000, chain.objs.size()=1 2024-09-12T18:01:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FfvC-I3K8WPdhVMc_wLWDNgBqMTo_T9_0 2024-09-12T18:01:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1608284663139767610', time=2024-09-12T19:53:22.582562+0000, chain.objs.size()=1 2024-09-12T18:01:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wiSoDisYwhfajVgFZQVHkBTRmqcZNfY_0 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10070969553346529482', time=2024-09-12T19:53:22.613701+0000, chain.objs.size()=1 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MLT7g5aa3dudL_WKADKo4kFZ-0huos7_0 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3898505462335875946', time=2024-09-12T19:53:22.667759+0000, chain.objs.size()=1 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ao_uU3DFxL4djEM9ooBhKgo30YYo-N8_0 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10815816249169772287', time=2024-09-12T19:53:26.118157+0000, chain.objs.size()=1 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.303+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.280__shadow_.p8J_hMkYl_MbkEOl6cnSJV_-5b7Ui2i_0 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9354832310041090029', time=2024-09-12T19:53:29.353321+0000, chain.objs.size()=1 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.KTufGY2FUhtsteEPUn-nm3obFNIfIi4_0 2024-09-12T18:01:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7911340653315822737', time=2024-09-12T19:53:30.576941+0000, chain.objs.size()=1 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.297__shadow_.lJ0XtCvtkxsMsTsxffEgwBwV8VeWMqL_0 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16236846141619659048', time=2024-09-12T19:53:30.577935+0000, chain.objs.size()=1 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.297__shadow_.2H5XtJzqg_2_afBks0FodKIsYtql8hd_0 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11365593624632592272', time=2024-09-12T19:53:31.775979+0000, chain.objs.size()=1 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.302__shadow_.2wUyDyw440_3vGDwgdEOB7sDITkbx7J_0 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17722454946601794767', time=2024-09-12T19:53:35.450511+0000, chain.objs.size()=1 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.320__shadow:tdOP.03WIl2VGCHXFOfx9kWL1Iss1u3_.DN4_0KnjEcPEM_AUyawXWRASjspS--B_0 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9992708144940533547', time=2024-09-12T19:53:44.523081+0000, chain.objs.size()=1 2024-09-12T18:01:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.304+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dsDMTyZnsGUIg89yTDXU_H5sXCRiMgr_0 2024-09-12T18:01:04.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.308+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7806948244646080932', time=2024-09-12T19:53:44.564246+0000, chain.objs.size()=1 2024-09-12T18:01:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.308+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vV_s6Q6rwAwLUZOuWAA-TwMBqpWM9q9_0 2024-09-12T18:01:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.308+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1589633316759255476', time=2024-09-12T19:53:44.599639+0000, chain.objs.size()=1 2024-09-12T18:01:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.308+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dWqAKSLp0wiVo7olSySRJZ-XpRAWpul_0 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12318989361573049752', time=2024-09-12T19:53:44.927883+0000, chain.objs.size()=1 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._kYK4Qm1GpzOOWg2pTC9chyqLIPiMp__0 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16861882653282465253', time=2024-09-12T19:53:44.976589+0000, chain.objs.size()=1 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.L3CxhE31w5zv3l7R3dT-Z1mnlIk1PrJ_0 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18010589360219353443', time=2024-09-12T19:53:45.020805+0000, chain.objs.size()=1 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.asoV4F9x_49rmrzPhjKhAVQjn2lVvHY_0 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9448431939783499374', time=2024-09-12T19:53:45.033083+0000, chain.objs.size()=1 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7IH8bd4j1kn-lMgg5Rq_M41VwwieAO9_0 2024-09-12T18:01:04.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7829867849109720753', time=2024-09-12T19:53:45.051156+0000, chain.objs.size()=1 2024-09-12T18:01:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5paMFyLrx5tHVoAu0WIbTul_VoYvPKH_0 2024-09-12T18:01:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9304192308015831407', time=2024-09-12T19:53:45.204826+0000, chain.objs.size()=1 2024-09-12T18:01:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.309+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hpFcZcXAzIyORIix9WYTmM3bMG0a8OS_0 2024-09-12T18:01:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14564235138236773278', time=2024-09-12T19:53:45.249693+0000, chain.objs.size()=1 2024-09-12T18:01:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.p0tLWyugKtC6fLTpSQgnelBAwnJJkws_0 2024-09-12T18:01:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14425409632139012868', time=2024-09-12T19:53:45.254868+0000, chain.objs.size()=1 2024-09-12T18:01:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CCHd0hnE-ed6a4TKQrkw6TknThT3NAc_0 2024-09-12T18:01:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6415980458948595525', time=2024-09-12T19:53:45.340172+0000, chain.objs.size()=1 2024-09-12T18:01:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yhfDThocG1v4yI_yu2_sREOFXwyQvwd_0 2024-09-12T18:01:04.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.312+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1985067800972574692', time=2024-09-12T19:53:45.353538+0000, chain.objs.size()=1 2024-09-12T18:01:04.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.312+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.A19v918GZiWAQyuH0umq65nzqXkv8IR_0 2024-09-12T18:01:04.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.312+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5435155100302873156', time=2024-09-12T19:53:45.368692+0000, chain.objs.size()=1 2024-09-12T18:01:04.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.312+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qvhCaXpCjLIOAHCblunV5QGmNmzTuDO_0 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3815698158398203478', time=2024-09-12T19:53:45.429001+0000, chain.objs.size()=1 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OSgoFdh_d7VFdGqC8MM7prjp7T6twrj_0 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2850742469468533400', time=2024-09-12T19:53:45.565914+0000, chain.objs.size()=1 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.q7rrNyN3b5wVfcxHN9m_jbZrQP470pJ_0 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9716228158299616298', time=2024-09-12T19:53:45.570051+0000, chain.objs.size()=1 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mdCBhc_Aw3Mr9gCxyZdDWWQYo_KBj95_0 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10533118720431922062', time=2024-09-12T19:53:45.626371+0000, chain.objs.size()=1 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AgPhkPF-lc3gMMq9YlLLyTF1k7GsleZ_0 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.101984916779247200', time=2024-09-12T19:53:45.631791+0000, chain.objs.size()=1 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HdpjwwbKihEsRvDryYrUGgmwIQ8HFZR_0 2024-09-12T18:01:04.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9285565722315542363', time=2024-09-12T19:53:45.754649+0000, chain.objs.size()=1 2024-09-12T18:01:04.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.314+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6B_aaWt4kY_XigYcDaxf5VrjCAeG86g_0 2024-09-12T18:01:04.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.316+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6936502455065902345', time=2024-09-12T19:53:45.766163+0000, chain.objs.size()=1 2024-09-12T18:01:04.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.316+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yz4Q2qRIRed-y6T66gEuqk6iyHI9oDZ_0 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.316+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3097621917606128606', time=2024-09-12T19:53:45.797201+0000, chain.objs.size()=1 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.316+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.s_aQquJ9tWRtFyvRLGPX9-i4EUY5i2k_0 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.316+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3169530179999070074', time=2024-09-12T19:53:45.803434+0000, chain.objs.size()=1 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.317+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CaXcevEv_O5QK8rgXLVY2KGUNjjgK9__0 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.317+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13215172390028896229', time=2024-09-12T19:53:45.807569+0000, chain.objs.size()=1 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.317+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CKXt0d7lIE52asW6b7K-Dtx88HV9qj7_0 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.317+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9094213424589400794', time=2024-09-12T19:53:45.837747+0000, chain.objs.size()=1 2024-09-12T18:01:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.317+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.v5fdnsPh8jg48j5-1Z68payjQX77ZqN_0 2024-09-12T18:01:04.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11331274056963521965', time=2024-09-12T19:53:45.840455+0000, chain.objs.size()=1 2024-09-12T18:01:04.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.T379OWB8JdfnxP1LhB9WZ68JFq5IRms_0 2024-09-12T18:01:04.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14043352033475776343', time=2024-09-12T19:53:45.841564+0000, chain.objs.size()=1 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uS6MUJThz_L-VMIqBLUrDfFAB4JNVYb_0 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15652860580746264054', time=2024-09-12T19:53:45.860476+0000, chain.objs.size()=1 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OdfB7_On3Rox0mHLdHeqBvkte4GtLBj_0 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15022481867498738974', time=2024-09-12T19:53:45.971641+0000, chain.objs.size()=1 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3qhhyjZi0fpBjUeayhM4fPjRVcV8WvX_0 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.363864146624364375', time=2024-09-12T19:53:45.972689+0000, chain.objs.size()=1 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JOjch4LJssHbRJulV5iglm-h1wuMymk_0 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11221835591316547697', time=2024-09-12T19:53:45.980398+0000, chain.objs.size()=1 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0w9X80CRIovFidFZxHsDxX6bhhgjWMC_0 2024-09-12T18:01:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7927549187865889775', time=2024-09-12T19:53:46.048346+0000, chain.objs.size()=1 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zQ7sg81LvqR4x5fEqhaA6ilK2SFBcfk_0 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9865666139186641676', time=2024-09-12T19:53:46.067197+0000, chain.objs.size()=1 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8hCA6luiq4D49ZuKVYze-7x74g4HzIH_0 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1860503858269063912', time=2024-09-12T19:53:46.195934+0000, chain.objs.size()=1 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xq4eDXqrt6RUZTWcKvJQzJzZXSbKRop_0 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12798134420627147255', time=2024-09-12T19:53:46.227641+0000, chain.objs.size()=1 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wW1wi2Qs2EPez9whW_RPWsIHK3WM9cB_0 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3749052788250751142', time=2024-09-12T19:53:46.240945+0000, chain.objs.size()=1 2024-09-12T18:01:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ONQ76lErsgaYZl2N0vQ-uy51TmMO3JF_0 2024-09-12T18:01:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.326+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7055187883716529324', time=2024-09-12T19:53:46.241875+0000, chain.objs.size()=1 2024-09-12T18:01:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.326+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._IEDSscM-hoM6AFdY2jdWXqousrB6Ss_0 2024-09-12T18:01:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3724583394987610328', time=2024-09-12T19:53:54.635957+0000, chain.objs.size()=1 2024-09-12T18:01:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.AvP6ikOSvyVToVPc45u-DV013fEWsaw_0 2024-09-12T18:01:04.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12038168462613678920', time=2024-09-12T19:53:54.676504+0000, chain.objs.size()=1 2024-09-12T18:01:04.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DvFCI-alzPlH2fIEQpE3EpHpFknVto4_0 2024-09-12T18:01:04.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.327+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11837359842064721671', time=2024-09-12T19:53:54.702481+0000, chain.objs.size()=1 2024-09-12T18:01:04.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.327+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.UfaLKlKKCaZ-yARoJvKogfP5mb0dYtg_0 2024-09-12T18:01:04.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.346205868878383449', time=2024-09-12T19:53:54.712495+0000, chain.objs.size()=1 2024-09-12T18:01:04.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6mS7BJueuiu541gAbsmb0DvZazb-QJa_0 2024-09-12T18:01:04.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5048495459708565995', time=2024-09-12T19:53:54.713249+0000, chain.objs.size()=1 2024-09-12T18:01:04.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TycpHyQK8WbHIJ1Jm18DRMc1WJXfBwO_0 2024-09-12T18:01:04.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3527058566774047470', time=2024-09-12T19:53:54.895157+0000, chain.objs.size()=1 2024-09-12T18:01:04.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yIKVjRgtJIyr38umleqrcOjbBCqxpNb_0 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12785239940988875090', time=2024-09-12T19:53:54.952025+0000, chain.objs.size()=1 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QFok_e6vSysq4JI6pIgijzdCsgTSngf_0 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11135131325681586689', time=2024-09-12T19:53:54.959978+0000, chain.objs.size()=1 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.clLngIEY8dJq8CkCz4Q8T4uOHJp6r_o_0 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4405868039536489926', time=2024-09-12T19:53:55.051470+0000, chain.objs.size()=1 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hN57f00llZFCqf0Yk7-ULepWYTxJQry_0 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.416740929286573661', time=2024-09-12T19:53:55.103075+0000, chain.objs.size()=1 2024-09-12T18:01:04.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.329+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hp9iTvYpThrD4BW-6Co9G1YCw-mDWDl_0 2024-09-12T18:01:04.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1390854324658551605', time=2024-09-12T19:53:55.110787+0000, chain.objs.size()=1 2024-09-12T18:01:04.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tPTrzC6BZT8jQ7DVasG7fXbDlqFC72G_0 2024-09-12T18:01:04.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10898141853723316878', time=2024-09-12T19:53:55.112215+0000, chain.objs.size()=1 2024-09-12T18:01:04.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Kvz1g6FlOiRGtwJCzgZc7yvHno4X4AM_0 2024-09-12T18:01:04.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10149093919011083610', time=2024-09-12T19:53:55.122601+0000, chain.objs.size()=1 2024-09-12T18:01:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1lre8p_6afw8PJso6khdD_AgCS1iE8W_0 2024-09-12T18:01:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1839996315576882680', time=2024-09-12T19:53:55.172957+0000, chain.objs.size()=1 2024-09-12T18:01:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.333+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fsDjyJ0SetneVfHYUJvBOoTbL_H7KWv_0 2024-09-12T18:01:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15933726995977753027', time=2024-09-12T19:53:55.279279+0000, chain.objs.size()=1 2024-09-12T18:01:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8PrCvlHbZQLaQmrqu6vFolNiy0giJF0_0 2024-09-12T18:01:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3123974960826729670', time=2024-09-12T19:53:55.295150+0000, chain.objs.size()=1 2024-09-12T18:01:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FHJTpUDav8GkJlrUtIwcJhyaK8ic-3B_0 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6613635565277139628', time=2024-09-12T19:53:55.301637+0000, chain.objs.size()=1 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CIb66DpNw-PUTRMdwY0xvyauWENP4OC_0 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16496781913619683117', time=2024-09-12T19:53:55.311301+0000, chain.objs.size()=1 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._p66pMKHTMmYGhU1NWNim5_HbV0nRBm_0 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12898305741061228324', time=2024-09-12T19:53:55.319656+0000, chain.objs.size()=1 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tGgTX9NuyDzeiwsZ78d1xmwM3iDgwqF_0 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4625049903009795357', time=2024-09-12T19:53:55.353634+0000, chain.objs.size()=1 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xehvwhhH9NzzuqgbDiQfn38-pXHWavz_0 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12232267684004415820', time=2024-09-12T19:53:55.359004+0000, chain.objs.size()=1 2024-09-12T18:01:04.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.334+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZWDp2ckQgQPXSJD_PER9WtXsqQh4f8C_0 2024-09-12T18:01:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10338810759849636303', time=2024-09-12T19:53:55.365186+0000, chain.objs.size()=1 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4LGFY3X6k_kdimpbjnwq1AXjN8t6SVY_0 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14049044659889431658', time=2024-09-12T19:53:55.529693+0000, chain.objs.size()=1 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qBUfRgdTdLVhNcO761dva-mVeFj8gSm_0 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17996023307030857043', time=2024-09-12T19:53:55.561521+0000, chain.objs.size()=1 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.injksZi6oHkSpF1LZWjsmRrWc33Jz2F_0 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16838071288518164499', time=2024-09-12T19:53:55.568970+0000, chain.objs.size()=1 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0pWWCqU2NS4tZO8UTGL0BG0GAKYsgSC_0 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12863757715851449712', time=2024-09-12T19:53:55.808170+0000, chain.objs.size()=1 2024-09-12T18:01:04.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yrOcuP8y-KikRwDk4PNDQOEgf2Aikb6_0 2024-09-12T18:01:04.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11757017095547064571', time=2024-09-12T19:53:56.117316+0000, chain.objs.size()=1 2024-09-12T18:01:04.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.340+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tpuk9ub0p2tplpuOHOSwT-aIPIOLrbN_0 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.344+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/68630 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.702176319237141170', time=2024-09-12T19:53:56.118779+0000, chain.objs.size()=1 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4YGiLep_4ydj0T9kiOZ3coUiQQ3mzCD_0 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12608202230590668175', time=2024-09-12T19:53:56.133945+0000, chain.objs.size()=1 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LiIwlwjLznGiFbND7Ax9Q08JzbwFr09_0 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1682033249668530053', time=2024-09-12T19:53:56.158844+0000, chain.objs.size()=1 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1BNwJaHlLzXid3aSoKnvGSuOfbl4_K3_0 2024-09-12T18:01:04.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3415962952337408574', time=2024-09-12T19:53:56.181762+0000, chain.objs.size()=1 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.989yNHn1ime37LGU5rwI7zHdFavEvKr_0 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2329272893071274012', time=2024-09-12T19:53:59.449123+0000, chain.objs.size()=1 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.342__shadow_.-Pn2e3oQUB_kzJjjFxwj1wepxnN0nSX_0 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6291772228220136471', time=2024-09-12T19:54:06.659433+0000, chain.objs.size()=1 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.378__shadow_.6eA7Y2xQLLAFD0uYdUeoWd6tZ3g4Zqt_0 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1188940877403988575', time=2024-09-12T19:54:19.436870+0000, chain.objs.size()=1 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.434__shadow_.O_rR_qDPWujFAhnRRZhq11YVNKiePWI_0 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17968710764902789261', time=2024-09-12T19:54:25.727195+0000, chain.objs.size()=1 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.459__shadow_.ZpwxkQvpL4jaBSonhdA9kZYNHyc-1FX_0 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2672215199068530330', time=2024-09-12T19:54:31.433484+0000, chain.objs.size()=1 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.485__shadow_.Tbiq7ECILdyWbeprsQSxG-ayyXTIN_5_0 2024-09-12T18:01:04.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1427865315990526718', time=2024-09-12T19:54:34.020131+0000, chain.objs.size()=1 2024-09-12T18:01:04.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.496__shadow_.Wmkq87Lc7WOZShO1DUogxOd8RcPPIBy_0 2024-09-12T18:01:04.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6527234812323736081', time=2024-09-12T19:54:51.226973+0000, chain.objs.size()=2 2024-09-12T18:01:04.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~Uk-GqIYnvxT0h5KOHeDcTYQpk9HE3M8.1 2024-09-12T18:01:04.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.347+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~Uk-GqIYnvxT0h5KOHeDcTYQpk9HE3M8.2 2024-09-12T18:01:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.351+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13947488491575659520', time=2024-09-12T19:54:53.284717+0000, chain.objs.size()=1 2024-09-12T18:01:04.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.351+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.529__shadow_.nOK_4vQ-hAIJKMihh5OXbl2qX_Mspsw_0 2024-09-12T18:01:04.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15667217362163116057', time=2024-09-12T19:55:23.140741+0000, chain.objs.size()=1 2024-09-12T18:01:04.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.553__shadow_.wKvWq0jt9DD3LMV2XdsjqfPcRdpNz6b_0 2024-09-12T18:01:04.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5184010941752898619', time=2024-09-12T19:55:24.109687+0000, chain.objs.size()=1 2024-09-12T18:01:04.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.555__shadow_.nnGhL2YR09PVXJA9PQIayJY6ldkMOB7_0 2024-09-12T18:01:04.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15625027815223442028', time=2024-09-12T19:55:25.977749+0000, chain.objs.size()=1 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.559__shadow_.mLLDHEmvIGJ6DO6DwjunwG65qqJ2APz_0 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14337753126148133088', time=2024-09-12T19:55:31.900266+0000, chain.objs.size()=1 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.565__shadow_.7m_KXtGYkcyQnJbvxSvT6fllVXz6seT_0 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.709474144257002590', time=2024-09-12T19:55:33.827204+0000, chain.objs.size()=1 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:3IakVl3tuxWMDSJPqoFkY-aw1C3JYQj_.D9UJARCLz8hsyQ67n92US-bbotyYYQj_0 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9119421104885828443', time=2024-09-12T19:55:35.436549+0000, chain.objs.size()=1 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:da.div95ulr0cDjMKLSVByMRoxBLPR0_.8sGlrhHunlPHHBCsBsXMa4d_4qQO5w1_0 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8313579451912383996', time=2024-09-12T19:55:37.897022+0000, chain.objs.size()=1 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:UW8wzAa.nywkQmv4caJc-IEF1MNhasN_.DK2uidbQKBCedC7lna39YEfGd_JRAm__0 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12499787577194727069', time=2024-09-12T19:55:40.445592+0000, chain.objs.size()=1 2024-09-12T18:01:04.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.352+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.574__shadow_.-lN4rREIAesntqlN9BfMTZ3U-FtXTHe_0 2024-09-12T18:01:04.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.354+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17550828138475315456', time=2024-09-12T19:55:44.838076+0000, chain.objs.size()=1 2024-09-12T18:01:04.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.354+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:8L3IdnUyMfMZEQSvpfd.apqAfAvZ3L3_.7_VeHblNll_lheA9QmdPZf5aHwJ6DD8_0 2024-09-12T18:01:04.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.354+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9507691877630093349', time=2024-09-12T19:56:02.108789+0000, chain.objs.size()=1 2024-09-12T18:01:04.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.354+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:rSQVJPvXorb9JLHlv50JjqcfHdc-IVe_.wU-7ZBNQVweFED5rhAVeVD0U8bTs9Ud_0 2024-09-12T18:01:04.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.356+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16289916048997623430', time=2024-09-12T19:56:08.620263+0000, chain.objs.size()=1 2024-09-12T18:01:04.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.357+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.607__shadow_.FynuNKI9iv5xKsk51dUOkI-LYiADQwH_0 2024-09-12T18:01:04.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.357+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11424789489655653733', time=2024-09-12T19:58:33.337967+0000, chain.objs.size()=1 2024-09-12T18:01:04.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.357+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.680__shadow_.kFTurN4H3B4zOkajCvYtTZq19ccOMuA_0 2024-09-12T18:01:04.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.359+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11718269837213735404', time=2024-09-12T19:58:38.718243+0000, chain.objs.size()=1 2024-09-12T18:01:04.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.359+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.706__shadow:M-V5DcEj1rrN5PidrdITuEEYfOkkQX8_.JAjefv9MDTB08GZ7zZFw6yye6ltnXQJ_0 2024-09-12T18:01:04.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.359+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3219748359247814559', time=2024-09-12T19:59:01.610886+0000, chain.objs.size()=1 2024-09-12T18:01:04.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.359+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.720__shadow_.OKHSV-QbdM_JE9MChbGiAHj2F39oclC_0 2024-09-12T18:01:04.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.359+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16756678530243947637', time=2024-09-12T19:59:07.375314+0000, chain.objs.size()=1 2024-09-12T18:01:04.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.359+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743__multipart_mymultipart3.2~KzV3r8kN8INVmETMEcT_ptCpmjnWoIb.1 2024-09-12T18:01:04.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.362+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.365+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:01:04.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.366+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.367+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49098' 2024-09-12T18:01:04.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8925333555160036792', time=2024-09-12T19:51:59.343566+0000, chain.objs.size()=5 2024-09-12T18:01:04.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-LUKEWARM.2~4KpTP_0ZGBAGd7JgiV6iR6fVndnEWPn.1 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_foo-LUKEWARM.2~4KpTP_0ZGBAGd7JgiV6iR6fVndnEWPn.1_1 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-LUKEWARM.2~4KpTP_0ZGBAGd7JgiV6iR6fVndnEWPn.2 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_foo-LUKEWARM.2~4KpTP_0ZGBAGd7JgiV6iR6fVndnEWPn.2_1 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__multipart_foo-LUKEWARM.2~4KpTP_0ZGBAGd7JgiV6iR6fVndnEWPn.3 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~3XDu-qgd0viqJqRvAJyldx-MFSzbI1L', time=2024-09-12T19:52:17.724541+0000, chain.objs.size()=2 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.203__multipart_mymultipart.2~3XDu-qgd0viqJqRvAJyldx-MFSzbI1L.1 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.203__shadow_mymultipart.2~3XDu-qgd0viqJqRvAJyldx-MFSzbI1L.1_1 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17531684874903520071', time=2024-09-12T19:53:07.245485+0000, chain.objs.size()=1 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.235__shadow_.IlFrGaPBT7vdX6XgU25M_lJSzbDsBno_0 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1218593726870862051', time=2024-09-12T19:53:07.653306+0000, chain.objs.size()=1 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.237__shadow_.nPEMKQ0ewNlKHaSqByucGKpdt20954c_0 2024-09-12T18:01:04.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9721616303509026655', time=2024-09-12T19:53:09.238023+0000, chain.objs.size()=1 2024-09-12T18:01:04.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.244__shadow_.8o2KPUTnABVaQTQGvNUQgOfbt6-Om-z_0 2024-09-12T18:01:04.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13794802452760760864', time=2024-09-12T19:53:09.502405+0000, chain.objs.size()=1 2024-09-12T18:01:04.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.245__shadow_.aIcWtHEM0tEM0-Pv8itdedtKeWt1yJf_0 2024-09-12T18:01:04.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7950185244959683676', time=2024-09-12T19:53:10.760901+0000, chain.objs.size()=1 2024-09-12T18:01:04.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.368+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.251__shadow_.3jO8S-sShiEMXXiDBeGZtCpwnctOqav_0 2024-09-12T18:01:04.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5319948620238824202', time=2024-09-12T19:53:11.212743+0000, chain.objs.size()=1 2024-09-12T18:01:04.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.253__shadow_.wgG4ZHxNQ63HqTYKdvOT_TUv2CdcaMQ_0 2024-09-12T18:01:04.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1964155420084978906', time=2024-09-12T19:53:11.830862+0000, chain.objs.size()=1 2024-09-12T18:01:04.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.256__shadow_.Yix6N6EMoyRuC8cMwNSi7GS1vuDzNx__0 2024-09-12T18:01:04.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.372+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18195933275950182876', time=2024-09-12T19:53:12.034781+0000, chain.objs.size()=1 2024-09-12T18:01:04.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.372+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.257__shadow_.zfvAHP8bMOD5C5Dnqk8xzeeGjUkwn-__0 2024-09-12T18:01:04.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12103226063268601699', time=2024-09-12T19:53:21.171766+0000, chain.objs.size()=1 2024-09-12T18:01:04.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.U-28_EojsBJS4fKpna0XuB-jzQVCum1_0 2024-09-12T18:01:04.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1016166299005328036', time=2024-09-12T19:53:21.215107+0000, chain.objs.size()=1 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.asfUWm6Qli7y9KnF9ctw3jB1aj8FBBv_0 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4292105019082029382', time=2024-09-12T19:53:21.224020+0000, chain.objs.size()=1 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xP4WkvkQkMvXMOFM0SGdQpahAsQeEG8_0 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9925644559817344920', time=2024-09-12T19:53:21.231814+0000, chain.objs.size()=1 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kOe-_p3OwruHnb-qZYGx8enGnC-jpBg_0 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.373+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2096964974248347162', time=2024-09-12T19:53:21.386583+0000, chain.objs.size()=1 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.374+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.5mYqhSq_sUk413EVJ6zIAHsD97X-YUo_0 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.374+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1489249458205340997', time=2024-09-12T19:53:21.407977+0000, chain.objs.size()=1 2024-09-12T18:01:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.374+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XVp9Kk4FxP2jRbwRX2VgerARjs2qdRY_0 2024-09-12T18:01:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.374+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13829693053685320201', time=2024-09-12T19:53:21.417521+0000, chain.objs.size()=1 2024-09-12T18:01:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.374+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.K5LPLX1n4IiJTLVJn6uMob32OALJaOn_0 2024-09-12T18:01:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.374+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15258734873504106094', time=2024-09-12T19:53:21.455381+0000, chain.objs.size()=1 2024-09-12T18:01:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.374+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.NKsOf8rtMYApyB5HN8cn9_GkGxm1El9_0 2024-09-12T18:01:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.375+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13661446183637033350', time=2024-09-12T19:53:21.461125+0000, chain.objs.size()=1 2024-09-12T18:01:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.375+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qv0PZJn04d4XL4ph8eYeTJjRguveeVj_0 2024-09-12T18:01:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.376+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15885019926897850552', time=2024-09-12T19:53:21.598398+0000, chain.objs.size()=1 2024-09-12T18:01:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.376+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MkzEPt8RFHAS5JKU1lkq_clRc1aA_21_0 2024-09-12T18:01:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.376+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17616640538294508187', time=2024-09-12T19:53:21.605615+0000, chain.objs.size()=1 2024-09-12T18:01:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.376+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fDArgvwT60BbtFQCYAp9FbkdqDMMo5g_0 2024-09-12T18:01:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.376+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1581536228578227933', time=2024-09-12T19:53:21.613150+0000, chain.objs.size()=1 2024-09-12T18:01:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.376+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OuRAWGYpb-X_7gEN7shCC2an6ik9qHn_0 2024-09-12T18:01:04.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.377+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4271893462082301040', time=2024-09-12T19:53:21.633945+0000, chain.objs.size()=1 2024-09-12T18:01:04.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.377+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0vXiqrq6yBz-xq86IMkiwxnVMawF0Er_0 2024-09-12T18:01:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3708623203832429569', time=2024-09-12T19:53:21.645979+0000, chain.objs.size()=1 2024-09-12T18:01:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MAfv5FhY694cjUyUw_95OWWjzmdZI9H_0 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1182756898591635536', time=2024-09-12T19:53:21.647140+0000, chain.objs.size()=1 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2pzAkJGYIdNCDUgtxfe2PRtm85LNIQE_0 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14797431903202263146', time=2024-09-12T19:53:21.782655+0000, chain.objs.size()=1 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QGyB5Cj5sVUQHtRHk6eduPBe_Gmbcsg_0 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2180391157751618306', time=2024-09-12T19:53:21.812420+0000, chain.objs.size()=1 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.61rY3wEWeuBg44_BjjWmkhbGCipDzBq_0 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16552722290363337533', time=2024-09-12T19:53:21.877397+0000, chain.objs.size()=1 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jnT7350niM4GIqYANSVUHucGxsaJ5kO_0 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8487082256304692259', time=2024-09-12T19:53:22.020785+0000, chain.objs.size()=1 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qvPB7ShsgPtFlEMFKfiKNFl1iRczjdF_0 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11732569800063585127', time=2024-09-12T19:53:22.078870+0000, chain.objs.size()=1 2024-09-12T18:01:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.379+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QmvMUGepfRSoRTN6Wwzwp_HaPrtJ5sE_0 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.380+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14927229233642539291', time=2024-09-12T19:53:22.083519+0000, chain.objs.size()=1 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.380+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.l9doEoW0D_EMyuHtWuY21gEYWLVXTsl_0 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.381+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2093073681952271348', time=2024-09-12T19:53:22.085357+0000, chain.objs.size()=1 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.381+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rhnvdSVqxQ75G8XdRSFV_OOl0u_xp-8_0 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.381+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5062294528815238927', time=2024-09-12T19:53:22.095960+0000, chain.objs.size()=1 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.381+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.chFa1Uxng8lD6uKDbUgPKwud5W6JlnF_0 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.381+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16759098808352139404', time=2024-09-12T19:53:22.196568+0000, chain.objs.size()=1 2024-09-12T18:01:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.381+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qs2m26oPEgJKe-0BW819bXqeNhKUwtH_0 2024-09-12T18:01:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.384+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12302600155662371371', time=2024-09-12T19:53:22.208022+0000, chain.objs.size()=1 2024-09-12T18:01:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.384+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.q_eCjtBzm2Y6iJYN7fQbJV_9w7k4zbv_0 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15401359380918474190', time=2024-09-12T19:53:22.223005+0000, chain.objs.size()=1 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rhfMRr4ghf8ZUsdw0r5S9KQxQeoDuWU_0 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16416319362346754053', time=2024-09-12T19:53:22.245480+0000, chain.objs.size()=1 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TatS9nHIEWlrJ2uoK9QRcbR06wUjiX5_0 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13851800138467531143', time=2024-09-12T19:53:22.264615+0000, chain.objs.size()=1 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0fS4L2wnqVgs_nbUPwtzxIyR49msuEW_0 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12036952723952143436', time=2024-09-12T19:53:22.281095+0000, chain.objs.size()=1 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iqTP2sxOa6SX3XuM8yxBBMb4RG24HX8_0 2024-09-12T18:01:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15920838821400794064', time=2024-09-12T19:53:22.382158+0000, chain.objs.size()=1 2024-09-12T18:01:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3G3RYEo4Uk1A6FWpAl9skk-3-1i0IiN_0 2024-09-12T18:01:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.891953773275962982', time=2024-09-12T19:53:22.456461+0000, chain.objs.size()=1 2024-09-12T18:01:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.386+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qIF0ebfMO_PoaRc9FA9rl1IHrtm6QJR_0 2024-09-12T18:01:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16068765069343846062', time=2024-09-12T19:53:22.471008+0000, chain.objs.size()=1 2024-09-12T18:01:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nOPKi5J0FEtuj19wj-E6eBitD8X75e4_0 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13168277119836297530', time=2024-09-12T19:53:22.496982+0000, chain.objs.size()=1 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1d20yAEpq8OHTAQIaKeITdUs0QlOAeB_0 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3407672694343133228', time=2024-09-12T19:53:22.498322+0000, chain.objs.size()=1 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vplz9IirFqqO4x6MTFKywU-Gl1YbjOw_0 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18011780533623190254', time=2024-09-12T19:53:22.593265+0000, chain.objs.size()=1 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yB01U3cNnJc8cJQsu1JPf-9B9Tk73yQ_0 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4750392220137549123', time=2024-09-12T19:53:22.599394+0000, chain.objs.size()=1 2024-09-12T18:01:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.388+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.eHFLzNJ9ZgGUZHupUb7-L2Mxs8zg7H2_0 2024-09-12T18:01:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16434427079725057890', time=2024-09-12T19:53:22.603113+0000, chain.objs.size()=1 2024-09-12T18:01:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CQ9hyz6q4B1RtKO7HNY6MaL4Vde1luN_0 2024-09-12T18:01:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6237271321030228791', time=2024-09-12T19:53:22.683450+0000, chain.objs.size()=1 2024-09-12T18:01:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3HUxQhXKJvML3MBoVkf4MnG9j_YqLg3_0 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6970518501463430185', time=2024-09-12T19:53:24.463419+0000, chain.objs.size()=1 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.272__shadow_.XrKoA6XN9xmdeSZuEMD-4BhgXww2H3D_0 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4458796229064559932', time=2024-09-12T19:53:25.092904+0000, chain.objs.size()=1 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.275__shadow_.8eSOZummONL238hrtTMsvZ4XuKee6DY_0 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2857998343067045465', time=2024-09-12T19:53:25.505022+0000, chain.objs.size()=1 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.277__shadow_.8K6z3Z3ZLL0NfKEexDBb-pI0OkH_mMH_0 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14202123944692299573', time=2024-09-12T19:53:27.435320+0000, chain.objs.size()=1 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.391+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.286__shadow_.dewGjSvpGcTi46oUUjCoTa6Vwko6i9e_0 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.392+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1059221256415104688', time=2024-09-12T19:53:28.546198+0000, chain.objs.size()=1 2024-09-12T18:01:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.392+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.291__shadow_.ZyjC00NPJ1wOOR8EG-N6dqMV3akktl3_0 2024-09-12T18:01:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.394+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2180218150820106914', time=2024-09-12T19:53:31.072156+0000, chain.objs.size()=1 2024-09-12T18:01:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.394+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.299__shadow_.iobd5mfe1-4hAGuA0niaPSVyo03a1ng_0 2024-09-12T18:01:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.394+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6183581243438893480', time=2024-09-12T19:53:31.320593+0000, chain.objs.size()=1 2024-09-12T18:01:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.394+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.300__shadow_.yR0qgm-0VNKgR2yqBLzO0X6eqw1vTbh_0 2024-09-12T18:01:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.394+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15414255791159670408', time=2024-09-12T19:53:31.525508+0000, chain.objs.size()=1 2024-09-12T18:01:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.394+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.301__shadow_.wbaaK3thgQD3bRQWymNOerSiW9hEGaq_0 2024-09-12T18:01:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.395+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17829359832016660182', time=2024-09-12T19:53:35.729822+0000, chain.objs.size()=1 2024-09-12T18:01:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.395+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.322__shadow_.PZbWpHEL5V3CF9cbPGS0RKG0OruYBAb_0 2024-09-12T18:01:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.395+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13051430623741214788', time=2024-09-12T19:53:36.060126+0000, chain.objs.size()=1 2024-09-12T18:01:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.395+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.323__shadow_.ppwniZkzK5DP8MvLyo6JFvG8hf77IYR_0 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14109851019254833128', time=2024-09-12T19:53:44.578704+0000, chain.objs.size()=1 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.M2W8Nvf5zU4feE9F8UrQlg3ixbfDzs2_0 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6853455962527741125', time=2024-09-12T19:53:44.594935+0000, chain.objs.size()=1 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.U8OnqDNx0RdrnBzYrZzw8UuYevypZyw_0 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9325798604282354142', time=2024-09-12T19:53:44.617149+0000, chain.objs.size()=1 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2U2faLbWeXOwLNrcQ5XZomIvIAHig0z_0 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.42458209983863400', time=2024-09-12T19:53:44.963144+0000, chain.objs.size()=1 2024-09-12T18:01:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cO7AQj5fnKcY_H8M5dpWuwbJI5Ycc4T_0 2024-09-12T18:01:04.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12690002002478258480', time=2024-09-12T19:53:44.981535+0000, chain.objs.size()=1 2024-09-12T18:01:04.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.397+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.k9X5DKAgWxH3A78DKFgLmEgLuymgchC_0 2024-09-12T18:01:04.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.398+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12631907521717593447', time=2024-09-12T19:53:45.037147+0000, chain.objs.size()=1 2024-09-12T18:01:04.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.398+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5SVGTfF0hkAfzJ6h1KZkg_6NaUqDs60_0 2024-09-12T18:01:04.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.400+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6869943893329278434', time=2024-09-12T19:53:45.135012+0000, chain.objs.size()=1 2024-09-12T18:01:04.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.400+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cOnNGXvKY-rc9vxKneRnCSIQGPOCj8Q_0 2024-09-12T18:01:04.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.401+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10658233853486736152', time=2024-09-12T19:53:45.176451+0000, chain.objs.size()=1 2024-09-12T18:01:04.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.401+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bslJjnEDrH5V6C2TyZdqzYSyGsmb0eN_0 2024-09-12T18:01:04.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.401+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15438680701098427780', time=2024-09-12T19:53:45.188274+0000, chain.objs.size()=1 2024-09-12T18:01:04.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.401+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8Ge3EZOPID5lGlxtNLKzOp3PGLgnPHH_0 2024-09-12T18:01:04.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.401+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15892642928583839297', time=2024-09-12T19:53:45.200381+0000, chain.objs.size()=1 2024-09-12T18:01:04.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.401+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-9Gd5q-wU7G0gZJNZ4iehLNMDB9h_WX_0 2024-09-12T18:01:04.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.402+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17521062689117189831', time=2024-09-12T19:53:45.340694+0000, chain.objs.size()=1 2024-09-12T18:01:04.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.402+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zwDsMpaeVZidAbWb87KJ4o5lMVmRNS9_0 2024-09-12T18:01:04.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13081099512888971721', time=2024-09-12T19:53:45.346034+0000, chain.objs.size()=1 2024-09-12T18:01:04.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zohEcJQFm4VgYNWdrc7YGgIT4HAQFGS_0 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7900154211785433135', time=2024-09-12T19:53:45.402100+0000, chain.objs.size()=1 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jGlgtrA5N96tK75NDplIxaV3aULqmJc_0 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9896191627610159379', time=2024-09-12T19:53:45.417131+0000, chain.objs.size()=1 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bEjEJyXZrwSBPFamaVELb1_H3w0pIds_0 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15046612786772964293', time=2024-09-12T19:53:45.430533+0000, chain.objs.size()=1 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.acYnBTyzQbEDYeHuJaDfvTCBA_R946u_0 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2462010703539508444', time=2024-09-12T19:53:45.622273+0000, chain.objs.size()=1 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4qsCmz0uw1wMf1dCApSQsTi9M2viCoN_0 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10983423584993120314', time=2024-09-12T19:53:45.765768+0000, chain.objs.size()=1 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Zch8GVMJJvWV65jaYxsdM30TwIlceSQ_0 2024-09-12T18:01:04.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12387793863036089984', time=2024-09-12T19:53:45.772493+0000, chain.objs.size()=1 2024-09-12T18:01:04.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.405+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zuIzJFdiSVHPIO10YfDGA4pX1X-fP4q_0 2024-09-12T18:01:04.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6752458558799370028', time=2024-09-12T19:53:45.801136+0000, chain.objs.size()=1 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Xpk3DjDEaTHfWV3g-f6MBKFMB1dUty2_0 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11932120885149690153', time=2024-09-12T19:53:45.970399+0000, chain.objs.size()=1 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1oZJUzejDNH_rlq__qqQWBl5O16VT6q_0 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12999613044137487298', time=2024-09-12T19:53:46.003382+0000, chain.objs.size()=1 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VDX1JreGCK7Ll4mw8_Qq7xYAclgA8tU_0 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14735770344731413068', time=2024-09-12T19:53:46.010647+0000, chain.objs.size()=1 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.l8w3cjn0ZMxemBcuXJkAW1vw9RaWVhy_0 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3690251915133510424', time=2024-09-12T19:53:46.021537+0000, chain.objs.size()=1 2024-09-12T18:01:04.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.408+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TWsREvCJnVM8pdL-uyfXUliHr6ap_pU_0 2024-09-12T18:01:04.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.410+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13904878678797316585', time=2024-09-12T19:53:46.062569+0000, chain.objs.size()=1 2024-09-12T18:01:04.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.410+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.PDNizgzHa-rLyUNCHnvYpnsNZJcmpsq_0 2024-09-12T18:01:04.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.410+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12882484795982937344', time=2024-09-12T19:53:46.141196+0000, chain.objs.size()=1 2024-09-12T18:01:04.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.410+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FBpIjNijO3ayFCSg_QTC_f4XxMBkyKK_0 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.410+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14070512700076790253', time=2024-09-12T19:53:46.144198+0000, chain.objs.size()=1 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.410+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FFrhsLVnBYWuid-vKcBc7w-RINHZpiz_0 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.411+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9588114607802122434', time=2024-09-12T19:53:46.144899+0000, chain.objs.size()=1 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.411+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.13a_vIHoZkxQJfE6MHG-AuDPgxAy6Cn_0 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.411+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7770276959968298142', time=2024-09-12T19:53:46.146146+0000, chain.objs.size()=1 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.411+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HxVCE86zFOhp2FTu3QYExhHYhxBVnGq_0 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.411+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15753477090909271547', time=2024-09-12T19:53:46.165838+0000, chain.objs.size()=1 2024-09-12T18:01:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.411+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YHU4PeRSm-brH4y8vipyJa0bhprsKEQ_0 2024-09-12T18:01:04.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.412+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7533384821320560103', time=2024-09-12T19:53:46.217865+0000, chain.objs.size()=1 2024-09-12T18:01:04.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.412+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GlfuCedpnvD_AsrIhE0cc0o7PXNjHOM_0 2024-09-12T18:01:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9600364223119331429', time=2024-09-12T19:53:54.644674+0000, chain.objs.size()=1 2024-09-12T18:01:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.g3EyBbL_26-nd43gdvTzJUhyYQHRXmD_0 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8228115904664210962', time=2024-09-12T19:53:54.703092+0000, chain.objs.size()=1 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ySSa9gys3vPnxlcjPa3CpOtWrb847W5_0 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.413+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8228187135106753325', time=2024-09-12T19:53:54.714335+0000, chain.objs.size()=1 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.413+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yd3qeffyr9zs7TwRZfhIVKRjxxbUqkp_0 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.414+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15011049683196494870', time=2024-09-12T19:53:54.730402+0000, chain.objs.size()=1 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.414+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Y76XeFLr4GlSE4G8dD27sE6AKVaP1Bu_0 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.414+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13937064279561107250', time=2024-09-12T19:53:54.882022+0000, chain.objs.size()=1 2024-09-12T18:01:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.414+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qlTg0UQokSof2ghzO9jnO1YT2My7Rq-_0 2024-09-12T18:01:04.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.417+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2196394487895882123', time=2024-09-12T19:53:55.066007+0000, chain.objs.size()=1 2024-09-12T18:01:04.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.417+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IwDg3EpSmuOgS-8AQ48XvrKK1oVPZIt_0 2024-09-12T18:01:04.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.417+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9835919665142518759', time=2024-09-12T19:53:55.067093+0000, chain.objs.size()=1 2024-09-12T18:01:04.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.417+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.B1gwRf3-STK97wTHnWFXgHmo0T7vsYY_0 2024-09-12T18:01:04.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7090850594806510246', time=2024-09-12T19:53:55.075248+0000, chain.objs.size()=1 2024-09-12T18:01:04.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mqP2QtOqIKmsZ4ZvfNuJHfHl4k4tZIE_0 2024-09-12T18:01:04.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15526076528451802443', time=2024-09-12T19:53:55.081363+0000, chain.objs.size()=1 2024-09-12T18:01:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZX5BB0N9txyZreH_Kn3XbccYmnAfjqL_0 2024-09-12T18:01:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.418+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6879812338669062051', time=2024-09-12T19:53:55.082324+0000, chain.objs.size()=1 2024-09-12T18:01:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.418+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SZ5FrCJjIYYBYlEAn3VxW4BTigYeNGy_0 2024-09-12T18:01:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.419+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7074288004004223939', time=2024-09-12T19:53:55.084346+0000, chain.objs.size()=1 2024-09-12T18:01:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.419+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8uG05iiphR_gf5vLX_leA4UXGV2k6FN_0 2024-09-12T18:01:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.419+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11189100559004307923', time=2024-09-12T19:53:55.103014+0000, chain.objs.size()=1 2024-09-12T18:01:04.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.420+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.z2VkTkEp6LW9d7AgyHBwYv-MtewCMbk_0 2024-09-12T18:01:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.422+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/49098 2024-09-12T18:01:04.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-12T18:01:04.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11108288991662739587', time=2024-09-12T19:53:55.112870+0000, chain.objs.size()=1 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8yhdqCpO65Zfj9Gmuv3IA9jcv_FMbzE_0 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13328081287275651924', time=2024-09-12T19:53:55.143509+0000, chain.objs.size()=1 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tMd4I4xCD6pqnjWibgK8f9j4guukJDg_0 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7258701667636272867', time=2024-09-12T19:53:55.266204+0000, chain.objs.size()=1 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.KTPxGc6Qf_HdPiv9_n8_r5y1Ks3LEB8_0 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13611248332627576963', time=2024-09-12T19:53:55.298027+0000, chain.objs.size()=1 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3HvOnJJDg1v-qDTfgrWEfQoVEZkwGKz_0 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5531657648142800559', time=2024-09-12T19:53:55.361607+0000, chain.objs.size()=1 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mDAQqJbIDXo6SWmVJzmoxlcOmYAHatE_0 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7772267254798254372', time=2024-09-12T19:53:55.502777+0000, chain.objs.size()=1 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9pQ5RdNC_RhXyYjpD1MP4FnRbX2Rz9F_0 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11412134720460446787', time=2024-09-12T19:53:55.538088+0000, chain.objs.size()=1 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6OSoc9ceFhk7dEjRPc_q-emxygP_90e_0 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11500361937581764453', time=2024-09-12T19:53:55.577390+0000, chain.objs.size()=1 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DnvMmTS2Wiql_Oh6YXVv_p9bEyVRptY_0 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1198923629897884476', time=2024-09-12T19:53:55.739064+0000, chain.objs.size()=1 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QrWwrAXbCxa0M3XhscanVzmlkg_kPUG_0 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2444512393102288294', time=2024-09-12T19:53:55.804881+0000, chain.objs.size()=1 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0AHUD1wLJRTZh30j_NaoODG2DTxDihu_0 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.986672633009533185', time=2024-09-12T19:53:55.941415+0000, chain.objs.size()=1 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gN6MowdEpcT0gA4kV4w3ytca4Uu65_A_0 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5656254411095734538', time=2024-09-12T19:53:55.953263+0000, chain.objs.size()=1 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.425+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IGEtNQqU90l7DgnVKqno0iYqeKsDF64_0 2024-09-12T18:01:04.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.428+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6075724751180726122', time=2024-09-12T19:53:55.960495+0000, chain.objs.size()=1 2024-09-12T18:01:04.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.428+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IHJ92kudpcmeeivCykoScHWUag7TkpK_0 2024-09-12T18:01:04.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.428+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11580745121532951543', time=2024-09-12T19:53:56.029325+0000, chain.objs.size()=1 2024-09-12T18:01:04.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.428+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.z0AQFQOmEA-c96oqVC4nvtfCbNlTcBP_0 2024-09-12T18:01:04.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.428+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1401889169836963031', time=2024-09-12T19:53:56.129723+0000, chain.objs.size()=1 2024-09-12T18:01:04.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.428+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bvGbYY7THqlDmmBl_QJBJ8fizU9qBgs_0 2024-09-12T18:01:04.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9010790999211922400', time=2024-09-12T19:53:56.519640+0000, chain.objs.size()=1 2024-09-12T18:01:04.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.327__shadow_.zr6707J9YJSQaSaLfUMt9Ix4EMPXs0o_0 2024-09-12T18:01:04.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5309340030277861905', time=2024-09-12T19:53:57.475079+0000, chain.objs.size()=1 2024-09-12T18:01:04.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.332__shadow_.B6EO3UgCd0OhIdj1juu0U6k4j2W7PSF_0 2024-09-12T18:01:04.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4365791420440157498', time=2024-09-12T19:53:59.217106+0000, chain.objs.size()=1 2024-09-12T18:01:04.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.341__shadow_.zsfawKoPLM1pXui1QO9Js1z5dDst-8W_0 2024-09-12T18:01:04.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16806063666161988', time=2024-09-12T19:54:08.273389+0000, chain.objs.size()=1 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.429+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.384__shadow_.fqOtuKzCs_LvNjxfZk18fNsJah-rZFo_0 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10096953840674310492', time=2024-09-12T19:54:25.028171+0000, chain.objs.size()=1 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.457__shadow_.2V6f6VMe1MKMjxlVzc7EyGRXN5jQBa6_0 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3923750837707755104', time=2024-09-12T19:54:26.078243+0000, chain.objs.size()=1 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.460__shadow_.i0r0T1ytTgSuMQmXRoAazujO67J0FBJ_0 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.38204243516267234', time=2024-09-12T19:54:27.664763+0000, chain.objs.size()=1 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.465__shadow_.lzhhVCQxjvMIi5FmhnB_tUk365MKCzg_0 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10637281260653141135', time=2024-09-12T19:54:34.826250+0000, chain.objs.size()=1 2024-09-12T18:01:04.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.430+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.499__shadow_.xUa5zv6isgwcC6ejZVL3z_ju493cZLB_0 2024-09-12T18:01:04.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.433+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12846509118914421661', time=2024-09-12T19:54:35.271315+0000, chain.objs.size()=1 2024-09-12T18:01:04.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.433+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.501__shadow_.KhM8ewWMbwxF8hLbOxfaVOKh40aQ6jq_0 2024-09-12T18:01:04.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11186495333862102890', time=2024-09-12T19:54:43.788624+0000, chain.objs.size()=1 2024-09-12T18:01:04.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.521__shadow:.SXLyOXfJE6aQzAQUprecVlGrBkAJ4Y_.c5jOZzBPISp5ynSqEc-KwXEN3lZ4NVa_0 2024-09-12T18:01:04.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx', time=2024-09-12T19:54:52.474721+0000, chain.objs.size()=10 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.1 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.2 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.3 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.4 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.5 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.6 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.7 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.8 2024-09-12T18:01:04.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.434+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.9 2024-09-12T18:01:04.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.437+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.527__multipart_mymultipart.2~_r6qfIBbm7Khyn2dJAA_7fmCm0FktNx.10 2024-09-12T18:01:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~Q7aNQFTJ8axfVAwvE3uVRgG4S3nznQe', time=2024-09-12T19:54:54.895877+0000, chain.objs.size()=1 2024-09-12T18:01:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.534__multipart_mymultipart.2~Q7aNQFTJ8axfVAwvE3uVRgG4S3nznQe.1 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~Ojh7aeedpOz0A4Gu1LzEEZc4lI2mdCF', time=2024-09-12T19:54:55.091672+0000, chain.objs.size()=1 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.535__multipart_mymultipart.2~Ojh7aeedpOz0A4Gu1LzEEZc4lI2mdCF.1 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7907853831992584014', time=2024-09-12T19:55:32.121819+0000, chain.objs.size()=1 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.566__shadow_.dTj5s9ISWCY7hWfdrkAb9RtBklFehqx_0 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3903067668133526626', time=2024-09-12T19:55:36.179151+0000, chain.objs.size()=1 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:dN2YMOQE6b-RirD8oIqZP-aIMFmzes7_.0sOQz5Nj7c_AD_xR7Bei2Vc8cRSREdj_0 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15507453982199865492', time=2024-09-12T19:55:37.026431+0000, chain.objs.size()=1 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:mLv8xMuy83k8lmyj4OCLBlRW3cHvaj3_.woVBfp8Bimm5YmIohv4cmkHx6vUtuTT_0 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5335161487678795096', time=2024-09-12T19:55:45.944179+0000, chain.objs.size()=1 2024-09-12T18:01:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:kS9x3sfjjkLnZtn8ztFCIEJch8D44EN_.b9tsC-K6lQIFWS8SDFSXn9HGv6U2qI2_0 2024-09-12T18:01:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1538118485326907373', time=2024-09-12T19:55:54.871759+0000, chain.objs.size()=1 2024-09-12T18:01:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.439+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:opAiSOIRGbL0t5Ow5lxFYRVLJ-W1UtL_.ym7RBUCWH0y5ZgqLEejczVjK83hRg9w_0 2024-09-12T18:01:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.440+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8019199271599438565', time=2024-09-12T19:56:02.112451+0000, chain.objs.size()=1 2024-09-12T18:01:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.440+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:pD3Dz1PxynyAHfIMS3OlXuc7ha6rQqB_.0_Jht2zu0imUPf_pC3DM-kbPSvPtol5_0 2024-09-12T18:01:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.440+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15453928839085838746', time=2024-09-12T19:56:03.074707+0000, chain.objs.size()=1 2024-09-12T18:01:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.440+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:fibYK8hvuwLnQQKjFMcPOEcFL533Om0_.wPq5CRPeaxdr5e2qh3cws0wvkyHZBqr_0 2024-09-12T18:01:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.440+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5657400182045010829', time=2024-09-12T19:56:05.275730+0000, chain.objs.size()=1 2024-09-12T18:01:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.440+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:o5obTuUttu-XPfvcTk3YfQGHCqBM-RA_.rUWsSkF3TPAABVEUORJAIpCWbWQdAdn_0 2024-09-12T18:01:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.442+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L', time=2024-09-12T19:58:18.476257+0000, chain.objs.size()=12 2024-09-12T18:01:04.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.442+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__multipart_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.1 2024-09-12T18:01:04.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.444+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__shadow_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.1_1 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.444+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__multipart_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.2 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.444+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__shadow_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.2_1 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.444+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__multipart_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.3 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.445+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__shadow_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.3_1 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.445+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__multipart_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.4 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.445+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__shadow_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.4_1 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.445+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__multipart_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.5 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.445+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__shadow_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.5_1 2024-09-12T18:01:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.445+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__multipart_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.6 2024-09-12T18:01:04.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.447+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.625__shadow_multipart_enc.2~Kj0QplsGmEHzuoGB_pTJk2EnKWEKY6L.6_1 2024-09-12T18:01:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.449+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.706044377725815977', time=2024-09-12T19:58:21.191731+0000, chain.objs.size()=1 2024-09-12T18:01:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.449+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.636__shadow_.Vv6RWST821sMAFUxfNG5TXxn4ZggC1x_0 2024-09-12T18:01:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.449+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13078378449424814609', time=2024-09-12T19:58:24.866713+0000, chain.objs.size()=2 2024-09-12T18:01:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.449+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.650__shadow_.2EkmqIzkS7ES3JJ2Hz64kkQCtiqkvDz_0 2024-09-12T18:01:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.449+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.650__shadow_.2EkmqIzkS7ES3JJ2Hz64kkQCtiqkvDz_1 2024-09-12T18:01:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.450+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2167907933040097453', time=2024-09-12T19:58:30.847438+0000, chain.objs.size()=1 2024-09-12T18:01:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.450+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.667__shadow_.OrCpwmvkY72nlNa_nys3Ks7ujsamV45_0 2024-09-12T18:01:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.451+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.589866417849273018', time=2024-09-12T19:59:07.871878+0000, chain.objs.size()=3 2024-09-12T18:01:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.451+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.744__multipart_mymultipart3.2~63HVhcwdBluSAKkKVJrO3b29BHkATfV.1 2024-09-12T18:01:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.452+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.744__multipart_mymultipart3.2~63HVhcwdBluSAKkKVJrO3b29BHkATfV.2 2024-09-12T18:01:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.452+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.744__multipart_mymultipart3.2~63HVhcwdBluSAKkKVJrO3b29BHkATfV.3 2024-09-12T18:01:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.455+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.458+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:01:04.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.459+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.460+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48887' 2024-09-12T18:01:04.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8152195978279802124', time=2024-09-12T19:52:01.039522+0000, chain.objs.size()=2 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.165__multipart_foo.2~ZSBd66OJCK4s_mNRaZa2KBNB7bG0wJf.1 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.165__multipart_foo.2~ZSBd66OJCK4s_mNRaZa2KBNB7bG0wJf.2 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14012361082919055896', time=2024-09-12T19:52:11.234291+0000, chain.objs.size()=1 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.177__shadow_.4way-59KB7LXxGsDdF5HjtrA0sWnxzn_0 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5442516746888697283', time=2024-09-12T19:53:08.568180+0000, chain.objs.size()=1 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.241__shadow_.LT7GNk51QMPZVShdtjm561ursuzQtJk_0 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14587133214008354968', time=2024-09-12T19:53:21.206155+0000, chain.objs.size()=1 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1ip35S0VK3no8Rawk8lNyUaFa8VY9gG_0 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11112034840195635070', time=2024-09-12T19:53:21.212489+0000, chain.objs.size()=1 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gDvkWZIuQUYzClzoTC89jQkZxwKiP9M_0 2024-09-12T18:01:04.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10253944445362478899', time=2024-09-12T19:53:21.213317+0000, chain.objs.size()=1 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JMu5DJX2_GuqCVwBM0CHURIrAPXJoH6_0 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9727367923907643139', time=2024-09-12T19:53:21.382894+0000, chain.objs.size()=1 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xI-_ZXibeUQdybu5IKpY0RrdsMklPxc_0 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15637203917305143927', time=2024-09-12T19:53:21.444721+0000, chain.objs.size()=1 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Vw2VuxZpQ-DtOFNarbXcuCkB3emxYgs_0 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7034475454448611915', time=2024-09-12T19:53:21.460630+0000, chain.objs.size()=1 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Pq8uOQc8wsdmtSJ2j4Gn77Zaj_t5w0W_0 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7765090368413904100', time=2024-09-12T19:53:21.475180+0000, chain.objs.size()=1 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.g2gCsoztHSAKfyA0i_qdapx9kgFwnXj_0 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16297456522241203385', time=2024-09-12T19:53:21.479076+0000, chain.objs.size()=1 2024-09-12T18:01:04.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.461+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Np7jzUk_F-hP74ysLkT9BCk6nTpLxkr_0 2024-09-12T18:01:04.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3838610452770284481', time=2024-09-12T19:53:21.622956+0000, chain.objs.size()=1 2024-09-12T18:01:04.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.f4p0T634eQ0mMlY856oFSMZ-eUDGPGg_0 2024-09-12T18:01:04.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13508585407005274991', time=2024-09-12T19:53:21.624933+0000, chain.objs.size()=1 2024-09-12T18:01:04.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.f6ziZBDhRN5ALoVMkUEG-2AQysLZb7P_0 2024-09-12T18:01:04.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.464+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13704742170055170169', time=2024-09-12T19:53:21.800282+0000, chain.objs.size()=1 2024-09-12T18:01:04.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.464+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.5iLBBx1JglBA3EiS9gGs-Oi-OmEoEHx_0 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.465+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11131144304257800688', time=2024-09-12T19:53:21.801347+0000, chain.objs.size()=1 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.465+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.y-4CfejGxtmIihECsTC8oXfrcOD5TQ5_0 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.465+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15467012257961499916', time=2024-09-12T19:53:21.875631+0000, chain.objs.size()=1 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.465+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1TZNq7orLTphCIwwTcjSumWtqIKzK26_0 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14774893696966610190', time=2024-09-12T19:53:21.884566+0000, chain.objs.size()=1 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Xo3zkgIFiLeFgsWrg_8XIqo08RWG4Hm_0 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5800558815772065891', time=2024-09-12T19:53:21.893224+0000, chain.objs.size()=1 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vbkZO1HQWi8M6s8924jwzxa969gvmhx_0 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17102820599031372909', time=2024-09-12T19:53:22.067748+0000, chain.objs.size()=1 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WmT-NCy1kvLMDpa9z1BOqWwH241vDyt_0 2024-09-12T18:01:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7819377790436278597', time=2024-09-12T19:53:22.068759+0000, chain.objs.size()=1 2024-09-12T18:01:04.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-0-fKX8X1lMd5wEa6s-znIqo-h3d86u_0 2024-09-12T18:01:04.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15144059330714588207', time=2024-09-12T19:53:22.082541+0000, chain.objs.size()=1 2024-09-12T18:01:04.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JJm1D6GZQ1s2dL7nxLL8y-lv4wCSE1-_0 2024-09-12T18:01:04.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11114087646616277677', time=2024-09-12T19:53:22.265585+0000, chain.objs.size()=1 2024-09-12T18:01:04.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.466+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MG93OXX17xA8VACjaEK-mJybFwR8BDX_0 2024-09-12T18:01:04.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1192385006418204852', time=2024-09-12T19:53:22.295812+0000, chain.objs.size()=1 2024-09-12T18:01:04.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kqNQ8GTEOUFd-YEGjOKXnl6c4Zrp8Ps_0 2024-09-12T18:01:04.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.469+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13988381205941691879', time=2024-09-12T19:53:22.434909+0000, chain.objs.size()=1 2024-09-12T18:01:04.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.469+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Y7gvnhxRNpRVZHJpgA2TFWsyLwEVo50_0 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14754838664832416465', time=2024-09-12T19:53:22.591330+0000, chain.objs.size()=1 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.flNeWlR2QTiel3F9BB234dIeI0d6LgK_0 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6435035732984346947', time=2024-09-12T19:53:22.611836+0000, chain.objs.size()=1 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qG2Em3lSqaiRLK4bCHreRW28PMC9p0j_0 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1767819278469728285', time=2024-09-12T19:53:22.638005+0000, chain.objs.size()=1 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.e9FhnDv9bSf4EyMIkM4mPeopGFNYdnd_0 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10350454116461425709', time=2024-09-12T19:53:23.441202+0000, chain.objs.size()=1 2024-09-12T18:01:04.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.267__shadow_.0934B4GWb2PishqWg_xLNBZP390Ineq_0 2024-09-12T18:01:04.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10127896000020738779', time=2024-09-12T19:53:23.871524+0000, chain.objs.size()=1 2024-09-12T18:01:04.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.471+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.269__shadow_.ui9slxubZqV6oIGOkJ0bb-RQSUeIhri_0 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13928570051973789158', time=2024-09-12T19:53:24.463757+0000, chain.objs.size()=1 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.272__shadow_.Df4AG3O4ZlVgTUnPGU-XDGkGtF1j2de_0 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5799881698141699114', time=2024-09-12T19:53:25.710529+0000, chain.objs.size()=1 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.278__shadow_.52cXlE2GCGBbnpWdtMrY64dpWn3zAF1_0 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14020685239207981847', time=2024-09-12T19:53:44.565528+0000, chain.objs.size()=1 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CWEQL8oWhPrGGBVaMWmI3nLbLejGCFB_0 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13321171438277648102', time=2024-09-12T19:53:44.586156+0000, chain.objs.size()=1 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Bo30PxojCrSgBe-dkC_YW2dhztqX4ZQ_0 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6068613649177752599', time=2024-09-12T19:53:44.592591+0000, chain.objs.size()=1 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AGgXhEvoNuXu_R00XC43oMU9etos2qa_0 2024-09-12T18:01:04.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6840223328878104156', time=2024-09-12T19:53:44.924688+0000, chain.objs.size()=1 2024-09-12T18:01:04.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.474+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.i2mnhDvqTMPwIO56OUiEsw8NQL0qe4O_0 2024-09-12T18:01:04.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.476+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14400850836284496405', time=2024-09-12T19:53:45.023504+0000, chain.objs.size()=1 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.476+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7oTR1M7kkDPQy4IWuLu-VCuvHYmYl77_0 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.476+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18187880413393501221', time=2024-09-12T19:53:45.050948+0000, chain.objs.size()=1 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.476+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sWtB5ytFf7Vip4JWXRvmfSTlOaS8f86_0 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13769427145021456588', time=2024-09-12T19:53:45.132256+0000, chain.objs.size()=1 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NsiURbylpwdaoZuPytlPvvTu-9nU4I-_0 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13984330562669502106', time=2024-09-12T19:53:45.180715+0000, chain.objs.size()=1 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7wPzQ5GrE8TFuf_jdPW_UnDZIlv4gWu_0 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5398652948465767740', time=2024-09-12T19:53:45.224424+0000, chain.objs.size()=1 2024-09-12T18:01:04.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9qp6Bk_rdNMZTi3d8O5YQTehfi2e4fS_0 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16288869651484326067', time=2024-09-12T19:53:45.246133+0000, chain.objs.size()=1 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jKRMzGBF-Ct47F9WSCmjFuPNUpe7odC_0 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11319590439013222909', time=2024-09-12T19:53:45.343819+0000, chain.objs.size()=1 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.477+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UrIdxzh6hKfNnxUjZm3iBJtbByWrbvL_0 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.478+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5868003474850672980', time=2024-09-12T19:53:45.351230+0000, chain.objs.size()=1 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.478+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Q8bsoKE4lbJR6BUlZsR9vEuiawXHAsu_0 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.478+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9395261086999224468', time=2024-09-12T19:53:45.376055+0000, chain.objs.size()=1 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.478+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RXEsFwFOTkSn31Iaw-6WPbJaSZZT2DJ_0 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.478+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5777046808275946043', time=2024-09-12T19:53:45.378629+0000, chain.objs.size()=1 2024-09-12T18:01:04.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.478+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8PRHED-7fDyON4aAgH--BBSCye8dUVE_0 2024-09-12T18:01:04.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.479+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14103055975631046686', time=2024-09-12T19:53:45.401922+0000, chain.objs.size()=1 2024-09-12T18:01:04.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.479+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OQIbtlMVEN-Itz9cAXFx0dMdORhstIb_0 2024-09-12T18:01:04.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.481+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9148067547592840322', time=2024-09-12T19:53:45.535365+0000, chain.objs.size()=1 2024-09-12T18:01:04.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.481+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ms_oq2ACEc3yMIHF2D3PvdaN6Cbm6_g_0 2024-09-12T18:01:04.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9493500524615654101', time=2024-09-12T19:53:45.586385+0000, chain.objs.size()=1 2024-09-12T18:01:04.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.U_Imwqj-j5gDlMxhY63l-SSGBnszFmv_0 2024-09-12T18:01:04.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11147795513813780493', time=2024-09-12T19:53:45.649551+0000, chain.objs.size()=1 2024-09-12T18:01:04.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4aPh2MeQRI4BQ76Jlq-0H2WSgUBOSay_0 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9664665888582261425', time=2024-09-12T19:53:45.775737+0000, chain.objs.size()=1 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DpKSaQlb5bn_aFlyL64rnVvKNu-L8Pm_0 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8779788760664486774', time=2024-09-12T19:53:45.835930+0000, chain.objs.size()=1 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.l1kITdAj0VvVZfccXIidXA7UlHcqWlp_0 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10828067034874744973', time=2024-09-12T19:53:45.954541+0000, chain.objs.size()=1 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mag_1cosK5KwmMdtFCcnd5P5uvDWECu_0 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7326392705146868546', time=2024-09-12T19:53:45.956805+0000, chain.objs.size()=1 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.newrnDbL0CSavmecMFIdrF2H-ehpTya_0 2024-09-12T18:01:04.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17430122349988390247', time=2024-09-12T19:53:45.965304+0000, chain.objs.size()=1 2024-09-12T18:01:04.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iXjIn4CGRMULzHa-zJ-Sw0k1eIFEqCL_0 2024-09-12T18:01:04.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6987618029656496435', time=2024-09-12T19:53:45.975100+0000, chain.objs.size()=1 2024-09-12T18:01:04.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.f1llNaCDR1s4ulLULLO_Dsd_5D09gQb_0 2024-09-12T18:01:04.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18218182832354947196', time=2024-09-12T19:53:45.992623+0000, chain.objs.size()=1 2024-09-12T18:01:04.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tp6pvnniHpWNxDx5tyvUWQi9fqTGYgs_0 2024-09-12T18:01:04.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12800417301656356082', time=2024-09-12T19:53:46.017248+0000, chain.objs.size()=1 2024-09-12T18:01:04.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.483+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8kMFBGiesjMdLd4DoAzlOa6mpt5ujPG_0 2024-09-12T18:01:04.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11303975359770874674', time=2024-09-12T19:53:46.020157+0000, chain.objs.size()=1 2024-09-12T18:01:04.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8RY1uHPfIPkihXzafaY8VVxBkiDY6Av_0 2024-09-12T18:01:04.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.487+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15936156886297972422', time=2024-09-12T19:53:46.030595+0000, chain.objs.size()=1 2024-09-12T18:01:04.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.487+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nnSjmWVS-N4dEzmebfksu0PrKTrNiuB_0 2024-09-12T18:01:04.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.488+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8024354894049799894', time=2024-09-12T19:53:46.148424+0000, chain.objs.size()=1 2024-09-12T18:01:04.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.488+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.c7UCLcL8st8fMogeBIo65UmnaleolpY_0 2024-09-12T18:01:04.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.489+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6087330517944586216', time=2024-09-12T19:53:46.219404+0000, chain.objs.size()=1 2024-09-12T18:01:04.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.489+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.q5CUT6xOvw3R45cQMFHaTtDPp-3edfc_0 2024-09-12T18:01:04.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.489+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2943989915579135298', time=2024-09-12T19:53:46.220523+0000, chain.objs.size()=1 2024-09-12T18:01:04.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.489+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XCEuqQJAWlO3ihEoz9IpAIT8oM5GvsN_0 2024-09-12T18:01:04.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17052621987806756160', time=2024-09-12T19:53:46.230409+0000, chain.objs.size()=1 2024-09-12T18:01:04.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WoLWvUeljJb-yF_FXqBgWu_H-Q1yM7Y_0 2024-09-12T18:01:04.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6117028185745930608', time=2024-09-12T19:53:54.647164+0000, chain.objs.size()=1 2024-09-12T18:01:04.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.KYCbyICsefpfDwuAXGJXb1aEfhGk5Yu_0 2024-09-12T18:01:04.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16667207077130099983', time=2024-09-12T19:53:54.715611+0000, chain.objs.size()=1 2024-09-12T18:01:04.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qVqx124eR9Doh3YBzPZ1d4slprQPwBP_0 2024-09-12T18:01:04.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6625557600875248003', time=2024-09-12T19:53:54.727491+0000, chain.objs.size()=1 2024-09-12T18:01:04.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.490+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.WWNK4NTuRr8L-E3q2sOj3um7pcd-k-d_0 2024-09-12T18:01:04.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12703358248401487388', time=2024-09-12T19:53:54.749413+0000, chain.objs.size()=1 2024-09-12T18:01:04.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MKY-HPnQRgEDhqYOrbnM2wC4j0DZrwq_0 2024-09-12T18:01:04.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17519253701307979032', time=2024-09-12T19:53:54.760671+0000, chain.objs.size()=1 2024-09-12T18:01:04.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DTfLSPjHb7wBqwbVkvCrF2iTxPMvxeK_0 2024-09-12T18:01:04.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10314420927183278233', time=2024-09-12T19:53:54.843823+0000, chain.objs.size()=1 2024-09-12T18:01:04.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.k9l-eJAgoxKv_wtHHKnQS91t0wQ3is6_0 2024-09-12T18:01:04.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14683429432152258584', time=2024-09-12T19:53:54.847069+0000, chain.objs.size()=1 2024-09-12T18:01:04.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.492+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lnkL016Zwm8rXw6qKQJ4HCCaprvFDZ4_0 2024-09-12T18:01:04.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.495+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3086145056704460290', time=2024-09-12T19:53:54.879493+0000, chain.objs.size()=1 2024-09-12T18:01:04.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.495+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kikjnL3ZSgASL4hIlyqSx81u3fO5cP5_0 2024-09-12T18:01:04.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6900377146608306175', time=2024-09-12T19:53:54.887028+0000, chain.objs.size()=1 2024-09-12T18:01:04.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0ksjkxTmmbnx3RpQ4xMxbcdhd2EbXhE_0 2024-09-12T18:01:04.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1434453428618145727', time=2024-09-12T19:53:54.936783+0000, chain.objs.size()=1 2024-09-12T18:01:04.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cMbnQr1yHINGC1JANOKThaTOM6JQeJY_0 2024-09-12T18:01:04.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17809523950156211460', time=2024-09-12T19:53:55.111890+0000, chain.objs.size()=1 2024-09-12T18:01:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ucL2BbEGRyHHJeA7p7eUVGZvNV6PoxJ_0 2024-09-12T18:01:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11641158632197950752', time=2024-09-12T19:53:55.148332+0000, chain.objs.size()=1 2024-09-12T18:01:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bTjI8OX6lTpbvW5xwJ5a9AiZGCtDkEU_0 2024-09-12T18:01:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12994495864092735122', time=2024-09-12T19:53:55.256494+0000, chain.objs.size()=1 2024-09-12T18:01:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.P0Ik4vtivnYYkZpQyZ_Oz31aGg0Mj-J_0 2024-09-12T18:01:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8136539351346189698', time=2024-09-12T19:53:55.257604+0000, chain.objs.size()=1 2024-09-12T18:01:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.496+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GMeAqc4019CT5eyj2nLAMnEoJHyXhEr_0 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8592384210873846743', time=2024-09-12T19:53:55.297475+0000, chain.objs.size()=1 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Yn1KgyeCVxEl6dhsocPjmW8J0ybHOxd_0 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5739964867823987910', time=2024-09-12T19:53:55.311473+0000, chain.objs.size()=1 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JEtc4pAIB8AqNDVY8_IubP3L-q_dVqM_0 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6364630233425986678', time=2024-09-12T19:53:55.321706+0000, chain.objs.size()=1 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TDSemJh4JhfpA3BpstA9Rz2EHS2aLnz_0 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13001379526470215062', time=2024-09-12T19:53:55.536509+0000, chain.objs.size()=1 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.497+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GZ55WAfe_BUv3Vb1b9i1sdWGo-SIgne_0 2024-09-12T18:01:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.498+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18021306308758173214', time=2024-09-12T19:53:55.566271+0000, chain.objs.size()=1 2024-09-12T18:01:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.498+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LCBeLLqK6pNgBFmakn-Jucns5EDD6Y7_0 2024-09-12T18:01:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16026431723626338700', time=2024-09-12T19:53:55.762482+0000, chain.objs.size()=1 2024-09-12T18:01:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LQLuD90kEykU5qciEdy1UFHyOuwrE7S_0 2024-09-12T18:01:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5831963641206123922', time=2024-09-12T19:53:55.775984+0000, chain.objs.size()=1 2024-09-12T18:01:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1EOBp133im1vWEPmlRud2UDA2a_CIpK_0 2024-09-12T18:01:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5239769474600694354', time=2024-09-12T19:53:55.795515+0000, chain.objs.size()=1 2024-09-12T18:01:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LRXAf5pSufw2Wo0yhnftXzIQqBXQDBD_0 2024-09-12T18:01:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17726271441457092591', time=2024-09-12T19:53:55.807866+0000, chain.objs.size()=1 2024-09-12T18:01:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.501+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aiwIxgqucO6CwcWPm4w63NiCAzwxswb_0 2024-09-12T18:01:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.502+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4600792468041365642', time=2024-09-12T19:53:55.996229+0000, chain.objs.size()=1 2024-09-12T18:01:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.502+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.H3zwnUitXl0zGqtt5vQRLvxk9OGHrEm_0 2024-09-12T18:01:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9404519856960367773', time=2024-09-12T19:53:56.010793+0000, chain.objs.size()=1 2024-09-12T18:01:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BEiLv1AJ33nv3kgkGnJmZ7HbaHlFAWV_0 2024-09-12T18:01:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14210226904139565618', time=2024-09-12T19:53:56.026116+0000, chain.objs.size()=1 2024-09-12T18:01:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.46NZ9ezNMdthKddNZagTrxj8l827UMY_0 2024-09-12T18:01:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11136681812418734907', time=2024-09-12T19:53:56.189574+0000, chain.objs.size()=1 2024-09-12T18:01:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mD5c35LpdFmYnk3w8aroxN8Gl8g5ErU_0 2024-09-12T18:01:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6861416658659997732', time=2024-09-12T19:53:56.201747+0000, chain.objs.size()=1 2024-09-12T18:01:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tksNLPIeqbeojzuuT1pZHHH00zMJ7H1_0 2024-09-12T18:01:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18189099070508152332', time=2024-09-12T19:54:06.346309+0000, chain.objs.size()=1 2024-09-12T18:01:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.377__shadow_.3FIcWXYwfyuEAk93Fc9Q33W4ITMbreL_0 2024-09-12T18:01:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11362143731727143337', time=2024-09-12T19:54:07.248083+0000, chain.objs.size()=1 2024-09-12T18:01:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.503+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.380__shadow_.02CDmetp4571GV_t4JJ1cufvOaizwOu_0 2024-09-12T18:01:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2974315993553055168', time=2024-09-12T19:54:09.532104+0000, chain.objs.size()=1 2024-09-12T18:01:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.391__shadow_.E-N7EiCntROxjZoprGOmyoitcdrKeaR_0 2024-09-12T18:01:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8582440031783087628', time=2024-09-12T19:54:27.516170+0000, chain.objs.size()=1 2024-09-12T18:01:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.464__shadow_.sOc-IYXS2yfxi7m7KjbK6Zay8eWwoKi_0 2024-09-12T18:01:04.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.506+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC', time=2024-09-12T19:54:48.870325+0000, chain.objs.size()=2 2024-09-12T18:01:04.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.1 2024-09-12T18:01:04.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.506+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.1_1 2024-09-12T18:01:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.508+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC', time=2024-09-12T19:54:48.871859+0000, chain.objs.size()=2 2024-09-12T18:01:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.508+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.2 2024-09-12T18:01:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.508+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.2_1 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.509+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC', time=2024-09-12T19:54:48.872992+0000, chain.objs.size()=2 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.509+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.3 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.509+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.3_1 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.509+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC', time=2024-09-12T19:54:48.874976+0000, chain.objs.size()=2 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.509+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.4 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.509+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.4_1 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.510+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC', time=2024-09-12T19:54:48.876384+0000, chain.objs.size()=2 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.510+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.5 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.510+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.5_1 2024-09-12T18:01:04.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.514+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/48887 2024-09-12T18:01:04.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:01:04.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC', time=2024-09-12T19:54:48.877477+0000, chain.objs.size()=2 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.6 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__shadow_mymultipart.2~r6RZDxMLbrcyVbPxThP8h2rvWxeYEuC.6_1 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14208186417929005066', time=2024-09-12T19:54:48.883703+0000, chain.objs.size()=6 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5.1 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.36Zl0cmN2dREwUH2lpxgUJZp-FJzP03Q.2 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.tkQ_kYOP3Jw_P5993SFq196ovtpSVFSG.3 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5.4 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5.5 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.523__multipart_mymultipart.2~paZH0I-48fkNy1F2l7S-EtJIGSO03P5.6 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12017587374473483797', time=2024-09-12T19:54:50.266684+0000, chain.objs.size()=3 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~WCs2jeaLRHZUcPaDfyh32GGTyj-OQB5.1 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~WCs2jeaLRHZUcPaDfyh32GGTyj-OQB5.2 2024-09-12T18:01:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~WCs2jeaLRHZUcPaDfyh32GGTyj-OQB5.3 2024-09-12T18:01:04.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6632496610781903112', time=2024-09-12T19:55:27.371425+0000, chain.objs.size()=1 2024-09-12T18:01:04.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.517+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.563__shadow_.pIgSvJ-VYpvAHZMZFnmkD0pIKYRpLId_0 2024-09-12T18:01:04.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8869970342785681527', time=2024-09-12T19:55:31.637264+0000, chain.objs.size()=2 2024-09-12T18:01:04.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.564__shadow_.Y1NSG1pnrLGwl57dICMNS6ONxJcgzlo_0 2024-09-12T18:01:04.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.564__shadow_.Y1NSG1pnrLGwl57dICMNS6ONxJcgzlo_1 2024-09-12T18:01:04.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14095802932438131675', time=2024-09-12T19:55:33.410185+0000, chain.objs.size()=1 2024-09-12T18:01:04.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:HLtAqXoeOfoFf0rjZLIDqJXT5YcoQEV_.05bLv7a-Kje1dONOuWKSMiu5UH-lznF_0 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5127153309583205254', time=2024-09-12T19:55:37.475200+0000, chain.objs.size()=1 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:EPnz.lNzU.b4KKOaOsszjUkdGR4n6a7_.Ppy5kbZZOgh94OK36SzeIa5FKHBtCM1_0 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14680278795582469264', time=2024-09-12T19:55:47.202154+0000, chain.objs.size()=1 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:EU4LJk16GtYy5hCSQ1uaTydFBzm4d5K_.pyKKyOKg1If-cP5Hgv3e3lASwXUcz3N_0 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17512304379104148617', time=2024-09-12T19:55:47.699338+0000, chain.objs.size()=1 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:-XACAEaS8kRd2xAYuGvFmjrRzOThjEC_.zOFK0dL7Kgq0CV76MCvB-vKGdR33mkI_0 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14476521397063803336', time=2024-09-12T19:55:57.996274+0000, chain.objs.size()=1 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:q2yoMTKf.t26eoRSbMyVf3WP9gokAKG_.iaY1eKXBVl-FgBovEiOSBanxFCdsr2L_0 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14944867820956849854', time=2024-09-12T19:58:20.786937+0000, chain.objs.size()=1 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.634__shadow_.VAsxZONtpPb8FiFrcGyI4lAy76lrSOU_0 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16211062224674144750', time=2024-09-12T19:58:30.847601+0000, chain.objs.size()=1 2024-09-12T18:01:04.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.667__shadow_.SGV9KSr0MowzLaCJiY4sd8oW2jctMwA_0 2024-09-12T18:01:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3913311079937423567', time=2024-09-12T19:58:35.993442+0000, chain.objs.size()=1 2024-09-12T18:01:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.694__shadow:--3SV4h9RwWASCPDQk6YmjUVcp8yZ4M_.5KIejwG3vFoqyG1lDKO5F7TTLrGWYTB_0 2024-09-12T18:01:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11337555729866482880', time=2024-09-12T19:58:37.044362+0000, chain.objs.size()=1 2024-09-12T18:01:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.521+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.699__shadow:BSlcyXqAVIwqjcQdSkRywI.rIvRcWkY_.im8QXDHT0wX1Z4Vv2BDF_T5KJHQJuLE_0 2024-09-12T18:01:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.526+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14439015821344982346', time=2024-09-12T19:59:06.440665+0000, chain.objs.size()=1 2024-09-12T18:01:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.526+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.740__shadow_.yZTYevUfnZJaBIL3DzYJwcwyRdm05SB_0 2024-09-12T18:01:04.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.528+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.531+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:01:04.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.532+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.532+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46691' 2024-09-12T18:01:04.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11274641759868861437', time=2024-09-12T19:51:56.674800+0000, chain.objs.size()=3 2024-09-12T18:01:04.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159__shadow_.i6H49ZUbNcWyipNLJ5YSuUW5FITcpdr_0 2024-09-12T18:01:04.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159__shadow_.i6H49ZUbNcWyipNLJ5YSuUW5FITcpdr_1 2024-09-12T18:01:04.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.159__shadow_.i6H49ZUbNcWyipNLJ5YSuUW5FITcpdr_2 2024-09-12T18:01:04.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.492770167739057911', time=2024-09-12T19:53:09.703120+0000, chain.objs.size()=1 2024-09-12T18:01:04.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.246__shadow_.Cu8pO_F9CUkCHCimnfFJziLu-Sk-5t1_0 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10137274649899669903', time=2024-09-12T19:53:11.416379+0000, chain.objs.size()=1 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.254__shadow_.NJNst4kIz_HSOACKr3z5dJaWqkRcB8r_0 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14306015225541298404', time=2024-09-12T19:53:12.867436+0000, chain.objs.size()=1 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.261__shadow_.ICRXcZ4Tl5x0jdKrpyznFKdha3eDo77_0 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3216237999172110503', time=2024-09-12T19:53:21.219957+0000, chain.objs.size()=1 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.eOaAbeflcHuH1MgEpIvkiiDv4Nd8t8u_0 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11446363663610400494', time=2024-09-12T19:53:21.222739+0000, chain.objs.size()=1 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._USVYM98VAZTmbvSx_0KubqUO3tLHOc_0 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4140613185941623980', time=2024-09-12T19:53:21.231004+0000, chain.objs.size()=1 2024-09-12T18:01:04.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-hUwU27ZbVxkDZmeEbGOFpzbM_b5kMl_0 2024-09-12T18:01:04.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9263688542489361855', time=2024-09-12T19:53:21.261405+0000, chain.objs.size()=1 2024-09-12T18:01:04.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._hc0_F8YGq5FDGAeM5ByxAMD_vZ9fk0_0 2024-09-12T18:01:04.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11578970094295904486', time=2024-09-12T19:53:21.280263+0000, chain.objs.size()=1 2024-09-12T18:01:04.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Rv6_ulXBKTLrKJ5xA2yRANQ84ym_mVa_0 2024-09-12T18:01:04.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8396194365579473100', time=2024-09-12T19:53:21.393450+0000, chain.objs.size()=1 2024-09-12T18:01:04.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.533+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.V9xxL-XhVCFBVVYzlR_gHn8KET2XniH_0 2024-09-12T18:01:04.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.537+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9569960343351499822', time=2024-09-12T19:53:21.437515+0000, chain.objs.size()=1 2024-09-12T18:01:04.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BcAmIDSa1swumVkF2x2RJPHI1SWDDNa_0 2024-09-12T18:01:04.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16508883359995636924', time=2024-09-12T19:53:21.629310+0000, chain.objs.size()=1 2024-09-12T18:01:04.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.d1ujAx11Qt7zWVinxWmff85PkOD70zg_0 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17686559609672726267', time=2024-09-12T19:53:21.656427+0000, chain.objs.size()=1 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.VLOoCmBxLg27W3aoSpViHhe3tHY_7xn_0 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3848690549312231225', time=2024-09-12T19:53:21.673641+0000, chain.objs.size()=1 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.IeJv-ngVIuFfubZaju4TMKrEYpQ5XtD_0 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5217292102757873982', time=2024-09-12T19:53:21.674740+0000, chain.objs.size()=1 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gtEqBbCry5Ae61Z1h6IZcoXujE84S_L_0 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6914689313703247103', time=2024-09-12T19:53:21.806088+0000, chain.objs.size()=1 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3BhKMZBnxDYuCbqJDyUpJuyvb7KApfY_0 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13934893422893045974', time=2024-09-12T19:53:21.814911+0000, chain.objs.size()=1 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1z1yWAab_xj0KOTQOVD-fL4H-QErD1C_0 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3232176990202802440', time=2024-09-12T19:53:21.897942+0000, chain.objs.size()=1 2024-09-12T18:01:04.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XT5dSxrmLkKDT2bQQU50scrrdL0oLHa_0 2024-09-12T18:01:04.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3542486057556808443', time=2024-09-12T19:53:22.008291+0000, chain.objs.size()=1 2024-09-12T18:01:04.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hSRgBhw3aaVwT5QGg4f6RuZEzGotadT_0 2024-09-12T18:01:04.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15434619350388962543', time=2024-09-12T19:53:22.203788+0000, chain.objs.size()=1 2024-09-12T18:01:04.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.sUg0cFpRzzEpTKj1kqMN-0g6Me3Zvs__0 2024-09-12T18:01:04.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13288218544191951931', time=2024-09-12T19:53:22.229386+0000, chain.objs.size()=1 2024-09-12T18:01:04.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.538+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AWFd2VOrsqYnYBWg9xz0SH95kMWgRQK_0 2024-09-12T18:01:04.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5809286412233628299', time=2024-09-12T19:53:22.283914+0000, chain.objs.size()=1 2024-09-12T18:01:04.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.I0xd1kyVdTTxZCarS3XubEair0jaIZL_0 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1921946442561206133', time=2024-09-12T19:53:22.418310+0000, chain.objs.size()=1 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.L-2TqAGw4yqSWY3sBbHSXGxprhzcYs__0 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6978387875138906161', time=2024-09-12T19:53:22.503731+0000, chain.objs.size()=1 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pkrJDNAK_DKd5Upfd-c0xnXV9yVVv6L_0 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14378311663673639599', time=2024-09-12T19:53:22.635205+0000, chain.objs.size()=1 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GuU-F5umQXKLAhfSKpn7h_XBhGHNmYb_0 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17167843515406479285', time=2024-09-12T19:53:22.672996+0000, chain.objs.size()=1 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2YH43OnzO3ZhKlOIVtGwUvNOhW564fn_0 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5039814028064258534', time=2024-09-12T19:53:23.440580+0000, chain.objs.size()=1 2024-09-12T18:01:04.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.541+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.267__shadow_.jVFdWLnGuuQYz4JzWIe5ThOE7Z_Bd_C_0 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3831195249670646181', time=2024-09-12T19:53:24.266619+0000, chain.objs.size()=1 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.271__shadow_.v4NeeBQaaoVTIZX_pr_9YIj2NOetcw__0 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5045755476765417953', time=2024-09-12T19:53:25.092735+0000, chain.objs.size()=1 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.275__shadow_.ZG9M4fKO5vVSKWDYiGfsMZWw-Ea0AV0_0 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6803919973305450209', time=2024-09-12T19:53:26.982032+0000, chain.objs.size()=1 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.284__shadow_.hPh-2aSRBqJ-39qrM-xPSNH6jeG1FJP_0 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5029856205903104704', time=2024-09-12T19:53:29.949965+0000, chain.objs.size()=1 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.SIeNRlq9lDmuipP7aXFw0-bsBAzXc5Q_0 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15482761897434732678', time=2024-09-12T19:53:44.542952+0000, chain.objs.size()=1 2024-09-12T18:01:04.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.544+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IAZ1kC88MOAtEDQfg1IAaARLp_ubA_2_0 2024-09-12T18:01:04.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.546+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.382224783721019834', time=2024-09-12T19:53:44.601399+0000, chain.objs.size()=1 2024-09-12T18:01:04.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.546+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.VMTkBHUYoQ4FuJQqds7scQ_qDnMIsTo_0 2024-09-12T18:01:04.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15258961271591879972', time=2024-09-12T19:53:44.607958+0000, chain.objs.size()=1 2024-09-12T18:01:04.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mmAghuhfC0f-pF4vyoYN6L6I6lnXXU7_0 2024-09-12T18:01:04.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10124029580074909611', time=2024-09-12T19:53:44.641859+0000, chain.objs.size()=1 2024-09-12T18:01:04.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.v6MBf_lsk2J-i_ENZhEFEKwsucuZYiR_0 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16347937499710400098', time=2024-09-12T19:53:44.643605+0000, chain.objs.size()=1 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IEgtLbDg9btyTN2ZoB4NIVUbCgZ9f4m_0 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9619943833013221396', time=2024-09-12T19:53:44.939324+0000, chain.objs.size()=1 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZDrUjzjooueBALIrI1pWDlb1anu6trm_0 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9041625392690601435', time=2024-09-12T19:53:44.948687+0000, chain.objs.size()=1 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-XWZaAxBrd607673B8AIhkT_FMPKBho_0 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7258518702745177720', time=2024-09-12T19:53:44.964486+0000, chain.objs.size()=1 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GkK9uDE_Zkj6w-MaagBEzB3wVcGV_R7_0 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6460662906019280422', time=2024-09-12T19:53:45.035787+0000, chain.objs.size()=1 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.548+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4YaSt8VPn9IZoUC0O7OpMth2QPvwX51_0 2024-09-12T18:01:04.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.549+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13548944186186143895', time=2024-09-12T19:53:45.151219+0000, chain.objs.size()=1 2024-09-12T18:01:04.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.549+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZgSR77Q55aeVE0w66Uing9p5h4KYy4D_0 2024-09-12T18:01:04.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.549+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14368596103186122764', time=2024-09-12T19:53:45.151927+0000, chain.objs.size()=1 2024-09-12T18:01:04.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.549+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.o0iJD8V174akn3IeG_gmzaCtcZfTIs0_0 2024-09-12T18:01:04.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.550+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14119522732078100609', time=2024-09-12T19:53:45.153675+0000, chain.objs.size()=1 2024-09-12T18:01:04.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.550+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.IpokwiHsZNEYNgXYHhhRycxaTb9kagr_0 2024-09-12T18:01:04.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.551+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15331073074077773586', time=2024-09-12T19:53:45.162112+0000, chain.objs.size()=1 2024-09-12T18:01:04.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.551+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cHdozl9c-b-DHk4AZM4RfqZVIkw1glz_0 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17666527742625919053', time=2024-09-12T19:53:45.213064+0000, chain.objs.size()=1 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KTPJntNrzVosLQofxZjEUyrch34udtM_0 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4179963524679702296', time=2024-09-12T19:53:45.338042+0000, chain.objs.size()=1 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XHuOtXw-y7Ywbk87sIqF_BFZVpqdnPN_0 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12101303004530328446', time=2024-09-12T19:53:45.372451+0000, chain.objs.size()=1 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hOV67BpD8Rwt1pALsDHij_V_8qkWZYy_0 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9874720209404588215', time=2024-09-12T19:53:45.415326+0000, chain.objs.size()=1 2024-09-12T18:01:04.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.553+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.EHYiYepLGHEP6SL17WHhdwkd8HWLK9t_0 2024-09-12T18:01:04.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2027089501424325888', time=2024-09-12T19:53:45.422809+0000, chain.objs.size()=1 2024-09-12T18:01:04.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.twZsb4Gn4YrS6P5ATwb2aZHz7exiukM_0 2024-09-12T18:01:04.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10186870157097032520', time=2024-09-12T19:53:45.430568+0000, chain.objs.size()=1 2024-09-12T18:01:04.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jzPtWq3DeV5fdJlxd8F0S0D7rcrXmB8_0 2024-09-12T18:01:04.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4858064783276901131', time=2024-09-12T19:53:45.539005+0000, chain.objs.size()=1 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1GtrD7I0D5ENlklxwHhyx7z7EZASY_E_0 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17358121828828487446', time=2024-09-12T19:53:45.557164+0000, chain.objs.size()=1 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JDUnP1JvCey9wSD2g5r8RpSLGA-_kp0_0 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7012871490367581138', time=2024-09-12T19:53:45.566899+0000, chain.objs.size()=1 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xIDV7dJFIGhoaoa_JQUeiIW0yqjex77_0 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10064337352534593577', time=2024-09-12T19:53:45.584787+0000, chain.objs.size()=1 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.555+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qIcrkWTxkbHjOA-i77Jy72qOnQQALlv_0 2024-09-12T18:01:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.556+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8998072685478294378', time=2024-09-12T19:53:45.588876+0000, chain.objs.size()=1 2024-09-12T18:01:04.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.556+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.46HJy6HhB_sZzGUKFYiq4ZcRfSgOPLd_0 2024-09-12T18:01:04.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.557+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.903485371816677815', time=2024-09-12T19:53:45.603621+0000, chain.objs.size()=1 2024-09-12T18:01:04.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.557+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.r2Yq581q6pIxJrv4Asnz4des4TnvKTb_0 2024-09-12T18:01:04.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18265886157575532988', time=2024-09-12T19:53:45.626547+0000, chain.objs.size()=1 2024-09-12T18:01:04.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RRUIXEnLbZ9v7aedDA8jLRxPkcUjmGh_0 2024-09-12T18:01:04.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6549196912907830021', time=2024-09-12T19:53:45.655374+0000, chain.objs.size()=1 2024-09-12T18:01:04.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.cKiGXdRV7gOozd7DIv55hgdEF615hX8_0 2024-09-12T18:01:04.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12297658982607263428', time=2024-09-12T19:53:45.819344+0000, chain.objs.size()=1 2024-09-12T18:01:04.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.rGDx5zvItHeIaWvdDN8pQlpdsUJNlZP_0 2024-09-12T18:01:04.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1922881726253548017', time=2024-09-12T19:53:45.826579+0000, chain.objs.size()=1 2024-09-12T18:01:04.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.558+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NmJkX9QeO1tc0bll9MGAZ63IGXp4WQQ_0 2024-09-12T18:01:04.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1778646904886911576', time=2024-09-12T19:53:45.847447+0000, chain.objs.size()=1 2024-09-12T18:01:04.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.65QrvbpX3z5zTnBEFeANHFrwaFt5wYy_0 2024-09-12T18:01:04.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9309781961782765372', time=2024-09-12T19:53:45.854664+0000, chain.objs.size()=1 2024-09-12T18:01:04.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lPA04TQe5fPloN7CzGp8zDTyh3A97H5_0 2024-09-12T18:01:04.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3265989017614777115', time=2024-09-12T19:53:45.856979+0000, chain.objs.size()=1 2024-09-12T18:01:04.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.x7clUnW5RQxWkLHurLcn3Ye2OX4dNRp_0 2024-09-12T18:01:04.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8717839419952914266', time=2024-09-12T19:53:45.943746+0000, chain.objs.size()=1 2024-09-12T18:01:04.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5rldZgH4wYZf7wABSqgfjPUV3xDZzni_0 2024-09-12T18:01:04.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10142983663889298867', time=2024-09-12T19:53:45.947779+0000, chain.objs.size()=1 2024-09-12T18:01:04.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sdI3n3eeq7pm8lLKAf1E_ebMDF86L7x_0 2024-09-12T18:01:04.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13118279935564187175', time=2024-09-12T19:53:45.992134+0000, chain.objs.size()=1 2024-09-12T18:01:04.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.560+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sLJglB9qTh4Ok931UAvr2C7c-cByfvJ_0 2024-09-12T18:01:04.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.562+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9167159573951344386', time=2024-09-12T19:53:45.995867+0000, chain.objs.size()=1 2024-09-12T18:01:04.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.562+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.O6mYy6zElcqfpqjwWHIbetQSgrOK1-q_0 2024-09-12T18:01:04.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.562+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16335668879014165247', time=2024-09-12T19:53:46.147764+0000, chain.objs.size()=1 2024-09-12T18:01:04.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.562+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TH_Q-e1RB7S-XS9zlx5WywXDZb4uBo0_0 2024-09-12T18:01:04.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12259534963265435721', time=2024-09-12T19:53:46.161141+0000, chain.objs.size()=1 2024-09-12T18:01:04.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gCxu_CTrTXQSYcp6N9AUTHzgPgCDBJc_0 2024-09-12T18:01:04.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13659490759919432934', time=2024-09-12T19:53:46.191411+0000, chain.objs.size()=1 2024-09-12T18:01:04.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.j2uaUBv5ZO3gZaLdffIkWy_-s4BUSKo_0 2024-09-12T18:01:04.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.563+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17002861359299545567', time=2024-09-12T19:53:46.203883+0000, chain.objs.size()=1 2024-09-12T18:01:04.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.563+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Xxn0w3E8xaaQkgKEz8waQIjgy7IH8Q0_0 2024-09-12T18:01:04.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.565+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.683677322981266215', time=2024-09-12T19:53:54.657926+0000, chain.objs.size()=1 2024-09-12T18:01:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.565+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.PSWHpFWnnxBljLRu765zPWk_cluFUwv_0 2024-09-12T18:01:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.565+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.562710950346855821', time=2024-09-12T19:53:54.671227+0000, chain.objs.size()=1 2024-09-12T18:01:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.565+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qyEHl2ZFkJuuscciVO2G7QS-DVb3EX-_0 2024-09-12T18:01:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.565+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8868568037874774409', time=2024-09-12T19:53:54.686434+0000, chain.objs.size()=1 2024-09-12T18:01:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.565+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HNPS8K02SYqtK1HS-OhY1CTec-CTzM4_0 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6226452091339816730', time=2024-09-12T19:53:54.743634+0000, chain.objs.size()=1 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VcA-IZvmPjUb9NIWbejROi0t5Xdo6mq_0 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14997173961208669362', time=2024-09-12T19:53:54.759509+0000, chain.objs.size()=1 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CYBIA_kkT5LNSuyLIzekHcuBtsnLZdN_0 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10035486072644355940', time=2024-09-12T19:53:54.846792+0000, chain.objs.size()=1 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LJu0pT9ezyJDnw19F4TyLB-U3iMiEyh_0 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.260702075324237548', time=2024-09-12T19:53:54.875701+0000, chain.objs.size()=1 2024-09-12T18:01:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.566+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5zbJ-5CbDgUxFBS7jIk_2qQK4CZQGLA_0 2024-09-12T18:01:04.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.567+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9716974045336989494', time=2024-09-12T19:53:54.934118+0000, chain.objs.size()=1 2024-09-12T18:01:04.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.567+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.pDzsW1Uvpv4fRJFD48oUTyDFHlFkGia_0 2024-09-12T18:01:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.568+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9579530180900760630', time=2024-09-12T19:53:54.942757+0000, chain.objs.size()=1 2024-09-12T18:01:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.568+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.naFPfLokymJ0V4HX_UTY-ZmkgEOPqbz_0 2024-09-12T18:01:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.568+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8892816784056371285', time=2024-09-12T19:53:55.094746+0000, chain.objs.size()=1 2024-09-12T18:01:04.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.568+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.u0Z6My3BDIi6OHvnmwEt7bBgrBtASm8_0 2024-09-12T18:01:04.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.568+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.719308268244546361', time=2024-09-12T19:53:55.330009+0000, chain.objs.size()=1 2024-09-12T18:01:04.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.568+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.D73hfzCY22Tk3O8CP2T6WnqKyHHrgrC_0 2024-09-12T18:01:04.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1971954523250615010', time=2024-09-12T19:53:55.335475+0000, chain.objs.size()=1 2024-09-12T18:01:04.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8G-Y6-hM4YO4vWBNtR8CR4_rrKjSpOD_0 2024-09-12T18:01:04.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17284306654753178832', time=2024-09-12T19:53:55.349618+0000, chain.objs.size()=1 2024-09-12T18:01:04.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.oveyajeRMUY8jOteTHvHK6MUwcmYwun_0 2024-09-12T18:01:04.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5477248039787151721', time=2024-09-12T19:53:55.375942+0000, chain.objs.size()=1 2024-09-12T18:01:04.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Z19ao2k4w0tOrxbjPKDOJ9165U4Wzxc_0 2024-09-12T18:01:04.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4506040620553320100', time=2024-09-12T19:53:55.517846+0000, chain.objs.size()=1 2024-09-12T18:01:04.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Xn6-OBwZZ4whoLOMWhw6XPnvKfraTCj_0 2024-09-12T18:01:04.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11320025103842445986', time=2024-09-12T19:53:55.580288+0000, chain.objs.size()=1 2024-09-12T18:01:04.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.571+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QtiO9yE-ACGcE7zIdtsJCvXHSigXHQf_0 2024-09-12T18:01:04.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.572+0000 7fe4cb783640 0 -- 172.21.15.63:0/1810345191 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x7fe3940874f0 msgr2=0x7fe394089920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:04.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.573+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4504540376736770270', time=2024-09-12T19:53:55.594811+0000, chain.objs.size()=1 2024-09-12T18:01:04.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.573+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3Xu__hZ5_Ihz80EjlC3f2S2cGasQud0_0 2024-09-12T18:01:04.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5030888120673347035', time=2024-09-12T19:53:55.796137+0000, chain.objs.size()=1 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.R9rSnogldkQL9zfKJEpPaZFugt4n56i_0 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17138021616851429296', time=2024-09-12T19:53:55.814611+0000, chain.objs.size()=1 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.WXLjE-Uo6dE6eRfoShaGYgehVzOYPB8_0 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13768144080073235907', time=2024-09-12T19:53:55.822117+0000, chain.objs.size()=1 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TFyIJZ6CtlivUPFdZZmiwgIjb6NDire_0 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1013440891147754505', time=2024-09-12T19:53:55.919530+0000, chain.objs.size()=1 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.574+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Xf2Al9pxEXcpNob8el-WkMqqo8Q6EWW_0 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.575+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8232342982278651921', time=2024-09-12T19:53:55.948432+0000, chain.objs.size()=1 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.575+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9veWkZDNvmdrsWNs0nFsd0X7c3m6dcG_0 2024-09-12T18:01:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.575+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9552699733296937689', time=2024-09-12T19:53:55.959281+0000, chain.objs.size()=1 2024-09-12T18:01:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.575+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xSU57PDk7uJ7ErIEHRo3Ee6qFqhpQSR_0 2024-09-12T18:01:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.575+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11242074801679609320', time=2024-09-12T19:53:56.104504+0000, chain.objs.size()=1 2024-09-12T18:01:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.575+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rvWNj2frn37vnUumkvpdouSjvvVCT-7_0 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14373883025961680966', time=2024-09-12T19:53:56.124583+0000, chain.objs.size()=1 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.53ei_QoSdk6VeBlO932sq8AJqTsQRfD_0 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3947951217884149514', time=2024-09-12T19:53:56.138975+0000, chain.objs.size()=1 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rsSeew_xvRUHl-uyuF_F-9zZ92gXCf8_0 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15647704975475923155', time=2024-09-12T19:53:56.147587+0000, chain.objs.size()=1 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wTkANSJjG2gmfavoa9CXFXrLDGd4_7b_0 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13398478579087264021', time=2024-09-12T19:53:56.164639+0000, chain.objs.size()=1 2024-09-12T18:01:04.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.578+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DZ7l9ysvdQNmCEHBC9-wqRBv4fBhbyV_0 2024-09-12T18:01:04.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.580+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15605593629765245121', time=2024-09-12T19:54:18.997436+0000, chain.objs.size()=1 2024-09-12T18:01:04.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.580+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.432__shadow_.WAF6tgeiKicpCC5iKxs3k40PEfIPUAc_0 2024-09-12T18:01:04.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.584+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/46691 2024-09-12T18:01:04.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:01:04.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2685099894694755433', time=2024-09-12T19:54:24.298880+0000, chain.objs.size()=1 2024-09-12T18:01:04.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.455__shadow_.zCGRIUrCYOtPtCeDo3ZwqsfXvXC6Htw_0 2024-09-12T18:01:04.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1529399697912203171', time=2024-09-12T19:54:25.027463+0000, chain.objs.size()=1 2024-09-12T18:01:04.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.457__shadow_.Hy1ppgtzouZKmoI_zSDCHON3FhUm9B2_0 2024-09-12T18:01:04.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15846720497571521352', time=2024-09-12T19:54:31.216087+0000, chain.objs.size()=1 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.eKYNjU-FxXD-JkvX79oZbz7_okZQcQ__0 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11331143692948505794', time=2024-09-12T19:54:31.554902+0000, chain.objs.size()=1 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.486__shadow_.vPIgoc3W3sVnyVCOTAMEDDGjZwyqiZ9_0 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6280435747275597118', time=2024-09-12T19:55:24.653355+0000, chain.objs.size()=3 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.556__shadow_.ufvGzZuD30S8hsrFRB8I1yixXj96Me__0 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.556__shadow_.ufvGzZuD30S8hsrFRB8I1yixXj96Me__1 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.556__shadow_.ufvGzZuD30S8hsrFRB8I1yixXj96Me__2 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.802823637441630595', time=2024-09-12T19:55:39.478598+0000, chain.objs.size()=1 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.571__shadow:OIXXXJ3F-jEqGtiTbObS9VQqHjp.0E1_.lcOtj9sfVtgWWZA4hiFC5ljRkPuiRST_0 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6558279422474275639', time=2024-09-12T19:55:42.527822+0000, chain.objs.size()=1 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:nNvEd6rjLSunTfmljNYKt-cEJgnd1z0_.2K9DJzZf11An2LvgGHULUwps-J7ysyr_0 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7873157751659074223', time=2024-09-12T19:55:46.659782+0000, chain.objs.size()=1 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:RzvSQIKRANLxjWkdHkq1D5.yNXW7bly_.mGQ8_9XJTDaXraudmXQOwhIKPsObLyR_0 2024-09-12T18:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12090187658149935862', time=2024-09-12T19:55:53.505109+0000, chain.objs.size()=1 2024-09-12T18:01:04.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:AyLkUNTxtqxzb.Z-MADVWQW1Zw4JeY3_.VxdNSwtVebyGz-gVlsisnQY0WGtnH37_0 2024-09-12T18:01:04.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1412257834604781197', time=2024-09-12T19:55:57.128108+0000, chain.objs.size()=1 2024-09-12T18:01:04.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.587+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:niQzH4cphZ4P5UpIBE4ofazb1cpYNtH_.dZ5eighHIM3nIoZggkr1GKimxCODyjI_0 2024-09-12T18:01:04.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.589+0000 7fe4cb783640 0 -- 172.21.15.63:0/1810345191 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x7fe4b40022f0 msgr2=0x7fe394098b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:04.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.591+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17939388578965683719', time=2024-09-12T19:56:04.955323+0000, chain.objs.size()=1 2024-09-12T18:01:04.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.591+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.587__shadow:X36KSU8SY51YVlAhDyH8dfyvNbq98hR_.g9IX_hBa3il8nxwlRJztHG8kI2VGpF__0 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5008172150792679292', time=2024-09-12T19:56:07.974323+0000, chain.objs.size()=1 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.604__shadow_.MoCFBFsIdYt1fca-nC0C1zg-9wJpeG3_0 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3602859616123380040', time=2024-09-12T19:58:24.205914+0000, chain.objs.size()=1 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.648__shadow_.gq_AIDaYuI2sNRHq0vCJanJiupENCeq_0 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5371654974351572657', time=2024-09-12T19:58:26.609301+0000, chain.objs.size()=1 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.656__shadow_.-xit2EgNbGKZh2oJl4b4LgCrdG8-VMj_0 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~e11v68c22O-HSTOzzKFFHy3NW6b1B_R', time=2024-09-12T19:59:07.431886+0000, chain.objs.size()=1 2024-09-12T18:01:04.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.592+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.743__multipart_mymultipart2.2~e11v68c22O-HSTOzzKFFHy3NW6b1B_R.1 2024-09-12T18:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.594+0000 7fe4cb783640 0 -- 172.21.15.63:0/1810345191 >> [v2:172.21.15.82:6808/3312995022,v1:172.21.15.82:6809/3312995022] conn(0x7fe3940874f0 msgr2=0x7fe394089900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.596+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.598+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:01:04.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.599+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.600+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/66958' 2024-09-12T18:01:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17496218761037509940', time=2024-09-12T19:51:52.654647+0000, chain.objs.size()=1 2024-09-12T18:01:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.148__shadow_.A9Q8a4rAj2ClUTJhUPHSrYs32UI3mLz_0 2024-09-12T18:01:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_nHzZLecNnQcyX6yOx_rzVnO7mWVo7sJ', time=2024-09-12T19:51:58.947191+0000, chain.objs.size()=1 2024-09-12T18:01:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.F6ND5gDHCy8ySX90zJXkSUOhxpitO8Q_0 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4751173899564989276', time=2024-09-12T19:53:06.321117+0000, chain.objs.size()=1 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.231__shadow_.TG8EnNbRF7FP2FFEkFacWwYZzkNaXBB_0 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12196332175931873502', time=2024-09-12T19:53:06.563608+0000, chain.objs.size()=1 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.232__shadow_.OnuE-4vSE7YM0VKGmna0E6M5iMwZcbD_0 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16197835831660807393', time=2024-09-12T19:53:10.759476+0000, chain.objs.size()=1 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.251__shadow_.bbdvgc_PThUhmsQVWwuLzaoXtJ7csWv_0 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11057412053765001022', time=2024-09-12T19:53:12.427605+0000, chain.objs.size()=1 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.259__shadow_.ImgbTuILXbxHhZtHSw5WqZ-TS7xMfSF_0 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13023175517894269452', time=2024-09-12T19:53:21.176237+0000, chain.objs.size()=1 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vsEbfw5l23CiByG1V8V3lgDH57AkeYY_0 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16639726226801528779', time=2024-09-12T19:53:21.189571+0000, chain.objs.size()=1 2024-09-12T18:01:04.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iaYGvAD2Tll4Jm6V-N2wNSWWWuaYtup_0 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17637506653432344541', time=2024-09-12T19:53:21.198407+0000, chain.objs.size()=1 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7oY-Sq5F_Uoa3Fx9jdio-mxnrmJbe0F_0 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8327572987922578343', time=2024-09-12T19:53:21.202450+0000, chain.objs.size()=1 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hPFMyoUY3hyRHd6OmsXaFjnIT2u5ltv_0 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12691533455918908565', time=2024-09-12T19:53:21.392061+0000, chain.objs.size()=1 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-mmayUlUKAnHw0hG4NqQzrYBkky55kK_0 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17344905303579748430', time=2024-09-12T19:53:21.428759+0000, chain.objs.size()=1 2024-09-12T18:01:04.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.601+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PkVtJ8MHMwb7mveP8McCz-W1UfXPliX_0 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5521119315806675416', time=2024-09-12T19:53:21.478844+0000, chain.objs.size()=1 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AEYx_nTV4OdiE3sWx4hnFIsfSUxgFcZ_0 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8979632833532412302', time=2024-09-12T19:53:21.578138+0000, chain.objs.size()=1 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tQY5v2tb7c9_jC8_AvVd8LB8MFUFYeD_0 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1061971218792857821', time=2024-09-12T19:53:21.584486+0000, chain.objs.size()=1 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gPUp8jSyki5gswmjDIuZ5XuhkM7gszJ_0 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2202915594214366626', time=2024-09-12T19:53:21.697468+0000, chain.objs.size()=1 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TvD-_R75sgcdVeAcStd-ZI15h9CX8V1_0 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12586634761132352486', time=2024-09-12T19:53:21.795653+0000, chain.objs.size()=1 2024-09-12T18:01:04.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OJlmVXZ_9BsSIaUSumJaIV3rUUEo97N_0 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17571937919752068261', time=2024-09-12T19:53:21.828997+0000, chain.objs.size()=1 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.604+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fknInbyf4Ml-cefLJAfeWKlAcbekLxx_0 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6894637623079758246', time=2024-09-12T19:53:21.980834+0000, chain.objs.size()=1 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.e401Cwt2_cu_baUywRwdwo6DG1OVDvw_0 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1764837798363121322', time=2024-09-12T19:53:22.066724+0000, chain.objs.size()=1 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JTIvTtRU_ujuV3CHgxz7eFIkqLLnbQV_0 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.605+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8047052764796632947', time=2024-09-12T19:53:22.183141+0000, chain.objs.size()=1 2024-09-12T18:01:04.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.605+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.weKCPIz-gS50q7VS27XqUSf8F7tX6M7_0 2024-09-12T18:01:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.607+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11833646770831240327', time=2024-09-12T19:53:22.216468+0000, chain.objs.size()=1 2024-09-12T18:01:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.607+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HTAfttGM0k2BITh8IaDYXs8U8l8k_tx_0 2024-09-12T18:01:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.607+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16469529961069413083', time=2024-09-12T19:53:22.260820+0000, chain.objs.size()=1 2024-09-12T18:01:04.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.607+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WDtnU8M046ZxDqvpJ5Zd-B7-LFafX1A_0 2024-09-12T18:01:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.608+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2802278935530019743', time=2024-09-12T19:53:22.289660+0000, chain.objs.size()=1 2024-09-12T18:01:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.608+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.I8S2E7Efke5jFEGUWmoNNSYGbaNwFgd_0 2024-09-12T18:01:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.608+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.435497760889353961', time=2024-09-12T19:53:22.297826+0000, chain.objs.size()=1 2024-09-12T18:01:04.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.608+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HeWs08yr8SS2kht0aFTgay9tkGki9TX_0 2024-09-12T18:01:04.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.609+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8615979878545130918', time=2024-09-12T19:53:22.389447+0000, chain.objs.size()=1 2024-09-12T18:01:04.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.609+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wTb7I3BlBM_J5bXgD4zcfRl6zbX4C7t_0 2024-09-12T18:01:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10686803890275130744', time=2024-09-12T19:53:22.400586+0000, chain.objs.size()=1 2024-09-12T18:01:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RiXaXTj1Bcl2oDBtxhO1VXXPPeU0g3Y_0 2024-09-12T18:01:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11723051511115181325', time=2024-09-12T19:53:22.422890+0000, chain.objs.size()=1 2024-09-12T18:01:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.z3vNaf0K5N8M9IQIlNgUNpy6NSPwWEj_0 2024-09-12T18:01:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7043733988184705390', time=2024-09-12T19:53:22.435151+0000, chain.objs.size()=1 2024-09-12T18:01:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TBz314r_sPYNeGHFHR8irgkcu-4b1ta_0 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12503319468109972903', time=2024-09-12T19:53:22.444726+0000, chain.objs.size()=1 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EGI8uwg85S25Fl9GfRNiZywSZmaclFC_0 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17707568398298175388', time=2024-09-12T19:53:22.604410+0000, chain.objs.size()=1 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wTwQAji5Q2oN5DkU-hrrAHmHeDXyzRx_0 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9288740574100456517', time=2024-09-12T19:53:22.658283+0000, chain.objs.size()=1 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.610+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EijhfokVtlO1almX3X-0EKu_j4CBRJc_0 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.611+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16097934731208760926', time=2024-09-12T19:53:26.118026+0000, chain.objs.size()=1 2024-09-12T18:01:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.611+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.280__shadow_.c0zcpJwr2YUXIT3QnjqgVRC4mq6L5Yb_0 2024-09-12T18:01:04.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.611+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12489460765063237420', time=2024-09-12T19:53:27.186311+0000, chain.objs.size()=1 2024-09-12T18:01:04.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.611+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.285__shadow_.Wb7P32o200BMcA2mq2nDabzlNOFAbDr_0 2024-09-12T18:01:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.615+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5426089727790042478', time=2024-09-12T19:53:29.340491+0000, chain.objs.size()=1 2024-09-12T18:01:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.615+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.Agft4Lr5icTlIVG2Cc5mBfuAr4ycMHr_0 2024-09-12T18:01:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.615+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7254560887327552519', time=2024-09-12T19:53:29.346548+0000, chain.objs.size()=1 2024-09-12T18:01:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.615+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.g7oYDfu_4KBu44l5dvkdXLBpZ0XGD6Z_0 2024-09-12T18:01:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.615+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.74423238828625982', time=2024-09-12T19:53:29.953968+0000, chain.objs.size()=1 2024-09-12T18:01:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.615+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.DMJxLNvqyCllV4p7Wm7FHunD2xgpzgP_0 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12529579803736017957', time=2024-09-12T19:53:30.576968+0000, chain.objs.size()=1 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.297__shadow_.k510MND6nUdSGt4uTf1Ag0c_IIjFZ8A_0 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4358890696171578473', time=2024-09-12T19:53:31.980803+0000, chain.objs.size()=1 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.303__shadow_.lJBsreygf5S3_odU2Q9zR68y2ax-XCs_0 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3992510383396312234', time=2024-09-12T19:53:44.524697+0000, chain.objs.size()=1 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5kQ0PAcpji4UnnN_to4RoR98q2kHUKT_0 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8190835021917787362', time=2024-09-12T19:53:44.540285+0000, chain.objs.size()=1 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xnH8Tw8I1ad1s7NPlGhfBh7gTGGzmEj_0 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3664491378025444743', time=2024-09-12T19:53:44.572244+0000, chain.objs.size()=1 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zT1Jt6famwnZ-FQiuHUs8kn0otCxWBv_0 2024-09-12T18:01:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3976551418463906944', time=2024-09-12T19:53:44.575567+0000, chain.objs.size()=1 2024-09-12T18:01:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XYQqx-Tz8tmf7wAoMlX_Y6hnSZvKv_d_0 2024-09-12T18:01:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6483474583552637016', time=2024-09-12T19:53:44.592974+0000, chain.objs.size()=1 2024-09-12T18:01:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.PeBTJ8MXicVp23nTnTe5Xtc4tj0aFd6_0 2024-09-12T18:01:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16998234984040858794', time=2024-09-12T19:53:44.594351+0000, chain.objs.size()=1 2024-09-12T18:01:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.617+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8roVUrXD0e_A1dRSNYHWl3ywnjNmlxt_0 2024-09-12T18:01:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.618+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5886274432328427965', time=2024-09-12T19:53:44.608212+0000, chain.objs.size()=1 2024-09-12T18:01:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.618+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7Qyhi0_hU87tWBudMqIJ5utYkpXIAy2_0 2024-09-12T18:01:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.619+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2967338594928302231', time=2024-09-12T19:53:44.623920+0000, chain.objs.size()=1 2024-09-12T18:01:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.619+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Le7uZ5jV-K_kimDibDa9X4D2ebznzOd_0 2024-09-12T18:01:04.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.621+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9552792172453937074', time=2024-09-12T19:53:44.634589+0000, chain.objs.size()=1 2024-09-12T18:01:04.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.621+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.j7d6A2lI1CRxdrEf6en7Jlg-pXrxffy_0 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12711130759069013993', time=2024-09-12T19:53:44.843474+0000, chain.objs.size()=1 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JGP3kgNTpKAc43z4GhHdmysILONel6N_0 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17221157904973532258', time=2024-09-12T19:53:44.926345+0000, chain.objs.size()=1 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Q9xe1COuy6H0QGtlLxNF6ozMHt2VWA2_0 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9625784134443044515', time=2024-09-12T19:53:44.938474+0000, chain.objs.size()=1 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CK57v5fDPBfIJVMcD0w8l_9DIMVmHER_0 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3033170762489164827', time=2024-09-12T19:53:44.961817+0000, chain.objs.size()=1 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kRMK7ce_HyTuDCHPfEX_ldpvOk8oem-_0 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18159113918968648477', time=2024-09-12T19:53:44.971021+0000, chain.objs.size()=1 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vBJPz_0yiCu8mjNnie5MafndyePgh9Z_0 2024-09-12T18:01:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17007128294522394206', time=2024-09-12T19:53:45.170603+0000, chain.objs.size()=1 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.623+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tExICA81iEzHbnrH8peGgtOvXsxb3aL_0 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9662919766701311748', time=2024-09-12T19:53:45.203022+0000, chain.objs.size()=1 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.nbzR8y_32i4E_08UiC2oUrfQ-4vJZsr_0 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11349499534676666510', time=2024-09-12T19:53:45.360851+0000, chain.objs.size()=1 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sOkJNIgSYBNLZvKNCABSCDLat7fKXku_0 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12704929142835457271', time=2024-09-12T19:53:45.387305+0000, chain.objs.size()=1 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BSGVYRySbLHRzf_pjX2qgZPN4bGWd1W_0 2024-09-12T18:01:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.27572340290387169', time=2024-09-12T19:53:45.432339+0000, chain.objs.size()=1 2024-09-12T18:01:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.624+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.EBMLdIPtwBPYKn_0G4bKSnLCrfQAR7B_0 2024-09-12T18:01:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.625+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12729524774765227237', time=2024-09-12T19:53:45.541225+0000, chain.objs.size()=1 2024-09-12T18:01:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.625+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.msM1ClReMif1CiT3P311wtKQrhD9Xv8_0 2024-09-12T18:01:04.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15864567748914864919', time=2024-09-12T19:53:45.572861+0000, chain.objs.size()=1 2024-09-12T18:01:04.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.D-BU25v70ywZ7rjAW42Q70sos5PJ8C0_0 2024-09-12T18:01:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6038388351252591566', time=2024-09-12T19:53:45.623329+0000, chain.objs.size()=1 2024-09-12T18:01:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-H7ATP8a0SptrmDXSuv7_v2QRrCMqbq_0 2024-09-12T18:01:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5660086307824281278', time=2024-09-12T19:53:45.636681+0000, chain.objs.size()=1 2024-09-12T18:01:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.a7VQPWxhXAKFyQwh6qOuyy9dS8k4mwy_0 2024-09-12T18:01:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17249297752323647825', time=2024-09-12T19:53:45.757247+0000, chain.objs.size()=1 2024-09-12T18:01:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.629+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FkGYOmVmSOgim-YyAwoznihzX7qQIi-_0 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9897170103979112452', time=2024-09-12T19:53:45.788259+0000, chain.objs.size()=1 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lbo2kts-b64wrHQitWk1ytijSwdUPj5_0 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17448295213940453098', time=2024-09-12T19:53:45.943419+0000, chain.objs.size()=1 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bVz7EXmRh6prWK0cqy1yEj7JwgO4Nsi_0 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1038327638238966763', time=2024-09-12T19:53:45.963201+0000, chain.objs.size()=1 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9lc5JGu2MKOozbg4NnE4STDR4_Z7lXM_0 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3664222757931264432', time=2024-09-12T19:53:45.977518+0000, chain.objs.size()=1 2024-09-12T18:01:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.631+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.x_Cme4DidOXPFL7nQWsAVrXnOOsdqbe_0 2024-09-12T18:01:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6417924101478710783', time=2024-09-12T19:53:46.019568+0000, chain.objs.size()=1 2024-09-12T18:01:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HlX0kJEfnSsciytg2hqMsTxgu8DM2au_0 2024-09-12T18:01:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11882632458767432281', time=2024-09-12T19:53:46.023534+0000, chain.objs.size()=1 2024-09-12T18:01:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5IghCDZwmWGomkVKfViukF9LveVdMCz_0 2024-09-12T18:01:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4615037583729662552', time=2024-09-12T19:53:46.237440+0000, chain.objs.size()=1 2024-09-12T18:01:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.632+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tmekyALhtfe0HZlbl0LlbeWk9CsQPsW_0 2024-09-12T18:01:04.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.632+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11200718454850743367', time=2024-09-12T19:53:54.694546+0000, chain.objs.size()=1 2024-09-12T18:01:04.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.633+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sfpX5VGEdZ0mmUCeNdrku1WzWO61Kr0_0 2024-09-12T18:01:04.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.634+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11387590733769071018', time=2024-09-12T19:53:54.896101+0000, chain.objs.size()=1 2024-09-12T18:01:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.634+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.C84s8kxr6Bw9V_tI13uSwsC4oWIlfLy_0 2024-09-12T18:01:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.634+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5590035102890690561', time=2024-09-12T19:53:54.927956+0000, chain.objs.size()=1 2024-09-12T18:01:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.634+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EfWrp_5lUHZdTtAmmCKabF0NBtu348p_0 2024-09-12T18:01:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.634+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8558086803261950943', time=2024-09-12T19:53:54.928564+0000, chain.objs.size()=1 2024-09-12T18:01:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.634+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.J-pqUkAYR5ZOh9obFCbbYdOBvVkPlX9_0 2024-09-12T18:01:04.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.635+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8823782678287380846', time=2024-09-12T19:53:54.969194+0000, chain.objs.size()=1 2024-09-12T18:01:04.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.635+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Q2hhLgZi_7vD2sVHWRamYrn8DvSHKsD_0 2024-09-12T18:01:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.739071944697263864', time=2024-09-12T19:53:54.969844+0000, chain.objs.size()=1 2024-09-12T18:01:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.h04rzhAKLq8nVOwB15w3klDEqsF_aM5_0 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4185812471946349193', time=2024-09-12T19:53:55.054014+0000, chain.objs.size()=1 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VHcpyjtoyL21zMUEIxWpyAnqwK3-mTq_0 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.861487826450021963', time=2024-09-12T19:53:55.058570+0000, chain.objs.size()=1 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZWQ6N2SxtSHtSRG5m08xL9uRUbzvuFc_0 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16734484783080972687', time=2024-09-12T19:53:55.067153+0000, chain.objs.size()=1 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.OoqGI2H_cZw-eFKVSM99dHKoY1kmDPp_0 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10774434587605566370', time=2024-09-12T19:53:55.074196+0000, chain.objs.size()=1 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.q__xDOByqRPeqPTYwavSJAvsbcU-yqb_0 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2973458550309633175', time=2024-09-12T19:53:55.082686+0000, chain.objs.size()=1 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.k2fcN-AJ82MHWtGs5IcPmXvgtIwKT6l_0 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11002454972381316211', time=2024-09-12T19:53:55.127400+0000, chain.objs.size()=1 2024-09-12T18:01:04.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.637+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Cvzd2TnUadaVOwqaXMcoCTzuNOb-ufb_0 2024-09-12T18:01:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.638+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15901659080386287215', time=2024-09-12T19:53:55.144957+0000, chain.objs.size()=1 2024-09-12T18:01:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.638+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sX9H8vNHtbf8c1WkpR27WbyfMyWKX4g_0 2024-09-12T18:01:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.638+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8899835966597438243', time=2024-09-12T19:53:55.277611+0000, chain.objs.size()=1 2024-09-12T18:01:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.638+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rgkKnVAbT1Cak38T83ASJ7aogotyIGO_0 2024-09-12T18:01:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.638+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9087902116180188479', time=2024-09-12T19:53:55.278581+0000, chain.objs.size()=1 2024-09-12T18:01:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.638+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.McMwKKpuiPqzyKS-DnEqF42Hwq1rCDu_0 2024-09-12T18:01:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.642+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3221437250241674980', time=2024-09-12T19:53:55.341080+0000, chain.objs.size()=1 2024-09-12T18:01:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.642+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.j-KImE7Yf8xPgYQsqv46a6qMAhe4ZUM_0 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.411468693266613526', time=2024-09-12T19:53:55.342028+0000, chain.objs.size()=1 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ijwgg_3fXTrqryTEOkA_ciyWaxyCmX6_0 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16482627063817943963', time=2024-09-12T19:53:55.343387+0000, chain.objs.size()=1 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.N2EQ3-t-pz_TNip7ct0Wp1np8lqkRpF_0 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2737713660091483091', time=2024-09-12T19:53:55.504284+0000, chain.objs.size()=1 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VmrK3hX4-ZdYc6U1NddcP6DIFi_Ekk__0 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13967636216271922890', time=2024-09-12T19:53:55.536116+0000, chain.objs.size()=1 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8PtA1DFzT6Aa8H5qgq8lkE0oOSYxZUw_0 2024-09-12T18:01:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12056948485073834361', time=2024-09-12T19:53:55.563365+0000, chain.objs.size()=1 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZG2CVldStjWl1FnWuuelPuN7qxYuzxy_0 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15899966422676632232', time=2024-09-12T19:53:55.602780+0000, chain.objs.size()=1 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Lk1CECp7m9slVApOdn0rqO3MuWUFLHi_0 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16572550486319664968', time=2024-09-12T19:53:55.621793+0000, chain.objs.size()=1 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ArW0tiCcqWelhXd-lZxcxkMJnw_eiz__0 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18173098179924386317', time=2024-09-12T19:53:55.700440+0000, chain.objs.size()=1 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nlxgSXyU3PXSbsdRjtEU81Yj83_hHd8_0 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2978084257695679065', time=2024-09-12T19:53:55.702658+0000, chain.objs.size()=1 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2k7gp-4lDp-UGZUfXEubSBpYdBlaonS_0 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10285364829437318915', time=2024-09-12T19:53:55.722607+0000, chain.objs.size()=1 2024-09-12T18:01:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.644+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BL9aDsrO_oCBhd0zwtE3wwwZLETwqzO_0 2024-09-12T18:01:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.646+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6122541538821769483', time=2024-09-12T19:53:55.727184+0000, chain.objs.size()=1 2024-09-12T18:01:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.646+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5hZAtrElYRmrxN-myBRgxuCiwU96iQO_0 2024-09-12T18:01:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.648+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17380953254776009828', time=2024-09-12T19:53:55.769621+0000, chain.objs.size()=1 2024-09-12T18:01:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.648+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.pCXOJ-31v2cpJwPx8f8BxVqm_7PZ0VE_0 2024-09-12T18:01:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.648+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3887127678515124044', time=2024-09-12T19:53:55.905792+0000, chain.objs.size()=1 2024-09-12T18:01:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.648+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6tG_WRCwgE30TBia-zBX1nixUoQ3Rxx_0 2024-09-12T18:01:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.648+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6215168784653994110', time=2024-09-12T19:53:55.936379+0000, chain.objs.size()=1 2024-09-12T18:01:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.648+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jCFR5qnxJMksovCN5jvZVUEq7m7XQmi_0 2024-09-12T18:01:04.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.651+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/66958 2024-09-12T18:01:04.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:01:04.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6372917399019609704', time=2024-09-12T19:53:55.989786+0000, chain.objs.size()=1 2024-09-12T18:01:04.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GQUieG2uk_1qWJ3sMb1GUBZrbjm71iC_0 2024-09-12T18:01:04.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7758306270599926599', time=2024-09-12T19:53:56.019571+0000, chain.objs.size()=1 2024-09-12T18:01:04.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zQu66SlU9vkp_RvCb2SUnLfzEPd2Tum_0 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8520819591503411141', time=2024-09-12T19:53:56.028597+0000, chain.objs.size()=1 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._9tRZt1V4gXCRt183_it1uishs9x__S_0 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5423979181524703254', time=2024-09-12T19:53:56.103855+0000, chain.objs.size()=1 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sVCGEjqJdCaUYLQ3cmPnIgBh-ZJi640_0 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14763363887293772706', time=2024-09-12T19:53:56.110241+0000, chain.objs.size()=1 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gSq7Pcio_wAVPW86QOy51YtnHa75TBZ_0 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9823077438485252184', time=2024-09-12T19:53:56.118688+0000, chain.objs.size()=1 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.J3lEzOaNJm1L5rOTORXw3uqtfCSLZg5_0 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11626529670131184170', time=2024-09-12T19:53:56.124935+0000, chain.objs.size()=1 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.pHNjpwlPRV46ZT1T0AOLhwOX2nz8KnJ_0 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.671802169465564089', time=2024-09-12T19:53:56.165048+0000, chain.objs.size()=1 2024-09-12T18:01:04.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aqkKxoccaWaNjJiEgrFL-gtRn6pkuN0_0 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9027167887060002373', time=2024-09-12T19:54:12.368012+0000, chain.objs.size()=1 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.395__shadow:YSPwUIVgh.5cuyzcT4OrAAJEnDHKfu6_.Wj-2pbnGtxY06c4XEuePZZyze-4g6JA_0 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12883060147861837357', time=2024-09-12T19:54:19.603096+0000, chain.objs.size()=1 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.435__shadow_.Mqcf_bAgEAAc6uiM5fy8z-q9wlo9LcG_0 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6811024997882141742', time=2024-09-12T19:54:43.784294+0000, chain.objs.size()=1 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.521__shadow:jMG7a6nDcukrVmYSOopQmWRYUdR4Qhg_.bQBSzNE0xwEn6YJXXXB9E_R9MujJdB__0 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3172881627188735777', time=2024-09-12T19:54:50.458312+0000, chain.objs.size()=3 2024-09-12T18:01:04.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.654+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~F5NlyiTPYHPjeJC8uyrbsgJrHv_1Efo.1 2024-09-12T18:01:04.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.657+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~F5NlyiTPYHPjeJC8uyrbsgJrHv_1Efo.2 2024-09-12T18:01:04.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.657+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~F5NlyiTPYHPjeJC8uyrbsgJrHv_1Efo.3 2024-09-12T18:01:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1702897064833381244', time=2024-09-12T19:55:25.213312+0000, chain.objs.size()=2 2024-09-12T18:01:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.558__shadow_.WpogUDw8bp6s0o2VvEjWmq0tX96wDoI_0 2024-09-12T18:01:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.558__shadow_.WpogUDw8bp6s0o2VvEjWmq0tX96wDoI_1 2024-09-12T18:01:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6120527651551819789', time=2024-09-12T19:55:26.413430+0000, chain.objs.size()=1 2024-09-12T18:01:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.560__shadow_.X25UZ-QoVt_vRB0kKXRulQW-hajg4uj_0 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8528832937904257143', time=2024-09-12T19:55:35.160454+0000, chain.objs.size()=1 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:ZtkE1m7TlzwDTYdTKo4hWp.FXoPkymG_.BQUznJI6JQ4BjdOfEJrt1vvM6NGaSFh_0 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2335501230652984219', time=2024-09-12T19:55:42.251350+0000, chain.objs.size()=1 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:UzHqaraoO9guFE.TFZVc0wau-.qb4VC_.6wVvv7tvODPKCFWMowA7OxpgfSAB4cQ_0 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9977252957844430233', time=2024-09-12T19:55:52.955011+0000, chain.objs.size()=1 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:Akmod5GtAiIedXojOT.pexi4ncLigB8_.IewD4RYXV-hnJtvKDcbalm_O2wzDfg7_0 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13162447927426317780', time=2024-09-12T19:55:56.629593+0000, chain.objs.size()=1 2024-09-12T18:01:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:TzMl7B6O3Yn5Uz35.2kDvb1NS5RfGkf_.2haCoPgCbpONIIqP0YZVuxhElYy6VMR_0 2024-09-12T18:01:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15238457538565502362', time=2024-09-12T19:56:03.087761+0000, chain.objs.size()=1 2024-09-12T18:01:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:fibYK8hvuwLnQQKjFMcPOEcFL533Om0_.wPq5CRPeaxdr5e2qh3cws0wvkyHZBqr_0 2024-09-12T18:01:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6421601309454627027', time=2024-09-12T19:56:08.433485+0000, chain.objs.size()=1 2024-09-12T18:01:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.658+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.606__shadow_.I65G3PW1LPOhvBZR-xuTBeMZtWb81VP_0 2024-09-12T18:01:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.661+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12199567520657048213', time=2024-09-12T19:56:09.065679+0000, chain.objs.size()=1 2024-09-12T18:01:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.661+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.609__shadow_.pCvjzbgbKw_zI_4fKUk0UNzBcM4QZ1o_0 2024-09-12T18:01:04.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.664+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5624846143218467154', time=2024-09-12T19:58:30.433361+0000, chain.objs.size()=1 2024-09-12T18:01:04.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.664+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.666__shadow_.OnaZ9yQtPAML8-nBq1UeTWvQeCq6Fs1_0 2024-09-12T18:01:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.666+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.668+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:01:04.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.670+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.670+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47390' 2024-09-12T18:01:04.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_mwR3i7D-Ho2Ro6dCvRbzT142f2GuJJJ', time=2024-09-12T19:51:59.914507+0000, chain.objs.size()=3 2024-09-12T18:01:04.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.n1gZ3ESJae_hAeDGVug-REe6cXg9YkF_0 2024-09-12T18:01:04.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.n1gZ3ESJae_hAeDGVug-REe6cXg9YkF_1 2024-09-12T18:01:04.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.n1gZ3ESJae_hAeDGVug-REe6cXg9YkF_2 2024-09-12T18:01:04.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_f28Gc9eyRRFc3mMx8rjVHeneaUZUPvo', time=2024-09-12T19:52:00.510119+0000, chain.objs.size()=1 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.164__shadow_.zLWG6uxCsAaTQBBOLYYUAUPLIIbmxog_0 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15635466202888484551', time=2024-09-12T19:52:18.206023+0000, chain.objs.size()=1 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.205__shadow_.mXf75JDZ4jbNA8_2HODJHDPkSI2fajQ_0 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6113391153208489088', time=2024-09-12T19:53:07.450421+0000, chain.objs.size()=1 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.236__shadow_.YhHv0iN9A_xRheCQa-Dfleb-U3oFqU1_0 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5675311373066842018', time=2024-09-12T19:53:08.172055+0000, chain.objs.size()=1 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.239__shadow_.cx0Ld9hAjO952pT7XtGnpdEjMZsysuA_0 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3714900532341974065', time=2024-09-12T19:53:10.554148+0000, chain.objs.size()=1 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.250__shadow_.jG77uW1FV-NNRhyyXo-IdcivJ5PswbO_0 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8606325427330504651', time=2024-09-12T19:53:21.199452+0000, chain.objs.size()=1 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.us4M5gmWDDRp8BAqOb5z4aqZSy9RDsx_0 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17059616072510028907', time=2024-09-12T19:53:21.203342+0000, chain.objs.size()=1 2024-09-12T18:01:04.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XGm0rUl-nxCzKQSExqEWpXnLZcItwH2_0 2024-09-12T18:01:04.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17271099172628847399', time=2024-09-12T19:53:21.236399+0000, chain.objs.size()=1 2024-09-12T18:01:04.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3aI9evBmv9eT_zQGQyCDFOcPve9UV0v_0 2024-09-12T18:01:04.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14925864958817171156', time=2024-09-12T19:53:21.237726+0000, chain.objs.size()=1 2024-09-12T18:01:04.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.671+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iq6p79vrYUqUksetM8odajEDW-77V0J_0 2024-09-12T18:01:04.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.674+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14074495776542227287', time=2024-09-12T19:53:21.243447+0000, chain.objs.size()=1 2024-09-12T18:01:04.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.674+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ULfVnB8Ss_I_enDgKAeTiAglzl8Fp1o_0 2024-09-12T18:01:04.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.674+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16286123024174776443', time=2024-09-12T19:53:21.285100+0000, chain.objs.size()=1 2024-09-12T18:01:04.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.674+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8kcqMvBk83y3La9KIXuiQ0cZLhvI7nC_0 2024-09-12T18:01:04.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.674+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8545875832215376877', time=2024-09-12T19:53:21.408694+0000, chain.objs.size()=1 2024-09-12T18:01:04.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.674+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.v-UgWL5-0SqLcCWT1hsl93htGT-uYLq_0 2024-09-12T18:01:04.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.675+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8762062467284158432', time=2024-09-12T19:53:21.457711+0000, chain.objs.size()=1 2024-09-12T18:01:04.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.675+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AjoDGDhbQuC_pfXhHQ3p3na-Pl1UZyq_0 2024-09-12T18:01:04.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.677+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.913582828752286611', time=2024-09-12T19:53:21.470531+0000, chain.objs.size()=1 2024-09-12T18:01:04.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.677+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.w4jXTQoSOU-DhR2tEusfZuYOLNWuFzi_0 2024-09-12T18:01:04.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.677+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14096432910286054649', time=2024-09-12T19:53:21.491970+0000, chain.objs.size()=1 2024-09-12T18:01:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.677+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1zua9nWqrBeMT3dL8WKggfgVOH7pcZc_0 2024-09-12T18:01:04.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6880673696805809863', time=2024-09-12T19:53:21.601679+0000, chain.objs.size()=1 2024-09-12T18:01:04.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3kRg1L0Ev9Rw8utZwKJdM7KmOclEizd_0 2024-09-12T18:01:04.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2995437182352214309', time=2024-09-12T19:53:21.625509+0000, chain.objs.size()=1 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Yv5tPbtDzmc9zkcMgFBV7gU06yJ3Ra2_0 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.948542068086324734', time=2024-09-12T19:53:21.679797+0000, chain.objs.size()=1 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aFSazywxuzQuL6601XqnTQlINB0qrsx_0 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6027594197924985992', time=2024-09-12T19:53:21.695889+0000, chain.objs.size()=1 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.AS4RNR2K9eSkZVtj1MidZzZg_bPgWCA_0 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1784275855764634988', time=2024-09-12T19:53:21.815341+0000, chain.objs.size()=1 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.678+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vXBR_uFyVoKNM2wwT8kWAKVCmmc8JPl_0 2024-09-12T18:01:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4060083892502099323', time=2024-09-12T19:53:21.829085+0000, chain.objs.size()=1 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.U_GrbfAp-j_qvJCiOitfdGblKkXsLp0_0 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16992150629922037684', time=2024-09-12T19:53:21.835748+0000, chain.objs.size()=1 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PyjZcIevNGJfYDMf4fjXOuOzRiNUvT4_0 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.680469182791830108', time=2024-09-12T19:53:21.852782+0000, chain.objs.size()=1 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OcppCNAG56e-ugC4SEZIKeXiTiuREVt_0 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9812144350468322516', time=2024-09-12T19:53:21.857162+0000, chain.objs.size()=1 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.M4o4sVade4KRTfEFoeglH1OlYVYwNJ4_0 2024-09-12T18:01:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1928833351959371009', time=2024-09-12T19:53:21.992364+0000, chain.objs.size()=1 2024-09-12T18:01:04.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.680+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3vX0hhoJvek6LmXaWOvDZLkMw2OnRgM_0 2024-09-12T18:01:04.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.682+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.250184771312531375', time=2024-09-12T19:53:22.041186+0000, chain.objs.size()=1 2024-09-12T18:01:04.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.682+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.70olvbIK-rzuu1mTddrY-LuzGsDBFmq_0 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6305495784768363758', time=2024-09-12T19:53:22.078043+0000, chain.objs.size()=1 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Yz_gJiwUXozvm0cCGUzGwk_RGjWNJsf_0 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11529319570284436462', time=2024-09-12T19:53:22.090811+0000, chain.objs.size()=1 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2uc5AKHJ4KjHUHKf9NzX-tLMQYh2RF-_0 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18045059774762760635', time=2024-09-12T19:53:22.096172+0000, chain.objs.size()=1 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.uAURpDmwqpdXFrxVBdaUk0UoZeaKu5S_0 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2880284366177002178', time=2024-09-12T19:53:22.101766+0000, chain.objs.size()=1 2024-09-12T18:01:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9s4zbP5lOqA--W63hQnYHV3wxi27L-l_0 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2515386262509481475', time=2024-09-12T19:53:22.179238+0000, chain.objs.size()=1 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YrnVRcZ2EuvYk7m9pEYOmgKIH8wpO1W_0 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16133971073017590212', time=2024-09-12T19:53:22.218594+0000, chain.objs.size()=1 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7BuHGoB6Ccrb09OxnK9yQRdCCFwan8B_0 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10416091982476284965', time=2024-09-12T19:53:22.234179+0000, chain.objs.size()=1 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nJICAGlibTvJq59Fem4GzZEu1N5VhZD_0 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16020334216067242965', time=2024-09-12T19:53:22.287553+0000, chain.objs.size()=1 2024-09-12T18:01:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.684+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mrjia8kH6jUTtP6dixmMLp8HVHOBTjw_0 2024-09-12T18:01:04.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.685+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5245687403876892517', time=2024-09-12T19:53:22.289945+0000, chain.objs.size()=1 2024-09-12T18:01:04.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.685+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vfa6gXc1ssqTt9FxWjrDb7lILzQOWKi_0 2024-09-12T18:01:04.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.687+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1445409649509955111', time=2024-09-12T19:53:22.383154+0000, chain.objs.size()=1 2024-09-12T18:01:04.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.687+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pbQjSaHc0ACDzMQgK5l5kUCes8Nbzd9_0 2024-09-12T18:01:04.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.687+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.782233454637017017', time=2024-09-12T19:53:22.398672+0000, chain.objs.size()=1 2024-09-12T18:01:04.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.687+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mWeQuwiZwELXBB6_arhMZ6Xa_N9pe05_0 2024-09-12T18:01:04.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.687+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8482648576261669982', time=2024-09-12T19:53:22.401580+0000, chain.objs.size()=1 2024-09-12T18:01:04.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.687+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ytxbBh4EGkb_SbT58vvVAy-F6pLzk8u_0 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10609420251204361253', time=2024-09-12T19:53:22.414141+0000, chain.objs.size()=1 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oGI8ck8GDfo98LNmC8CFwjxe4RPA9Tp_0 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15326365108834359178', time=2024-09-12T19:53:22.465284+0000, chain.objs.size()=1 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.t5RG5e63IxCEV_XOt7didlk9HmuSa2E_0 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7553509131819384414', time=2024-09-12T19:53:22.492480+0000, chain.objs.size()=1 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.xwdIewWYKppgh76Z8e8jCWeDcUj-0i6_0 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4131033145617694163', time=2024-09-12T19:53:22.504665+0000, chain.objs.size()=1 2024-09-12T18:01:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.689+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._IXbk9dxKnNbGeDUJ1_467yicu5EQ0C_0 2024-09-12T18:01:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14503025261388735849', time=2024-09-12T19:53:22.581673+0000, chain.objs.size()=1 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.naZSWJiDOVTV_h1ebBXwgTLkHIhgnQo_0 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1375309840198611645', time=2024-09-12T19:53:22.604004+0000, chain.objs.size()=1 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ozTha04YAqnsvpKNkiMe_cZlRHRM1hP_0 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14266598917736787575', time=2024-09-12T19:53:22.667082+0000, chain.objs.size()=1 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vnRevFf1Lh-q25RydGOSG-wIfdehJeC_0 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6341203277685307895', time=2024-09-12T19:53:22.668517+0000, chain.objs.size()=1 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.peS-DjHwek860V2t3PdQYUmr6TJOosQ_0 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16147937655749598956', time=2024-09-12T19:53:23.242514+0000, chain.objs.size()=1 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.266__shadow_.1smQvU0WYX7uCtZw_9-8q59aQ-f0CGh_0 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.371961748057983379', time=2024-09-12T19:53:25.915821+0000, chain.objs.size()=1 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.279__shadow_.TYFE4uT1LWZOGttnCeGsCT-e0S4i_ZN_0 2024-09-12T18:01:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6070362431811763543', time=2024-09-12T19:53:26.773165+0000, chain.objs.size()=1 2024-09-12T18:01:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.691+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.283__shadow_.Hs-a3ni_VsVNWMSwols8vsRoD6Nc8zb_0 2024-09-12T18:01:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8260804336216603830', time=2024-09-12T19:53:26.982492+0000, chain.objs.size()=1 2024-09-12T18:01:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.284__shadow_.JhAbqKTXEc2NOOi5H0NC9lS4rBj27ae_0 2024-09-12T18:01:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1072149625758042452', time=2024-09-12T19:53:28.135341+0000, chain.objs.size()=1 2024-09-12T18:01:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.289__shadow_.bQ6wqqmg9A-d7Qn4_m0O5r0QB2If7_-_0 2024-09-12T18:01:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7797824780098496151', time=2024-09-12T19:53:29.341636+0000, chain.objs.size()=1 2024-09-12T18:01:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.YMkcCNwvO3xq39s2iOu44NbU9KOgfeO_0 2024-09-12T18:01:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7172553834401220942', time=2024-09-12T19:53:29.358289+0000, chain.objs.size()=1 2024-09-12T18:01:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.694+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.fKIsAv44Qx-chTKzW54wT3JMDevfSH2_0 2024-09-12T18:01:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.695+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11882071492994066915', time=2024-09-12T19:53:29.934492+0000, chain.objs.size()=1 2024-09-12T18:01:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.695+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.0Ur-0dT2UOwiEqgWbpouUAf8BFVdJGi_0 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11890667086897767513', time=2024-09-12T19:53:29.938887+0000, chain.objs.size()=1 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.3AVW96C3UWdPsRNEB9SC5kqg0tNjtTT_0 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9447917976352548819', time=2024-09-12T19:53:31.526376+0000, chain.objs.size()=1 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.301__shadow_.NzSPxcTUarlumbrDd8qcwMIdEvxbreN_0 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6419055232917382167', time=2024-09-12T19:53:32.635676+0000, chain.objs.size()=1 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.306__shadow_.NaNCiGZND1gnKPPveozgzy1mxz9JJtU_0 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8072069725577829666', time=2024-09-12T19:53:35.731322+0000, chain.objs.size()=1 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.322__shadow_.QdjjGmsXk1kFgUDnAV5SL78qpczJ_fR_0 2024-09-12T18:01:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12483925732970308704', time=2024-09-12T19:53:44.591459+0000, chain.objs.size()=1 2024-09-12T18:01:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.697+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hoRxE3PeGOEtNpxUK8BhRGYYrbe4o77_0 2024-09-12T18:01:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15110741007214290485', time=2024-09-12T19:53:44.619054+0000, chain.objs.size()=1 2024-09-12T18:01:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uESpYEIvHBa0GrRfDcX5D_xIs5HcS9l_0 2024-09-12T18:01:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.698+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10694999426319425166', time=2024-09-12T19:53:44.941887+0000, chain.objs.size()=1 2024-09-12T18:01:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.698+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3uW79cVwP1VyGm-C_4y8ZTIHw7cHVCh_0 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6785626898720529777', time=2024-09-12T19:53:44.979234+0000, chain.objs.size()=1 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bZFx_QAaDHxBJ2M8dM2MD4PkfMhvCnG_0 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17029169687265714265', time=2024-09-12T19:53:45.338986+0000, chain.objs.size()=1 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GFjGLHkv-p2OQTEBl5DcGk135KIaDio_0 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16523423342528633904', time=2024-09-12T19:53:45.404244+0000, chain.objs.size()=1 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FoZKGMOBfz_8LY2jMWeiGZIn5LHa4TF_0 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6277818174005787335', time=2024-09-12T19:53:45.416491+0000, chain.objs.size()=1 2024-09-12T18:01:04.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.siN5L1n7n0xFPf_XxesV46H50qGY1Qk_0 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5311322570483682352', time=2024-09-12T19:53:45.423051+0000, chain.objs.size()=1 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.utY71LCJx0XepVE612jV_Ouh_Glz749_0 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.445331592816819318', time=2024-09-12T19:53:45.454568+0000, chain.objs.size()=1 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lGBCRNGGmJYHPfrBIoPewFbLvlV3s5f_0 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7595431274150134530', time=2024-09-12T19:53:45.558675+0000, chain.objs.size()=1 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.58WfjM-xXRPy5N66LS27nj2BgOSJsV1_0 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1194344476026658720', time=2024-09-12T19:53:45.622009+0000, chain.objs.size()=1 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._XfOa0qfxaAMcaImAykrvG1t78YppXY_0 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18364285674170746953', time=2024-09-12T19:53:45.641042+0000, chain.objs.size()=1 2024-09-12T18:01:04.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.701+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Azv2y-ugBUaif1YD-9vy6HwENvL0zbT_0 2024-09-12T18:01:04.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.705+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14670301736112257460', time=2024-09-12T19:53:45.662580+0000, chain.objs.size()=1 2024-09-12T18:01:04.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.705+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.R0bqyR2U-aRf_BnFfL8tcFcxL0T2j94_0 2024-09-12T18:01:04.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.705+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11542439223935241101', time=2024-09-12T19:53:45.759179+0000, chain.objs.size()=1 2024-09-12T18:01:04.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.705+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hcrPJznSxTm-qwrtY8WgFiqZ0elb0W7_0 2024-09-12T18:01:04.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.706+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14380445417976374394', time=2024-09-12T19:53:45.759867+0000, chain.objs.size()=1 2024-09-12T18:01:04.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.706+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OCjvnuD_Odm9Y3mUc-1GNioLXqFMHjP_0 2024-09-12T18:01:04.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.706+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6859061136280465727', time=2024-09-12T19:53:45.761515+0000, chain.objs.size()=1 2024-09-12T18:01:04.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.706+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Sh_V1xlZeNRZXU4-UEbK_hJfK10qNX__0 2024-09-12T18:01:04.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.706+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14779764805671921749', time=2024-09-12T19:53:45.769996+0000, chain.objs.size()=1 2024-09-12T18:01:04.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.706+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fwen8KKBt3ftSexXJWGOwqAi8OacR11_0 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3658343305420665864', time=2024-09-12T19:53:45.798360+0000, chain.objs.size()=1 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zf46i_iHfZ0FYHCT2hoTanLUFBeNJK2_0 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14917517321758275297', time=2024-09-12T19:53:45.974538+0000, chain.objs.size()=1 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fIXtIIx_GI5LrBULVWZ0SN6tQFp6k0c_0 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4307231200518714478', time=2024-09-12T19:53:46.041992+0000, chain.objs.size()=1 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GeKW8qi4YFDNdZozRwaZio7ku2kyCpe_0 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4504150218854452424', time=2024-09-12T19:53:46.165328+0000, chain.objs.size()=1 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.EY_0l-CccNv1ijfnOYJf_N3zt3kh05a_0 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.667441085675355477', time=2024-09-12T19:53:46.198117+0000, chain.objs.size()=1 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Z5YBfUO-W2MlVefPVt7H8QEc_YJ0roV_0 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13197653424932335931', time=2024-09-12T19:53:46.211452+0000, chain.objs.size()=1 2024-09-12T18:01:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tRUVR3jg7fPb3Z4miJFFdHbcnxipOoc_0 2024-09-12T18:01:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12045728175313800496', time=2024-09-12T19:53:54.659777+0000, chain.objs.size()=1 2024-09-12T18:01:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ciHy_-vpviw6fD8xAmVpIJJim9EOMgu_0 2024-09-12T18:01:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13095927814537804381', time=2024-09-12T19:53:54.677966+0000, chain.objs.size()=1 2024-09-12T18:01:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.708+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Yg5dVEZSD8Uon1wATotlITojZoQhXuu_0 2024-09-12T18:01:04.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.711+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5048475243139301453', time=2024-09-12T19:53:54.714722+0000, chain.objs.size()=1 2024-09-12T18:01:04.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.711+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.exSoI1ACtUOMPgooMXe9SeGGewqBK5L_0 2024-09-12T18:01:04.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.711+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10906318614171150721', time=2024-09-12T19:53:54.733755+0000, chain.objs.size()=1 2024-09-12T18:01:04.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.711+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2W1mgXHEobDbhHavFh99bO3qjFsqMO-_0 2024-09-12T18:01:04.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.711+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17714040915271393507', time=2024-09-12T19:53:54.740654+0000, chain.objs.size()=1 2024-09-12T18:01:04.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.711+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.U8xy_iAoJEqQ_rxkizzzwVjX1OHl2kf_0 2024-09-12T18:01:04.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3090599988411965455', time=2024-09-12T19:53:54.745027+0000, chain.objs.size()=1 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.v_sRZGKpI_mSib7obMoLqDaJXMDhN78_0 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9283429436109773481', time=2024-09-12T19:53:54.747362+0000, chain.objs.size()=1 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VeTBLfT_VXdBW2Sg0CpxCz99hdTrmFo_0 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6850198393320395123', time=2024-09-12T19:53:54.748148+0000, chain.objs.size()=1 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rQBE34J5WWcyYSSn7uM1iboDNRqe9r6_0 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9392348097124565034', time=2024-09-12T19:53:54.854228+0000, chain.objs.size()=1 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.R0ZskgQQ46lA7Kl9PFbPAGUwktkEKJj_0 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15586505552660090930', time=2024-09-12T19:53:54.910760+0000, chain.objs.size()=1 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EVxTt8r-WYH1oLcdvziLFoPMMDl6I84_0 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8144383979373928949', time=2024-09-12T19:53:54.957627+0000, chain.objs.size()=1 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.5rnzw1nkzAdoY4OWLEkk_RXcEGoZ26s_0 2024-09-12T18:01:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1485789766255325023', time=2024-09-12T19:53:55.136419+0000, chain.objs.size()=1 2024-09-12T18:01:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.g40hGNCidLCYiIjWjh-RleTC5uYkd1H_0 2024-09-12T18:01:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3505383675048055009', time=2024-09-12T19:53:55.144413+0000, chain.objs.size()=1 2024-09-12T18:01:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.714+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.eZ9T2Nhgjx3MhMbv6xBZDCLTcGT2_nR_0 2024-09-12T18:01:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.716+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15983752954608433129', time=2024-09-12T19:53:55.164973+0000, chain.objs.size()=1 2024-09-12T18:01:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.716+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qGpzT2mECWbnC3-ad9M7m-EMbyO1ieH_0 2024-09-12T18:01:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.716+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2803883747586144308', time=2024-09-12T19:53:55.277639+0000, chain.objs.size()=1 2024-09-12T18:01:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.716+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.I48nQOxEnlZaiNIn0We7E-XRdk5cOiI_0 2024-09-12T18:01:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.717+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6463580079224822300', time=2024-09-12T19:53:55.285177+0000, chain.objs.size()=1 2024-09-12T18:01:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.717+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.f5hYPof3iCw6JeK_5SAs8HBAmeEQG7a_0 2024-09-12T18:01:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.717+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5651873697003885053', time=2024-09-12T19:53:55.295986+0000, chain.objs.size()=1 2024-09-12T18:01:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.717+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FIAhiEjblLBf2l6ZAeS82potwFrJNfR_0 2024-09-12T18:01:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.718+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2390066822704053518', time=2024-09-12T19:53:55.330148+0000, chain.objs.size()=1 2024-09-12T18:01:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.718+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DQJV7c2NBGZxOwXORdh7qSEx2BAqiZd_0 2024-09-12T18:01:04.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.721+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/47390 2024-09-12T18:01:04.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T18:01:04.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17782307006158326232', time=2024-09-12T19:53:55.349468+0000, chain.objs.size()=1 2024-09-12T18:01:04.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.K90xEELrg-8kvZNrx48mX3sTO1ji6Ss_0 2024-09-12T18:01:04.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9812043789464609885', time=2024-09-12T19:53:55.367325+0000, chain.objs.size()=1 2024-09-12T18:01:04.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RVQfoD53gO5CbuTZpECdz_j5YIUBqqo_0 2024-09-12T18:01:04.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18203654188624342056', time=2024-09-12T19:53:55.379585+0000, chain.objs.size()=1 2024-09-12T18:01:04.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uZqNvY96dsDUmPVC883AXAV8rEsNg7W_0 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16409273714010087517', time=2024-09-12T19:53:55.516508+0000, chain.objs.size()=1 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RNJe-GO0TuakE2jiLVetOF7cgJipIlq_0 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15763305790310671040', time=2024-09-12T19:53:55.551493+0000, chain.objs.size()=1 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gc3vKphNd8j28X_x38sbi9uWSMLH6O5_0 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4509591967822670114', time=2024-09-12T19:53:55.567325+0000, chain.objs.size()=1 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rK0CSYGZKM2moPSn2M2Wp7eQ56VxKv-_0 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11429066485918124677', time=2024-09-12T19:53:55.615609+0000, chain.objs.size()=1 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4vdWpBcPMsHQOrs4aRdAJIeI6SxknJI_0 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12090530706314833053', time=2024-09-12T19:53:55.703324+0000, chain.objs.size()=1 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.UiwP7YM2nz82Wmm4AJ6BYHgMaBYZg1w_0 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18031823097369753861', time=2024-09-12T19:53:55.706529+0000, chain.objs.size()=1 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rlAKdoP0rnfyaChv88b_osPn0vK1YJG_0 2024-09-12T18:01:04.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6646658055557533429', time=2024-09-12T19:53:55.794284+0000, chain.objs.size()=1 2024-09-12T18:01:04.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.l0JxBVM5pJ1njLm27SZ2bMceFUOjqhx_0 2024-09-12T18:01:04.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2872772841239528663', time=2024-09-12T19:53:55.961775+0000, chain.objs.size()=1 2024-09-12T18:01:04.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.X064xAeuDGnn5EdqyLjv6b3PLeFF-8O_0 2024-09-12T18:01:04.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1302924955112596386', time=2024-09-12T19:53:55.974695+0000, chain.objs.size()=1 2024-09-12T18:01:04.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.724+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.47hmo-56itSjwxYwL01FULKxKW6ztJO_0 2024-09-12T18:01:04.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.726+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16546140772709609687', time=2024-09-12T19:53:55.979442+0000, chain.objs.size()=1 2024-09-12T18:01:04.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.726+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.i3moJg6aYcKXZGYVVeeIt_CJ0S1zv17_0 2024-09-12T18:01:04.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.727+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8253448069119414468', time=2024-09-12T19:53:56.016475+0000, chain.objs.size()=1 2024-09-12T18:01:04.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.727+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.l_WnlPNZgJpkxfaE06fs1ROU5CNd7J4_0 2024-09-12T18:01:04.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.727+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6723896521450162861', time=2024-09-12T19:53:56.186473+0000, chain.objs.size()=1 2024-09-12T18:01:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.727+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zs3Z-DKAfJ67IFNedUYhRcpZFDriBEq_0 2024-09-12T18:01:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.728+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9035241573928593575', time=2024-09-12T19:53:56.194600+0000, chain.objs.size()=1 2024-09-12T18:01:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.728+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BtCYdBANbbX2tHcJPyA4g7IHadvRWOD_0 2024-09-12T18:01:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2246721268390052077', time=2024-09-12T19:53:56.203556+0000, chain.objs.size()=1 2024-09-12T18:01:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MkELYN2PKZMeDVuk60SIPIdWHYZyvNB_0 2024-09-12T18:01:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12976479501383701905', time=2024-09-12T19:54:27.515973+0000, chain.objs.size()=1 2024-09-12T18:01:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.464__shadow_.eJOpsjjllPp1oun79nJV3m6NMonJOTk_0 2024-09-12T18:01:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.729+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16015297451324453827', time=2024-09-12T19:54:27.835979+0000, chain.objs.size()=1 2024-09-12T18:01:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.729+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.465__shadow_.Aw7-1ZHjnSLNeghzpB3uWuDtkbXPODG_0 2024-09-12T18:01:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.731+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8497469284348900834', time=2024-09-12T19:54:35.154861+0000, chain.objs.size()=1 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.731+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.500__shadow_.DDvLoqsWkVWJFwCVgFJJvcFTeLdyjLd_0 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.731+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12599590384403539273', time=2024-09-12T19:54:39.587385+0000, chain.objs.size()=1 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.731+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.516__shadow_.AZASe2Q6hSXcbyIKOVY--jJu85zmHSr_0 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.732+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3890556590341130363', time=2024-09-12T19:55:33.971587+0000, chain.objs.size()=1 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.732+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:j732YG4DCjdtVPJTd-2.XR9zIDh2N8j_.mkd965h5gNwaI3UQ3Le2bOKDbwxgvBb_0 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.732+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11020664964468710979', time=2024-09-12T19:55:35.668686+0000, chain.objs.size()=1 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.732+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:77cwWc40X.d8aS5kPqBvTCp028GQ-P-_.ZOksmFrvqt0wSwgm5WMDIPJ2yjYIhpr_0 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.732+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11387543600429128574', time=2024-09-12T19:55:40.099550+0000, chain.objs.size()=1 2024-09-12T18:01:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.732+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.573__shadow_.tjDM6_dQ9WQZ1kQPkAqE96ZqzRrNVGf_0 2024-09-12T18:01:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.213785542729653696', time=2024-09-12T19:55:48.567525+0000, chain.objs.size()=1 2024-09-12T18:01:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:uvbtC-DCZILEyE7XVE9sh0m5RuPmS-p_.-azc1wFJR7q_71G5S6dM5iFJMvsUpqk_0 2024-09-12T18:01:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8405484540587241077', time=2024-09-12T19:55:58.977126+0000, chain.objs.size()=1 2024-09-12T18:01:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:5hmDS1vIbfrCQcml4G8IzE7Cph3TnNX_.iPSUahhlv9JyPuaQLl52vQFwPIwDie5_0 2024-09-12T18:01:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8933209772919456479', time=2024-09-12T19:56:08.843095+0000, chain.objs.size()=1 2024-09-12T18:01:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.608__shadow_.ME2EIUDGZhJwqzyzTZKYnoy-lV25oRc_0 2024-09-12T18:01:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2912275147847180330', time=2024-09-12T19:58:16.092364+0000, chain.objs.size()=1 2024-09-12T18:01:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.733+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.620__shadow_.nUeUuY9VZz_HpNJifpTjU9C1_Kq7AZs_0 2024-09-12T18:01:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14572938858788299232', time=2024-09-12T19:58:22.623486+0000, chain.objs.size()=1 2024-09-12T18:01:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.643__shadow_.Yq4PjP6-QAFGa4_KB2vlmlpO-oyDgHS_0 2024-09-12T18:01:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13346776693922958259', time=2024-09-12T19:58:29.721528+0000, chain.objs.size()=1 2024-09-12T18:01:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.664__shadow_.cgsHl6SBcfGzlYbg_s7L7An_o-VLbFV_0 2024-09-12T18:01:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.735+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14638037882579459928', time=2024-09-12T19:58:31.384448+0000, chain.objs.size()=1 2024-09-12T18:01:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.735+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.669__shadow_.YruQdWc80NTZSnvp4Lh8hDUreilfU9__0 2024-09-12T18:01:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.737+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14227058585338614637', time=2024-09-12T19:58:36.156013+0000, chain.objs.size()=1 2024-09-12T18:01:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.737+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.695__shadow:Xk-1JLzImQjEgR53UoOEpk1HJaOh8c3_.ohOdS4dYik_omm-U72PNWyDHcacBKxY_0 2024-09-12T18:01:04.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.741+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.743+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:01:04.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.745+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.745+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42323' 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16293616041953346004', time=2024-09-12T19:51:58.309325+0000, chain.objs.size()=3 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.9tBAn0oIzbp8-WPBe90W7Yh6ltV54m-_0 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.9tBAn0oIzbp8-WPBe90W7Yh6ltV54m-_1 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.9tBAn0oIzbp8-WPBe90W7Yh6ltV54m-_2 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8661561129717962588', time=2024-09-12T19:52:12.137896+0000, chain.objs.size()=1 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.182__shadow_.Cy0j09dPaxUoYgWDvsmAOTIXjVvUp8f_0 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2809863593595420173', time=2024-09-12T19:53:07.002135+0000, chain.objs.size()=1 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.234__shadow_.2jJsFPYgVxdQoGEEm72r4-bi6FRReJH_0 2024-09-12T18:01:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9403511848165168238', time=2024-09-12T19:53:09.943301+0000, chain.objs.size()=1 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.247__shadow_._ruZgk_fHRW8QpUjvZTU19DIV-RI6I-_0 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3143334786934224193', time=2024-09-12T19:53:10.759698+0000, chain.objs.size()=1 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.251__shadow_.us20hZFhPNSWafAcETKveTtJCF-__-4_0 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4721988417064220355', time=2024-09-12T19:53:12.427067+0000, chain.objs.size()=1 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.259__shadow_.BGiYPCxBIURoDRTtzTKflrgqy1M8Hod_0 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16961949905844560330', time=2024-09-12T19:53:21.165705+0000, chain.objs.size()=1 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Lw5PRppsEObumJEPOGmP_POanfv5WSL_0 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11539020497703883361', time=2024-09-12T19:53:21.169560+0000, chain.objs.size()=1 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2bbZIOdpooP6dt6a_yebrWqckwpg6b8_0 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14743150466263651160', time=2024-09-12T19:53:21.171413+0000, chain.objs.size()=1 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zylijK2CIOqCvgK4XkU2uhuiJ_6jqNz_0 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17011018296170697767', time=2024-09-12T19:53:21.220286+0000, chain.objs.size()=1 2024-09-12T18:01:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.746+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Qgwl3Wttuxm0es2RVcWfl4kinzimtEk_0 2024-09-12T18:01:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.748+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14877701424249457046', time=2024-09-12T19:53:21.246977+0000, chain.objs.size()=1 2024-09-12T18:01:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.748+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1iD5pgEBFkySiSNlCDq6JjhPTX0l0sf_0 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.748+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1125931962116339096', time=2024-09-12T19:53:21.471950+0000, chain.objs.size()=1 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.748+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oOFFtKiGPIaruztxrzyTBDPRamIAxCV_0 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.748+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1455568127670935902', time=2024-09-12T19:53:21.572131+0000, chain.objs.size()=1 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.748+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jtibFYJcqmbhwob2b_lCvpRnwxTnQIm_0 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.749+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11174859963804498191', time=2024-09-12T19:53:21.580732+0000, chain.objs.size()=1 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.749+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oVaeulwPtznS_XIgu_8UfLzFMeJlxXK_0 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.749+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7263060999066111831', time=2024-09-12T19:53:21.605577+0000, chain.objs.size()=1 2024-09-12T18:01:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.749+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rYRN6-VeYhJIEfC3S5fE_bd1rx2NPn1_0 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17181616344205100204', time=2024-09-12T19:53:21.613183+0000, chain.objs.size()=1 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rFe0yYRIO0awP-a24aikrLWb0FQLEHA_0 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7741567135932899615', time=2024-09-12T19:53:21.618085+0000, chain.objs.size()=1 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.q7cVImwvJvwIDT9QcZvdmHbDQdUHuzs_0 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1464620802013587991', time=2024-09-12T19:53:21.621648+0000, chain.objs.size()=1 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1z3BqmOzgAQxJGpgI_PRFXpcx2sPW-t_0 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6246330422841736709', time=2024-09-12T19:53:21.788622+0000, chain.objs.size()=1 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kd53I48j-KRtaTqNqw13qsViQ6CmYAF_0 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2889249763953727088', time=2024-09-12T19:53:21.794190+0000, chain.objs.size()=1 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ZwdTIIQuwIe445zhKapnGVaMjl1tJrA_0 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14074623789044247423', time=2024-09-12T19:53:21.824406+0000, chain.objs.size()=1 2024-09-12T18:01:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.r8VH5ptL9Z1uYwwv-faS5VJX9HNvWLD_0 2024-09-12T18:01:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6017534229904785217', time=2024-09-12T19:53:21.834846+0000, chain.objs.size()=1 2024-09-12T18:01:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.752+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.utLh_rgNQyk7RnnuU1HT36M6SbebABN_0 2024-09-12T18:01:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.754+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7982278196111430562', time=2024-09-12T19:53:21.853597+0000, chain.objs.size()=1 2024-09-12T18:01:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.754+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.c6GJlTCKUbQZR49y0Ftt4S8PWSUc6sx_0 2024-09-12T18:01:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.754+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15690439250938020611', time=2024-09-12T19:53:21.981904+0000, chain.objs.size()=1 2024-09-12T18:01:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.754+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4j8pYYxvsx506vDdR8Dt_gh9JjGD7mS_0 2024-09-12T18:01:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.754+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16560984502001696699', time=2024-09-12T19:53:21.983573+0000, chain.objs.size()=1 2024-09-12T18:01:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.754+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JfTbsWslqighEcX4fCzqyhtEtoU4VK1_0 2024-09-12T18:01:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11959829999743928892', time=2024-09-12T19:53:21.987352+0000, chain.objs.size()=1 2024-09-12T18:01:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.d4uiNBZ67emfMWZLwqauns2R1ay9r4t_0 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17282779412560933886', time=2024-09-12T19:53:22.035167+0000, chain.objs.size()=1 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dRE8I2ZzsU-EOInV1UrXCTr7VI1Dqet_0 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16721800234496983990', time=2024-09-12T19:53:22.037420+0000, chain.objs.size()=1 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.gvpggOVbjrYRkdvcEokl2kuSkztn9qT_0 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10931808959214721301', time=2024-09-12T19:53:22.048438+0000, chain.objs.size()=1 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.T-QPUAfCPBDdICx02Qgh2_eIs_Z19PT_0 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3870488918019270280', time=2024-09-12T19:53:22.061024+0000, chain.objs.size()=1 2024-09-12T18:01:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.755+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QzBxILvEpaZCTqLrj8mVJRd81FR7skQ_0 2024-09-12T18:01:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.67216951015556881', time=2024-09-12T19:53:22.187102+0000, chain.objs.size()=1 2024-09-12T18:01:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XcDmNvk8fMnmtANzjlrSUyZPPN3sHnJ_0 2024-09-12T18:01:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.757+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17313596256665911005', time=2024-09-12T19:53:22.188511+0000, chain.objs.size()=1 2024-09-12T18:01:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.757+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.rCqH2fzoAif7ZthDANkMJHuxi9SiI0X_0 2024-09-12T18:01:04.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.759+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1221164523285804588', time=2024-09-12T19:53:22.236128+0000, chain.objs.size()=1 2024-09-12T18:01:04.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.759+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qKEUC1kVyg2DPTyH0HfO14m91O28UZG_0 2024-09-12T18:01:04.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.760+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16926652091589085421', time=2024-09-12T19:53:22.249283+0000, chain.objs.size()=1 2024-09-12T18:01:04.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.760+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7Qv4ZFMM8VMa2wg-6aN2h14MB1bCKDO_0 2024-09-12T18:01:04.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2495502364686387320', time=2024-09-12T19:53:22.300777+0000, chain.objs.size()=1 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LZpsXacklEk3spcWBXFb3pJavh6wRiw_0 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10805889131970112257', time=2024-09-12T19:53:22.440455+0000, chain.objs.size()=1 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nk25cKJHDFfJSHEczPoFdcgJdQ1zXzH_0 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9834612447256686381', time=2024-09-12T19:53:22.445662+0000, chain.objs.size()=1 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.M3zcYkpI-vlvfMeBbT-j-JIGNiptJ67_0 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10907337302486103025', time=2024-09-12T19:53:22.586396+0000, chain.objs.size()=1 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GV9Yhr50TfG670224B5AaHTma3kncxp_0 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12036071860068781025', time=2024-09-12T19:53:22.616819+0000, chain.objs.size()=1 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.V5GZXWWZV_lBfeW3deGSGAbA_T8HDzD_0 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17637177821720463016', time=2024-09-12T19:53:22.617702+0000, chain.objs.size()=1 2024-09-12T18:01:04.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zALF6IACXoCC1EGQSZO5KCWReAvEpL7_0 2024-09-12T18:01:04.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7016992659702164690', time=2024-09-12T19:53:22.619687+0000, chain.objs.size()=1 2024-09-12T18:01:04.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.MFhfyl9rhZeQaA54Jl8ckXQzJFD2SvC_0 2024-09-12T18:01:04.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15855446272952699616', time=2024-09-12T19:53:22.653948+0000, chain.objs.size()=1 2024-09-12T18:01:04.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TZdC_DnBiKaNmP7yEyXYgCvc26dIkxC_0 2024-09-12T18:01:04.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5360522589702602777', time=2024-09-12T19:53:22.680706+0000, chain.objs.size()=1 2024-09-12T18:01:04.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.762+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bMDk7IrrDQoYk-aLgl8-eRLSbf5BlYU_0 2024-09-12T18:01:04.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.697174163611652580', time=2024-09-12T19:53:28.339132+0000, chain.objs.size()=1 2024-09-12T18:01:04.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.290__shadow_.V4AGWdKMFKhKSOlKtU4i09JJXMrHc6n_0 2024-09-12T18:01:04.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13401724646282200561', time=2024-09-12T19:53:29.340879+0000, chain.objs.size()=1 2024-09-12T18:01:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.Yj5EiZQb5Zq4byTKpjJ4wXLaQoPlc3Q_0 2024-09-12T18:01:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10657517715773121559', time=2024-09-12T19:53:29.358340+0000, chain.objs.size()=1 2024-09-12T18:01:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.dio740Y5Zd8lCkaJ1w6G7UrK0hUh3I5_0 2024-09-12T18:01:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11143127766958866675', time=2024-09-12T19:53:29.956147+0000, chain.objs.size()=1 2024-09-12T18:01:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.765+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.qqQ7s8YVA0Pp19pTsQ04ATj2HrhWiUN_0 2024-09-12T18:01:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.766+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6452480952915351225', time=2024-09-12T19:53:31.981275+0000, chain.objs.size()=1 2024-09-12T18:01:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.766+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.303__shadow_.RkdFA4Z0ffDi4x8SCGl9O3lCXdM1hzb_0 2024-09-12T18:01:04.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.767+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.541592061520681843', time=2024-09-12T19:53:44.549210+0000, chain.objs.size()=1 2024-09-12T18:01:04.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.767+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.AcFxwRmtPBgUwcTBSKHpg8tlA1pf5Le_0 2024-09-12T18:01:04.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5156123462213535059', time=2024-09-12T19:53:44.624956+0000, chain.objs.size()=1 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Vgfyv6m5m_GlRWpR_8ZfgHQG5Epntb4_0 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5158676773679789270', time=2024-09-12T19:53:44.627125+0000, chain.objs.size()=1 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ya-f6gU2o27NVL9B_CGd2poLhallq6-_0 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10472298473181091041', time=2024-09-12T19:53:44.951546+0000, chain.objs.size()=1 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BMk8oxXyi4vlFvkdwywAamH0_BcqdPy_0 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10972574670403946434', time=2024-09-12T19:53:44.954401+0000, chain.objs.size()=1 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.F8CopvQ_QzOKEYgHuO10u5vWpijVK7a_0 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13421546015334587909', time=2024-09-12T19:53:44.961953+0000, chain.objs.size()=1 2024-09-12T18:01:04.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.768+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0tcNyztSoC57W9bpP9qDJ0n4HJHeU0m_0 2024-09-12T18:01:04.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.770+0000 7fe4caf82640 0 -- 172.21.15.63:0/1810345191 >> [v2:172.21.15.63:6808/4011131089,v1:172.21.15.63:6809/4011131089] conn(0x7fe4bc055040 msgr2=0x7fe4bc056430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:04.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.771+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7492603021057941094', time=2024-09-12T19:53:45.004174+0000, chain.objs.size()=1 2024-09-12T18:01:04.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.771+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.r556CxjBXMIj297oAEyIhDrnO6PdtCq_0 2024-09-12T18:01:04.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.771+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1133000562937847296', time=2024-09-12T19:53:45.034176+0000, chain.objs.size()=1 2024-09-12T18:01:04.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.771+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FZbBTGFUMhcOr_c3-M1MNYtVcAnr7-Y_0 2024-09-12T18:01:04.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.773+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13261847575785052870', time=2024-09-12T19:53:45.040897+0000, chain.objs.size()=1 2024-09-12T18:01:04.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.773+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6hhctj9ZxQ9JgkAEae525OyG1ulOUfS_0 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13818038615971176509', time=2024-09-12T19:53:45.048456+0000, chain.objs.size()=1 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qHcv15PGiguuetNGcKAf--6a9epUDwe_0 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16289256890913545092', time=2024-09-12T19:53:45.151695+0000, chain.objs.size()=1 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.R8pv1Wnn7z8vCRiLSZbSjJMoErARia3_0 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4894888259164321190', time=2024-09-12T19:53:45.184473+0000, chain.objs.size()=1 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5AWnr7Az0C_nODEUm__iIQQFXN5VVjO_0 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2288760666393036446', time=2024-09-12T19:53:45.217530+0000, chain.objs.size()=1 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.J0B369tGzqcBZ0WBGCpXhcmUV_x9E2y_0 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14563732382610686930', time=2024-09-12T19:53:45.220611+0000, chain.objs.size()=1 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mrEDEAgFFJhg9CvGZ5Ujo8dVUujJkmF_0 2024-09-12T18:01:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6298289252140259821', time=2024-09-12T19:53:45.222935+0000, chain.objs.size()=1 2024-09-12T18:01:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.01AZ21RTPpghU4741snmzfb01sBs-Vk_0 2024-09-12T18:01:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.259571270305618214', time=2024-09-12T19:53:45.245350+0000, chain.objs.size()=1 2024-09-12T18:01:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.rwPOipxTeEGJSdiaw1VITUhb14Xa2Of_0 2024-09-12T18:01:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18086163405885784389', time=2024-09-12T19:53:45.589594+0000, chain.objs.size()=1 2024-09-12T18:01:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.774+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.foLbiw-0RZFNVvK51PglXr8seCmnHlO_0 2024-09-12T18:01:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.776+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5869384506622075874', time=2024-09-12T19:53:45.614924+0000, chain.objs.size()=1 2024-09-12T18:01:04.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.776+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YVDBSVPGsaZY82wOLvuqXJbQ1iOLBc4_0 2024-09-12T18:01:04.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.776+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10562031801090196133', time=2024-09-12T19:53:45.650054+0000, chain.objs.size()=1 2024-09-12T18:01:04.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.776+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.O5m3OMM59TGSLxCeysv27-lYXA-LoED_0 2024-09-12T18:01:04.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.778+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5626881314365389725', time=2024-09-12T19:53:45.741455+0000, chain.objs.size()=1 2024-09-12T18:01:04.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.778+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wfNZNqduQ5voAeu24_ISOp-A-PLE4cT_0 2024-09-12T18:01:04.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10455587140054928595', time=2024-09-12T19:53:45.744480+0000, chain.objs.size()=1 2024-09-12T18:01:04.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hAYqPXxj8TzHU3KYvqOW6cPpC3LRafA_0 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10002639494863586440', time=2024-09-12T19:53:45.823504+0000, chain.objs.size()=1 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ig5Tn1wm3a3STOu1oNuCn56ocxJ20aJ_0 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1574419708431611491', time=2024-09-12T19:53:45.946356+0000, chain.objs.size()=1 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BHKf1ygQMN8bSzl_ksVto8knUAU5hq9_0 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16780055629614109572', time=2024-09-12T19:53:46.001821+0000, chain.objs.size()=1 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BTJb1d9okrJQYhovfFifY-7OeAp0BPI_0 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16340729060101877091', time=2024-09-12T19:53:46.022282+0000, chain.objs.size()=1 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.780+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ALNXY4olVFXt6rjn5l5wJ9Aiehk-iZb_0 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.781+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7244519587528806479', time=2024-09-12T19:53:46.027469+0000, chain.objs.size()=1 2024-09-12T18:01:04.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.781+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.m0ELUH8XJukNPm31lBU6D-OwFjjxlVV_0 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3034364585908560640', time=2024-09-12T19:53:46.030599+0000, chain.objs.size()=1 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OVPoLQZIYj6TZHFQooeF7hWzjOehRch_0 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16670533222469428440', time=2024-09-12T19:53:46.164021+0000, chain.objs.size()=1 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hFl5wT-SgfSEkY8meoMPKv1Gex-AjO0_0 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17351201332523237650', time=2024-09-12T19:53:46.220118+0000, chain.objs.size()=1 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lwjAti401FB3q7k4_bNIAmyLkx3IGTi_0 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3463103988924366758', time=2024-09-12T19:53:46.224633+0000, chain.objs.size()=1 2024-09-12T18:01:04.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.782+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OEMvseVgQBfgSSfl3Cz1GeZwaN1BaAd_0 2024-09-12T18:01:04.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.785+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11147157581624179607', time=2024-09-12T19:53:54.641252+0000, chain.objs.size()=1 2024-09-12T18:01:04.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.785+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.A4BkowsCrCBWyESbgQ-IvuEU2Tn995A_0 2024-09-12T18:01:04.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.786+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5236941998194073380', time=2024-09-12T19:53:54.646942+0000, chain.objs.size()=1 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.786+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6N5VWY9FWpnWF1jemzS5-XYF375JwZ8_0 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13122938800357227385', time=2024-09-12T19:53:54.738226+0000, chain.objs.size()=1 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rxQOk36zixO7zBz15imN-YdNrMGWL_f_0 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2985388707754454796', time=2024-09-12T19:53:54.876419+0000, chain.objs.size()=1 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hMCDwO8vj8L5MqXZZG2ntKWhQkJjPrH_0 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5452953369308367440', time=2024-09-12T19:53:54.896307+0000, chain.objs.size()=1 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LRbBXrmd0QhcOrUet75cGsICRLJxurr_0 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15773490287587140379', time=2024-09-12T19:53:54.910234+0000, chain.objs.size()=1 2024-09-12T18:01:04.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.787+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8xlxWOOIRpYSStJuRDx2vSLD_bfsjwj_0 2024-09-12T18:01:04.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9165980239717488158', time=2024-09-12T19:53:54.928348+0000, chain.objs.size()=1 2024-09-12T18:01:04.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cvt08dUcbHaw31JzLK8W_FesIYUSphE_0 2024-09-12T18:01:04.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10351778671118415156', time=2024-09-12T19:53:54.944638+0000, chain.objs.size()=1 2024-09-12T18:01:04.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gSeG7YB0__tgTqoTc4OpFLkUhPTlJJz_0 2024-09-12T18:01:04.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.989434340067263775', time=2024-09-12T19:53:54.966650+0000, chain.objs.size()=1 2024-09-12T18:01:04.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bqmRJkj--JYjm9bINezDXVppd5vNipZ_0 2024-09-12T18:01:04.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7762307710341754042', time=2024-09-12T19:53:55.048577+0000, chain.objs.size()=1 2024-09-12T18:01:04.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Lr17jYwAB_f3gFaIxLuKCrIqXOPBN2i_0 2024-09-12T18:01:04.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14352569814114515924', time=2024-09-12T19:53:55.168218+0000, chain.objs.size()=1 2024-09-12T18:01:04.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.788+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.js7UOhqOxnkimlXurrPguZFkDuDag4U_0 2024-09-12T18:01:04.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.790+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8005758042640783088', time=2024-09-12T19:53:55.175962+0000, chain.objs.size()=1 2024-09-12T18:01:04.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.790+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6RdOAj1zBImJQrdVolZ5hYBPLwZfE7x_0 2024-09-12T18:01:04.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.792+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17538546911951438301', time=2024-09-12T19:53:55.299449+0000, chain.objs.size()=1 2024-09-12T18:01:04.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.793+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LoIbX52HUZOXHDrTQz4tHI70tzEXEmN_0 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6706556580581366455', time=2024-09-12T19:53:55.330601+0000, chain.objs.size()=1 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hFB6cNYkFFMjlmuq30d29KHSEzV2Bn1_0 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16505807989021724348', time=2024-09-12T19:53:55.520967+0000, chain.objs.size()=1 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.575b-dIy-sstaZuqRIsJIKbQu8e7aIK_0 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11987047396864426509', time=2024-09-12T19:53:55.524987+0000, chain.objs.size()=1 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DhMNAxYOr0NU6N34pprPAWg_9fz1L5M_0 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17798612523976351203', time=2024-09-12T19:53:55.572674+0000, chain.objs.size()=1 2024-09-12T18:01:04.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qAovg6lPvhqhDWhuGYTeJ3zGC_iOqwv_0 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4112800669200556485', time=2024-09-12T19:53:55.596864+0000, chain.objs.size()=1 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9JLMXxIuI4GHTx2CagbIL0637WpQZO1_0 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14939724366244055223', time=2024-09-12T19:53:55.622834+0000, chain.objs.size()=1 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.XR-NxaW1pJYjl5Y4Qqh5pD5X1ccJaq0_0 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16236853909128797549', time=2024-09-12T19:53:55.758016+0000, chain.objs.size()=1 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9HZ9RcWVJ2zasXxslluLYcRm-23XCbl_0 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18176168564402247027', time=2024-09-12T19:53:55.821465+0000, chain.objs.size()=1 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0OrLkTDgvxv2c2uT-mrXiNhv_Y5YHUc_0 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4638340501991676508', time=2024-09-12T19:53:55.928246+0000, chain.objs.size()=1 2024-09-12T18:01:04.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.794+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QE1pd3BmCxDi2_S9EUnj2mjM800NTxE_0 2024-09-12T18:01:04.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.799+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/42323 2024-09-12T18:01:04.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:01:04.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17980599262986323135', time=2024-09-12T19:53:55.943778+0000, chain.objs.size()=1 2024-09-12T18:01:04.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.V5Aioafkw2AFT28RmeF70tn0wUipf3z_0 2024-09-12T18:01:04.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12228448833341121055', time=2024-09-12T19:53:55.963604+0000, chain.objs.size()=1 2024-09-12T18:01:04.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7tD4eN9i3eluvromGOgHlFlDqJp2QoR_0 2024-09-12T18:01:04.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8178583611290199659', time=2024-09-12T19:53:55.967446+0000, chain.objs.size()=1 2024-09-12T18:01:04.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2KxDOsIFkx22PHkDlt1yqjj97boPWGB_0 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3652096834345130525', time=2024-09-12T19:53:56.119210+0000, chain.objs.size()=1 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.DDfdTPuyobuRnC-W2b-asm6lN_bSqkD_0 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.921086955550682735', time=2024-09-12T19:53:56.121196+0000, chain.objs.size()=1 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.iJNcN9xTEpT23FsDGusYndi3AjrSmSs_0 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16339390997667038274', time=2024-09-12T19:53:56.141850+0000, chain.objs.size()=1 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YiGHrKXoA0vN41xX0TDO-_HAP5OxX1H_0 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16790981100446932449', time=2024-09-12T19:53:56.169510+0000, chain.objs.size()=1 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.VrWnkMcMMBmZpH2BUvS277c42sLW0bj_0 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8961051203606606360', time=2024-09-12T19:53:57.293429+0000, chain.objs.size()=1 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.331__shadow_.gmZo-Yw5eEiUatgZSc-KAiIEKwD-Jni_0 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1592842528551417630', time=2024-09-12T19:54:14.718298+0000, chain.objs.size()=1 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.408__shadow_.eiQqbtk9L8L14sIQHqJJz-AgYS21nyQ_0 2024-09-12T18:01:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17144418475236187772', time=2024-09-12T19:54:23.714398+0000, chain.objs.size()=1 2024-09-12T18:01:04.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.802+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.452__shadow_.KQeSmx7pNoWD1qDwISCvWzJ5ul9leJO_0 2024-09-12T18:01:04.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.803+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17519251893112597606', time=2024-09-12T19:54:24.642932+0000, chain.objs.size()=1 2024-09-12T18:01:04.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.803+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.456__shadow_.JXtrm6iuOxl51qCFagrhunNFoeuDgHc_0 2024-09-12T18:01:04.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.803+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13255749668790872877', time=2024-09-12T19:54:34.711690+0000, chain.objs.size()=1 2024-09-12T18:01:04.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.803+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.498__shadow_.eTARI9fRv4hTIsPGY7GgsE0nvhwRJQL_0 2024-09-12T18:01:04.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16860113067811566098', time=2024-09-12T19:54:36.258363+0000, chain.objs.size()=1 2024-09-12T18:01:04.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.504__shadow:YnY3RpnWdxNL2AAWGjaSqYdBVkxd.2r_.0H8-qd5wL1YloYv9-TjdMVbSrLkSqV7_0 2024-09-12T18:01:04.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.806+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11874434964202724723', time=2024-09-12T19:54:37.851787+0000, chain.objs.size()=6 2024-09-12T18:01:04.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.806+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.1 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.2 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.3 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.4 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.5 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.508__multipart_srcmultipart.2~-LNIJSYCliw-DiDXDkrgmrzGE4LIZxe.6 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15863725827804717210', time=2024-09-12T19:56:02.141579+0000, chain.objs.size()=1 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:6F9VqDcxXTof4w0olD-rDVHkD2D43s9_.oheCPw3_DYMgdVxVfazm75hpnBmihfc_0 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6903203738244740513', time=2024-09-12T19:56:03.182380+0000, chain.objs.size()=1 2024-09-12T18:01:04.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:tg7WJJmIE6b3HFbv7b64VutpKfaHd6O_.Jph1oohUmMPdZs5ctTkO5sEPruwdOdr_0 2024-09-12T18:01:04.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6134979358931195751', time=2024-09-12T19:56:11.388614+0000, chain.objs.size()=12 2024-09-12T18:01:04.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__multipart_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.1 2024-09-12T18:01:04.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.808+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__shadow_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.1_1 2024-09-12T18:01:04.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.811+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__multipart_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.2 2024-09-12T18:01:04.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.812+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__shadow_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.2_1 2024-09-12T18:01:04.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.812+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__multipart_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.3 2024-09-12T18:01:04.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.812+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__shadow_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.3_1 2024-09-12T18:01:04.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.812+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__multipart_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.4 2024-09-12T18:01:04.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.814+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__shadow_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.4_1 2024-09-12T18:01:04.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.814+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__multipart_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.5 2024-09-12T18:01:04.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.814+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__shadow_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.5_1 2024-09-12T18:01:04.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.814+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__multipart_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.6 2024-09-12T18:01:04.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.814+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.614__shadow_multipart_enc.2~dNHhVWUjG_qUYxOsGVGoPpDmjGMdhWX.6_1 2024-09-12T18:01:04.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.814+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4226033585610678532', time=2024-09-12T19:58:17.798818+0000, chain.objs.size()=12 2024-09-12T18:01:04.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.814+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__multipart_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.1 2024-09-12T18:01:04.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.815+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__shadow_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.1_1 2024-09-12T18:01:04.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.819+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__multipart_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.2 2024-09-12T18:01:04.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.819+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__shadow_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.2_1 2024-09-12T18:01:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.819+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__multipart_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.3 2024-09-12T18:01:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.819+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__shadow_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.3_1 2024-09-12T18:01:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.821+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__multipart_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.4 2024-09-12T18:01:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.821+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__shadow_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.4_1 2024-09-12T18:01:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.822+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__multipart_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.5 2024-09-12T18:01:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.822+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__shadow_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.5_1 2024-09-12T18:01:04.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.824+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__multipart_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.6 2024-09-12T18:01:04.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.824+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.624__shadow_multipart_enc.2~izqgnhZDCDYyYP4S6hExN6kSJDiYeOP.6_1 2024-09-12T18:01:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.824+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12007925797852354476', time=2024-09-12T19:58:23.903628+0000, chain.objs.size()=1 2024-09-12T18:01:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.824+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.647__shadow_.gTeDUHAjFKWsrTXm4RQWy8CBbyODpA4_0 2024-09-12T18:01:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.825+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11990348326253435840', time=2024-09-12T19:58:33.338513+0000, chain.objs.size()=1 2024-09-12T18:01:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.825+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.680__shadow_.wK2Q1YsIS-eYtcLkY3d962hr5_g0Mtf_0 2024-09-12T18:01:04.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.827+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17897452452112000473', time=2024-09-12T19:58:39.164393+0000, chain.objs.size()=1 2024-09-12T18:01:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.827+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.708__shadow:0hKbVv8eBFJU48FEasyWnQ37AF2sX2v_.oacXt4Zrj46AgqVJmOBaaSqf553QoWB_0 2024-09-12T18:01:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.832+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.836+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:01:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.837+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.837+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58482' 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11036411462148781002', time=2024-09-12T19:51:57.681911+0000, chain.objs.size()=3 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-STANDARD.2~zdsSQG_65ldag63H9yiJxz4P6ihbJvb.1 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-STANDARD.2~zdsSQG_65ldag63H9yiJxz4P6ihbJvb.2 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.160__multipart_mymultipart-STANDARD.2~zdsSQG_65ldag63H9yiJxz4P6ihbJvb.3 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10428509416363927710', time=2024-09-12T19:51:58.045856+0000, chain.objs.size()=3 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.7-cBsbXOFl2WSZ7hqKj4YBkP6Sti8on_0 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.7-cBsbXOFl2WSZ7hqKj4YBkP6Sti8on_1 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.7-cBsbXOFl2WSZ7hqKj4YBkP6Sti8on_2 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5737455210746942283', time=2024-09-12T19:52:17.924103+0000, chain.objs.size()=1 2024-09-12T18:01:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.204__shadow_.lb3A-WoznYXMwsTWXNi-pmGfD6Zs6ae_0 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15832010181745076965', time=2024-09-12T19:53:08.352679+0000, chain.objs.size()=1 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.240__shadow_.qve6an8o_c5l_ERCN_Yi9uFwv8Q7xDD_0 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.767095378195322754', time=2024-09-12T19:53:10.352103+0000, chain.objs.size()=1 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.249__shadow_.t16bKoH8vX3gaBURtRPdkYyWB4nXbEL_0 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2839460732605541923', time=2024-09-12T19:53:21.169184+0000, chain.objs.size()=1 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.beT0YXQE0dhVLkNCx-HreWcQpuTKnQF_0 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9096738316034660003', time=2024-09-12T19:53:21.206862+0000, chain.objs.size()=1 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Ddf-eYPtJ7cJKaFRxrHBcwHpSOw9GqD_0 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12876946851879411166', time=2024-09-12T19:53:21.246351+0000, chain.objs.size()=1 2024-09-12T18:01:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.838+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hjZsELd6uFuW6H4KjouLee4yFtwTFr0_0 2024-09-12T18:01:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.842+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3625040897046225325', time=2024-09-12T19:53:21.259196+0000, chain.objs.size()=1 2024-09-12T18:01:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.842+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EX7kLHIKqfTjaKEQ9_hbKBd2MK3hOZ2_0 2024-09-12T18:01:04.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13569764508024320477', time=2024-09-12T19:53:21.369546+0000, chain.objs.size()=1 2024-09-12T18:01:04.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9lBIh1-4jTeDYMnep2EoP9L44QLKPRc_0 2024-09-12T18:01:04.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9182856283980912057', time=2024-09-12T19:53:21.392838+0000, chain.objs.size()=1 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.i8HYwENwjwVH5CtWFzzGn6_2fqmcQ3W_0 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18080569626770480211', time=2024-09-12T19:53:21.432958+0000, chain.objs.size()=1 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Yyf4ZNgE8yGZZ8sdxgESKlH8mz_qsCh_0 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14552572552905910904', time=2024-09-12T19:53:21.443692+0000, chain.objs.size()=1 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.IweF1g74Z9c2XLXvQH6hROY2m65ofyO_0 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13010101350450559806', time=2024-09-12T19:53:21.447094+0000, chain.objs.size()=1 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YvOo6qUjRU1AykMGaJmN_5yvX5bN8EW_0 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12255671891272812780', time=2024-09-12T19:53:21.466069+0000, chain.objs.size()=1 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ohvzLLom0kyxZjwwqoC2AY8lwWYX6p__0 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14691246767596757464', time=2024-09-12T19:53:21.475976+0000, chain.objs.size()=1 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.KPEjPjW19RdD50OapCDOsc3egAV0wGw_0 2024-09-12T18:01:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1476523076312527860', time=2024-09-12T19:53:21.491418+0000, chain.objs.size()=1 2024-09-12T18:01:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yo6tmGteWY7Ymc6c99BnslCIC-pXFGC_0 2024-09-12T18:01:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7456243826178491435', time=2024-09-12T19:53:21.605609+0000, chain.objs.size()=1 2024-09-12T18:01:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.t6Q_8h5ErEGe5kt6DMwMK3y8ar79BNS_0 2024-09-12T18:01:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15548671821692014304', time=2024-09-12T19:53:21.681476+0000, chain.objs.size()=1 2024-09-12T18:01:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.844+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DJu8rJufWl3F2MZZRVlWf1ZquPt8O2d_0 2024-09-12T18:01:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.846+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3545698076132062668', time=2024-09-12T19:53:21.689017+0000, chain.objs.size()=1 2024-09-12T18:01:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.846+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HZ6NISEMSjuJhzQvADvbSJpaw5ijx_j_0 2024-09-12T18:01:04.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.847+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18217185881039580158', time=2024-09-12T19:53:21.689781+0000, chain.objs.size()=1 2024-09-12T18:01:04.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.847+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CT7iXOpq7tVyr142FybX2sLowqlUAzm_0 2024-09-12T18:01:04.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15324152186927424538', time=2024-09-12T19:53:21.781135+0000, chain.objs.size()=1 2024-09-12T18:01:04.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ea21hlO1vHFss6ajR1QY3MsN0n5kZMU_0 2024-09-12T18:01:04.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9280684204675518307', time=2024-09-12T19:53:21.813477+0000, chain.objs.size()=1 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9wWdNb9xb8722VENocF784P-xZsTmMj_0 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15831923938126884485', time=2024-09-12T19:53:21.884095+0000, chain.objs.size()=1 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DZ82G0s5G0G07NuR47GiBNfuTwhzmei_0 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10443959823124022646', time=2024-09-12T19:53:21.885578+0000, chain.objs.size()=1 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._NHb1BylvSNS1DIEXXw6Lh_FOajsjA9_0 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4074912960808593704', time=2024-09-12T19:53:22.035190+0000, chain.objs.size()=1 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yMObsJ1JNLaT0XjYuO_nl0qHv6ERk-m_0 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1225167165627885711', time=2024-09-12T19:53:22.060053+0000, chain.objs.size()=1 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kobG-9ak1nEisqWf6cnO6wuxDtiAeH2_0 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16024878638413625546', time=2024-09-12T19:53:22.236585+0000, chain.objs.size()=1 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jDicQLLt5XkxuWRjz7mC1BmJyDu2kza_0 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2073798155975042534', time=2024-09-12T19:53:22.247947+0000, chain.objs.size()=1 2024-09-12T18:01:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.nH7PfAW17u3iXTt690TjLNIKJIZRy-H_0 2024-09-12T18:01:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2940457464166271231', time=2024-09-12T19:53:22.303197+0000, chain.objs.size()=1 2024-09-12T18:01:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.849+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.n9_2D2SgR5WzZcej6oniFIdnjhNhQEk_0 2024-09-12T18:01:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.850+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6802998485156018397', time=2024-09-12T19:53:22.303938+0000, chain.objs.size()=1 2024-09-12T18:01:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.850+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.k53ePnTdHHFlPyHYiCr4fXuX6koHy9A_0 2024-09-12T18:01:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.850+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4296440113821755788', time=2024-09-12T19:53:22.399535+0000, chain.objs.size()=1 2024-09-12T18:01:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.850+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oXcbx0rLEj4aYBSGAHFMppRglauBn92_0 2024-09-12T18:01:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2729045590194977390', time=2024-09-12T19:53:22.403127+0000, chain.objs.size()=1 2024-09-12T18:01:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fnqjUZ_72U4DMxmW5eihx-3OYOBGsQS_0 2024-09-12T18:01:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13756155076821001180', time=2024-09-12T19:53:22.404193+0000, chain.objs.size()=1 2024-09-12T18:01:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kC9QTAwVxFbtcVCZBenUv8B135E-vI5_0 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4023004138205619150', time=2024-09-12T19:53:22.424567+0000, chain.objs.size()=1 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mTbi0l85f2DPFUCimcjDwF1iDIRESkw_0 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15058376064105066931', time=2024-09-12T19:53:22.446128+0000, chain.objs.size()=1 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Lb223x2Xgk3X1iOQGvMuxpdxLXEVyFO_0 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12345850363813334783', time=2024-09-12T19:53:22.465865+0000, chain.objs.size()=1 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Z3ns34ry-UQexa0MurmT4lp-m9qPars_0 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4741546670066105237', time=2024-09-12T19:53:22.473062+0000, chain.objs.size()=1 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FFTKvNbmkzD9qxQXIIArN0tVNoIJZzf_0 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10828150733704900648', time=2024-09-12T19:53:22.474452+0000, chain.objs.size()=1 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mCglMRceEvfFehMa_nUqIkY_ml6rRAx_0 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5491961566126773343', time=2024-09-12T19:53:22.480596+0000, chain.objs.size()=1 2024-09-12T18:01:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TaeG0FWZhCeUNHiUF57N6nbThWFmPRU_0 2024-09-12T18:01:04.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10434237588205081081', time=2024-09-12T19:53:22.488907+0000, chain.objs.size()=1 2024-09-12T18:01:04.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zU_Rj-lSKmu8Mrh4vNeA2bDFa2EJnTo_0 2024-09-12T18:01:04.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3066974498401890469', time=2024-09-12T19:53:22.503004+0000, chain.objs.size()=1 2024-09-12T18:01:04.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.IkET58vdcnIPHZdaU9sji2sBBezqFDj_0 2024-09-12T18:01:04.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14138378417421733405', time=2024-09-12T19:53:22.635728+0000, chain.objs.size()=1 2024-09-12T18:01:04.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.855+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.52LqgsuRM-C7vniXIwJ4EB9M4V4uMsc_0 2024-09-12T18:01:04.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17720683391872980211', time=2024-09-12T19:53:22.639814+0000, chain.objs.size()=1 2024-09-12T18:01:04.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.OUuamR1FAbUl40-KtYVWgnB8_i6jApR_0 2024-09-12T18:01:04.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.860+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14431552458400168262', time=2024-09-12T19:53:22.665317+0000, chain.objs.size()=1 2024-09-12T18:01:04.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.860+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qQY1Kn8LpzvLn_8IrNjYwvm3wFQ0c2M_0 2024-09-12T18:01:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.861+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17636958218324122430', time=2024-09-12T19:53:24.070670+0000, chain.objs.size()=1 2024-09-12T18:01:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.861+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.270__shadow_.fiqu_XndjWpr0M5nPAL3SHyADXw786R_0 2024-09-12T18:01:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.861+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10952690040283214612', time=2024-09-12T19:53:24.463121+0000, chain.objs.size()=1 2024-09-12T18:01:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.861+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.272__shadow_.eJAygCRLN6BSQVZNc9sn9L7Pku_DZGF_0 2024-09-12T18:01:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.861+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5695650646213511176', time=2024-09-12T19:53:26.566484+0000, chain.objs.size()=1 2024-09-12T18:01:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.861+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.282__shadow_.TsavYeVhlXGiwXfL0YHKMgAUul0GY9Y_0 2024-09-12T18:01:04.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2181936739597731872', time=2024-09-12T19:53:27.927162+0000, chain.objs.size()=1 2024-09-12T18:01:04.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.288__shadow_.3pt4Sx9X6bi_pLX7ypMq8t7uxFYmE73_0 2024-09-12T18:01:04.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9641336197432099918', time=2024-09-12T19:53:29.937439+0000, chain.objs.size()=1 2024-09-12T18:01:04.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.9B7CR7vJqJJcb71qki64dYTM-fIxc6Q_0 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4766723879478605269', time=2024-09-12T19:53:30.781442+0000, chain.objs.size()=1 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.298__shadow_.9xL04G2mu4a9fm5_8VZkQvlh_TNQBbG_0 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7048176352719559599', time=2024-09-12T19:53:31.074068+0000, chain.objs.size()=1 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.299__shadow_.VlyyrorJh0_Fr-KOuPOR6U0xroK-MjS_0 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4735999425138117116', time=2024-09-12T19:53:33.007560+0000, chain.objs.size()=1 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.307__shadow_.s6OWiOw_7SnvSgxHc8E2G8rpVh6Rf1S_0 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3258906028540233815', time=2024-09-12T19:53:44.560414+0000, chain.objs.size()=1 2024-09-12T18:01:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.862+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uwRgwUxzJwtwPAtEr3H64Vc6mHj-E1D_0 2024-09-12T18:01:04.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.866+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14902875481131292074', time=2024-09-12T19:53:44.573137+0000, chain.objs.size()=1 2024-09-12T18:01:04.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.866+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7yJttEcortU0nh7E8Ww9U_mmI_3WkOI_0 2024-09-12T18:01:04.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.866+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6341986679408094548', time=2024-09-12T19:53:44.928472+0000, chain.objs.size()=1 2024-09-12T18:01:04.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.866+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9umKYpDin40TkJ6Rk03QIv_emT0vlvY_0 2024-09-12T18:01:04.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.868+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7505888429531210538', time=2024-09-12T19:53:44.978113+0000, chain.objs.size()=1 2024-09-12T18:01:04.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.868+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hzrzd3qTblWSd-32V6YszY10ho5yxII_0 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9179260004559583924', time=2024-09-12T19:53:44.987798+0000, chain.objs.size()=1 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ivOqUxauFrBW1mH8iex-gw0q16n5aJV_0 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6688560524636633612', time=2024-09-12T19:53:45.022926+0000, chain.objs.size()=1 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kFr6bRvc02vdy1QWeaB1WdPVyra-HzE_0 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6730673556135150445', time=2024-09-12T19:53:45.167680+0000, chain.objs.size()=1 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Zt2mpiHq0DJwt4C8CwKuJVmcsPqDXge_0 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11523961290363825976', time=2024-09-12T19:53:45.168468+0000, chain.objs.size()=1 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1yKN0zv0v0_TzeWNuByvS5ShSs1TuFu_0 2024-09-12T18:01:04.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17697843532691178898', time=2024-09-12T19:53:45.185501+0000, chain.objs.size()=1 2024-09-12T18:01:04.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WWGGwnv6p_oZtJSnTf5aRJbgocKnk77_0 2024-09-12T18:01:04.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4122843998387247416', time=2024-09-12T19:53:45.238350+0000, chain.objs.size()=1 2024-09-12T18:01:04.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.u3d8LABam-BeiMimqhVOJbd8U26Bmdf_0 2024-09-12T18:01:04.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3738615379845915187', time=2024-09-12T19:53:45.375530+0000, chain.objs.size()=1 2024-09-12T18:01:04.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.l9Ul8HW9JuFKx8Q21n5nQsZqKalMZcN_0 2024-09-12T18:01:04.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2008524585494545645', time=2024-09-12T19:53:45.403789+0000, chain.objs.size()=1 2024-09-12T18:01:04.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.869+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iz5e6IVvcHV4WTt2aiffNj8NTqH5TnM_0 2024-09-12T18:01:04.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.871+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12537546615949547902', time=2024-09-12T19:53:45.441282+0000, chain.objs.size()=1 2024-09-12T18:01:04.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.871+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.69q_KfeN5q6OqHxJzgmApuLrAkvvyw5_0 2024-09-12T18:01:04.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.871+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.842152312195155853', time=2024-09-12T19:53:45.557384+0000, chain.objs.size()=1 2024-09-12T18:01:04.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.871+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UqlO6t2ymhRr7HWM8osHVZUL_uagWEy_0 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2729847640811714701', time=2024-09-12T19:53:45.577146+0000, chain.objs.size()=1 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KgNlhsKrRwJ4408itF0xmhr5P8_aLDE_0 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16391727415527744629', time=2024-09-12T19:53:45.601838+0000, chain.objs.size()=1 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2mIsfHIfSYFn9RbMCNHXubRAs0b_Ygv_0 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17237442396614621906', time=2024-09-12T19:53:45.618967+0000, chain.objs.size()=1 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.e6n9Ks9ZRbk3JQmucBrGKhzthiIxSkJ_0 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6022454127672905289', time=2024-09-12T19:53:45.755996+0000, chain.objs.size()=1 2024-09-12T18:01:04.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.874+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NgXxrg8CMtnWywDQCt-T7H2cA_ojTxT_0 2024-09-12T18:01:04.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.875+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17636837421423641180', time=2024-09-12T19:53:45.769104+0000, chain.objs.size()=1 2024-09-12T18:01:04.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.875+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KMVqndmXEKtppakbQerSoXM2U7uw1ul_0 2024-09-12T18:01:04.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6480272439184465685', time=2024-09-12T19:53:45.783996+0000, chain.objs.size()=1 2024-09-12T18:01:04.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uW6H6e7wR8cwAom9QjHf-wvcUUUcOWR_0 2024-09-12T18:01:04.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9773562413162383454', time=2024-09-12T19:53:45.789959+0000, chain.objs.size()=1 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.bTqtenI-483nlw4rdWI7cHwOPgUIAa0_0 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13977399159209434717', time=2024-09-12T19:53:45.797080+0000, chain.objs.size()=1 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NO7xugD6IwBMWCazOPOTiNe-XKvCTw-_0 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2572775330173811003', time=2024-09-12T19:53:45.828539+0000, chain.objs.size()=1 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sOHSYpBzEdYO_wZThW1f61ExqCP3yKN_0 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9789616529544860268', time=2024-09-12T19:53:45.848360+0000, chain.objs.size()=1 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.foCSgy8sTw2xwY_eOXIHwib40roTm8i_0 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14715398856930448457', time=2024-09-12T19:53:45.862055+0000, chain.objs.size()=1 2024-09-12T18:01:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.876+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.OD1HTP3VGHRNigSOO1c4evwRs1L0FPN_0 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17225815397513783001', time=2024-09-12T19:53:46.031114+0000, chain.objs.size()=1 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dQqJU7Vcm63Vk2B87SOG-zpZLFHuQRg_0 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9145105678460370155', time=2024-09-12T19:53:46.055334+0000, chain.objs.size()=1 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.SJbJecHNDKxvdyTYbUqL_4xAvtdUwum_0 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2018529764335689031', time=2024-09-12T19:53:46.063612+0000, chain.objs.size()=1 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZwZ0Q_KNJtkx-yOGFBT5IlXhe4-9rEY_0 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10820990703051605973', time=2024-09-12T19:53:46.160715+0000, chain.objs.size()=1 2024-09-12T18:01:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.878+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tCSNczZWdn46vTaauo_Cnt_WMmUqSsM_0 2024-09-12T18:01:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.879+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9156558489504465324', time=2024-09-12T19:53:46.205884+0000, chain.objs.size()=1 2024-09-12T18:01:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.879+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.68VQuyJftBr8QONfIAZweZ_KxkxKXSl_0 2024-09-12T18:01:04.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12147731058081837494', time=2024-09-12T19:53:54.674253+0000, chain.objs.size()=1 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.iHYgLWXkiZLUfFxBDv_0a-wd-nIw8eF_0 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14033777933138099524', time=2024-09-12T19:53:54.724633+0000, chain.objs.size()=1 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.urgquGNp_PaOC2M8WY5tKg8lHz2XhG5_0 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13582852260555878995', time=2024-09-12T19:53:54.750621+0000, chain.objs.size()=1 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BPHyNyS1yv4unnEsnM45-11ReGh-8hh_0 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5089733627440002905', time=2024-09-12T19:53:54.855768+0000, chain.objs.size()=1 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cSuwuZMDITwz3hO2AF41oRGljdE1C1-_0 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4924882108080642889', time=2024-09-12T19:53:54.863836+0000, chain.objs.size()=1 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CqBJRUuCBBDf1X9LuGmTXJNXzX8JJUi_0 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7539878480435754813', time=2024-09-12T19:53:54.874481+0000, chain.objs.size()=1 2024-09-12T18:01:04.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.882+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1IPe0S1GxkAm5PTpHyBYemu7PbT4kuZ_0 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7238463696380989431', time=2024-09-12T19:53:54.894383+0000, chain.objs.size()=1 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sr2JEg2hOCe49yExln_eu1nLC0r2-f4_0 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8792984946936435427', time=2024-09-12T19:53:54.912486+0000, chain.objs.size()=1 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.E_9u69J81GWLb2MmbBBCfmgKyamQFOz_0 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8259647834207580704', time=2024-09-12T19:53:54.914919+0000, chain.objs.size()=1 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.40lxP8TXjLcLAITW5cQta0K-dUQz_g8_0 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6304524096648342618', time=2024-09-12T19:53:54.928040+0000, chain.objs.size()=1 2024-09-12T18:01:04.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9Q3Ok8aS5SmRBa8UkUySqQRIWkbg9qa_0 2024-09-12T18:01:04.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2992898239811491121', time=2024-09-12T19:53:54.937100+0000, chain.objs.size()=1 2024-09-12T18:01:04.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.883+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.swVuhvPHkI73z3RO_OLEeHio6k_Kc3S_0 2024-09-12T18:01:04.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.886+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7567471767445560544', time=2024-09-12T19:53:54.948125+0000, chain.objs.size()=1 2024-09-12T18:01:04.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.886+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6aaakfLvOhzR2cXVjofafraG9jbYQUx_0 2024-09-12T18:01:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.887+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10867469267961270034', time=2024-09-12T19:53:55.065383+0000, chain.objs.size()=1 2024-09-12T18:01:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.887+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.l2k44-dQv7G2KahnzCkRTbVK6oQFXmJ_0 2024-09-12T18:01:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.887+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13504644771591273790', time=2024-09-12T19:53:55.076735+0000, chain.objs.size()=1 2024-09-12T18:01:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.887+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nJmporFOgO9U-_DIK_Uo1lGedesfet5_0 2024-09-12T18:01:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.888+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10109191840161586016', time=2024-09-12T19:53:55.079074+0000, chain.objs.size()=1 2024-09-12T18:01:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.888+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.blezflqQT1FNRZsJKNUHQpJ4xVO5M34_0 2024-09-12T18:01:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.888+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3612169709197849592', time=2024-09-12T19:53:55.127988+0000, chain.objs.size()=1 2024-09-12T18:01:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.888+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qkdVjrDVgdEQWF5J9es2Ysb3bvTT6DV_0 2024-09-12T18:01:04.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.888+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7060626108636520447', time=2024-09-12T19:53:55.161903+0000, chain.objs.size()=1 2024-09-12T18:01:04.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.888+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._s-BfdZSJ28cG2YcgGscYCmpA4meGmX_0 2024-09-12T18:01:04.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.892+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/58482 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17264857782539383858', time=2024-09-12T19:53:55.312877+0000, chain.objs.size()=1 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HrIW9BGFZw420oQW0nlJlz2LczKdOzX_0 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4071186691037345028', time=2024-09-12T19:53:55.323979+0000, chain.objs.size()=1 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZLi3APyhfWTHMvE3R70zbfWzck7cqoU_0 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13686928593666430095', time=2024-09-12T19:53:55.337745+0000, chain.objs.size()=1 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SEimj24dL4lTTXkVhaA7VA43iL575It_0 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12394218954609304051', time=2024-09-12T19:53:55.600119+0000, chain.objs.size()=1 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FS4tfDSyc_VYpGjTdL_UBBs9waVJFBP_0 2024-09-12T18:01:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4718882165033793639', time=2024-09-12T19:53:55.623398+0000, chain.objs.size()=1 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Npsb9DJtA9yGV1dyIjGTQlrURMz74ea_0 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15632565518191420807', time=2024-09-12T19:53:55.732208+0000, chain.objs.size()=1 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.d-dTWVnxKYcdLhyoXv7miupWuMnHGNK_0 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17611526897330519361', time=2024-09-12T19:53:55.765926+0000, chain.objs.size()=1 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bD8FjUsW-X_c3FycN5-Z5Yvc_ga2brW_0 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16990271582058048213', time=2024-09-12T19:53:55.777790+0000, chain.objs.size()=1 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jKA5nJ67cYIT1J0hfUA-Xb07pzQc7d4_0 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17009431119388293238', time=2024-09-12T19:53:55.805834+0000, chain.objs.size()=1 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tGvaQbOmbvCGy2i9nU2hXI429xdSfKp_0 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8431502818552208977', time=2024-09-12T19:53:55.811895+0000, chain.objs.size()=1 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cJfYFPWXz5YpBKuOhkUR3rAGZCTkvad_0 2024-09-12T18:01:04.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12439220657687350546', time=2024-09-12T19:53:55.940291+0000, chain.objs.size()=1 2024-09-12T18:01:04.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Zfs5LLPwIOV8rQAQJj7bGww5B23WtKE_0 2024-09-12T18:01:04.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11304519306603150015', time=2024-09-12T19:53:55.964198+0000, chain.objs.size()=1 2024-09-12T18:01:04.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.895+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8Py408aMOBQh9H6tC0hN7NbBxiCQVFZ_0 2024-09-12T18:01:04.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3177246325222206788', time=2024-09-12T19:53:55.973785+0000, chain.objs.size()=1 2024-09-12T18:01:04.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9gjRO7zO4KVLggToGKwdZOQWOKKHiNo_0 2024-09-12T18:01:04.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.898+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6234830478457699096', time=2024-09-12T19:53:55.989042+0000, chain.objs.size()=1 2024-09-12T18:01:04.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.898+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Co40O_OgvQgbiDQdgoBSf01IQhprEME_0 2024-09-12T18:01:04.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5062530397380010535', time=2024-09-12T19:53:55.992204+0000, chain.objs.size()=1 2024-09-12T18:01:04.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rHCqtfXhl1NnZV9wKkFfQGSsysoblB4_0 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12914553765997125579', time=2024-09-12T19:53:56.022816+0000, chain.objs.size()=1 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kzYBSG6549AHkvfnAr6JTMIK4w-2OG5_0 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12471147866901635345', time=2024-09-12T19:53:56.119361+0000, chain.objs.size()=1 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.D0onMicc_qk445zSvVulnskl5KapVLo_0 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5578546366311517155', time=2024-09-12T19:53:56.154258+0000, chain.objs.size()=1 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LplDHTn9NDMyAjD4psknEWHvq6dNDm4_0 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3691852245356189578', time=2024-09-12T19:53:56.155049+0000, chain.objs.size()=1 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JcgjMVfjnGposZp3u04F5HXuOEldepM_0 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15843618763882047748', time=2024-09-12T19:53:56.175756+0000, chain.objs.size()=1 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.p-WDdLu9hmiCii3C8e6dtvFM6jmUoU6_0 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11432945990584213974', time=2024-09-12T19:53:56.202462+0000, chain.objs.size()=1 2024-09-12T18:01:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.dVR8T_4S0Tn1gvv-6g_ud-cDVxW0qpv_0 2024-09-12T18:01:04.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161517445448359083', time=2024-09-12T19:54:26.077915+0000, chain.objs.size()=1 2024-09-12T18:01:04.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.899+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.460__shadow_.6qNpGHd155zCdi9tDg0l2ktChXjIeTF_0 2024-09-12T18:01:04.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.902+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11332958940721537088', time=2024-09-12T19:54:26.425692+0000, chain.objs.size()=1 2024-09-12T18:01:04.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.902+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.461__shadow_.Y_epMIx775RW_GuiJY4RWXAMZk973-A_0 2024-09-12T18:01:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.903+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11723937975679741966', time=2024-09-12T19:54:31.215908+0000, chain.objs.size()=1 2024-09-12T18:01:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.TpByjnpZCZLwN_wQYMlrvX4HoKfw-9q_0 2024-09-12T18:01:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7433062842992215625', time=2024-09-12T19:54:31.219171+0000, chain.objs.size()=1 2024-09-12T18:01:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.Q4B9ThwCLd7Os6EsppHbLOrsOawr4lt_0 2024-09-12T18:01:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17724817733975342465', time=2024-09-12T19:54:32.053491+0000, chain.objs.size()=1 2024-09-12T18:01:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.487__shadow_.Ener0fpf7FHC39Opu_zCqnCqQ9OrnDt_0 2024-09-12T18:01:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10036905559706370705', time=2024-09-12T19:54:40.817627+0000, chain.objs.size()=1 2024-09-12T18:01:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.518__shadow_.K_xzSCQYL_woPhCHO1pz6KbLJl2PguK_0 2024-09-12T18:01:04.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.904+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10053077627551245350', time=2024-09-12T19:54:51.515424+0000, chain.objs.size()=2 2024-09-12T18:01:04.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.905+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~JQ9XbbFZJZmrhCANVxER28e6E45G0sq.1 2024-09-12T18:01:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.526__multipart_mymultipart.2~JQ9XbbFZJZmrhCANVxER28e6E45G0sq.2 2024-09-12T18:01:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3345333266616741017', time=2024-09-12T19:55:23.642858+0000, chain.objs.size()=1 2024-09-12T18:01:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.554__shadow_.Ze6ZSAzqGw_OcnxK4vLhQWgz3Mez4It_0 2024-09-12T18:01:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9819385273168697601', time=2024-09-12T19:55:25.272159+0000, chain.objs.size()=2 2024-09-12T18:01:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.558__shadow_.SF9C94bv8eOXBK5TmN2k-03yi1ng0y9_0 2024-09-12T18:01:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.558__shadow_.SF9C94bv8eOXBK5TmN2k-03yi1ng0y9_1 2024-09-12T18:01:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.473069797452211201', time=2024-09-12T19:55:39.453203+0000, chain.objs.size()=1 2024-09-12T18:01:04.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.571__shadow:Op4v31-x1V5fZtTuucm0JXi-GRgEq3C_.2agWJsR09KPpWbJmHBzVdOSvXuNmu7Z_0 2024-09-12T18:01:04.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11282781703568929048', time=2024-09-12T19:55:53.147189+0000, chain.objs.size()=1 2024-09-12T18:01:04.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:Fv8xsILwIsWPZY-wjdad.yZeLNoBkfj_.JVFSPW9WEH5UxApN1ULUl_WkXToYEBz_0 2024-09-12T18:01:04.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6458279631491394298', time=2024-09-12T19:55:54.000312+0000, chain.objs.size()=1 2024-09-12T18:01:04.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:co6iV.2YahbCMtmrBXPkqgLX5fGlj9y_.jShdgP2MHSFk_QOCt-OCpEpLXAD3FuI_0 2024-09-12T18:01:04.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4955006868624596274', time=2024-09-12T19:55:59.214751+0000, chain.objs.size()=1 2024-09-12T18:01:04.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.908+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:RzaHWB3sdT-TnpzVYcC2EdxXoBRhCeX_.-fG26xNn4rKQiLsY0DdwyGuXcRtHz4W_0 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11901169248883779583', time=2024-09-12T19:56:03.182462+0000, chain.objs.size()=1 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:6OQFdRzGi.ynuCPaE4dP4RwUZjL9Sev_.HFzP5Z_2qQMprS5fGwgqifwSZ_OqWc7_0 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12356053525016241145', time=2024-09-12T19:56:03.183345+0000, chain.objs.size()=1 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:6OQFdRzGi.ynuCPaE4dP4RwUZjL9Sev_.HFzP5Z_2qQMprS5fGwgqifwSZ_OqWc7_0 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5888242354498664841', time=2024-09-12T19:56:05.198131+0000, chain.objs.size()=1 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:77KUwpU1yG09YlLs2a.mzPB8Qk10sWF_.zkyZSl258AfCPvP6WFw5iN8bU7uDxAa_0 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1291696124070765017', time=2024-09-12T19:58:15.891461+0000, chain.objs.size()=1 2024-09-12T18:01:04.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.911+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.619__shadow_.qBJS4OPBlrOcvgzlPBMcU2b7sXPlNhp_0 2024-09-12T18:01:04.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14333110320363480412', time=2024-09-12T19:58:29.721905+0000, chain.objs.size()=1 2024-09-12T18:01:04.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.664__shadow_.aLlX8PKa9NqWAZAuq23ZOs8RjNrperp_0 2024-09-12T18:01:04.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12887656438786678053', time=2024-09-12T19:58:31.955706+0000, chain.objs.size()=1 2024-09-12T18:01:04.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.672__shadow_.26i6YJ-5uCTmn6_aebVed5OoHcGl1Ej_0 2024-09-12T18:01:04.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6953809756075313604', time=2024-09-12T19:59:01.300528+0000, chain.objs.size()=1 2024-09-12T18:01:04.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.719__shadow_.15fNqxT_OYvlVaMnejihRN0nQ3AaqCt_0 2024-09-12T18:01:04.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17653667861367428365', time=2024-09-12T19:59:01.301310+0000, chain.objs.size()=1 2024-09-12T18:01:04.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.913+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.719__shadow_.15fNqxT_OYvlVaMnejihRN0nQ3AaqCt_0 2024-09-12T18:01:04.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.917+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.920+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:01:04.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.921+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=90, truncated=0, next_marker='' 2024-09-12T18:01:04.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5047592085725455238', time=2024-09-12T19:53:06.563158+0000, chain.objs.size()=1 2024-09-12T18:01:04.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.232__shadow_.RqlGhOVx-eIN-peyOd5H1Wqqhpb1r5R_0 2024-09-12T18:01:04.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2229446849907577154', time=2024-09-12T19:53:07.449059+0000, chain.objs.size()=1 2024-09-12T18:01:04.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.236__shadow_.dXCMU4raFrF26wZw5Ct6AYo10IpH2Zk_0 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1226603433258440218', time=2024-09-12T19:53:08.977754+0000, chain.objs.size()=1 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.243__shadow_.Mma9Nj3L0mH0LtbvDa0rDHPPVdiQqfO_0 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5200277160312650496', time=2024-09-12T19:53:10.145921+0000, chain.objs.size()=1 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.248__shadow_.XpSMjAv7dSLUq_lSlwWvkkgjxFfr7LW_0 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9048878021415945823', time=2024-09-12T19:53:11.622777+0000, chain.objs.size()=1 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.255__shadow_.iev9UayYD051NKQMu-ajoQ6V5ZK6gna_0 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2460024785315475428', time=2024-09-12T19:53:12.231653+0000, chain.objs.size()=1 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.922+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.258__shadow_.cMCFV54CtslNTllOluhw1xQZWm-3ELJ_0 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14273607906093220948', time=2024-09-12T19:53:21.165007+0000, chain.objs.size()=1 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.TjsvOxy40q7-3oIAJPbRC3E-wMGbKVt_0 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15222383555656334845', time=2024-09-12T19:53:21.187669+0000, chain.objs.size()=1 2024-09-12T18:01:04.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fz3oir5X85RPTs8zK5GqTv6H_70hK0y_0 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15565503882998643504', time=2024-09-12T19:53:21.268360+0000, chain.objs.size()=1 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.i8Wg2A8K7TBaiG5RMnkt3QQpWFwNLla_0 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6879016565196148859', time=2024-09-12T19:53:21.392153+0000, chain.objs.size()=1 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dR7oSf0sS8pvzDdwXegODYsm0KXK-jY_0 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10348154508551205271', time=2024-09-12T19:53:21.427794+0000, chain.objs.size()=1 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.vrKbM3cPv3yp7TNjS3LauvOblNpQxrP_0 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11678542794683660481', time=2024-09-12T19:53:21.621717+0000, chain.objs.size()=1 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.923+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GOKb_0nn4zq4vEunEW0qrLgciMqzUad_0 2024-09-12T18:01:04.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.925+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13098837104269166490', time=2024-09-12T19:53:21.654958+0000, chain.objs.size()=1 2024-09-12T18:01:04.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.925+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tHVwIoD2NzJFMefEn_l03im6FfRKttb_0 2024-09-12T18:01:04.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2484054739855886146', time=2024-09-12T19:53:21.683879+0000, chain.objs.size()=1 2024-09-12T18:01:04.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.K3FgA5DZh7ue1dxkyNMF_tnZUmPtTn0_0 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10480183480659864857', time=2024-09-12T19:53:21.851177+0000, chain.objs.size()=1 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Hdo528b8Ew8uEHIXQj52fsJoDjKI_CI_0 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1085093405564230944', time=2024-09-12T19:53:21.997277+0000, chain.objs.size()=1 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bwLydZHKWUA9EDPAXQfJjyzz7OA-cej_0 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16487261941030924163', time=2024-09-12T19:53:22.050824+0000, chain.objs.size()=1 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.926+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aRjs-cRrRwxTlcs2KATybLTyJY5PXR4_0 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8774800404876925968', time=2024-09-12T19:53:22.058844+0000, chain.objs.size()=1 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-LQU-9Pru7jemHqH0Redtm3JoCWSCGy_0 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6396433974249209889', time=2024-09-12T19:53:22.198895+0000, chain.objs.size()=1 2024-09-12T18:01:04.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8KKIofFSnohpa_XJl6UNoN28NQ54n2X_0 2024-09-12T18:01:04.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2997663051539380086', time=2024-09-12T19:53:22.199918+0000, chain.objs.size()=1 2024-09-12T18:01:04.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.N3yxE9DMcZGNrxr5sqIC6LAQ1Y-xViq_0 2024-09-12T18:01:04.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2394305129598346408', time=2024-09-12T19:53:22.417975+0000, chain.objs.size()=1 2024-09-12T18:01:04.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6cGlJiqH3PerTzN3Au2wuCDnqwyswXx_0 2024-09-12T18:01:04.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14875790234746187524', time=2024-09-12T19:53:22.449389+0000, chain.objs.size()=1 2024-09-12T18:01:04.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.927+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jCcxYSPksrZoC3A7LMHIg4UcHn7v9sV_0 2024-09-12T18:01:04.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.929+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1295677072363269934', time=2024-09-12T19:53:22.583415+0000, chain.objs.size()=1 2024-09-12T18:01:04.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.929+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Rh8gp0SxYndWfDXO4LfnmL1EOxxzxe5_0 2024-09-12T18:01:04.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15028704177046677610', time=2024-09-12T19:53:22.637367+0000, chain.objs.size()=1 2024-09-12T18:01:04.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JlnP1625nL1fWqxSYCcuhTsFIwOgVxR_0 2024-09-12T18:01:04.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2638467167170055055', time=2024-09-12T19:53:22.651680+0000, chain.objs.size()=1 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ic_c4h_tITvUDPa5nsGK79VyJboYkhD_0 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12822577032412155512', time=2024-09-12T19:53:30.137857+0000, chain.objs.size()=1 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.295__shadow_._Fu8Dp7ropGQYGgAomcTCwO0hjv2Iwp_0 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9461033635652510878', time=2024-09-12T19:53:44.522570+0000, chain.objs.size()=1 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.PJVYNW7WsMxC1Dt_T8VOiesix00X7r2_0 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18177982489314999273', time=2024-09-12T19:53:44.608880+0000, chain.objs.size()=1 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0vYhQDZb5AajJi9LZzHJF1Q17FzYGUC_0 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.354782107360501158', time=2024-09-12T19:53:44.645115+0000, chain.objs.size()=1 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.M65gff26eXC1n0yeh44gFfuePZSwGfU_0 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11817959181236096547', time=2024-09-12T19:53:44.924553+0000, chain.objs.size()=1 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ODjBzPjG80eCT_vO4mQUCaeS78P1h5c_0 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13603743290993971055', time=2024-09-12T19:53:44.927898+0000, chain.objs.size()=1 2024-09-12T18:01:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FydjYdGseboKLKm4qUde54WqHgNi6fR_0 2024-09-12T18:01:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6072231652713663280', time=2024-09-12T19:53:44.947849+0000, chain.objs.size()=1 2024-09-12T18:01:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.zE8-kR-KHa_EcucFHCg6OgyIduf2FHC_0 2024-09-12T18:01:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17227637594598280203', time=2024-09-12T19:53:44.958633+0000, chain.objs.size()=1 2024-09-12T18:01:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.932+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.S1XfFldEy-bTF0kFN-X3Gm0dKe-qn2U_0 2024-09-12T18:01:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.933+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8198956795616522140', time=2024-09-12T19:53:45.156177+0000, chain.objs.size()=1 2024-09-12T18:01:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.933+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.I-l0YT6hC1Q0inmMr6ABaPr5RNxxZYA_0 2024-09-12T18:01:04.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.937+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3323416540569718514', time=2024-09-12T19:53:45.166050+0000, chain.objs.size()=1 2024-09-12T18:01:04.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.937+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lwcrP5mCBA7q3eJESBzZTgCmPd_BZXC_0 2024-09-12T18:01:04.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.937+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16278886531767852703', time=2024-09-12T19:53:45.176048+0000, chain.objs.size()=1 2024-09-12T18:01:04.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.937+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kDi6NvCZ2jrDgxM70TI7cXvKdwirzBb_0 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1244043217865797953', time=2024-09-12T19:53:45.358335+0000, chain.objs.size()=1 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pdg_3ONLXxv8FgIqJoNv3CIbgHwDMBU_0 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12603886394635021079', time=2024-09-12T19:53:45.390430+0000, chain.objs.size()=1 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7wqWrGpDPWTk1lUvwZvMiY6fxHO-cQI_0 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9940318647311130391', time=2024-09-12T19:53:45.440691+0000, chain.objs.size()=1 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YJfQ1DDO6kZazLw3UvU6szAYdytzq5D_0 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5868520206409707452', time=2024-09-12T19:53:45.539095+0000, chain.objs.size()=1 2024-09-12T18:01:04.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hwsdrVmroDna0EC_ey1FotQWzFKRcX8_0 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6205591873238224314', time=2024-09-12T19:53:45.558484+0000, chain.objs.size()=1 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.d3y-DXYwMopRhdEWWJGZhn90pb-BCtQ_0 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.499815373690631129', time=2024-09-12T19:53:45.573329+0000, chain.objs.size()=1 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.qxhEu6Mw7MFzUbXC04lLtv7JZ8bNLmW_0 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8082796917693810247', time=2024-09-12T19:53:45.585024+0000, chain.objs.size()=1 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JcUtPY6xkiioi4SEBD7P-39g2-BicyG_0 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3198470357818060099', time=2024-09-12T19:53:45.606512+0000, chain.objs.size()=1 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-YEdvcWA0wrn7Z4y6AkiOHF0wcN2EOz_0 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13944686402919410718', time=2024-09-12T19:53:45.627659+0000, chain.objs.size()=1 2024-09-12T18:01:04.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.939+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oY4ef9hOq2iInUrwDnjEf45f6EdwcU8_0 2024-09-12T18:01:04.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.942+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14252087604334838145', time=2024-09-12T19:53:45.636921+0000, chain.objs.size()=1 2024-09-12T18:01:04.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.942+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._znJBTZTqN-V7Dk8Zn_dIG1VkAl93AN_0 2024-09-12T18:01:04.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.942+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5156271998377367710', time=2024-09-12T19:53:45.661166+0000, chain.objs.size()=1 2024-09-12T18:01:04.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.942+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Vujj-9Vuq45pswnPZCGeCXxa1oejnzO_0 2024-09-12T18:01:04.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.944+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1693351826901792745', time=2024-09-12T19:53:45.743493+0000, chain.objs.size()=1 2024-09-12T18:01:04.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.944+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.P5GQodL8OBJPr66RHonqz9VY_qCP4ka_0 2024-09-12T18:01:04.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13301127695553335798', time=2024-09-12T19:53:45.787053+0000, chain.objs.size()=1 2024-09-12T18:01:04.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MmLmGgUnQiYsRrPLS7xeR5gXCOq56Tj_0 2024-09-12T18:01:04.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12752994416372427107', time=2024-09-12T19:53:45.799061+0000, chain.objs.size()=1 2024-09-12T18:01:04.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.kzEjmV-qLxKb75YOHs324fff04fulud_0 2024-09-12T18:01:04.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1617167914729164364', time=2024-09-12T19:53:45.816649+0000, chain.objs.size()=1 2024-09-12T18:01:04.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.p0B3HhVIUkmkOnCpTWfDl5oS5I37cFv_0 2024-09-12T18:01:04.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3025522783225407239', time=2024-09-12T19:53:45.844371+0000, chain.objs.size()=1 2024-09-12T18:01:04.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.eahQJNtRpSuMbWmI_u_wGAcnLp6VzJa_0 2024-09-12T18:01:04.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17630482933222820394', time=2024-09-12T19:53:45.940200+0000, chain.objs.size()=1 2024-09-12T18:01:04.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4UYrTfeqfez9j-Mssobb-CvAXJ4vnM6_0 2024-09-12T18:01:04.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8408914588440987033', time=2024-09-12T19:53:46.060094+0000, chain.objs.size()=1 2024-09-12T18:01:04.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.945+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.eBcmV3-pD0fw3-NSiaSGIjgkdN8YSrq_0 2024-09-12T18:01:04.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7058809851538276243', time=2024-09-12T19:53:46.157683+0000, chain.objs.size()=1 2024-09-12T18:01:04.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.LxqxRwze2_yD4b7oIC8lEkB5Yv6PdAr_0 2024-09-12T18:01:04.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6173022185575896434', time=2024-09-12T19:53:46.171859+0000, chain.objs.size()=1 2024-09-12T18:01:04.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.NlN9JEeI7LwlqIEfAUFl6mk-bKg73Yg_0 2024-09-12T18:01:04.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3732830758807837452', time=2024-09-12T19:53:46.210568+0000, chain.objs.size()=1 2024-09-12T18:01:04.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GGbnMxOrRgE9dgsNmgu_qsl2maePn9z_0 2024-09-12T18:01:04.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14353503433494006733', time=2024-09-12T19:53:46.221079+0000, chain.objs.size()=1 2024-09-12T18:01:04.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.947+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.lFb1gHqtqDnZM83vWt5qadKBEe1aGt6_0 2024-09-12T18:01:04.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.949+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6350156913602051724', time=2024-09-12T19:53:54.650379+0000, chain.objs.size()=1 2024-09-12T18:01:04.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.949+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.--rAS7nFnI-s6m5BDM5TesvrJWEF9qD_0 2024-09-12T18:01:04.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.949+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10882060311612537995', time=2024-09-12T19:53:54.664516+0000, chain.objs.size()=1 2024-09-12T18:01:04.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.949+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jP6K6NQEUhsTGJl8K6m8YEl0K02Hi4g_0 2024-09-12T18:01:04.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.949+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1883872672582478173', time=2024-09-12T19:53:54.666451+0000, chain.objs.size()=1 2024-09-12T18:01:04.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.949+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HAhueaPOaPYYgGdPkEDLlfEhr8n3v1w_0 2024-09-12T18:01:04.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5577080151787145563', time=2024-09-12T19:53:54.696645+0000, chain.objs.size()=1 2024-09-12T18:01:04.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Doj0VQysZ7qzsV84qtETu6DJbd_FEZ5_0 2024-09-12T18:01:04.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.951+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1017392843889126210', time=2024-09-12T19:53:54.733705+0000, chain.objs.size()=1 2024-09-12T18:01:04.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.951+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zCrRp6QgfyS_rRP3iuZy1kedqP-v1P8_0 2024-09-12T18:01:04.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3453730177363939437', time=2024-09-12T19:53:54.875738+0000, chain.objs.size()=1 2024-09-12T18:01:04.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RC8mcZB8SH4XUyhbC-_giyUzgrV-DpP_0 2024-09-12T18:01:04.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13832135311460648423', time=2024-09-12T19:53:55.067181+0000, chain.objs.size()=1 2024-09-12T18:01:04.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3AIchE42Sx54bJNNndTU8Wn-iqhmByS_0 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12930023364968768976', time=2024-09-12T19:53:55.089907+0000, chain.objs.size()=1 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.MnRJtNVlKvOuaUQBj3ydbAu_16z1GKD_0 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5017059544910466689', time=2024-09-12T19:53:55.091534+0000, chain.objs.size()=1 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.S3aGJMiuiaAykQ2-vtQ-EiMDbPngMmw_0 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13200908326944119307', time=2024-09-12T19:53:55.133500+0000, chain.objs.size()=1 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LG8siNDpBmRjvLlWDD9aPODqfHSeRQi_0 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16529155059893051984', time=2024-09-12T19:53:55.178038+0000, chain.objs.size()=1 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.952+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3qNCMifyFbB4w1KYIBcXwGLLqYSfjk7_0 2024-09-12T18:01:04.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.953+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17147252628221717123', time=2024-09-12T19:53:55.259673+0000, chain.objs.size()=1 2024-09-12T18:01:04.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.953+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.m38VRiINvf8eWXmreVPnzgn7vfJu-oX_0 2024-09-12T18:01:04.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.953+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6420535657452268066', time=2024-09-12T19:53:55.276057+0000, chain.objs.size()=1 2024-09-12T18:01:04.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.953+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.UebJuH90gC_lZfs0wfkgYGOSA9-vy_k_0 2024-09-12T18:01:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.955+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16687293570145930158', time=2024-09-12T19:53:55.324520+0000, chain.objs.size()=1 2024-09-12T18:01:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.955+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.sg4Ak9NfwKIEcN0mAmRvelqK9GYN04X_0 2024-09-12T18:01:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.955+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3351541544396719751', time=2024-09-12T19:53:55.344684+0000, chain.objs.size()=1 2024-09-12T18:01:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.955+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QRr_yKL2uFxNOVlm9IB9p1ILLMwBELv_0 2024-09-12T18:01:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.955+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13662631148617060538', time=2024-09-12T19:53:55.364137+0000, chain.objs.size()=1 2024-09-12T18:01:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.955+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aJsmj4p27tNj60DP1AXz8evjCT4hSqz_0 2024-09-12T18:01:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.956+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14346160976972213808', time=2024-09-12T19:53:55.502352+0000, chain.objs.size()=1 2024-09-12T18:01:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.956+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.egeOVp3JZpxWvo3RZQ99ySbOOKEemhf_0 2024-09-12T18:01:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9487710927819026765', time=2024-09-12T19:53:55.538421+0000, chain.objs.size()=1 2024-09-12T18:01:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.8cCqpqAycyrQmu_MRetplOwdhMNnw6b_0 2024-09-12T18:01:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1956010556461373472', time=2024-09-12T19:53:55.615553+0000, chain.objs.size()=1 2024-09-12T18:01:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.u5MxEwTYlp6rrBCrTs46C2mVL4Adfqq_0 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11179317837587623966', time=2024-09-12T19:53:55.791789+0000, chain.objs.size()=1 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CVCcT045oz2NBCMYXftT3pbvW8979lf_0 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9494809655924390102', time=2024-09-12T19:53:55.931441+0000, chain.objs.size()=1 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FCpj1a7u7lWIpPYRnWnBacTfjKT3UjX_0 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13646540082341772600', time=2024-09-12T19:53:55.979415+0000, chain.objs.size()=1 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CIcKMGFp_14ptaCfjBSllOiIvWN179U_0 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12216833198812679426', time=2024-09-12T19:53:56.002375+0000, chain.objs.size()=1 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LBwC-SsW3QRpH2ncJe7Ul97DTt2CMGI_0 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12565495264891831520', time=2024-09-12T19:53:56.185614+0000, chain.objs.size()=1 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.KOhuMkVZe5EJQj6z9cXjGrR3bPABWBu_0 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3416228915973528524', time=2024-09-12T19:53:59.982868+0000, chain.objs.size()=1 2024-09-12T18:01:04.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.958+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.345__shadow_.PvxCNvZn1galxIsrt4A1Z1Kr7IsBU0s_0 2024-09-12T18:01:04.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.962+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1434553283094226127', time=2024-09-12T19:54:04.253354+0000, chain.objs.size()=1 2024-09-12T18:01:04.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.962+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.372__shadow_.Kj2zTsa2Fp2d9-VmU7DfTqDYx_2tWmN_0 2024-09-12T18:01:04.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.962+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6085025536988232372', time=2024-09-12T19:54:40.817468+0000, chain.objs.size()=2 2024-09-12T18:01:04.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.962+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.518__shadow_.hSF7EP8fClaCpQiVqShNA5Y-viR2s5B_0 2024-09-12T18:01:04.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.962+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.518__shadow_.hSF7EP8fClaCpQiVqShNA5Y-viR2s5B_1 2024-09-12T18:01:04.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.963+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8803826626596566344', time=2024-09-12T19:55:24.846999+0000, chain.objs.size()=1 2024-09-12T18:01:04.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.963+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.557__shadow_.w8OJw4XWTQbJSOBjcH1oZa7OjtQlPdl_0 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7948364598370530346', time=2024-09-12T19:55:40.043075+0000, chain.objs.size()=1 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.573__shadow:eyl-FU6HAbg27Gh-Fc7oKnRK2oMUbE0_.rSKB4cNXT-kA3_Qw9ESD_95q4XFPjEg_0 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4146821384264069147', time=2024-09-12T19:58:21.420929+0000, chain.objs.size()=1 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.637__shadow_.2h3EPTuGqe7o_SxNUkcfZ7ntgMVybEH_0 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12942653785803839808', time=2024-09-12T19:58:37.995721+0000, chain.objs.size()=1 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.703__multipart_file1.2~3xW6Jkw_8pJ90CA1PGhifpxMiud9M4m.1 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15535950529375257971', time=2024-09-12T19:59:08.084251+0000, chain.objs.size()=1 2024-09-12T18:01:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.965+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.745__shadow_.Wh6iRdI5PvbL3fIoZwQxwXKQ0C2O3ab_0 2024-09-12T18:01:04.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.970+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:04.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.973+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:01:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.974+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:04.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.974+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:04.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46415' 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17161482221776706136', time=2024-09-12T19:53:06.563963+0000, chain.objs.size()=1 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.232__shadow_.5AEmM9Ba3hNMeJORHX5BjerBilpcPTS_0 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14611734354276803685', time=2024-09-12T19:53:07.002791+0000, chain.objs.size()=1 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.234__shadow_.C4Ra-Iu10wEfhPpILNF3Lrh2yVapUEo_0 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16210738025120740346', time=2024-09-12T19:53:08.771521+0000, chain.objs.size()=1 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.242__shadow_.fpxzjPHiE_5VL7lPH-giOqTEM-QQA0m_0 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9803564072537852714', time=2024-09-12T19:53:10.351293+0000, chain.objs.size()=1 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.249__shadow_.Mhebnu7Bwjr33ohreVBbfFUNCLz9jvU_0 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12474615684993348665', time=2024-09-12T19:53:10.553931+0000, chain.objs.size()=1 2024-09-12T18:01:04.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.250__shadow_.KxtpIWo4um1pwespI4IqErICD7DdfAd_0 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6670360700963883799', time=2024-09-12T19:53:21.165095+0000, chain.objs.size()=1 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.o6M0a7mkGaXyb6l1BYHZtx450KFKMgE_0 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15702505776809108185', time=2024-09-12T19:53:21.183126+0000, chain.objs.size()=1 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Qxc5xV_3UeHrhOxYZWyQ0_CUsHuruGQ_0 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14650402657608477854', time=2024-09-12T19:53:21.224211+0000, chain.objs.size()=1 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.18UFShXn8r-yD00KZRJbw8tUMRXJIap_0 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7152705647363176530', time=2024-09-12T19:53:21.412907+0000, chain.objs.size()=1 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ES2OInoi4gtArwYREAJsaMwnd69GpsW_0 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1098428432035483759', time=2024-09-12T19:53:21.489934+0000, chain.objs.size()=1 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bxVMxdPHZt1HLLVrzQZ0rYl_0KmDsCw_0 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4180993165246964900', time=2024-09-12T19:53:21.593176+0000, chain.objs.size()=1 2024-09-12T18:01:04.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jxA7c9u_DEnnQ_dWqFvIBmTqWPrE3Js_0 2024-09-12T18:01:04.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.163350014960044275', time=2024-09-12T19:53:21.832713+0000, chain.objs.size()=1 2024-09-12T18:01:04.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.975+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.c_WbLZhdDgY-22ajKxaw-7tkfm0vkLM_0 2024-09-12T18:01:04.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7411717287640711144', time=2024-09-12T19:53:21.846948+0000, chain.objs.size()=1 2024-09-12T18:01:04.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HRNF0jUa_tN2l7Tqo16KosQgFfnkKsY_0 2024-09-12T18:01:04.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.978+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.723607662936742095', time=2024-09-12T19:53:21.856224+0000, chain.objs.size()=1 2024-09-12T18:01:04.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.978+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jy3dm5DnzgiTSZQhEChZ_-B_yVKtKFd_0 2024-09-12T18:01:04.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17578767628328167029', time=2024-09-12T19:53:21.890773+0000, chain.objs.size()=1 2024-09-12T18:01:04.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7EKhYv7m_S0epRHXGC9HWRieNZ5yOTj_0 2024-09-12T18:01:04.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11059953882546333042', time=2024-09-12T19:53:21.995082+0000, chain.objs.size()=1 2024-09-12T18:01:04.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lInRBac7bq53GDeRjr-ketHyQmb0fqA_0 2024-09-12T18:01:04.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14810458441233408899', time=2024-09-12T19:53:22.001388+0000, chain.objs.size()=1 2024-09-12T18:01:04.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.j_5oUGawaUrlfYKQmvo5VIMNfnhhccX_0 2024-09-12T18:01:04.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1409510116365001449', time=2024-09-12T19:53:22.027068+0000, chain.objs.size()=1 2024-09-12T18:01:04.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.hdLMEintfqhDuh45idI2zT6qzi0F_8q_0 2024-09-12T18:01:04.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11873920128886590250', time=2024-09-12T19:53:22.097456+0000, chain.objs.size()=1 2024-09-12T18:01:04.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.979+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YfWNaaHc2Wu4kG-cdYxnazWCiPzRbcp_0 2024-09-12T18:01:04.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.981+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8425978659254073800', time=2024-09-12T19:53:22.182720+0000, chain.objs.size()=1 2024-09-12T18:01:04.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.981+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.adwkkWJxPkaelrf5VsBC6hBokUayUWv_0 2024-09-12T18:01:04.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.981+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3228528554437972296', time=2024-09-12T19:53:22.207545+0000, chain.objs.size()=1 2024-09-12T18:01:04.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.981+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jJqaWMByZkDUwEGbMwPw5-CAcgU6EYb_0 2024-09-12T18:01:04.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4463198267835907707', time=2024-09-12T19:53:22.214837+0000, chain.objs.size()=1 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QPtJ0b-y01wh-yzn-sg0R2SPjkXN_z7_0 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6583747742753200251', time=2024-09-12T19:53:22.227751+0000, chain.objs.size()=1 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QLyM7ZJX4jUHQci6mA8F7EQ_PB5Ktnh_0 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7247681189235908817', time=2024-09-12T19:53:22.239425+0000, chain.objs.size()=1 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Ka0uLFJ8slTxVjB5S7z89pHSy5hnfz0_0 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5486500221216905222', time=2024-09-12T19:53:22.244810+0000, chain.objs.size()=1 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qP9fcFGDyMwFwYxQmtrHseMSfr9WKDT_0 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13748410698409408875', time=2024-09-12T19:53:22.261894+0000, chain.objs.size()=1 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.983+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EIIVwccLJdsqkNP3eWVu_T-QDH030tH_0 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3677584772040693292', time=2024-09-12T19:53:22.296731+0000, chain.objs.size()=1 2024-09-12T18:01:04.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.n6rBJMSvaKJgunJSBInjqf7u_i8CxHx_0 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7285895085766695480', time=2024-09-12T19:53:22.382597+0000, chain.objs.size()=1 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XziGNivHsfqwSzAvu05dRelqbmmbEcE_0 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16726291147574579170', time=2024-09-12T19:53:22.386764+0000, chain.objs.size()=1 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4xmvrKyscfK5bJ9qouck0TcaxD2c-rs_0 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14271902339758342982', time=2024-09-12T19:53:22.458980+0000, chain.objs.size()=1 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.72rSfADDxeHCFessJDm0rqk16Lf1bmN_0 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1225903715333289263', time=2024-09-12T19:53:22.627009+0000, chain.objs.size()=1 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.984+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.h6PCtSF2bHne2KN-BW5wpOBcHCaEBr9_0 2024-09-12T18:01:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.985+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4727688890444547738', time=2024-09-12T19:53:22.642960+0000, chain.objs.size()=1 2024-09-12T18:01:04.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.985+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-xQPBUwSOnhTHGyfaz5T-5dcIfiNqx6_0 2024-09-12T18:01:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.988+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17321229843381632587', time=2024-09-12T19:53:22.658076+0000, chain.objs.size()=1 2024-09-12T18:01:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.988+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XlY_2qBczBu-97eWDiXYIiRPTwVS2r5_0 2024-09-12T18:01:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.988+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11490700479073160047', time=2024-09-12T19:53:22.674732+0000, chain.objs.size()=1 2024-09-12T18:01:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.988+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HOsLFCFe7BMXkx8RWrwmHtIXpr7GaAx_0 2024-09-12T18:01:04.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.988+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17276328477967251611', time=2024-09-12T19:53:22.680200+0000, chain.objs.size()=1 2024-09-12T18:01:04.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.988+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.djNU9wf5-O-cThiu3RxIbqPHBNd9EwA_0 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17883877861227696437', time=2024-09-12T19:53:26.117683+0000, chain.objs.size()=1 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.280__shadow_.R0UkN7jo3iutOYkQlJn6v-A3Jp1KHKi_0 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1624070208820574532', time=2024-09-12T19:53:26.322339+0000, chain.objs.size()=1 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.281__shadow_.Mzis0LmMq7bnq4I5TBwNoycN9UXCHlM_0 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7228192639803744215', time=2024-09-12T19:53:26.568668+0000, chain.objs.size()=1 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.282__shadow_.yYPwVrJakzlHQBIR5lwQxREzrOAXuv0_0 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13761746562405821554', time=2024-09-12T19:53:28.134943+0000, chain.objs.size()=1 2024-09-12T18:01:04.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.289__shadow_.OEKnnq9R_4RDZQZspHQAt2lC_Y1QSOY_0 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9901617618220052955', time=2024-09-12T19:53:32.394269+0000, chain.objs.size()=1 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.305__shadow_.EVzwdhX36ASEst4tXzqUPCUe1OO6pbz_0 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15403638574689388410', time=2024-09-12T19:53:33.007556+0000, chain.objs.size()=1 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.307__shadow_.zMvIGuxMUixN9pZPqiPMLaTe0mwXH2H_0 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6637860723313760752', time=2024-09-12T19:53:44.589118+0000, chain.objs.size()=1 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.P0Ex7RtSXHj37MZK_n-w1cGtNfdJAGt_0 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15780377452537859162', time=2024-09-12T19:53:44.605904+0000, chain.objs.size()=1 2024-09-12T18:01:04.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.991+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5YMsv279c5eSg0k2M5_h48EnxeC7xmZ_0 2024-09-12T18:01:04.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.992+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7562355766378557065', time=2024-09-12T19:53:44.613782+0000, chain.objs.size()=1 2024-09-12T18:01:04.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.992+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ivNetyzj9zhl6bmi9P6-osvUPwzW5hr_0 2024-09-12T18:01:04.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.993+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.62952880558329350', time=2024-09-12T19:53:44.638162+0000, chain.objs.size()=1 2024-09-12T18:01:04.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.993+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BiaE2KuqloSEp0gRxFWhyRyhsMJolUo_0 2024-09-12T18:01:04.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.994+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17437038162595168856', time=2024-09-12T19:53:44.924644+0000, chain.objs.size()=1 2024-09-12T18:01:04.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.994+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0a8Pc_o7AdBxFmeHRhg-kwGdDAZHdyH_0 2024-09-12T18:01:04.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.996+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15853481131795549375', time=2024-09-12T19:53:44.947809+0000, chain.objs.size()=1 2024-09-12T18:01:04.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.996+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7wAqswgJhXknHoG_vOCDoQy_l1TH0bl_0 2024-09-12T18:01:04.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.996+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1520341556033397744', time=2024-09-12T19:53:44.970835+0000, chain.objs.size()=1 2024-09-12T18:01:04.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.996+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XnbTQMfruVmdR1f2ppqS_0gmn_NvnR7_0 2024-09-12T18:01:04.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3292103168589968747', time=2024-09-12T19:53:45.012369+0000, chain.objs.size()=1 2024-09-12T18:01:04.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FlCE3S9dFjyDoLwZj1HvZcyDjGDJb0H_0 2024-09-12T18:01:04.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5472987549213162535', time=2024-09-12T19:53:45.013042+0000, chain.objs.size()=1 2024-09-12T18:01:04.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ikPmz5NUfrzWqXqCotxhe20UNIiUueD_0 2024-09-12T18:01:04.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7288339993557582704', time=2024-09-12T19:53:45.182229+0000, chain.objs.size()=1 2024-09-12T18:01:04.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oYuuATec-YCQnU8SldNTHOdZWhcyMjr_0 2024-09-12T18:01:04.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14389883130560281183', time=2024-09-12T19:53:45.225326+0000, chain.objs.size()=1 2024-09-12T18:01:04.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.997+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.xn1qH6eIsWUqiWZQM-ln9EPirQT2gD1_0 2024-09-12T18:01:04.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5733229621350332059', time=2024-09-12T19:53:45.433172+0000, chain.objs.size()=1 2024-09-12T18:01:04.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wq0K9tynpTPUritUcWU4VqTdBAuSzSs_0 2024-09-12T18:01:04.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6402267867537681256', time=2024-09-12T19:53:45.551531+0000, chain.objs.size()=1 2024-09-12T18:01:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.g4ongufYFwbucHFT6IDUbUsx2hJOtfx_0 2024-09-12T18:01:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2195385886390557560', time=2024-09-12T19:53:45.608950+0000, chain.objs.size()=1 2024-09-12T18:01:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.B-ZBlfsuVNqAUiQ6596sSLSrpNNhe16_0 2024-09-12T18:01:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1334459938401610294', time=2024-09-12T19:53:45.633354+0000, chain.objs.size()=1 2024-09-12T18:01:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.998+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1vvpAuD4le8e2uI4sL9LpUQo8_1UxqH_0 2024-09-12T18:01:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.999+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14846969563179906496', time=2024-09-12T19:53:45.659514+0000, chain.objs.size()=1 2024-09-12T18:01:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:04.999+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Xo1cCuzniCi3I08KGH9kropLYS9QS-Q_0 2024-09-12T18:01:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.001+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10502827878645418210', time=2024-09-12T19:53:45.942432+0000, chain.objs.size()=1 2024-09-12T18:01:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.001+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3gmrqnxdXK6Bj5d6v4HPf9rPexgdtD2_0 2024-09-12T18:01:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.001+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4290604807477969541', time=2024-09-12T19:53:46.024991+0000, chain.objs.size()=1 2024-09-12T18:01:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.001+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.T44zO-knAvAQgBnMkcHKG-eDUSMhH06_0 2024-09-12T18:01:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.001+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11350995315987275006', time=2024-09-12T19:53:46.140835+0000, chain.objs.size()=1 2024-09-12T18:01:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.001+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6J_IIsqqJfpAgRgYyJIU0iv3A9qEm3k_0 2024-09-12T18:01:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3196506923923769993', time=2024-09-12T19:53:46.148575+0000, chain.objs.size()=1 2024-09-12T18:01:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.timO-M5umMCPGnTYSj66CrKCHSu-Ytr_0 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1223568617830582547', time=2024-09-12T19:53:46.158783+0000, chain.objs.size()=1 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YL4lQgEDYbzoHAwQ4geC4GIktqsGFkn_0 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6905320623931416993', time=2024-09-12T19:53:46.176541+0000, chain.objs.size()=1 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.QjYrDTlmMKlJiBtq4Y-uIus9KzUn2i5_0 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4127966882193202760', time=2024-09-12T19:53:46.213684+0000, chain.objs.size()=1 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JJpNpiOp19qq02g1uKwwmkGVpI_eC5b_0 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1566671148836637195', time=2024-09-12T19:53:46.214971+0000, chain.objs.size()=1 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.sW74zsl34qmuDmTBEl78Yu7OO_r2Klq_0 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4534018155524197021', time=2024-09-12T19:53:46.228116+0000, chain.objs.size()=1 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.002+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._BhJbYSn_gHP7ImSmT_C3IXz0CXmMlb_0 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.003+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6342848900840041272', time=2024-09-12T19:53:54.648935+0000, chain.objs.size()=1 2024-09-12T18:01:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.003+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YN6joPgElnm8uCpFX1lE178jabVW8E5_0 2024-09-12T18:01:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.003+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3563850813709863197', time=2024-09-12T19:53:54.657567+0000, chain.objs.size()=1 2024-09-12T18:01:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.003+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BwtrvoXUmfT6asbOuKaK_r1Ev50Nx6A_0 2024-09-12T18:01:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.006+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13305312025023742533', time=2024-09-12T19:53:54.663598+0000, chain.objs.size()=1 2024-09-12T18:01:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.006+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vw3ek_lqoOoUBOccEmRsKdfGXkVgq6Y_0 2024-09-12T18:01:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.006+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7972202355915398470', time=2024-09-12T19:53:54.688624+0000, chain.objs.size()=1 2024-09-12T18:01:05.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.006+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.eLc_4HtCF557SCy5qZ7m0G_itA_Os91_0 2024-09-12T18:01:05.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.006+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6845685341660613160', time=2024-09-12T19:53:54.715963+0000, chain.objs.size()=1 2024-09-12T18:01:05.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.006+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.A8AuQJqyMZ7brYHe30pKOWuVRnCopzV_0 2024-09-12T18:01:05.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.007+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10363050570281831440', time=2024-09-12T19:53:54.859423+0000, chain.objs.size()=1 2024-09-12T18:01:05.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.007+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yfiLGgFmadX8xskhzWoqQw12H-gSUdl_0 2024-09-12T18:01:05.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.008+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4979812068681089957', time=2024-09-12T19:53:54.866338+0000, chain.objs.size()=1 2024-09-12T18:01:05.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.008+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.r5QnuGsmGRJJ1Qh9-kPv7zRlTEx8p_n_0 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8198945843364211840', time=2024-09-12T19:53:54.895164+0000, chain.objs.size()=1 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zWpfpu-zFDUVZ0DBOGMNm73cm3VvtYv_0 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15186994526319101955', time=2024-09-12T19:53:54.964848+0000, chain.objs.size()=1 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NFpHIb0KwcdwEhlXCuDl5s4ziE6V1Q9_0 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4224711195634145709', time=2024-09-12T19:53:55.076748+0000, chain.objs.size()=1 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.0WS9668LsV3Q0Q8MykW7VUCWsB01Psz_0 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.430060515229569406', time=2024-09-12T19:53:55.081121+0000, chain.objs.size()=1 2024-09-12T18:01:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.012+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nc-ccj4CieNWnCkM5KyjJWcKXjuXwHf_0 2024-09-12T18:01:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10568123723000613615', time=2024-09-12T19:53:55.090866+0000, chain.objs.size()=1 2024-09-12T18:01:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.64u9-a1xPNjJGUbSeDBNTd9kX0kVRfA_0 2024-09-12T18:01:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.014+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10624304106542412570', time=2024-09-12T19:53:55.159204+0000, chain.objs.size()=1 2024-09-12T18:01:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.014+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.e-k1ub_mEeyEd_E7_YNh8Mv1x7jUIiS_0 2024-09-12T18:01:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10632849644358054191', time=2024-09-12T19:53:55.161702+0000, chain.objs.size()=1 2024-09-12T18:01:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.U7wGulnXjfUrUZfafC68e16CNrTqt4I_0 2024-09-12T18:01:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3016712490816400707', time=2024-09-12T19:53:55.301876+0000, chain.objs.size()=1 2024-09-12T18:01:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1-vAtc3EuJE4-4sIQLSlvjJIDU9FHRA_0 2024-09-12T18:01:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9024435815508523183', time=2024-09-12T19:53:55.311449+0000, chain.objs.size()=1 2024-09-12T18:01:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.X843BnhBS3r8S6LXk9peH3w_tTj5BNy_0 2024-09-12T18:01:05.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.671221474605537012', time=2024-09-12T19:53:55.327252+0000, chain.objs.size()=1 2024-09-12T18:01:05.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZCqxvFz3Pd7eNV_9lgxWGIdLc-MQ666_0 2024-09-12T18:01:05.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12439305559117776707', time=2024-09-12T19:53:55.333137+0000, chain.objs.size()=1 2024-09-12T18:01:05.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.016+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.v3pP7a1Kqq_Vm3tHmy9kvKihnqlaEBs_0 2024-09-12T18:01:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.018+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6068375817797566949', time=2024-09-12T19:53:55.513770+0000, chain.objs.size()=1 2024-09-12T18:01:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.018+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TySd2dSBxGhLJgz8HQHa_oTlahpFk1-_0 2024-09-12T18:01:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.83679137581646820', time=2024-09-12T19:53:55.605852+0000, chain.objs.size()=1 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Ol70x0LWRpzdBEzscUCSmONXdRK45pk_0 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2310363623296337960', time=2024-09-12T19:53:55.722630+0000, chain.objs.size()=1 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GTsjmWz1Ke3_bff2gMeEZ0kl-q1GoRz_0 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6374425189152768182', time=2024-09-12T19:53:55.758818+0000, chain.objs.size()=1 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EEjVH31AqSkSxLiK4xCCK6J61_-Joe8_0 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5694301625083860700', time=2024-09-12T19:53:55.777911+0000, chain.objs.size()=1 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SUp3NW2tzzaOPwUpXxmtg_a3dA6thIj_0 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5941079790657574261', time=2024-09-12T19:53:55.808854+0000, chain.objs.size()=1 2024-09-12T18:01:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.019+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.34yCIWzjEZGiCgDoWNRgHr-kJJjKwD1_0 2024-09-12T18:01:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.020+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8343366874495144717', time=2024-09-12T19:53:55.816592+0000, chain.objs.size()=1 2024-09-12T18:01:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.020+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.v1KucR9J5fCg8I_zUscCRRgcBbP78LZ_0 2024-09-12T18:01:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.021+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12664305441556188122', time=2024-09-12T19:53:55.824643+0000, chain.objs.size()=1 2024-09-12T18:01:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.021+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-ZumgDVUhzyHguen8d1LuQMCLYAwuSl_0 2024-09-12T18:01:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.022+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15921845503040713645', time=2024-09-12T19:53:55.921763+0000, chain.objs.size()=1 2024-09-12T18:01:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.022+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4PiHiawz1QwgSbxi4uqOr02j2QxCyW__0 2024-09-12T18:01:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.022+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2738704439490548207', time=2024-09-12T19:53:55.946851+0000, chain.objs.size()=1 2024-09-12T18:01:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.022+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.GZEyLPvMYaXdAsZjrZ6KTrPNX7eVJyC_0 2024-09-12T18:01:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.023+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12079725246397325628', time=2024-09-12T19:53:55.948512+0000, chain.objs.size()=1 2024-09-12T18:01:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.023+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.T33pbs2Nkq-X77xnmJF0zStoHSD7nIj_0 2024-09-12T18:01:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12099955162378426667', time=2024-09-12T19:53:55.950275+0000, chain.objs.size()=1 2024-09-12T18:01:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9bwPiEZr3QXs4KGdhDGsmMZRZ3GpcBg_0 2024-09-12T18:01:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15575731012454105799', time=2024-09-12T19:53:55.976516+0000, chain.objs.size()=1 2024-09-12T18:01:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HSrz5KmtrWAqOJO2f5CtLIqfgLYkOlB_0 2024-09-12T18:01:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14295601997991563229', time=2024-09-12T19:53:56.192050+0000, chain.objs.size()=1 2024-09-12T18:01:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HDQflYqzTYnxJTI-nAudJMuTkrJOcwf_0 2024-09-12T18:01:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5230301205232841828', time=2024-09-12T19:54:00.163728+0000, chain.objs.size()=1 2024-09-12T18:01:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.346__shadow_.ehPhOQZxdYLc9TwsKjZuVjHjHm6DugY_0 2024-09-12T18:01:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3048918114874415144', time=2024-09-12T19:54:07.738668+0000, chain.objs.size()=1 2024-09-12T18:01:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.024+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.382__shadow_.B5BH6Rp28D9wCSpVHOGQ-dK5Av916sw_0 2024-09-12T18:01:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.030+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/46415 2024-09-12T18:01:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:01:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18076020138470512197', time=2024-09-12T19:54:25.379307+0000, chain.objs.size()=1 2024-09-12T18:01:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.458__shadow_.hTZyT4sG6bg3X968fRC2zh7ZOyc0nkk_0 2024-09-12T18:01:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5667930884312026463', time=2024-09-12T19:54:27.167406+0000, chain.objs.size()=1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.463__shadow_.hpFugfdIcM-m9lpdyqyr-NYgYK50bJx_0 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2126759945295200178', time=2024-09-12T19:54:31.213086+0000, chain.objs.size()=1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.jpvZVsUkkSdyrEB2aL_npwKobzS4g0h_0 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6455823528780645585', time=2024-09-12T19:54:40.932339+0000, chain.objs.size()=1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.519__multipart_mymultipart.2~PSKb-CTDAm10TBmc4_EhqoodwhupCQk.1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~s5pAqaW8oh7utkM4qw91Nd8YzdME1jb', time=2024-09-12T19:54:54.370762+0000, chain.objs.size()=1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.532__multipart_mymultipart2.2~s5pAqaW8oh7utkM4qw91Nd8YzdME1jb.1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10642087306537244959', time=2024-09-12T19:55:32.343087+0000, chain.objs.size()=1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.567__shadow_.0mLQbADUr7h2nfN1cBmp01gfIYW1hrL_0 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1760228390505530508', time=2024-09-12T19:55:33.132579+0000, chain.objs.size()=1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:cbv5rQzKWyGo7Cr2jaxbzA1Fr-GLxN4_.svJBbTujBc73_ufrz-PUw-y8r2JfG5c_0 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16036826680242219751', time=2024-09-12T19:55:36.689245+0000, chain.objs.size()=1 2024-09-12T18:01:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:pbvHN.d29oLoCIlYBj7nHn0c8savBk0_.3Pz33IjNGSxaNOg1NpgOvud6bUWZgqg_0 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17121976610165857302', time=2024-09-12T19:55:38.044511+0000, chain.objs.size()=1 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:yOJrJ2iHwEvSZ.Y9tE50C0IjBvJyrZI_.uO68Rbe-DleDczxrl005YWaru_sUGGn_0 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13804787966940239323', time=2024-09-12T19:55:39.062853+0000, chain.objs.size()=1 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:fpVF4aN.3dUqzAK1vKBkROzWgssa2hB_._rjKKxK-qIXnfIxCzwDdrlfMbZcajiz_0 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6377307693110980022', time=2024-09-12T19:55:39.439690+0000, chain.objs.size()=1 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.571__shadow:fubnyZznTaAq5oKcA-g541w5l3klBwa_.kBtrO1IH-jLY1Ez-euZ52DKbAxirv48_0 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14466470622493058660', time=2024-09-12T19:55:50.135155+0000, chain.objs.size()=1 2024-09-12T18:01:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.032+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:httIBOBHsU6vrQ9DEmxIOmOurvL.r.D_.unElwk16Tkkf0hBwQ26XDfHIenY9beX_0 2024-09-12T18:01:05.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10548075092565270283', time=2024-09-12T19:55:58.695465+0000, chain.objs.size()=1 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:isWKjx.J7fwXnIKT8iC2enxxKqnMX0B_.tHkQH3TValV1uV99uemZJ7j_bpPDGaH_0 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4615182198557668025', time=2024-09-12T19:56:03.762104+0000, chain.objs.size()=1 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.584__shadow:zlJbWaU0Z70xRdhMkDxW-V5GHrQ3hx-_.L-HVXstyJcXGjqvPNaxQSOcKXHDggeL_0 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12709623937458576624', time=2024-09-12T19:56:05.262458+0000, chain.objs.size()=1 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:YfyJ191IArhEZtrrUHrsEhOpLga7qFp_.aVnZeZNKUfkM-2ZVkd7fCwPTTcive_r_0 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.542649211568747377', time=2024-09-12T19:58:16.314848+0000, chain.objs.size()=1 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.038+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.621__shadow_.QQ6rowEGdahw5Wt8UeXVULYnTqNurVX_0 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.039+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1750814652616681011', time=2024-09-12T19:58:25.688976+0000, chain.objs.size()=1 2024-09-12T18:01:05.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.039+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.653__shadow_.K42Wa9arFFqxr3HZrGEuqjDEB0uGyqe_0 2024-09-12T18:01:05.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.042+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:05.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.045+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:01:05.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.046+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.047+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:05.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45312' 2024-09-12T18:01:05.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15140562733969287428', time=2024-09-12T19:52:02.081641+0000, chain.objs.size()=1 2024-09-12T18:01:05.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.172__shadow_.hFcPA8324TvNLWA2n67otwifznqW0X0_0 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9293043112733298637', time=2024-09-12T19:52:11.789552+0000, chain.objs.size()=1 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.180__shadow_.1yhonmWdXtxXbilaZDP7t8lBUnZkoKQ_0 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5994349943862812693', time=2024-09-12T19:53:07.652229+0000, chain.objs.size()=1 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.237__shadow_.ohhpMUHOCBlXj_Wh0TIIrsGLyVDEvWu_0 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5135281079103204808', time=2024-09-12T19:53:08.172016+0000, chain.objs.size()=1 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.239__shadow_.AyT4CS-RxzR-fMJtHU8FP9q9iWGcB7C_0 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14421908366727727267', time=2024-09-12T19:53:12.231459+0000, chain.objs.size()=1 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.258__shadow_.kRqWhDWGSS2KqKNU3Xc1EGcsDPJfHpQ_0 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17297324450309997228', time=2024-09-12T19:53:21.169236+0000, chain.objs.size()=1 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9WZZKrGxH6cjpsYVoIQTV8Z5E8nmU60_0 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13059967640275058905', time=2024-09-12T19:53:21.268803+0000, chain.objs.size()=1 2024-09-12T18:01:05.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.RPWZUnXdBrQu_aypIvjptOjShXwiMvq_0 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18154402455447012938', time=2024-09-12T19:53:21.364916+0000, chain.objs.size()=1 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zDkWqdbYRw0ssHwAODpRiGaaac3N82v_0 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17492156959352966379', time=2024-09-12T19:53:21.385391+0000, chain.objs.size()=1 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CbNvz7rkAX1hACqZvOEKH2ijegRmDZP_0 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16656683981309688875', time=2024-09-12T19:53:21.572062+0000, chain.objs.size()=1 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.SGGx85R0gfXQunm_heam7ydI_ydazrU_0 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8542313987963812599', time=2024-09-12T19:53:21.597202+0000, chain.objs.size()=1 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bD8KiNbdQQr5GjHasnU2XkJSdZjIqeW_0 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9210988438984404978', time=2024-09-12T19:53:21.610972+0000, chain.objs.size()=1 2024-09-12T18:01:05.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.048+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.XTBKlsbahYiXPoFo4mshPwkIzEjC8VF_0 2024-09-12T18:01:05.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.051+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15610840924714944114', time=2024-09-12T19:53:21.639658+0000, chain.objs.size()=1 2024-09-12T18:01:05.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.051+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.c9X8pONJSjN23VvUPhSYfWCWJGoUo2S_0 2024-09-12T18:01:05.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10728813921209420338', time=2024-09-12T19:53:21.651067+0000, chain.objs.size()=1 2024-09-12T18:01:05.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zCC9S_dYso55-KTNum4O4aXTqUC53QO_0 2024-09-12T18:01:05.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9764490875175752213', time=2024-09-12T19:53:21.651891+0000, chain.objs.size()=1 2024-09-12T18:01:05.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Wu_avhJYAILfzmn02tisk-7Z8bzW2nf_0 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4121296960535809910', time=2024-09-12T19:53:21.653123+0000, chain.objs.size()=1 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Rgulwy2qlEUMDDgai2H7Ce-xKGywTdq_0 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9773990933992793692', time=2024-09-12T19:53:21.657426+0000, chain.objs.size()=1 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YL6VyHgeWBRYsBO7__3l_4JjlBxP-mp_0 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16696185684469713249', time=2024-09-12T19:53:21.666573+0000, chain.objs.size()=1 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.s7FDOELUeUglDSKRyKyTRqidJwJvD4c_0 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.342210162962782322', time=2024-09-12T19:53:21.675389+0000, chain.objs.size()=1 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Z020WguMhNP-jvuKvbslhmrLJudcbV3_0 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9103751350281946828', time=2024-09-12T19:53:21.777524+0000, chain.objs.size()=1 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.wi9tlCO10xLzyvOPAvg7u-e98KbeSg1_0 2024-09-12T18:01:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6987003011296729059', time=2024-09-12T19:53:21.788375+0000, chain.objs.size()=1 2024-09-12T18:01:05.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bfi8ajPJurFdVJnMWr_GD4Jgk10NCmg_0 2024-09-12T18:01:05.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2816644493781223157', time=2024-09-12T19:53:21.798966+0000, chain.objs.size()=1 2024-09-12T18:01:05.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Msys8iO8OuadYcmgFDlmcHk6vnrrNY1_0 2024-09-12T18:01:05.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.052+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14148423423806278129', time=2024-09-12T19:53:21.825170+0000, chain.objs.size()=1 2024-09-12T18:01:05.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.053+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Qc5w_Hq7K2_IaThVjhjU0fmny-Xg0cq_0 2024-09-12T18:01:05.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.055+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14962546270174585809', time=2024-09-12T19:53:21.842416+0000, chain.objs.size()=1 2024-09-12T18:01:05.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.055+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WdtAktvkpyPBlhIDcahDW1MgM4Ux47h_0 2024-09-12T18:01:05.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.056+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18227273768713170386', time=2024-09-12T19:53:21.869575+0000, chain.objs.size()=1 2024-09-12T18:01:05.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.056+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.iS2otbMhYi6ezQ4xoMmkriZfI1-Tnll_0 2024-09-12T18:01:05.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.057+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5219595307731353195', time=2024-09-12T19:53:21.887394+0000, chain.objs.size()=1 2024-09-12T18:01:05.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.057+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tw2r1flKO0UEz666_Gp0EmFEE2NVysJ_0 2024-09-12T18:01:05.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8609817892284917052', time=2024-09-12T19:53:21.980809+0000, chain.objs.size()=1 2024-09-12T18:01:05.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.dO1nPbxLrRtfk0_NlBQ9Vos9F2p52km_0 2024-09-12T18:01:05.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10450524701944240648', time=2024-09-12T19:53:21.981504+0000, chain.objs.size()=1 2024-09-12T18:01:05.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.9XUKHnJZTBDtBrHiBXNEeATsmUp7IIc_0 2024-09-12T18:01:05.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16397750922368730437', time=2024-09-12T19:53:22.012179+0000, chain.objs.size()=1 2024-09-12T18:01:05.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0MJk6gaHspxaO6dqsV8aUGofeDUk26i_0 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17609142931307487371', time=2024-09-12T19:53:22.027669+0000, chain.objs.size()=1 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_._Z95Z7x_CW7-3vs6s087rRWQeRCfgmW_0 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1060169038560083032', time=2024-09-12T19:53:22.048589+0000, chain.objs.size()=1 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6iEESpZoY2x06nkIEx6OOfS-aY4_adw_0 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18287247335992833044', time=2024-09-12T19:53:22.051790+0000, chain.objs.size()=1 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.mxs9c5cZ9FDNMlqLXWPdbpVKeANtDQt_0 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1735764870656111843', time=2024-09-12T19:53:22.104543+0000, chain.objs.size()=1 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aSdKfuuCpfs7Vn5nharJRaaXL4lUizF_0 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4835101902384149260', time=2024-09-12T19:53:22.248053+0000, chain.objs.size()=1 2024-09-12T18:01:05.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.059+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3lkqZEXRqmZRp3UJe-31wcdRox8TYI7_0 2024-09-12T18:01:05.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.061+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3413562285203353603', time=2024-09-12T19:53:22.277627+0000, chain.objs.size()=1 2024-09-12T18:01:05.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.061+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.GuYsoS4PsQ1MlcEcnW0Q1ugwlnDZzw9_0 2024-09-12T18:01:05.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.061+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13953847126599855049', time=2024-09-12T19:53:22.402107+0000, chain.objs.size()=1 2024-09-12T18:01:05.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.061+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.P_iz6tyGwyDvceUvjke5ck99Nb1I16C_0 2024-09-12T18:01:05.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.062+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13071068639204908190', time=2024-09-12T19:53:22.442500+0000, chain.objs.size()=1 2024-09-12T18:01:05.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.062+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ICVQ4v5V84_k3ukeDopmw3Ti-2Og5GF_0 2024-09-12T18:01:05.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8312823568260385279', time=2024-09-12T19:53:22.459324+0000, chain.objs.size()=1 2024-09-12T18:01:05.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HInv9OgHn9quTxkMCEnDggJitkBwt92_0 2024-09-12T18:01:05.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.063+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17571493964835902312', time=2024-09-12T19:53:22.503494+0000, chain.objs.size()=1 2024-09-12T18:01:05.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.063+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tCx8K_2_2z4YUMJ7mhfnLlVk2X3sthI_0 2024-09-12T18:01:05.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.064+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10996204704524979968', time=2024-09-12T19:53:22.583091+0000, chain.objs.size()=1 2024-09-12T18:01:05.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.064+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Rv0fgJYrgRPL0mZM4Ep64iOtVLyROZD_0 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14605319248580696068', time=2024-09-12T19:53:22.595743+0000, chain.objs.size()=1 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.w38UXPvbc4Qx7JIbyF4gJjDMpM2wePl_0 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16285519464877426275', time=2024-09-12T19:53:22.638052+0000, chain.objs.size()=1 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.NMhc0eJFyzoYlNYS0gebeFNsd1fexpv_0 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4808475639123397559', time=2024-09-12T19:53:22.847831+0000, chain.objs.size()=1 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.264__shadow_.o7kQpUjnJcmq9LCv9DGy5VXaUeYXwPC_0 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12937521197443337357', time=2024-09-12T19:53:23.871233+0000, chain.objs.size()=1 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.269__shadow_.pheIZo5OLvalNm_GCxvGBsxCGj-5gfJ_0 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17976488672238971061', time=2024-09-12T19:53:26.980661+0000, chain.objs.size()=1 2024-09-12T18:01:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.065+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.284__shadow_.dXFKAGZxfFEEpiKSeoM6Dhabie8DfwX_0 2024-09-12T18:01:05.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.066+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.447517093290469601', time=2024-09-12T19:53:29.345063+0000, chain.objs.size()=1 2024-09-12T18:01:05.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.066+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.j1fhCPSwWMHjjX6GNxUZj8bDDgwg4gS_0 2024-09-12T18:01:05.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.066+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9051556903676188303', time=2024-09-12T19:53:29.351621+0000, chain.objs.size()=1 2024-09-12T18:01:05.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.066+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_._AWvTZSsHmOb3K_yjTZ9jl-q2Gd0Bf__0 2024-09-12T18:01:05.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.066+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16338335466834331108', time=2024-09-12T19:53:29.943251+0000, chain.objs.size()=1 2024-09-12T18:01:05.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.066+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.2FkwY1GmPjP7OPyMbL_mQC5aOx4EPm-_0 2024-09-12T18:01:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.069+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11703965347432930757', time=2024-09-12T19:53:30.139192+0000, chain.objs.size()=1 2024-09-12T18:01:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.069+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.295__shadow_.FjDefpih8O2gZVh7xsP0FQ_rUUDH7zy_0 2024-09-12T18:01:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.069+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9811846706905519910', time=2024-09-12T19:53:30.781688+0000, chain.objs.size()=1 2024-09-12T18:01:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.069+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.298__shadow_.qjo2Xo40yzmoEGwqtm7ksC_dhjfobNx_0 2024-09-12T18:01:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.070+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8987421742513414821', time=2024-09-12T19:53:32.185730+0000, chain.objs.size()=1 2024-09-12T18:01:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.070+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.304__shadow_.NpCfTUgK-1yHG7d4rKuRbyY-Ld9hrsK_0 2024-09-12T18:01:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.070+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13104832322086684929', time=2024-09-12T19:53:32.391711+0000, chain.objs.size()=1 2024-09-12T18:01:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.070+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.305__shadow_.GA94LptXco7IEFR0JYCrbgZsxra5Yl9_0 2024-09-12T18:01:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17979660416590712918', time=2024-09-12T19:53:32.392509+0000, chain.objs.size()=1 2024-09-12T18:01:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.305__shadow_.EnPkd9-Uu5uv5rnI_UxhviNJ6ny5KHU_0 2024-09-12T18:01:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2345169939123117953', time=2024-09-12T19:53:35.730502+0000, chain.objs.size()=1 2024-09-12T18:01:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.322__shadow_.1xb4R4n-d5yB6B32HoJXZMybEmqRz8Y_0 2024-09-12T18:01:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4664709801790706782', time=2024-09-12T19:53:44.544552+0000, chain.objs.size()=1 2024-09-12T18:01:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6ZOhRWNiryvT6go9TAwO5HC8vU1qneX_0 2024-09-12T18:01:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8560941765526853058', time=2024-09-12T19:53:44.587751+0000, chain.objs.size()=1 2024-09-12T18:01:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.071+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.PuKuAOwNIdam5zGMXcVLyi2gt1yoTcT_0 2024-09-12T18:01:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.072+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3253867741219640306', time=2024-09-12T19:53:44.970479+0000, chain.objs.size()=1 2024-09-12T18:01:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.072+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.UpD0S7gzCkmIOZsBvBHpLzArQWxk594_0 2024-09-12T18:01:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.072+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15157126553141832851', time=2024-09-12T19:53:45.009996+0000, chain.objs.size()=1 2024-09-12T18:01:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.072+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GKvcFe0CFLxPIge3FasFgTqMa39fEQZ_0 2024-09-12T18:01:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.072+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4529972960460656509', time=2024-09-12T19:53:45.161373+0000, chain.objs.size()=1 2024-09-12T18:01:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.072+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.g6hkWg0nNNR1HDxEATmX788QGm-ts9s_0 2024-09-12T18:01:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.073+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1719794953471396253', time=2024-09-12T19:53:45.170867+0000, chain.objs.size()=1 2024-09-12T18:01:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.073+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.aWSGdt-OGdsk3wrDDPhAp6PMwevEqMC_0 2024-09-12T18:01:05.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.074+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16400723382973434800', time=2024-09-12T19:53:45.183917+0000, chain.objs.size()=1 2024-09-12T18:01:05.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.074+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1wnGFRQL9MtzPoElZtQFPC-OUfHw9sI_0 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12468709268467079035', time=2024-09-12T19:53:45.194534+0000, chain.objs.size()=1 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Fkmm92aiXs4wjoPS8-b0tbqJrq3VAR2_0 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16170588960096609157', time=2024-09-12T19:53:45.202322+0000, chain.objs.size()=1 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.QGKEAbe7JlS74VXiT7sQ8UVSptrJoN0_0 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18152787320356210802', time=2024-09-12T19:53:45.231627+0000, chain.objs.size()=1 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZKiT0hYrtoVwgz9zMW24GF3KVAd3_uT_0 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8220660654976125118', time=2024-09-12T19:53:45.236413+0000, chain.objs.size()=1 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vlrcpdW1_K5nJQEWnXFz6Dh09IgaB5t_0 2024-09-12T18:01:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11282320134854030787', time=2024-09-12T19:53:45.255397+0000, chain.objs.size()=1 2024-09-12T18:01:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.7C2meXVz0daVQmAyZJLuTS6L2vF_fIu_0 2024-09-12T18:01:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12625917234561115096', time=2024-09-12T19:53:45.258507+0000, chain.objs.size()=1 2024-09-12T18:01:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.077+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.2pO6DXsb-MlrLsdEkDCi4-_S0JIcFSq_0 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3002407708975534452', time=2024-09-12T19:53:45.371107+0000, chain.objs.size()=1 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.TB44GuRJw5UfN6v2Nl7xM6eSAy-PQn__0 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3533460188314810700', time=2024-09-12T19:53:45.402782+0000, chain.objs.size()=1 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.KDMcsOoiYaMU9YbxlUbgHCo6_mlRZU6_0 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5476374264802784663', time=2024-09-12T19:53:45.440336+0000, chain.objs.size()=1 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.raJ1qoWj0oT0rTpMaEFTW4JGscUFb6z_0 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8707056074995088641', time=2024-09-12T19:53:45.452788+0000, chain.objs.size()=1 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZKZ3LNM4I0FTRral7QKPMooElZzg9js_0 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5888270637079630851', time=2024-09-12T19:53:45.567837+0000, chain.objs.size()=1 2024-09-12T18:01:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Bglraw_itjchYFiMka8kqaHk7sD_cmA_0 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.245639346083437243', time=2024-09-12T19:53:45.639735+0000, chain.objs.size()=1 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.DRsuDFdxh5fJNuDYZPLfTxa5ukZy30-_0 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4248278980159548132', time=2024-09-12T19:53:45.646873+0000, chain.objs.size()=1 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.llab3OXylIhhuSjKEiCGxWQmCuERtaV_0 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11557264688735975348', time=2024-09-12T19:53:45.759873+0000, chain.objs.size()=1 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dQ3ykuTMqRzz2GUUtMfKiKpoElXTY0S_0 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11465371705521171828', time=2024-09-12T19:53:45.785247+0000, chain.objs.size()=1 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.080+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.htj5fedQeXPsDOdmhyou8N4d2mP1SPW_0 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.081+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1476896279678769271', time=2024-09-12T19:53:45.819958+0000, chain.objs.size()=1 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.081+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.wzB7-S2DA3-ECZR-TAwaBt4C18SL_uP_0 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.081+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8776754413391727857', time=2024-09-12T19:53:45.947968+0000, chain.objs.size()=1 2024-09-12T18:01:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.081+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Sg18Rxaj33EPJz5zcDPp8ASK_xNPG92_0 2024-09-12T18:01:05.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.084+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.257156519863609275', time=2024-09-12T19:53:45.976006+0000, chain.objs.size()=1 2024-09-12T18:01:05.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.084+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.66ISJQNGEMYVN2uXehIcLkQe_gK5XJJ_0 2024-09-12T18:01:05.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5268246619109477172', time=2024-09-12T19:53:46.016023+0000, chain.objs.size()=1 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.jc14RC8idAuX6oJ_YDwW-RxMTDUnulx_0 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10754291119255217652', time=2024-09-12T19:53:46.038042+0000, chain.objs.size()=1 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.rLwUVUFU0Z2GtcUcnjQ4syK2GsQRBBC_0 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2232521716218883275', time=2024-09-12T19:53:46.146172+0000, chain.objs.size()=1 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fef-lgDGe18ZE8zsvhc1mbPBAor1BMO_0 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1666606409578389533', time=2024-09-12T19:53:46.195001+0000, chain.objs.size()=1 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3k4ogn6A5z0Fm48fi-ldT7MTO3IYadZ_0 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13167017007372918513', time=2024-09-12T19:53:46.206159+0000, chain.objs.size()=1 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.U98NzemwF8VfzlhvcTBuMNAqhMhAo_9_0 2024-09-12T18:01:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3038966773869645274', time=2024-09-12T19:53:54.653936+0000, chain.objs.size()=1 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.TI_zW6kXai2QIEHZZ47L-MjOx8DG20Y_0 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2473362629307322579', time=2024-09-12T19:53:54.685144+0000, chain.objs.size()=1 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.9GTmLutzIW2OrsApfJzATYs247sAHc7_0 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7359031205166228711', time=2024-09-12T19:53:54.705795+0000, chain.objs.size()=1 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.oGthrHjg8DifyODn0Ie2ubXWuy5gM88_0 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13995697574627981760', time=2024-09-12T19:53:54.732907+0000, chain.objs.size()=1 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.XxOzNSWN2A55mqPTG1yr4eG_I6dXYlo_0 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18251448230706580733', time=2024-09-12T19:53:54.758577+0000, chain.objs.size()=1 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.086+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mGaJaME-Lp0bzwizcUgJ9AmPDAGXFLA_0 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.087+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9786668593395329165', time=2024-09-12T19:53:54.842797+0000, chain.objs.size()=1 2024-09-12T18:01:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.087+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qteM0fygXOiR6EbJrfYlaQS_iTi6b3H_0 2024-09-12T18:01:05.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.090+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9515546461469932708', time=2024-09-12T19:53:54.859922+0000, chain.objs.size()=1 2024-09-12T18:01:05.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.090+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7xdX7_t48VDj6wEq3fb2ZpvsnRNsSHr_0 2024-09-12T18:01:05.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.090+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17159291410534435584', time=2024-09-12T19:53:54.941824+0000, chain.objs.size()=1 2024-09-12T18:01:05.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.090+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.SLNFjg4pjnC6pp7yMHfnZLgL_k9S7DE_0 2024-09-12T18:01:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.091+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7813243425326891217', time=2024-09-12T19:53:55.057181+0000, chain.objs.size()=1 2024-09-12T18:01:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.091+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Gu_gqir_2sWMsdCabwZm9r06U6T8CQL_0 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1288644695579402938', time=2024-09-12T19:53:55.110822+0000, chain.objs.size()=1 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FB2YEizweKeOB_FMI8IsTM6vxEflbVu_0 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17675729268814987190', time=2024-09-12T19:53:55.113386+0000, chain.objs.size()=1 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uxaXRpgmPNC3tYrlwjhgGb5pMCxvyxX_0 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5881519123290026719', time=2024-09-12T19:53:55.128270+0000, chain.objs.size()=1 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ftNKN3RXtZKRsYJfp1mDSTSCaPXR_pE_0 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3867717572979506626', time=2024-09-12T19:53:55.143291+0000, chain.objs.size()=1 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YNF3msGQAyVQkVJbptWioj7NMB6a5bz_0 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3350523803129467220', time=2024-09-12T19:53:55.161137+0000, chain.objs.size()=1 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ma4RVKZkUUemKbSbdUSX127QFkqrC3l_0 2024-09-12T18:01:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4672039893004874527', time=2024-09-12T19:53:55.263674+0000, chain.objs.size()=1 2024-09-12T18:01:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aAP71nAKstT8w2EG0boeKYlaxF2skKo_0 2024-09-12T18:01:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17710814055320508599', time=2024-09-12T19:53:55.265420+0000, chain.objs.size()=1 2024-09-12T18:01:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.093+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rv_UL28HJUNbUDXeioK_gGy5QxiT0ZH_0 2024-09-12T18:01:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.097+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/45312 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9050359964233635187', time=2024-09-12T19:53:55.339866+0000, chain.objs.size()=1 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Izr0dEakYDcKjKcf6ArHz_zSmv_b8Zv_0 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13257709587226921422', time=2024-09-12T19:53:55.372386+0000, chain.objs.size()=1 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qtiuUe3O4v2t2oRxfOrEre1-NqwB6Yb_0 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8804798018361541776', time=2024-09-12T19:53:55.379055+0000, chain.objs.size()=1 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Q4DlMBNuOXbncjqN12Ootw7pX-BgjGl_0 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11976660506260246926', time=2024-09-12T19:53:55.381649+0000, chain.objs.size()=1 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HrkNqAD-8BxjGJtDUYrzDJwbnZu2-PI_0 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2869556720938409208', time=2024-09-12T19:53:55.579334+0000, chain.objs.size()=1 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Lz3rE7SesIw8kyvsED_V0yT9Wr7fXCi_0 2024-09-12T18:01:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7530455845452545343', time=2024-09-12T19:53:55.588541+0000, chain.objs.size()=1 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Iq0iMT_ACa953VWJUEArYbXVdjgKIgq_0 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3339932043129571890', time=2024-09-12T19:53:55.717265+0000, chain.objs.size()=1 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fScXpsJnEBLK-ogrrkX0jvXNQDCkvBE_0 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.77749558115491132', time=2024-09-12T19:53:55.773704+0000, chain.objs.size()=1 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6juYUFE4Q75JpX7Z3Y8Bl68uerY5S_K_0 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.397076652039840522', time=2024-09-12T19:53:55.786227+0000, chain.objs.size()=1 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CfqgdpLfQMBfjugaLCZVvPPYLOvVjmJ_0 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9884858876873890081', time=2024-09-12T19:53:55.790343+0000, chain.objs.size()=1 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FI3Qudenq9dhbvfrndXIgxfLbZ4OCZi_0 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6040811653041421157', time=2024-09-12T19:53:55.811277+0000, chain.objs.size()=1 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mL5s0WCTO_FGeTj5yHlZrc6NS5p_WO0_0 2024-09-12T18:01:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12188894898675078815', time=2024-09-12T19:53:55.912804+0000, chain.objs.size()=1 2024-09-12T18:01:05.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.100+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.caD_cAQjKhhlM5HQ6dGDCrRgJm4JwXd_0 2024-09-12T18:01:05.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.103+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7737378580181601376', time=2024-09-12T19:53:55.952996+0000, chain.objs.size()=1 2024-09-12T18:01:05.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.103+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.bH5DlJ3A6OyuTiacrEhWerUdkf46wlU_0 2024-09-12T18:01:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8993202107205594710', time=2024-09-12T19:53:55.981044+0000, chain.objs.size()=1 2024-09-12T18:01:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.kpfZuMMBS1csUf30vehc4d5bkYovNkn_0 2024-09-12T18:01:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5142779403355376926', time=2024-09-12T19:53:56.105173+0000, chain.objs.size()=1 2024-09-12T18:01:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mptykDkz9oZpy28Q4TEqybDeMQ_wvoA_0 2024-09-12T18:01:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3861764381745853397', time=2024-09-12T19:53:56.106337+0000, chain.objs.size()=1 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.qARBcpYvT4h9qcStH5Kredi5WQijZix_0 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17924517877067907027', time=2024-09-12T19:53:56.166424+0000, chain.objs.size()=1 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NTwCaPDkZT3Zw_Ma2rEUMKuHrdgsxIm_0 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.23176666710382086', time=2024-09-12T19:54:34.199683+0000, chain.objs.size()=1 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.104+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.497__shadow_.INZaSBlZf8mcPQAvkQOgdtPjCsd9O0V_0 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8667062351563742466', time=2024-09-12T19:54:43.296650+0000, chain.objs.size()=3 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~8fDdUi7a76cY9KUCSYKzuGMpN3RDaKo.1 2024-09-12T18:01:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~8fDdUi7a76cY9KUCSYKzuGMpN3RDaKo.2 2024-09-12T18:01:05.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.522__multipart_mymultipart.2~8fDdUi7a76cY9KUCSYKzuGMpN3RDaKo.3 2024-09-12T18:01:05.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11142871756987346380', time=2024-09-12T19:55:45.617675+0000, chain.objs.size()=1 2024-09-12T18:01:05.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:CPKUJFFMpDBakPIfeblZar2v.nVOCzX_.diB6KSBY-COFffrsDLEEN5BUiFdizuJ_0 2024-09-12T18:01:05.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13434610639286284423', time=2024-09-12T19:55:55.852678+0000, chain.objs.size()=1 2024-09-12T18:01:05.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.105+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:wISMgzZMJ7zSGUNyiVdsqJypCHHoKFF_.RIyCbpeGOCNCJXhUtM5mEoAHXYlb3bi_0 2024-09-12T18:01:05.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.426253658356304646', time=2024-09-12T19:56:02.146524+0000, chain.objs.size()=1 2024-09-12T18:01:05.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:n6QKWTWH8TMgWi0SbX749A9U4rcxdXV_.l-DQurphhJ7cCZuzt0dUIZrzveelUTZ_0 2024-09-12T18:01:05.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7543484808011702533', time=2024-09-12T19:56:04.636145+0000, chain.objs.size()=1 2024-09-12T18:01:05.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.586__shadow:mjDaWtKvVYMmxq4ibMzTkyiuwCVS6co_.afKGiFfhBtv4Yy5IesXZhTNCoxsv9aZ_0 2024-09-12T18:01:05.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16816525347751873329', time=2024-09-12T19:56:08.174352+0000, chain.objs.size()=1 2024-09-12T18:01:05.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.605__shadow_.x9cf7XbKY5vFHZLtcMrTWGiohjXqQPf_0 2024-09-12T18:01:05.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10976007589465814857', time=2024-09-12T19:58:24.506363+0000, chain.objs.size()=1 2024-09-12T18:01:05.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.649__shadow_.gFSe-XI6XuSEyd-znBDNht0A_1SBW1B_0 2024-09-12T18:01:05.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1802549287162911829', time=2024-09-12T19:58:40.277441+0000, chain.objs.size()=1 2024-09-12T18:01:05.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.110+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.712__multipart_file1.2~Ac_1l3h920r6caLLdobStzizfQ8MFtu.1 2024-09-12T18:01:05.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.114+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:05.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.117+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:01:05.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.118+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:05.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.118+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:05.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=97, truncated=0, next_marker='' 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_jwOoiAApWcuINUoJex6fABgpVUm0q7X', time=2024-09-12T19:51:58.125146+0000, chain.objs.size()=3 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.CvFHa-sXasEYDNOac27aEuXs8asETBZ_0 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.CvFHa-sXasEYDNOac27aEuXs8asETBZ_1 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.161__shadow_.CvFHa-sXasEYDNOac27aEuXs8asETBZ_2 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12921213016724750666', time=2024-09-12T19:53:07.245605+0000, chain.objs.size()=1 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.235__shadow_.NvEkQb4ZtS6RNiCve0cRmHDL1YiafyR_0 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13385560775446555017', time=2024-09-12T19:53:07.653447+0000, chain.objs.size()=1 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.237__shadow_.FrRqtQp3fJD7MHPApBD4G5E83pffvsF_0 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6260975280706856397', time=2024-09-12T19:53:07.910728+0000, chain.objs.size()=1 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.238__shadow_.0RGAcCMTAFT2N9amaHkrw6DRwKHA0tB_0 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14010206751266980455', time=2024-09-12T19:53:07.911510+0000, chain.objs.size()=1 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.238__shadow_.BJgwvCQAVLQcT5MD3y45qIG2D7ZKtqT_0 2024-09-12T18:01:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17589779061456623043', time=2024-09-12T19:53:09.703772+0000, chain.objs.size()=1 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.246__shadow_.KUmgjraC7BhCWH8COlhD4SnNNeKKKoj_0 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14734537056696192474', time=2024-09-12T19:53:11.830559+0000, chain.objs.size()=1 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.256__shadow_.o3rqcPU2DJlXBOEZy2afsc4k-RtOMAP_0 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11422939525390316047', time=2024-09-12T19:53:21.180447+0000, chain.objs.size()=1 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.WF-JjWRvtxRm1pXLpLcobLKIqtJVqj__0 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1402393946260958846', time=2024-09-12T19:53:21.230319+0000, chain.objs.size()=1 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Orwj29Zf51FLpb1ipIC_xYtHE1GgqHh_0 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6125907073614406866', time=2024-09-12T19:53:21.239488+0000, chain.objs.size()=1 2024-09-12T18:01:05.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.119+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.COQOFcPhugDGttPPBS87WwTWBi2yUoE_0 2024-09-12T18:01:05.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8920794656184819327', time=2024-09-12T19:53:21.443632+0000, chain.objs.size()=1 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.KIvmu0PLGYYhN4Le0XjAyPM_Ac_XiLG_0 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5943040735598856146', time=2024-09-12T19:53:21.462509+0000, chain.objs.size()=1 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4J9hpeYFxtpiPUHBpSq_-4fvC5Ttf2h_0 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18123925468321243046', time=2024-09-12T19:53:21.463522+0000, chain.objs.size()=1 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.6abc5eRRAWntybbtOXEe3xe6KFKMceO_0 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16465862388928029450', time=2024-09-12T19:53:21.599904+0000, chain.objs.size()=1 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HViPk_578T9oX_LUn_rQCeAhS4HICbu_0 2024-09-12T18:01:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13985128569542869612', time=2024-09-12T19:53:21.611145+0000, chain.objs.size()=1 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1h_Ay_5Uw-jZ5HsfF6QMxdU87Gy0KYE_0 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14508081259145565249', time=2024-09-12T19:53:21.649885+0000, chain.objs.size()=1 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tFh0RtVO_Zdmg8jWTWg4yvPWyTNp_5K_0 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11864271132323114603', time=2024-09-12T19:53:21.870854+0000, chain.objs.size()=1 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BGeH_pqLj-oK39Upuna_7Tu6-8q0zyI_0 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9569121252646949167', time=2024-09-12T19:53:21.871491+0000, chain.objs.size()=1 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.j-Dvo8ncfgR3hp5Eu8mZBv9e6bDlgZi_0 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5554695343656350850', time=2024-09-12T19:53:21.883966+0000, chain.objs.size()=1 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.X-PTB1mhaFTPUAllHpyt77LDwr7vKJf_0 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3283205760677585817', time=2024-09-12T19:53:22.094977+0000, chain.objs.size()=1 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.KG6wComuOnlR1ERqB_oFeUsodvHLMJN_0 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12322716120974418518', time=2024-09-12T19:53:22.198912+0000, chain.objs.size()=1 2024-09-12T18:01:05.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.125+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.tWdu_ZH-9Hz3Nk-dZcnYfO4MiY7GGIT_0 2024-09-12T18:01:05.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8342279167663133446', time=2024-09-12T19:53:22.200254+0000, chain.objs.size()=1 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1N4QYB-iPhMFaImSvWwYUwiyWDvfSuL_0 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17687744866712815063', time=2024-09-12T19:53:22.223249+0000, chain.objs.size()=1 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HBwX1cO8Cx6cqNdvv9gMwggPFC1N7St_0 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10921842459004236898', time=2024-09-12T19:53:22.269213+0000, chain.objs.size()=1 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1KhOZ5HrrJQXAaYj_6zyc9S3N0IIPW-_0 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5888353519859614386', time=2024-09-12T19:53:22.301983+0000, chain.objs.size()=1 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kZ2AOj7KBntfl4bdYRgIPr6_uz40diL_0 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8412149621778596059', time=2024-09-12T19:53:22.386769+0000, chain.objs.size()=1 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.QfsTLVQZmBcYrNjHzhK3IAiJFiasB1x_0 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1059693936297329965', time=2024-09-12T19:53:22.399515+0000, chain.objs.size()=1 2024-09-12T18:01:05.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1PMKe_wX1fz0i0UNcWldw6ldMNAr-YD_0 2024-09-12T18:01:05.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6962525650806907615', time=2024-09-12T19:53:22.435966+0000, chain.objs.size()=1 2024-09-12T18:01:05.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.aBkPgUAX4R6uKQLo7woDt9LuhVCHjEP_0 2024-09-12T18:01:05.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8797274566206569105', time=2024-09-12T19:53:22.477536+0000, chain.objs.size()=1 2024-09-12T18:01:05.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.3uhbH_3VW1FBm6ttmCCNjOzZHxBQsFd_0 2024-09-12T18:01:05.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14895275212885098787', time=2024-09-12T19:53:22.599738+0000, chain.objs.size()=1 2024-09-12T18:01:05.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.bSjPQGAs6g29JZq_Mc1AChqrx4VzRaG_0 2024-09-12T18:01:05.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4280804706340119455', time=2024-09-12T19:53:22.619743+0000, chain.objs.size()=1 2024-09-12T18:01:05.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.F4LuwexV4QdeOwecn4NXgauW6tuUGp5_0 2024-09-12T18:01:05.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12403625305096595228', time=2024-09-12T19:53:22.635446+0000, chain.objs.size()=1 2024-09-12T18:01:05.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.130+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.qZ9K94G_bS153o8Pj81IJZq86ARO0m5_0 2024-09-12T18:01:05.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.133+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11249543303592990627', time=2024-09-12T19:53:29.938333+0000, chain.objs.size()=1 2024-09-12T18:01:05.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.133+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.294__shadow_.1V6rjuFZFdsvmxBVU0X3zK26CsIqe2B_0 2024-09-12T18:01:05.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14372232832925983605', time=2024-09-12T19:53:30.139310+0000, chain.objs.size()=1 2024-09-12T18:01:05.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.295__shadow_.9X1zOc5AwP2pgrsU5sjxO0SCpTq3LO0_0 2024-09-12T18:01:05.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5818946436211930101', time=2024-09-12T19:53:31.319425+0000, chain.objs.size()=1 2024-09-12T18:01:05.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.300__shadow_.fJp9cNoiisRv0qY4TpG20vzLnnZSVjM_0 2024-09-12T18:01:05.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13862496580524508411', time=2024-09-12T19:53:32.635309+0000, chain.objs.size()=1 2024-09-12T18:01:05.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.306__shadow_.70W4J3CRKftD5mlqwDfHtXgDXfXgoBM_0 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6317887903920666539', time=2024-09-12T19:53:33.480571+0000, chain.objs.size()=1 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.308__shadow:N5vVKmeypkTvW5pghT1pMWzUX0L90Ye_.Y6yRba_rIH2oUslpyF5gNywkK0Rtrj__0 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17480739143976253298', time=2024-09-12T19:53:44.529965+0000, chain.objs.size()=1 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.8rSP_o8Oej7ov9ugK0p2toLcYPR7Db2_0 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10480390791763612471', time=2024-09-12T19:53:44.548671+0000, chain.objs.size()=1 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pZtIhVZeHxWqxO83QUL5aOdolYNy2UD_0 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7477580709923166702', time=2024-09-12T19:53:44.554972+0000, chain.objs.size()=1 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BSiLRmIbgLZnazcU2PWuwQ40Hh4SOfY_0 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7908215739506442645', time=2024-09-12T19:53:44.569540+0000, chain.objs.size()=1 2024-09-12T18:01:05.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.p21eDUzK22nMTzwrWVp1_qwBL1IZ2YO_0 2024-09-12T18:01:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6238508972786369881', time=2024-09-12T19:53:44.645178+0000, chain.objs.size()=1 2024-09-12T18:01:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.X6x9W9z3kCxyOI594WUADh4lnis9phU_0 2024-09-12T18:01:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17168015590322777269', time=2024-09-12T19:53:44.986418+0000, chain.objs.size()=1 2024-09-12T18:01:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.136+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.yJaqTjBII-ITvBI5ZOMowm_FH6Qu82T_0 2024-09-12T18:01:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.138+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11482942726028729652', time=2024-09-12T19:53:45.135827+0000, chain.objs.size()=1 2024-09-12T18:01:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.138+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ydb5fYl_1iQWms6yvD7d79vo2gb7ntq_0 2024-09-12T18:01:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1396489599925125908', time=2024-09-12T19:53:45.196735+0000, chain.objs.size()=1 2024-09-12T18:01:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4iXxtHC7DbxUnMfCoZ9utVaZJmxNWJU_0 2024-09-12T18:01:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14729144418915817635', time=2024-09-12T19:53:45.221034+0000, chain.objs.size()=1 2024-09-12T18:01:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.pPyE50-YBl0OmL75WwP2ez3-nAHf6lI_0 2024-09-12T18:01:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13539613066934739020', time=2024-09-12T19:53:45.241852+0000, chain.objs.size()=1 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WXT1aGlXs_m7pCMtoSXrYhwVE_NVO9e_0 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.156456005925381781', time=2024-09-12T19:53:45.417131+0000, chain.objs.size()=1 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.z_3CBlbgLFMzFOtPwh_jONzCNGm8dl5_0 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18418165691734648755', time=2024-09-12T19:53:45.569663+0000, chain.objs.size()=1 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Nqb1Y8Mtrp5iJpAA4Seb00-JWLQtIqu_0 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2246058322115157841', time=2024-09-12T19:53:45.577985+0000, chain.objs.size()=1 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.R4oigOW6lAD_rbeSFGN-7KQ-t3OcX9m_0 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2565181315448936852', time=2024-09-12T19:53:45.623229+0000, chain.objs.size()=1 2024-09-12T18:01:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.141+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.vZDuQqeW9xRJISbROzucVP0UizhLM_v_0 2024-09-12T18:01:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9255336204551991185', time=2024-09-12T19:53:45.640280+0000, chain.objs.size()=1 2024-09-12T18:01:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5tjLG0wUSQxV-XeJ7d72WKKuMNhnO0j_0 2024-09-12T18:01:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9524983443903685477', time=2024-09-12T19:53:45.744420+0000, chain.objs.size()=1 2024-09-12T18:01:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0dYtQdw2WaU9I2yfuzardtFYOG8L5Mw_0 2024-09-12T18:01:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12822029439124110977', time=2024-09-12T19:53:45.785425+0000, chain.objs.size()=1 2024-09-12T18:01:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0MfBQ0c4syZvvjXjrDeZB-kck7Ogc98_0 2024-09-12T18:01:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9511388219835029017', time=2024-09-12T19:53:45.852403+0000, chain.objs.size()=1 2024-09-12T18:01:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.144+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tyTaq8wEPLL5az1pVfeAcgGXFTcP9Cz_0 2024-09-12T18:01:05.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3134630965450176948', time=2024-09-12T19:53:45.984150+0000, chain.objs.size()=1 2024-09-12T18:01:05.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gXtLUGnmixTUZo2O8mUOKzOiM46KaJ6_0 2024-09-12T18:01:05.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.146+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15510215549670083443', time=2024-09-12T19:53:45.996698+0000, chain.objs.size()=1 2024-09-12T18:01:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.146+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mrFxygmn8y7sD28Hx_MQBYzxqqfPutz_0 2024-09-12T18:01:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6576453566336591672', time=2024-09-12T19:53:46.031938+0000, chain.objs.size()=1 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9WEOl80JwvIkfc9se2aA2bgJnqPSY7p_0 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17285194356277983595', time=2024-09-12T19:53:46.044302+0000, chain.objs.size()=1 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.mN-S4DQ6CtOUfW99YeCUV4WtaoKFKkg_0 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14204793816040658071', time=2024-09-12T19:53:46.174790+0000, chain.objs.size()=1 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.smwxC-49GnDqR74gHF3SWHqxJewCwqs_0 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17003805922341361670', time=2024-09-12T19:53:46.234921+0000, chain.objs.size()=1 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.PIT8ZYQklPiHJGe5caj88izv0Hr7jLq_0 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11086725422065229740', time=2024-09-12T19:53:54.637022+0000, chain.objs.size()=1 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.148+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aJIiUjI2tZWmQZb-qFk_jDKISjtMVod_0 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11084787421018804513', time=2024-09-12T19:53:54.844182+0000, chain.objs.size()=1 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CfPObRtp8Ls143AXGIeeXUtA6Yn-kRo_0 2024-09-12T18:01:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11763167992114939145', time=2024-09-12T19:53:54.943064+0000, chain.objs.size()=1 2024-09-12T18:01:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.ZoWn7Its5YVlmyEPvgRGwfM1B0WIePx_0 2024-09-12T18:01:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3215234888825444261', time=2024-09-12T19:53:54.956058+0000, chain.objs.size()=1 2024-09-12T18:01:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uvAS-U0rNTSJKO5lyWJ7JfBWstzB81h_0 2024-09-12T18:01:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7251467344204806657', time=2024-09-12T19:53:55.112111+0000, chain.objs.size()=1 2024-09-12T18:01:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.149+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.YvgxxEd8SeEtjrCHQMIMJHdQzQRCNbG_0 2024-09-12T18:01:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6114159954075712600', time=2024-09-12T19:53:55.160667+0000, chain.objs.size()=1 2024-09-12T18:01:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.topxdZRsnREFodfZf5FxTmQchlMBTAv_0 2024-09-12T18:01:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.152+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13915014777856076663', time=2024-09-12T19:53:55.499662+0000, chain.objs.size()=1 2024-09-12T18:01:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.152+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EoANpWjmCSC1nPNJbgsbTh57KxXixH1_0 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1947969900297266669', time=2024-09-12T19:53:55.516733+0000, chain.objs.size()=1 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.pyWfHMFkl-aHLrUCs7uPnhxm4FPv66G_0 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11287595008004547206', time=2024-09-12T19:53:55.522376+0000, chain.objs.size()=1 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jGsDwXIRdCHJMI9PzAZk6XmxZ5LHZ-h_0 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5852067881165697689', time=2024-09-12T19:53:55.529894+0000, chain.objs.size()=1 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.jQQf642oN9aNntKw9BPnLEfN_fmhMff_0 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11634574546133681118', time=2024-09-12T19:53:55.564008+0000, chain.objs.size()=1 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CRQtdnmFvp0Xd7crbcBvs9-YL6QB9Mo_0 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15094042771693390886', time=2024-09-12T19:53:55.713944+0000, chain.objs.size()=1 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.RP57V4junCEmShOrEyWS5qXkSqAMKAE_0 2024-09-12T18:01:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2710546404959079377', time=2024-09-12T19:53:55.725144+0000, chain.objs.size()=1 2024-09-12T18:01:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.gjc7p94FOTVlTCizYcWp93fSTF-Bg-g_0 2024-09-12T18:01:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7496146499885631316', time=2024-09-12T19:53:55.929168+0000, chain.objs.size()=1 2024-09-12T18:01:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.D5vJTwoguoWO7pm73eDDd48ozNdUj63_0 2024-09-12T18:01:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10268670427204727921', time=2024-09-12T19:53:56.008582+0000, chain.objs.size()=1 2024-09-12T18:01:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.153+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.nOKaEVxCSRn2MlFlNwjOfRX4yJvh8OM_0 2024-09-12T18:01:05.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.156+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6873884481498252863', time=2024-09-12T19:53:56.024030+0000, chain.objs.size()=1 2024-09-12T18:01:05.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.156+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.mklaejgouESjrMAP1JH-CrONzNZbFyD_0 2024-09-12T18:01:05.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.156+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17277014303711955303', time=2024-09-12T19:53:56.106065+0000, chain.objs.size()=1 2024-09-12T18:01:05.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.156+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6zvQOmp3eQjxTPchnWrm5l9ZszF1yhd_0 2024-09-12T18:01:05.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.157+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.861055672048845249', time=2024-09-12T19:53:56.155873+0000, chain.objs.size()=1 2024-09-12T18:01:05.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.157+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Kt5qJBfM579gAyxQjV7iqb8giUGT_HO_0 2024-09-12T18:01:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1737793811904237067', time=2024-09-12T19:53:56.158289+0000, chain.objs.size()=1 2024-09-12T18:01:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.L1Q3APAaH71s3uODtSFh15i2bLHnrfJ_0 2024-09-12T18:01:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.667347312920574779', time=2024-09-12T19:53:56.184015+0000, chain.objs.size()=1 2024-09-12T18:01:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-LRdXLViZcjxkevb-F3ws3mjMt-WHkO_0 2024-09-12T18:01:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.525016976560776788', time=2024-09-12T19:53:56.190802+0000, chain.objs.size()=1 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-IQx3JV-4wfg6Ey3-_D_Vw77-XriMmd_0 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10857180930447896333', time=2024-09-12T19:53:56.201231+0000, chain.objs.size()=1 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.HGuc1Rr_UstCULIuQSLP56JLRxeQP6k_0 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.535952551383231030', time=2024-09-12T19:54:15.260435+0000, chain.objs.size()=1 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.411__shadow_.XXVf8SNIdaKiQCaWAFAiVCoTuMZsSmD_0 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15704175325266388435', time=2024-09-12T19:54:36.478751+0000, chain.objs.size()=1 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.504__shadow:YnY3RpnWdxNL2AAWGjaSqYdBVkxd.2r_.0H8-qd5wL1YloYv9-TjdMVbSrLkSqV7_0 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8877526552912564260', time=2024-09-12T19:54:38.986063+0000, chain.objs.size()=1 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.514__multipart_mymultipart.2~L0yKL38CdwrJvmB90-KpN67_M28mDKF.1 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13513712431192086913', time=2024-09-12T19:55:08.869604+0000, chain.objs.size()=4 2024-09-12T18:01:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.159+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.536__multipart_mymultipart.2~g4jX6CdMy5CWki8Meo6pQ5ThGkG-W2o.1 2024-09-12T18:01:05.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.160+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.536__multipart_mymultipart.2~g4jX6CdMy5CWki8Meo6pQ5ThGkG-W2o.2 2024-09-12T18:01:05.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.161+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.536__multipart_mymultipart.s_AJkmW0JUukNQ647HnY0fTDghNGg6PW.3 2024-09-12T18:01:05.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.162+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.536__multipart_mymultipart.2~g4jX6CdMy5CWki8Meo6pQ5ThGkG-W2o.4 2024-09-12T18:01:05.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.165+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.71420932262625825', time=2024-09-12T19:55:40.545893+0000, chain.objs.size()=1 2024-09-12T18:01:05.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.165+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.574__shadow_.z-XCKEM4Wk7ukZsBkNjg8qa-wL_8-S0_0 2024-09-12T18:01:05.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.165+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11847224503508707102', time=2024-09-12T19:55:55.571341+0000, chain.objs.size()=1 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.165+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.578__shadow:ZgWnIFTaFST8rw9fW4-pWbwUJBznnsg_.KqiYf58uTYi5Izdwq-VZGEA1BktL8vm_0 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15642972069162247605', time=2024-09-12T19:56:02.152864+0000, chain.objs.size()=1 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.580__shadow:Uta2MiTM6R54HxPd2HO4uthLsFa6ps0_.aR_6DfJzCIwv5_5GoKINRmXDvUiBZJt_0 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13313199882235617480', time=2024-09-12T19:56:03.075047+0000, chain.objs.size()=1 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:tg7WJJmIE6b3HFbv7b64VutpKfaHd6O_.Jph1oohUmMPdZs5ctTkO5sEPruwdOdr_0 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5463570493436129959', time=2024-09-12T19:56:05.281375+0000, chain.objs.size()=1 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:DnC7T5FDkqfF9dSlXTqsN1wqwHAlea3_.103Mlgt3QTA7EUBK_KcPYimIpiE9qxe_0 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8', time=2024-09-12T19:58:19.113908+0000, chain.objs.size()=12 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__multipart_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.1 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__shadow_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.1_1 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__multipart_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.2 2024-09-12T18:01:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__shadow_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.2_1 2024-09-12T18:01:05.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.166+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__multipart_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.3 2024-09-12T18:01:05.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.168+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__shadow_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.3_1 2024-09-12T18:01:05.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__multipart_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.4 2024-09-12T18:01:05.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__shadow_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.4_1 2024-09-12T18:01:05.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__multipart_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.5 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__shadow_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.5_1 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__multipart_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.6 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.626__shadow_multipart_enc.2~N2bddHskUo90EGT-RMdmpaVAgLfpzY8.6_1 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11690787444979838946', time=2024-09-12T19:58:19.692374+0000, chain.objs.size()=1 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.629__shadow_.5b3MchFzr1VpAPvPOjG4v8WXk7W2XdH_0 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4170335305183109424', time=2024-09-12T19:58:23.527055+0000, chain.objs.size()=1 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.646__shadow_.E89VZfT4E5ax8DGTEV-yK1wbEuID8Ad_0 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11484032372053649982', time=2024-09-12T19:58:26.265471+0000, chain.objs.size()=2 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.655__shadow_.lX3fv1MRz9e1soeRFJCBgboY8UP7ZWS_0 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.171+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.655__shadow_.lX3fv1MRz9e1soeRFJCBgboY8UP7ZWS_1 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.172+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16942243378673898063', time=2024-09-12T19:58:26.956805+0000, chain.objs.size()=1 2024-09-12T18:01:05.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.172+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.657__shadow_.j_obGi6EN3mj7Z_-ie57L00JCe6JJi1_0 2024-09-12T18:01:05.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.179+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:05.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.182+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:01:05.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.183+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:05.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.183+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:05.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50220' 2024-09-12T18:01:05.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='_bYmlZ8c0No-3XAqAdRqHPUH9JZ7IzQ4', time=2024-09-12T19:51:59.431268+0000, chain.objs.size()=3 2024-09-12T18:01:05.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.8DgzWe2g5JjOGInkg1_MbsiYQVpF27k_0 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.8DgzWe2g5JjOGInkg1_MbsiYQVpF27k_1 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.162__shadow_.8DgzWe2g5JjOGInkg1_MbsiYQVpF27k_2 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1978247279403413858', time=2024-09-12T19:52:11.419147+0000, chain.objs.size()=1 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.178__shadow_.YVIMSgDxdC91winc3aLqZPk6fn5HlBZ_0 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7571781936147512173', time=2024-09-12T19:52:16.865004+0000, chain.objs.size()=1 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.200__shadow_.uC1QzeUGgNXaeQRloqXfamf232Ria_B_0 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13659633175706974535', time=2024-09-12T19:53:07.910715+0000, chain.objs.size()=1 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.238__shadow_.0JtGLuZDL8ySb-7KKaVw1aoV3OOIpDj_0 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8206872860246847242', time=2024-09-12T19:53:09.238092+0000, chain.objs.size()=1 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.244__shadow_.YUK74mnbeJx8SlYOKDWz62l2yaBpi0w_0 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2650779223210452284', time=2024-09-12T19:53:09.944788+0000, chain.objs.size()=1 2024-09-12T18:01:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.247__shadow_.VU6FNBOaQl7SFPwGYrDXNX_yOvyKH2c_0 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13033283997949686691', time=2024-09-12T19:53:11.830840+0000, chain.objs.size()=1 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.256__shadow_.5ttHtWA3kJEGCnk4z8MRgvF7cFY56a-_0 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2363266442254056224', time=2024-09-12T19:53:21.185574+0000, chain.objs.size()=1 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LgXGsiDaXCkjbHPK8kiMJYyOybhe5L3_0 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7005894989398017555', time=2024-09-12T19:53:21.224773+0000, chain.objs.size()=1 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.7Q6HSSc_x7YZgrQYN2mqSlMFDsoAlSm_0 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.557562487663021600', time=2024-09-12T19:53:21.259479+0000, chain.objs.size()=1 2024-09-12T18:01:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.184+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pt54I8CqQ_QccnxehgLA0jUzLngcHZd_0 2024-09-12T18:01:05.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.187+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7788354824942804826', time=2024-09-12T19:53:21.379122+0000, chain.objs.size()=1 2024-09-12T18:01:05.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.187+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.ggKaIibg4Isau74nUTXRXna29K4LSpu_0 2024-09-12T18:01:05.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.188+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8595936934690987130', time=2024-09-12T19:53:21.408462+0000, chain.objs.size()=1 2024-09-12T18:01:05.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.188+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kW-3YxKMksgRwLGE-FqyoE3OEfQIJqz_0 2024-09-12T18:01:05.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4299444776195752886', time=2024-09-12T19:53:21.411539+0000, chain.objs.size()=1 2024-09-12T18:01:05.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.d-4s3aFFHV1HsYmAfS00Evp34p3_b8Y_0 2024-09-12T18:01:05.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4110475858225019639', time=2024-09-12T19:53:21.439506+0000, chain.objs.size()=1 2024-09-12T18:01:05.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yBc9xEQbjdnxQqkPivP87R2tjTr3y4j_0 2024-09-12T18:01:05.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15104126482478600029', time=2024-09-12T19:53:21.449750+0000, chain.objs.size()=1 2024-09-12T18:01:05.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.cRjEap_H7_wOdqj6z7tD_HdMg7kfrlP_0 2024-09-12T18:01:05.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10949336905158192851', time=2024-09-12T19:53:21.453356+0000, chain.objs.size()=1 2024-09-12T18:01:05.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.189+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.EiJRjdlJd7y6cNrqdLu3GhfTFifEl5-_0 2024-09-12T18:01:05.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8569618700305228743', time=2024-09-12T19:53:21.613044+0000, chain.objs.size()=1 2024-09-12T18:01:05.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.LrX2SyLNF_opuwTCRb3t06uzDKdT05g_0 2024-09-12T18:01:05.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.269664301242793377', time=2024-09-12T19:53:21.637619+0000, chain.objs.size()=1 2024-09-12T18:01:05.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.U11PuZxfHiu2dxLYY9LiDkzeXSWvt53_0 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15145396439659225892', time=2024-09-12T19:53:21.665286+0000, chain.objs.size()=1 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CHtTigQGhyuHkBWTZrZkQywWAm7rF6v_0 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.965800260055376789', time=2024-09-12T19:53:21.819541+0000, chain.objs.size()=1 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.lNb-R13Zc42WuC7juRAo7RogCBSkADh_0 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1028867952430424878', time=2024-09-12T19:53:21.853826+0000, chain.objs.size()=1 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.g9hO-jT1QodHbTOpzDBo8Y-nOIpUiq3_0 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16677246255198415265', time=2024-09-12T19:53:21.872636+0000, chain.objs.size()=1 2024-09-12T18:01:05.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.190+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.n-wcP1ojjM5StzywVZTAUcDFAC0Jjxq_0 2024-09-12T18:01:05.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.192+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2006781042761656827', time=2024-09-12T19:53:21.977249+0000, chain.objs.size()=1 2024-09-12T18:01:05.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.192+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.jc0iZX16YLcVXglbyBh88gKEe70far1_0 2024-09-12T18:01:05.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4332375609009295388', time=2024-09-12T19:53:22.035480+0000, chain.objs.size()=1 2024-09-12T18:01:05.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.81KF4JkmnV2c8BMCaw_CDVuh_2A0Iej_0 2024-09-12T18:01:05.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10266781822963722600', time=2024-09-12T19:53:22.049907+0000, chain.objs.size()=1 2024-09-12T18:01:05.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.E-GkzKEYPqOGzy6n_-5iC8JOzbDSqng_0 2024-09-12T18:01:05.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.193+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9718390637568410421', time=2024-09-12T19:53:22.074404+0000, chain.objs.size()=1 2024-09-12T18:01:05.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.193+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.FPT1f7i1g16J68AKAcQLOmsmAxXawlr_0 2024-09-12T18:01:05.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17436060287526325817', time=2024-09-12T19:53:22.085228+0000, chain.objs.size()=1 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.0UJRpE3LTTdHnwyjnZ6vslVKYVWk2gE_0 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6825799869719703762', time=2024-09-12T19:53:22.180681+0000, chain.objs.size()=1 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Yu4M3d0-UHCU6aQtWQMoN2hfeUY7Ip__0 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7865919614266786679', time=2024-09-12T19:53:22.189411+0000, chain.objs.size()=1 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.R9bK_Svy2bnn4N80APcWNkXSzvT5BL0_0 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16133031653239359044', time=2024-09-12T19:53:22.192120+0000, chain.objs.size()=1 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.T33_6d5EQ_cCKvyt4hLSEmvcPZwHkL7_0 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18006670863387539025', time=2024-09-12T19:53:22.227338+0000, chain.objs.size()=1 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.JczHCONIRd3Lu9OLu0uKoWyRIEKlpT-_0 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3306742726423987237', time=2024-09-12T19:53:22.238004+0000, chain.objs.size()=1 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.DsVbiUD-y0LFXWUGC2_E_dEbRXJbSvN_0 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15522731577451007065', time=2024-09-12T19:53:22.253577+0000, chain.objs.size()=1 2024-09-12T18:01:05.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.-hMpdqxGefbCMgMIEiUTCQX87qAznbl_0 2024-09-12T18:01:05.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7255058287087509085', time=2024-09-12T19:53:22.398802+0000, chain.objs.size()=1 2024-09-12T18:01:05.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.195+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Jv4dx6IbHuUi2pZnQYWDVvgSuTrV4RV_0 2024-09-12T18:01:05.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.196+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1724107020563765140', time=2024-09-12T19:53:22.412517+0000, chain.objs.size()=1 2024-09-12T18:01:05.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.196+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.oXB-GeqGaXFqUkYqCCop1fdL4PoQXPq_0 2024-09-12T18:01:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.199+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10464325102501177634', time=2024-09-12T19:53:22.475260+0000, chain.objs.size()=1 2024-09-12T18:01:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.199+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.S4arP2lPeKhl4AhPDSn-5rPl-8hg5Qi_0 2024-09-12T18:01:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.199+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10472880314806360020', time=2024-09-12T19:53:22.477747+0000, chain.objs.size()=1 2024-09-12T18:01:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.199+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.myVCJ4lmcZ0SeuYncEUashcmWgAW2HD_0 2024-09-12T18:01:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.200+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13624226603438541088', time=2024-09-12T19:53:22.589329+0000, chain.objs.size()=1 2024-09-12T18:01:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.200+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.YMVFMGFoiFX1_Jn_qF9aDqzy49pW9lL_0 2024-09-12T18:01:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11005071609340945292', time=2024-09-12T19:53:22.605974+0000, chain.objs.size()=1 2024-09-12T18:01:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zqqRz7s6IKhQIUdIOWHg0i3ClbtqM7x_0 2024-09-12T18:01:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15197237433460392441', time=2024-09-12T19:53:22.630096+0000, chain.objs.size()=1 2024-09-12T18:01:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4zYTxwiaBDH0Bxahmpq6t3LUJCT8DE8_0 2024-09-12T18:01:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5635461233663300682', time=2024-09-12T19:53:22.644543+0000, chain.objs.size()=1 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kynB5_1b0Vlml9VPnQvRxbYdEmEuTa__0 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4823008678787429990', time=2024-09-12T19:53:23.045600+0000, chain.objs.size()=1 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.265__shadow_.z1PtgXzE7qB8H9p7hl3QKndnlBUn5LW_0 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3233903254147046420', time=2024-09-12T19:53:23.046458+0000, chain.objs.size()=1 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.265__shadow_.TwBKi9XoMtOvhF3PpV17hKtEGnKtWyh_0 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17119536738263549169', time=2024-09-12T19:53:24.266567+0000, chain.objs.size()=1 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.271__shadow_.WVkl-Xhob--NXBSzljZWd2k2AkwHJ5f_0 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13304705553715778097', time=2024-09-12T19:53:25.297845+0000, chain.objs.size()=1 2024-09-12T18:01:05.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.276__shadow_.DwE8LhtS4oZ4CpUyNmPaZbPNuRnKp6m_0 2024-09-12T18:01:05.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10039839713197994454', time=2024-09-12T19:53:26.772342+0000, chain.objs.size()=1 2024-09-12T18:01:05.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.201+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.283__shadow_.9EVpjmtUIzOiZsi1lJF9j8vYuaGXhpq_0 2024-09-12T18:01:05.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.204+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16785286567052858064', time=2024-09-12T19:53:27.435205+0000, chain.objs.size()=1 2024-09-12T18:01:05.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.204+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.286__shadow_.6zI2dgBrVx5lIDv3688jaq7z1x0JEAF_0 2024-09-12T18:01:05.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.205+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3256270620279161867', time=2024-09-12T19:53:27.927585+0000, chain.objs.size()=1 2024-09-12T18:01:05.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.205+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.288__shadow_.w9bQ3VRdSxWifQdfKSqVdx1HekBffon_0 2024-09-12T18:01:05.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.206+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1391782755676964772', time=2024-09-12T19:53:29.357434+0000, chain.objs.size()=1 2024-09-12T18:01:05.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.206+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.Gk9ZI_3XwqX6Z8ouXdqow2XqfJ_umiA_0 2024-09-12T18:01:05.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.206+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4104735059081185822', time=2024-09-12T19:53:44.548839+0000, chain.objs.size()=1 2024-09-12T18:01:05.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.206+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.9KJfbS7_tBcLL0oUFlgqO1ZdgsiW7x5_0 2024-09-12T18:01:05.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.206+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2802580762423704793', time=2024-09-12T19:53:44.602867+0000, chain.objs.size()=1 2024-09-12T18:01:05.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.206+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.h5t4YKTF-bclkJsPHBg3Hsj0O9xv8Qf_0 2024-09-12T18:01:05.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.207+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13307538480478531979', time=2024-09-12T19:53:44.995253+0000, chain.objs.size()=1 2024-09-12T18:01:05.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.207+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Q7ZVUfh5GnABLC7PfhPkltv1KCEuMm-_0 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.207+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9811716491068051802', time=2024-09-12T19:53:45.000911+0000, chain.objs.size()=1 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.207+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_._8dtiT93bcO_FtRNBioYMVlMHJRxieW_0 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11193878223522424899', time=2024-09-12T19:53:45.023488+0000, chain.objs.size()=1 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.3gDETQSQQ3afc_zkI7Q8_BML4CU1shR_0 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9365875622813770828', time=2024-09-12T19:53:45.037942+0000, chain.objs.size()=1 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.CKQ_Gy5Z4Y-YiRZdno8VPiROGd0Gzyt_0 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14530181783313875469', time=2024-09-12T19:53:45.129433+0000, chain.objs.size()=1 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Vgybz7mpiqgGQ-WLe_Xxb8oN0b3UQon_0 2024-09-12T18:01:05.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17436415436856258857', time=2024-09-12T19:53:45.170183+0000, chain.objs.size()=1 2024-09-12T18:01:05.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.208+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0rusTVTyFCJwbezTxuthtxWqEWABzF-_0 2024-09-12T18:01:05.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.210+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14004786161620709368', time=2024-09-12T19:53:45.222792+0000, chain.objs.size()=1 2024-09-12T18:01:05.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.210+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.XgEqJTZE6SxHDAps3IjykqQL4U0JCtg_0 2024-09-12T18:01:05.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5927972863094470906', time=2024-09-12T19:53:45.253973+0000, chain.objs.size()=1 2024-09-12T18:01:05.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MlcakzH4-8rhyZ6YCISl1TaU8HTNQcg_0 2024-09-12T18:01:05.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15959317603522473271', time=2024-09-12T19:53:45.352292+0000, chain.objs.size()=1 2024-09-12T18:01:05.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.55vCMlQ57dQurza8rBlFZfdx-uocbaK_0 2024-09-12T18:01:05.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13722046784541514725', time=2024-09-12T19:53:45.353729+0000, chain.objs.size()=1 2024-09-12T18:01:05.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fDSx7GC3NHEPxfllONCy-eDakUhSzHf_0 2024-09-12T18:01:05.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14723531048153863932', time=2024-09-12T19:53:45.354726+0000, chain.objs.size()=1 2024-09-12T18:01:05.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.fVFf8LEx-LDHfodPeSKQKo0x29gBDve_0 2024-09-12T18:01:05.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8996225059840950009', time=2024-09-12T19:53:45.369197+0000, chain.objs.size()=1 2024-09-12T18:01:05.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.212+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1S3MKEy_6Ghmakj75UV1WBOKxsO5K1q_0 2024-09-12T18:01:05.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.213+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.262555256545253828', time=2024-09-12T19:53:45.392559+0000, chain.objs.size()=1 2024-09-12T18:01:05.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.213+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.r00MY2nJWtBs_lbu3R6eaG1XWpdmyLB_0 2024-09-12T18:01:05.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.213+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16376571972249886955', time=2024-09-12T19:53:45.453893+0000, chain.objs.size()=1 2024-09-12T18:01:05.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.213+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.YUYIVqp3PaTGyob6xaig8ezP8AVd0_y_0 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.215+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12078134159016612992', time=2024-09-12T19:53:45.603532+0000, chain.objs.size()=1 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1OF1Tr-S9CV7YTZwbYUVNdxYwwTyKCj_0 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13750126682268984344', time=2024-09-12T19:53:45.660348+0000, chain.objs.size()=1 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.RbIWEI5JDwaVCkK-trDT_0st1qrnji0_0 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7345350179864473089', time=2024-09-12T19:53:45.738663+0000, chain.objs.size()=1 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.T-nh0bAqHm1_UZHNbNyUL4cjwYXPxoO_0 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1443548617027265857', time=2024-09-12T19:53:45.741690+0000, chain.objs.size()=1 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.W3YFUTgrqGXexMhBWy4cS7aNph3JF14_0 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15960694701073046269', time=2024-09-12T19:53:45.744694+0000, chain.objs.size()=1 2024-09-12T18:01:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6kUxp4r5xsVo2MmnaTykwioB998Omf2_0 2024-09-12T18:01:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8320208382081113176', time=2024-09-12T19:53:45.797201+0000, chain.objs.size()=1 2024-09-12T18:01:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.H-rhdubl60W2Q8tM4p_yMHYsVoxp3LJ_0 2024-09-12T18:01:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1408117060738562208', time=2024-09-12T19:53:45.801279+0000, chain.objs.size()=1 2024-09-12T18:01:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.216+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6dArrj_W_CJb1P0O6sCX9nDutWFFdYD_0 2024-09-12T18:01:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12470370115252523729', time=2024-09-12T19:53:45.958705+0000, chain.objs.size()=1 2024-09-12T18:01:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1ATXOgKEcLxLb8LPT4owoKmRDi2sX-o_0 2024-09-12T18:01:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18436658266964169240', time=2024-09-12T19:53:45.962766+0000, chain.objs.size()=1 2024-09-12T18:01:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.Ik4AeF5YjbvSZ55OxRFx9YCQ7dWo9wa_0 2024-09-12T18:01:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1299954420815798364', time=2024-09-12T19:53:45.993509+0000, chain.objs.size()=1 2024-09-12T18:01:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.JB7rAh2Uhgz6P0GmbMo8a1V8o9aSFKh_0 2024-09-12T18:01:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10138944934949605532', time=2024-09-12T19:53:46.006426+0000, chain.objs.size()=1 2024-09-12T18:01:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.217+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.MAsLynOy8LO5xfF0VJpsKxsPmV9ZL5Z_0 2024-09-12T18:01:05.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.220+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8337616531859297768', time=2024-09-12T19:53:46.045232+0000, chain.objs.size()=1 2024-09-12T18:01:05.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.220+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ou7vVw3-SZspjs3vmAQiSU94fRmFFWT_0 2024-09-12T18:01:05.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16406759837094651745', time=2024-09-12T19:53:46.059340+0000, chain.objs.size()=1 2024-09-12T18:01:05.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.HfUkbos79bV0T6GwavLMhO-wTgyP4_7_0 2024-09-12T18:01:05.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14712492704697231375', time=2024-09-12T19:53:46.159114+0000, chain.objs.size()=1 2024-09-12T18:01:05.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.6XOhbbb_HCq57opT3lAgql9wk0gcOKJ_0 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9881612979331489328', time=2024-09-12T19:53:46.173915+0000, chain.objs.size()=1 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.uSkLy51ogh_gDwGq36opFbeIfA10xHH_0 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14801103821884546845', time=2024-09-12T19:53:46.177281+0000, chain.objs.size()=1 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ukOOKaYufDor-rbccRu8dHo5TZQtFlS_0 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17788454949913061125', time=2024-09-12T19:53:46.246133+0000, chain.objs.size()=1 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.BX52UFwfz7ZYCCB-odV-zcp6zKBCcWi_0 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6633651910190672558', time=2024-09-12T19:53:54.679807+0000, chain.objs.size()=1 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6fzIHYGCQ7ccfye2qRUVuWX5dMpBmSX_0 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14616427815302141725', time=2024-09-12T19:53:54.874073+0000, chain.objs.size()=1 2024-09-12T18:01:05.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.221+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.rDMKYgvUiSByZItm7dlio-PYfYxCRw2_0 2024-09-12T18:01:05.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.223+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4572775030364571528', time=2024-09-12T19:53:54.880285+0000, chain.objs.size()=1 2024-09-12T18:01:05.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.223+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.30fGN3y-A5WH9bzjU7mFBKwSwQjmWxz_0 2024-09-12T18:01:05.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.223+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.427617739906632011', time=2024-09-12T19:53:54.905328+0000, chain.objs.size()=1 2024-09-12T18:01:05.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.223+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xduFwKtBXksh9vXNGg1QwxQDlv6Tnsl_0 2024-09-12T18:01:05.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.223+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6061130080401193044', time=2024-09-12T19:53:55.055127+0000, chain.objs.size()=1 2024-09-12T18:01:05.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.223+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Pwt2zqe-BfQrRq8XBUIrZw1A0B8q2CH_0 2024-09-12T18:01:05.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15111961517621815729', time=2024-09-12T19:53:55.057930+0000, chain.objs.size()=1 2024-09-12T18:01:05.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BxmUvvWN5MMWNrHHg3oQ1ofgdZ7j71G_0 2024-09-12T18:01:05.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17908788845009021253', time=2024-09-12T19:53:55.096674+0000, chain.objs.size()=1 2024-09-12T18:01:05.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.vS46ndMXqFjqlHi8wBXgYp4xJadVs4p_0 2024-09-12T18:01:05.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9518740301453852288', time=2024-09-12T19:53:55.099531+0000, chain.objs.size()=1 2024-09-12T18:01:05.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.QWQ9HNKZ5tV1UhtZMCZl2aFgHUd7api_0 2024-09-12T18:01:05.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10964687803189797126', time=2024-09-12T19:53:55.105224+0000, chain.objs.size()=1 2024-09-12T18:01:05.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.226+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.CQFJunzkomWUMaSDwHKDL5klN5lbTdl_0 2024-09-12T18:01:05.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4301198897515873182', time=2024-09-12T19:53:55.107877+0000, chain.objs.size()=1 2024-09-12T18:01:05.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.OAJWZ3al0hWEpnwz22uRrFzAcyy5arD_0 2024-09-12T18:01:05.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5634949366192792255', time=2024-09-12T19:53:55.126363+0000, chain.objs.size()=1 2024-09-12T18:01:05.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.to4d96RvwXE-8ImeqDhl-2Uun7UWSfZ_0 2024-09-12T18:01:05.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15109119945022238069', time=2024-09-12T19:53:55.263454+0000, chain.objs.size()=1 2024-09-12T18:01:05.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.oQXDVtQXquevriwLO9mEwG8IyAqvHii_0 2024-09-12T18:01:05.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3586508451035709295', time=2024-09-12T19:53:55.284841+0000, chain.objs.size()=1 2024-09-12T18:01:05.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.228+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.FbOz_VxR7R6x50UzZwsA_A5R3Sqw7Vq_0 2024-09-12T18:01:05.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.229+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16545890249601746807', time=2024-09-12T19:53:55.315436+0000, chain.objs.size()=1 2024-09-12T18:01:05.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.229+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aqmGpAdz5NdG5uRbJ4ZKwiocul8eS7W_0 2024-09-12T18:01:05.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.229+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15791998990545046088', time=2024-09-12T19:53:55.337915+0000, chain.objs.size()=1 2024-09-12T18:01:05.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.229+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7li0Oigjo98NwSVddZt_TRxpA5TOlIz_0 2024-09-12T18:01:05.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.230+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4585951343667328119', time=2024-09-12T19:53:55.519727+0000, chain.objs.size()=1 2024-09-12T18:01:05.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.230+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._kIe4X2BpbhoAwY4ouamHzxK-fuUTTs_0 2024-09-12T18:01:05.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.231+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18360732364085982897', time=2024-09-12T19:53:55.542380+0000, chain.objs.size()=1 2024-09-12T18:01:05.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.231+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.EMjENMTP6CI9PueAgV4tO8KLdJc56S1_0 2024-09-12T18:01:05.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.232+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2620104874350533527', time=2024-09-12T19:53:55.546608+0000, chain.objs.size()=1 2024-09-12T18:01:05.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.232+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-VzYGRzAFSKzeBD9sYfmHEddLDTEBH3_0 2024-09-12T18:01:05.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.235+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/50220 2024-09-12T18:01:05.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4004988230766681969', time=2024-09-12T19:53:55.570914+0000, chain.objs.size()=1 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zpNaXYZAXIeHWXFSdPl_CGjjIKpHvTE_0 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4639931638764899563', time=2024-09-12T19:53:55.577573+0000, chain.objs.size()=1 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.NRcF8vnxOcs5hxbwDRx4Hek5Ltkahb9_0 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17021960648504581677', time=2024-09-12T19:53:55.610148+0000, chain.objs.size()=1 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.BDGXoHtQxDKQgChdrLsARD9-eLxtHsr_0 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1928487995231503649', time=2024-09-12T19:53:55.617754+0000, chain.objs.size()=1 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.yHd7wCGJjFTmos7HWLdznOJtMFOxw-U_0 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3190671441484963406', time=2024-09-12T19:53:55.767281+0000, chain.objs.size()=1 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.s5ObigBvijJ5-GZNUqwX0iaC9izs0BX_0 2024-09-12T18:01:05.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14947415265451866469', time=2024-09-12T19:53:55.808018+0000, chain.objs.size()=1 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.UDn9QzfT1V3-jcs8mdsw5pcd_bTxreH_0 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4363952857254724789', time=2024-09-12T19:53:55.912874+0000, chain.objs.size()=1 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.E2nNl60atUPTfD4Vyp5EdnINsAkrdHc_0 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16235765416311620480', time=2024-09-12T19:53:55.924219+0000, chain.objs.size()=1 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.LUuWliqMQDLUoOTmfNNUdnBTkegxE43_0 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3363425537024286425', time=2024-09-12T19:53:56.017641+0000, chain.objs.size()=1 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.usbxdiIsNmmf1mYTmu9SG3pMNxOyppM_0 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4331604334221550020', time=2024-09-12T19:53:56.119435+0000, chain.objs.size()=1 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.hBAagmC_724SIgTpeO-8efDUNhVzsfP_0 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3329704460551497206', time=2024-09-12T19:53:56.134530+0000, chain.objs.size()=1 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.3yI_xWzN3v4lhOjf1te6QvUaPr2HKwC_0 2024-09-12T18:01:05.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2863399626684244082', time=2024-09-12T19:53:56.136366+0000, chain.objs.size()=1 2024-09-12T18:01:05.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.238+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.avViSWj1AgaDzYZVpEs7HG3wUqE4D8i_0 2024-09-12T18:01:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17848724399805171735', time=2024-09-12T19:53:56.182708+0000, chain.objs.size()=1 2024-09-12T18:01:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.KVya6aa0ZlfQ607UIP7ytqWLEsF3btu_0 2024-09-12T18:01:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2569854598560018504', time=2024-09-12T19:53:57.091104+0000, chain.objs.size()=1 2024-09-12T18:01:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.330__shadow_.-cDKtFATFRVRFWyWkaoKBl4h_EmB2s__0 2024-09-12T18:01:05.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14302683994920897243', time=2024-09-12T19:53:59.044216+0000, chain.objs.size()=1 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.340__shadow_.hLHT-zkxxRrr-_HqQ4m9qBQpiCdE60E_0 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12375400801131105142', time=2024-09-12T19:54:22.221275+0000, chain.objs.size()=1 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.445__shadow_.EweeODi2obbwsxkKi4eRROzEgHdm8A0_0 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11399870268062608015', time=2024-09-12T19:54:28.154958+0000, chain.objs.size()=1 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.466__shadow_.XOk6vZLJPm2dutVlijc-QNE7cRmv1LD_0 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10621700732545598023', time=2024-09-12T19:54:31.213081+0000, chain.objs.size()=1 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.484__shadow_.zgKfD_1wT69VWajakIpx6HDXGtlaqqR_0 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13890364303059721177', time=2024-09-12T19:54:31.433448+0000, chain.objs.size()=1 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.485__shadow_.E4AwWHCOSC84OIKHNFr9kOpUNK_Cu4l_0 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7894114222878470552', time=2024-09-12T19:54:49.842941+0000, chain.objs.size()=2 2024-09-12T18:01:05.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~0sGJIhdISKlncVFwTwF6eG7L9PMKKJ6.1 2024-09-12T18:01:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~0sGJIhdISKlncVFwTwF6eG7L9PMKKJ6.2 2024-09-12T18:01:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2867232633670525023', time=2024-09-12T19:55:22.529325+0000, chain.objs.size()=1 2024-09-12T18:01:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.242+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.551__shadow_.nSANMg5asdOxM_yPjCrVo1sWH20Vc9B_0 2024-09-12T18:01:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.243+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13765464115472748309', time=2024-09-12T19:55:34.648093+0000, chain.objs.size()=1 2024-09-12T18:01:05.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.243+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.570__shadow:bRLa.JW1b2tcJBJR6U5ub2hWjgbeCoM_.zi_i86KV5ln-PjX-77K18l-08iUTf4V_0 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17480616732155431392', time=2024-09-12T19:55:41.568232+0000, chain.objs.size()=1 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:22VO8gPtxVwRIpY9Oqjz5ldVR9hClx6_.VS9J7n3V0JcAVrpgrjUhwXsmmReShYj_0 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14253508098574582173', time=2024-09-12T19:55:41.930408+0000, chain.objs.size()=1 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.575__shadow:i.MaftIO29eyordnNMnLuKBZ12lajpM_.aYyYKvYgxgiqNXX1UEOgpdjlLOjB6Q3_0 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3280375713712939408', time=2024-09-12T19:55:46.465896+0000, chain.objs.size()=1 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.577__shadow:azvPzfiRysKlfDyQw-8E.n4FKXMD5FU_.BS1lH2bEQ-aIbxcDuORWCYyQOAqSk1E_0 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8100158301354629858', time=2024-09-12T19:56:03.081544+0000, chain.objs.size()=1 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.581__shadow:6OQFdRzGi.ynuCPaE4dP4RwUZjL9Sev_.HFzP5Z_2qQMprS5fGwgqifwSZ_OqWc7_0 2024-09-12T18:01:05.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9311416907565246433', time=2024-09-12T19:58:20.989760+0000, chain.objs.size()=1 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.635__shadow_.8hrWzbb0NO3P1DDtfmslsZP2cS6TCpQ_0 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10567969352078050163', time=2024-09-12T19:58:29.456459+0000, chain.objs.size()=6 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.663__multipart_foo.2~b5IqIfltYxJQalz8RMSxoXnbS2pt-cO.1 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.663__multipart_foo.2~b5IqIfltYxJQalz8RMSxoXnbS2pt-cO.2 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.663__multipart_foo.2~b5IqIfltYxJQalz8RMSxoXnbS2pt-cO.3 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.663__multipart_foo.2~b5IqIfltYxJQalz8RMSxoXnbS2pt-cO.4 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.663__multipart_foo.2~b5IqIfltYxJQalz8RMSxoXnbS2pt-cO.5 2024-09-12T18:01:05.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.249+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.663__multipart_foo.2~b5IqIfltYxJQalz8RMSxoXnbS2pt-cO.6 2024-09-12T18:01:05.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15319453900468568607', time=2024-09-12T19:58:36.585515+0000, chain.objs.size()=1 2024-09-12T18:01:05.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.697__shadow:IsRlZ2adoYUg83nISzZk3Y6I4Asaf7u_.TMTbMyE2Enmd49_t8KRmBdypyZE4ZKd_0 2024-09-12T18:01:05.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1783747516965652051', time=2024-09-12T19:58:38.472567+0000, chain.objs.size()=1 2024-09-12T18:01:05.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.705__shadow:lCZBwWvdczgSI7trwOTLb8SzzoymRSf_.TC6Np0a4nsPy6mBa1JO39edzCvWznpH_0 2024-09-12T18:01:05.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16615970523101469332', time=2024-09-12T19:59:05.677217+0000, chain.objs.size()=10 2024-09-12T18:01:05.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.1 2024-09-12T18:01:05.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.2 2024-09-12T18:01:05.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.3 2024-09-12T18:01:05.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.4 2024-09-12T18:01:05.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.253+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.5 2024-09-12T18:01:05.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.256+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.6 2024-09-12T18:01:05.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.256+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.7 2024-09-12T18:01:05.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.256+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.8 2024-09-12T18:01:05.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.256+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.9 2024-09-12T18:01:05.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.257+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.736__multipart_foo.2~ZIYtJWwgUoQfhi4N1_CRg5aKZNCi4fW.10 2024-09-12T18:01:05.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.261+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:05.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.264+0000 7fe4cd498800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:01:05.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.265+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:05.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:05.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45338' 2024-09-12T18:01:05.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZXu5aOIeKLzyxCeCGGhhSBrBlKw-k3E', time=2024-09-12T19:52:17.404062+0000, chain.objs.size()=1 2024-09-12T18:01:05.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.202__multipart_mymultipart.2~ZXu5aOIeKLzyxCeCGGhhSBrBlKw-k3E.1 2024-09-12T18:01:05.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16854624488300953031', time=2024-09-12T19:53:07.002746+0000, chain.objs.size()=1 2024-09-12T18:01:05.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.234__shadow_.2hi470H5_yL5t56yQmEzA7XDgB6gCr1_0 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7217040575460623043', time=2024-09-12T19:53:09.702978+0000, chain.objs.size()=1 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.246__shadow_.NWMd0GKB1Z34Gtwl2XX3JnAsU2xP-V8_0 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5115419547497328648', time=2024-09-12T19:53:12.426870+0000, chain.objs.size()=1 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.259__shadow_.EFFIVakT2tFIcgHPb98RGxpkE-SXv3Y_0 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17238417617372905037', time=2024-09-12T19:53:21.191787+0000, chain.objs.size()=1 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.e48lc8wPJrN26dNXD4hM17dVgOUNqUu_0 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7848410349429772582', time=2024-09-12T19:53:21.226362+0000, chain.objs.size()=1 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.zL1eK4b3pWGtATqIw4VdgdXPnfLBkQ9_0 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4924255196863366799', time=2024-09-12T19:53:21.231070+0000, chain.objs.size()=1 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.4Vp9mDiK6o9LrRqdwgRnQpZPRKy4zDz_0 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8534393664840106004', time=2024-09-12T19:53:21.244729+0000, chain.objs.size()=1 2024-09-12T18:01:05.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.S1IqJmq26HAOuOiU4vUmOchkzqTxAkG_0 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14997061277564882740', time=2024-09-12T19:53:21.251380+0000, chain.objs.size()=1 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.obpoHjbgwQS3aE_pRtPYR26n4m65PRF_0 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4536012369542496782', time=2024-09-12T19:53:21.257808+0000, chain.objs.size()=1 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.IT_l4AWU3hVTO7qp3c5BiIzXw7u9YE3_0 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4645138571443584421', time=2024-09-12T19:53:21.275233+0000, chain.objs.size()=1 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.266+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.cb5s5YxVK-nCbFTbzCw5bSh9jAtF5wG_0 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.267+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14118790670648643827', time=2024-09-12T19:53:21.283664+0000, chain.objs.size()=1 2024-09-12T18:01:05.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.267+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pvwVLepcqqSQK2uV3PSjMz3OJE6rnOR_0 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14125760376926774118', time=2024-09-12T19:53:21.369837+0000, chain.objs.size()=1 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.2-NwQ5wtVFFAXaDWrFA6gVPahnAjtab_0 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3477747470241696073', time=2024-09-12T19:53:21.426191+0000, chain.objs.size()=1 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.5X7vXpNBSUX7-VykWz5T61lKPmrnEMP_0 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4385339442749884288', time=2024-09-12T19:53:21.580052+0000, chain.objs.size()=1 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Su8jnJhBOR79hjrmssXDROrZ1mX4bky_0 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3332403780573567693', time=2024-09-12T19:53:21.598191+0000, chain.objs.size()=1 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.BrtQmMN1D-LvxNL-FOLtUUjPMkMlFhv_0 2024-09-12T18:01:05.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6503967508209234677', time=2024-09-12T19:53:21.624910+0000, chain.objs.size()=1 2024-09-12T18:01:05.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.241ioRYgDiRxwb30-iVKf8Ny1akCKH6_0 2024-09-12T18:01:05.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7178602868580091561', time=2024-09-12T19:53:21.670461+0000, chain.objs.size()=1 2024-09-12T18:01:05.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.8dzXf7L0I7M6oHP_kWC7RnLAG7DWQyT_0 2024-09-12T18:01:05.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.271+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8553712497311453210', time=2024-09-12T19:53:21.776048+0000, chain.objs.size()=1 2024-09-12T18:01:05.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.p-0urBdl8VKMsSMv4tWPyw2FpjNTgVA_0 2024-09-12T18:01:05.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5827836723012827689', time=2024-09-12T19:53:21.798301+0000, chain.objs.size()=1 2024-09-12T18:01:05.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.kmzBkamky2rNqOyOuqJY3rKIvkg8PdF_0 2024-09-12T18:01:05.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4919568592806975188', time=2024-09-12T19:53:21.801347+0000, chain.objs.size()=1 2024-09-12T18:01:05.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.f2osjlz4ZMV8UAay0EbzKd0zNyejNDl_0 2024-09-12T18:01:05.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11884355666818531642', time=2024-09-12T19:53:21.868447+0000, chain.objs.size()=1 2024-09-12T18:01:05.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.Zmh4DKoIKdsDhgtd4e98VY6sbJRNZDI_0 2024-09-12T18:01:05.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15818805942346429562', time=2024-09-12T19:53:21.883971+0000, chain.objs.size()=1 2024-09-12T18:01:05.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.272+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.pt69qjJZcpdxFxcrtEWB7iawgs_9ca9_0 2024-09-12T18:01:05.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.275+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1108606022950496250', time=2024-09-12T19:53:22.014397+0000, chain.objs.size()=1 2024-09-12T18:01:05.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.275+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.NX3wqvvcNHwZzwi6KPJxxGs9e5ViHPC_0 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13738510074922837506', time=2024-09-12T19:53:22.018142+0000, chain.objs.size()=1 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.CTml8f9NP2Td_WONuOPY19EWa4ra_XS_0 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4405279328057271800', time=2024-09-12T19:53:22.042026+0000, chain.objs.size()=1 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.1e1yR0Reo2zlfnEIxYWp5nRbCZE17iM_0 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3748892859596998520', time=2024-09-12T19:53:22.061024+0000, chain.objs.size()=1 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.95PIOUMMpnszadoZZRagwVCJZRzXYm0_0 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17764276542961318617', time=2024-09-12T19:53:22.068532+0000, chain.objs.size()=1 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.HyXR9WXMk8U52lK5LLtCru_o2twoXqN_0 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1000797604637469750', time=2024-09-12T19:53:22.184523+0000, chain.objs.size()=1 2024-09-12T18:01:05.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.276+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fibvqrVmtEkJAXFZgsWmgPJbXoKw_4j_0 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3436291732796864374', time=2024-09-12T19:53:22.277616+0000, chain.objs.size()=1 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.PA7ORQzkyR1wXD_JgDSzyIDiqdqbTwS_0 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.211631677085176556', time=2024-09-12T19:53:22.284694+0000, chain.objs.size()=1 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.71-9QSiN6ymw-TF6y_xemJID0dKMl_9_0 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12266592863092169816', time=2024-09-12T19:53:22.287953+0000, chain.objs.size()=1 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.fabOGKFVYl1JtzkqRJVqhqYoDLXJGKi_0 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7659072224591140957', time=2024-09-12T19:53:22.296904+0000, chain.objs.size()=1 2024-09-12T18:01:05.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.yD8UxjSaWPqIYw3f3sTIrc5A0mdc6gE_0 2024-09-12T18:01:05.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15724896144818575715', time=2024-09-12T19:53:22.475898+0000, chain.objs.size()=1 2024-09-12T18:01:05.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.277+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.263__shadow_.T1cEk7c-D7r_SfpYeuoGZ7A5BYmaWQC_0 2024-09-12T18:01:05.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.279+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12199612970356635505', time=2024-09-12T19:53:24.857757+0000, chain.objs.size()=1 2024-09-12T18:01:05.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.279+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.274__shadow_.IMWMD_sBehx4_zR0E5cREJInGxHbwtE_0 2024-09-12T18:01:05.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.279+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3007951762717849415', time=2024-09-12T19:53:25.297071+0000, chain.objs.size()=1 2024-09-12T18:01:05.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.279+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.276__shadow_.M1LiuumoXJUJtGAFpgdcj_HbxFPLMHp_0 2024-09-12T18:01:05.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.280+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6649974943022409003', time=2024-09-12T19:53:25.504555+0000, chain.objs.size()=1 2024-09-12T18:01:05.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.280+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.277__shadow_.qoJbCbejl8LlZZG_64HJIkTDwPh3HTs_0 2024-09-12T18:01:05.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.280+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2725049776904353613', time=2024-09-12T19:53:25.913432+0000, chain.objs.size()=1 2024-09-12T18:01:05.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.280+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.279__shadow_.M_ukMavhfrEUcE7IFOBbUJItj1wavrS_0 2024-09-12T18:01:05.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.282+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14778301090838077449', time=2024-09-12T19:53:26.323845+0000, chain.objs.size()=1 2024-09-12T18:01:05.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.282+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.281__shadow_.xR6fFPscRZHwC2NTHWPUtaJQzf5kdVK_0 2024-09-12T18:01:05.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.282+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7408141978561306556', time=2024-09-12T19:53:29.341983+0000, chain.objs.size()=1 2024-09-12T18:01:05.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.282+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.293__shadow_.OVFOUdqcEqhmebs9QcdHcR6rVbDeIdS_0 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1101759439315837808', time=2024-09-12T19:53:30.344815+0000, chain.objs.size()=1 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.296__shadow_.a1RrTOSOuvKiUBYgp0YErKB-DPFXxTR_0 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3497913760079358822', time=2024-09-12T19:53:33.007627+0000, chain.objs.size()=1 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.307__shadow_.8Y7vIYgqj08fGkSm0-U_wWfC_5kr_VM_0 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1076812255119376771', time=2024-09-12T19:53:35.447939+0000, chain.objs.size()=1 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.320__shadow:LVvVpD6MOULe0IBELdQ5zBFDeISN7xB_.PHJC6bQ_vMlmsoU7Fj5Jk3PV90t6acB_0 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5678466143575003363', time=2024-09-12T19:53:44.553163+0000, chain.objs.size()=1 2024-09-12T18:01:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.ZJ2OvbS1iY6GQvFrDkGP6p5rK3GEAeJ_0 2024-09-12T18:01:05.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12622891913232760138', time=2024-09-12T19:53:44.583356+0000, chain.objs.size()=1 2024-09-12T18:01:05.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.hVIY0dlIwXT-jPqk3oveFdLXM_P_dTK_0 2024-09-12T18:01:05.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6648867481333730585', time=2024-09-12T19:53:44.591837+0000, chain.objs.size()=1 2024-09-12T18:01:05.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.285+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FGsZrNQpj9QtjqsWx9Ix36Ht6gNM8Ld_0 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.12881158265625531137', time=2024-09-12T19:53:44.628227+0000, chain.objs.size()=1 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4kyFqrsmfgsfzS7KuhnEg76O-5cTKa4_0 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13280233325752022517', time=2024-09-12T19:53:44.962899+0000, chain.objs.size()=1 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.0tium424czCPypvIKW5TxU7agzS8utt_0 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9229185859604164691', time=2024-09-12T19:53:45.024604+0000, chain.objs.size()=1 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.EZi-C3IyNQKfgIsOw5kQiHgal4DjK7R_0 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3192714728036097864', time=2024-09-12T19:53:45.189114+0000, chain.objs.size()=1 2024-09-12T18:01:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.5CTtQ_6wjD-8cBJxF2MOFM8PA3KDrvd_0 2024-09-12T18:01:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6078274010313625522', time=2024-09-12T19:53:45.196739+0000, chain.objs.size()=1 2024-09-12T18:01:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oRejM8rPH47XKp9OpiBnQ2OnZssGLEr_0 2024-09-12T18:01:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3701727616384934120', time=2024-09-12T19:53:45.350163+0000, chain.objs.size()=1 2024-09-12T18:01:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.287+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.4EMgQAhIKfP3NMOy6RJles9nGGXGICQ_0 2024-09-12T18:01:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.288+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14069674225704869609', time=2024-09-12T19:53:45.380862+0000, chain.objs.size()=1 2024-09-12T18:01:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.288+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.dBmETrYNEABBZ1Z51Wu4nzmPcKF5pPM_0 2024-09-12T18:01:05.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.289+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17374267759445348628', time=2024-09-12T19:53:45.421755+0000, chain.objs.size()=1 2024-09-12T18:01:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.289+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.GUT_yevp8_ZhP429ejQYeLxv6iar8vN_0 2024-09-12T18:01:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.290+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.641227048011576650', time=2024-09-12T19:53:45.422516+0000, chain.objs.size()=1 2024-09-12T18:01:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.290+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.oP-D89RiUi64IV3V3HaNz22OLn729cq_0 2024-09-12T18:01:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.290+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6470567912554276364', time=2024-09-12T19:53:45.435358+0000, chain.objs.size()=1 2024-09-12T18:01:05.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.290+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.FPvTSzreaH_ck38i3_wkZvresfj6Wpc_0 2024-09-12T18:01:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.291+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4731554019742604653', time=2024-09-12T19:53:45.598911+0000, chain.objs.size()=1 2024-09-12T18:01:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.291+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.r0leV8ywlFf8w0JDVLDOpRj6--Ye4Br_0 2024-09-12T18:01:05.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.293+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4678135976771186729', time=2024-09-12T19:53:45.608048+0000, chain.objs.size()=1 2024-09-12T18:01:05.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.293+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.-j99uarmIIW-waXHgd9GtGn7HuibGMf_0 2024-09-12T18:01:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9275361270464863748', time=2024-09-12T19:53:45.608658+0000, chain.objs.size()=1 2024-09-12T18:01:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.r4mka_IcYXp2u2atrwbSKTJYbZTZs_f_0 2024-09-12T18:01:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5988342693600256095', time=2024-09-12T19:53:45.746880+0000, chain.objs.size()=1 2024-09-12T18:01:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.tFOjfcsPFDrX-Zk-SmO90TJ0JHsahgW_0 2024-09-12T18:01:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.2354671116787912251', time=2024-09-12T19:53:45.784023+0000, chain.objs.size()=1 2024-09-12T18:01:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.rmC-jYonP9bczKP6Qxfuvh1S-Bp-OP2_0 2024-09-12T18:01:05.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1393372058484817771', time=2024-09-12T19:53:45.798527+0000, chain.objs.size()=1 2024-09-12T18:01:05.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.gxjjeHxPtqKFustzgvO74OgswBUrG-F_0 2024-09-12T18:01:05.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7126994090445426067', time=2024-09-12T19:53:45.848377+0000, chain.objs.size()=1 2024-09-12T18:01:05.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.1GEUabLkkgO049N-bSjPVqiGPqdKMZ9_0 2024-09-12T18:01:05.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13794936907764123194', time=2024-09-12T19:53:45.850506+0000, chain.objs.size()=1 2024-09-12T18:01:05.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.295+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.SB0JEPqxcDZl2dvBksZzJaocXFjCjWD_0 2024-09-12T18:01:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17557543870612371702', time=2024-09-12T19:53:46.010670+0000, chain.objs.size()=1 2024-09-12T18:01:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.iPC9Y7XX6RiZsCKLaIw5wG-q84gSzNi_0 2024-09-12T18:01:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.299+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.11347156536519776401', time=2024-09-12T19:53:46.046337+0000, chain.objs.size()=1 2024-09-12T18:01:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.299+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.324__shadow_.WDqGs17jQS4IsW0PINQD-lTLKxgW6mx_0 2024-09-12T18:01:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15956733286444678646', time=2024-09-12T19:53:54.634593+0000, chain.objs.size()=1 2024-09-12T18:01:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6XMt1NEnR19TQrCl4Tx3tfGlFE1tyfW_0 2024-09-12T18:01:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.337100314484576688', time=2024-09-12T19:53:54.639487+0000, chain.objs.size()=1 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xm7arJvYtHeTQsdKQaz6M7yOfRQ2tGw_0 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3143627693111027481', time=2024-09-12T19:53:54.640324+0000, chain.objs.size()=1 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xMwjKUJ6taFA0md2ZMSXCFhN9auGmCS_0 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9689747102576995098', time=2024-09-12T19:53:54.656856+0000, chain.objs.size()=1 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.1ABl6UFRMgkIWVr4ZQCDlSNM4z_jNWG_0 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13449626778504756893', time=2024-09-12T19:53:54.667909+0000, chain.objs.size()=1 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.wCQnydu1oOK8F0d0x7pD15tr1N1gyd2_0 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17215635152288210602', time=2024-09-12T19:53:54.725543+0000, chain.objs.size()=1 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.cKYVrNwhBgP7hLFkKVmLQZyUTCdblZw_0 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.15029618490397095949', time=2024-09-12T19:53:54.889914+0000, chain.objs.size()=1 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.-fKDaEpaXNOGSRjTBfjQggrb3EK92kD_0 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1544134873203891486', time=2024-09-12T19:53:54.953690+0000, chain.objs.size()=1 2024-09-12T18:01:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.w5jAksRFJAq8kwZB8FV3U7SD7prP3fw_0 2024-09-12T18:01:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5337177176701624857', time=2024-09-12T19:53:54.956831+0000, chain.objs.size()=1 2024-09-12T18:01:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.300+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.p0VqbZySUgL2mE-5eeLz2QpxFMls50a_0 2024-09-12T18:01:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.305+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.722399616621829257', time=2024-09-12T19:53:54.963012+0000, chain.objs.size()=1 2024-09-12T18:01:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.305+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.r7fa7MTQDO0V5PMwDJOlx2qMJxbK9uQ_0 2024-09-12T18:01:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.305+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5387657731113215523', time=2024-09-12T19:53:55.065350+0000, chain.objs.size()=1 2024-09-12T18:01:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.305+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.L7uvR_B0sMMZPDsiifOd858lf67pz7K_0 2024-09-12T18:01:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.305+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9276053878015998014', time=2024-09-12T19:53:55.174408+0000, chain.objs.size()=1 2024-09-12T18:01:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.305+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.IElMt5KkEh7VEk9CQSrvhZD4xFIViLZ_0 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1817827234604110888', time=2024-09-12T19:53:55.274988+0000, chain.objs.size()=1 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.zx2vRYRMvlHzY3DBtTsqW3jodZqH9aP_0 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3256159250905652481', time=2024-09-12T19:53:55.345833+0000, chain.objs.size()=1 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.o0spH0mK69DhP_Ix-j4fvlMzB6Xxz8T_0 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9622865041372097655', time=2024-09-12T19:53:55.349242+0000, chain.objs.size()=1 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tXFDHlncV9ZOyhgmT74_NYRASkQbMlf_0 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4960081150200282516', time=2024-09-12T19:53:55.386534+0000, chain.objs.size()=1 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._CNm3Tyk2Xqg4uXt3ayg6XYT8f8ikVV_0 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16575664761411784092', time=2024-09-12T19:53:55.500487+0000, chain.objs.size()=1 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.d6uoDjiCIWeaRwLj9F97O2Zxb_jLtiZ_0 2024-09-12T18:01:05.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13802617651442292203', time=2024-09-12T19:53:55.532890+0000, chain.objs.size()=1 2024-09-12T18:01:05.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7tonq3Ro9jRWd7-Rg-L8ejDwZmqRqq6_0 2024-09-12T18:01:05.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14295477694222825424', time=2024-09-12T19:53:55.600679+0000, chain.objs.size()=1 2024-09-12T18:01:05.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.2EXP6tbf44Rwc-aB8qb9bcjRa1lLewn_0 2024-09-12T18:01:05.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16627537432992149650', time=2024-09-12T19:53:55.601612+0000, chain.objs.size()=1 2024-09-12T18:01:05.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.307+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.tQysOtCp5zYgDZcWoEqgK-5ifq4o28u_0 2024-09-12T18:01:05.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.309+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9817795839363316969', time=2024-09-12T19:53:55.620654+0000, chain.objs.size()=1 2024-09-12T18:01:05.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.309+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.4XgCRivOkvIYpDptjcFwIe30p0AyIJ0_0 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4284272485776824621', time=2024-09-12T19:53:55.701139+0000, chain.objs.size()=1 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.uhi9LmPGbqmX7HSFCssNiz9m4b6txmk_0 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17536512876832238561', time=2024-09-12T19:53:55.701956+0000, chain.objs.size()=1 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.XyaYMfcjZBf3kkvQ0wBgzQ0x-jmaStL_0 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4670700950094866786', time=2024-09-12T19:53:55.704483+0000, chain.objs.size()=1 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.aZYttXKPAFhpWbtDz8RnKR15pP3IMxT_0 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8488478616934328667', time=2024-09-12T19:53:55.706008+0000, chain.objs.size()=1 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.AgZAAhilG6PvBMnFko_XNZYsLBj9zhw_0 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10872202642430044338', time=2024-09-12T19:53:55.717744+0000, chain.objs.size()=1 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.311+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.xTO25GxgBv2On-q_VWdasnYhx1R_AmN_0 2024-09-12T18:01:05.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.8533358369904150651', time=2024-09-12T19:53:55.736458+0000, chain.objs.size()=1 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.lXpho4i3L2yefQGOUNSxINKlRMBmRmf_0 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.18442764033810007213', time=2024-09-12T19:53:55.754602+0000, chain.objs.size()=1 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.6BUSgbcbK7fOGrZK1Ul9m1zSbpZK0r8_0 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6851007326676084299', time=2024-09-12T19:53:55.790907+0000, chain.objs.size()=1 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Xu9Z3nKL1UwglPmZZ-2fVGDJfRMg-6V_0 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4259417285467283739', time=2024-09-12T19:53:55.960103+0000, chain.objs.size()=1 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_._6Sc1cFrzm9FCUGagNjCzhUpjZYqBqZ_0 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5791221389311830555', time=2024-09-12T19:53:56.001943+0000, chain.objs.size()=1 2024-09-12T18:01:05.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.312+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.Rxvs1V4gl-OXbOFZ2xmnituOqQEXqM5_0 2024-09-12T18:01:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.314+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.3843161369158053740', time=2024-09-12T19:53:56.002614+0000, chain.objs.size()=1 2024-09-12T18:01:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.314+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.007k3qIPlNMnvepdCzyp-ZLQGCeonuQ_0 2024-09-12T18:01:05.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.316+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9553116060619775793', time=2024-09-12T19:53:56.118087+0000, chain.objs.size()=1 2024-09-12T18:01:05.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.316+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.JoRY2KYT17IaLsTnow8PpwSE_mpSXM5_0 2024-09-12T18:01:05.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.317+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5721100826556109297', time=2024-09-12T19:53:56.132725+0000, chain.objs.size()=1 2024-09-12T18:01:05.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.317+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.7NTg6-_dC12p5veQQg3fce3oK1kW9Fx_0 2024-09-12T18:01:05.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.319+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 0/45338 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.321+0000 7fe4cd498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.321+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.10153950020983246411', time=2024-09-12T19:53:56.167868+0000, chain.objs.size()=1 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.325__shadow_.fv2NIKA2SQaIqf7CLF8Da8XUnCSIKse_0 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.14725851388033474438', time=2024-09-12T19:54:09.532129+0000, chain.objs.size()=1 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.391__shadow_.p7EFcvv74SsA9MpF9Sl1JE2-CNg8gmi_0 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.13455863244375681705', time=2024-09-12T19:54:14.899115+0000, chain.objs.size()=1 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.409__shadow_.a-xReButKAfzbYDtvwawwViXp0_tTi0_0 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.6708302367452228658', time=2024-09-12T19:54:25.726945+0000, chain.objs.size()=1 2024-09-12T18:01:05.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.459__shadow_.ULNg1OXQgLY35vxkKkpJiVw92iCVJ8o_0 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.389108287183483058', time=2024-09-12T19:54:28.036978+0000, chain.objs.size()=1 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.466__shadow_.KKGo8FKuWinBnXEfIQU4RpU82ZsryP1_0 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.9807945727234900613', time=2024-09-12T19:54:32.327576+0000, chain.objs.size()=1 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.488__shadow_.HnTOqjha6UJw0EUWR048Kq9kCHpSuHU_0 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.5246488251893376148', time=2024-09-12T19:54:33.387121+0000, chain.objs.size()=1 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.492__shadow_.ZOkOKe-kPJtoEZO0Tb-LBbqR5neOAor_0 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.16584141448215402080', time=2024-09-12T19:54:49.743666+0000, chain.objs.size()=1 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.524__multipart_mymultipart.2~6UqjWtXTsAp31KgB7BSqmEmLwN6Jyq2.1 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17614783607537684163', time=2024-09-12T19:56:05.296137+0000, chain.objs.size()=1 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.588__shadow:8MQzUULO.UVO6lEooYDxv05Xk1uEYCn_.Ej8unq3B1QapV2i-S_2y8RDn0h3_X-q_0 2024-09-12T18:01:05.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.4395932544937562743', time=2024-09-12T19:56:07.747773+0000, chain.objs.size()=1 2024-09-12T18:01:05.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.603__shadow_.Jfd-ldjDvMaoZuBySpzzi4uIb9fSUd0_0 2024-09-12T18:01:05.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.17003196440237762128', time=2024-09-12T19:58:21.831830+0000, chain.objs.size()=1 2024-09-12T18:01:05.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.639__shadow_.yWjEkBvxXk4Qo70wCrtvClu8O2A-twq_0 2024-09-12T18:01:05.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.1405523691946358188', time=2024-09-12T19:58:29.338907+0000, chain.objs.size()=6 2024-09-12T18:01:05.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.322+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.662__multipart_baz.2~4yYt0x57hGkQUOCdK6qgtI36dv_J2H3.1 2024-09-12T18:01:05.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.325+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.662__multipart_baz.2~4yYt0x57hGkQUOCdK6qgtI36dv_J2H3.2 2024-09-12T18:01:05.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.325+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.662__multipart_baz.2~4yYt0x57hGkQUOCdK6qgtI36dv_J2H3.3 2024-09-12T18:01:05.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.325+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.662__multipart_baz.2~4yYt0x57hGkQUOCdK6qgtI36dv_J2H3.4 2024-09-12T18:01:05.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.325+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.662__multipart_baz.2~4yYt0x57hGkQUOCdK6qgtI36dv_J2H3.5 2024-09-12T18:01:05.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.325+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.662__multipart_baz.2~4yYt0x57hGkQUOCdK6qgtI36dv_J2H3.6 2024-09-12T18:01:05.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.326+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7309540135210913196', time=2024-09-12T19:58:35.268472+0000, chain.objs.size()=1 2024-09-12T18:01:05.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.326+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.691__shadow:..eWSfQL5ObX9DpoC3.zhK1OV-NYpk._.akfsrPZ_bobfSiI9CHHvbphZW-YNTgp_0 2024-09-12T18:01:05.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.326+0000 7fe4cd498800 20 garbage collection: RGWGC::process iterating over entry tag='44b5948e-036f-4ba3-a922-c18ae061c84d.4683.7318785418869194855', time=2024-09-12T19:58:37.455633+0000, chain.objs.size()=1 2024-09-12T18:01:05.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.326+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:44b5948e-036f-4ba3-a922-c18ae061c84d.4683.701__shadow:H5JswcXZ.UIdj4eVxJqpz161s..pgkV_.9danVOLNqE_z3fHbu7KzC5viQ6qIFrY_0 2024-09-12T18:01:05.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.331+0000 7fe4cd498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:05.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.334+0000 7fe3817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:05.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.336+0000 7fe4cd498800 20 remove_watcher() i=0 2024-09-12T18:01:05.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.336+0000 7fe4cd498800 2 removed watcher, disabling cache 2024-09-12T18:01:05.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.337+0000 7fe4cd498800 20 remove_watcher() i=1 2024-09-12T18:01:05.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.338+0000 7fe4cd498800 20 remove_watcher() i=2 2024-09-12T18:01:05.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.339+0000 7fe4cd498800 20 remove_watcher() i=3 2024-09-12T18:01:05.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.340+0000 7fe4cd498800 20 remove_watcher() i=4 2024-09-12T18:01:05.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.341+0000 7fe4cd498800 20 remove_watcher() i=5 2024-09-12T18:01:05.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.342+0000 7fe4cd498800 20 remove_watcher() i=6 2024-09-12T18:01:05.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T18:01:05.343+0000 7fe4cd498800 20 remove_watcher() i=7 2024-09-12T18:01:05.357 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T18:01:05.368 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:01:05.386 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:01:05.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:01:05.747 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:01:05.749 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1446,"stamp":"2024-09-12T18:01:05.133266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657141058,"num_objects":4909,"num_object_clones":0,"num_object_copies":18584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4909,"num_whiteouts":0,"num_read":285692,"num_read_kb":2395651,"num_write":156840,"num_write_kb":2366905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13537,"ondisk_log_size":13537,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2676072,"kb_used_data":1044008,"kb_used_omap":12,"kb_used_meta":1631923,"kb_avail":752298648,"statfs":{"total":773094113280,"available":770353815552,"internally_reserved":0,"allocated":1069064192,"data_stored":1052820340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1671089712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4838261,"num_objects":-100,"num_object_clones":0,"num_object_copies":-364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-100,"num_whiteouts":0,"num_read":366,"num_read_kb":321,"num_write":131,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006546"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013121+0000","last_change":"2024-09-12T17:49:56.045663+0000","last_active":"2024-09-12T17:57:27.013121+0000","last_peered":"2024-09-12T17:57:27.013121+0000","last_clean":"2024-09-12T17:57:27.013121+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T17:57:27.013121+0000","last_undegraded":"2024-09-12T17:57:27.013121+0000","last_fullsized":"2024-09-12T17:57:27.013121+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:17.001669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.114014+0000","last_change":"2024-09-12T17:38:47.032756+0000","last_active":"2024-09-12T17:56:17.114014+0000","last_peered":"2024-09-12T17:56:17.114014+0000","last_clean":"2024-09-12T17:56:17.114014+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T17:56:17.114014+0000","last_undegraded":"2024-09-12T17:56:17.114014+0000","last_fullsized":"2024-09-12T17:56:17.114014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:43.869294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:15.122813+0000","last_change":"2024-09-12T17:38:43.996174+0000","last_active":"2024-09-12T17:56:15.122813+0000","last_peered":"2024-09-12T17:56:15.122813+0000","last_clean":"2024-09-12T17:56:15.122813+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T17:56:15.122813+0000","last_undegraded":"2024-09-12T17:56:15.122813+0000","last_fullsized":"2024-09-12T17:56:15.122813+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.191809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.019082+0000","last_change":"2024-09-12T17:37:08.657434+0000","last_active":"2024-09-12T17:58:02.019082+0000","last_peered":"2024-09-12T17:58:02.019082+0000","last_clean":"2024-09-12T17:58:02.019082+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T17:58:02.019082+0000","last_undegraded":"2024-09-12T17:58:02.019082+0000","last_fullsized":"2024-09-12T17:58:02.019082+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.018613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128952+0000","last_change":"2024-09-12T17:49:56.047260+0000","last_active":"2024-09-12T17:57:27.128952+0000","last_peered":"2024-09-12T17:57:27.128952+0000","last_clean":"2024-09-12T17:57:27.128952+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T17:57:27.128952+0000","last_undegraded":"2024-09-12T17:57:27.128952+0000","last_fullsized":"2024-09-12T17:57:27.128952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:13.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154633+0000","last_change":"2024-09-12T17:38:47.032526+0000","last_active":"2024-09-12T17:56:17.154633+0000","last_peered":"2024-09-12T17:56:17.154633+0000","last_clean":"2024-09-12T17:56:17.154633+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T17:56:17.154633+0000","last_undegraded":"2024-09-12T17:56:17.154633+0000","last_fullsized":"2024-09-12T17:56:17.154633+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.382669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:13.114703+0000","last_change":"2024-09-12T17:38:43.991731+0000","last_active":"2024-09-12T17:56:13.114703+0000","last_peered":"2024-09-12T17:56:13.114703+0000","last_clean":"2024-09-12T17:56:13.114703+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T17:56:13.114703+0000","last_undegraded":"2024-09-12T17:56:13.114703+0000","last_fullsized":"2024-09-12T17:56:13.114703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.972040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8434971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4142,"num_write":9,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:19.118189+0000","last_change":"2024-09-12T17:37:08.650147+0000","last_active":"2024-09-12T17:58:19.118189+0000","last_peered":"2024-09-12T17:58:19.118189+0000","last_clean":"2024-09-12T17:58:19.118189+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T17:58:19.118189+0000","last_undegraded":"2024-09-12T17:58:19.118189+0000","last_fullsized":"2024-09-12T17:58:19.118189+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:58.755566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.122054+0000","last_change":"2024-09-12T17:49:56.046643+0000","last_active":"2024-09-12T17:57:12.122054+0000","last_peered":"2024-09-12T17:57:12.122054+0000","last_clean":"2024-09-12T17:57:12.122054+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T17:57:12.122054+0000","last_undegraded":"2024-09-12T17:57:12.122054+0000","last_fullsized":"2024-09-12T17:57:12.122054+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.487756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'1","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127968+0000","last_change":"2024-09-12T17:38:47.027090+0000","last_active":"2024-09-12T17:57:33.127968+0000","last_peered":"2024-09-12T17:57:33.127968+0000","last_clean":"2024-09-12T17:57:33.127968+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T17:57:33.127968+0000","last_undegraded":"2024-09-12T17:57:33.127968+0000","last_fullsized":"2024-09-12T17:57:33.127968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:21.352493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144193+0000","last_change":"2024-09-12T17:38:43.992601+0000","last_active":"2024-09-12T17:58:45.144193+0000","last_peered":"2024-09-12T17:58:45.144193+0000","last_clean":"2024-09-12T17:58:45.144193+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T17:58:45.144193+0000","last_undegraded":"2024-09-12T17:58:45.144193+0000","last_fullsized":"2024-09-12T17:58:45.144193+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:05.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":243,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.266547+0000","last_change":"2024-09-12T17:37:08.657551+0000","last_active":"2024-09-12T17:59:07.266547+0000","last_peered":"2024-09-12T17:59:07.266547+0000","last_clean":"2024-09-12T17:59:07.266547+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T17:59:07.266547+0000","last_undegraded":"2024-09-12T17:59:07.266547+0000","last_fullsized":"2024-09-12T17:59:07.266547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:01.832274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:18.125196+0000","last_change":"2024-09-12T17:49:56.040426+0000","last_active":"2024-09-12T17:57:18.125196+0000","last_peered":"2024-09-12T17:57:18.125196+0000","last_clean":"2024-09-12T17:57:18.125196+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T17:57:18.125196+0000","last_undegraded":"2024-09-12T17:57:18.125196+0000","last_fullsized":"2024-09-12T17:57:18.125196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:54.760400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.139311+0000","last_change":"2024-09-12T17:38:47.027638+0000","last_active":"2024-09-12T17:58:53.139311+0000","last_peered":"2024-09-12T17:58:53.139311+0000","last_clean":"2024-09-12T17:58:53.139311+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T17:58:53.139311+0000","last_undegraded":"2024-09-12T17:58:53.139311+0000","last_fullsized":"2024-09-12T17:58:53.139311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:43.893874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12378,"num_write":5,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.124986+0000","last_change":"2024-09-12T17:38:43.990788+0000","last_active":"2024-09-12T17:57:32.124986+0000","last_peered":"2024-09-12T17:57:32.124986+0000","last_clean":"2024-09-12T17:57:32.124986+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T17:57:32.124986+0000","last_undegraded":"2024-09-12T17:57:32.124986+0000","last_fullsized":"2024-09-12T17:57:32.124986+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:59.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":14340,"num_write":5,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126674+0000","last_change":"2024-09-12T17:37:08.653015+0000","last_active":"2024-09-12T17:57:12.126674+0000","last_peered":"2024-09-12T17:57:12.126674+0000","last_clean":"2024-09-12T17:57:12.126674+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T17:57:12.126674+0000","last_undegraded":"2024-09-12T17:57:12.126674+0000","last_fullsized":"2024-09-12T17:57:12.126674+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:29.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137509+0000","last_change":"2024-09-12T17:49:56.043841+0000","last_active":"2024-09-12T17:57:55.137509+0000","last_peered":"2024-09-12T17:57:55.137509+0000","last_clean":"2024-09-12T17:57:55.137509+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T17:57:55.137509+0000","last_undegraded":"2024-09-12T17:57:55.137509+0000","last_fullsized":"2024-09-12T17:57:55.137509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:54.316816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.019362+0000","last_change":"2024-09-12T17:38:47.020351+0000","last_active":"2024-09-12T17:58:12.019362+0000","last_peered":"2024-09-12T17:58:12.019362+0000","last_clean":"2024-09-12T17:58:12.019362+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T17:58:12.019362+0000","last_undegraded":"2024-09-12T17:58:12.019362+0000","last_fullsized":"2024-09-12T17:58:12.019362+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:50.384206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132353+0000","last_change":"2024-09-12T17:38:43.991420+0000","last_active":"2024-09-12T17:58:03.132353+0000","last_peered":"2024-09-12T17:58:03.132353+0000","last_clean":"2024-09-12T17:58:03.132353+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T17:58:03.132353+0000","last_undegraded":"2024-09-12T17:58:03.132353+0000","last_fullsized":"2024-09-12T17:58:03.132353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126614+0000","last_change":"2024-09-12T17:37:08.656898+0000","last_active":"2024-09-12T17:57:12.126614+0000","last_peered":"2024-09-12T17:57:12.126614+0000","last_clean":"2024-09-12T17:57:12.126614+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T17:57:12.126614+0000","last_undegraded":"2024-09-12T17:57:12.126614+0000","last_fullsized":"2024-09-12T17:57:12.126614+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:09.179411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.022015+0000","last_change":"2024-09-12T17:49:56.038230+0000","last_active":"2024-09-12T17:58:17.022015+0000","last_peered":"2024-09-12T17:58:17.022015+0000","last_clean":"2024-09-12T17:58:17.022015+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T17:58:17.022015+0000","last_undegraded":"2024-09-12T17:58:17.022015+0000","last_fullsized":"2024-09-12T17:58:17.022015+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:01.328505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'1","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018999+0000","last_change":"2024-09-12T17:38:47.024390+0000","last_active":"2024-09-12T17:58:07.018999+0000","last_peered":"2024-09-12T17:58:07.018999+0000","last_clean":"2024-09-12T17:58:07.018999+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T17:58:07.018999+0000","last_undegraded":"2024-09-12T17:58:07.018999+0000","last_fullsized":"2024-09-12T17:58:07.018999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:38.074041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020049+0000","last_change":"2024-09-12T17:38:43.992661+0000","last_active":"2024-09-12T17:58:12.020049+0000","last_peered":"2024-09-12T17:58:12.020049+0000","last_clean":"2024-09-12T17:58:12.020049+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T17:58:12.020049+0000","last_undegraded":"2024-09-12T17:58:12.020049+0000","last_fullsized":"2024-09-12T17:58:12.020049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:23.126019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.118389+0000","last_change":"2024-09-12T17:37:08.657360+0000","last_active":"2024-09-12T17:58:29.118389+0000","last_peered":"2024-09-12T17:58:29.118389+0000","last_clean":"2024-09-12T17:58:29.118389+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T17:58:29.118389+0000","last_undegraded":"2024-09-12T17:58:29.118389+0000","last_fullsized":"2024-09-12T17:58:29.118389+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:37.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164252+0000","last_change":"2024-09-12T17:49:56.045176+0000","last_active":"2024-09-12T17:57:27.164252+0000","last_peered":"2024-09-12T17:57:27.164252+0000","last_clean":"2024-09-12T17:57:27.164252+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T17:57:27.164252+0000","last_undegraded":"2024-09-12T17:57:27.164252+0000","last_fullsized":"2024-09-12T17:57:27.164252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:33.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154608+0000","last_change":"2024-09-12T17:38:47.030932+0000","last_active":"2024-09-12T17:56:17.154608+0000","last_peered":"2024-09-12T17:56:17.154608+0000","last_clean":"2024-09-12T17:56:17.154608+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T17:56:17.154608+0000","last_undegraded":"2024-09-12T17:56:17.154608+0000","last_fullsized":"2024-09-12T17:56:17.154608+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:41.271072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.002901+0000","last_change":"2024-09-12T17:38:43.994843+0000","last_active":"2024-09-12T17:56:17.002901+0000","last_peered":"2024-09-12T17:56:17.002901+0000","last_clean":"2024-09-12T17:56:17.002901+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T17:56:17.002901+0000","last_undegraded":"2024-09-12T17:56:17.002901+0000","last_fullsized":"2024-09-12T17:56:17.002901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:41.681786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4663,"num_write":3,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124762+0000","last_change":"2024-09-12T17:37:08.654696+0000","last_active":"2024-09-12T17:56:30.124762+0000","last_peered":"2024-09-12T17:56:30.124762+0000","last_clean":"2024-09-12T17:56:30.124762+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T17:56:30.124762+0000","last_undegraded":"2024-09-12T17:56:30.124762+0000","last_fullsized":"2024-09-12T17:56:30.124762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:03.990843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013188+0000","last_change":"2024-09-12T17:49:56.044511+0000","last_active":"2024-09-12T17:57:27.013188+0000","last_peered":"2024-09-12T17:57:27.013188+0000","last_clean":"2024-09-12T17:57:27.013188+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T17:57:27.013188+0000","last_undegraded":"2024-09-12T17:57:27.013188+0000","last_fullsized":"2024-09-12T17:57:27.013188+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:47.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'6","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:20.123428+0000","last_change":"2024-09-12T17:38:47.024321+0000","last_active":"2024-09-12T17:56:20.123428+0000","last_peered":"2024-09-12T17:56:20.123428+0000","last_clean":"2024-09-12T17:56:20.123428+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T17:56:20.123428+0000","last_undegraded":"2024-09-12T17:56:20.123428+0000","last_fullsized":"2024-09-12T17:56:20.123428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:06.138900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7348224,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":13320,"num_write":16,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'9","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.118833+0000","last_change":"2024-09-12T17:38:43.990416+0000","last_active":"2024-09-12T17:56:17.118833+0000","last_peered":"2024-09-12T17:56:17.118833+0000","last_clean":"2024-09-12T17:56:17.118833+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T17:56:17.118833+0000","last_undegraded":"2024-09-12T17:56:17.118833+0000","last_fullsized":"2024-09-12T17:56:17.118833+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.211902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:40.117649+0000","last_change":"2024-09-12T17:37:08.660746+0000","last_active":"2024-09-12T17:58:40.117649+0000","last_peered":"2024-09-12T17:58:40.117649+0000","last_clean":"2024-09-12T17:58:40.117649+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T17:58:40.117649+0000","last_undegraded":"2024-09-12T17:58:40.117649+0000","last_fullsized":"2024-09-12T17:58:40.117649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:53.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.121922+0000","last_change":"2024-09-12T17:49:56.044578+0000","last_active":"2024-09-12T17:56:58.121922+0000","last_peered":"2024-09-12T17:56:58.121922+0000","last_clean":"2024-09-12T17:56:58.121922+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T17:56:58.121922+0000","last_undegraded":"2024-09-12T17:56:58.121922+0000","last_fullsized":"2024-09-12T17:56:58.121922+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:59.881857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139830+0000","last_change":"2024-09-12T17:38:47.024618+0000","last_active":"2024-09-12T17:58:10.139830+0000","last_peered":"2024-09-12T17:58:10.139830+0000","last_clean":"2024-09-12T17:58:10.139830+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T17:58:10.139830+0000","last_undegraded":"2024-09-12T17:58:10.139830+0000","last_fullsized":"2024-09-12T17:58:10.139830+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:49.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'9","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014371+0000","last_change":"2024-09-12T17:38:43.991705+0000","last_active":"2024-09-12T17:57:32.014371+0000","last_peered":"2024-09-12T17:57:32.014371+0000","last_clean":"2024-09-12T17:57:32.014371+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T17:57:32.014371+0000","last_undegraded":"2024-09-12T17:57:32.014371+0000","last_fullsized":"2024-09-12T17:57:32.014371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.996078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641131,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":4710,"num_write":14,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'113","reported_seq":388,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.275995+0000","last_change":"2024-09-12T17:37:08.655763+0000","last_active":"2024-09-12T17:58:17.275995+0000","last_peered":"2024-09-12T17:58:17.275995+0000","last_clean":"2024-09-12T17:58:17.275995+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T17:58:17.275995+0000","last_undegraded":"2024-09-12T17:58:17.275995+0000","last_fullsized":"2024-09-12T17:58:17.275995+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:41.813693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124631+0000","last_change":"2024-09-12T17:49:56.034209+0000","last_active":"2024-09-12T17:56:57.124631+0000","last_peered":"2024-09-12T17:56:57.124631+0000","last_clean":"2024-09-12T17:56:57.124631+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T17:56:57.124631+0000","last_undegraded":"2024-09-12T17:56:57.124631+0000","last_fullsized":"2024-09-12T17:56:57.124631+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:11.559774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127870+0000","last_change":"2024-09-12T17:38:47.024189+0000","last_active":"2024-09-12T17:57:33.127870+0000","last_peered":"2024-09-12T17:57:33.127870+0000","last_clean":"2024-09-12T17:57:33.127870+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T17:57:33.127870+0000","last_undegraded":"2024-09-12T17:57:33.127870+0000","last_fullsized":"2024-09-12T17:57:33.127870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:12.716839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018494+0000","last_change":"2024-09-12T17:38:43.995454+0000","last_active":"2024-09-12T17:58:07.018494+0000","last_peered":"2024-09-12T17:58:07.018494+0000","last_clean":"2024-09-12T17:58:07.018494+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T17:58:07.018494+0000","last_undegraded":"2024-09-12T17:58:07.018494+0000","last_fullsized":"2024-09-12T17:58:07.018494+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.629425+0000","last_change":"2024-09-12T17:37:08.650302+0000","last_active":"2024-09-12T17:58:28.629425+0000","last_peered":"2024-09-12T17:58:28.629425+0000","last_clean":"2024-09-12T17:58:28.629425+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T17:58:28.629425+0000","last_undegraded":"2024-09-12T17:58:28.629425+0000","last_fullsized":"2024-09-12T17:58:28.629425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:26.087974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159949+0000","last_change":"2024-09-12T17:49:56.037995+0000","last_active":"2024-09-12T17:56:57.159949+0000","last_peered":"2024-09-12T17:56:57.159949+0000","last_clean":"2024-09-12T17:56:57.159949+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T17:56:57.159949+0000","last_undegraded":"2024-09-12T17:56:57.159949+0000","last_fullsized":"2024-09-12T17:56:57.159949+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:04.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139871+0000","last_change":"2024-09-12T17:38:47.016476+0000","last_active":"2024-09-12T17:58:10.139871+0000","last_peered":"2024-09-12T17:58:10.139871+0000","last_clean":"2024-09-12T17:58:10.139871+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T17:58:10.139871+0000","last_undegraded":"2024-09-12T17:58:10.139871+0000","last_fullsized":"2024-09-12T17:58:10.139871+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:05.344871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138926+0000","last_change":"2024-09-12T17:38:43.996222+0000","last_active":"2024-09-12T17:58:05.138926+0000","last_peered":"2024-09-12T17:58:05.138926+0000","last_clean":"2024-09-12T17:58:05.138926+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T17:58:05.138926+0000","last_undegraded":"2024-09-12T17:58:05.138926+0000","last_fullsized":"2024-09-12T17:58:05.138926+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:17.497778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124845+0000","last_change":"2024-09-12T17:37:08.661473+0000","last_active":"2024-09-12T17:56:30.124845+0000","last_peered":"2024-09-12T17:56:30.124845+0000","last_clean":"2024-09-12T17:56:30.124845+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T17:56:30.124845+0000","last_undegraded":"2024-09-12T17:56:30.124845+0000","last_fullsized":"2024-09-12T17:56:30.124845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:03.318444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.008878+0000","last_change":"2024-09-12T17:49:56.045356+0000","last_active":"2024-09-12T17:56:57.008878+0000","last_peered":"2024-09-12T17:56:57.008878+0000","last_clean":"2024-09-12T17:56:57.008878+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T17:56:57.008878+0000","last_undegraded":"2024-09-12T17:56:57.008878+0000","last_fullsized":"2024-09-12T17:56:57.008878+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:33.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'1","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018535+0000","last_change":"2024-09-12T17:38:47.023380+0000","last_active":"2024-09-12T17:58:07.018535+0000","last_peered":"2024-09-12T17:58:07.018535+0000","last_clean":"2024-09-12T17:58:07.018535+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T17:58:07.018535+0000","last_undegraded":"2024-09-12T17:58:07.018535+0000","last_fullsized":"2024-09-12T17:58:07.018535+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.275074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132508+0000","last_change":"2024-09-12T17:38:43.989365+0000","last_active":"2024-09-12T17:58:03.132508+0000","last_peered":"2024-09-12T17:58:03.132508+0000","last_clean":"2024-09-12T17:58:03.132508+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T17:58:03.132508+0000","last_undegraded":"2024-09-12T17:58:03.132508+0000","last_fullsized":"2024-09-12T17:58:03.132508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:53.634008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020922+0000","last_change":"2024-09-12T17:37:08.651846+0000","last_active":"2024-09-12T17:58:17.020922+0000","last_peered":"2024-09-12T17:58:17.020922+0000","last_clean":"2024-09-12T17:58:17.020922+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T17:58:17.020922+0000","last_undegraded":"2024-09-12T17:58:17.020922+0000","last_fullsized":"2024-09-12T17:58:17.020922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:47.950299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:13.124363+0000","last_change":"2024-09-12T17:49:56.042508+0000","last_active":"2024-09-12T17:57:13.124363+0000","last_peered":"2024-09-12T17:57:13.124363+0000","last_clean":"2024-09-12T17:57:13.124363+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T17:57:13.124363+0000","last_undegraded":"2024-09-12T17:57:13.124363+0000","last_fullsized":"2024-09-12T17:57:13.124363+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:56.026526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.127091+0000","last_change":"2024-09-12T17:38:47.028439+0000","last_active":"2024-09-12T17:57:28.127091+0000","last_peered":"2024-09-12T17:57:28.127091+0000","last_clean":"2024-09-12T17:57:28.127091+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T17:57:28.127091+0000","last_undegraded":"2024-09-12T17:57:28.127091+0000","last_fullsized":"2024-09-12T17:57:28.127091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:40.113111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124185+0000","last_change":"2024-09-12T17:38:43.990984+0000","last_active":"2024-09-12T17:57:27.124185+0000","last_peered":"2024-09-12T17:57:27.124185+0000","last_clean":"2024-09-12T17:57:27.124185+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T17:57:27.124185+0000","last_undegraded":"2024-09-12T17:57:27.124185+0000","last_fullsized":"2024-09-12T17:57:27.124185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:55.979807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020118+0000","last_change":"2024-09-12T17:37:08.656056+0000","last_active":"2024-09-12T17:58:12.020118+0000","last_peered":"2024-09-12T17:58:12.020118+0000","last_clean":"2024-09-12T17:58:12.020118+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T17:58:12.020118+0000","last_undegraded":"2024-09-12T17:58:12.020118+0000","last_fullsized":"2024-09-12T17:58:12.020118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:45.733213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126727+0000","last_change":"2024-09-12T17:49:56.042525+0000","last_active":"2024-09-12T17:57:12.126727+0000","last_peered":"2024-09-12T17:57:12.126727+0000","last_clean":"2024-09-12T17:57:12.126727+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T17:57:12.126727+0000","last_undegraded":"2024-09-12T17:57:12.126727+0000","last_fullsized":"2024-09-12T17:57:12.126727+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:07.790123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.147415+0000","last_change":"2024-09-12T17:38:47.030812+0000","last_active":"2024-09-12T17:59:48.147415+0000","last_peered":"2024-09-12T17:59:48.147415+0000","last_clean":"2024-09-12T17:59:48.147415+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T17:59:48.147415+0000","last_undegraded":"2024-09-12T17:59:48.147415+0000","last_fullsized":"2024-09-12T17:59:48.147415+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:21.678813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10258,"num_write":14,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.126144+0000","last_change":"2024-09-12T17:38:43.987476+0000","last_active":"2024-09-12T17:57:23.126144+0000","last_peered":"2024-09-12T17:57:23.126144+0000","last_clean":"2024-09-12T17:57:23.126144+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T17:57:23.126144+0000","last_undegraded":"2024-09-12T17:57:23.126144+0000","last_fullsized":"2024-09-12T17:57:23.126144+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.672726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139794+0000","last_change":"2024-09-12T17:37:08.661575+0000","last_active":"2024-09-12T17:58:10.139794+0000","last_peered":"2024-09-12T17:58:10.139794+0000","last_clean":"2024-09-12T17:58:10.139794+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T17:58:10.139794+0000","last_undegraded":"2024-09-12T17:58:10.139794+0000","last_fullsized":"2024-09-12T17:58:10.139794+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:44.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009869+0000","last_change":"2024-09-12T17:49:56.037386+0000","last_active":"2024-09-12T17:57:02.009869+0000","last_peered":"2024-09-12T17:57:02.009869+0000","last_clean":"2024-09-12T17:57:02.009869+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T17:57:02.009869+0000","last_undegraded":"2024-09-12T17:57:02.009869+0000","last_fullsized":"2024-09-12T17:57:02.009869+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:00.713527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:30.133900+0000","last_change":"2024-09-12T17:38:47.022479+0000","last_active":"2024-09-12T17:57:30.133900+0000","last_peered":"2024-09-12T17:57:30.133900+0000","last_clean":"2024-09-12T17:57:30.133900+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T17:57:30.133900+0000","last_undegraded":"2024-09-12T17:57:30.133900+0000","last_fullsized":"2024-09-12T17:57:30.133900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:49.306337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124233+0000","last_change":"2024-09-12T17:38:43.988889+0000","last_active":"2024-09-12T17:57:27.124233+0000","last_peered":"2024-09-12T17:57:27.124233+0000","last_clean":"2024-09-12T17:57:27.124233+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T17:57:27.124233+0000","last_undegraded":"2024-09-12T17:57:27.124233+0000","last_fullsized":"2024-09-12T17:57:27.124233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:26.795414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7172,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.170376+0000","last_change":"2024-09-12T17:37:08.658663+0000","last_active":"2024-09-12T17:58:12.170376+0000","last_peered":"2024-09-12T17:58:12.170376+0000","last_clean":"2024-09-12T17:58:12.170376+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T17:58:12.170376+0000","last_undegraded":"2024-09-12T17:58:12.170376+0000","last_fullsized":"2024-09-12T17:58:12.170376+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.276415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126695+0000","last_change":"2024-09-12T17:49:56.036857+0000","last_active":"2024-09-12T17:57:12.126695+0000","last_peered":"2024-09-12T17:57:12.126695+0000","last_clean":"2024-09-12T17:57:12.126695+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T17:57:12.126695+0000","last_undegraded":"2024-09-12T17:57:12.126695+0000","last_fullsized":"2024-09-12T17:57:12.126695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:01.304735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013658+0000","last_change":"2024-09-12T17:38:47.019373+0000","last_active":"2024-09-12T17:57:27.013658+0000","last_peered":"2024-09-12T17:57:27.013658+0000","last_clean":"2024-09-12T17:57:27.013658+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T17:57:27.013658+0000","last_undegraded":"2024-09-12T17:57:27.013658+0000","last_fullsized":"2024-09-12T17:57:27.013658+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:16.314152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124255+0000","last_change":"2024-09-12T17:38:43.992720+0000","last_active":"2024-09-12T17:57:27.124255+0000","last_peered":"2024-09-12T17:57:27.124255+0000","last_clean":"2024-09-12T17:57:27.124255+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T17:57:27.124255+0000","last_undegraded":"2024-09-12T17:57:27.124255+0000","last_fullsized":"2024-09-12T17:57:27.124255+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:49.377878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.480567+0000","last_change":"2024-09-12T17:37:08.662089+0000","last_active":"2024-09-12T17:58:18.480567+0000","last_peered":"2024-09-12T17:58:18.480567+0000","last_clean":"2024-09-12T17:58:18.480567+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T17:58:18.480567+0000","last_undegraded":"2024-09-12T17:58:18.480567+0000","last_fullsized":"2024-09-12T17:58:18.480567+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:41.016001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.137350+0000","last_change":"2024-09-12T17:49:56.047641+0000","last_active":"2024-09-12T17:58:43.137350+0000","last_peered":"2024-09-12T17:58:43.137350+0000","last_clean":"2024-09-12T17:58:43.137350+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T17:58:43.137350+0000","last_undegraded":"2024-09-12T17:58:43.137350+0000","last_fullsized":"2024-09-12T17:58:43.137350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:16.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127812+0000","last_change":"2024-09-12T17:38:47.029582+0000","last_active":"2024-09-12T17:56:50.127812+0000","last_peered":"2024-09-12T17:56:50.127812+0000","last_clean":"2024-09-12T17:56:50.127812+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T17:56:50.127812+0000","last_undegraded":"2024-09-12T17:56:50.127812+0000","last_fullsized":"2024-09-12T17:56:50.127812+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.565082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.158658+0000","last_change":"2024-09-12T17:38:43.989865+0000","last_active":"2024-09-12T17:56:47.158658+0000","last_peered":"2024-09-12T17:56:47.158658+0000","last_clean":"2024-09-12T17:56:47.158658+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T17:56:47.158658+0000","last_undegraded":"2024-09-12T17:56:47.158658+0000","last_fullsized":"2024-09-12T17:56:47.158658+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:53.024317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133309+0000","last_change":"2024-09-12T17:37:08.662016+0000","last_active":"2024-09-12T17:57:25.133309+0000","last_peered":"2024-09-12T17:57:25.133309+0000","last_clean":"2024-09-12T17:57:25.133309+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T17:57:25.133309+0000","last_undegraded":"2024-09-12T17:57:25.133309+0000","last_fullsized":"2024-09-12T17:57:25.133309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:38.421910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.117628+0000","last_change":"2024-09-12T17:49:56.049044+0000","last_active":"2024-09-12T17:56:42.117628+0000","last_peered":"2024-09-12T17:56:42.117628+0000","last_clean":"2024-09-12T17:56:42.117628+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T17:56:42.117628+0000","last_undegraded":"2024-09-12T17:56:42.117628+0000","last_fullsized":"2024-09-12T17:56:42.117628+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:10.014418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127772+0000","last_change":"2024-09-12T17:38:47.025348+0000","last_active":"2024-09-12T17:56:50.127772+0000","last_peered":"2024-09-12T17:56:50.127772+0000","last_clean":"2024-09-12T17:56:50.127772+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T17:56:50.127772+0000","last_undegraded":"2024-09-12T17:56:50.127772+0000","last_fullsized":"2024-09-12T17:56:50.127772+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:14.763266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.123070+0000","last_change":"2024-09-12T17:38:43.989723+0000","last_active":"2024-09-12T17:56:47.123070+0000","last_peered":"2024-09-12T17:56:47.123070+0000","last_clean":"2024-09-12T17:56:47.123070+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T17:56:47.123070+0000","last_undegraded":"2024-09-12T17:56:47.123070+0000","last_fullsized":"2024-09-12T17:56:47.123070+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:38.471857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8392704,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":3,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013744+0000","last_change":"2024-09-12T17:37:08.648920+0000","last_active":"2024-09-12T17:57:27.013744+0000","last_peered":"2024-09-12T17:57:27.013744+0000","last_clean":"2024-09-12T17:57:27.013744+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T17:57:27.013744+0000","last_undegraded":"2024-09-12T17:57:27.013744+0000","last_fullsized":"2024-09-12T17:57:27.013744+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.023058+0000","last_change":"2024-09-12T17:49:56.036894+0000","last_active":"2024-09-12T17:58:37.023058+0000","last_peered":"2024-09-12T17:58:37.023058+0000","last_clean":"2024-09-12T17:58:37.023058+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T17:58:37.023058+0000","last_undegraded":"2024-09-12T17:58:37.023058+0000","last_fullsized":"2024-09-12T17:58:37.023058+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:30.781444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'5","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127863+0000","last_change":"2024-09-12T17:38:47.027005+0000","last_active":"2024-09-12T17:56:50.127863+0000","last_peered":"2024-09-12T17:56:50.127863+0000","last_clean":"2024-09-12T17:56:50.127863+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T17:56:50.127863+0000","last_undegraded":"2024-09-12T17:56:50.127863+0000","last_fullsized":"2024-09-12T17:56:50.127863+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:26.959823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10534097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":15452,"num_write":5,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:45.127156+0000","last_change":"2024-09-12T17:38:43.996009+0000","last_active":"2024-09-12T17:56:45.127156+0000","last_peered":"2024-09-12T17:56:45.127156+0000","last_clean":"2024-09-12T17:56:45.127156+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T17:56:45.127156+0000","last_undegraded":"2024-09-12T17:56:45.127156+0000","last_fullsized":"2024-09-12T17:56:45.127156+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.956208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4108,"num_write":5,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124276+0000","last_change":"2024-09-12T17:37:08.653415+0000","last_active":"2024-09-12T17:57:27.124276+0000","last_peered":"2024-09-12T17:57:27.124276+0000","last_clean":"2024-09-12T17:57:27.124276+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T17:57:27.124276+0000","last_undegraded":"2024-09-12T17:57:27.124276+0000","last_fullsized":"2024-09-12T17:57:27.124276+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:16.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.133197+0000","last_change":"2024-09-12T17:49:56.047746+0000","last_active":"2024-09-12T17:58:37.133197+0000","last_peered":"2024-09-12T17:58:37.133197+0000","last_clean":"2024-09-12T17:58:37.133197+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T17:58:37.133197+0000","last_undegraded":"2024-09-12T17:58:37.133197+0000","last_fullsized":"2024-09-12T17:58:37.133197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:19.785797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:48.120271+0000","last_change":"2024-09-12T17:38:47.022037+0000","last_active":"2024-09-12T17:56:48.120271+0000","last_peered":"2024-09-12T17:56:48.120271+0000","last_clean":"2024-09-12T17:56:48.120271+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T17:56:48.120271+0000","last_undegraded":"2024-09-12T17:56:48.120271+0000","last_fullsized":"2024-09-12T17:56:48.120271+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:58.528885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11258,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:45.127205+0000","last_change":"2024-09-12T17:38:43.991999+0000","last_active":"2024-09-12T17:56:45.127205+0000","last_peered":"2024-09-12T17:56:45.127205+0000","last_clean":"2024-09-12T17:56:45.127205+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T17:56:45.127205+0000","last_undegraded":"2024-09-12T17:56:45.127205+0000","last_fullsized":"2024-09-12T17:56:45.127205+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:23.142677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128990+0000","last_change":"2024-09-12T17:37:08.659437+0000","last_active":"2024-09-12T17:57:27.128990+0000","last_peered":"2024-09-12T17:57:27.128990+0000","last_clean":"2024-09-12T17:57:27.128990+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T17:57:27.128990+0000","last_undegraded":"2024-09-12T17:57:27.128990+0000","last_fullsized":"2024-09-12T17:57:27.128990+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:00.942567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:43.119397+0000","last_change":"2024-09-12T17:49:56.045196+0000","last_active":"2024-09-12T17:56:43.119397+0000","last_peered":"2024-09-12T17:56:43.119397+0000","last_clean":"2024-09-12T17:56:43.119397+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T17:56:43.119397+0000","last_undegraded":"2024-09-12T17:56:43.119397+0000","last_fullsized":"2024-09-12T17:56:43.119397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:39.426641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020855+0000","last_change":"2024-09-12T17:38:47.020511+0000","last_active":"2024-09-12T17:58:17.020855+0000","last_peered":"2024-09-12T17:58:17.020855+0000","last_clean":"2024-09-12T17:58:17.020855+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T17:58:17.020855+0000","last_undegraded":"2024-09-12T17:58:17.020855+0000","last_fullsized":"2024-09-12T17:58:17.020855+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.015103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:15.140467+0000","last_change":"2024-09-12T17:38:43.993571+0000","last_active":"2024-09-12T17:58:15.140467+0000","last_peered":"2024-09-12T17:58:15.140467+0000","last_clean":"2024-09-12T17:58:15.140467+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T17:58:15.140467+0000","last_undegraded":"2024-09-12T17:58:15.140467+0000","last_fullsized":"2024-09-12T17:58:15.140467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.884799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128966+0000","last_change":"2024-09-12T17:37:08.656385+0000","last_active":"2024-09-12T17:57:27.128966+0000","last_peered":"2024-09-12T17:57:27.128966+0000","last_clean":"2024-09-12T17:57:27.128966+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T17:57:27.128966+0000","last_undegraded":"2024-09-12T17:57:27.128966+0000","last_fullsized":"2024-09-12T17:57:27.128966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.157975+0000","last_change":"2024-09-12T17:49:56.048011+0000","last_active":"2024-09-12T17:56:42.157975+0000","last_peered":"2024-09-12T17:56:42.157975+0000","last_clean":"2024-09-12T17:56:42.157975+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T17:56:42.157975+0000","last_undegraded":"2024-09-12T17:56:42.157975+0000","last_fullsized":"2024-09-12T17:56:42.157975+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:44.187088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.170917+0000","last_change":"2024-09-12T17:38:47.032812+0000","last_active":"2024-09-12T17:58:17.170917+0000","last_peered":"2024-09-12T17:58:17.170917+0000","last_clean":"2024-09-12T17:58:17.170917+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T17:58:17.170917+0000","last_undegraded":"2024-09-12T17:58:17.170917+0000","last_fullsized":"2024-09-12T17:58:17.170917+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:16.283298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.133853+0000","last_change":"2024-09-12T17:38:43.988490+0000","last_active":"2024-09-12T17:58:13.133853+0000","last_peered":"2024-09-12T17:58:13.133853+0000","last_clean":"2024-09-12T17:58:13.133853+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T17:58:13.133853+0000","last_undegraded":"2024-09-12T17:58:13.133853+0000","last_fullsized":"2024-09-12T17:58:13.133853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.984138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.428411+0000","last_change":"2024-09-12T17:37:08.652495+0000","last_active":"2024-09-12T17:59:07.428411+0000","last_peered":"2024-09-12T17:59:07.428411+0000","last_clean":"2024-09-12T17:59:07.428411+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T17:59:07.428411+0000","last_undegraded":"2024-09-12T17:59:07.428411+0000","last_fullsized":"2024-09-12T17:59:07.428411+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:18.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.006624+0000","last_change":"2024-09-12T17:49:56.045788+0000","last_active":"2024-09-12T17:56:42.006624+0000","last_peered":"2024-09-12T17:56:42.006624+0000","last_clean":"2024-09-12T17:56:42.006624+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T17:56:42.006624+0000","last_undegraded":"2024-09-12T17:56:42.006624+0000","last_fullsized":"2024-09-12T17:56:42.006624+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:29.577491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.123014+0000","last_change":"2024-09-12T17:38:47.030610+0000","last_active":"2024-09-12T17:56:47.123014+0000","last_peered":"2024-09-12T17:56:47.123014+0000","last_clean":"2024-09-12T17:56:47.123014+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T17:56:47.123014+0000","last_undegraded":"2024-09-12T17:56:47.123014+0000","last_fullsized":"2024-09-12T17:56:47.123014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:48.238050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:15.140519+0000","last_change":"2024-09-12T17:38:43.992844+0000","last_active":"2024-09-12T17:58:15.140519+0000","last_peered":"2024-09-12T17:58:15.140519+0000","last_clean":"2024-09-12T17:58:15.140519+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T17:58:15.140519+0000","last_undegraded":"2024-09-12T17:58:15.140519+0000","last_fullsized":"2024-09-12T17:58:15.140519+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:06.166487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":15350,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138340+0000","last_change":"2024-09-12T17:37:08.661047+0000","last_active":"2024-09-12T17:58:48.138340+0000","last_peered":"2024-09-12T17:58:48.138340+0000","last_clean":"2024-09-12T17:58:48.138340+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T17:58:48.138340+0000","last_undegraded":"2024-09-12T17:58:48.138340+0000","last_fullsized":"2024-09-12T17:58:48.138340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:35.362254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:40.126255+0000","last_change":"2024-09-12T17:49:56.045203+0000","last_active":"2024-09-12T17:56:40.126255+0000","last_peered":"2024-09-12T17:56:40.126255+0000","last_clean":"2024-09-12T17:56:40.126255+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T17:56:40.126255+0000","last_undegraded":"2024-09-12T17:56:40.126255+0000","last_fullsized":"2024-09-12T17:56:40.126255+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.690292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.020496+0000","last_change":"2024-09-12T17:38:47.026783+0000","last_active":"2024-09-12T17:58:22.020496+0000","last_peered":"2024-09-12T17:58:22.020496+0000","last_clean":"2024-09-12T17:58:22.020496+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T17:58:22.020496+0000","last_undegraded":"2024-09-12T17:58:22.020496+0000","last_fullsized":"2024-09-12T17:58:22.020496+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:20.362697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.007702+0000","last_change":"2024-09-12T17:38:43.993534+0000","last_active":"2024-09-12T17:56:47.007702+0000","last_peered":"2024-09-12T17:56:47.007702+0000","last_clean":"2024-09-12T17:56:47.007702+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T17:56:47.007702+0000","last_undegraded":"2024-09-12T17:56:47.007702+0000","last_fullsized":"2024-09-12T17:56:47.007702+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:36.199628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.024519+0000","last_change":"2024-09-12T17:37:08.652306+0000","last_active":"2024-09-12T17:58:52.024519+0000","last_peered":"2024-09-12T17:58:52.024519+0000","last_clean":"2024-09-12T17:58:52.024519+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T17:58:52.024519+0000","last_undegraded":"2024-09-12T17:58:52.024519+0000","last_fullsized":"2024-09-12T17:58:52.024519+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.726476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.019998+0000","last_change":"2024-09-12T17:49:56.046641+0000","last_active":"2024-09-12T17:58:17.019998+0000","last_peered":"2024-09-12T17:58:17.019998+0000","last_clean":"2024-09-12T17:58:17.019998+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T17:58:17.019998+0000","last_undegraded":"2024-09-12T17:58:17.019998+0000","last_fullsized":"2024-09-12T17:58:17.019998+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:58.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'7","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:38.128643+0000","last_change":"2024-09-12T17:38:47.030849+0000","last_active":"2024-09-12T17:57:38.128643+0000","last_peered":"2024-09-12T17:57:38.128643+0000","last_clean":"2024-09-12T17:57:38.128643+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T17:57:38.128643+0000","last_undegraded":"2024-09-12T17:57:38.128643+0000","last_fullsized":"2024-09-12T17:57:38.128643+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:33.916148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014388+0000","last_change":"2024-09-12T17:38:43.991595+0000","last_active":"2024-09-12T17:57:32.014388+0000","last_peered":"2024-09-12T17:57:32.014388+0000","last_clean":"2024-09-12T17:57:32.014388+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T17:57:32.014388+0000","last_undegraded":"2024-09-12T17:57:32.014388+0000","last_fullsized":"2024-09-12T17:57:32.014388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.739988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025891+0000","last_change":"2024-09-12T17:37:08.661553+0000","last_active":"2024-09-12T17:58:52.025891+0000","last_peered":"2024-09-12T17:58:52.025891+0000","last_clean":"2024-09-12T17:58:52.025891+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T17:58:52.025891+0000","last_undegraded":"2024-09-12T17:58:52.025891+0000","last_fullsized":"2024-09-12T17:58:52.025891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.649379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020012+0000","last_change":"2024-09-12T17:49:56.041888+0000","last_active":"2024-09-12T17:58:17.020012+0000","last_peered":"2024-09-12T17:58:17.020012+0000","last_clean":"2024-09-12T17:58:17.020012+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T17:58:17.020012+0000","last_undegraded":"2024-09-12T17:58:17.020012+0000","last_fullsized":"2024-09-12T17:58:17.020012+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127910+0000","last_change":"2024-09-12T17:38:47.024913+0000","last_active":"2024-09-12T17:57:33.127910+0000","last_peered":"2024-09-12T17:57:33.127910+0000","last_clean":"2024-09-12T17:57:33.127910+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T17:57:33.127910+0000","last_undegraded":"2024-09-12T17:57:33.127910+0000","last_fullsized":"2024-09-12T17:57:33.127910+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:06.755928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:37.015192+0000","last_change":"2024-09-12T17:38:43.990480+0000","last_active":"2024-09-12T17:57:37.015192+0000","last_peered":"2024-09-12T17:57:37.015192+0000","last_clean":"2024-09-12T17:57:37.015192+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T17:57:37.015192+0000","last_undegraded":"2024-09-12T17:57:37.015192+0000","last_fullsized":"2024-09-12T17:57:37.015192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:13.712977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":20468,"num_write":11,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025154+0000","last_change":"2024-09-12T17:37:08.649723+0000","last_active":"2024-09-12T17:58:52.025154+0000","last_peered":"2024-09-12T17:58:52.025154+0000","last_clean":"2024-09-12T17:58:52.025154+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T17:58:52.025154+0000","last_undegraded":"2024-09-12T17:58:52.025154+0000","last_fullsized":"2024-09-12T17:58:52.025154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.186149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132327+0000","last_change":"2024-09-12T17:49:56.046876+0000","last_active":"2024-09-12T17:58:03.132327+0000","last_peered":"2024-09-12T17:58:03.132327+0000","last_clean":"2024-09-12T17:58:03.132327+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T17:58:03.132327+0000","last_undegraded":"2024-09-12T17:58:03.132327+0000","last_fullsized":"2024-09-12T17:58:03.132327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:45.910023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020050+0000","last_change":"2024-09-12T17:38:47.026137+0000","last_active":"2024-09-12T17:58:17.020050+0000","last_peered":"2024-09-12T17:58:17.020050+0000","last_clean":"2024-09-12T17:58:17.020050+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T17:58:17.020050+0000","last_undegraded":"2024-09-12T17:58:17.020050+0000","last_fullsized":"2024-09-12T17:58:17.020050+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:14.366739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.171001+0000","last_change":"2024-09-12T17:38:43.992358+0000","last_active":"2024-09-12T17:58:17.171001+0000","last_peered":"2024-09-12T17:58:17.171001+0000","last_clean":"2024-09-12T17:58:17.171001+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T17:58:17.171001+0000","last_undegraded":"2024-09-12T17:58:17.171001+0000","last_fullsized":"2024-09-12T17:58:17.171001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:38.097131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.169817+0000","last_change":"2024-09-12T17:37:08.658795+0000","last_active":"2024-09-12T17:58:07.169817+0000","last_peered":"2024-09-12T17:58:07.169817+0000","last_clean":"2024-09-12T17:58:07.169817+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T17:58:07.169817+0000","last_undegraded":"2024-09-12T17:58:07.169817+0000","last_fullsized":"2024-09-12T17:58:07.169817+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.988783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020817+0000","last_change":"2024-09-12T17:49:56.036001+0000","last_active":"2024-09-12T17:58:17.020817+0000","last_peered":"2024-09-12T17:58:17.020817+0000","last_clean":"2024-09-12T17:58:17.020817+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T17:58:17.020817+0000","last_undegraded":"2024-09-12T17:58:17.020817+0000","last_fullsized":"2024-09-12T17:58:17.020817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:20.176376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'4","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021010+0000","last_change":"2024-09-12T17:38:47.021549+0000","last_active":"2024-09-12T17:58:17.021010+0000","last_peered":"2024-09-12T17:58:17.021010+0000","last_clean":"2024-09-12T17:58:17.021010+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T17:58:17.021010+0000","last_undegraded":"2024-09-12T17:58:17.021010+0000","last_fullsized":"2024-09-12T17:58:17.021010+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:06.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5116,"num_write":9,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021033+0000","last_change":"2024-09-12T17:38:43.994549+0000","last_active":"2024-09-12T17:58:17.021033+0000","last_peered":"2024-09-12T17:58:17.021033+0000","last_clean":"2024-09-12T17:58:17.021033+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T17:58:17.021033+0000","last_undegraded":"2024-09-12T17:58:17.021033+0000","last_fullsized":"2024-09-12T17:58:17.021033+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:30.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":171,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.435685+0000","last_change":"2024-09-12T17:37:08.659177+0000","last_active":"2024-09-12T17:59:07.435685+0000","last_peered":"2024-09-12T17:59:07.435685+0000","last_clean":"2024-09-12T17:59:07.435685+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T17:59:07.435685+0000","last_undegraded":"2024-09-12T17:59:07.435685+0000","last_fullsized":"2024-09-12T17:59:07.435685+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:04.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:35.142766+0000","last_change":"2024-09-12T17:49:56.038182+0000","last_active":"2024-09-12T17:58:35.142766+0000","last_peered":"2024-09-12T17:58:35.142766+0000","last_clean":"2024-09-12T17:58:35.142766+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T17:58:35.142766+0000","last_undegraded":"2024-09-12T17:58:35.142766+0000","last_fullsized":"2024-09-12T17:58:35.142766+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:22.086611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014474+0000","last_change":"2024-09-12T17:38:47.026375+0000","last_active":"2024-09-12T17:57:32.014474+0000","last_peered":"2024-09-12T17:57:32.014474+0000","last_clean":"2024-09-12T17:57:32.014474+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T17:57:32.014474+0000","last_undegraded":"2024-09-12T17:57:32.014474+0000","last_fullsized":"2024-09-12T17:57:32.014474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:56.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.175038+0000","last_change":"2024-09-12T17:38:43.992950+0000","last_active":"2024-09-12T17:58:52.175038+0000","last_peered":"2024-09-12T17:58:52.175038+0000","last_clean":"2024-09-12T17:58:52.175038+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T17:58:52.175038+0000","last_undegraded":"2024-09-12T17:58:52.175038+0000","last_fullsized":"2024-09-12T17:58:52.175038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:18.833241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.762077+0000","last_change":"2024-09-12T17:37:08.654619+0000","last_active":"2024-09-12T17:59:07.762077+0000","last_peered":"2024-09-12T17:59:07.762077+0000","last_clean":"2024-09-12T17:59:07.762077+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T17:59:07.762077+0000","last_undegraded":"2024-09-12T17:59:07.762077+0000","last_fullsized":"2024-09-12T17:59:07.762077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:44.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.024006+0000","last_change":"2024-09-12T17:49:56.039258+0000","last_active":"2024-09-12T17:58:37.024006+0000","last_peered":"2024-09-12T17:58:37.024006+0000","last_clean":"2024-09-12T17:58:37.024006+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T17:58:37.024006+0000","last_undegraded":"2024-09-12T17:58:37.024006+0000","last_fullsized":"2024-09-12T17:58:37.024006+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.182004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025035+0000","last_change":"2024-09-12T17:38:47.026063+0000","last_active":"2024-09-12T17:58:52.025035+0000","last_peered":"2024-09-12T17:58:52.025035+0000","last_clean":"2024-09-12T17:58:52.025035+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T17:58:52.025035+0000","last_undegraded":"2024-09-12T17:58:52.025035+0000","last_fullsized":"2024-09-12T17:58:52.025035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.717038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4778667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3651,"num_write":10,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014307+0000","last_change":"2024-09-12T17:38:43.988186+0000","last_active":"2024-09-12T17:57:32.014307+0000","last_peered":"2024-09-12T17:57:32.014307+0000","last_clean":"2024-09-12T17:57:32.014307+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T17:57:32.014307+0000","last_undegraded":"2024-09-12T17:57:32.014307+0000","last_fullsized":"2024-09-12T17:57:32.014307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:03.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.018369+0000","last_change":"2024-09-12T17:37:08.647170+0000","last_active":"2024-09-12T17:58:02.018369+0000","last_peered":"2024-09-12T17:58:02.018369+0000","last_clean":"2024-09-12T17:58:02.018369+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T17:58:02.018369+0000","last_undegraded":"2024-09-12T17:58:02.018369+0000","last_fullsized":"2024-09-12T17:58:02.018369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:33.128612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.134437+0000","last_change":"2024-09-12T17:49:56.044807+0000","last_active":"2024-09-12T17:58:18.134437+0000","last_peered":"2024-09-12T17:58:18.134437+0000","last_clean":"2024-09-12T17:58:18.134437+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T17:58:18.134437+0000","last_undegraded":"2024-09-12T17:58:18.134437+0000","last_fullsized":"2024-09-12T17:58:18.134437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:28.012638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164999+0000","last_change":"2024-09-12T17:38:47.035193+0000","last_active":"2024-09-12T17:57:32.164999+0000","last_peered":"2024-09-12T17:57:32.164999+0000","last_clean":"2024-09-12T17:57:32.164999+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T17:57:32.164999+0000","last_undegraded":"2024-09-12T17:57:32.164999+0000","last_fullsized":"2024-09-12T17:57:32.164999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:54.991568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.129624+0000","last_change":"2024-09-12T17:38:43.993095+0000","last_active":"2024-09-12T17:57:32.129624+0000","last_peered":"2024-09-12T17:57:32.129624+0000","last_clean":"2024-09-12T17:57:32.129624+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T17:57:32.129624+0000","last_undegraded":"2024-09-12T17:57:32.129624+0000","last_fullsized":"2024-09-12T17:57:32.129624+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:07.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4118,"num_write":5,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.571968+0000","last_change":"2024-09-12T17:37:08.656010+0000","last_active":"2024-09-12T17:59:05.571968+0000","last_peered":"2024-09-12T17:59:05.571968+0000","last_clean":"2024-09-12T17:59:05.571968+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T17:59:05.571968+0000","last_undegraded":"2024-09-12T17:59:05.571968+0000","last_fullsized":"2024-09-12T17:59:05.571968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.346921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021616+0000","last_change":"2024-09-12T17:49:56.043230+0000","last_active":"2024-09-12T17:58:22.021616+0000","last_peered":"2024-09-12T17:58:22.021616+0000","last_clean":"2024-09-12T17:58:22.021616+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T17:58:22.021616+0000","last_undegraded":"2024-09-12T17:58:22.021616+0000","last_fullsized":"2024-09-12T17:58:22.021616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:33.627052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164967+0000","last_change":"2024-09-12T17:38:47.029841+0000","last_active":"2024-09-12T17:57:32.164967+0000","last_peered":"2024-09-12T17:57:32.164967+0000","last_clean":"2024-09-12T17:57:32.164967+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T17:57:32.164967+0000","last_undegraded":"2024-09-12T17:57:32.164967+0000","last_fullsized":"2024-09-12T17:57:32.164967+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:16.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.124927+0000","last_change":"2024-09-12T17:38:43.992352+0000","last_active":"2024-09-12T17:57:32.124927+0000","last_peered":"2024-09-12T17:57:32.124927+0000","last_clean":"2024-09-12T17:57:32.124927+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T17:57:32.124927+0000","last_undegraded":"2024-09-12T17:57:32.124927+0000","last_fullsized":"2024-09-12T17:57:32.124927+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:57.443048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.100022+0000","last_change":"2024-09-12T17:37:08.651452+0000","last_active":"2024-09-12T17:58:28.100022+0000","last_peered":"2024-09-12T17:58:28.100022+0000","last_clean":"2024-09-12T17:58:28.100022+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T17:58:28.100022+0000","last_undegraded":"2024-09-12T17:58:28.100022+0000","last_fullsized":"2024-09-12T17:58:28.100022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:02.681669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'268","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.286608+0000","last_change":"2024-09-12T17:21:50.778519+0000","last_active":"2024-09-12T17:59:12.286608+0000","last_peered":"2024-09-12T17:59:12.286608+0000","last_clean":"2024-09-12T17:59:12.286608+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T17:59:12.286608+0000","last_undegraded":"2024-09-12T17:59:12.286608+0000","last_fullsized":"2024-09-12T17:59:12.286608+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.146345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768658,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":415,"num_read_kb":38784,"num_write":991,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'477","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.761716+0000","last_change":"2024-09-12T17:21:52.747415+0000","last_active":"2024-09-12T17:59:34.761716+0000","last_peered":"2024-09-12T17:59:34.761716+0000","last_clean":"2024-09-12T17:59:34.761716+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T17:59:34.761716+0000","last_undegraded":"2024-09-12T17:59:34.761716+0000","last_fullsized":"2024-09-12T17:59:34.761716+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:53.654833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'327","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.023013+0000","last_change":"2024-09-12T17:21:50.769396+0000","last_active":"2024-09-12T18:01:03.023013+0000","last_peered":"2024-09-12T18:01:03.023013+0000","last_clean":"2024-09-12T18:01:03.023013+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:03.023013+0000","last_undegraded":"2024-09-12T18:01:03.023013+0000","last_fullsized":"2024-09-12T18:01:03.023013+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:43.716922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11211288,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":547,"num_read_kb":37148,"num_write":1276,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'544","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501861+0000","last_change":"2024-09-12T17:21:52.746868+0000","last_active":"2024-09-12T17:59:18.501861+0000","last_peered":"2024-09-12T17:59:18.501861+0000","last_clean":"2024-09-12T17:59:18.501861+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T17:59:18.501861+0000","last_undegraded":"2024-09-12T17:59:18.501861+0000","last_fullsized":"2024-09-12T17:59:18.501861+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:06.625492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'256","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.042023+0000","last_change":"2024-09-12T17:21:50.754884+0000","last_active":"2024-09-12T18:01:03.042023+0000","last_peered":"2024-09-12T18:01:03.042023+0000","last_clean":"2024-09-12T18:01:03.042023+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:03.042023+0000","last_undegraded":"2024-09-12T18:01:03.042023+0000","last_fullsized":"2024-09-12T18:01:03.042023+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:00.548422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629626,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":655,"num_read_kb":16802,"num_write":914,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'613","reported_seq":2373,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760782+0000","last_change":"2024-09-12T17:21:52.743802+0000","last_active":"2024-09-12T17:59:34.760782+0000","last_peered":"2024-09-12T17:59:34.760782+0000","last_clean":"2024-09-12T17:59:34.760782+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T17:59:34.760782+0000","last_undegraded":"2024-09-12T17:59:34.760782+0000","last_fullsized":"2024-09-12T17:59:34.760782+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:44.764410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'352","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.900897+0000","last_change":"2024-09-12T17:21:50.773572+0000","last_active":"2024-09-12T17:59:15.900897+0000","last_peered":"2024-09-12T17:59:15.900897+0000","last_clean":"2024-09-12T17:59:15.900897+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T17:59:15.900897+0000","last_undegraded":"2024-09-12T17:59:15.900897+0000","last_fullsized":"2024-09-12T17:59:15.900897+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:19.872303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3074358,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":516,"num_read_kb":16039,"num_write":1242,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952830+0000","last_change":"2024-09-12T17:21:52.744313+0000","last_active":"2024-09-12T17:59:16.952830+0000","last_peered":"2024-09-12T17:59:16.952830+0000","last_clean":"2024-09-12T17:59:16.952830+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T17:59:16.952830+0000","last_undegraded":"2024-09-12T17:59:16.952830+0000","last_fullsized":"2024-09-12T17:59:16.952830+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:36.240139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'222","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.631679+0000","last_change":"2024-09-12T17:21:50.775138+0000","last_active":"2024-09-12T17:59:10.631679+0000","last_peered":"2024-09-12T17:59:10.631679+0000","last_clean":"2024-09-12T17:59:10.631679+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T17:59:10.631679+0000","last_undegraded":"2024-09-12T17:59:10.631679+0000","last_fullsized":"2024-09-12T17:59:10.631679+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.644034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":324,"num_read_kb":5548,"num_write":827,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'843","reported_seq":2503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170215+0000","last_change":"2024-09-12T17:21:52.756513+0000","last_active":"2024-09-12T17:59:16.170215+0000","last_peered":"2024-09-12T17:59:16.170215+0000","last_clean":"2024-09-12T17:59:16.170215+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T17:59:16.170215+0000","last_undegraded":"2024-09-12T17:59:16.170215+0000","last_fullsized":"2024-09-12T17:59:16.170215+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:27.548029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'264","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.450979+0000","last_change":"2024-09-12T17:21:50.777104+0000","last_active":"2024-09-12T17:59:11.450979+0000","last_peered":"2024-09-12T17:59:11.450979+0000","last_clean":"2024-09-12T17:59:11.450979+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T17:59:11.450979+0000","last_undegraded":"2024-09-12T17:59:11.450979+0000","last_fullsized":"2024-09-12T17:59:11.450979+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:28.170918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3186360,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":457,"num_read_kb":30145,"num_write":1023,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'506","reported_seq":2100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002369+0000","last_change":"2024-09-12T17:21:52.754895+0000","last_active":"2024-09-12T18:00:55.002369+0000","last_peered":"2024-09-12T18:00:55.002369+0000","last_clean":"2024-09-12T18:00:55.002369+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:00:55.002369+0000","last_undegraded":"2024-09-12T18:00:55.002369+0000","last_fullsized":"2024-09-12T18:00:55.002369+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:11.896956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'300","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.442228+0000","last_change":"2024-09-12T17:21:50.774992+0000","last_active":"2024-09-12T17:59:15.442228+0000","last_peered":"2024-09-12T17:59:15.442228+0000","last_clean":"2024-09-12T17:59:15.442228+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T17:59:15.442228+0000","last_undegraded":"2024-09-12T17:59:15.442228+0000","last_fullsized":"2024-09-12T17:59:15.442228+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:13.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4147498,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":607,"num_read_kb":10444,"num_write":1069,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'744","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390042+0000","last_change":"2024-09-12T17:21:52.749164+0000","last_active":"2024-09-12T17:59:16.390042+0000","last_peered":"2024-09-12T17:59:16.390042+0000","last_clean":"2024-09-12T17:59:16.390042+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T17:59:16.390042+0000","last_undegraded":"2024-09-12T17:59:16.390042+0000","last_fullsized":"2024-09-12T17:59:16.390042+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:52.169981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'342","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.115367+0000","last_change":"2024-09-12T17:21:50.769398+0000","last_active":"2024-09-12T18:01:03.115367+0000","last_peered":"2024-09-12T18:01:03.115367+0000","last_clean":"2024-09-12T18:01:03.115367+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:03.115367+0000","last_undegraded":"2024-09-12T18:01:03.115367+0000","last_fullsized":"2024-09-12T18:01:03.115367+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:23.356425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4746346,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":506,"num_read_kb":69094,"num_write":1090,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1194","reported_seq":2914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.762595+0000","last_change":"2024-09-12T17:21:52.754000+0000","last_active":"2024-09-12T17:59:34.762595+0000","last_peered":"2024-09-12T17:59:34.762595+0000","last_clean":"2024-09-12T17:59:34.762595+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T17:59:34.762595+0000","last_undegraded":"2024-09-12T17:59:34.762595+0000","last_fullsized":"2024-09-12T17:59:34.762595+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.531613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'489","reported_seq":2037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.359232+0000","last_change":"2024-09-12T17:21:52.751378+0000","last_active":"2024-09-12T17:59:34.359232+0000","last_peered":"2024-09-12T17:59:34.359232+0000","last_clean":"2024-09-12T17:59:34.359232+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T17:59:34.359232+0000","last_undegraded":"2024-09-12T17:59:34.359232+0000","last_fullsized":"2024-09-12T17:59:34.359232+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:04.419740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'326","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:48.080974+0000","last_change":"2024-09-12T17:21:50.764045+0000","last_active":"2024-09-12T18:00:48.080974+0000","last_peered":"2024-09-12T18:00:48.080974+0000","last_clean":"2024-09-12T18:00:48.080974+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:00:48.080974+0000","last_undegraded":"2024-09-12T18:00:48.080974+0000","last_fullsized":"2024-09-12T18:00:48.080974+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:33.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4191997,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":553,"num_read_kb":53764,"num_write":1159,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'445","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.834035+0000","last_change":"2024-09-12T17:21:52.752185+0000","last_active":"2024-09-12T17:59:28.834035+0000","last_peered":"2024-09-12T17:59:28.834035+0000","last_clean":"2024-09-12T17:59:28.834035+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T17:59:28.834035+0000","last_undegraded":"2024-09-12T17:59:28.834035+0000","last_fullsized":"2024-09-12T17:59:28.834035+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:15.912648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'252","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.590358+0000","last_change":"2024-09-12T17:21:50.768025+0000","last_active":"2024-09-12T17:59:17.590358+0000","last_peered":"2024-09-12T17:59:17.590358+0000","last_clean":"2024-09-12T17:59:17.590358+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T17:59:17.590358+0000","last_undegraded":"2024-09-12T17:59:17.590358+0000","last_fullsized":"2024-09-12T17:59:17.590358+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:02.016388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11503118,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":403,"num_read_kb":34593,"num_write":987,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'465","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170603+0000","last_change":"2024-09-12T17:21:52.755703+0000","last_active":"2024-09-12T17:59:16.170603+0000","last_peered":"2024-09-12T17:59:16.170603+0000","last_clean":"2024-09-12T17:59:16.170603+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T17:59:16.170603+0000","last_undegraded":"2024-09-12T17:59:16.170603+0000","last_fullsized":"2024-09-12T17:59:16.170603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:42.867412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'272","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.240675+0000","last_change":"2024-09-12T17:21:50.770163+0000","last_active":"2024-09-12T17:59:16.240675+0000","last_peered":"2024-09-12T17:59:16.240675+0000","last_clean":"2024-09-12T17:59:16.240675+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T17:59:16.240675+0000","last_undegraded":"2024-09-12T17:59:16.240675+0000","last_fullsized":"2024-09-12T17:59:16.240675+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:41.245093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13973510,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":807,"num_read_kb":30506,"num_write":992,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'419","reported_seq":1998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521811+0000","last_change":"2024-09-12T17:21:52.757976+0000","last_active":"2024-09-12T17:59:17.521811+0000","last_peered":"2024-09-12T17:59:17.521811+0000","last_clean":"2024-09-12T17:59:17.521811+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T17:59:17.521811+0000","last_undegraded":"2024-09-12T17:59:17.521811+0000","last_fullsized":"2024-09-12T17:59:17.521811+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:40.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'353","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.043199+0000","last_change":"2024-09-12T17:21:50.770236+0000","last_active":"2024-09-12T17:59:10.043199+0000","last_peered":"2024-09-12T17:59:10.043199+0000","last_clean":"2024-09-12T17:59:10.043199+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T17:59:10.043199+0000","last_undegraded":"2024-09-12T17:59:10.043199+0000","last_fullsized":"2024-09-12T17:59:10.043199+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:22.133455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13731819,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":564,"num_read_kb":18097,"num_write":1236,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1543","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769737+0000","last_change":"2024-09-12T17:21:52.755355+0000","last_active":"2024-09-12T17:59:34.769737+0000","last_peered":"2024-09-12T17:59:34.769737+0000","last_clean":"2024-09-12T17:59:34.769737+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T17:59:34.769737+0000","last_undegraded":"2024-09-12T17:59:34.769737+0000","last_fullsized":"2024-09-12T17:59:34.769737+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.429894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'274","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.871076+0000","last_change":"2024-09-12T17:21:50.767696+0000","last_active":"2024-09-12T17:59:31.871076+0000","last_peered":"2024-09-12T17:59:31.871076+0000","last_clean":"2024-09-12T17:59:31.871076+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T17:59:31.871076+0000","last_undegraded":"2024-09-12T17:59:31.871076+0000","last_fullsized":"2024-09-12T17:59:31.871076+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:07.425923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9819806,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":423,"num_read_kb":18482,"num_write":978,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'787","reported_seq":2365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365184+0000","last_change":"2024-09-12T17:21:52.754058+0000","last_active":"2024-09-12T17:59:34.365184+0000","last_peered":"2024-09-12T17:59:34.365184+0000","last_clean":"2024-09-12T17:59:34.365184+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T17:59:34.365184+0000","last_undegraded":"2024-09-12T17:59:34.365184+0000","last_fullsized":"2024-09-12T17:59:34.365184+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:35.171675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'274","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.655009+0000","last_change":"2024-09-12T17:21:50.754844+0000","last_active":"2024-09-12T17:59:11.655009+0000","last_peered":"2024-09-12T17:59:11.655009+0000","last_clean":"2024-09-12T17:59:11.655009+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T17:59:11.655009+0000","last_undegraded":"2024-09-12T17:59:11.655009+0000","last_fullsized":"2024-09-12T17:59:11.655009+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:01.060374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6721451,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":362,"num_read_kb":4177,"num_write":907,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'172","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.828620+0000","last_change":"2024-09-12T17:22:00.797198+0000","last_active":"2024-09-12T17:59:34.828620+0000","last_peered":"2024-09-12T17:59:34.828620+0000","last_clean":"2024-09-12T17:59:34.828620+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T17:59:34.828620+0000","last_undegraded":"2024-09-12T17:59:34.828620+0000","last_fullsized":"2024-09-12T17:59:34.828620+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.624828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'441","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769810+0000","last_change":"2024-09-12T17:21:52.752268+0000","last_active":"2024-09-12T17:59:34.769810+0000","last_peered":"2024-09-12T17:59:34.769810+0000","last_clean":"2024-09-12T17:59:34.769810+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T17:59:34.769810+0000","last_undegraded":"2024-09-12T17:59:34.769810+0000","last_fullsized":"2024-09-12T17:59:34.769810+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:22.039178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'343","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:39.545004+0000","last_change":"2024-09-12T17:22:25.841354+0000","last_active":"2024-09-12T17:58:39.545004+0000","last_peered":"2024-09-12T17:58:39.545004+0000","last_clean":"2024-09-12T17:58:39.545004+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T17:58:39.545004+0000","last_undegraded":"2024-09-12T17:58:39.545004+0000","last_fullsized":"2024-09-12T17:58:39.545004+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:21.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21655202,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":908,"num_read_kb":57262,"num_write":1296,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020196+0000","last_change":"2024-09-12T17:21:54.756402+0000","last_active":"2024-09-12T17:58:12.020196+0000","last_peered":"2024-09-12T17:58:12.020196+0000","last_clean":"2024-09-12T17:58:12.020196+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T17:58:12.020196+0000","last_undegraded":"2024-09-12T17:58:12.020196+0000","last_fullsized":"2024-09-12T17:58:12.020196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'338","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.039892+0000","last_change":"2024-09-12T17:21:56.762895+0000","last_active":"2024-09-12T18:00:37.039892+0000","last_peered":"2024-09-12T18:00:37.039892+0000","last_clean":"2024-09-12T18:00:37.039892+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:00:37.039892+0000","last_undegraded":"2024-09-12T18:00:37.039892+0000","last_fullsized":"2024-09-12T18:00:37.039892+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:42.017239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":988,"num_write":422,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131391+0000","last_change":"2024-09-12T17:21:58.779492+0000","last_active":"2024-09-12T17:58:17.131391+0000","last_peered":"2024-09-12T17:58:17.131391+0000","last_clean":"2024-09-12T17:58:17.131391+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T17:58:17.131391+0000","last_undegraded":"2024-09-12T17:58:17.131391+0000","last_fullsized":"2024-09-12T17:58:17.131391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:41.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2432","reported_seq":4316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.251478+0000","last_change":"2024-09-12T17:22:00.789480+0000","last_active":"2024-09-12T17:59:33.251478+0000","last_peered":"2024-09-12T17:59:33.251478+0000","last_clean":"2024-09-12T17:59:33.251478+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T17:59:33.251478+0000","last_undegraded":"2024-09-12T17:59:33.251478+0000","last_fullsized":"2024-09-12T17:59:33.251478+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.233355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'790","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998878+0000","last_change":"2024-09-12T17:21:52.750476+0000","last_active":"2024-09-12T18:00:54.998878+0000","last_peered":"2024-09-12T18:00:54.998878+0000","last_clean":"2024-09-12T18:00:54.998878+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:00:54.998878+0000","last_undegraded":"2024-09-12T18:00:54.998878+0000","last_fullsized":"2024-09-12T18:00:54.998878+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:08.162006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'243","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.578837+0000","last_change":"2024-09-12T17:21:50.757901+0000","last_active":"2024-09-12T17:59:17.578837+0000","last_peered":"2024-09-12T17:59:17.578837+0000","last_clean":"2024-09-12T17:59:17.578837+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T17:59:17.578837+0000","last_undegraded":"2024-09-12T17:59:17.578837+0000","last_fullsized":"2024-09-12T17:59:17.578837+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.728223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8553618,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":293,"num_read_kb":2179,"num_write":802,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010650+0000","last_change":"2024-09-12T17:21:54.752252+0000","last_active":"2024-09-12T17:57:07.010650+0000","last_peered":"2024-09-12T17:57:07.010650+0000","last_clean":"2024-09-12T17:57:07.010650+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T17:57:07.010650+0000","last_undegraded":"2024-09-12T17:57:07.010650+0000","last_fullsized":"2024-09-12T17:57:07.010650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.652789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'92","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.607688+0000","last_change":"2024-09-12T17:21:56.763049+0000","last_active":"2024-09-12T17:59:04.607688+0000","last_peered":"2024-09-12T17:59:04.607688+0000","last_clean":"2024-09-12T17:59:04.607688+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T17:59:04.607688+0000","last_undegraded":"2024-09-12T17:59:04.607688+0000","last_fullsized":"2024-09-12T17:59:04.607688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:05.126795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131351+0000","last_change":"2024-09-12T17:21:58.781052+0000","last_active":"2024-09-12T17:58:17.131351+0000","last_peered":"2024-09-12T17:58:17.131351+0000","last_clean":"2024-09-12T17:58:17.131351+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T17:58:17.131351+0000","last_undegraded":"2024-09-12T17:58:17.131351+0000","last_fullsized":"2024-09-12T17:58:17.131351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:41.465265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.645798+0000","last_change":"2024-09-12T17:22:00.795013+0000","last_active":"2024-09-12T17:59:34.645798+0000","last_peered":"2024-09-12T17:59:34.645798+0000","last_clean":"2024-09-12T17:59:34.645798+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T17:59:34.645798+0000","last_undegraded":"2024-09-12T17:59:34.645798+0000","last_fullsized":"2024-09-12T17:59:34.645798+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:11.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1527","reported_seq":3096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129953+0000","last_change":"2024-09-12T17:21:52.757548+0000","last_active":"2024-09-12T17:59:18.129953+0000","last_peered":"2024-09-12T17:59:18.129953+0000","last_clean":"2024-09-12T17:59:18.129953+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T17:59:18.129953+0000","last_undegraded":"2024-09-12T17:59:18.129953+0000","last_fullsized":"2024-09-12T17:59:18.129953+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:17.307943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'280","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.045480+0000","last_change":"2024-09-12T17:21:50.763989+0000","last_active":"2024-09-12T17:59:07.045480+0000","last_peered":"2024-09-12T17:59:07.045480+0000","last_clean":"2024-09-12T17:59:07.045480+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T17:59:07.045480+0000","last_undegraded":"2024-09-12T17:59:07.045480+0000","last_fullsized":"2024-09-12T17:59:07.045480+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:25.544190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11311711,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":405,"num_read_kb":7817,"num_write":1031,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.021331+0000","last_change":"2024-09-12T17:21:54.750735+0000","last_active":"2024-09-12T17:58:12.021331+0000","last_peered":"2024-09-12T17:58:12.021331+0000","last_clean":"2024-09-12T17:58:12.021331+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T17:58:12.021331+0000","last_undegraded":"2024-09-12T17:58:12.021331+0000","last_fullsized":"2024-09-12T17:58:12.021331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.118206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'103","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.030304+0000","last_change":"2024-09-12T17:21:56.760401+0000","last_active":"2024-09-12T17:59:27.030304+0000","last_peered":"2024-09-12T17:59:27.030304+0000","last_clean":"2024-09-12T17:59:27.030304+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T17:59:27.030304+0000","last_undegraded":"2024-09-12T17:59:27.030304+0000","last_fullsized":"2024-09-12T17:59:27.030304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:57.514040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'784","reported_seq":2209,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.132145+0000","last_change":"2024-09-12T17:21:58.790046+0000","last_active":"2024-09-12T18:00:56.132145+0000","last_peered":"2024-09-12T18:00:56.132145+0000","last_clean":"2024-09-12T18:00:56.132145+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:00:56.132145+0000","last_undegraded":"2024-09-12T18:00:56.132145+0000","last_fullsized":"2024-09-12T18:00:56.132145+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:36.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'222","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.951156+0000","last_change":"2024-09-12T17:22:00.795256+0000","last_active":"2024-09-12T18:00:54.951156+0000","last_peered":"2024-09-12T18:00:54.951156+0000","last_clean":"2024-09-12T18:00:54.951156+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:00:54.951156+0000","last_undegraded":"2024-09-12T18:00:54.951156+0000","last_fullsized":"2024-09-12T18:00:54.951156+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:18.506943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'711","reported_seq":1965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.198269+0000","last_change":"2024-09-12T17:21:52.754960+0000","last_active":"2024-09-12T17:59:17.198269+0000","last_peered":"2024-09-12T17:59:17.198269+0000","last_clean":"2024-09-12T17:59:17.198269+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T17:59:17.198269+0000","last_undegraded":"2024-09-12T17:59:17.198269+0000","last_fullsized":"2024-09-12T17:59:17.198269+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":700,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:04.170159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'342","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.089766+0000","last_change":"2024-09-12T17:21:50.763211+0000","last_active":"2024-09-12T17:58:33.089766+0000","last_peered":"2024-09-12T17:58:33.089766+0000","last_clean":"2024-09-12T17:58:33.089766+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T17:58:33.089766+0000","last_undegraded":"2024-09-12T17:58:33.089766+0000","last_fullsized":"2024-09-12T17:58:33.089766+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:09.631310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7337834,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":686,"num_read_kb":18202,"num_write":1393,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020236+0000","last_change":"2024-09-12T17:21:54.755690+0000","last_active":"2024-09-12T17:58:12.020236+0000","last_peered":"2024-09-12T17:58:12.020236+0000","last_clean":"2024-09-12T17:58:12.020236+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T17:58:12.020236+0000","last_undegraded":"2024-09-12T17:58:12.020236+0000","last_fullsized":"2024-09-12T17:58:12.020236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.998087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'273","reported_seq":831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.188619+0000","last_change":"2024-09-12T17:21:56.765160+0000","last_active":"2024-09-12T18:00:37.188619+0000","last_peered":"2024-09-12T18:00:37.188619+0000","last_clean":"2024-09-12T18:00:37.188619+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:00:37.188619+0000","last_undegraded":"2024-09-12T18:00:37.188619+0000","last_fullsized":"2024-09-12T18:00:37.188619+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:14.179700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1004,"num_write":378,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'809","reported_seq":2312,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.905898+0000","last_change":"2024-09-12T17:21:58.787567+0000","last_active":"2024-09-12T18:01:02.905898+0000","last_peered":"2024-09-12T18:01:02.905898+0000","last_clean":"2024-09-12T18:01:02.905898+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:02.905898+0000","last_undegraded":"2024-09-12T18:01:02.905898+0000","last_fullsized":"2024-09-12T18:01:02.905898+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:46.462958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'420","reported_seq":1985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008093+0000","last_change":"2024-09-12T17:21:52.748275+0000","last_active":"2024-09-12T18:00:55.008093+0000","last_peered":"2024-09-12T18:00:55.008093+0000","last_clean":"2024-09-12T18:00:55.008093+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:00:55.008093+0000","last_undegraded":"2024-09-12T18:00:55.008093+0000","last_fullsized":"2024-09-12T18:00:55.008093+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:17.610168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'268","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.149058+0000","last_change":"2024-09-12T17:21:50.783712+0000","last_active":"2024-09-12T17:59:07.149058+0000","last_peered":"2024-09-12T17:59:07.149058+0000","last_clean":"2024-09-12T17:59:07.149058+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T17:59:07.149058+0000","last_undegraded":"2024-09-12T17:59:07.149058+0000","last_fullsized":"2024-09-12T17:59:07.149058+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.656882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6318991,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":377,"num_read_kb":9180,"num_write":967,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'5","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.847177+0000","last_change":"2024-09-12T17:21:54.753421+0000","last_active":"2024-09-12T18:00:55.847177+0000","last_peered":"2024-09-12T18:00:55.847177+0000","last_clean":"2024-09-12T18:00:55.847177+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:00:55.847177+0000","last_undegraded":"2024-09-12T18:00:55.847177+0000","last_fullsized":"2024-09-12T18:00:55.847177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:14.711780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'306","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.025191+0000","last_change":"2024-09-12T17:21:56.772550+0000","last_active":"2024-09-12T17:58:57.025191+0000","last_peered":"2024-09-12T17:58:57.025191+0000","last_clean":"2024-09-12T17:58:57.025191+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T17:58:57.025191+0000","last_undegraded":"2024-09-12T17:58:57.025191+0000","last_fullsized":"2024-09-12T17:58:57.025191+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.672167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56871,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":947,"num_write":400,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133829+0000","last_change":"2024-09-12T17:21:58.785030+0000","last_active":"2024-09-12T17:58:02.133829+0000","last_peered":"2024-09-12T17:58:02.133829+0000","last_clean":"2024-09-12T17:58:02.133829+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T17:58:02.133829+0000","last_undegraded":"2024-09-12T17:58:02.133829+0000","last_fullsized":"2024-09-12T17:58:02.133829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:09.008553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'541","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.118388+0000","last_change":"2024-09-12T17:22:00.792070+0000","last_active":"2024-09-12T18:00:56.118388+0000","last_peered":"2024-09-12T18:00:56.118388+0000","last_clean":"2024-09-12T18:00:56.118388+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:00:56.118388+0000","last_undegraded":"2024-09-12T18:00:56.118388+0000","last_fullsized":"2024-09-12T18:00:56.118388+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:34.644522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'852","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840428+0000","last_change":"2024-09-12T17:21:52.754955+0000","last_active":"2024-09-12T17:59:28.840428+0000","last_peered":"2024-09-12T17:59:28.840428+0000","last_clean":"2024-09-12T17:59:28.840428+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T17:59:28.840428+0000","last_undegraded":"2024-09-12T17:59:28.840428+0000","last_fullsized":"2024-09-12T17:59:28.840428+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:26.586616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'269","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.156948+0000","last_change":"2024-09-12T17:21:50.765891+0000","last_active":"2024-09-12T17:59:18.156948+0000","last_peered":"2024-09-12T17:59:18.156948+0000","last_clean":"2024-09-12T17:59:18.156948+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T17:59:18.156948+0000","last_undegraded":"2024-09-12T17:59:18.156948+0000","last_fullsized":"2024-09-12T17:59:18.156948+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.566299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8970216,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":443,"num_read_kb":25915,"num_write":1024,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.139539+0000","last_change":"2024-09-12T17:21:54.751975+0000","last_active":"2024-09-12T17:58:47.139539+0000","last_peered":"2024-09-12T17:58:47.139539+0000","last_clean":"2024-09-12T17:58:47.139539+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T17:58:47.139539+0000","last_undegraded":"2024-09-12T17:58:47.139539+0000","last_fullsized":"2024-09-12T17:58:47.139539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:39.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'269","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.036581+0000","last_change":"2024-09-12T17:21:56.763953+0000","last_active":"2024-09-12T18:00:12.036581+0000","last_peered":"2024-09-12T18:00:12.036581+0000","last_clean":"2024-09-12T18:00:12.036581+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:00:12.036581+0000","last_undegraded":"2024-09-12T18:00:12.036581+0000","last_fullsized":"2024-09-12T18:00:12.036581+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:57.115467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61195,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":959,"num_write":364,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:52.008193+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:56:52.008193+0000","last_peered":"2024-09-12T17:56:52.008193+0000","last_clean":"2024-09-12T17:56:52.008193+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T17:56:52.008193+0000","last_undegraded":"2024-09-12T17:56:52.008193+0000","last_fullsized":"2024-09-12T17:56:52.008193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'97","reported_seq":580,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.140607+0000","last_change":"2024-09-12T17:22:00.792783+0000","last_active":"2024-09-12T17:59:37.140607+0000","last_peered":"2024-09-12T17:59:37.140607+0000","last_clean":"2024-09-12T17:59:37.140607+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T17:59:37.140607+0000","last_undegraded":"2024-09-12T17:59:37.140607+0000","last_fullsized":"2024-09-12T17:59:37.140607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:57.921660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'380","reported_seq":1851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774821+0000","last_change":"2024-09-12T17:21:52.747363+0000","last_active":"2024-09-12T17:59:18.774821+0000","last_peered":"2024-09-12T17:59:18.774821+0000","last_clean":"2024-09-12T17:59:18.774821+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T17:59:18.774821+0000","last_undegraded":"2024-09-12T17:59:18.774821+0000","last_fullsized":"2024-09-12T17:59:18.774821+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:23.091871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'324","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.131723+0000","last_change":"2024-09-12T17:21:50.762942+0000","last_active":"2024-09-12T17:58:51.131723+0000","last_peered":"2024-09-12T17:58:51.131723+0000","last_clean":"2024-09-12T17:58:51.131723+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T17:58:51.131723+0000","last_undegraded":"2024-09-12T17:58:51.131723+0000","last_fullsized":"2024-09-12T17:58:51.131723+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:36.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4754569,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":687,"num_read_kb":11787,"num_write":1217,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'3","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.669612+0000","last_change":"2024-09-12T17:21:54.749892+0000","last_active":"2024-09-12T18:01:02.669612+0000","last_peered":"2024-09-12T18:01:02.669612+0000","last_clean":"2024-09-12T18:01:02.669612+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:02.669612+0000","last_undegraded":"2024-09-12T18:01:02.669612+0000","last_fullsized":"2024-09-12T18:01:02.669612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:07.627632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'237","reported_seq":810,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.106867+0000","last_change":"2024-09-12T17:21:56.767379+0000","last_active":"2024-09-12T18:00:56.106867+0000","last_peered":"2024-09-12T18:00:56.106867+0000","last_clean":"2024-09-12T18:00:56.106867+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:00:56.106867+0000","last_undegraded":"2024-09-12T18:00:56.106867+0000","last_fullsized":"2024-09-12T18:00:56.106867+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:36.431381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45021,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":757,"num_write":298,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'808","reported_seq":6237,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.907105+0000","last_change":"2024-09-12T17:21:58.786457+0000","last_active":"2024-09-12T18:01:02.907105+0000","last_peered":"2024-09-12T18:01:02.907105+0000","last_clean":"2024-09-12T18:01:02.907105+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:02.907105+0000","last_undegraded":"2024-09-12T18:01:02.907105+0000","last_fullsized":"2024-09-12T18:01:02.907105+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:35.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'97","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.003698+0000","last_change":"2024-09-12T17:22:00.795600+0000","last_active":"2024-09-12T18:00:55.003698+0000","last_peered":"2024-09-12T18:00:55.003698+0000","last_clean":"2024-09-12T18:00:55.003698+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:00:55.003698+0000","last_undegraded":"2024-09-12T18:00:55.003698+0000","last_fullsized":"2024-09-12T18:00:55.003698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:12.865071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'886","reported_seq":2499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012883+0000","last_change":"2024-09-12T17:21:52.754090+0000","last_active":"2024-09-12T17:59:19.012883+0000","last_peered":"2024-09-12T17:59:19.012883+0000","last_clean":"2024-09-12T17:59:19.012883+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T17:59:19.012883+0000","last_undegraded":"2024-09-12T17:59:19.012883+0000","last_fullsized":"2024-09-12T17:59:19.012883+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:08.146246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'268","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.579979+0000","last_change":"2024-09-12T17:21:50.781428+0000","last_active":"2024-09-12T17:59:07.579979+0000","last_peered":"2024-09-12T17:59:07.579979+0000","last_clean":"2024-09-12T17:59:07.579979+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T17:59:07.579979+0000","last_undegraded":"2024-09-12T17:59:07.579979+0000","last_fullsized":"2024-09-12T17:59:07.579979+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:03.976696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8396844,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":397,"num_read_kb":4507,"num_write":972,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.140189+0000","last_change":"2024-09-12T17:21:54.756631+0000","last_active":"2024-09-12T17:58:52.140189+0000","last_peered":"2024-09-12T17:58:52.140189+0000","last_clean":"2024-09-12T17:58:52.140189+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T17:58:52.140189+0000","last_undegraded":"2024-09-12T17:58:52.140189+0000","last_fullsized":"2024-09-12T17:58:52.140189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:30.950089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'449","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.109651+0000","last_change":"2024-09-12T17:21:56.761927+0000","last_active":"2024-09-12T18:00:56.109651+0000","last_peered":"2024-09-12T18:00:56.109651+0000","last_clean":"2024-09-12T18:00:56.109651+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:00:56.109651+0000","last_undegraded":"2024-09-12T18:00:56.109651+0000","last_fullsized":"2024-09-12T18:00:56.109651+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:22.363422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109212,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":798,"num_read_kb":1759,"num_write":668,"num_write_kb":582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138304+0000","last_change":"2024-09-12T17:21:58.789916+0000","last_active":"2024-09-12T17:58:48.138304+0000","last_peered":"2024-09-12T17:58:48.138304+0000","last_clean":"2024-09-12T17:58:48.138304+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T17:58:48.138304+0000","last_undegraded":"2024-09-12T17:58:48.138304+0000","last_fullsized":"2024-09-12T17:58:48.138304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'118","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.360795+0000","last_change":"2024-09-12T17:22:00.797337+0000","last_active":"2024-09-12T17:59:34.360795+0000","last_peered":"2024-09-12T17:59:34.360795+0000","last_clean":"2024-09-12T17:59:34.360795+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T17:59:34.360795+0000","last_undegraded":"2024-09-12T17:59:34.360795+0000","last_fullsized":"2024-09-12T17:59:34.360795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.474417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1094","reported_seq":2455,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.391930+0000","last_change":"2024-09-12T17:21:52.752079+0000","last_active":"2024-09-12T17:59:15.391930+0000","last_peered":"2024-09-12T17:59:15.391930+0000","last_clean":"2024-09-12T17:59:15.391930+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T17:59:15.391930+0000","last_undegraded":"2024-09-12T17:59:15.391930+0000","last_fullsized":"2024-09-12T17:59:15.391930+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1000,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.260009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'317","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.019873+0000","last_change":"2024-09-12T17:21:50.771854+0000","last_active":"2024-09-12T17:59:08.019873+0000","last_peered":"2024-09-12T17:59:08.019873+0000","last_clean":"2024-09-12T17:59:08.019873+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T17:59:08.019873+0000","last_undegraded":"2024-09-12T17:59:08.019873+0000","last_fullsized":"2024-09-12T17:59:08.019873+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:43.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5342730,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":456,"num_read_kb":4065,"num_write":1080,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137482+0000","last_change":"2024-09-12T17:21:54.754091+0000","last_active":"2024-09-12T17:57:55.137482+0000","last_peered":"2024-09-12T17:57:55.137482+0000","last_clean":"2024-09-12T17:57:55.137482+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T17:57:55.137482+0000","last_undegraded":"2024-09-12T17:57:55.137482+0000","last_fullsized":"2024-09-12T17:57:55.137482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:01.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'271","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.144859+0000","last_change":"2024-09-12T17:21:56.766601+0000","last_active":"2024-09-12T18:00:12.144859+0000","last_peered":"2024-09-12T18:00:12.144859+0000","last_clean":"2024-09-12T18:00:12.144859+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:00:12.144859+0000","last_undegraded":"2024-09-12T18:00:12.144859+0000","last_fullsized":"2024-09-12T18:00:12.144859+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:02.002328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57281,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":936,"num_write":424,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138983+0000","last_change":"2024-09-12T17:21:58.780947+0000","last_active":"2024-09-12T17:58:05.138983+0000","last_peered":"2024-09-12T17:58:05.138983+0000","last_clean":"2024-09-12T17:58:05.138983+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T17:58:05.138983+0000","last_undegraded":"2024-09-12T17:58:05.138983+0000","last_fullsized":"2024-09-12T17:58:05.138983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.674014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'125","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:45.147948+0000","last_change":"2024-09-12T17:22:00.794120+0000","last_active":"2024-09-12T18:00:45.147948+0000","last_peered":"2024-09-12T18:00:45.147948+0000","last_clean":"2024-09-12T18:00:45.147948+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:00:45.147948+0000","last_undegraded":"2024-09-12T18:00:45.147948+0000","last_fullsized":"2024-09-12T18:00:45.147948+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.905380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'852","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.130052+0000","last_change":"2024-09-12T17:21:52.744001+0000","last_active":"2024-09-12T17:59:18.130052+0000","last_peered":"2024-09-12T17:59:18.130052+0000","last_clean":"2024-09-12T17:59:18.130052+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T17:59:18.130052+0000","last_undegraded":"2024-09-12T17:59:18.130052+0000","last_fullsized":"2024-09-12T17:59:18.130052+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.116207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'236","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.324527+0000","last_change":"2024-09-12T17:21:50.763216+0000","last_active":"2024-09-12T17:59:18.324527+0000","last_peered":"2024-09-12T17:59:18.324527+0000","last_clean":"2024-09-12T17:59:18.324527+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T17:59:18.324527+0000","last_undegraded":"2024-09-12T17:59:18.324527+0000","last_fullsized":"2024-09-12T17:59:18.324527+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:33.880090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581454,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":379,"num_read_kb":12213,"num_write":903,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.131531+0000","last_change":"2024-09-12T17:21:54.753927+0000","last_active":"2024-09-12T17:57:58.131531+0000","last_peered":"2024-09-12T17:57:58.131531+0000","last_clean":"2024-09-12T17:57:58.131531+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T17:57:58.131531+0000","last_undegraded":"2024-09-12T17:57:58.131531+0000","last_fullsized":"2024-09-12T17:57:58.131531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:03.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'272","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.105905+0000","last_change":"2024-09-12T17:21:56.769847+0000","last_active":"2024-09-12T18:01:03.105905+0000","last_peered":"2024-09-12T18:01:03.105905+0000","last_clean":"2024-09-12T18:01:03.105905+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:03.105905+0000","last_undegraded":"2024-09-12T18:01:03.105905+0000","last_fullsized":"2024-09-12T18:01:03.105905+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:50.849719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53000,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":937,"num_write":357,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'767","reported_seq":2281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.133223+0000","last_change":"2024-09-12T17:21:58.787962+0000","last_active":"2024-09-12T18:00:56.133223+0000","last_peered":"2024-09-12T18:00:56.133223+0000","last_clean":"2024-09-12T18:00:56.133223+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:00:56.133223+0000","last_undegraded":"2024-09-12T18:00:56.133223+0000","last_fullsized":"2024-09-12T18:00:56.133223+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.107541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'91","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.238731+0000","last_change":"2024-09-12T17:22:00.788149+0000","last_active":"2024-09-12T17:59:08.238731+0000","last_peered":"2024-09-12T17:59:08.238731+0000","last_clean":"2024-09-12T17:59:08.238731+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T17:59:08.238731+0000","last_undegraded":"2024-09-12T17:59:08.238731+0000","last_fullsized":"2024-09-12T17:59:08.238731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:52.865371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'393","reported_seq":1796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618253+0000","last_change":"2024-09-12T17:21:52.746636+0000","last_active":"2024-09-12T17:59:16.618253+0000","last_peered":"2024-09-12T17:59:16.618253+0000","last_clean":"2024-09-12T17:59:16.618253+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T17:59:16.618253+0000","last_undegraded":"2024-09-12T17:59:16.618253+0000","last_fullsized":"2024-09-12T17:59:16.618253+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:16.893041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'254","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.691518+0000","last_change":"2024-09-12T17:21:50.764044+0000","last_active":"2024-09-12T17:59:10.691518+0000","last_peered":"2024-09-12T17:59:10.691518+0000","last_clean":"2024-09-12T17:59:10.691518+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T17:59:10.691518+0000","last_undegraded":"2024-09-12T17:59:10.691518+0000","last_fullsized":"2024-09-12T17:59:10.691518+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:30.691491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4566413,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":398,"num_read_kb":2736,"num_write":978,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.846903+0000","last_change":"2024-09-12T17:21:54.752963+0000","last_active":"2024-09-12T18:00:55.846903+0000","last_peered":"2024-09-12T18:00:55.846903+0000","last_clean":"2024-09-12T18:00:55.846903+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:00:55.846903+0000","last_undegraded":"2024-09-12T18:00:55.846903+0000","last_fullsized":"2024-09-12T18:00:55.846903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:56.647371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'76","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.935202+0000","last_change":"2024-09-12T17:21:56.766705+0000","last_active":"2024-09-12T17:59:07.935202+0000","last_peered":"2024-09-12T17:59:07.935202+0000","last_clean":"2024-09-12T17:59:07.935202+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T17:59:07.935202+0000","last_undegraded":"2024-09-12T17:59:07.935202+0000","last_fullsized":"2024-09-12T17:59:07.935202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.416717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'802","reported_seq":2225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.134327+0000","last_change":"2024-09-12T17:21:58.775054+0000","last_active":"2024-09-12T18:00:56.134327+0000","last_peered":"2024-09-12T18:00:56.134327+0000","last_clean":"2024-09-12T18:00:56.134327+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:00:56.134327+0000","last_undegraded":"2024-09-12T18:00:56.134327+0000","last_fullsized":"2024-09-12T18:00:56.134327+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:40.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'123","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.753528+0000","last_change":"2024-09-12T17:22:00.796406+0000","last_active":"2024-09-12T17:59:06.753528+0000","last_peered":"2024-09-12T17:59:06.753528+0000","last_clean":"2024-09-12T17:59:06.753528+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T17:59:06.753528+0000","last_undegraded":"2024-09-12T17:59:06.753528+0000","last_fullsized":"2024-09-12T17:59:06.753528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:55.110524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'767","reported_seq":2391,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501638+0000","last_change":"2024-09-12T17:21:52.753271+0000","last_active":"2024-09-12T17:59:18.501638+0000","last_peered":"2024-09-12T17:59:18.501638+0000","last_clean":"2024-09-12T17:59:18.501638+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T17:59:18.501638+0000","last_undegraded":"2024-09-12T17:59:18.501638+0000","last_fullsized":"2024-09-12T17:59:18.501638+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:40.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'230","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.091939+0000","last_change":"2024-09-12T17:21:50.759354+0000","last_active":"2024-09-12T17:59:09.091939+0000","last_peered":"2024-09-12T17:59:09.091939+0000","last_clean":"2024-09-12T17:59:09.091939+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T17:59:09.091939+0000","last_undegraded":"2024-09-12T17:59:09.091939+0000","last_fullsized":"2024-09-12T17:59:09.091939+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:28.652326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40468,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":648,"num_read_kb":10056,"num_write":808,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:57.017784+0000","last_change":"2024-09-12T17:21:54.755944+0000","last_active":"2024-09-12T17:57:57.017784+0000","last_peered":"2024-09-12T17:57:57.017784+0000","last_clean":"2024-09-12T17:57:57.017784+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T17:57:57.017784+0000","last_undegraded":"2024-09-12T17:57:57.017784+0000","last_fullsized":"2024-09-12T17:57:57.017784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:30.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'314","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.144814+0000","last_change":"2024-09-12T17:21:56.769845+0000","last_active":"2024-09-12T18:00:12.144814+0000","last_peered":"2024-09-12T18:00:12.144814+0000","last_clean":"2024-09-12T18:00:12.144814+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:00:12.144814+0000","last_undegraded":"2024-09-12T18:00:12.144814+0000","last_fullsized":"2024-09-12T18:00:12.144814+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.744587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52527,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1087,"num_read_kb":1540,"num_write":1574,"num_write_kb":1456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.169136+0000","last_change":"2024-09-12T17:21:58.783566+0000","last_active":"2024-09-12T17:58:02.169136+0000","last_peered":"2024-09-12T17:58:02.169136+0000","last_clean":"2024-09-12T17:58:02.169136+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T17:58:02.169136+0000","last_undegraded":"2024-09-12T17:58:02.169136+0000","last_fullsized":"2024-09-12T17:58:02.169136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:16.155795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'100","reported_seq":584,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.982177+0000","last_change":"2024-09-12T17:22:00.795820+0000","last_active":"2024-09-12T17:59:06.982177+0000","last_peered":"2024-09-12T17:59:06.982177+0000","last_clean":"2024-09-12T17:59:06.982177+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T17:59:06.982177+0000","last_undegraded":"2024-09-12T17:59:06.982177+0000","last_fullsized":"2024-09-12T17:59:06.982177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:47.982837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'458","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.171017+0000","last_change":"2024-09-12T17:21:52.747649+0000","last_active":"2024-09-12T17:59:16.171017+0000","last_peered":"2024-09-12T17:59:16.171017+0000","last_clean":"2024-09-12T17:59:16.171017+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T17:59:16.171017+0000","last_undegraded":"2024-09-12T17:59:16.171017+0000","last_fullsized":"2024-09-12T17:59:16.171017+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:32.995329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:42.126398+0000","last_change":"2024-09-12T17:21:34.165528+0000","last_active":"2024-09-12T17:57:42.126398+0000","last_peered":"2024-09-12T17:57:42.126398+0000","last_clean":"2024-09-12T17:57:42.126398+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T17:57:42.126398+0000","last_undegraded":"2024-09-12T17:57:42.126398+0000","last_fullsized":"2024-09-12T17:57:42.126398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_clean_scrub_stamp":"2024-09-12T17:21:32.756341+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:27.504316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010866+0000","last_change":"2024-09-12T17:21:41.866930+0000","last_active":"2024-09-12T17:57:07.010866+0000","last_peered":"2024-09-12T17:57:07.010866+0000","last_clean":"2024-09-12T17:57:07.010866+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T17:57:07.010866+0000","last_undegraded":"2024-09-12T17:57:07.010866+0000","last_fullsized":"2024-09-12T17:57:07.010866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:40.562409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'291","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.982742+0000","last_change":"2024-09-12T17:21:50.760757+0000","last_active":"2024-09-12T17:59:14.982742+0000","last_peered":"2024-09-12T17:59:14.982742+0000","last_clean":"2024-09-12T17:59:14.982742+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T17:59:14.982742+0000","last_undegraded":"2024-09-12T17:59:14.982742+0000","last_fullsized":"2024-09-12T17:59:14.982742+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:52.679675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357547,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":570,"num_read_kb":42378,"num_write":1108,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012494+0000","last_change":"2024-09-12T17:21:54.750180+0000","last_active":"2024-09-12T17:57:22.012494+0000","last_peered":"2024-09-12T17:57:22.012494+0000","last_clean":"2024-09-12T17:57:22.012494+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T17:57:22.012494+0000","last_undegraded":"2024-09-12T17:57:22.012494+0000","last_fullsized":"2024-09-12T17:57:22.012494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:24.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'722","reported_seq":1406,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.114358+0000","last_change":"2024-09-12T17:21:56.765494+0000","last_active":"2024-09-12T18:00:56.114358+0000","last_peered":"2024-09-12T18:00:56.114358+0000","last_clean":"2024-09-12T18:00:56.114358+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:00:56.114358+0000","last_undegraded":"2024-09-12T18:00:56.114358+0000","last_fullsized":"2024-09-12T18:00:56.114358+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:08.857619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201009,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1413,"num_read_kb":2992,"num_write":1362,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138445+0000","last_change":"2024-09-12T17:21:58.788291+0000","last_active":"2024-09-12T17:58:48.138445+0000","last_peered":"2024-09-12T17:58:48.138445+0000","last_clean":"2024-09-12T17:58:48.138445+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T17:58:48.138445+0000","last_undegraded":"2024-09-12T17:58:48.138445+0000","last_fullsized":"2024-09-12T17:58:48.138445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:07.437948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'195","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.775559+0000","last_change":"2024-09-12T17:22:00.796574+0000","last_active":"2024-09-12T17:59:34.775559+0000","last_peered":"2024-09-12T17:59:34.775559+0000","last_clean":"2024-09-12T17:59:34.775559+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T17:59:34.775559+0000","last_undegraded":"2024-09-12T17:59:34.775559+0000","last_fullsized":"2024-09-12T17:59:34.775559+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.468190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'468","reported_seq":1992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774603+0000","last_change":"2024-09-12T17:21:52.757096+0000","last_active":"2024-09-12T17:59:18.774603+0000","last_peered":"2024-09-12T17:59:18.774603+0000","last_clean":"2024-09-12T17:59:18.774603+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T17:59:18.774603+0000","last_undegraded":"2024-09-12T17:59:18.774603+0000","last_fullsized":"2024-09-12T17:59:18.774603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.000502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:47.016306+0000","last_change":"2024-09-12T17:21:41.866473+0000","last_active":"2024-09-12T17:57:47.016306+0000","last_peered":"2024-09-12T17:57:47.016306+0000","last_clean":"2024-09-12T17:57:47.016306+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T17:57:47.016306+0000","last_undegraded":"2024-09-12T17:57:47.016306+0000","last_fullsized":"2024-09-12T17:57:47.016306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:12.213846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'330","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.867648+0000","last_change":"2024-09-12T17:21:50.757872+0000","last_active":"2024-09-12T17:59:11.867648+0000","last_peered":"2024-09-12T17:59:11.867648+0000","last_clean":"2024-09-12T17:59:11.867648+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T17:59:11.867648+0000","last_undegraded":"2024-09-12T17:59:11.867648+0000","last_fullsized":"2024-09-12T17:59:11.867648+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:09.535999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10884887,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":556,"num_read_kb":13401,"num_write":1298,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.024531+0000","last_change":"2024-09-12T17:21:54.755790+0000","last_active":"2024-09-12T17:58:47.024531+0000","last_peered":"2024-09-12T17:58:47.024531+0000","last_clean":"2024-09-12T17:58:47.024531+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T17:58:47.024531+0000","last_undegraded":"2024-09-12T17:58:47.024531+0000","last_fullsized":"2024-09-12T17:58:47.024531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:59.470297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1231","reported_seq":2612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.128703+0000","last_change":"2024-09-12T17:21:56.768252+0000","last_active":"2024-09-12T18:00:56.128703+0000","last_peered":"2024-09-12T18:00:56.128703+0000","last_clean":"2024-09-12T18:00:56.128703+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:00:56.128703+0000","last_undegraded":"2024-09-12T18:00:56.128703+0000","last_fullsized":"2024-09-12T18:00:56.128703+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":1200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:01.013352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189156,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1940,"num_read_kb":3413,"num_write":1060,"num_write_kb":937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014403+0000","last_change":"2024-09-12T17:21:58.790253+0000","last_active":"2024-09-12T17:57:32.014403+0000","last_peered":"2024-09-12T17:57:32.014403+0000","last_clean":"2024-09-12T17:57:32.014403+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T17:57:32.014403+0000","last_undegraded":"2024-09-12T17:57:32.014403+0000","last_fullsized":"2024-09-12T17:57:32.014403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:47.790212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'133","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.894435+0000","last_change":"2024-09-12T17:22:00.798051+0000","last_active":"2024-09-12T17:59:12.894435+0000","last_peered":"2024-09-12T17:59:12.894435+0000","last_clean":"2024-09-12T17:59:12.894435+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T17:59:12.894435+0000","last_undegraded":"2024-09-12T17:59:12.894435+0000","last_fullsized":"2024-09-12T17:59:12.894435+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:21.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'449","reported_seq":1957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365791+0000","last_change":"2024-09-12T17:21:52.754734+0000","last_active":"2024-09-12T17:59:34.365791+0000","last_peered":"2024-09-12T17:59:34.365791+0000","last_clean":"2024-09-12T17:59:34.365791+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T17:59:34.365791+0000","last_undegraded":"2024-09-12T17:59:34.365791+0000","last_fullsized":"2024-09-12T17:59:34.365791+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:38.929430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:05.130098+0000","last_change":"2024-09-12T17:21:42.043085+0000","last_active":"2024-09-12T17:57:05.130098+0000","last_peered":"2024-09-12T17:57:05.130098+0000","last_clean":"2024-09-12T17:57:05.130098+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T17:57:05.130098+0000","last_undegraded":"2024-09-12T17:57:05.130098+0000","last_fullsized":"2024-09-12T17:57:05.130098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:25.499579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'307","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.079873+0000","last_change":"2024-09-12T17:21:50.744141+0000","last_active":"2024-09-12T18:01:03.079873+0000","last_peered":"2024-09-12T18:01:03.079873+0000","last_clean":"2024-09-12T18:01:03.079873+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:03.079873+0000","last_undegraded":"2024-09-12T18:01:03.079873+0000","last_fullsized":"2024-09-12T18:01:03.079873+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:16.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8349148,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":490,"num_read_kb":34998,"num_write":1087,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144229+0000","last_change":"2024-09-12T17:21:54.756222+0000","last_active":"2024-09-12T17:58:45.144229+0000","last_peered":"2024-09-12T17:58:45.144229+0000","last_clean":"2024-09-12T17:58:45.144229+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T17:58:45.144229+0000","last_undegraded":"2024-09-12T17:58:45.144229+0000","last_fullsized":"2024-09-12T17:58:45.144229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.426990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'196","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.143046+0000","last_change":"2024-09-12T17:21:56.768882+0000","last_active":"2024-09-12T18:00:54.143046+0000","last_peered":"2024-09-12T18:00:54.143046+0000","last_clean":"2024-09-12T18:00:54.143046+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:00:54.143046+0000","last_undegraded":"2024-09-12T18:00:54.143046+0000","last_fullsized":"2024-09-12T18:00:54.143046+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:28.839162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013880+0000","last_change":"2024-09-12T17:21:58.787288+0000","last_active":"2024-09-12T17:57:27.013880+0000","last_peered":"2024-09-12T17:57:27.013880+0000","last_clean":"2024-09-12T17:57:27.013880+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T17:57:27.013880+0000","last_undegraded":"2024-09-12T17:57:27.013880+0000","last_fullsized":"2024-09-12T17:57:27.013880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.278913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'288","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.917584+0000","last_change":"2024-09-12T17:22:00.794526+0000","last_active":"2024-09-12T17:59:34.917584+0000","last_peered":"2024-09-12T17:59:34.917584+0000","last_clean":"2024-09-12T17:59:34.917584+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T17:59:34.917584+0000","last_undegraded":"2024-09-12T17:59:34.917584+0000","last_fullsized":"2024-09-12T17:59:34.917584+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:11.669153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'466","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008227+0000","last_change":"2024-09-12T17:21:52.750831+0000","last_active":"2024-09-12T18:00:55.008227+0000","last_peered":"2024-09-12T18:00:55.008227+0000","last_clean":"2024-09-12T18:00:55.008227+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:00:55.008227+0000","last_undegraded":"2024-09-12T18:00:55.008227+0000","last_fullsized":"2024-09-12T18:00:55.008227+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:37.661922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010821+0000","last_change":"2024-09-12T17:21:41.867476+0000","last_active":"2024-09-12T17:57:07.010821+0000","last_peered":"2024-09-12T17:57:07.010821+0000","last_clean":"2024-09-12T17:57:07.010821+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T17:57:07.010821+0000","last_undegraded":"2024-09-12T17:57:07.010821+0000","last_fullsized":"2024-09-12T17:57:07.010821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:11.414546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'342","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.922185+0000","last_change":"2024-09-12T17:21:50.774438+0000","last_active":"2024-09-12T17:59:06.922185+0000","last_peered":"2024-09-12T17:59:06.922185+0000","last_clean":"2024-09-12T17:59:06.922185+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T17:59:06.922185+0000","last_undegraded":"2024-09-12T17:59:06.922185+0000","last_fullsized":"2024-09-12T17:59:06.922185+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.163145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9638691,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":550,"num_read_kb":11799,"num_write":1294,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133267+0000","last_change":"2024-09-12T17:21:54.752679+0000","last_active":"2024-09-12T17:57:25.133267+0000","last_peered":"2024-09-12T17:57:25.133267+0000","last_clean":"2024-09-12T17:57:25.133267+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T17:57:25.133267+0000","last_undegraded":"2024-09-12T17:57:25.133267+0000","last_fullsized":"2024-09-12T17:57:25.133267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:38.750473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'103","reported_seq":628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.240568+0000","last_change":"2024-09-12T17:21:56.763840+0000","last_active":"2024-09-12T18:00:56.240568+0000","last_peered":"2024-09-12T18:00:56.240568+0000","last_clean":"2024-09-12T18:00:56.240568+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:00:56.240568+0000","last_undegraded":"2024-09-12T18:00:56.240568+0000","last_fullsized":"2024-09-12T18:00:56.240568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:23.362341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025180+0000","last_change":"2024-09-12T17:21:58.789360+0000","last_active":"2024-09-12T17:58:52.025180+0000","last_peered":"2024-09-12T17:58:52.025180+0000","last_clean":"2024-09-12T17:58:52.025180+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T17:58:52.025180+0000","last_undegraded":"2024-09-12T17:58:52.025180+0000","last_fullsized":"2024-09-12T17:58:52.025180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:51.063573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'141","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.497508+0000","last_change":"2024-09-12T17:22:00.788204+0000","last_active":"2024-09-12T17:59:06.497508+0000","last_peered":"2024-09-12T17:59:06.497508+0000","last_clean":"2024-09-12T17:59:06.497508+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T17:59:06.497508+0000","last_undegraded":"2024-09-12T17:59:06.497508+0000","last_fullsized":"2024-09-12T17:59:06.497508+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:34.479482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'875","reported_seq":2704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521421+0000","last_change":"2024-09-12T17:21:52.747529+0000","last_active":"2024-09-12T17:59:17.521421+0000","last_peered":"2024-09-12T17:59:17.521421+0000","last_clean":"2024-09-12T17:59:17.521421+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T17:59:17.521421+0000","last_undegraded":"2024-09-12T17:59:17.521421+0000","last_fullsized":"2024-09-12T17:59:17.521421+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:25.413581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'314","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.008318+0000","last_change":"2024-09-12T17:21:50.763853+0000","last_active":"2024-09-12T17:58:51.008318+0000","last_peered":"2024-09-12T17:58:51.008318+0000","last_clean":"2024-09-12T17:58:51.008318+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T17:58:51.008318+0000","last_undegraded":"2024-09-12T17:58:51.008318+0000","last_fullsized":"2024-09-12T17:58:51.008318+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:50.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12929870,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":536,"num_read_kb":25520,"num_write":1185,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:08.123646+0000","last_change":"2024-09-12T17:21:42.043334+0000","last_active":"2024-09-12T17:57:08.123646+0000","last_peered":"2024-09-12T17:57:08.123646+0000","last_clean":"2024-09-12T17:57:08.123646+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T17:57:08.123646+0000","last_undegraded":"2024-09-12T17:57:08.123646+0000","last_fullsized":"2024-09-12T17:57:08.123646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:38.050118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.013014+0000","last_change":"2024-09-12T17:21:54.755491+0000","last_active":"2024-09-12T17:57:22.013014+0000","last_peered":"2024-09-12T17:57:22.013014+0000","last_clean":"2024-09-12T17:57:22.013014+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T17:57:22.013014+0000","last_undegraded":"2024-09-12T17:57:22.013014+0000","last_fullsized":"2024-09-12T17:57:22.013014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:39.242340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'533","reported_seq":1173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.094727+0000","last_change":"2024-09-12T17:21:56.763880+0000","last_active":"2024-09-12T18:00:56.094727+0000","last_peered":"2024-09-12T18:00:56.094727+0000","last_clean":"2024-09-12T18:00:56.094727+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:00:56.094727+0000","last_undegraded":"2024-09-12T18:00:56.094727+0000","last_fullsized":"2024-09-12T18:00:56.094727+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:59.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131153,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":1991,"num_write":782,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164192+0000","last_change":"2024-09-12T17:21:58.786573+0000","last_active":"2024-09-12T17:57:27.164192+0000","last_peered":"2024-09-12T17:57:27.164192+0000","last_clean":"2024-09-12T17:57:27.164192+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T17:57:27.164192+0000","last_undegraded":"2024-09-12T17:57:27.164192+0000","last_fullsized":"2024-09-12T17:57:27.164192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:30.677838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'166","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.362537+0000","last_change":"2024-09-12T17:22:00.798528+0000","last_active":"2024-09-12T17:59:34.362537+0000","last_peered":"2024-09-12T17:59:34.362537+0000","last_clean":"2024-09-12T17:59:34.362537+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T17:59:34.362537+0000","last_undegraded":"2024-09-12T17:59:34.362537+0000","last_fullsized":"2024-09-12T17:59:34.362537+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:54.854895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'825","reported_seq":2342,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.763003+0000","last_change":"2024-09-12T17:21:52.754209+0000","last_active":"2024-09-12T17:59:34.763003+0000","last_peered":"2024-09-12T17:59:34.763003+0000","last_clean":"2024-09-12T17:59:34.763003+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T17:59:34.763003+0000","last_undegraded":"2024-09-12T17:59:34.763003+0000","last_fullsized":"2024-09-12T17:59:34.763003+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:34.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'318","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.766376+0000","last_change":"2024-09-12T17:21:50.763342+0000","last_active":"2024-09-12T17:59:16.766376+0000","last_peered":"2024-09-12T17:59:16.766376+0000","last_clean":"2024-09-12T17:59:16.766376+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T17:59:16.766376+0000","last_undegraded":"2024-09-12T17:59:16.766376+0000","last_fullsized":"2024-09-12T17:59:16.766376+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:44.497032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2859250,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":521,"num_read_kb":7304,"num_write":1185,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.011523+0000","last_change":"2024-09-12T17:21:41.866466+0000","last_active":"2024-09-12T17:57:12.011523+0000","last_peered":"2024-09-12T17:57:12.011523+0000","last_clean":"2024-09-12T17:57:12.011523+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T17:57:12.011523+0000","last_undegraded":"2024-09-12T17:57:12.011523+0000","last_fullsized":"2024-09-12T17:57:12.011523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:41.352304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012430+0000","last_change":"2024-09-12T17:21:54.751823+0000","last_active":"2024-09-12T17:57:22.012430+0000","last_peered":"2024-09-12T17:57:22.012430+0000","last_clean":"2024-09-12T17:57:22.012430+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T17:57:22.012430+0000","last_undegraded":"2024-09-12T17:57:22.012430+0000","last_fullsized":"2024-09-12T17:57:22.012430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:45.553180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'154","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144606+0000","last_change":"2024-09-12T17:21:56.762425+0000","last_active":"2024-09-12T17:59:27.144606+0000","last_peered":"2024-09-12T17:59:27.144606+0000","last_clean":"2024-09-12T17:59:27.144606+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T17:59:27.144606+0000","last_undegraded":"2024-09-12T17:59:27.144606+0000","last_fullsized":"2024-09-12T17:59:27.144606+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:35.405866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'802","reported_seq":2565,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.130961+0000","last_change":"2024-09-12T17:21:58.782857+0000","last_active":"2024-09-12T18:00:56.130961+0000","last_peered":"2024-09-12T18:00:56.130961+0000","last_clean":"2024-09-12T18:00:56.130961+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:00:56.130961+0000","last_undegraded":"2024-09-12T18:00:56.130961+0000","last_fullsized":"2024-09-12T18:00:56.130961+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:02.049669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'109","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:20.158995+0000","last_change":"2024-09-12T17:22:00.794639+0000","last_active":"2024-09-12T18:00:20.158995+0000","last_peered":"2024-09-12T18:00:20.158995+0000","last_clean":"2024-09-12T18:00:20.158995+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:00:20.158995+0000","last_undegraded":"2024-09-12T18:00:20.158995+0000","last_fullsized":"2024-09-12T18:00:20.158995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:42.302531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'871","reported_seq":2582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.800538+0000","last_change":"2024-09-12T17:21:52.745987+0000","last_active":"2024-09-12T17:59:17.800538+0000","last_peered":"2024-09-12T17:59:17.800538+0000","last_clean":"2024-09-12T17:59:17.800538+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T17:59:17.800538+0000","last_undegraded":"2024-09-12T17:59:17.800538+0000","last_fullsized":"2024-09-12T17:59:17.800538+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:35.780719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'301","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.845137+0000","last_change":"2024-09-12T17:21:50.756194+0000","last_active":"2024-09-12T17:59:18.845137+0000","last_peered":"2024-09-12T17:59:18.845137+0000","last_clean":"2024-09-12T17:59:18.845137+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T17:59:18.845137+0000","last_undegraded":"2024-09-12T17:59:18.845137+0000","last_fullsized":"2024-09-12T17:59:18.845137+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:46.420332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6674336,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":464,"num_read_kb":10322,"num_write":1115,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.023460+0000","last_change":"2024-09-12T17:21:41.865878+0000","last_active":"2024-09-12T17:58:32.023460+0000","last_peered":"2024-09-12T17:58:32.023460+0000","last_clean":"2024-09-12T17:58:32.023460+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T17:58:32.023460+0000","last_undegraded":"2024-09-12T17:58:32.023460+0000","last_fullsized":"2024-09-12T17:58:32.023460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.625705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012930+0000","last_change":"2024-09-12T17:21:54.758563+0000","last_active":"2024-09-12T17:57:22.012930+0000","last_peered":"2024-09-12T17:57:22.012930+0000","last_clean":"2024-09-12T17:57:22.012930+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T17:57:22.012930+0000","last_undegraded":"2024-09-12T17:57:22.012930+0000","last_fullsized":"2024-09-12T17:57:22.012930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:07.608583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'96","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.275920+0000","last_change":"2024-09-12T17:21:56.765131+0000","last_active":"2024-09-12T17:59:06.275920+0000","last_peered":"2024-09-12T17:59:06.275920+0000","last_clean":"2024-09-12T17:59:06.275920+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T17:59:06.275920+0000","last_undegraded":"2024-09-12T17:59:06.275920+0000","last_fullsized":"2024-09-12T17:59:06.275920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:57.138933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'808","reported_seq":2355,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.904669+0000","last_change":"2024-09-12T17:21:58.785486+0000","last_active":"2024-09-12T18:01:02.904669+0000","last_peered":"2024-09-12T18:01:02.904669+0000","last_clean":"2024-09-12T18:01:02.904669+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:02.904669+0000","last_undegraded":"2024-09-12T18:01:02.904669+0000","last_fullsized":"2024-09-12T18:01:02.904669+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:06.317754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'325","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.374584+0000","last_change":"2024-09-12T17:22:00.794801+0000","last_active":"2024-09-12T17:59:34.374584+0000","last_peered":"2024-09-12T17:59:34.374584+0000","last_clean":"2024-09-12T17:59:34.374584+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T17:59:34.374584+0000","last_undegraded":"2024-09-12T17:59:34.374584+0000","last_fullsized":"2024-09-12T17:59:34.374584+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:20.169521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'491","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501739+0000","last_change":"2024-09-12T17:21:52.740621+0000","last_active":"2024-09-12T17:59:18.501739+0000","last_peered":"2024-09-12T17:59:18.501739+0000","last_clean":"2024-09-12T17:59:18.501739+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T17:59:18.501739+0000","last_undegraded":"2024-09-12T17:59:18.501739+0000","last_fullsized":"2024-09-12T17:59:18.501739+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:50.850961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'266","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.861386+0000","last_change":"2024-09-12T17:21:50.759984+0000","last_active":"2024-09-12T17:59:31.861386+0000","last_peered":"2024-09-12T17:59:31.861386+0000","last_clean":"2024-09-12T17:59:31.861386+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T17:59:31.861386+0000","last_undegraded":"2024-09-12T17:59:31.861386+0000","last_fullsized":"2024-09-12T17:59:31.861386+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.213987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4518961,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":476,"num_read_kb":59240,"num_write":949,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.022640+0000","last_change":"2024-09-12T17:21:41.866850+0000","last_active":"2024-09-12T17:58:32.022640+0000","last_peered":"2024-09-12T17:58:32.022640+0000","last_clean":"2024-09-12T17:58:32.022640+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T17:58:32.022640+0000","last_undegraded":"2024-09-12T17:58:32.022640+0000","last_fullsized":"2024-09-12T17:58:32.022640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.746085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.019639+0000","last_change":"2024-09-12T17:21:54.752228+0000","last_active":"2024-09-12T17:58:07.019639+0000","last_peered":"2024-09-12T17:58:07.019639+0000","last_clean":"2024-09-12T17:58:07.019639+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T17:58:07.019639+0000","last_undegraded":"2024-09-12T17:58:07.019639+0000","last_fullsized":"2024-09-12T17:58:07.019639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.871367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'731","reported_seq":1425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.090847+0000","last_change":"2024-09-12T17:21:56.767995+0000","last_active":"2024-09-12T18:00:56.090847+0000","last_peered":"2024-09-12T18:00:56.090847+0000","last_clean":"2024-09-12T18:00:56.090847+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:00:56.090847+0000","last_undegraded":"2024-09-12T18:00:56.090847+0000","last_fullsized":"2024-09-12T18:00:56.090847+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:13.584754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178459,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1281,"num_read_kb":2755,"num_write":1070,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013828+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:57:27.013828+0000","last_peered":"2024-09-12T17:57:27.013828+0000","last_clean":"2024-09-12T17:57:27.013828+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T17:57:27.013828+0000","last_undegraded":"2024-09-12T17:57:27.013828+0000","last_fullsized":"2024-09-12T17:57:27.013828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:01.402224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'132","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.226950+0000","last_change":"2024-09-12T17:22:00.789098+0000","last_active":"2024-09-12T17:59:03.226950+0000","last_peered":"2024-09-12T17:59:03.226950+0000","last_clean":"2024-09-12T17:59:03.226950+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T17:59:03.226950+0000","last_undegraded":"2024-09-12T17:59:03.226950+0000","last_fullsized":"2024-09-12T17:59:03.226950+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.614418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'152","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.424191+0000","last_change":"2024-09-12T17:22:00.786992+0000","last_active":"2024-09-12T17:59:34.424191+0000","last_peered":"2024-09-12T17:59:34.424191+0000","last_clean":"2024-09-12T17:59:34.424191+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T17:59:34.424191+0000","last_undegraded":"2024-09-12T17:59:34.424191+0000","last_fullsized":"2024-09-12T17:59:34.424191+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:08.329121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'468","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.769697+0000","last_change":"2024-09-12T17:21:52.742192+0000","last_active":"2024-09-12T17:59:18.769697+0000","last_peered":"2024-09-12T17:59:18.769697+0000","last_clean":"2024-09-12T17:59:18.769697+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T17:59:18.769697+0000","last_undegraded":"2024-09-12T17:59:18.769697+0000","last_fullsized":"2024-09-12T17:59:18.769697+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:43.783519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'260","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.047773+0000","last_change":"2024-09-12T17:21:50.771110+0000","last_active":"2024-09-12T17:59:19.047773+0000","last_peered":"2024-09-12T17:59:19.047773+0000","last_clean":"2024-09-12T17:59:19.047773+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T17:59:19.047773+0000","last_undegraded":"2024-09-12T17:59:19.047773+0000","last_fullsized":"2024-09-12T17:59:19.047773+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:22.753809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6582477,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":416,"num_read_kb":5950,"num_write":970,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124604+0000","last_change":"2024-09-12T17:21:54.759266+0000","last_active":"2024-09-12T17:56:57.124604+0000","last_peered":"2024-09-12T17:56:57.124604+0000","last_clean":"2024-09-12T17:56:57.124604+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T17:56:57.124604+0000","last_undegraded":"2024-09-12T17:56:57.124604+0000","last_fullsized":"2024-09-12T17:56:57.124604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:37.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'290","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.143175+0000","last_change":"2024-09-12T17:21:56.766802+0000","last_active":"2024-09-12T17:59:17.143175+0000","last_peered":"2024-09-12T17:59:17.143175+0000","last_clean":"2024-09-12T17:59:17.143175+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T17:59:17.143175+0000","last_undegraded":"2024-09-12T17:59:17.143175+0000","last_fullsized":"2024-09-12T17:59:17.143175+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.524361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1042,"num_write":404,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129355+0000","last_change":"2024-09-12T17:21:58.781271+0000","last_active":"2024-09-12T17:57:00.129355+0000","last_peered":"2024-09-12T17:57:00.129355+0000","last_clean":"2024-09-12T17:57:00.129355+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T17:57:00.129355+0000","last_undegraded":"2024-09-12T17:57:00.129355+0000","last_fullsized":"2024-09-12T17:57:00.129355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:44.876899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.826880+0000","last_change":"2024-09-12T17:22:00.795423+0000","last_active":"2024-09-12T17:59:34.826880+0000","last_peered":"2024-09-12T17:59:34.826880+0000","last_clean":"2024-09-12T17:59:34.826880+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T17:59:34.826880+0000","last_undegraded":"2024-09-12T17:59:34.826880+0000","last_fullsized":"2024-09-12T17:59:34.826880+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:51.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'639","reported_seq":2255,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.002741+0000","last_change":"2024-09-12T17:21:52.744060+0000","last_active":"2024-09-12T17:59:16.002741+0000","last_peered":"2024-09-12T17:59:16.002741+0000","last_clean":"2024-09-12T17:59:16.002741+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T17:59:16.002741+0000","last_undegraded":"2024-09-12T17:59:16.002741+0000","last_fullsized":"2024-09-12T17:59:16.002741+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:49.782641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'246","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.122964+0000","last_change":"2024-09-12T17:22:26.296706+0000","last_active":"2024-09-12T18:01:03.122964+0000","last_peered":"2024-09-12T18:01:03.122964+0000","last_clean":"2024-09-12T18:01:03.122964+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:03.122964+0000","last_undegraded":"2024-09-12T18:01:03.122964+0000","last_fullsized":"2024-09-12T18:01:03.122964+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:49.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7374334,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":367,"num_read_kb":12892,"num_write":912,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009094+0000","last_change":"2024-09-12T17:21:54.755356+0000","last_active":"2024-09-12T17:56:57.009094+0000","last_peered":"2024-09-12T17:56:57.009094+0000","last_clean":"2024-09-12T17:56:57.009094+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T17:56:57.009094+0000","last_undegraded":"2024-09-12T17:56:57.009094+0000","last_fullsized":"2024-09-12T17:56:57.009094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:02.209702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":547,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.778422+0000","last_change":"2024-09-12T17:21:56.761388+0000","last_active":"2024-09-12T17:58:38.778422+0000","last_peered":"2024-09-12T17:58:38.778422+0000","last_clean":"2024-09-12T17:58:38.778422+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T17:58:38.778422+0000","last_undegraded":"2024-09-12T17:58:38.778422+0000","last_fullsized":"2024-09-12T17:58:38.778422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:20.116062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160637+0000","last_change":"2024-09-12T17:21:58.779273+0000","last_active":"2024-09-12T17:57:02.160637+0000","last_peered":"2024-09-12T17:57:02.160637+0000","last_clean":"2024-09-12T17:57:02.160637+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T17:57:02.160637+0000","last_undegraded":"2024-09-12T17:57:02.160637+0000","last_fullsized":"2024-09-12T17:57:02.160637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:23.417297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'227","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.355106+0000","last_change":"2024-09-12T17:22:00.795725+0000","last_active":"2024-09-12T17:59:34.355106+0000","last_peered":"2024-09-12T17:59:34.355106+0000","last_clean":"2024-09-12T17:59:34.355106+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T17:59:34.355106+0000","last_undegraded":"2024-09-12T17:59:34.355106+0000","last_fullsized":"2024-09-12T17:59:34.355106+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:25.111700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'387","reported_seq":1863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760420+0000","last_change":"2024-09-12T17:21:52.750349+0000","last_active":"2024-09-12T17:59:34.760420+0000","last_peered":"2024-09-12T17:59:34.760420+0000","last_clean":"2024-09-12T17:59:34.760420+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T17:59:34.760420+0000","last_undegraded":"2024-09-12T17:59:34.760420+0000","last_fullsized":"2024-09-12T17:59:34.760420+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:27.902470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'274","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:39.444565+0000","last_change":"2024-09-12T17:21:50.769491+0000","last_active":"2024-09-12T17:58:39.444565+0000","last_peered":"2024-09-12T17:58:39.444565+0000","last_clean":"2024-09-12T17:58:39.444565+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T17:58:39.444565+0000","last_undegraded":"2024-09-12T17:58:39.444565+0000","last_fullsized":"2024-09-12T17:58:39.444565+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:13.935748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4503077,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":372,"num_read_kb":8586,"num_write":1045,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159979+0000","last_change":"2024-09-12T17:21:54.753914+0000","last_active":"2024-09-12T17:56:57.159979+0000","last_peered":"2024-09-12T17:56:57.159979+0000","last_clean":"2024-09-12T17:56:57.159979+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T17:56:57.159979+0000","last_undegraded":"2024-09-12T17:56:57.159979+0000","last_fullsized":"2024-09-12T17:56:57.159979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.689343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'313","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.367050+0000","last_change":"2024-09-12T17:21:56.766069+0000","last_active":"2024-09-12T17:59:34.367050+0000","last_peered":"2024-09-12T17:59:34.367050+0000","last_clean":"2024-09-12T17:59:34.367050+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T17:59:34.367050+0000","last_undegraded":"2024-09-12T17:59:34.367050+0000","last_fullsized":"2024-09-12T17:59:34.367050+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:38.666434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":1089,"num_write":432,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.120621+0000","last_change":"2024-09-12T17:21:58.781433+0000","last_active":"2024-09-12T17:57:02.120621+0000","last_peered":"2024-09-12T17:57:02.120621+0000","last_clean":"2024-09-12T17:57:02.120621+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T17:57:02.120621+0000","last_undegraded":"2024-09-12T17:57:02.120621+0000","last_fullsized":"2024-09-12T17:57:02.120621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:29.832595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'133","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.970181+0000","last_change":"2024-09-12T17:22:00.797551+0000","last_active":"2024-09-12T17:59:02.970181+0000","last_peered":"2024-09-12T17:59:02.970181+0000","last_clean":"2024-09-12T17:59:02.970181+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T17:59:02.970181+0000","last_undegraded":"2024-09-12T17:59:02.970181+0000","last_fullsized":"2024-09-12T17:59:02.970181+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:41.162485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'740","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.538431+0000","last_change":"2024-09-12T17:21:52.749905+0000","last_active":"2024-09-12T17:59:12.538431+0000","last_peered":"2024-09-12T17:59:12.538431+0000","last_clean":"2024-09-12T17:59:12.538431+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T17:59:12.538431+0000","last_undegraded":"2024-09-12T17:59:12.538431+0000","last_fullsized":"2024-09-12T17:59:12.538431+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:52.822961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'276","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.048928+0000","last_change":"2024-09-12T17:21:50.755503+0000","last_active":"2024-09-12T18:01:03.048928+0000","last_peered":"2024-09-12T18:01:03.048928+0000","last_clean":"2024-09-12T18:01:03.048928+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:03.048928+0000","last_undegraded":"2024-09-12T18:01:03.048928+0000","last_fullsized":"2024-09-12T18:01:03.048928+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:37.883856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406045,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":467,"num_read_kb":5945,"num_write":1155,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009139+0000","last_change":"2024-09-12T17:21:54.758453+0000","last_active":"2024-09-12T17:56:57.009139+0000","last_peered":"2024-09-12T17:56:57.009139+0000","last_clean":"2024-09-12T17:56:57.009139+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T17:56:57.009139+0000","last_undegraded":"2024-09-12T17:56:57.009139+0000","last_fullsized":"2024-09-12T17:56:57.009139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.810118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'249","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.027723+0000","last_change":"2024-09-12T17:21:56.769935+0000","last_active":"2024-09-12T17:59:17.027723+0000","last_peered":"2024-09-12T17:59:17.027723+0000","last_clean":"2024-09-12T17:59:17.027723+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T17:59:17.027723+0000","last_undegraded":"2024-09-12T17:59:17.027723+0000","last_fullsized":"2024-09-12T17:59:17.027723+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:39.633555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60129,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":944,"num_write":362,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129426+0000","last_change":"2024-09-12T17:21:58.785066+0000","last_active":"2024-09-12T17:57:00.129426+0000","last_peered":"2024-09-12T17:57:00.129426+0000","last_clean":"2024-09-12T17:57:00.129426+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T17:57:00.129426+0000","last_undegraded":"2024-09-12T17:57:00.129426+0000","last_fullsized":"2024-09-12T17:57:00.129426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:41.442928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'404","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618747+0000","last_change":"2024-09-12T17:21:52.755203+0000","last_active":"2024-09-12T17:59:16.618747+0000","last_peered":"2024-09-12T17:59:16.618747+0000","last_clean":"2024-09-12T17:59:16.618747+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T17:59:16.618747+0000","last_undegraded":"2024-09-12T17:59:16.618747+0000","last_fullsized":"2024-09-12T17:59:16.618747+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:20.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'254","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.985943+0000","last_change":"2024-09-12T17:21:50.762696+0000","last_active":"2024-09-12T18:01:02.985943+0000","last_peered":"2024-09-12T18:01:02.985943+0000","last_clean":"2024-09-12T18:01:02.985943+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:02.985943+0000","last_undegraded":"2024-09-12T18:01:02.985943+0000","last_fullsized":"2024-09-12T18:01:02.985943+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:29.711995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10435358,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":392,"num_read_kb":25374,"num_write":917,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133894+0000","last_change":"2024-09-12T17:21:54.759183+0000","last_active":"2024-09-12T17:58:02.133894+0000","last_peered":"2024-09-12T17:58:02.133894+0000","last_clean":"2024-09-12T17:58:02.133894+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T17:58:02.133894+0000","last_undegraded":"2024-09-12T17:58:02.133894+0000","last_fullsized":"2024-09-12T17:58:02.133894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:44.448393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'476","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.087281+0000","last_change":"2024-09-12T17:21:56.768691+0000","last_active":"2024-09-12T18:00:56.087281+0000","last_peered":"2024-09-12T18:00:56.087281+0000","last_clean":"2024-09-12T18:00:56.087281+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:00:56.087281+0000","last_undegraded":"2024-09-12T18:00:56.087281+0000","last_fullsized":"2024-09-12T18:00:56.087281+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.730690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116754,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1861,"num_write":748,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160707+0000","last_change":"2024-09-12T17:21:58.784784+0000","last_active":"2024-09-12T17:57:02.160707+0000","last_peered":"2024-09-12T17:57:02.160707+0000","last_clean":"2024-09-12T17:57:02.160707+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T17:57:02.160707+0000","last_undegraded":"2024-09-12T17:57:02.160707+0000","last_fullsized":"2024-09-12T17:57:02.160707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:09.975350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'164","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.836312+0000","last_change":"2024-09-12T17:22:00.798771+0000","last_active":"2024-09-12T17:59:28.836312+0000","last_peered":"2024-09-12T17:59:28.836312+0000","last_clean":"2024-09-12T17:59:28.836312+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T17:59:28.836312+0000","last_undegraded":"2024-09-12T17:59:28.836312+0000","last_fullsized":"2024-09-12T17:59:28.836312+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:10.472501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'420","reported_seq":1885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952594+0000","last_change":"2024-09-12T17:21:52.746392+0000","last_active":"2024-09-12T17:59:16.952594+0000","last_peered":"2024-09-12T17:59:16.952594+0000","last_clean":"2024-09-12T17:59:16.952594+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T17:59:16.952594+0000","last_undegraded":"2024-09-12T17:59:16.952594+0000","last_fullsized":"2024-09-12T17:59:16.952594+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:08.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'275","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.985038+0000","last_change":"2024-09-12T17:21:50.759865+0000","last_active":"2024-09-12T17:59:09.985038+0000","last_peered":"2024-09-12T17:59:09.985038+0000","last_clean":"2024-09-12T17:59:09.985038+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T17:59:09.985038+0000","last_undegraded":"2024-09-12T17:59:09.985038+0000","last_fullsized":"2024-09-12T17:59:09.985038+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:18.154345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7238788,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":454,"num_read_kb":48900,"num_write":991,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.163561+0000","last_change":"2024-09-12T17:21:54.757887+0000","last_active":"2024-09-12T17:57:22.163561+0000","last_peered":"2024-09-12T17:57:22.163561+0000","last_clean":"2024-09-12T17:57:22.163561+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T17:57:22.163561+0000","last_undegraded":"2024-09-12T17:57:22.163561+0000","last_fullsized":"2024-09-12T17:57:22.163561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:57.740295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'290","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.029763+0000","last_change":"2024-09-12T17:21:56.759500+0000","last_active":"2024-09-12T17:59:27.029763+0000","last_peered":"2024-09-12T17:59:27.029763+0000","last_clean":"2024-09-12T17:59:27.029763+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T17:59:27.029763+0000","last_undegraded":"2024-09-12T17:59:27.029763+0000","last_fullsized":"2024-09-12T17:59:27.029763+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:26.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55713,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":962,"num_write":408,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.122006+0000","last_change":"2024-09-12T17:21:58.795399+0000","last_active":"2024-09-12T17:56:58.122006+0000","last_peered":"2024-09-12T17:56:58.122006+0000","last_clean":"2024-09-12T17:56:58.122006+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T17:56:58.122006+0000","last_undegraded":"2024-09-12T17:56:58.122006+0000","last_fullsized":"2024-09-12T17:56:58.122006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:48.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'190","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.181615+0000","last_change":"2024-09-12T17:22:00.794027+0000","last_active":"2024-09-12T17:59:33.181615+0000","last_peered":"2024-09-12T17:59:33.181615+0000","last_clean":"2024-09-12T17:59:33.181615+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T17:59:33.181615+0000","last_undegraded":"2024-09-12T17:59:33.181615+0000","last_fullsized":"2024-09-12T17:59:33.181615+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:17.004717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'853","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.133185+0000","last_change":"2024-09-12T17:21:52.755426+0000","last_active":"2024-09-12T17:59:15.133185+0000","last_peered":"2024-09-12T17:59:15.133185+0000","last_clean":"2024-09-12T17:59:15.133185+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T17:59:15.133185+0000","last_undegraded":"2024-09-12T17:59:15.133185+0000","last_fullsized":"2024-09-12T17:59:15.133185+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:04.598499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'270","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.669418+0000","last_change":"2024-09-12T17:21:50.755856+0000","last_active":"2024-09-12T17:59:15.669418+0000","last_peered":"2024-09-12T17:59:15.669418+0000","last_clean":"2024-09-12T17:59:15.669418+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T17:59:15.669418+0000","last_undegraded":"2024-09-12T17:59:15.669418+0000","last_fullsized":"2024-09-12T17:59:15.669418+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:22.206678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8742585,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":429,"num_read_kb":72608,"num_write":1034,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160042+0000","last_change":"2024-09-12T17:21:54.750383+0000","last_active":"2024-09-12T17:56:57.160042+0000","last_peered":"2024-09-12T17:56:57.160042+0000","last_clean":"2024-09-12T17:56:57.160042+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T17:56:57.160042+0000","last_undegraded":"2024-09-12T17:56:57.160042+0000","last_fullsized":"2024-09-12T17:56:57.160042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'233","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144735+0000","last_change":"2024-09-12T17:21:56.768390+0000","last_active":"2024-09-12T17:59:27.144735+0000","last_peered":"2024-09-12T17:59:27.144735+0000","last_clean":"2024-09-12T17:59:27.144735+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T17:59:27.144735+0000","last_undegraded":"2024-09-12T17:59:27.144735+0000","last_fullsized":"2024-09-12T17:59:27.144735+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:20.766139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56008,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":384,"num_read_kb":808,"num_write":308,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138962+0000","last_change":"2024-09-12T17:21:58.784005+0000","last_active":"2024-09-12T17:58:05.138962+0000","last_peered":"2024-09-12T17:58:05.138962+0000","last_clean":"2024-09-12T17:58:05.138962+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T17:58:05.138962+0000","last_undegraded":"2024-09-12T17:58:05.138962+0000","last_fullsized":"2024-09-12T17:58:05.138962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:02.608599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'111","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.117938+0000","last_change":"2024-09-12T17:22:00.796332+0000","last_active":"2024-09-12T18:00:56.117938+0000","last_peered":"2024-09-12T18:00:56.117938+0000","last_clean":"2024-09-12T18:00:56.117938+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:00:56.117938+0000","last_undegraded":"2024-09-12T18:00:56.117938+0000","last_fullsized":"2024-09-12T18:00:56.117938+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'488","reported_seq":2088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999609+0000","last_change":"2024-09-12T17:21:52.747235+0000","last_active":"2024-09-12T18:00:54.999609+0000","last_peered":"2024-09-12T18:00:54.999609+0000","last_clean":"2024-09-12T18:00:54.999609+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:00:54.999609+0000","last_undegraded":"2024-09-12T18:00:54.999609+0000","last_fullsized":"2024-09-12T18:00:54.999609+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:11.805325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'249","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.110615+0000","last_change":"2024-09-12T17:21:50.761070+0000","last_active":"2024-09-12T17:59:12.110615+0000","last_peered":"2024-09-12T17:59:12.110615+0000","last_clean":"2024-09-12T17:59:12.110615+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T17:59:12.110615+0000","last_undegraded":"2024-09-12T17:59:12.110615+0000","last_fullsized":"2024-09-12T17:59:12.110615+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:43.740244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4363624,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":359,"num_read_kb":22007,"num_write":882,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009133+0000","last_change":"2024-09-12T17:21:54.755644+0000","last_active":"2024-09-12T17:56:57.009133+0000","last_peered":"2024-09-12T17:56:57.009133+0000","last_clean":"2024-09-12T17:56:57.009133+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T17:56:57.009133+0000","last_undegraded":"2024-09-12T17:56:57.009133+0000","last_fullsized":"2024-09-12T17:56:57.009133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'79","reported_seq":592,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:16.585394+0000","last_change":"2024-09-12T17:21:56.761019+0000","last_active":"2024-09-12T17:58:16.585394+0000","last_peered":"2024-09-12T17:58:16.585394+0000","last_clean":"2024-09-12T17:58:16.585394+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T17:58:16.585394+0000","last_undegraded":"2024-09-12T17:58:16.585394+0000","last_fullsized":"2024-09-12T17:58:16.585394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.371470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'753","reported_seq":2430,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.129874+0000","last_change":"2024-09-12T17:21:58.783309+0000","last_active":"2024-09-12T18:00:56.129874+0000","last_peered":"2024-09-12T18:00:56.129874+0000","last_clean":"2024-09-12T18:00:56.129874+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:00:56.129874+0000","last_undegraded":"2024-09-12T18:00:56.129874+0000","last_fullsized":"2024-09-12T18:00:56.129874+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:14.021972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'111","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.028820+0000","last_change":"2024-09-12T17:22:00.792450+0000","last_active":"2024-09-12T17:59:22.028820+0000","last_peered":"2024-09-12T17:59:22.028820+0000","last_clean":"2024-09-12T17:59:22.028820+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T17:59:22.028820+0000","last_undegraded":"2024-09-12T17:59:22.028820+0000","last_fullsized":"2024-09-12T17:59:22.028820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.275271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'468","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.759665+0000","last_change":"2024-09-12T17:21:52.751365+0000","last_active":"2024-09-12T17:59:34.759665+0000","last_peered":"2024-09-12T17:59:34.759665+0000","last_clean":"2024-09-12T17:59:34.759665+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T17:59:34.759665+0000","last_undegraded":"2024-09-12T17:59:34.759665+0000","last_fullsized":"2024-09-12T17:59:34.759665+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:36.771613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'277","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.240174+0000","last_change":"2024-09-12T17:21:50.768703+0000","last_active":"2024-09-12T17:58:51.240174+0000","last_peered":"2024-09-12T17:58:51.240174+0000","last_clean":"2024-09-12T17:58:51.240174+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T17:58:51.240174+0000","last_undegraded":"2024-09-12T17:58:51.240174+0000","last_fullsized":"2024-09-12T17:58:51.240174+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:26.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16653203,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":406,"num_read_kb":20561,"num_write":1007,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.120023+0000","last_change":"2024-09-12T17:21:54.752741+0000","last_active":"2024-09-12T17:56:57.120023+0000","last_peered":"2024-09-12T17:56:57.120023+0000","last_clean":"2024-09-12T17:56:57.120023+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T17:56:57.120023+0000","last_undegraded":"2024-09-12T17:56:57.120023+0000","last_fullsized":"2024-09-12T17:56:57.120023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:50.651848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:47.038518+0000","last_change":"2024-09-12T17:21:56.771872+0000","last_active":"2024-09-12T18:00:47.038518+0000","last_peered":"2024-09-12T18:00:47.038518+0000","last_clean":"2024-09-12T18:00:47.038518+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:00:47.038518+0000","last_undegraded":"2024-09-12T18:00:47.038518+0000","last_fullsized":"2024-09-12T18:00:47.038518+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:31.183940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60828,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":462,"num_read_kb":940,"num_write":384,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021920+0000","last_change":"2024-09-12T17:21:58.789902+0000","last_active":"2024-09-12T17:58:17.021920+0000","last_peered":"2024-09-12T17:58:17.021920+0000","last_clean":"2024-09-12T17:58:17.021920+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T17:58:17.021920+0000","last_undegraded":"2024-09-12T17:58:17.021920+0000","last_fullsized":"2024-09-12T17:58:17.021920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.777449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'139","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.021593+0000","last_change":"2024-09-12T17:22:00.794282+0000","last_active":"2024-09-12T17:59:34.021593+0000","last_peered":"2024-09-12T17:59:34.021593+0000","last_clean":"2024-09-12T17:59:34.021593+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T17:59:34.021593+0000","last_undegraded":"2024-09-12T17:59:34.021593+0000","last_fullsized":"2024-09-12T17:59:34.021593+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:58.732912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'468","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002055+0000","last_change":"2024-09-12T17:21:52.746743+0000","last_active":"2024-09-12T18:00:55.002055+0000","last_peered":"2024-09-12T18:00:55.002055+0000","last_clean":"2024-09-12T18:00:55.002055+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:00:55.002055+0000","last_undegraded":"2024-09-12T18:00:55.002055+0000","last_fullsized":"2024-09-12T18:00:55.002055+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.604964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'275","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.416272+0000","last_change":"2024-09-12T17:21:50.771314+0000","last_active":"2024-09-12T18:00:54.416272+0000","last_peered":"2024-09-12T18:00:54.416272+0000","last_clean":"2024-09-12T18:00:54.416272+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:00:54.416272+0000","last_undegraded":"2024-09-12T18:00:54.416272+0000","last_fullsized":"2024-09-12T18:00:54.416272+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:28.163181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13097890,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":430,"num_read_kb":60843,"num_write":1041,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160026+0000","last_change":"2024-09-12T17:21:54.754687+0000","last_active":"2024-09-12T17:56:57.160026+0000","last_peered":"2024-09-12T17:56:57.160026+0000","last_clean":"2024-09-12T17:56:57.160026+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T17:56:57.160026+0000","last_undegraded":"2024-09-12T17:56:57.160026+0000","last_fullsized":"2024-09-12T17:56:57.160026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.236794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'248","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.039810+0000","last_change":"2024-09-12T17:21:56.764040+0000","last_active":"2024-09-12T18:00:37.039810+0000","last_peered":"2024-09-12T18:00:37.039810+0000","last_clean":"2024-09-12T18:00:37.039810+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:00:37.039810+0000","last_undegraded":"2024-09-12T18:00:37.039810+0000","last_fullsized":"2024-09-12T18:00:37.039810+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:13.554679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56791,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":411,"num_read_kb":885,"num_write":340,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021541+0000","last_change":"2024-09-12T17:21:58.783726+0000","last_active":"2024-09-12T17:58:22.021541+0000","last_peered":"2024-09-12T17:58:22.021541+0000","last_clean":"2024-09-12T17:58:22.021541+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T17:58:22.021541+0000","last_undegraded":"2024-09-12T17:58:22.021541+0000","last_fullsized":"2024-09-12T17:58:22.021541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'103","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.765064+0000","last_change":"2024-09-12T17:22:00.798683+0000","last_active":"2024-09-12T17:59:34.765064+0000","last_peered":"2024-09-12T17:59:34.765064+0000","last_clean":"2024-09-12T17:59:34.765064+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T17:59:34.765064+0000","last_undegraded":"2024-09-12T17:59:34.765064+0000","last_fullsized":"2024-09-12T17:59:34.765064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:52.343353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840653+0000","last_change":"2024-09-12T17:21:52.750254+0000","last_active":"2024-09-12T17:59:28.840653+0000","last_peered":"2024-09-12T17:59:28.840653+0000","last_clean":"2024-09-12T17:59:28.840653+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T17:59:28.840653+0000","last_undegraded":"2024-09-12T17:59:28.840653+0000","last_fullsized":"2024-09-12T17:59:28.840653+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:42.642542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'333","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.145849+0000","last_change":"2024-09-12T17:21:50.747069+0000","last_active":"2024-09-12T18:01:03.145849+0000","last_peered":"2024-09-12T18:01:03.145849+0000","last_clean":"2024-09-12T18:01:03.145849+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:03.145849+0000","last_undegraded":"2024-09-12T18:01:03.145849+0000","last_fullsized":"2024-09-12T18:01:03.145849+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:49.408880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18570645,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":598,"num_read_kb":67994,"num_write":1172,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.130730+0000","last_change":"2024-09-12T17:21:54.750762+0000","last_active":"2024-09-12T17:58:12.130730+0000","last_peered":"2024-09-12T17:58:12.130730+0000","last_clean":"2024-09-12T17:58:12.130730+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T17:58:12.130730+0000","last_undegraded":"2024-09-12T17:58:12.130730+0000","last_fullsized":"2024-09-12T17:58:12.130730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:35.152406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'226","reported_seq":773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144681+0000","last_change":"2024-09-12T17:21:56.763924+0000","last_active":"2024-09-12T17:59:27.144681+0000","last_peered":"2024-09-12T17:59:27.144681+0000","last_clean":"2024-09-12T17:59:27.144681+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T17:59:27.144681+0000","last_undegraded":"2024-09-12T17:59:27.144681+0000","last_fullsized":"2024-09-12T17:59:27.144681+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.766828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":857,"num_write":324,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.010097+0000","last_change":"2024-09-12T17:21:58.790322+0000","last_active":"2024-09-12T17:57:02.010097+0000","last_peered":"2024-09-12T17:57:02.010097+0000","last_clean":"2024-09-12T17:57:02.010097+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T17:57:02.010097+0000","last_undegraded":"2024-09-12T17:57:02.010097+0000","last_fullsized":"2024-09-12T17:57:02.010097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:02.075930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'218","reported_seq":1317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.414101+0000","last_change":"2024-09-12T17:22:00.798392+0000","last_active":"2024-09-12T17:59:33.414101+0000","last_peered":"2024-09-12T17:59:33.414101+0000","last_clean":"2024-09-12T17:59:33.414101+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T17:59:33.414101+0000","last_undegraded":"2024-09-12T17:59:33.414101+0000","last_fullsized":"2024-09-12T17:59:33.414101+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:00.108534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012393+0000","last_change":"2024-09-12T17:21:52.737742+0000","last_active":"2024-09-12T17:59:19.012393+0000","last_peered":"2024-09-12T17:59:19.012393+0000","last_clean":"2024-09-12T17:59:19.012393+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T17:59:19.012393+0000","last_undegraded":"2024-09-12T17:59:19.012393+0000","last_fullsized":"2024-09-12T17:59:19.012393+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:14.225738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'288","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.128386+0000","last_change":"2024-09-12T17:21:50.755052+0000","last_active":"2024-09-12T18:01:03.128386+0000","last_peered":"2024-09-12T18:01:03.128386+0000","last_clean":"2024-09-12T18:01:03.128386+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:03.128386+0000","last_undegraded":"2024-09-12T18:01:03.128386+0000","last_fullsized":"2024-09-12T18:01:03.128386+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:25.454728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8793260,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":474,"num_read_kb":16565,"num_write":1033,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.022475+0000","last_change":"2024-09-12T17:21:54.758914+0000","last_active":"2024-09-12T17:58:22.022475+0000","last_peered":"2024-09-12T17:58:22.022475+0000","last_clean":"2024-09-12T17:58:22.022475+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T17:58:22.022475+0000","last_undegraded":"2024-09-12T17:58:22.022475+0000","last_fullsized":"2024-09-12T17:58:22.022475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:37.175631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'288","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.029722+0000","last_change":"2024-09-12T17:21:56.770020+0000","last_active":"2024-09-12T17:59:27.029722+0000","last_peered":"2024-09-12T17:59:27.029722+0000","last_clean":"2024-09-12T17:59:27.029722+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T17:59:27.029722+0000","last_undegraded":"2024-09-12T17:59:27.029722+0000","last_fullsized":"2024-09-12T17:59:27.029722+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:51.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":984,"num_write":398,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009822+0000","last_change":"2024-09-12T17:21:58.782815+0000","last_active":"2024-09-12T17:57:02.009822+0000","last_peered":"2024-09-12T17:57:02.009822+0000","last_clean":"2024-09-12T17:57:02.009822+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T17:57:02.009822+0000","last_undegraded":"2024-09-12T17:57:02.009822+0000","last_fullsized":"2024-09-12T17:57:02.009822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:12.520411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'136","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998151+0000","last_change":"2024-09-12T17:22:00.796520+0000","last_active":"2024-09-12T18:00:54.998151+0000","last_peered":"2024-09-12T18:00:54.998151+0000","last_clean":"2024-09-12T18:00:54.998151+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:00:54.998151+0000","last_undegraded":"2024-09-12T18:00:54.998151+0000","last_fullsized":"2024-09-12T18:00:54.998151+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:43.432009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'777","reported_seq":2423,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774914+0000","last_change":"2024-09-12T17:21:52.742859+0000","last_active":"2024-09-12T17:59:18.774914+0000","last_peered":"2024-09-12T17:59:18.774914+0000","last_clean":"2024-09-12T17:59:18.774914+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T17:59:18.774914+0000","last_undegraded":"2024-09-12T17:59:18.774914+0000","last_fullsized":"2024-09-12T17:59:18.774914+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:32.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'301","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.640869+0000","last_change":"2024-09-12T17:21:50.764860+0000","last_active":"2024-09-12T17:59:31.640869+0000","last_peered":"2024-09-12T17:59:31.640869+0000","last_clean":"2024-09-12T17:59:31.640869+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T17:59:31.640869+0000","last_undegraded":"2024-09-12T17:59:31.640869+0000","last_fullsized":"2024-09-12T17:59:31.640869+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:29.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13727362,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":471,"num_read_kb":161127,"num_write":1069,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'469","reported_seq":1778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129978+0000","last_change":"2024-09-12T17:21:52.753034+0000","last_active":"2024-09-12T17:59:18.129978+0000","last_peered":"2024-09-12T17:59:18.129978+0000","last_clean":"2024-09-12T17:59:18.129978+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T17:59:18.129978+0000","last_undegraded":"2024-09-12T17:59:18.129978+0000","last_fullsized":"2024-09-12T17:59:18.129978+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.231475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'393","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.637964+0000","last_change":"2024-09-12T17:21:50.763558+0000","last_active":"2024-09-12T17:59:31.637964+0000","last_peered":"2024-09-12T17:59:31.637964+0000","last_clean":"2024-09-12T17:59:31.637964+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T17:59:31.637964+0000","last_undegraded":"2024-09-12T17:59:31.637964+0000","last_fullsized":"2024-09-12T17:59:31.637964+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:23.906686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7369359,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":754,"num_read_kb":23219,"num_write":1254,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'804","reported_seq":2433,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.260815+0000","last_change":"2024-09-12T17:21:52.750129+0000","last_active":"2024-09-12T17:59:12.260815+0000","last_peered":"2024-09-12T17:59:12.260815+0000","last_clean":"2024-09-12T17:59:12.260815+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T17:59:12.260815+0000","last_undegraded":"2024-09-12T17:59:12.260815+0000","last_fullsized":"2024-09-12T17:59:12.260815+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.542955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'305","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.136362+0000","last_change":"2024-09-12T17:21:50.764053+0000","last_active":"2024-09-12T17:58:51.136362+0000","last_peered":"2024-09-12T17:58:51.136362+0000","last_clean":"2024-09-12T17:58:51.136362+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T17:58:51.136362+0000","last_undegraded":"2024-09-12T17:58:51.136362+0000","last_fullsized":"2024-09-12T17:58:51.136362+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.510424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109542,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":553,"num_read_kb":33088,"num_write":1109,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'920","reported_seq":2559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390034+0000","last_change":"2024-09-12T17:21:52.751702+0000","last_active":"2024-09-12T17:59:16.390034+0000","last_peered":"2024-09-12T17:59:16.390034+0000","last_clean":"2024-09-12T17:59:16.390034+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T17:59:16.390034+0000","last_undegraded":"2024-09-12T17:59:16.390034+0000","last_fullsized":"2024-09-12T17:59:16.390034+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.873565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'342","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.096244+0000","last_change":"2024-09-12T17:21:50.769742+0000","last_active":"2024-09-12T18:01:03.096244+0000","last_peered":"2024-09-12T18:01:03.096244+0000","last_clean":"2024-09-12T18:01:03.096244+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:03.096244+0000","last_undegraded":"2024-09-12T18:01:03.096244+0000","last_fullsized":"2024-09-12T18:01:03.096244+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:23.762144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14992016,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":612,"num_read_kb":28924,"num_write":1282,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'501","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.635643+0000","last_change":"2024-09-12T17:21:52.750068+0000","last_active":"2024-09-12T17:59:15.635643+0000","last_peered":"2024-09-12T17:59:15.635643+0000","last_clean":"2024-09-12T17:59:15.635643+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T17:59:15.635643+0000","last_undegraded":"2024-09-12T17:59:15.635643+0000","last_fullsized":"2024-09-12T17:59:15.635643+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:42.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'285","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:42.138751+0000","last_change":"2024-09-12T17:21:50.777506+0000","last_active":"2024-09-12T17:58:42.138751+0000","last_peered":"2024-09-12T17:58:42.138751+0000","last_clean":"2024-09-12T17:58:42.138751+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T17:58:42.138751+0000","last_undegraded":"2024-09-12T17:58:42.138751+0000","last_fullsized":"2024-09-12T17:58:42.138751+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.155150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8779971,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":449,"num_read_kb":85437,"num_write":1001,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'462","reported_seq":1955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.357110+0000","last_change":"2024-09-12T17:21:52.747550+0000","last_active":"2024-09-12T17:59:34.357110+0000","last_peered":"2024-09-12T17:59:34.357110+0000","last_clean":"2024-09-12T17:59:34.357110+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T17:59:34.357110+0000","last_undegraded":"2024-09-12T17:59:34.357110+0000","last_fullsized":"2024-09-12T17:59:34.357110+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.595623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'250","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.061929+0000","last_change":"2024-09-12T17:21:50.777489+0000","last_active":"2024-09-12T17:59:19.061929+0000","last_peered":"2024-09-12T17:59:19.061929+0000","last_clean":"2024-09-12T17:59:19.061929+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T17:59:19.061929+0000","last_undegraded":"2024-09-12T17:59:19.061929+0000","last_fullsized":"2024-09-12T17:59:19.061929+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:18.905928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11318756,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":460,"num_read_kb":83513,"num_write":980,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'599","reported_seq":2270,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501171+0000","last_change":"2024-09-12T17:21:52.754098+0000","last_active":"2024-09-12T17:59:18.501171+0000","last_peered":"2024-09-12T17:59:18.501171+0000","last_clean":"2024-09-12T17:59:18.501171+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T17:59:18.501171+0000","last_undegraded":"2024-09-12T17:59:18.501171+0000","last_fullsized":"2024-09-12T17:59:18.501171+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:19.357268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'285","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.389755+0000","last_change":"2024-09-12T17:21:50.769098+0000","last_active":"2024-09-12T17:59:12.389755+0000","last_peered":"2024-09-12T17:59:12.389755+0000","last_clean":"2024-09-12T17:59:12.389755+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T17:59:12.389755+0000","last_undegraded":"2024-09-12T17:59:12.389755+0000","last_fullsized":"2024-09-12T17:59:12.389755+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:09.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18149226,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":519,"num_read_kb":100977,"num_write":1026,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'365","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001710+0000","last_change":"2024-09-12T17:21:52.752509+0000","last_active":"2024-09-12T18:00:55.001710+0000","last_peered":"2024-09-12T18:00:55.001710+0000","last_clean":"2024-09-12T18:00:55.001710+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:00:55.001710+0000","last_undegraded":"2024-09-12T18:00:55.001710+0000","last_fullsized":"2024-09-12T18:00:55.001710+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:29.192100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'298","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.138657+0000","last_change":"2024-09-12T17:21:50.771358+0000","last_active":"2024-09-12T18:01:03.138657+0000","last_peered":"2024-09-12T18:01:03.138657+0000","last_clean":"2024-09-12T18:01:03.138657+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:03.138657+0000","last_undegraded":"2024-09-12T18:01:03.138657+0000","last_fullsized":"2024-09-12T18:01:03.138657+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:36.115502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12863539,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":402,"num_read_kb":5744,"num_write":1115,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'855","reported_seq":2396,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001101+0000","last_change":"2024-09-12T17:21:52.755007+0000","last_active":"2024-09-12T18:00:55.001101+0000","last_peered":"2024-09-12T18:00:55.001101+0000","last_clean":"2024-09-12T18:00:55.001101+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:00:55.001101+0000","last_undegraded":"2024-09-12T18:00:55.001101+0000","last_fullsized":"2024-09-12T18:00:55.001101+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:26.620534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'322","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.909744+0000","last_change":"2024-09-12T17:21:50.766664+0000","last_active":"2024-09-12T17:59:09.909744+0000","last_peered":"2024-09-12T17:59:09.909744+0000","last_clean":"2024-09-12T17:59:09.909744+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T17:59:09.909744+0000","last_undegraded":"2024-09-12T17:59:09.909744+0000","last_fullsized":"2024-09-12T17:59:09.909744+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:36.008036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224892,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":554,"num_read_kb":751,"num_write":1207,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'635","reported_seq":2038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.382860+0000","last_change":"2024-09-12T17:21:52.752393+0000","last_active":"2024-09-12T17:59:16.382860+0000","last_peered":"2024-09-12T17:59:16.382860+0000","last_clean":"2024-09-12T17:59:16.382860+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T17:59:16.382860+0000","last_undegraded":"2024-09-12T17:59:16.382860+0000","last_fullsized":"2024-09-12T17:59:16.382860+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:35.883929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'308","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.133941+0000","last_change":"2024-09-12T17:21:50.769891+0000","last_active":"2024-09-12T18:01:03.133941+0000","last_peered":"2024-09-12T18:01:03.133941+0000","last_clean":"2024-09-12T18:01:03.133941+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:03.133941+0000","last_undegraded":"2024-09-12T18:01:03.133941+0000","last_fullsized":"2024-09-12T18:01:03.133941+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:44.325817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13624130,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":17253,"num_write":1086,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'557","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769742+0000","last_change":"2024-09-12T17:21:52.754609+0000","last_active":"2024-09-12T17:59:34.769742+0000","last_peered":"2024-09-12T17:59:34.769742+0000","last_clean":"2024-09-12T17:59:34.769742+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T17:59:34.769742+0000","last_undegraded":"2024-09-12T17:59:34.769742+0000","last_fullsized":"2024-09-12T17:59:34.769742+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.921162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'302","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:50.946309+0000","last_change":"2024-09-12T17:22:26.299370+0000","last_active":"2024-09-12T18:00:50.946309+0000","last_peered":"2024-09-12T18:00:50.946309+0000","last_clean":"2024-09-12T18:00:50.946309+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:00:50.946309+0000","last_undegraded":"2024-09-12T18:00:50.946309+0000","last_fullsized":"2024-09-12T18:00:50.946309+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.880431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7039374,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":500,"num_read_kb":8559,"num_write":1124,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'553","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999194+0000","last_change":"2024-09-12T17:21:52.749942+0000","last_active":"2024-09-12T18:00:54.999194+0000","last_peered":"2024-09-12T18:00:54.999194+0000","last_clean":"2024-09-12T18:00:54.999194+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:00:54.999194+0000","last_undegraded":"2024-09-12T18:00:54.999194+0000","last_fullsized":"2024-09-12T18:00:54.999194+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:15.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'262","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.429027+0000","last_change":"2024-09-12T17:21:50.758098+0000","last_active":"2024-09-12T17:58:38.429027+0000","last_peered":"2024-09-12T17:58:38.429027+0000","last_clean":"2024-09-12T17:58:38.429027+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T17:58:38.429027+0000","last_undegraded":"2024-09-12T17:58:38.429027+0000","last_fullsized":"2024-09-12T17:58:38.429027+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:44.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6990877,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":437,"num_read_kb":7270,"num_write":920,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'495","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012334+0000","last_change":"2024-09-12T17:21:52.755013+0000","last_active":"2024-09-12T17:59:19.012334+0000","last_peered":"2024-09-12T17:59:19.012334+0000","last_clean":"2024-09-12T17:59:19.012334+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T17:59:19.012334+0000","last_undegraded":"2024-09-12T17:59:19.012334+0000","last_fullsized":"2024-09-12T17:59:19.012334+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:03.543775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'304","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.843716+0000","last_change":"2024-09-12T17:21:50.785028+0000","last_active":"2024-09-12T17:59:18.843716+0000","last_peered":"2024-09-12T17:59:18.843716+0000","last_clean":"2024-09-12T17:59:18.843716+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T17:59:18.843716+0000","last_undegraded":"2024-09-12T17:59:18.843716+0000","last_fullsized":"2024-09-12T17:59:18.843716+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:11.230359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318700,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":520,"num_read_kb":1808,"num_write":1157,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'757","reported_seq":2524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365262+0000","last_change":"2024-09-12T17:21:52.751189+0000","last_active":"2024-09-12T17:59:34.365262+0000","last_peered":"2024-09-12T17:59:34.365262+0000","last_clean":"2024-09-12T17:59:34.365262+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T17:59:34.365262+0000","last_undegraded":"2024-09-12T17:59:34.365262+0000","last_fullsized":"2024-09-12T17:59:34.365262+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:44.765214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'272","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.035713+0000","last_change":"2024-09-12T17:21:50.764846+0000","last_active":"2024-09-12T18:00:12.035713+0000","last_peered":"2024-09-12T18:00:12.035713+0000","last_clean":"2024-09-12T18:00:12.035713+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:00:12.035713+0000","last_undegraded":"2024-09-12T18:00:12.035713+0000","last_fullsized":"2024-09-12T18:00:12.035713+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:23.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535045,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":368,"num_read_kb":11532,"num_write":996,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1313","reported_seq":3051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.197533+0000","last_change":"2024-09-12T17:21:52.750173+0000","last_active":"2024-09-12T17:59:17.197533+0000","last_peered":"2024-09-12T17:59:17.197533+0000","last_clean":"2024-09-12T17:59:17.197533+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T17:59:17.197533+0000","last_undegraded":"2024-09-12T17:59:17.197533+0000","last_fullsized":"2024-09-12T17:59:17.197533+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:57.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'358","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.083779+0000","last_change":"2024-09-12T17:21:50.770800+0000","last_active":"2024-09-12T17:59:08.083779+0000","last_peered":"2024-09-12T17:59:08.083779+0000","last_clean":"2024-09-12T17:59:08.083779+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T17:59:08.083779+0000","last_undegraded":"2024-09-12T17:59:08.083779+0000","last_fullsized":"2024-09-12T17:59:08.083779+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:32.517729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5580672,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":760,"num_read_kb":12646,"num_write":1262,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'850","reported_seq":2463,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521273+0000","last_change":"2024-09-12T17:21:52.755424+0000","last_active":"2024-09-12T17:59:17.521273+0000","last_peered":"2024-09-12T17:59:17.521273+0000","last_clean":"2024-09-12T17:59:17.521273+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T17:59:17.521273+0000","last_undegraded":"2024-09-12T17:59:17.521273+0000","last_fullsized":"2024-09-12T17:59:17.521273+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:30.408737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'335","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.097364+0000","last_change":"2024-09-12T17:21:50.770612+0000","last_active":"2024-09-12T17:59:16.097364+0000","last_peered":"2024-09-12T17:59:16.097364+0000","last_clean":"2024-09-12T17:59:16.097364+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T17:59:16.097364+0000","last_undegraded":"2024-09-12T17:59:16.097364+0000","last_fullsized":"2024-09-12T17:59:16.097364+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:10.767250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1283978,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":582,"num_read_kb":21305,"num_write":1223,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'291","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.725936+0000","last_change":"2024-09-12T17:21:50.765427+0000","last_active":"2024-09-12T17:59:12.725936+0000","last_peered":"2024-09-12T17:59:12.725936+0000","last_clean":"2024-09-12T17:59:12.725936+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T17:59:12.725936+0000","last_undegraded":"2024-09-12T17:59:12.725936+0000","last_fullsized":"2024-09-12T17:59:12.725936+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:49.438329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17015302,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":580,"num_read_kb":38619,"num_write":1081,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'583","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.770082+0000","last_change":"2024-09-12T17:21:52.755082+0000","last_active":"2024-09-12T17:59:34.770082+0000","last_peered":"2024-09-12T17:59:34.770082+0000","last_clean":"2024-09-12T17:59:34.770082+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T17:59:34.770082+0000","last_undegraded":"2024-09-12T17:59:34.770082+0000","last_fullsized":"2024-09-12T17:59:34.770082+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:39.922432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'316","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.134077+0000","last_change":"2024-09-12T17:21:50.771898+0000","last_active":"2024-09-12T18:01:03.134077+0000","last_peered":"2024-09-12T18:01:03.134077+0000","last_clean":"2024-09-12T18:01:03.134077+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:03.134077+0000","last_undegraded":"2024-09-12T18:01:03.134077+0000","last_fullsized":"2024-09-12T18:01:03.134077+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.573435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18011618,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":456,"num_read_kb":51643,"num_write":1084,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'402","reported_seq":1963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170642+0000","last_change":"2024-09-12T17:21:52.745958+0000","last_active":"2024-09-12T17:59:16.170642+0000","last_peered":"2024-09-12T17:59:16.170642+0000","last_clean":"2024-09-12T17:59:16.170642+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T17:59:16.170642+0000","last_undegraded":"2024-09-12T17:59:16.170642+0000","last_fullsized":"2024-09-12T17:59:16.170642+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:44.648792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1647,"ondisk_log_size":1647,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":733,"ondisk_log_size":733,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1934577,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16480,"num_read_kb":32225,"num_write":13956,"num_write_kb":11426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3211264,"data_stored":2710927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1993,"ondisk_log_size":1993,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2869,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3984,"ondisk_log_size":3984,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":530444956,"num_objects":4383,"num_object_clones":0,"num_object_copies":17532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4383,"num_whiteouts":0,"num_read":32074,"num_read_kb":1816144,"num_write":68518,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":773279744,"data_stored":773279744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3931,"ondisk_log_size":3931,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59979586,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":134,"num_read_kb":163167,"num_write":157,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122068992,"data_stored":122056324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64173890,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":132,"num_read_kb":167173,"num_write":156,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128360448,"data_stored":128347780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477215,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396852,"kb_used_data":126884,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93974988,"statfs":{"total":96636764160,"available":96230387712,"internally_reserved":0,"allocated":129929216,"data_stored":127890114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509920,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250700,"kb_used_data":147324,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94121140,"statfs":{"total":96636764160,"available":96380047360,"internally_reserved":0,"allocated":150859776,"data_stored":148807094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105839046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509918,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359572,"kb_used_data":125764,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94012268,"statfs":{"total":96636764160,"available":96268562432,"internally_reserved":0,"allocated":128782336,"data_stored":126739892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509919,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":382284,"kb_used_data":148412,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93989556,"statfs":{"total":96636764160,"available":96245305344,"internally_reserved":0,"allocated":151973888,"data_stored":149950624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509921,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272088,"kb_used_data":146504,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94099752,"statfs":{"total":96636764160,"available":96358146048,"internally_reserved":0,"allocated":150020096,"data_stored":148019597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509920,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415468,"kb_used_data":99676,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93956372,"statfs":{"total":96636764160,"available":96211324928,"internally_reserved":0,"allocated":102068224,"data_stored":100031414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":323353029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509919,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237776,"kb_used_data":126080,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94134064,"statfs":{"total":96636764160,"available":96393281536,"internally_reserved":0,"allocated":129105920,"data_stored":127071879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575327,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361332,"kb_used_data":123364,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94010508,"statfs":{"total":96636764160,"available":96266760192,"internally_reserved":0,"allocated":126324736,"data_stored":124309726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114290688,"data_stored":114290688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82055168,"data_stored":82055168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112566272,"data_stored":112566272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":116948992,"data_stored":116948992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":89780224,"data_stored":89780224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":89399296,"data_stored":89399296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":96894976,"data_stored":96894976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71344128,"data_stored":71344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":496950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":480029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":124192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":251717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":381856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":317760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":342581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":315842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1673084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14675968,"data_stored":14675968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16317099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6885376,"data_stored":6884011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18399232,"data_stored":18397867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11591680,"data_stored":11588891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31514624,"data_stored":31511835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27299840,"data_stored":27299025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16781312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23638016,"data_stored":23636651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15953920,"data_stored":15947586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16367616,"data_stored":16363462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23121920,"data_stored":23121105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:05.767 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:01:06.130 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:01:06.132 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1446,"stamp":"2024-09-12T18:01:05.133266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657141058,"num_objects":4909,"num_object_clones":0,"num_object_copies":18584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4909,"num_whiteouts":0,"num_read":285692,"num_read_kb":2395651,"num_write":156840,"num_write_kb":2366905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13537,"ondisk_log_size":13537,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2676072,"kb_used_data":1044008,"kb_used_omap":12,"kb_used_meta":1631923,"kb_avail":752298648,"statfs":{"total":773094113280,"available":770353815552,"internally_reserved":0,"allocated":1069064192,"data_stored":1052820340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1671089712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4838261,"num_objects":-100,"num_object_clones":0,"num_object_copies":-364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-100,"num_whiteouts":0,"num_read":366,"num_read_kb":321,"num_write":131,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006546"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013121+0000","last_change":"2024-09-12T17:49:56.045663+0000","last_active":"2024-09-12T17:57:27.013121+0000","last_peered":"2024-09-12T17:57:27.013121+0000","last_clean":"2024-09-12T17:57:27.013121+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T17:57:27.013121+0000","last_undegraded":"2024-09-12T17:57:27.013121+0000","last_fullsized":"2024-09-12T17:57:27.013121+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:17.001669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.114014+0000","last_change":"2024-09-12T17:38:47.032756+0000","last_active":"2024-09-12T17:56:17.114014+0000","last_peered":"2024-09-12T17:56:17.114014+0000","last_clean":"2024-09-12T17:56:17.114014+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T17:56:17.114014+0000","last_undegraded":"2024-09-12T17:56:17.114014+0000","last_fullsized":"2024-09-12T17:56:17.114014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:43.869294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:15.122813+0000","last_change":"2024-09-12T17:38:43.996174+0000","last_active":"2024-09-12T17:56:15.122813+0000","last_peered":"2024-09-12T17:56:15.122813+0000","last_clean":"2024-09-12T17:56:15.122813+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T17:56:15.122813+0000","last_undegraded":"2024-09-12T17:56:15.122813+0000","last_fullsized":"2024-09-12T17:56:15.122813+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.191809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.019082+0000","last_change":"2024-09-12T17:37:08.657434+0000","last_active":"2024-09-12T17:58:02.019082+0000","last_peered":"2024-09-12T17:58:02.019082+0000","last_clean":"2024-09-12T17:58:02.019082+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T17:58:02.019082+0000","last_undegraded":"2024-09-12T17:58:02.019082+0000","last_fullsized":"2024-09-12T17:58:02.019082+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.018613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128952+0000","last_change":"2024-09-12T17:49:56.047260+0000","last_active":"2024-09-12T17:57:27.128952+0000","last_peered":"2024-09-12T17:57:27.128952+0000","last_clean":"2024-09-12T17:57:27.128952+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T17:57:27.128952+0000","last_undegraded":"2024-09-12T17:57:27.128952+0000","last_fullsized":"2024-09-12T17:57:27.128952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:13.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154633+0000","last_change":"2024-09-12T17:38:47.032526+0000","last_active":"2024-09-12T17:56:17.154633+0000","last_peered":"2024-09-12T17:56:17.154633+0000","last_clean":"2024-09-12T17:56:17.154633+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T17:56:17.154633+0000","last_undegraded":"2024-09-12T17:56:17.154633+0000","last_fullsized":"2024-09-12T17:56:17.154633+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.382669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:13.114703+0000","last_change":"2024-09-12T17:38:43.991731+0000","last_active":"2024-09-12T17:56:13.114703+0000","last_peered":"2024-09-12T17:56:13.114703+0000","last_clean":"2024-09-12T17:56:13.114703+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T17:56:13.114703+0000","last_undegraded":"2024-09-12T17:56:13.114703+0000","last_fullsized":"2024-09-12T17:56:13.114703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.972040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8434971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4142,"num_write":9,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:19.118189+0000","last_change":"2024-09-12T17:37:08.650147+0000","last_active":"2024-09-12T17:58:19.118189+0000","last_peered":"2024-09-12T17:58:19.118189+0000","last_clean":"2024-09-12T17:58:19.118189+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T17:58:19.118189+0000","last_undegraded":"2024-09-12T17:58:19.118189+0000","last_fullsized":"2024-09-12T17:58:19.118189+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:58.755566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.122054+0000","last_change":"2024-09-12T17:49:56.046643+0000","last_active":"2024-09-12T17:57:12.122054+0000","last_peered":"2024-09-12T17:57:12.122054+0000","last_clean":"2024-09-12T17:57:12.122054+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T17:57:12.122054+0000","last_undegraded":"2024-09-12T17:57:12.122054+0000","last_fullsized":"2024-09-12T17:57:12.122054+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.487756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'1","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127968+0000","last_change":"2024-09-12T17:38:47.027090+0000","last_active":"2024-09-12T17:57:33.127968+0000","last_peered":"2024-09-12T17:57:33.127968+0000","last_clean":"2024-09-12T17:57:33.127968+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T17:57:33.127968+0000","last_undegraded":"2024-09-12T17:57:33.127968+0000","last_fullsized":"2024-09-12T17:57:33.127968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:21.352493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144193+0000","last_change":"2024-09-12T17:38:43.992601+0000","last_active":"2024-09-12T17:58:45.144193+0000","last_peered":"2024-09-12T17:58:45.144193+0000","last_clean":"2024-09-12T17:58:45.144193+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T17:58:45.144193+0000","last_undegraded":"2024-09-12T17:58:45.144193+0000","last_fullsized":"2024-09-12T17:58:45.144193+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:05.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":243,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.266547+0000","last_change":"2024-09-12T17:37:08.657551+0000","last_active":"2024-09-12T17:59:07.266547+0000","last_peered":"2024-09-12T17:59:07.266547+0000","last_clean":"2024-09-12T17:59:07.266547+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T17:59:07.266547+0000","last_undegraded":"2024-09-12T17:59:07.266547+0000","last_fullsized":"2024-09-12T17:59:07.266547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:01.832274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:18.125196+0000","last_change":"2024-09-12T17:49:56.040426+0000","last_active":"2024-09-12T17:57:18.125196+0000","last_peered":"2024-09-12T17:57:18.125196+0000","last_clean":"2024-09-12T17:57:18.125196+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T17:57:18.125196+0000","last_undegraded":"2024-09-12T17:57:18.125196+0000","last_fullsized":"2024-09-12T17:57:18.125196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:54.760400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.139311+0000","last_change":"2024-09-12T17:38:47.027638+0000","last_active":"2024-09-12T17:58:53.139311+0000","last_peered":"2024-09-12T17:58:53.139311+0000","last_clean":"2024-09-12T17:58:53.139311+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T17:58:53.139311+0000","last_undegraded":"2024-09-12T17:58:53.139311+0000","last_fullsized":"2024-09-12T17:58:53.139311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:43.893874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12378,"num_write":5,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.124986+0000","last_change":"2024-09-12T17:38:43.990788+0000","last_active":"2024-09-12T17:57:32.124986+0000","last_peered":"2024-09-12T17:57:32.124986+0000","last_clean":"2024-09-12T17:57:32.124986+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T17:57:32.124986+0000","last_undegraded":"2024-09-12T17:57:32.124986+0000","last_fullsized":"2024-09-12T17:57:32.124986+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:59.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":14340,"num_write":5,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126674+0000","last_change":"2024-09-12T17:37:08.653015+0000","last_active":"2024-09-12T17:57:12.126674+0000","last_peered":"2024-09-12T17:57:12.126674+0000","last_clean":"2024-09-12T17:57:12.126674+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T17:57:12.126674+0000","last_undegraded":"2024-09-12T17:57:12.126674+0000","last_fullsized":"2024-09-12T17:57:12.126674+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:29.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137509+0000","last_change":"2024-09-12T17:49:56.043841+0000","last_active":"2024-09-12T17:57:55.137509+0000","last_peered":"2024-09-12T17:57:55.137509+0000","last_clean":"2024-09-12T17:57:55.137509+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T17:57:55.137509+0000","last_undegraded":"2024-09-12T17:57:55.137509+0000","last_fullsized":"2024-09-12T17:57:55.137509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:54.316816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.019362+0000","last_change":"2024-09-12T17:38:47.020351+0000","last_active":"2024-09-12T17:58:12.019362+0000","last_peered":"2024-09-12T17:58:12.019362+0000","last_clean":"2024-09-12T17:58:12.019362+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T17:58:12.019362+0000","last_undegraded":"2024-09-12T17:58:12.019362+0000","last_fullsized":"2024-09-12T17:58:12.019362+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:50.384206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132353+0000","last_change":"2024-09-12T17:38:43.991420+0000","last_active":"2024-09-12T17:58:03.132353+0000","last_peered":"2024-09-12T17:58:03.132353+0000","last_clean":"2024-09-12T17:58:03.132353+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T17:58:03.132353+0000","last_undegraded":"2024-09-12T17:58:03.132353+0000","last_fullsized":"2024-09-12T17:58:03.132353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126614+0000","last_change":"2024-09-12T17:37:08.656898+0000","last_active":"2024-09-12T17:57:12.126614+0000","last_peered":"2024-09-12T17:57:12.126614+0000","last_clean":"2024-09-12T17:57:12.126614+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T17:57:12.126614+0000","last_undegraded":"2024-09-12T17:57:12.126614+0000","last_fullsized":"2024-09-12T17:57:12.126614+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:09.179411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.022015+0000","last_change":"2024-09-12T17:49:56.038230+0000","last_active":"2024-09-12T17:58:17.022015+0000","last_peered":"2024-09-12T17:58:17.022015+0000","last_clean":"2024-09-12T17:58:17.022015+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T17:58:17.022015+0000","last_undegraded":"2024-09-12T17:58:17.022015+0000","last_fullsized":"2024-09-12T17:58:17.022015+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:01.328505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'1","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018999+0000","last_change":"2024-09-12T17:38:47.024390+0000","last_active":"2024-09-12T17:58:07.018999+0000","last_peered":"2024-09-12T17:58:07.018999+0000","last_clean":"2024-09-12T17:58:07.018999+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T17:58:07.018999+0000","last_undegraded":"2024-09-12T17:58:07.018999+0000","last_fullsized":"2024-09-12T17:58:07.018999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:38.074041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020049+0000","last_change":"2024-09-12T17:38:43.992661+0000","last_active":"2024-09-12T17:58:12.020049+0000","last_peered":"2024-09-12T17:58:12.020049+0000","last_clean":"2024-09-12T17:58:12.020049+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T17:58:12.020049+0000","last_undegraded":"2024-09-12T17:58:12.020049+0000","last_fullsized":"2024-09-12T17:58:12.020049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:23.126019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.118389+0000","last_change":"2024-09-12T17:37:08.657360+0000","last_active":"2024-09-12T17:58:29.118389+0000","last_peered":"2024-09-12T17:58:29.118389+0000","last_clean":"2024-09-12T17:58:29.118389+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T17:58:29.118389+0000","last_undegraded":"2024-09-12T17:58:29.118389+0000","last_fullsized":"2024-09-12T17:58:29.118389+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:37.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164252+0000","last_change":"2024-09-12T17:49:56.045176+0000","last_active":"2024-09-12T17:57:27.164252+0000","last_peered":"2024-09-12T17:57:27.164252+0000","last_clean":"2024-09-12T17:57:27.164252+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T17:57:27.164252+0000","last_undegraded":"2024-09-12T17:57:27.164252+0000","last_fullsized":"2024-09-12T17:57:27.164252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:33.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154608+0000","last_change":"2024-09-12T17:38:47.030932+0000","last_active":"2024-09-12T17:56:17.154608+0000","last_peered":"2024-09-12T17:56:17.154608+0000","last_clean":"2024-09-12T17:56:17.154608+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T17:56:17.154608+0000","last_undegraded":"2024-09-12T17:56:17.154608+0000","last_fullsized":"2024-09-12T17:56:17.154608+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:41.271072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.002901+0000","last_change":"2024-09-12T17:38:43.994843+0000","last_active":"2024-09-12T17:56:17.002901+0000","last_peered":"2024-09-12T17:56:17.002901+0000","last_clean":"2024-09-12T17:56:17.002901+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T17:56:17.002901+0000","last_undegraded":"2024-09-12T17:56:17.002901+0000","last_fullsized":"2024-09-12T17:56:17.002901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:41.681786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4663,"num_write":3,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124762+0000","last_change":"2024-09-12T17:37:08.654696+0000","last_active":"2024-09-12T17:56:30.124762+0000","last_peered":"2024-09-12T17:56:30.124762+0000","last_clean":"2024-09-12T17:56:30.124762+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T17:56:30.124762+0000","last_undegraded":"2024-09-12T17:56:30.124762+0000","last_fullsized":"2024-09-12T17:56:30.124762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:03.990843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013188+0000","last_change":"2024-09-12T17:49:56.044511+0000","last_active":"2024-09-12T17:57:27.013188+0000","last_peered":"2024-09-12T17:57:27.013188+0000","last_clean":"2024-09-12T17:57:27.013188+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T17:57:27.013188+0000","last_undegraded":"2024-09-12T17:57:27.013188+0000","last_fullsized":"2024-09-12T17:57:27.013188+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:47.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'6","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:20.123428+0000","last_change":"2024-09-12T17:38:47.024321+0000","last_active":"2024-09-12T17:56:20.123428+0000","last_peered":"2024-09-12T17:56:20.123428+0000","last_clean":"2024-09-12T17:56:20.123428+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T17:56:20.123428+0000","last_undegraded":"2024-09-12T17:56:20.123428+0000","last_fullsized":"2024-09-12T17:56:20.123428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:06.138900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7348224,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":13320,"num_write":16,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'9","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.118833+0000","last_change":"2024-09-12T17:38:43.990416+0000","last_active":"2024-09-12T17:56:17.118833+0000","last_peered":"2024-09-12T17:56:17.118833+0000","last_clean":"2024-09-12T17:56:17.118833+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T17:56:17.118833+0000","last_undegraded":"2024-09-12T17:56:17.118833+0000","last_fullsized":"2024-09-12T17:56:17.118833+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.211902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:40.117649+0000","last_change":"2024-09-12T17:37:08.660746+0000","last_active":"2024-09-12T17:58:40.117649+0000","last_peered":"2024-09-12T17:58:40.117649+0000","last_clean":"2024-09-12T17:58:40.117649+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T17:58:40.117649+0000","last_undegraded":"2024-09-12T17:58:40.117649+0000","last_fullsized":"2024-09-12T17:58:40.117649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:53.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.121922+0000","last_change":"2024-09-12T17:49:56.044578+0000","last_active":"2024-09-12T17:56:58.121922+0000","last_peered":"2024-09-12T17:56:58.121922+0000","last_clean":"2024-09-12T17:56:58.121922+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T17:56:58.121922+0000","last_undegraded":"2024-09-12T17:56:58.121922+0000","last_fullsized":"2024-09-12T17:56:58.121922+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:59.881857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139830+0000","last_change":"2024-09-12T17:38:47.024618+0000","last_active":"2024-09-12T17:58:10.139830+0000","last_peered":"2024-09-12T17:58:10.139830+0000","last_clean":"2024-09-12T17:58:10.139830+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T17:58:10.139830+0000","last_undegraded":"2024-09-12T17:58:10.139830+0000","last_fullsized":"2024-09-12T17:58:10.139830+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:49.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'9","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014371+0000","last_change":"2024-09-12T17:38:43.991705+0000","last_active":"2024-09-12T17:57:32.014371+0000","last_peered":"2024-09-12T17:57:32.014371+0000","last_clean":"2024-09-12T17:57:32.014371+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T17:57:32.014371+0000","last_undegraded":"2024-09-12T17:57:32.014371+0000","last_fullsized":"2024-09-12T17:57:32.014371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.996078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641131,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":4710,"num_write":14,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'113","reported_seq":388,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.275995+0000","last_change":"2024-09-12T17:37:08.655763+0000","last_active":"2024-09-12T17:58:17.275995+0000","last_peered":"2024-09-12T17:58:17.275995+0000","last_clean":"2024-09-12T17:58:17.275995+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T17:58:17.275995+0000","last_undegraded":"2024-09-12T17:58:17.275995+0000","last_fullsized":"2024-09-12T17:58:17.275995+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:41.813693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124631+0000","last_change":"2024-09-12T17:49:56.034209+0000","last_active":"2024-09-12T17:56:57.124631+0000","last_peered":"2024-09-12T17:56:57.124631+0000","last_clean":"2024-09-12T17:56:57.124631+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T17:56:57.124631+0000","last_undegraded":"2024-09-12T17:56:57.124631+0000","last_fullsized":"2024-09-12T17:56:57.124631+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:11.559774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127870+0000","last_change":"2024-09-12T17:38:47.024189+0000","last_active":"2024-09-12T17:57:33.127870+0000","last_peered":"2024-09-12T17:57:33.127870+0000","last_clean":"2024-09-12T17:57:33.127870+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T17:57:33.127870+0000","last_undegraded":"2024-09-12T17:57:33.127870+0000","last_fullsized":"2024-09-12T17:57:33.127870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:12.716839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018494+0000","last_change":"2024-09-12T17:38:43.995454+0000","last_active":"2024-09-12T17:58:07.018494+0000","last_peered":"2024-09-12T17:58:07.018494+0000","last_clean":"2024-09-12T17:58:07.018494+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T17:58:07.018494+0000","last_undegraded":"2024-09-12T17:58:07.018494+0000","last_fullsized":"2024-09-12T17:58:07.018494+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.629425+0000","last_change":"2024-09-12T17:37:08.650302+0000","last_active":"2024-09-12T17:58:28.629425+0000","last_peered":"2024-09-12T17:58:28.629425+0000","last_clean":"2024-09-12T17:58:28.629425+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T17:58:28.629425+0000","last_undegraded":"2024-09-12T17:58:28.629425+0000","last_fullsized":"2024-09-12T17:58:28.629425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:26.087974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159949+0000","last_change":"2024-09-12T17:49:56.037995+0000","last_active":"2024-09-12T17:56:57.159949+0000","last_peered":"2024-09-12T17:56:57.159949+0000","last_clean":"2024-09-12T17:56:57.159949+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T17:56:57.159949+0000","last_undegraded":"2024-09-12T17:56:57.159949+0000","last_fullsized":"2024-09-12T17:56:57.159949+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:04.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139871+0000","last_change":"2024-09-12T17:38:47.016476+0000","last_active":"2024-09-12T17:58:10.139871+0000","last_peered":"2024-09-12T17:58:10.139871+0000","last_clean":"2024-09-12T17:58:10.139871+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T17:58:10.139871+0000","last_undegraded":"2024-09-12T17:58:10.139871+0000","last_fullsized":"2024-09-12T17:58:10.139871+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:05.344871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138926+0000","last_change":"2024-09-12T17:38:43.996222+0000","last_active":"2024-09-12T17:58:05.138926+0000","last_peered":"2024-09-12T17:58:05.138926+0000","last_clean":"2024-09-12T17:58:05.138926+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T17:58:05.138926+0000","last_undegraded":"2024-09-12T17:58:05.138926+0000","last_fullsized":"2024-09-12T17:58:05.138926+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:17.497778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124845+0000","last_change":"2024-09-12T17:37:08.661473+0000","last_active":"2024-09-12T17:56:30.124845+0000","last_peered":"2024-09-12T17:56:30.124845+0000","last_clean":"2024-09-12T17:56:30.124845+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T17:56:30.124845+0000","last_undegraded":"2024-09-12T17:56:30.124845+0000","last_fullsized":"2024-09-12T17:56:30.124845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:03.318444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.008878+0000","last_change":"2024-09-12T17:49:56.045356+0000","last_active":"2024-09-12T17:56:57.008878+0000","last_peered":"2024-09-12T17:56:57.008878+0000","last_clean":"2024-09-12T17:56:57.008878+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T17:56:57.008878+0000","last_undegraded":"2024-09-12T17:56:57.008878+0000","last_fullsized":"2024-09-12T17:56:57.008878+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:33.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'1","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018535+0000","last_change":"2024-09-12T17:38:47.023380+0000","last_active":"2024-09-12T17:58:07.018535+0000","last_peered":"2024-09-12T17:58:07.018535+0000","last_clean":"2024-09-12T17:58:07.018535+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T17:58:07.018535+0000","last_undegraded":"2024-09-12T17:58:07.018535+0000","last_fullsized":"2024-09-12T17:58:07.018535+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.275074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132508+0000","last_change":"2024-09-12T17:38:43.989365+0000","last_active":"2024-09-12T17:58:03.132508+0000","last_peered":"2024-09-12T17:58:03.132508+0000","last_clean":"2024-09-12T17:58:03.132508+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T17:58:03.132508+0000","last_undegraded":"2024-09-12T17:58:03.132508+0000","last_fullsized":"2024-09-12T17:58:03.132508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:53.634008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020922+0000","last_change":"2024-09-12T17:37:08.651846+0000","last_active":"2024-09-12T17:58:17.020922+0000","last_peered":"2024-09-12T17:58:17.020922+0000","last_clean":"2024-09-12T17:58:17.020922+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T17:58:17.020922+0000","last_undegraded":"2024-09-12T17:58:17.020922+0000","last_fullsized":"2024-09-12T17:58:17.020922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:47.950299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:13.124363+0000","last_change":"2024-09-12T17:49:56.042508+0000","last_active":"2024-09-12T17:57:13.124363+0000","last_peered":"2024-09-12T17:57:13.124363+0000","last_clean":"2024-09-12T17:57:13.124363+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T17:57:13.124363+0000","last_undegraded":"2024-09-12T17:57:13.124363+0000","last_fullsized":"2024-09-12T17:57:13.124363+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:56.026526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.127091+0000","last_change":"2024-09-12T17:38:47.028439+0000","last_active":"2024-09-12T17:57:28.127091+0000","last_peered":"2024-09-12T17:57:28.127091+0000","last_clean":"2024-09-12T17:57:28.127091+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T17:57:28.127091+0000","last_undegraded":"2024-09-12T17:57:28.127091+0000","last_fullsized":"2024-09-12T17:57:28.127091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:40.113111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124185+0000","last_change":"2024-09-12T17:38:43.990984+0000","last_active":"2024-09-12T17:57:27.124185+0000","last_peered":"2024-09-12T17:57:27.124185+0000","last_clean":"2024-09-12T17:57:27.124185+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T17:57:27.124185+0000","last_undegraded":"2024-09-12T17:57:27.124185+0000","last_fullsized":"2024-09-12T17:57:27.124185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:55.979807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020118+0000","last_change":"2024-09-12T17:37:08.656056+0000","last_active":"2024-09-12T17:58:12.020118+0000","last_peered":"2024-09-12T17:58:12.020118+0000","last_clean":"2024-09-12T17:58:12.020118+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T17:58:12.020118+0000","last_undegraded":"2024-09-12T17:58:12.020118+0000","last_fullsized":"2024-09-12T17:58:12.020118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:45.733213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126727+0000","last_change":"2024-09-12T17:49:56.042525+0000","last_active":"2024-09-12T17:57:12.126727+0000","last_peered":"2024-09-12T17:57:12.126727+0000","last_clean":"2024-09-12T17:57:12.126727+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T17:57:12.126727+0000","last_undegraded":"2024-09-12T17:57:12.126727+0000","last_fullsized":"2024-09-12T17:57:12.126727+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:07.790123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.147415+0000","last_change":"2024-09-12T17:38:47.030812+0000","last_active":"2024-09-12T17:59:48.147415+0000","last_peered":"2024-09-12T17:59:48.147415+0000","last_clean":"2024-09-12T17:59:48.147415+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T17:59:48.147415+0000","last_undegraded":"2024-09-12T17:59:48.147415+0000","last_fullsized":"2024-09-12T17:59:48.147415+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:21.678813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10258,"num_write":14,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.126144+0000","last_change":"2024-09-12T17:38:43.987476+0000","last_active":"2024-09-12T17:57:23.126144+0000","last_peered":"2024-09-12T17:57:23.126144+0000","last_clean":"2024-09-12T17:57:23.126144+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T17:57:23.126144+0000","last_undegraded":"2024-09-12T17:57:23.126144+0000","last_fullsized":"2024-09-12T17:57:23.126144+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.672726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139794+0000","last_change":"2024-09-12T17:37:08.661575+0000","last_active":"2024-09-12T17:58:10.139794+0000","last_peered":"2024-09-12T17:58:10.139794+0000","last_clean":"2024-09-12T17:58:10.139794+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T17:58:10.139794+0000","last_undegraded":"2024-09-12T17:58:10.139794+0000","last_fullsized":"2024-09-12T17:58:10.139794+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:44.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009869+0000","last_change":"2024-09-12T17:49:56.037386+0000","last_active":"2024-09-12T17:57:02.009869+0000","last_peered":"2024-09-12T17:57:02.009869+0000","last_clean":"2024-09-12T17:57:02.009869+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T17:57:02.009869+0000","last_undegraded":"2024-09-12T17:57:02.009869+0000","last_fullsized":"2024-09-12T17:57:02.009869+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:00.713527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:30.133900+0000","last_change":"2024-09-12T17:38:47.022479+0000","last_active":"2024-09-12T17:57:30.133900+0000","last_peered":"2024-09-12T17:57:30.133900+0000","last_clean":"2024-09-12T17:57:30.133900+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T17:57:30.133900+0000","last_undegraded":"2024-09-12T17:57:30.133900+0000","last_fullsized":"2024-09-12T17:57:30.133900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:49.306337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124233+0000","last_change":"2024-09-12T17:38:43.988889+0000","last_active":"2024-09-12T17:57:27.124233+0000","last_peered":"2024-09-12T17:57:27.124233+0000","last_clean":"2024-09-12T17:57:27.124233+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T17:57:27.124233+0000","last_undegraded":"2024-09-12T17:57:27.124233+0000","last_fullsized":"2024-09-12T17:57:27.124233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:26.795414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7172,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.170376+0000","last_change":"2024-09-12T17:37:08.658663+0000","last_active":"2024-09-12T17:58:12.170376+0000","last_peered":"2024-09-12T17:58:12.170376+0000","last_clean":"2024-09-12T17:58:12.170376+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T17:58:12.170376+0000","last_undegraded":"2024-09-12T17:58:12.170376+0000","last_fullsized":"2024-09-12T17:58:12.170376+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.276415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126695+0000","last_change":"2024-09-12T17:49:56.036857+0000","last_active":"2024-09-12T17:57:12.126695+0000","last_peered":"2024-09-12T17:57:12.126695+0000","last_clean":"2024-09-12T17:57:12.126695+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T17:57:12.126695+0000","last_undegraded":"2024-09-12T17:57:12.126695+0000","last_fullsized":"2024-09-12T17:57:12.126695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:01.304735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013658+0000","last_change":"2024-09-12T17:38:47.019373+0000","last_active":"2024-09-12T17:57:27.013658+0000","last_peered":"2024-09-12T17:57:27.013658+0000","last_clean":"2024-09-12T17:57:27.013658+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T17:57:27.013658+0000","last_undegraded":"2024-09-12T17:57:27.013658+0000","last_fullsized":"2024-09-12T17:57:27.013658+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:16.314152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124255+0000","last_change":"2024-09-12T17:38:43.992720+0000","last_active":"2024-09-12T17:57:27.124255+0000","last_peered":"2024-09-12T17:57:27.124255+0000","last_clean":"2024-09-12T17:57:27.124255+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T17:57:27.124255+0000","last_undegraded":"2024-09-12T17:57:27.124255+0000","last_fullsized":"2024-09-12T17:57:27.124255+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:49.377878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.480567+0000","last_change":"2024-09-12T17:37:08.662089+0000","last_active":"2024-09-12T17:58:18.480567+0000","last_peered":"2024-09-12T17:58:18.480567+0000","last_clean":"2024-09-12T17:58:18.480567+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T17:58:18.480567+0000","last_undegraded":"2024-09-12T17:58:18.480567+0000","last_fullsized":"2024-09-12T17:58:18.480567+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:41.016001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.137350+0000","last_change":"2024-09-12T17:49:56.047641+0000","last_active":"2024-09-12T17:58:43.137350+0000","last_peered":"2024-09-12T17:58:43.137350+0000","last_clean":"2024-09-12T17:58:43.137350+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T17:58:43.137350+0000","last_undegraded":"2024-09-12T17:58:43.137350+0000","last_fullsized":"2024-09-12T17:58:43.137350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:16.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127812+0000","last_change":"2024-09-12T17:38:47.029582+0000","last_active":"2024-09-12T17:56:50.127812+0000","last_peered":"2024-09-12T17:56:50.127812+0000","last_clean":"2024-09-12T17:56:50.127812+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T17:56:50.127812+0000","last_undegraded":"2024-09-12T17:56:50.127812+0000","last_fullsized":"2024-09-12T17:56:50.127812+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.565082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.158658+0000","last_change":"2024-09-12T17:38:43.989865+0000","last_active":"2024-09-12T17:56:47.158658+0000","last_peered":"2024-09-12T17:56:47.158658+0000","last_clean":"2024-09-12T17:56:47.158658+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T17:56:47.158658+0000","last_undegraded":"2024-09-12T17:56:47.158658+0000","last_fullsized":"2024-09-12T17:56:47.158658+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:53.024317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133309+0000","last_change":"2024-09-12T17:37:08.662016+0000","last_active":"2024-09-12T17:57:25.133309+0000","last_peered":"2024-09-12T17:57:25.133309+0000","last_clean":"2024-09-12T17:57:25.133309+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T17:57:25.133309+0000","last_undegraded":"2024-09-12T17:57:25.133309+0000","last_fullsized":"2024-09-12T17:57:25.133309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:38.421910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.117628+0000","last_change":"2024-09-12T17:49:56.049044+0000","last_active":"2024-09-12T17:56:42.117628+0000","last_peered":"2024-09-12T17:56:42.117628+0000","last_clean":"2024-09-12T17:56:42.117628+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T17:56:42.117628+0000","last_undegraded":"2024-09-12T17:56:42.117628+0000","last_fullsized":"2024-09-12T17:56:42.117628+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:10.014418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127772+0000","last_change":"2024-09-12T17:38:47.025348+0000","last_active":"2024-09-12T17:56:50.127772+0000","last_peered":"2024-09-12T17:56:50.127772+0000","last_clean":"2024-09-12T17:56:50.127772+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T17:56:50.127772+0000","last_undegraded":"2024-09-12T17:56:50.127772+0000","last_fullsized":"2024-09-12T17:56:50.127772+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:14.763266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.123070+0000","last_change":"2024-09-12T17:38:43.989723+0000","last_active":"2024-09-12T17:56:47.123070+0000","last_peered":"2024-09-12T17:56:47.123070+0000","last_clean":"2024-09-12T17:56:47.123070+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T17:56:47.123070+0000","last_undegraded":"2024-09-12T17:56:47.123070+0000","last_fullsized":"2024-09-12T17:56:47.123070+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:38.471857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8392704,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":3,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013744+0000","last_change":"2024-09-12T17:37:08.648920+0000","last_active":"2024-09-12T17:57:27.013744+0000","last_peered":"2024-09-12T17:57:27.013744+0000","last_clean":"2024-09-12T17:57:27.013744+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T17:57:27.013744+0000","last_undegraded":"2024-09-12T17:57:27.013744+0000","last_fullsized":"2024-09-12T17:57:27.013744+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.023058+0000","last_change":"2024-09-12T17:49:56.036894+0000","last_active":"2024-09-12T17:58:37.023058+0000","last_peered":"2024-09-12T17:58:37.023058+0000","last_clean":"2024-09-12T17:58:37.023058+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T17:58:37.023058+0000","last_undegraded":"2024-09-12T17:58:37.023058+0000","last_fullsized":"2024-09-12T17:58:37.023058+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:30.781444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'5","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127863+0000","last_change":"2024-09-12T17:38:47.027005+0000","last_active":"2024-09-12T17:56:50.127863+0000","last_peered":"2024-09-12T17:56:50.127863+0000","last_clean":"2024-09-12T17:56:50.127863+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T17:56:50.127863+0000","last_undegraded":"2024-09-12T17:56:50.127863+0000","last_fullsized":"2024-09-12T17:56:50.127863+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:26.959823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10534097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":15452,"num_write":5,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:45.127156+0000","last_change":"2024-09-12T17:38:43.996009+0000","last_active":"2024-09-12T17:56:45.127156+0000","last_peered":"2024-09-12T17:56:45.127156+0000","last_clean":"2024-09-12T17:56:45.127156+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T17:56:45.127156+0000","last_undegraded":"2024-09-12T17:56:45.127156+0000","last_fullsized":"2024-09-12T17:56:45.127156+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.956208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4108,"num_write":5,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124276+0000","last_change":"2024-09-12T17:37:08.653415+0000","last_active":"2024-09-12T17:57:27.124276+0000","last_peered":"2024-09-12T17:57:27.124276+0000","last_clean":"2024-09-12T17:57:27.124276+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T17:57:27.124276+0000","last_undegraded":"2024-09-12T17:57:27.124276+0000","last_fullsized":"2024-09-12T17:57:27.124276+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:16.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.133197+0000","last_change":"2024-09-12T17:49:56.047746+0000","last_active":"2024-09-12T17:58:37.133197+0000","last_peered":"2024-09-12T17:58:37.133197+0000","last_clean":"2024-09-12T17:58:37.133197+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T17:58:37.133197+0000","last_undegraded":"2024-09-12T17:58:37.133197+0000","last_fullsized":"2024-09-12T17:58:37.133197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:19.785797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:48.120271+0000","last_change":"2024-09-12T17:38:47.022037+0000","last_active":"2024-09-12T17:56:48.120271+0000","last_peered":"2024-09-12T17:56:48.120271+0000","last_clean":"2024-09-12T17:56:48.120271+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T17:56:48.120271+0000","last_undegraded":"2024-09-12T17:56:48.120271+0000","last_fullsized":"2024-09-12T17:56:48.120271+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:58.528885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11258,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:45.127205+0000","last_change":"2024-09-12T17:38:43.991999+0000","last_active":"2024-09-12T17:56:45.127205+0000","last_peered":"2024-09-12T17:56:45.127205+0000","last_clean":"2024-09-12T17:56:45.127205+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T17:56:45.127205+0000","last_undegraded":"2024-09-12T17:56:45.127205+0000","last_fullsized":"2024-09-12T17:56:45.127205+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:23.142677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128990+0000","last_change":"2024-09-12T17:37:08.659437+0000","last_active":"2024-09-12T17:57:27.128990+0000","last_peered":"2024-09-12T17:57:27.128990+0000","last_clean":"2024-09-12T17:57:27.128990+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T17:57:27.128990+0000","last_undegraded":"2024-09-12T17:57:27.128990+0000","last_fullsized":"2024-09-12T17:57:27.128990+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:00.942567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:43.119397+0000","last_change":"2024-09-12T17:49:56.045196+0000","last_active":"2024-09-12T17:56:43.119397+0000","last_peered":"2024-09-12T17:56:43.119397+0000","last_clean":"2024-09-12T17:56:43.119397+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T17:56:43.119397+0000","last_undegraded":"2024-09-12T17:56:43.119397+0000","last_fullsized":"2024-09-12T17:56:43.119397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:39.426641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020855+0000","last_change":"2024-09-12T17:38:47.020511+0000","last_active":"2024-09-12T17:58:17.020855+0000","last_peered":"2024-09-12T17:58:17.020855+0000","last_clean":"2024-09-12T17:58:17.020855+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T17:58:17.020855+0000","last_undegraded":"2024-09-12T17:58:17.020855+0000","last_fullsized":"2024-09-12T17:58:17.020855+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.015103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:15.140467+0000","last_change":"2024-09-12T17:38:43.993571+0000","last_active":"2024-09-12T17:58:15.140467+0000","last_peered":"2024-09-12T17:58:15.140467+0000","last_clean":"2024-09-12T17:58:15.140467+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T17:58:15.140467+0000","last_undegraded":"2024-09-12T17:58:15.140467+0000","last_fullsized":"2024-09-12T17:58:15.140467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.884799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128966+0000","last_change":"2024-09-12T17:37:08.656385+0000","last_active":"2024-09-12T17:57:27.128966+0000","last_peered":"2024-09-12T17:57:27.128966+0000","last_clean":"2024-09-12T17:57:27.128966+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T17:57:27.128966+0000","last_undegraded":"2024-09-12T17:57:27.128966+0000","last_fullsized":"2024-09-12T17:57:27.128966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.157975+0000","last_change":"2024-09-12T17:49:56.048011+0000","last_active":"2024-09-12T17:56:42.157975+0000","last_peered":"2024-09-12T17:56:42.157975+0000","last_clean":"2024-09-12T17:56:42.157975+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T17:56:42.157975+0000","last_undegraded":"2024-09-12T17:56:42.157975+0000","last_fullsized":"2024-09-12T17:56:42.157975+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:44.187088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.170917+0000","last_change":"2024-09-12T17:38:47.032812+0000","last_active":"2024-09-12T17:58:17.170917+0000","last_peered":"2024-09-12T17:58:17.170917+0000","last_clean":"2024-09-12T17:58:17.170917+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T17:58:17.170917+0000","last_undegraded":"2024-09-12T17:58:17.170917+0000","last_fullsized":"2024-09-12T17:58:17.170917+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:16.283298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.133853+0000","last_change":"2024-09-12T17:38:43.988490+0000","last_active":"2024-09-12T17:58:13.133853+0000","last_peered":"2024-09-12T17:58:13.133853+0000","last_clean":"2024-09-12T17:58:13.133853+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T17:58:13.133853+0000","last_undegraded":"2024-09-12T17:58:13.133853+0000","last_fullsized":"2024-09-12T17:58:13.133853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.984138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.428411+0000","last_change":"2024-09-12T17:37:08.652495+0000","last_active":"2024-09-12T17:59:07.428411+0000","last_peered":"2024-09-12T17:59:07.428411+0000","last_clean":"2024-09-12T17:59:07.428411+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T17:59:07.428411+0000","last_undegraded":"2024-09-12T17:59:07.428411+0000","last_fullsized":"2024-09-12T17:59:07.428411+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:18.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.006624+0000","last_change":"2024-09-12T17:49:56.045788+0000","last_active":"2024-09-12T17:56:42.006624+0000","last_peered":"2024-09-12T17:56:42.006624+0000","last_clean":"2024-09-12T17:56:42.006624+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T17:56:42.006624+0000","last_undegraded":"2024-09-12T17:56:42.006624+0000","last_fullsized":"2024-09-12T17:56:42.006624+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:29.577491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.123014+0000","last_change":"2024-09-12T17:38:47.030610+0000","last_active":"2024-09-12T17:56:47.123014+0000","last_peered":"2024-09-12T17:56:47.123014+0000","last_clean":"2024-09-12T17:56:47.123014+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T17:56:47.123014+0000","last_undegraded":"2024-09-12T17:56:47.123014+0000","last_fullsized":"2024-09-12T17:56:47.123014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:48.238050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:15.140519+0000","last_change":"2024-09-12T17:38:43.992844+0000","last_active":"2024-09-12T17:58:15.140519+0000","last_peered":"2024-09-12T17:58:15.140519+0000","last_clean":"2024-09-12T17:58:15.140519+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T17:58:15.140519+0000","last_undegraded":"2024-09-12T17:58:15.140519+0000","last_fullsized":"2024-09-12T17:58:15.140519+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:06.166487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":15350,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138340+0000","last_change":"2024-09-12T17:37:08.661047+0000","last_active":"2024-09-12T17:58:48.138340+0000","last_peered":"2024-09-12T17:58:48.138340+0000","last_clean":"2024-09-12T17:58:48.138340+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T17:58:48.138340+0000","last_undegraded":"2024-09-12T17:58:48.138340+0000","last_fullsized":"2024-09-12T17:58:48.138340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:35.362254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:40.126255+0000","last_change":"2024-09-12T17:49:56.045203+0000","last_active":"2024-09-12T17:56:40.126255+0000","last_peered":"2024-09-12T17:56:40.126255+0000","last_clean":"2024-09-12T17:56:40.126255+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T17:56:40.126255+0000","last_undegraded":"2024-09-12T17:56:40.126255+0000","last_fullsized":"2024-09-12T17:56:40.126255+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.690292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.020496+0000","last_change":"2024-09-12T17:38:47.026783+0000","last_active":"2024-09-12T17:58:22.020496+0000","last_peered":"2024-09-12T17:58:22.020496+0000","last_clean":"2024-09-12T17:58:22.020496+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T17:58:22.020496+0000","last_undegraded":"2024-09-12T17:58:22.020496+0000","last_fullsized":"2024-09-12T17:58:22.020496+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:20.362697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.007702+0000","last_change":"2024-09-12T17:38:43.993534+0000","last_active":"2024-09-12T17:56:47.007702+0000","last_peered":"2024-09-12T17:56:47.007702+0000","last_clean":"2024-09-12T17:56:47.007702+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T17:56:47.007702+0000","last_undegraded":"2024-09-12T17:56:47.007702+0000","last_fullsized":"2024-09-12T17:56:47.007702+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:36.199628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.024519+0000","last_change":"2024-09-12T17:37:08.652306+0000","last_active":"2024-09-12T17:58:52.024519+0000","last_peered":"2024-09-12T17:58:52.024519+0000","last_clean":"2024-09-12T17:58:52.024519+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T17:58:52.024519+0000","last_undegraded":"2024-09-12T17:58:52.024519+0000","last_fullsized":"2024-09-12T17:58:52.024519+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.726476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.019998+0000","last_change":"2024-09-12T17:49:56.046641+0000","last_active":"2024-09-12T17:58:17.019998+0000","last_peered":"2024-09-12T17:58:17.019998+0000","last_clean":"2024-09-12T17:58:17.019998+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T17:58:17.019998+0000","last_undegraded":"2024-09-12T17:58:17.019998+0000","last_fullsized":"2024-09-12T17:58:17.019998+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:58.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'7","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:38.128643+0000","last_change":"2024-09-12T17:38:47.030849+0000","last_active":"2024-09-12T17:57:38.128643+0000","last_peered":"2024-09-12T17:57:38.128643+0000","last_clean":"2024-09-12T17:57:38.128643+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T17:57:38.128643+0000","last_undegraded":"2024-09-12T17:57:38.128643+0000","last_fullsized":"2024-09-12T17:57:38.128643+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:33.916148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014388+0000","last_change":"2024-09-12T17:38:43.991595+0000","last_active":"2024-09-12T17:57:32.014388+0000","last_peered":"2024-09-12T17:57:32.014388+0000","last_clean":"2024-09-12T17:57:32.014388+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T17:57:32.014388+0000","last_undegraded":"2024-09-12T17:57:32.014388+0000","last_fullsized":"2024-09-12T17:57:32.014388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.739988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025891+0000","last_change":"2024-09-12T17:37:08.661553+0000","last_active":"2024-09-12T17:58:52.025891+0000","last_peered":"2024-09-12T17:58:52.025891+0000","last_clean":"2024-09-12T17:58:52.025891+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T17:58:52.025891+0000","last_undegraded":"2024-09-12T17:58:52.025891+0000","last_fullsized":"2024-09-12T17:58:52.025891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.649379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020012+0000","last_change":"2024-09-12T17:49:56.041888+0000","last_active":"2024-09-12T17:58:17.020012+0000","last_peered":"2024-09-12T17:58:17.020012+0000","last_clean":"2024-09-12T17:58:17.020012+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T17:58:17.020012+0000","last_undegraded":"2024-09-12T17:58:17.020012+0000","last_fullsized":"2024-09-12T17:58:17.020012+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127910+0000","last_change":"2024-09-12T17:38:47.024913+0000","last_active":"2024-09-12T17:57:33.127910+0000","last_peered":"2024-09-12T17:57:33.127910+0000","last_clean":"2024-09-12T17:57:33.127910+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T17:57:33.127910+0000","last_undegraded":"2024-09-12T17:57:33.127910+0000","last_fullsized":"2024-09-12T17:57:33.127910+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:06.755928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:37.015192+0000","last_change":"2024-09-12T17:38:43.990480+0000","last_active":"2024-09-12T17:57:37.015192+0000","last_peered":"2024-09-12T17:57:37.015192+0000","last_clean":"2024-09-12T17:57:37.015192+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T17:57:37.015192+0000","last_undegraded":"2024-09-12T17:57:37.015192+0000","last_fullsized":"2024-09-12T17:57:37.015192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:13.712977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":20468,"num_write":11,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025154+0000","last_change":"2024-09-12T17:37:08.649723+0000","last_active":"2024-09-12T17:58:52.025154+0000","last_peered":"2024-09-12T17:58:52.025154+0000","last_clean":"2024-09-12T17:58:52.025154+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T17:58:52.025154+0000","last_undegraded":"2024-09-12T17:58:52.025154+0000","last_fullsized":"2024-09-12T17:58:52.025154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.186149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132327+0000","last_change":"2024-09-12T17:49:56.046876+0000","last_active":"2024-09-12T17:58:03.132327+0000","last_peered":"2024-09-12T17:58:03.132327+0000","last_clean":"2024-09-12T17:58:03.132327+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T17:58:03.132327+0000","last_undegraded":"2024-09-12T17:58:03.132327+0000","last_fullsized":"2024-09-12T17:58:03.132327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:45.910023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020050+0000","last_change":"2024-09-12T17:38:47.026137+0000","last_active":"2024-09-12T17:58:17.020050+0000","last_peered":"2024-09-12T17:58:17.020050+0000","last_clean":"2024-09-12T17:58:17.020050+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T17:58:17.020050+0000","last_undegraded":"2024-09-12T17:58:17.020050+0000","last_fullsized":"2024-09-12T17:58:17.020050+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:14.366739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.171001+0000","last_change":"2024-09-12T17:38:43.992358+0000","last_active":"2024-09-12T17:58:17.171001+0000","last_peered":"2024-09-12T17:58:17.171001+0000","last_clean":"2024-09-12T17:58:17.171001+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T17:58:17.171001+0000","last_undegraded":"2024-09-12T17:58:17.171001+0000","last_fullsized":"2024-09-12T17:58:17.171001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:38.097131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.169817+0000","last_change":"2024-09-12T17:37:08.658795+0000","last_active":"2024-09-12T17:58:07.169817+0000","last_peered":"2024-09-12T17:58:07.169817+0000","last_clean":"2024-09-12T17:58:07.169817+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T17:58:07.169817+0000","last_undegraded":"2024-09-12T17:58:07.169817+0000","last_fullsized":"2024-09-12T17:58:07.169817+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.988783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020817+0000","last_change":"2024-09-12T17:49:56.036001+0000","last_active":"2024-09-12T17:58:17.020817+0000","last_peered":"2024-09-12T17:58:17.020817+0000","last_clean":"2024-09-12T17:58:17.020817+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T17:58:17.020817+0000","last_undegraded":"2024-09-12T17:58:17.020817+0000","last_fullsized":"2024-09-12T17:58:17.020817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:20.176376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'4","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021010+0000","last_change":"2024-09-12T17:38:47.021549+0000","last_active":"2024-09-12T17:58:17.021010+0000","last_peered":"2024-09-12T17:58:17.021010+0000","last_clean":"2024-09-12T17:58:17.021010+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T17:58:17.021010+0000","last_undegraded":"2024-09-12T17:58:17.021010+0000","last_fullsized":"2024-09-12T17:58:17.021010+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:06.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5116,"num_write":9,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021033+0000","last_change":"2024-09-12T17:38:43.994549+0000","last_active":"2024-09-12T17:58:17.021033+0000","last_peered":"2024-09-12T17:58:17.021033+0000","last_clean":"2024-09-12T17:58:17.021033+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T17:58:17.021033+0000","last_undegraded":"2024-09-12T17:58:17.021033+0000","last_fullsized":"2024-09-12T17:58:17.021033+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:30.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":171,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.435685+0000","last_change":"2024-09-12T17:37:08.659177+0000","last_active":"2024-09-12T17:59:07.435685+0000","last_peered":"2024-09-12T17:59:07.435685+0000","last_clean":"2024-09-12T17:59:07.435685+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T17:59:07.435685+0000","last_undegraded":"2024-09-12T17:59:07.435685+0000","last_fullsized":"2024-09-12T17:59:07.435685+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:04.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:35.142766+0000","last_change":"2024-09-12T17:49:56.038182+0000","last_active":"2024-09-12T17:58:35.142766+0000","last_peered":"2024-09-12T17:58:35.142766+0000","last_clean":"2024-09-12T17:58:35.142766+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T17:58:35.142766+0000","last_undegraded":"2024-09-12T17:58:35.142766+0000","last_fullsized":"2024-09-12T17:58:35.142766+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:22.086611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014474+0000","last_change":"2024-09-12T17:38:47.026375+0000","last_active":"2024-09-12T17:57:32.014474+0000","last_peered":"2024-09-12T17:57:32.014474+0000","last_clean":"2024-09-12T17:57:32.014474+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T17:57:32.014474+0000","last_undegraded":"2024-09-12T17:57:32.014474+0000","last_fullsized":"2024-09-12T17:57:32.014474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:56.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.175038+0000","last_change":"2024-09-12T17:38:43.992950+0000","last_active":"2024-09-12T17:58:52.175038+0000","last_peered":"2024-09-12T17:58:52.175038+0000","last_clean":"2024-09-12T17:58:52.175038+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T17:58:52.175038+0000","last_undegraded":"2024-09-12T17:58:52.175038+0000","last_fullsized":"2024-09-12T17:58:52.175038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:18.833241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.762077+0000","last_change":"2024-09-12T17:37:08.654619+0000","last_active":"2024-09-12T17:59:07.762077+0000","last_peered":"2024-09-12T17:59:07.762077+0000","last_clean":"2024-09-12T17:59:07.762077+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T17:59:07.762077+0000","last_undegraded":"2024-09-12T17:59:07.762077+0000","last_fullsized":"2024-09-12T17:59:07.762077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:44.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.024006+0000","last_change":"2024-09-12T17:49:56.039258+0000","last_active":"2024-09-12T17:58:37.024006+0000","last_peered":"2024-09-12T17:58:37.024006+0000","last_clean":"2024-09-12T17:58:37.024006+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T17:58:37.024006+0000","last_undegraded":"2024-09-12T17:58:37.024006+0000","last_fullsized":"2024-09-12T17:58:37.024006+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.182004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025035+0000","last_change":"2024-09-12T17:38:47.026063+0000","last_active":"2024-09-12T17:58:52.025035+0000","last_peered":"2024-09-12T17:58:52.025035+0000","last_clean":"2024-09-12T17:58:52.025035+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T17:58:52.025035+0000","last_undegraded":"2024-09-12T17:58:52.025035+0000","last_fullsized":"2024-09-12T17:58:52.025035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.717038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4778667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3651,"num_write":10,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014307+0000","last_change":"2024-09-12T17:38:43.988186+0000","last_active":"2024-09-12T17:57:32.014307+0000","last_peered":"2024-09-12T17:57:32.014307+0000","last_clean":"2024-09-12T17:57:32.014307+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T17:57:32.014307+0000","last_undegraded":"2024-09-12T17:57:32.014307+0000","last_fullsized":"2024-09-12T17:57:32.014307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:03.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.018369+0000","last_change":"2024-09-12T17:37:08.647170+0000","last_active":"2024-09-12T17:58:02.018369+0000","last_peered":"2024-09-12T17:58:02.018369+0000","last_clean":"2024-09-12T17:58:02.018369+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T17:58:02.018369+0000","last_undegraded":"2024-09-12T17:58:02.018369+0000","last_fullsized":"2024-09-12T17:58:02.018369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:33.128612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.134437+0000","last_change":"2024-09-12T17:49:56.044807+0000","last_active":"2024-09-12T17:58:18.134437+0000","last_peered":"2024-09-12T17:58:18.134437+0000","last_clean":"2024-09-12T17:58:18.134437+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T17:58:18.134437+0000","last_undegraded":"2024-09-12T17:58:18.134437+0000","last_fullsized":"2024-09-12T17:58:18.134437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:28.012638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164999+0000","last_change":"2024-09-12T17:38:47.035193+0000","last_active":"2024-09-12T17:57:32.164999+0000","last_peered":"2024-09-12T17:57:32.164999+0000","last_clean":"2024-09-12T17:57:32.164999+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T17:57:32.164999+0000","last_undegraded":"2024-09-12T17:57:32.164999+0000","last_fullsized":"2024-09-12T17:57:32.164999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:54.991568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.129624+0000","last_change":"2024-09-12T17:38:43.993095+0000","last_active":"2024-09-12T17:57:32.129624+0000","last_peered":"2024-09-12T17:57:32.129624+0000","last_clean":"2024-09-12T17:57:32.129624+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T17:57:32.129624+0000","last_undegraded":"2024-09-12T17:57:32.129624+0000","last_fullsized":"2024-09-12T17:57:32.129624+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:07.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4118,"num_write":5,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.571968+0000","last_change":"2024-09-12T17:37:08.656010+0000","last_active":"2024-09-12T17:59:05.571968+0000","last_peered":"2024-09-12T17:59:05.571968+0000","last_clean":"2024-09-12T17:59:05.571968+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T17:59:05.571968+0000","last_undegraded":"2024-09-12T17:59:05.571968+0000","last_fullsized":"2024-09-12T17:59:05.571968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.346921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021616+0000","last_change":"2024-09-12T17:49:56.043230+0000","last_active":"2024-09-12T17:58:22.021616+0000","last_peered":"2024-09-12T17:58:22.021616+0000","last_clean":"2024-09-12T17:58:22.021616+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T17:58:22.021616+0000","last_undegraded":"2024-09-12T17:58:22.021616+0000","last_fullsized":"2024-09-12T17:58:22.021616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:33.627052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164967+0000","last_change":"2024-09-12T17:38:47.029841+0000","last_active":"2024-09-12T17:57:32.164967+0000","last_peered":"2024-09-12T17:57:32.164967+0000","last_clean":"2024-09-12T17:57:32.164967+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T17:57:32.164967+0000","last_undegraded":"2024-09-12T17:57:32.164967+0000","last_fullsized":"2024-09-12T17:57:32.164967+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:16.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.124927+0000","last_change":"2024-09-12T17:38:43.992352+0000","last_active":"2024-09-12T17:57:32.124927+0000","last_peered":"2024-09-12T17:57:32.124927+0000","last_clean":"2024-09-12T17:57:32.124927+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T17:57:32.124927+0000","last_undegraded":"2024-09-12T17:57:32.124927+0000","last_fullsized":"2024-09-12T17:57:32.124927+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:57.443048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.100022+0000","last_change":"2024-09-12T17:37:08.651452+0000","last_active":"2024-09-12T17:58:28.100022+0000","last_peered":"2024-09-12T17:58:28.100022+0000","last_clean":"2024-09-12T17:58:28.100022+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T17:58:28.100022+0000","last_undegraded":"2024-09-12T17:58:28.100022+0000","last_fullsized":"2024-09-12T17:58:28.100022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:02.681669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'268","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.286608+0000","last_change":"2024-09-12T17:21:50.778519+0000","last_active":"2024-09-12T17:59:12.286608+0000","last_peered":"2024-09-12T17:59:12.286608+0000","last_clean":"2024-09-12T17:59:12.286608+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T17:59:12.286608+0000","last_undegraded":"2024-09-12T17:59:12.286608+0000","last_fullsized":"2024-09-12T17:59:12.286608+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.146345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768658,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":415,"num_read_kb":38784,"num_write":991,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'477","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.761716+0000","last_change":"2024-09-12T17:21:52.747415+0000","last_active":"2024-09-12T17:59:34.761716+0000","last_peered":"2024-09-12T17:59:34.761716+0000","last_clean":"2024-09-12T17:59:34.761716+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T17:59:34.761716+0000","last_undegraded":"2024-09-12T17:59:34.761716+0000","last_fullsized":"2024-09-12T17:59:34.761716+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:53.654833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'327","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.023013+0000","last_change":"2024-09-12T17:21:50.769396+0000","last_active":"2024-09-12T18:01:03.023013+0000","last_peered":"2024-09-12T18:01:03.023013+0000","last_clean":"2024-09-12T18:01:03.023013+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:03.023013+0000","last_undegraded":"2024-09-12T18:01:03.023013+0000","last_fullsized":"2024-09-12T18:01:03.023013+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:43.716922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11211288,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":547,"num_read_kb":37148,"num_write":1276,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'544","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501861+0000","last_change":"2024-09-12T17:21:52.746868+0000","last_active":"2024-09-12T17:59:18.501861+0000","last_peered":"2024-09-12T17:59:18.501861+0000","last_clean":"2024-09-12T17:59:18.501861+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T17:59:18.501861+0000","last_undegraded":"2024-09-12T17:59:18.501861+0000","last_fullsized":"2024-09-12T17:59:18.501861+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:06.625492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'256","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.042023+0000","last_change":"2024-09-12T17:21:50.754884+0000","last_active":"2024-09-12T18:01:03.042023+0000","last_peered":"2024-09-12T18:01:03.042023+0000","last_clean":"2024-09-12T18:01:03.042023+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:03.042023+0000","last_undegraded":"2024-09-12T18:01:03.042023+0000","last_fullsized":"2024-09-12T18:01:03.042023+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:00.548422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629626,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":655,"num_read_kb":16802,"num_write":914,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'613","reported_seq":2373,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760782+0000","last_change":"2024-09-12T17:21:52.743802+0000","last_active":"2024-09-12T17:59:34.760782+0000","last_peered":"2024-09-12T17:59:34.760782+0000","last_clean":"2024-09-12T17:59:34.760782+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T17:59:34.760782+0000","last_undegraded":"2024-09-12T17:59:34.760782+0000","last_fullsized":"2024-09-12T17:59:34.760782+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:44.764410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'352","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.900897+0000","last_change":"2024-09-12T17:21:50.773572+0000","last_active":"2024-09-12T17:59:15.900897+0000","last_peered":"2024-09-12T17:59:15.900897+0000","last_clean":"2024-09-12T17:59:15.900897+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T17:59:15.900897+0000","last_undegraded":"2024-09-12T17:59:15.900897+0000","last_fullsized":"2024-09-12T17:59:15.900897+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:19.872303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3074358,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":516,"num_read_kb":16039,"num_write":1242,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952830+0000","last_change":"2024-09-12T17:21:52.744313+0000","last_active":"2024-09-12T17:59:16.952830+0000","last_peered":"2024-09-12T17:59:16.952830+0000","last_clean":"2024-09-12T17:59:16.952830+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T17:59:16.952830+0000","last_undegraded":"2024-09-12T17:59:16.952830+0000","last_fullsized":"2024-09-12T17:59:16.952830+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:36.240139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'222","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.631679+0000","last_change":"2024-09-12T17:21:50.775138+0000","last_active":"2024-09-12T17:59:10.631679+0000","last_peered":"2024-09-12T17:59:10.631679+0000","last_clean":"2024-09-12T17:59:10.631679+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T17:59:10.631679+0000","last_undegraded":"2024-09-12T17:59:10.631679+0000","last_fullsized":"2024-09-12T17:59:10.631679+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.644034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":324,"num_read_kb":5548,"num_write":827,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'843","reported_seq":2503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170215+0000","last_change":"2024-09-12T17:21:52.756513+0000","last_active":"2024-09-12T17:59:16.170215+0000","last_peered":"2024-09-12T17:59:16.170215+0000","last_clean":"2024-09-12T17:59:16.170215+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T17:59:16.170215+0000","last_undegraded":"2024-09-12T17:59:16.170215+0000","last_fullsized":"2024-09-12T17:59:16.170215+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:27.548029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'264","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.450979+0000","last_change":"2024-09-12T17:21:50.777104+0000","last_active":"2024-09-12T17:59:11.450979+0000","last_peered":"2024-09-12T17:59:11.450979+0000","last_clean":"2024-09-12T17:59:11.450979+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T17:59:11.450979+0000","last_undegraded":"2024-09-12T17:59:11.450979+0000","last_fullsized":"2024-09-12T17:59:11.450979+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:28.170918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3186360,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":457,"num_read_kb":30145,"num_write":1023,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'506","reported_seq":2100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002369+0000","last_change":"2024-09-12T17:21:52.754895+0000","last_active":"2024-09-12T18:00:55.002369+0000","last_peered":"2024-09-12T18:00:55.002369+0000","last_clean":"2024-09-12T18:00:55.002369+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:00:55.002369+0000","last_undegraded":"2024-09-12T18:00:55.002369+0000","last_fullsized":"2024-09-12T18:00:55.002369+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:11.896956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'300","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.442228+0000","last_change":"2024-09-12T17:21:50.774992+0000","last_active":"2024-09-12T17:59:15.442228+0000","last_peered":"2024-09-12T17:59:15.442228+0000","last_clean":"2024-09-12T17:59:15.442228+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T17:59:15.442228+0000","last_undegraded":"2024-09-12T17:59:15.442228+0000","last_fullsized":"2024-09-12T17:59:15.442228+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:13.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4147498,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":607,"num_read_kb":10444,"num_write":1069,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'744","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390042+0000","last_change":"2024-09-12T17:21:52.749164+0000","last_active":"2024-09-12T17:59:16.390042+0000","last_peered":"2024-09-12T17:59:16.390042+0000","last_clean":"2024-09-12T17:59:16.390042+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T17:59:16.390042+0000","last_undegraded":"2024-09-12T17:59:16.390042+0000","last_fullsized":"2024-09-12T17:59:16.390042+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:52.169981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'342","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.115367+0000","last_change":"2024-09-12T17:21:50.769398+0000","last_active":"2024-09-12T18:01:03.115367+0000","last_peered":"2024-09-12T18:01:03.115367+0000","last_clean":"2024-09-12T18:01:03.115367+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:03.115367+0000","last_undegraded":"2024-09-12T18:01:03.115367+0000","last_fullsized":"2024-09-12T18:01:03.115367+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:23.356425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4746346,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":506,"num_read_kb":69094,"num_write":1090,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1194","reported_seq":2914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.762595+0000","last_change":"2024-09-12T17:21:52.754000+0000","last_active":"2024-09-12T17:59:34.762595+0000","last_peered":"2024-09-12T17:59:34.762595+0000","last_clean":"2024-09-12T17:59:34.762595+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T17:59:34.762595+0000","last_undegraded":"2024-09-12T17:59:34.762595+0000","last_fullsized":"2024-09-12T17:59:34.762595+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.531613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'489","reported_seq":2037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.359232+0000","last_change":"2024-09-12T17:21:52.751378+0000","last_active":"2024-09-12T17:59:34.359232+0000","last_peered":"2024-09-12T17:59:34.359232+0000","last_clean":"2024-09-12T17:59:34.359232+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T17:59:34.359232+0000","last_undegraded":"2024-09-12T17:59:34.359232+0000","last_fullsized":"2024-09-12T17:59:34.359232+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:04.419740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'326","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:48.080974+0000","last_change":"2024-09-12T17:21:50.764045+0000","last_active":"2024-09-12T18:00:48.080974+0000","last_peered":"2024-09-12T18:00:48.080974+0000","last_clean":"2024-09-12T18:00:48.080974+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:00:48.080974+0000","last_undegraded":"2024-09-12T18:00:48.080974+0000","last_fullsized":"2024-09-12T18:00:48.080974+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:33.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4191997,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":553,"num_read_kb":53764,"num_write":1159,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'445","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.834035+0000","last_change":"2024-09-12T17:21:52.752185+0000","last_active":"2024-09-12T17:59:28.834035+0000","last_peered":"2024-09-12T17:59:28.834035+0000","last_clean":"2024-09-12T17:59:28.834035+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T17:59:28.834035+0000","last_undegraded":"2024-09-12T17:59:28.834035+0000","last_fullsized":"2024-09-12T17:59:28.834035+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:15.912648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'252","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.590358+0000","last_change":"2024-09-12T17:21:50.768025+0000","last_active":"2024-09-12T17:59:17.590358+0000","last_peered":"2024-09-12T17:59:17.590358+0000","last_clean":"2024-09-12T17:59:17.590358+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T17:59:17.590358+0000","last_undegraded":"2024-09-12T17:59:17.590358+0000","last_fullsized":"2024-09-12T17:59:17.590358+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:02.016388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11503118,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":403,"num_read_kb":34593,"num_write":987,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'465","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170603+0000","last_change":"2024-09-12T17:21:52.755703+0000","last_active":"2024-09-12T17:59:16.170603+0000","last_peered":"2024-09-12T17:59:16.170603+0000","last_clean":"2024-09-12T17:59:16.170603+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T17:59:16.170603+0000","last_undegraded":"2024-09-12T17:59:16.170603+0000","last_fullsized":"2024-09-12T17:59:16.170603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:42.867412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'272","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.240675+0000","last_change":"2024-09-12T17:21:50.770163+0000","last_active":"2024-09-12T17:59:16.240675+0000","last_peered":"2024-09-12T17:59:16.240675+0000","last_clean":"2024-09-12T17:59:16.240675+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T17:59:16.240675+0000","last_undegraded":"2024-09-12T17:59:16.240675+0000","last_fullsized":"2024-09-12T17:59:16.240675+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:41.245093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13973510,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":807,"num_read_kb":30506,"num_write":992,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'419","reported_seq":1998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521811+0000","last_change":"2024-09-12T17:21:52.757976+0000","last_active":"2024-09-12T17:59:17.521811+0000","last_peered":"2024-09-12T17:59:17.521811+0000","last_clean":"2024-09-12T17:59:17.521811+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T17:59:17.521811+0000","last_undegraded":"2024-09-12T17:59:17.521811+0000","last_fullsized":"2024-09-12T17:59:17.521811+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:40.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'353","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.043199+0000","last_change":"2024-09-12T17:21:50.770236+0000","last_active":"2024-09-12T17:59:10.043199+0000","last_peered":"2024-09-12T17:59:10.043199+0000","last_clean":"2024-09-12T17:59:10.043199+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T17:59:10.043199+0000","last_undegraded":"2024-09-12T17:59:10.043199+0000","last_fullsized":"2024-09-12T17:59:10.043199+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:22.133455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13731819,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":564,"num_read_kb":18097,"num_write":1236,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1543","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769737+0000","last_change":"2024-09-12T17:21:52.755355+0000","last_active":"2024-09-12T17:59:34.769737+0000","last_peered":"2024-09-12T17:59:34.769737+0000","last_clean":"2024-09-12T17:59:34.769737+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T17:59:34.769737+0000","last_undegraded":"2024-09-12T17:59:34.769737+0000","last_fullsized":"2024-09-12T17:59:34.769737+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.429894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'274","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.871076+0000","last_change":"2024-09-12T17:21:50.767696+0000","last_active":"2024-09-12T17:59:31.871076+0000","last_peered":"2024-09-12T17:59:31.871076+0000","last_clean":"2024-09-12T17:59:31.871076+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T17:59:31.871076+0000","last_undegraded":"2024-09-12T17:59:31.871076+0000","last_fullsized":"2024-09-12T17:59:31.871076+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:07.425923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9819806,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":423,"num_read_kb":18482,"num_write":978,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'787","reported_seq":2365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365184+0000","last_change":"2024-09-12T17:21:52.754058+0000","last_active":"2024-09-12T17:59:34.365184+0000","last_peered":"2024-09-12T17:59:34.365184+0000","last_clean":"2024-09-12T17:59:34.365184+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T17:59:34.365184+0000","last_undegraded":"2024-09-12T17:59:34.365184+0000","last_fullsized":"2024-09-12T17:59:34.365184+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:35.171675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'274","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.655009+0000","last_change":"2024-09-12T17:21:50.754844+0000","last_active":"2024-09-12T17:59:11.655009+0000","last_peered":"2024-09-12T17:59:11.655009+0000","last_clean":"2024-09-12T17:59:11.655009+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T17:59:11.655009+0000","last_undegraded":"2024-09-12T17:59:11.655009+0000","last_fullsized":"2024-09-12T17:59:11.655009+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:01.060374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6721451,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":362,"num_read_kb":4177,"num_write":907,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'172","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.828620+0000","last_change":"2024-09-12T17:22:00.797198+0000","last_active":"2024-09-12T17:59:34.828620+0000","last_peered":"2024-09-12T17:59:34.828620+0000","last_clean":"2024-09-12T17:59:34.828620+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T17:59:34.828620+0000","last_undegraded":"2024-09-12T17:59:34.828620+0000","last_fullsized":"2024-09-12T17:59:34.828620+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.624828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'441","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769810+0000","last_change":"2024-09-12T17:21:52.752268+0000","last_active":"2024-09-12T17:59:34.769810+0000","last_peered":"2024-09-12T17:59:34.769810+0000","last_clean":"2024-09-12T17:59:34.769810+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T17:59:34.769810+0000","last_undegraded":"2024-09-12T17:59:34.769810+0000","last_fullsized":"2024-09-12T17:59:34.769810+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:22.039178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'343","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:39.545004+0000","last_change":"2024-09-12T17:22:25.841354+0000","last_active":"2024-09-12T17:58:39.545004+0000","last_peered":"2024-09-12T17:58:39.545004+0000","last_clean":"2024-09-12T17:58:39.545004+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T17:58:39.545004+0000","last_undegraded":"2024-09-12T17:58:39.545004+0000","last_fullsized":"2024-09-12T17:58:39.545004+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:21.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21655202,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":908,"num_read_kb":57262,"num_write":1296,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020196+0000","last_change":"2024-09-12T17:21:54.756402+0000","last_active":"2024-09-12T17:58:12.020196+0000","last_peered":"2024-09-12T17:58:12.020196+0000","last_clean":"2024-09-12T17:58:12.020196+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T17:58:12.020196+0000","last_undegraded":"2024-09-12T17:58:12.020196+0000","last_fullsized":"2024-09-12T17:58:12.020196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'338","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.039892+0000","last_change":"2024-09-12T17:21:56.762895+0000","last_active":"2024-09-12T18:00:37.039892+0000","last_peered":"2024-09-12T18:00:37.039892+0000","last_clean":"2024-09-12T18:00:37.039892+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:00:37.039892+0000","last_undegraded":"2024-09-12T18:00:37.039892+0000","last_fullsized":"2024-09-12T18:00:37.039892+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:42.017239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":988,"num_write":422,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131391+0000","last_change":"2024-09-12T17:21:58.779492+0000","last_active":"2024-09-12T17:58:17.131391+0000","last_peered":"2024-09-12T17:58:17.131391+0000","last_clean":"2024-09-12T17:58:17.131391+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T17:58:17.131391+0000","last_undegraded":"2024-09-12T17:58:17.131391+0000","last_fullsized":"2024-09-12T17:58:17.131391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:41.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2432","reported_seq":4316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.251478+0000","last_change":"2024-09-12T17:22:00.789480+0000","last_active":"2024-09-12T17:59:33.251478+0000","last_peered":"2024-09-12T17:59:33.251478+0000","last_clean":"2024-09-12T17:59:33.251478+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T17:59:33.251478+0000","last_undegraded":"2024-09-12T17:59:33.251478+0000","last_fullsized":"2024-09-12T17:59:33.251478+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.233355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'790","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998878+0000","last_change":"2024-09-12T17:21:52.750476+0000","last_active":"2024-09-12T18:00:54.998878+0000","last_peered":"2024-09-12T18:00:54.998878+0000","last_clean":"2024-09-12T18:00:54.998878+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:00:54.998878+0000","last_undegraded":"2024-09-12T18:00:54.998878+0000","last_fullsized":"2024-09-12T18:00:54.998878+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:08.162006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'243","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.578837+0000","last_change":"2024-09-12T17:21:50.757901+0000","last_active":"2024-09-12T17:59:17.578837+0000","last_peered":"2024-09-12T17:59:17.578837+0000","last_clean":"2024-09-12T17:59:17.578837+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T17:59:17.578837+0000","last_undegraded":"2024-09-12T17:59:17.578837+0000","last_fullsized":"2024-09-12T17:59:17.578837+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.728223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8553618,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":293,"num_read_kb":2179,"num_write":802,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010650+0000","last_change":"2024-09-12T17:21:54.752252+0000","last_active":"2024-09-12T17:57:07.010650+0000","last_peered":"2024-09-12T17:57:07.010650+0000","last_clean":"2024-09-12T17:57:07.010650+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T17:57:07.010650+0000","last_undegraded":"2024-09-12T17:57:07.010650+0000","last_fullsized":"2024-09-12T17:57:07.010650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.652789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'92","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.607688+0000","last_change":"2024-09-12T17:21:56.763049+0000","last_active":"2024-09-12T17:59:04.607688+0000","last_peered":"2024-09-12T17:59:04.607688+0000","last_clean":"2024-09-12T17:59:04.607688+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T17:59:04.607688+0000","last_undegraded":"2024-09-12T17:59:04.607688+0000","last_fullsized":"2024-09-12T17:59:04.607688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:05.126795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131351+0000","last_change":"2024-09-12T17:21:58.781052+0000","last_active":"2024-09-12T17:58:17.131351+0000","last_peered":"2024-09-12T17:58:17.131351+0000","last_clean":"2024-09-12T17:58:17.131351+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T17:58:17.131351+0000","last_undegraded":"2024-09-12T17:58:17.131351+0000","last_fullsized":"2024-09-12T17:58:17.131351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:41.465265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.645798+0000","last_change":"2024-09-12T17:22:00.795013+0000","last_active":"2024-09-12T17:59:34.645798+0000","last_peered":"2024-09-12T17:59:34.645798+0000","last_clean":"2024-09-12T17:59:34.645798+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T17:59:34.645798+0000","last_undegraded":"2024-09-12T17:59:34.645798+0000","last_fullsized":"2024-09-12T17:59:34.645798+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:11.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1527","reported_seq":3096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129953+0000","last_change":"2024-09-12T17:21:52.757548+0000","last_active":"2024-09-12T17:59:18.129953+0000","last_peered":"2024-09-12T17:59:18.129953+0000","last_clean":"2024-09-12T17:59:18.129953+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T17:59:18.129953+0000","last_undegraded":"2024-09-12T17:59:18.129953+0000","last_fullsized":"2024-09-12T17:59:18.129953+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:17.307943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'280","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.045480+0000","last_change":"2024-09-12T17:21:50.763989+0000","last_active":"2024-09-12T17:59:07.045480+0000","last_peered":"2024-09-12T17:59:07.045480+0000","last_clean":"2024-09-12T17:59:07.045480+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T17:59:07.045480+0000","last_undegraded":"2024-09-12T17:59:07.045480+0000","last_fullsized":"2024-09-12T17:59:07.045480+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:25.544190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11311711,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":405,"num_read_kb":7817,"num_write":1031,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.021331+0000","last_change":"2024-09-12T17:21:54.750735+0000","last_active":"2024-09-12T17:58:12.021331+0000","last_peered":"2024-09-12T17:58:12.021331+0000","last_clean":"2024-09-12T17:58:12.021331+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T17:58:12.021331+0000","last_undegraded":"2024-09-12T17:58:12.021331+0000","last_fullsized":"2024-09-12T17:58:12.021331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.118206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'103","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.030304+0000","last_change":"2024-09-12T17:21:56.760401+0000","last_active":"2024-09-12T17:59:27.030304+0000","last_peered":"2024-09-12T17:59:27.030304+0000","last_clean":"2024-09-12T17:59:27.030304+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T17:59:27.030304+0000","last_undegraded":"2024-09-12T17:59:27.030304+0000","last_fullsized":"2024-09-12T17:59:27.030304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:57.514040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'784","reported_seq":2209,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.132145+0000","last_change":"2024-09-12T17:21:58.790046+0000","last_active":"2024-09-12T18:00:56.132145+0000","last_peered":"2024-09-12T18:00:56.132145+0000","last_clean":"2024-09-12T18:00:56.132145+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:00:56.132145+0000","last_undegraded":"2024-09-12T18:00:56.132145+0000","last_fullsized":"2024-09-12T18:00:56.132145+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:36.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'222","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.951156+0000","last_change":"2024-09-12T17:22:00.795256+0000","last_active":"2024-09-12T18:00:54.951156+0000","last_peered":"2024-09-12T18:00:54.951156+0000","last_clean":"2024-09-12T18:00:54.951156+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:00:54.951156+0000","last_undegraded":"2024-09-12T18:00:54.951156+0000","last_fullsized":"2024-09-12T18:00:54.951156+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:18.506943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'711","reported_seq":1965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.198269+0000","last_change":"2024-09-12T17:21:52.754960+0000","last_active":"2024-09-12T17:59:17.198269+0000","last_peered":"2024-09-12T17:59:17.198269+0000","last_clean":"2024-09-12T17:59:17.198269+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T17:59:17.198269+0000","last_undegraded":"2024-09-12T17:59:17.198269+0000","last_fullsized":"2024-09-12T17:59:17.198269+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":700,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:04.170159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'342","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.089766+0000","last_change":"2024-09-12T17:21:50.763211+0000","last_active":"2024-09-12T17:58:33.089766+0000","last_peered":"2024-09-12T17:58:33.089766+0000","last_clean":"2024-09-12T17:58:33.089766+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T17:58:33.089766+0000","last_undegraded":"2024-09-12T17:58:33.089766+0000","last_fullsized":"2024-09-12T17:58:33.089766+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:09.631310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7337834,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":686,"num_read_kb":18202,"num_write":1393,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020236+0000","last_change":"2024-09-12T17:21:54.755690+0000","last_active":"2024-09-12T17:58:12.020236+0000","last_peered":"2024-09-12T17:58:12.020236+0000","last_clean":"2024-09-12T17:58:12.020236+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T17:58:12.020236+0000","last_undegraded":"2024-09-12T17:58:12.020236+0000","last_fullsized":"2024-09-12T17:58:12.020236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.998087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'273","reported_seq":831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.188619+0000","last_change":"2024-09-12T17:21:56.765160+0000","last_active":"2024-09-12T18:00:37.188619+0000","last_peered":"2024-09-12T18:00:37.188619+0000","last_clean":"2024-09-12T18:00:37.188619+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:00:37.188619+0000","last_undegraded":"2024-09-12T18:00:37.188619+0000","last_fullsized":"2024-09-12T18:00:37.188619+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:14.179700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1004,"num_write":378,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'809","reported_seq":2312,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.905898+0000","last_change":"2024-09-12T17:21:58.787567+0000","last_active":"2024-09-12T18:01:02.905898+0000","last_peered":"2024-09-12T18:01:02.905898+0000","last_clean":"2024-09-12T18:01:02.905898+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:02.905898+0000","last_undegraded":"2024-09-12T18:01:02.905898+0000","last_fullsized":"2024-09-12T18:01:02.905898+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:46.462958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'420","reported_seq":1985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008093+0000","last_change":"2024-09-12T17:21:52.748275+0000","last_active":"2024-09-12T18:00:55.008093+0000","last_peered":"2024-09-12T18:00:55.008093+0000","last_clean":"2024-09-12T18:00:55.008093+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:00:55.008093+0000","last_undegraded":"2024-09-12T18:00:55.008093+0000","last_fullsized":"2024-09-12T18:00:55.008093+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:17.610168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'268","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.149058+0000","last_change":"2024-09-12T17:21:50.783712+0000","last_active":"2024-09-12T17:59:07.149058+0000","last_peered":"2024-09-12T17:59:07.149058+0000","last_clean":"2024-09-12T17:59:07.149058+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T17:59:07.149058+0000","last_undegraded":"2024-09-12T17:59:07.149058+0000","last_fullsized":"2024-09-12T17:59:07.149058+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.656882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6318991,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":377,"num_read_kb":9180,"num_write":967,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'5","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.847177+0000","last_change":"2024-09-12T17:21:54.753421+0000","last_active":"2024-09-12T18:00:55.847177+0000","last_peered":"2024-09-12T18:00:55.847177+0000","last_clean":"2024-09-12T18:00:55.847177+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:00:55.847177+0000","last_undegraded":"2024-09-12T18:00:55.847177+0000","last_fullsized":"2024-09-12T18:00:55.847177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:14.711780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'306","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.025191+0000","last_change":"2024-09-12T17:21:56.772550+0000","last_active":"2024-09-12T17:58:57.025191+0000","last_peered":"2024-09-12T17:58:57.025191+0000","last_clean":"2024-09-12T17:58:57.025191+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T17:58:57.025191+0000","last_undegraded":"2024-09-12T17:58:57.025191+0000","last_fullsized":"2024-09-12T17:58:57.025191+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.672167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56871,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":947,"num_write":400,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133829+0000","last_change":"2024-09-12T17:21:58.785030+0000","last_active":"2024-09-12T17:58:02.133829+0000","last_peered":"2024-09-12T17:58:02.133829+0000","last_clean":"2024-09-12T17:58:02.133829+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T17:58:02.133829+0000","last_undegraded":"2024-09-12T17:58:02.133829+0000","last_fullsized":"2024-09-12T17:58:02.133829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:09.008553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'541","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.118388+0000","last_change":"2024-09-12T17:22:00.792070+0000","last_active":"2024-09-12T18:00:56.118388+0000","last_peered":"2024-09-12T18:00:56.118388+0000","last_clean":"2024-09-12T18:00:56.118388+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:00:56.118388+0000","last_undegraded":"2024-09-12T18:00:56.118388+0000","last_fullsized":"2024-09-12T18:00:56.118388+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:34.644522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'852","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840428+0000","last_change":"2024-09-12T17:21:52.754955+0000","last_active":"2024-09-12T17:59:28.840428+0000","last_peered":"2024-09-12T17:59:28.840428+0000","last_clean":"2024-09-12T17:59:28.840428+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T17:59:28.840428+0000","last_undegraded":"2024-09-12T17:59:28.840428+0000","last_fullsized":"2024-09-12T17:59:28.840428+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:26.586616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'269","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.156948+0000","last_change":"2024-09-12T17:21:50.765891+0000","last_active":"2024-09-12T17:59:18.156948+0000","last_peered":"2024-09-12T17:59:18.156948+0000","last_clean":"2024-09-12T17:59:18.156948+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T17:59:18.156948+0000","last_undegraded":"2024-09-12T17:59:18.156948+0000","last_fullsized":"2024-09-12T17:59:18.156948+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.566299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8970216,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":443,"num_read_kb":25915,"num_write":1024,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.139539+0000","last_change":"2024-09-12T17:21:54.751975+0000","last_active":"2024-09-12T17:58:47.139539+0000","last_peered":"2024-09-12T17:58:47.139539+0000","last_clean":"2024-09-12T17:58:47.139539+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T17:58:47.139539+0000","last_undegraded":"2024-09-12T17:58:47.139539+0000","last_fullsized":"2024-09-12T17:58:47.139539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:39.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'269","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.036581+0000","last_change":"2024-09-12T17:21:56.763953+0000","last_active":"2024-09-12T18:00:12.036581+0000","last_peered":"2024-09-12T18:00:12.036581+0000","last_clean":"2024-09-12T18:00:12.036581+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:00:12.036581+0000","last_undegraded":"2024-09-12T18:00:12.036581+0000","last_fullsized":"2024-09-12T18:00:12.036581+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:57.115467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61195,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":959,"num_write":364,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:52.008193+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:56:52.008193+0000","last_peered":"2024-09-12T17:56:52.008193+0000","last_clean":"2024-09-12T17:56:52.008193+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T17:56:52.008193+0000","last_undegraded":"2024-09-12T17:56:52.008193+0000","last_fullsized":"2024-09-12T17:56:52.008193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'97","reported_seq":580,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.140607+0000","last_change":"2024-09-12T17:22:00.792783+0000","last_active":"2024-09-12T17:59:37.140607+0000","last_peered":"2024-09-12T17:59:37.140607+0000","last_clean":"2024-09-12T17:59:37.140607+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T17:59:37.140607+0000","last_undegraded":"2024-09-12T17:59:37.140607+0000","last_fullsized":"2024-09-12T17:59:37.140607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:57.921660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'380","reported_seq":1851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774821+0000","last_change":"2024-09-12T17:21:52.747363+0000","last_active":"2024-09-12T17:59:18.774821+0000","last_peered":"2024-09-12T17:59:18.774821+0000","last_clean":"2024-09-12T17:59:18.774821+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T17:59:18.774821+0000","last_undegraded":"2024-09-12T17:59:18.774821+0000","last_fullsized":"2024-09-12T17:59:18.774821+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:23.091871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'324","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.131723+0000","last_change":"2024-09-12T17:21:50.762942+0000","last_active":"2024-09-12T17:58:51.131723+0000","last_peered":"2024-09-12T17:58:51.131723+0000","last_clean":"2024-09-12T17:58:51.131723+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T17:58:51.131723+0000","last_undegraded":"2024-09-12T17:58:51.131723+0000","last_fullsized":"2024-09-12T17:58:51.131723+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:36.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4754569,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":687,"num_read_kb":11787,"num_write":1217,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'3","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.669612+0000","last_change":"2024-09-12T17:21:54.749892+0000","last_active":"2024-09-12T18:01:02.669612+0000","last_peered":"2024-09-12T18:01:02.669612+0000","last_clean":"2024-09-12T18:01:02.669612+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:02.669612+0000","last_undegraded":"2024-09-12T18:01:02.669612+0000","last_fullsized":"2024-09-12T18:01:02.669612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:07.627632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'237","reported_seq":810,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.106867+0000","last_change":"2024-09-12T17:21:56.767379+0000","last_active":"2024-09-12T18:00:56.106867+0000","last_peered":"2024-09-12T18:00:56.106867+0000","last_clean":"2024-09-12T18:00:56.106867+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:00:56.106867+0000","last_undegraded":"2024-09-12T18:00:56.106867+0000","last_fullsized":"2024-09-12T18:00:56.106867+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:36.431381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45021,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":757,"num_write":298,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'808","reported_seq":6237,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.907105+0000","last_change":"2024-09-12T17:21:58.786457+0000","last_active":"2024-09-12T18:01:02.907105+0000","last_peered":"2024-09-12T18:01:02.907105+0000","last_clean":"2024-09-12T18:01:02.907105+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:02.907105+0000","last_undegraded":"2024-09-12T18:01:02.907105+0000","last_fullsized":"2024-09-12T18:01:02.907105+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:35.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'97","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.003698+0000","last_change":"2024-09-12T17:22:00.795600+0000","last_active":"2024-09-12T18:00:55.003698+0000","last_peered":"2024-09-12T18:00:55.003698+0000","last_clean":"2024-09-12T18:00:55.003698+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:00:55.003698+0000","last_undegraded":"2024-09-12T18:00:55.003698+0000","last_fullsized":"2024-09-12T18:00:55.003698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:12.865071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'886","reported_seq":2499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012883+0000","last_change":"2024-09-12T17:21:52.754090+0000","last_active":"2024-09-12T17:59:19.012883+0000","last_peered":"2024-09-12T17:59:19.012883+0000","last_clean":"2024-09-12T17:59:19.012883+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T17:59:19.012883+0000","last_undegraded":"2024-09-12T17:59:19.012883+0000","last_fullsized":"2024-09-12T17:59:19.012883+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:08.146246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'268","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.579979+0000","last_change":"2024-09-12T17:21:50.781428+0000","last_active":"2024-09-12T17:59:07.579979+0000","last_peered":"2024-09-12T17:59:07.579979+0000","last_clean":"2024-09-12T17:59:07.579979+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T17:59:07.579979+0000","last_undegraded":"2024-09-12T17:59:07.579979+0000","last_fullsized":"2024-09-12T17:59:07.579979+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:03.976696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8396844,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":397,"num_read_kb":4507,"num_write":972,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.140189+0000","last_change":"2024-09-12T17:21:54.756631+0000","last_active":"2024-09-12T17:58:52.140189+0000","last_peered":"2024-09-12T17:58:52.140189+0000","last_clean":"2024-09-12T17:58:52.140189+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T17:58:52.140189+0000","last_undegraded":"2024-09-12T17:58:52.140189+0000","last_fullsized":"2024-09-12T17:58:52.140189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:30.950089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'449","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.109651+0000","last_change":"2024-09-12T17:21:56.761927+0000","last_active":"2024-09-12T18:00:56.109651+0000","last_peered":"2024-09-12T18:00:56.109651+0000","last_clean":"2024-09-12T18:00:56.109651+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:00:56.109651+0000","last_undegraded":"2024-09-12T18:00:56.109651+0000","last_fullsized":"2024-09-12T18:00:56.109651+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:22.363422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109212,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":798,"num_read_kb":1759,"num_write":668,"num_write_kb":582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138304+0000","last_change":"2024-09-12T17:21:58.789916+0000","last_active":"2024-09-12T17:58:48.138304+0000","last_peered":"2024-09-12T17:58:48.138304+0000","last_clean":"2024-09-12T17:58:48.138304+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T17:58:48.138304+0000","last_undegraded":"2024-09-12T17:58:48.138304+0000","last_fullsized":"2024-09-12T17:58:48.138304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'118","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.360795+0000","last_change":"2024-09-12T17:22:00.797337+0000","last_active":"2024-09-12T17:59:34.360795+0000","last_peered":"2024-09-12T17:59:34.360795+0000","last_clean":"2024-09-12T17:59:34.360795+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T17:59:34.360795+0000","last_undegraded":"2024-09-12T17:59:34.360795+0000","last_fullsized":"2024-09-12T17:59:34.360795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.474417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1094","reported_seq":2455,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.391930+0000","last_change":"2024-09-12T17:21:52.752079+0000","last_active":"2024-09-12T17:59:15.391930+0000","last_peered":"2024-09-12T17:59:15.391930+0000","last_clean":"2024-09-12T17:59:15.391930+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T17:59:15.391930+0000","last_undegraded":"2024-09-12T17:59:15.391930+0000","last_fullsized":"2024-09-12T17:59:15.391930+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1000,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.260009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'317","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.019873+0000","last_change":"2024-09-12T17:21:50.771854+0000","last_active":"2024-09-12T17:59:08.019873+0000","last_peered":"2024-09-12T17:59:08.019873+0000","last_clean":"2024-09-12T17:59:08.019873+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T17:59:08.019873+0000","last_undegraded":"2024-09-12T17:59:08.019873+0000","last_fullsized":"2024-09-12T17:59:08.019873+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:43.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5342730,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":456,"num_read_kb":4065,"num_write":1080,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137482+0000","last_change":"2024-09-12T17:21:54.754091+0000","last_active":"2024-09-12T17:57:55.137482+0000","last_peered":"2024-09-12T17:57:55.137482+0000","last_clean":"2024-09-12T17:57:55.137482+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T17:57:55.137482+0000","last_undegraded":"2024-09-12T17:57:55.137482+0000","last_fullsized":"2024-09-12T17:57:55.137482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:01.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'271","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.144859+0000","last_change":"2024-09-12T17:21:56.766601+0000","last_active":"2024-09-12T18:00:12.144859+0000","last_peered":"2024-09-12T18:00:12.144859+0000","last_clean":"2024-09-12T18:00:12.144859+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:00:12.144859+0000","last_undegraded":"2024-09-12T18:00:12.144859+0000","last_fullsized":"2024-09-12T18:00:12.144859+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:02.002328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57281,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":936,"num_write":424,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138983+0000","last_change":"2024-09-12T17:21:58.780947+0000","last_active":"2024-09-12T17:58:05.138983+0000","last_peered":"2024-09-12T17:58:05.138983+0000","last_clean":"2024-09-12T17:58:05.138983+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T17:58:05.138983+0000","last_undegraded":"2024-09-12T17:58:05.138983+0000","last_fullsized":"2024-09-12T17:58:05.138983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.674014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'125","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:45.147948+0000","last_change":"2024-09-12T17:22:00.794120+0000","last_active":"2024-09-12T18:00:45.147948+0000","last_peered":"2024-09-12T18:00:45.147948+0000","last_clean":"2024-09-12T18:00:45.147948+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:00:45.147948+0000","last_undegraded":"2024-09-12T18:00:45.147948+0000","last_fullsized":"2024-09-12T18:00:45.147948+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.905380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'852","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.130052+0000","last_change":"2024-09-12T17:21:52.744001+0000","last_active":"2024-09-12T17:59:18.130052+0000","last_peered":"2024-09-12T17:59:18.130052+0000","last_clean":"2024-09-12T17:59:18.130052+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T17:59:18.130052+0000","last_undegraded":"2024-09-12T17:59:18.130052+0000","last_fullsized":"2024-09-12T17:59:18.130052+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.116207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'236","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.324527+0000","last_change":"2024-09-12T17:21:50.763216+0000","last_active":"2024-09-12T17:59:18.324527+0000","last_peered":"2024-09-12T17:59:18.324527+0000","last_clean":"2024-09-12T17:59:18.324527+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T17:59:18.324527+0000","last_undegraded":"2024-09-12T17:59:18.324527+0000","last_fullsized":"2024-09-12T17:59:18.324527+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:33.880090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581454,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":379,"num_read_kb":12213,"num_write":903,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.131531+0000","last_change":"2024-09-12T17:21:54.753927+0000","last_active":"2024-09-12T17:57:58.131531+0000","last_peered":"2024-09-12T17:57:58.131531+0000","last_clean":"2024-09-12T17:57:58.131531+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T17:57:58.131531+0000","last_undegraded":"2024-09-12T17:57:58.131531+0000","last_fullsized":"2024-09-12T17:57:58.131531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:03.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'272","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.105905+0000","last_change":"2024-09-12T17:21:56.769847+0000","last_active":"2024-09-12T18:01:03.105905+0000","last_peered":"2024-09-12T18:01:03.105905+0000","last_clean":"2024-09-12T18:01:03.105905+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:03.105905+0000","last_undegraded":"2024-09-12T18:01:03.105905+0000","last_fullsized":"2024-09-12T18:01:03.105905+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:50.849719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53000,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":937,"num_write":357,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'767","reported_seq":2281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.133223+0000","last_change":"2024-09-12T17:21:58.787962+0000","last_active":"2024-09-12T18:00:56.133223+0000","last_peered":"2024-09-12T18:00:56.133223+0000","last_clean":"2024-09-12T18:00:56.133223+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:00:56.133223+0000","last_undegraded":"2024-09-12T18:00:56.133223+0000","last_fullsized":"2024-09-12T18:00:56.133223+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.107541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'91","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.238731+0000","last_change":"2024-09-12T17:22:00.788149+0000","last_active":"2024-09-12T17:59:08.238731+0000","last_peered":"2024-09-12T17:59:08.238731+0000","last_clean":"2024-09-12T17:59:08.238731+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T17:59:08.238731+0000","last_undegraded":"2024-09-12T17:59:08.238731+0000","last_fullsized":"2024-09-12T17:59:08.238731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:52.865371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'393","reported_seq":1796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618253+0000","last_change":"2024-09-12T17:21:52.746636+0000","last_active":"2024-09-12T17:59:16.618253+0000","last_peered":"2024-09-12T17:59:16.618253+0000","last_clean":"2024-09-12T17:59:16.618253+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T17:59:16.618253+0000","last_undegraded":"2024-09-12T17:59:16.618253+0000","last_fullsized":"2024-09-12T17:59:16.618253+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:16.893041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'254","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.691518+0000","last_change":"2024-09-12T17:21:50.764044+0000","last_active":"2024-09-12T17:59:10.691518+0000","last_peered":"2024-09-12T17:59:10.691518+0000","last_clean":"2024-09-12T17:59:10.691518+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T17:59:10.691518+0000","last_undegraded":"2024-09-12T17:59:10.691518+0000","last_fullsized":"2024-09-12T17:59:10.691518+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:30.691491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4566413,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":398,"num_read_kb":2736,"num_write":978,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.846903+0000","last_change":"2024-09-12T17:21:54.752963+0000","last_active":"2024-09-12T18:00:55.846903+0000","last_peered":"2024-09-12T18:00:55.846903+0000","last_clean":"2024-09-12T18:00:55.846903+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:00:55.846903+0000","last_undegraded":"2024-09-12T18:00:55.846903+0000","last_fullsized":"2024-09-12T18:00:55.846903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:56.647371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'76","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.935202+0000","last_change":"2024-09-12T17:21:56.766705+0000","last_active":"2024-09-12T17:59:07.935202+0000","last_peered":"2024-09-12T17:59:07.935202+0000","last_clean":"2024-09-12T17:59:07.935202+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T17:59:07.935202+0000","last_undegraded":"2024-09-12T17:59:07.935202+0000","last_fullsized":"2024-09-12T17:59:07.935202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.416717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'802","reported_seq":2225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.134327+0000","last_change":"2024-09-12T17:21:58.775054+0000","last_active":"2024-09-12T18:00:56.134327+0000","last_peered":"2024-09-12T18:00:56.134327+0000","last_clean":"2024-09-12T18:00:56.134327+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:00:56.134327+0000","last_undegraded":"2024-09-12T18:00:56.134327+0000","last_fullsized":"2024-09-12T18:00:56.134327+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:40.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'123","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.753528+0000","last_change":"2024-09-12T17:22:00.796406+0000","last_active":"2024-09-12T17:59:06.753528+0000","last_peered":"2024-09-12T17:59:06.753528+0000","last_clean":"2024-09-12T17:59:06.753528+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T17:59:06.753528+0000","last_undegraded":"2024-09-12T17:59:06.753528+0000","last_fullsized":"2024-09-12T17:59:06.753528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:55.110524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'767","reported_seq":2391,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501638+0000","last_change":"2024-09-12T17:21:52.753271+0000","last_active":"2024-09-12T17:59:18.501638+0000","last_peered":"2024-09-12T17:59:18.501638+0000","last_clean":"2024-09-12T17:59:18.501638+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T17:59:18.501638+0000","last_undegraded":"2024-09-12T17:59:18.501638+0000","last_fullsized":"2024-09-12T17:59:18.501638+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:40.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'230","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.091939+0000","last_change":"2024-09-12T17:21:50.759354+0000","last_active":"2024-09-12T17:59:09.091939+0000","last_peered":"2024-09-12T17:59:09.091939+0000","last_clean":"2024-09-12T17:59:09.091939+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T17:59:09.091939+0000","last_undegraded":"2024-09-12T17:59:09.091939+0000","last_fullsized":"2024-09-12T17:59:09.091939+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:28.652326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40468,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":648,"num_read_kb":10056,"num_write":808,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:57.017784+0000","last_change":"2024-09-12T17:21:54.755944+0000","last_active":"2024-09-12T17:57:57.017784+0000","last_peered":"2024-09-12T17:57:57.017784+0000","last_clean":"2024-09-12T17:57:57.017784+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T17:57:57.017784+0000","last_undegraded":"2024-09-12T17:57:57.017784+0000","last_fullsized":"2024-09-12T17:57:57.017784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:30.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'314","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.144814+0000","last_change":"2024-09-12T17:21:56.769845+0000","last_active":"2024-09-12T18:00:12.144814+0000","last_peered":"2024-09-12T18:00:12.144814+0000","last_clean":"2024-09-12T18:00:12.144814+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:00:12.144814+0000","last_undegraded":"2024-09-12T18:00:12.144814+0000","last_fullsized":"2024-09-12T18:00:12.144814+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.744587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52527,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1087,"num_read_kb":1540,"num_write":1574,"num_write_kb":1456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.169136+0000","last_change":"2024-09-12T17:21:58.783566+0000","last_active":"2024-09-12T17:58:02.169136+0000","last_peered":"2024-09-12T17:58:02.169136+0000","last_clean":"2024-09-12T17:58:02.169136+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T17:58:02.169136+0000","last_undegraded":"2024-09-12T17:58:02.169136+0000","last_fullsized":"2024-09-12T17:58:02.169136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:16.155795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'100","reported_seq":584,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.982177+0000","last_change":"2024-09-12T17:22:00.795820+0000","last_active":"2024-09-12T17:59:06.982177+0000","last_peered":"2024-09-12T17:59:06.982177+0000","last_clean":"2024-09-12T17:59:06.982177+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T17:59:06.982177+0000","last_undegraded":"2024-09-12T17:59:06.982177+0000","last_fullsized":"2024-09-12T17:59:06.982177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:47.982837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'458","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.171017+0000","last_change":"2024-09-12T17:21:52.747649+0000","last_active":"2024-09-12T17:59:16.171017+0000","last_peered":"2024-09-12T17:59:16.171017+0000","last_clean":"2024-09-12T17:59:16.171017+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T17:59:16.171017+0000","last_undegraded":"2024-09-12T17:59:16.171017+0000","last_fullsized":"2024-09-12T17:59:16.171017+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:32.995329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:42.126398+0000","last_change":"2024-09-12T17:21:34.165528+0000","last_active":"2024-09-12T17:57:42.126398+0000","last_peered":"2024-09-12T17:57:42.126398+0000","last_clean":"2024-09-12T17:57:42.126398+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T17:57:42.126398+0000","last_undegraded":"2024-09-12T17:57:42.126398+0000","last_fullsized":"2024-09-12T17:57:42.126398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_clean_scrub_stamp":"2024-09-12T17:21:32.756341+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:27.504316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010866+0000","last_change":"2024-09-12T17:21:41.866930+0000","last_active":"2024-09-12T17:57:07.010866+0000","last_peered":"2024-09-12T17:57:07.010866+0000","last_clean":"2024-09-12T17:57:07.010866+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T17:57:07.010866+0000","last_undegraded":"2024-09-12T17:57:07.010866+0000","last_fullsized":"2024-09-12T17:57:07.010866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:40.562409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'291","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.982742+0000","last_change":"2024-09-12T17:21:50.760757+0000","last_active":"2024-09-12T17:59:14.982742+0000","last_peered":"2024-09-12T17:59:14.982742+0000","last_clean":"2024-09-12T17:59:14.982742+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T17:59:14.982742+0000","last_undegraded":"2024-09-12T17:59:14.982742+0000","last_fullsized":"2024-09-12T17:59:14.982742+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:52.679675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357547,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":570,"num_read_kb":42378,"num_write":1108,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012494+0000","last_change":"2024-09-12T17:21:54.750180+0000","last_active":"2024-09-12T17:57:22.012494+0000","last_peered":"2024-09-12T17:57:22.012494+0000","last_clean":"2024-09-12T17:57:22.012494+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T17:57:22.012494+0000","last_undegraded":"2024-09-12T17:57:22.012494+0000","last_fullsized":"2024-09-12T17:57:22.012494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:24.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'722","reported_seq":1406,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.114358+0000","last_change":"2024-09-12T17:21:56.765494+0000","last_active":"2024-09-12T18:00:56.114358+0000","last_peered":"2024-09-12T18:00:56.114358+0000","last_clean":"2024-09-12T18:00:56.114358+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:00:56.114358+0000","last_undegraded":"2024-09-12T18:00:56.114358+0000","last_fullsized":"2024-09-12T18:00:56.114358+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:08.857619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201009,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1413,"num_read_kb":2992,"num_write":1362,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138445+0000","last_change":"2024-09-12T17:21:58.788291+0000","last_active":"2024-09-12T17:58:48.138445+0000","last_peered":"2024-09-12T17:58:48.138445+0000","last_clean":"2024-09-12T17:58:48.138445+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T17:58:48.138445+0000","last_undegraded":"2024-09-12T17:58:48.138445+0000","last_fullsized":"2024-09-12T17:58:48.138445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:07.437948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'195","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.775559+0000","last_change":"2024-09-12T17:22:00.796574+0000","last_active":"2024-09-12T17:59:34.775559+0000","last_peered":"2024-09-12T17:59:34.775559+0000","last_clean":"2024-09-12T17:59:34.775559+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T17:59:34.775559+0000","last_undegraded":"2024-09-12T17:59:34.775559+0000","last_fullsized":"2024-09-12T17:59:34.775559+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.468190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'468","reported_seq":1992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774603+0000","last_change":"2024-09-12T17:21:52.757096+0000","last_active":"2024-09-12T17:59:18.774603+0000","last_peered":"2024-09-12T17:59:18.774603+0000","last_clean":"2024-09-12T17:59:18.774603+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T17:59:18.774603+0000","last_undegraded":"2024-09-12T17:59:18.774603+0000","last_fullsized":"2024-09-12T17:59:18.774603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.000502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:47.016306+0000","last_change":"2024-09-12T17:21:41.866473+0000","last_active":"2024-09-12T17:57:47.016306+0000","last_peered":"2024-09-12T17:57:47.016306+0000","last_clean":"2024-09-12T17:57:47.016306+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T17:57:47.016306+0000","last_undegraded":"2024-09-12T17:57:47.016306+0000","last_fullsized":"2024-09-12T17:57:47.016306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:12.213846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'330","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.867648+0000","last_change":"2024-09-12T17:21:50.757872+0000","last_active":"2024-09-12T17:59:11.867648+0000","last_peered":"2024-09-12T17:59:11.867648+0000","last_clean":"2024-09-12T17:59:11.867648+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T17:59:11.867648+0000","last_undegraded":"2024-09-12T17:59:11.867648+0000","last_fullsized":"2024-09-12T17:59:11.867648+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:09.535999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10884887,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":556,"num_read_kb":13401,"num_write":1298,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.024531+0000","last_change":"2024-09-12T17:21:54.755790+0000","last_active":"2024-09-12T17:58:47.024531+0000","last_peered":"2024-09-12T17:58:47.024531+0000","last_clean":"2024-09-12T17:58:47.024531+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T17:58:47.024531+0000","last_undegraded":"2024-09-12T17:58:47.024531+0000","last_fullsized":"2024-09-12T17:58:47.024531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:59.470297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1231","reported_seq":2612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.128703+0000","last_change":"2024-09-12T17:21:56.768252+0000","last_active":"2024-09-12T18:00:56.128703+0000","last_peered":"2024-09-12T18:00:56.128703+0000","last_clean":"2024-09-12T18:00:56.128703+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:00:56.128703+0000","last_undegraded":"2024-09-12T18:00:56.128703+0000","last_fullsized":"2024-09-12T18:00:56.128703+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":1200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:01.013352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189156,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1940,"num_read_kb":3413,"num_write":1060,"num_write_kb":937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014403+0000","last_change":"2024-09-12T17:21:58.790253+0000","last_active":"2024-09-12T17:57:32.014403+0000","last_peered":"2024-09-12T17:57:32.014403+0000","last_clean":"2024-09-12T17:57:32.014403+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T17:57:32.014403+0000","last_undegraded":"2024-09-12T17:57:32.014403+0000","last_fullsized":"2024-09-12T17:57:32.014403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:47.790212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'133","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.894435+0000","last_change":"2024-09-12T17:22:00.798051+0000","last_active":"2024-09-12T17:59:12.894435+0000","last_peered":"2024-09-12T17:59:12.894435+0000","last_clean":"2024-09-12T17:59:12.894435+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T17:59:12.894435+0000","last_undegraded":"2024-09-12T17:59:12.894435+0000","last_fullsized":"2024-09-12T17:59:12.894435+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:21.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'449","reported_seq":1957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365791+0000","last_change":"2024-09-12T17:21:52.754734+0000","last_active":"2024-09-12T17:59:34.365791+0000","last_peered":"2024-09-12T17:59:34.365791+0000","last_clean":"2024-09-12T17:59:34.365791+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T17:59:34.365791+0000","last_undegraded":"2024-09-12T17:59:34.365791+0000","last_fullsized":"2024-09-12T17:59:34.365791+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:38.929430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:05.130098+0000","last_change":"2024-09-12T17:21:42.043085+0000","last_active":"2024-09-12T17:57:05.130098+0000","last_peered":"2024-09-12T17:57:05.130098+0000","last_clean":"2024-09-12T17:57:05.130098+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T17:57:05.130098+0000","last_undegraded":"2024-09-12T17:57:05.130098+0000","last_fullsized":"2024-09-12T17:57:05.130098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:25.499579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'307","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.079873+0000","last_change":"2024-09-12T17:21:50.744141+0000","last_active":"2024-09-12T18:01:03.079873+0000","last_peered":"2024-09-12T18:01:03.079873+0000","last_clean":"2024-09-12T18:01:03.079873+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:03.079873+0000","last_undegraded":"2024-09-12T18:01:03.079873+0000","last_fullsized":"2024-09-12T18:01:03.079873+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:16.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8349148,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":490,"num_read_kb":34998,"num_write":1087,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144229+0000","last_change":"2024-09-12T17:21:54.756222+0000","last_active":"2024-09-12T17:58:45.144229+0000","last_peered":"2024-09-12T17:58:45.144229+0000","last_clean":"2024-09-12T17:58:45.144229+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T17:58:45.144229+0000","last_undegraded":"2024-09-12T17:58:45.144229+0000","last_fullsized":"2024-09-12T17:58:45.144229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.426990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'196","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.143046+0000","last_change":"2024-09-12T17:21:56.768882+0000","last_active":"2024-09-12T18:00:54.143046+0000","last_peered":"2024-09-12T18:00:54.143046+0000","last_clean":"2024-09-12T18:00:54.143046+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:00:54.143046+0000","last_undegraded":"2024-09-12T18:00:54.143046+0000","last_fullsized":"2024-09-12T18:00:54.143046+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:28.839162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013880+0000","last_change":"2024-09-12T17:21:58.787288+0000","last_active":"2024-09-12T17:57:27.013880+0000","last_peered":"2024-09-12T17:57:27.013880+0000","last_clean":"2024-09-12T17:57:27.013880+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T17:57:27.013880+0000","last_undegraded":"2024-09-12T17:57:27.013880+0000","last_fullsized":"2024-09-12T17:57:27.013880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.278913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'288","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.917584+0000","last_change":"2024-09-12T17:22:00.794526+0000","last_active":"2024-09-12T17:59:34.917584+0000","last_peered":"2024-09-12T17:59:34.917584+0000","last_clean":"2024-09-12T17:59:34.917584+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T17:59:34.917584+0000","last_undegraded":"2024-09-12T17:59:34.917584+0000","last_fullsized":"2024-09-12T17:59:34.917584+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:11.669153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'466","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008227+0000","last_change":"2024-09-12T17:21:52.750831+0000","last_active":"2024-09-12T18:00:55.008227+0000","last_peered":"2024-09-12T18:00:55.008227+0000","last_clean":"2024-09-12T18:00:55.008227+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:00:55.008227+0000","last_undegraded":"2024-09-12T18:00:55.008227+0000","last_fullsized":"2024-09-12T18:00:55.008227+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:37.661922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010821+0000","last_change":"2024-09-12T17:21:41.867476+0000","last_active":"2024-09-12T17:57:07.010821+0000","last_peered":"2024-09-12T17:57:07.010821+0000","last_clean":"2024-09-12T17:57:07.010821+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T17:57:07.010821+0000","last_undegraded":"2024-09-12T17:57:07.010821+0000","last_fullsized":"2024-09-12T17:57:07.010821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:11.414546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'342","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.922185+0000","last_change":"2024-09-12T17:21:50.774438+0000","last_active":"2024-09-12T17:59:06.922185+0000","last_peered":"2024-09-12T17:59:06.922185+0000","last_clean":"2024-09-12T17:59:06.922185+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T17:59:06.922185+0000","last_undegraded":"2024-09-12T17:59:06.922185+0000","last_fullsized":"2024-09-12T17:59:06.922185+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.163145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9638691,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":550,"num_read_kb":11799,"num_write":1294,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133267+0000","last_change":"2024-09-12T17:21:54.752679+0000","last_active":"2024-09-12T17:57:25.133267+0000","last_peered":"2024-09-12T17:57:25.133267+0000","last_clean":"2024-09-12T17:57:25.133267+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T17:57:25.133267+0000","last_undegraded":"2024-09-12T17:57:25.133267+0000","last_fullsized":"2024-09-12T17:57:25.133267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:38.750473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'103","reported_seq":628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.240568+0000","last_change":"2024-09-12T17:21:56.763840+0000","last_active":"2024-09-12T18:00:56.240568+0000","last_peered":"2024-09-12T18:00:56.240568+0000","last_clean":"2024-09-12T18:00:56.240568+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:00:56.240568+0000","last_undegraded":"2024-09-12T18:00:56.240568+0000","last_fullsized":"2024-09-12T18:00:56.240568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:23.362341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025180+0000","last_change":"2024-09-12T17:21:58.789360+0000","last_active":"2024-09-12T17:58:52.025180+0000","last_peered":"2024-09-12T17:58:52.025180+0000","last_clean":"2024-09-12T17:58:52.025180+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T17:58:52.025180+0000","last_undegraded":"2024-09-12T17:58:52.025180+0000","last_fullsized":"2024-09-12T17:58:52.025180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:51.063573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'141","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.497508+0000","last_change":"2024-09-12T17:22:00.788204+0000","last_active":"2024-09-12T17:59:06.497508+0000","last_peered":"2024-09-12T17:59:06.497508+0000","last_clean":"2024-09-12T17:59:06.497508+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T17:59:06.497508+0000","last_undegraded":"2024-09-12T17:59:06.497508+0000","last_fullsized":"2024-09-12T17:59:06.497508+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:34.479482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'875","reported_seq":2704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521421+0000","last_change":"2024-09-12T17:21:52.747529+0000","last_active":"2024-09-12T17:59:17.521421+0000","last_peered":"2024-09-12T17:59:17.521421+0000","last_clean":"2024-09-12T17:59:17.521421+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T17:59:17.521421+0000","last_undegraded":"2024-09-12T17:59:17.521421+0000","last_fullsized":"2024-09-12T17:59:17.521421+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:25.413581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'314","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.008318+0000","last_change":"2024-09-12T17:21:50.763853+0000","last_active":"2024-09-12T17:58:51.008318+0000","last_peered":"2024-09-12T17:58:51.008318+0000","last_clean":"2024-09-12T17:58:51.008318+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T17:58:51.008318+0000","last_undegraded":"2024-09-12T17:58:51.008318+0000","last_fullsized":"2024-09-12T17:58:51.008318+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:50.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12929870,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":536,"num_read_kb":25520,"num_write":1185,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:08.123646+0000","last_change":"2024-09-12T17:21:42.043334+0000","last_active":"2024-09-12T17:57:08.123646+0000","last_peered":"2024-09-12T17:57:08.123646+0000","last_clean":"2024-09-12T17:57:08.123646+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T17:57:08.123646+0000","last_undegraded":"2024-09-12T17:57:08.123646+0000","last_fullsized":"2024-09-12T17:57:08.123646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:38.050118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.013014+0000","last_change":"2024-09-12T17:21:54.755491+0000","last_active":"2024-09-12T17:57:22.013014+0000","last_peered":"2024-09-12T17:57:22.013014+0000","last_clean":"2024-09-12T17:57:22.013014+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T17:57:22.013014+0000","last_undegraded":"2024-09-12T17:57:22.013014+0000","last_fullsized":"2024-09-12T17:57:22.013014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:39.242340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'533","reported_seq":1173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.094727+0000","last_change":"2024-09-12T17:21:56.763880+0000","last_active":"2024-09-12T18:00:56.094727+0000","last_peered":"2024-09-12T18:00:56.094727+0000","last_clean":"2024-09-12T18:00:56.094727+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:00:56.094727+0000","last_undegraded":"2024-09-12T18:00:56.094727+0000","last_fullsized":"2024-09-12T18:00:56.094727+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:59.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131153,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":1991,"num_write":782,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164192+0000","last_change":"2024-09-12T17:21:58.786573+0000","last_active":"2024-09-12T17:57:27.164192+0000","last_peered":"2024-09-12T17:57:27.164192+0000","last_clean":"2024-09-12T17:57:27.164192+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T17:57:27.164192+0000","last_undegraded":"2024-09-12T17:57:27.164192+0000","last_fullsized":"2024-09-12T17:57:27.164192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:30.677838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'166","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.362537+0000","last_change":"2024-09-12T17:22:00.798528+0000","last_active":"2024-09-12T17:59:34.362537+0000","last_peered":"2024-09-12T17:59:34.362537+0000","last_clean":"2024-09-12T17:59:34.362537+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T17:59:34.362537+0000","last_undegraded":"2024-09-12T17:59:34.362537+0000","last_fullsized":"2024-09-12T17:59:34.362537+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:54.854895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'825","reported_seq":2342,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.763003+0000","last_change":"2024-09-12T17:21:52.754209+0000","last_active":"2024-09-12T17:59:34.763003+0000","last_peered":"2024-09-12T17:59:34.763003+0000","last_clean":"2024-09-12T17:59:34.763003+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T17:59:34.763003+0000","last_undegraded":"2024-09-12T17:59:34.763003+0000","last_fullsized":"2024-09-12T17:59:34.763003+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:34.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'318","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.766376+0000","last_change":"2024-09-12T17:21:50.763342+0000","last_active":"2024-09-12T17:59:16.766376+0000","last_peered":"2024-09-12T17:59:16.766376+0000","last_clean":"2024-09-12T17:59:16.766376+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T17:59:16.766376+0000","last_undegraded":"2024-09-12T17:59:16.766376+0000","last_fullsized":"2024-09-12T17:59:16.766376+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:44.497032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2859250,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":521,"num_read_kb":7304,"num_write":1185,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.011523+0000","last_change":"2024-09-12T17:21:41.866466+0000","last_active":"2024-09-12T17:57:12.011523+0000","last_peered":"2024-09-12T17:57:12.011523+0000","last_clean":"2024-09-12T17:57:12.011523+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T17:57:12.011523+0000","last_undegraded":"2024-09-12T17:57:12.011523+0000","last_fullsized":"2024-09-12T17:57:12.011523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:41.352304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012430+0000","last_change":"2024-09-12T17:21:54.751823+0000","last_active":"2024-09-12T17:57:22.012430+0000","last_peered":"2024-09-12T17:57:22.012430+0000","last_clean":"2024-09-12T17:57:22.012430+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T17:57:22.012430+0000","last_undegraded":"2024-09-12T17:57:22.012430+0000","last_fullsized":"2024-09-12T17:57:22.012430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:45.553180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'154","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144606+0000","last_change":"2024-09-12T17:21:56.762425+0000","last_active":"2024-09-12T17:59:27.144606+0000","last_peered":"2024-09-12T17:59:27.144606+0000","last_clean":"2024-09-12T17:59:27.144606+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T17:59:27.144606+0000","last_undegraded":"2024-09-12T17:59:27.144606+0000","last_fullsized":"2024-09-12T17:59:27.144606+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:35.405866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'802","reported_seq":2565,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.130961+0000","last_change":"2024-09-12T17:21:58.782857+0000","last_active":"2024-09-12T18:00:56.130961+0000","last_peered":"2024-09-12T18:00:56.130961+0000","last_clean":"2024-09-12T18:00:56.130961+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:00:56.130961+0000","last_undegraded":"2024-09-12T18:00:56.130961+0000","last_fullsized":"2024-09-12T18:00:56.130961+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:02.049669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'109","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:20.158995+0000","last_change":"2024-09-12T17:22:00.794639+0000","last_active":"2024-09-12T18:00:20.158995+0000","last_peered":"2024-09-12T18:00:20.158995+0000","last_clean":"2024-09-12T18:00:20.158995+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:00:20.158995+0000","last_undegraded":"2024-09-12T18:00:20.158995+0000","last_fullsized":"2024-09-12T18:00:20.158995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:42.302531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'871","reported_seq":2582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.800538+0000","last_change":"2024-09-12T17:21:52.745987+0000","last_active":"2024-09-12T17:59:17.800538+0000","last_peered":"2024-09-12T17:59:17.800538+0000","last_clean":"2024-09-12T17:59:17.800538+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T17:59:17.800538+0000","last_undegraded":"2024-09-12T17:59:17.800538+0000","last_fullsized":"2024-09-12T17:59:17.800538+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:35.780719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'301","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.845137+0000","last_change":"2024-09-12T17:21:50.756194+0000","last_active":"2024-09-12T17:59:18.845137+0000","last_peered":"2024-09-12T17:59:18.845137+0000","last_clean":"2024-09-12T17:59:18.845137+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T17:59:18.845137+0000","last_undegraded":"2024-09-12T17:59:18.845137+0000","last_fullsized":"2024-09-12T17:59:18.845137+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:46.420332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6674336,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":464,"num_read_kb":10322,"num_write":1115,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.023460+0000","last_change":"2024-09-12T17:21:41.865878+0000","last_active":"2024-09-12T17:58:32.023460+0000","last_peered":"2024-09-12T17:58:32.023460+0000","last_clean":"2024-09-12T17:58:32.023460+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T17:58:32.023460+0000","last_undegraded":"2024-09-12T17:58:32.023460+0000","last_fullsized":"2024-09-12T17:58:32.023460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.625705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012930+0000","last_change":"2024-09-12T17:21:54.758563+0000","last_active":"2024-09-12T17:57:22.012930+0000","last_peered":"2024-09-12T17:57:22.012930+0000","last_clean":"2024-09-12T17:57:22.012930+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T17:57:22.012930+0000","last_undegraded":"2024-09-12T17:57:22.012930+0000","last_fullsized":"2024-09-12T17:57:22.012930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:07.608583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'96","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.275920+0000","last_change":"2024-09-12T17:21:56.765131+0000","last_active":"2024-09-12T17:59:06.275920+0000","last_peered":"2024-09-12T17:59:06.275920+0000","last_clean":"2024-09-12T17:59:06.275920+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T17:59:06.275920+0000","last_undegraded":"2024-09-12T17:59:06.275920+0000","last_fullsized":"2024-09-12T17:59:06.275920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:57.138933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'808","reported_seq":2355,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.904669+0000","last_change":"2024-09-12T17:21:58.785486+0000","last_active":"2024-09-12T18:01:02.904669+0000","last_peered":"2024-09-12T18:01:02.904669+0000","last_clean":"2024-09-12T18:01:02.904669+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:02.904669+0000","last_undegraded":"2024-09-12T18:01:02.904669+0000","last_fullsized":"2024-09-12T18:01:02.904669+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:06.317754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'325","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.374584+0000","last_change":"2024-09-12T17:22:00.794801+0000","last_active":"2024-09-12T17:59:34.374584+0000","last_peered":"2024-09-12T17:59:34.374584+0000","last_clean":"2024-09-12T17:59:34.374584+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T17:59:34.374584+0000","last_undegraded":"2024-09-12T17:59:34.374584+0000","last_fullsized":"2024-09-12T17:59:34.374584+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:20.169521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'491","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501739+0000","last_change":"2024-09-12T17:21:52.740621+0000","last_active":"2024-09-12T17:59:18.501739+0000","last_peered":"2024-09-12T17:59:18.501739+0000","last_clean":"2024-09-12T17:59:18.501739+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T17:59:18.501739+0000","last_undegraded":"2024-09-12T17:59:18.501739+0000","last_fullsized":"2024-09-12T17:59:18.501739+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:50.850961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'266","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.861386+0000","last_change":"2024-09-12T17:21:50.759984+0000","last_active":"2024-09-12T17:59:31.861386+0000","last_peered":"2024-09-12T17:59:31.861386+0000","last_clean":"2024-09-12T17:59:31.861386+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T17:59:31.861386+0000","last_undegraded":"2024-09-12T17:59:31.861386+0000","last_fullsized":"2024-09-12T17:59:31.861386+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.213987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4518961,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":476,"num_read_kb":59240,"num_write":949,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.022640+0000","last_change":"2024-09-12T17:21:41.866850+0000","last_active":"2024-09-12T17:58:32.022640+0000","last_peered":"2024-09-12T17:58:32.022640+0000","last_clean":"2024-09-12T17:58:32.022640+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T17:58:32.022640+0000","last_undegraded":"2024-09-12T17:58:32.022640+0000","last_fullsized":"2024-09-12T17:58:32.022640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.746085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.019639+0000","last_change":"2024-09-12T17:21:54.752228+0000","last_active":"2024-09-12T17:58:07.019639+0000","last_peered":"2024-09-12T17:58:07.019639+0000","last_clean":"2024-09-12T17:58:07.019639+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T17:58:07.019639+0000","last_undegraded":"2024-09-12T17:58:07.019639+0000","last_fullsized":"2024-09-12T17:58:07.019639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.871367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'731","reported_seq":1425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.090847+0000","last_change":"2024-09-12T17:21:56.767995+0000","last_active":"2024-09-12T18:00:56.090847+0000","last_peered":"2024-09-12T18:00:56.090847+0000","last_clean":"2024-09-12T18:00:56.090847+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:00:56.090847+0000","last_undegraded":"2024-09-12T18:00:56.090847+0000","last_fullsized":"2024-09-12T18:00:56.090847+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:13.584754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178459,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1281,"num_read_kb":2755,"num_write":1070,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013828+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:57:27.013828+0000","last_peered":"2024-09-12T17:57:27.013828+0000","last_clean":"2024-09-12T17:57:27.013828+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T17:57:27.013828+0000","last_undegraded":"2024-09-12T17:57:27.013828+0000","last_fullsized":"2024-09-12T17:57:27.013828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:01.402224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'132","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.226950+0000","last_change":"2024-09-12T17:22:00.789098+0000","last_active":"2024-09-12T17:59:03.226950+0000","last_peered":"2024-09-12T17:59:03.226950+0000","last_clean":"2024-09-12T17:59:03.226950+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T17:59:03.226950+0000","last_undegraded":"2024-09-12T17:59:03.226950+0000","last_fullsized":"2024-09-12T17:59:03.226950+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.614418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'152","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.424191+0000","last_change":"2024-09-12T17:22:00.786992+0000","last_active":"2024-09-12T17:59:34.424191+0000","last_peered":"2024-09-12T17:59:34.424191+0000","last_clean":"2024-09-12T17:59:34.424191+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T17:59:34.424191+0000","last_undegraded":"2024-09-12T17:59:34.424191+0000","last_fullsized":"2024-09-12T17:59:34.424191+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:08.329121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'468","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.769697+0000","last_change":"2024-09-12T17:21:52.742192+0000","last_active":"2024-09-12T17:59:18.769697+0000","last_peered":"2024-09-12T17:59:18.769697+0000","last_clean":"2024-09-12T17:59:18.769697+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T17:59:18.769697+0000","last_undegraded":"2024-09-12T17:59:18.769697+0000","last_fullsized":"2024-09-12T17:59:18.769697+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:43.783519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'260","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.047773+0000","last_change":"2024-09-12T17:21:50.771110+0000","last_active":"2024-09-12T17:59:19.047773+0000","last_peered":"2024-09-12T17:59:19.047773+0000","last_clean":"2024-09-12T17:59:19.047773+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T17:59:19.047773+0000","last_undegraded":"2024-09-12T17:59:19.047773+0000","last_fullsized":"2024-09-12T17:59:19.047773+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:22.753809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6582477,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":416,"num_read_kb":5950,"num_write":970,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124604+0000","last_change":"2024-09-12T17:21:54.759266+0000","last_active":"2024-09-12T17:56:57.124604+0000","last_peered":"2024-09-12T17:56:57.124604+0000","last_clean":"2024-09-12T17:56:57.124604+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T17:56:57.124604+0000","last_undegraded":"2024-09-12T17:56:57.124604+0000","last_fullsized":"2024-09-12T17:56:57.124604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:37.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'290","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.143175+0000","last_change":"2024-09-12T17:21:56.766802+0000","last_active":"2024-09-12T17:59:17.143175+0000","last_peered":"2024-09-12T17:59:17.143175+0000","last_clean":"2024-09-12T17:59:17.143175+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T17:59:17.143175+0000","last_undegraded":"2024-09-12T17:59:17.143175+0000","last_fullsized":"2024-09-12T17:59:17.143175+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.524361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1042,"num_write":404,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129355+0000","last_change":"2024-09-12T17:21:58.781271+0000","last_active":"2024-09-12T17:57:00.129355+0000","last_peered":"2024-09-12T17:57:00.129355+0000","last_clean":"2024-09-12T17:57:00.129355+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T17:57:00.129355+0000","last_undegraded":"2024-09-12T17:57:00.129355+0000","last_fullsized":"2024-09-12T17:57:00.129355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:44.876899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.826880+0000","last_change":"2024-09-12T17:22:00.795423+0000","last_active":"2024-09-12T17:59:34.826880+0000","last_peered":"2024-09-12T17:59:34.826880+0000","last_clean":"2024-09-12T17:59:34.826880+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T17:59:34.826880+0000","last_undegraded":"2024-09-12T17:59:34.826880+0000","last_fullsized":"2024-09-12T17:59:34.826880+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:51.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'639","reported_seq":2255,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.002741+0000","last_change":"2024-09-12T17:21:52.744060+0000","last_active":"2024-09-12T17:59:16.002741+0000","last_peered":"2024-09-12T17:59:16.002741+0000","last_clean":"2024-09-12T17:59:16.002741+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T17:59:16.002741+0000","last_undegraded":"2024-09-12T17:59:16.002741+0000","last_fullsized":"2024-09-12T17:59:16.002741+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:49.782641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'246","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.122964+0000","last_change":"2024-09-12T17:22:26.296706+0000","last_active":"2024-09-12T18:01:03.122964+0000","last_peered":"2024-09-12T18:01:03.122964+0000","last_clean":"2024-09-12T18:01:03.122964+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:03.122964+0000","last_undegraded":"2024-09-12T18:01:03.122964+0000","last_fullsized":"2024-09-12T18:01:03.122964+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:49.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7374334,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":367,"num_read_kb":12892,"num_write":912,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009094+0000","last_change":"2024-09-12T17:21:54.755356+0000","last_active":"2024-09-12T17:56:57.009094+0000","last_peered":"2024-09-12T17:56:57.009094+0000","last_clean":"2024-09-12T17:56:57.009094+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T17:56:57.009094+0000","last_undegraded":"2024-09-12T17:56:57.009094+0000","last_fullsized":"2024-09-12T17:56:57.009094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:02.209702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":547,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.778422+0000","last_change":"2024-09-12T17:21:56.761388+0000","last_active":"2024-09-12T17:58:38.778422+0000","last_peered":"2024-09-12T17:58:38.778422+0000","last_clean":"2024-09-12T17:58:38.778422+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T17:58:38.778422+0000","last_undegraded":"2024-09-12T17:58:38.778422+0000","last_fullsized":"2024-09-12T17:58:38.778422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:20.116062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160637+0000","last_change":"2024-09-12T17:21:58.779273+0000","last_active":"2024-09-12T17:57:02.160637+0000","last_peered":"2024-09-12T17:57:02.160637+0000","last_clean":"2024-09-12T17:57:02.160637+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T17:57:02.160637+0000","last_undegraded":"2024-09-12T17:57:02.160637+0000","last_fullsized":"2024-09-12T17:57:02.160637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:23.417297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'227","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.355106+0000","last_change":"2024-09-12T17:22:00.795725+0000","last_active":"2024-09-12T17:59:34.355106+0000","last_peered":"2024-09-12T17:59:34.355106+0000","last_clean":"2024-09-12T17:59:34.355106+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T17:59:34.355106+0000","last_undegraded":"2024-09-12T17:59:34.355106+0000","last_fullsized":"2024-09-12T17:59:34.355106+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:25.111700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'387","reported_seq":1863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760420+0000","last_change":"2024-09-12T17:21:52.750349+0000","last_active":"2024-09-12T17:59:34.760420+0000","last_peered":"2024-09-12T17:59:34.760420+0000","last_clean":"2024-09-12T17:59:34.760420+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T17:59:34.760420+0000","last_undegraded":"2024-09-12T17:59:34.760420+0000","last_fullsized":"2024-09-12T17:59:34.760420+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:27.902470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'274","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:39.444565+0000","last_change":"2024-09-12T17:21:50.769491+0000","last_active":"2024-09-12T17:58:39.444565+0000","last_peered":"2024-09-12T17:58:39.444565+0000","last_clean":"2024-09-12T17:58:39.444565+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T17:58:39.444565+0000","last_undegraded":"2024-09-12T17:58:39.444565+0000","last_fullsized":"2024-09-12T17:58:39.444565+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:13.935748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4503077,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":372,"num_read_kb":8586,"num_write":1045,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159979+0000","last_change":"2024-09-12T17:21:54.753914+0000","last_active":"2024-09-12T17:56:57.159979+0000","last_peered":"2024-09-12T17:56:57.159979+0000","last_clean":"2024-09-12T17:56:57.159979+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T17:56:57.159979+0000","last_undegraded":"2024-09-12T17:56:57.159979+0000","last_fullsized":"2024-09-12T17:56:57.159979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.689343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'313","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.367050+0000","last_change":"2024-09-12T17:21:56.766069+0000","last_active":"2024-09-12T17:59:34.367050+0000","last_peered":"2024-09-12T17:59:34.367050+0000","last_clean":"2024-09-12T17:59:34.367050+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T17:59:34.367050+0000","last_undegraded":"2024-09-12T17:59:34.367050+0000","last_fullsized":"2024-09-12T17:59:34.367050+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:38.666434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":1089,"num_write":432,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.120621+0000","last_change":"2024-09-12T17:21:58.781433+0000","last_active":"2024-09-12T17:57:02.120621+0000","last_peered":"2024-09-12T17:57:02.120621+0000","last_clean":"2024-09-12T17:57:02.120621+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T17:57:02.120621+0000","last_undegraded":"2024-09-12T17:57:02.120621+0000","last_fullsized":"2024-09-12T17:57:02.120621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:29.832595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'133","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.970181+0000","last_change":"2024-09-12T17:22:00.797551+0000","last_active":"2024-09-12T17:59:02.970181+0000","last_peered":"2024-09-12T17:59:02.970181+0000","last_clean":"2024-09-12T17:59:02.970181+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T17:59:02.970181+0000","last_undegraded":"2024-09-12T17:59:02.970181+0000","last_fullsized":"2024-09-12T17:59:02.970181+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:41.162485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'740","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.538431+0000","last_change":"2024-09-12T17:21:52.749905+0000","last_active":"2024-09-12T17:59:12.538431+0000","last_peered":"2024-09-12T17:59:12.538431+0000","last_clean":"2024-09-12T17:59:12.538431+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T17:59:12.538431+0000","last_undegraded":"2024-09-12T17:59:12.538431+0000","last_fullsized":"2024-09-12T17:59:12.538431+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:52.822961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'276","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.048928+0000","last_change":"2024-09-12T17:21:50.755503+0000","last_active":"2024-09-12T18:01:03.048928+0000","last_peered":"2024-09-12T18:01:03.048928+0000","last_clean":"2024-09-12T18:01:03.048928+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:03.048928+0000","last_undegraded":"2024-09-12T18:01:03.048928+0000","last_fullsized":"2024-09-12T18:01:03.048928+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:37.883856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406045,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":467,"num_read_kb":5945,"num_write":1155,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009139+0000","last_change":"2024-09-12T17:21:54.758453+0000","last_active":"2024-09-12T17:56:57.009139+0000","last_peered":"2024-09-12T17:56:57.009139+0000","last_clean":"2024-09-12T17:56:57.009139+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T17:56:57.009139+0000","last_undegraded":"2024-09-12T17:56:57.009139+0000","last_fullsized":"2024-09-12T17:56:57.009139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.810118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'249","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.027723+0000","last_change":"2024-09-12T17:21:56.769935+0000","last_active":"2024-09-12T17:59:17.027723+0000","last_peered":"2024-09-12T17:59:17.027723+0000","last_clean":"2024-09-12T17:59:17.027723+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T17:59:17.027723+0000","last_undegraded":"2024-09-12T17:59:17.027723+0000","last_fullsized":"2024-09-12T17:59:17.027723+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:39.633555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60129,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":944,"num_write":362,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129426+0000","last_change":"2024-09-12T17:21:58.785066+0000","last_active":"2024-09-12T17:57:00.129426+0000","last_peered":"2024-09-12T17:57:00.129426+0000","last_clean":"2024-09-12T17:57:00.129426+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T17:57:00.129426+0000","last_undegraded":"2024-09-12T17:57:00.129426+0000","last_fullsized":"2024-09-12T17:57:00.129426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:41.442928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'404","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618747+0000","last_change":"2024-09-12T17:21:52.755203+0000","last_active":"2024-09-12T17:59:16.618747+0000","last_peered":"2024-09-12T17:59:16.618747+0000","last_clean":"2024-09-12T17:59:16.618747+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T17:59:16.618747+0000","last_undegraded":"2024-09-12T17:59:16.618747+0000","last_fullsized":"2024-09-12T17:59:16.618747+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:20.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'254","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.985943+0000","last_change":"2024-09-12T17:21:50.762696+0000","last_active":"2024-09-12T18:01:02.985943+0000","last_peered":"2024-09-12T18:01:02.985943+0000","last_clean":"2024-09-12T18:01:02.985943+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:02.985943+0000","last_undegraded":"2024-09-12T18:01:02.985943+0000","last_fullsized":"2024-09-12T18:01:02.985943+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:29.711995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10435358,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":392,"num_read_kb":25374,"num_write":917,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133894+0000","last_change":"2024-09-12T17:21:54.759183+0000","last_active":"2024-09-12T17:58:02.133894+0000","last_peered":"2024-09-12T17:58:02.133894+0000","last_clean":"2024-09-12T17:58:02.133894+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T17:58:02.133894+0000","last_undegraded":"2024-09-12T17:58:02.133894+0000","last_fullsized":"2024-09-12T17:58:02.133894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:44.448393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'476","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.087281+0000","last_change":"2024-09-12T17:21:56.768691+0000","last_active":"2024-09-12T18:00:56.087281+0000","last_peered":"2024-09-12T18:00:56.087281+0000","last_clean":"2024-09-12T18:00:56.087281+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:00:56.087281+0000","last_undegraded":"2024-09-12T18:00:56.087281+0000","last_fullsized":"2024-09-12T18:00:56.087281+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.730690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116754,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1861,"num_write":748,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160707+0000","last_change":"2024-09-12T17:21:58.784784+0000","last_active":"2024-09-12T17:57:02.160707+0000","last_peered":"2024-09-12T17:57:02.160707+0000","last_clean":"2024-09-12T17:57:02.160707+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T17:57:02.160707+0000","last_undegraded":"2024-09-12T17:57:02.160707+0000","last_fullsized":"2024-09-12T17:57:02.160707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:09.975350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'164","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.836312+0000","last_change":"2024-09-12T17:22:00.798771+0000","last_active":"2024-09-12T17:59:28.836312+0000","last_peered":"2024-09-12T17:59:28.836312+0000","last_clean":"2024-09-12T17:59:28.836312+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T17:59:28.836312+0000","last_undegraded":"2024-09-12T17:59:28.836312+0000","last_fullsized":"2024-09-12T17:59:28.836312+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:10.472501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'420","reported_seq":1885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952594+0000","last_change":"2024-09-12T17:21:52.746392+0000","last_active":"2024-09-12T17:59:16.952594+0000","last_peered":"2024-09-12T17:59:16.952594+0000","last_clean":"2024-09-12T17:59:16.952594+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T17:59:16.952594+0000","last_undegraded":"2024-09-12T17:59:16.952594+0000","last_fullsized":"2024-09-12T17:59:16.952594+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:08.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'275","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.985038+0000","last_change":"2024-09-12T17:21:50.759865+0000","last_active":"2024-09-12T17:59:09.985038+0000","last_peered":"2024-09-12T17:59:09.985038+0000","last_clean":"2024-09-12T17:59:09.985038+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T17:59:09.985038+0000","last_undegraded":"2024-09-12T17:59:09.985038+0000","last_fullsized":"2024-09-12T17:59:09.985038+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:18.154345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7238788,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":454,"num_read_kb":48900,"num_write":991,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.163561+0000","last_change":"2024-09-12T17:21:54.757887+0000","last_active":"2024-09-12T17:57:22.163561+0000","last_peered":"2024-09-12T17:57:22.163561+0000","last_clean":"2024-09-12T17:57:22.163561+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T17:57:22.163561+0000","last_undegraded":"2024-09-12T17:57:22.163561+0000","last_fullsized":"2024-09-12T17:57:22.163561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:57.740295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'290","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.029763+0000","last_change":"2024-09-12T17:21:56.759500+0000","last_active":"2024-09-12T17:59:27.029763+0000","last_peered":"2024-09-12T17:59:27.029763+0000","last_clean":"2024-09-12T17:59:27.029763+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T17:59:27.029763+0000","last_undegraded":"2024-09-12T17:59:27.029763+0000","last_fullsized":"2024-09-12T17:59:27.029763+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:26.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55713,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":962,"num_write":408,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.122006+0000","last_change":"2024-09-12T17:21:58.795399+0000","last_active":"2024-09-12T17:56:58.122006+0000","last_peered":"2024-09-12T17:56:58.122006+0000","last_clean":"2024-09-12T17:56:58.122006+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T17:56:58.122006+0000","last_undegraded":"2024-09-12T17:56:58.122006+0000","last_fullsized":"2024-09-12T17:56:58.122006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:48.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'190","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.181615+0000","last_change":"2024-09-12T17:22:00.794027+0000","last_active":"2024-09-12T17:59:33.181615+0000","last_peered":"2024-09-12T17:59:33.181615+0000","last_clean":"2024-09-12T17:59:33.181615+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T17:59:33.181615+0000","last_undegraded":"2024-09-12T17:59:33.181615+0000","last_fullsized":"2024-09-12T17:59:33.181615+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:17.004717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'853","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.133185+0000","last_change":"2024-09-12T17:21:52.755426+0000","last_active":"2024-09-12T17:59:15.133185+0000","last_peered":"2024-09-12T17:59:15.133185+0000","last_clean":"2024-09-12T17:59:15.133185+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T17:59:15.133185+0000","last_undegraded":"2024-09-12T17:59:15.133185+0000","last_fullsized":"2024-09-12T17:59:15.133185+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:04.598499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'270","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.669418+0000","last_change":"2024-09-12T17:21:50.755856+0000","last_active":"2024-09-12T17:59:15.669418+0000","last_peered":"2024-09-12T17:59:15.669418+0000","last_clean":"2024-09-12T17:59:15.669418+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T17:59:15.669418+0000","last_undegraded":"2024-09-12T17:59:15.669418+0000","last_fullsized":"2024-09-12T17:59:15.669418+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:22.206678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8742585,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":429,"num_read_kb":72608,"num_write":1034,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160042+0000","last_change":"2024-09-12T17:21:54.750383+0000","last_active":"2024-09-12T17:56:57.160042+0000","last_peered":"2024-09-12T17:56:57.160042+0000","last_clean":"2024-09-12T17:56:57.160042+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T17:56:57.160042+0000","last_undegraded":"2024-09-12T17:56:57.160042+0000","last_fullsized":"2024-09-12T17:56:57.160042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'233","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144735+0000","last_change":"2024-09-12T17:21:56.768390+0000","last_active":"2024-09-12T17:59:27.144735+0000","last_peered":"2024-09-12T17:59:27.144735+0000","last_clean":"2024-09-12T17:59:27.144735+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T17:59:27.144735+0000","last_undegraded":"2024-09-12T17:59:27.144735+0000","last_fullsized":"2024-09-12T17:59:27.144735+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:20.766139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56008,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":384,"num_read_kb":808,"num_write":308,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138962+0000","last_change":"2024-09-12T17:21:58.784005+0000","last_active":"2024-09-12T17:58:05.138962+0000","last_peered":"2024-09-12T17:58:05.138962+0000","last_clean":"2024-09-12T17:58:05.138962+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T17:58:05.138962+0000","last_undegraded":"2024-09-12T17:58:05.138962+0000","last_fullsized":"2024-09-12T17:58:05.138962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:02.608599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'111","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.117938+0000","last_change":"2024-09-12T17:22:00.796332+0000","last_active":"2024-09-12T18:00:56.117938+0000","last_peered":"2024-09-12T18:00:56.117938+0000","last_clean":"2024-09-12T18:00:56.117938+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:00:56.117938+0000","last_undegraded":"2024-09-12T18:00:56.117938+0000","last_fullsized":"2024-09-12T18:00:56.117938+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'488","reported_seq":2088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999609+0000","last_change":"2024-09-12T17:21:52.747235+0000","last_active":"2024-09-12T18:00:54.999609+0000","last_peered":"2024-09-12T18:00:54.999609+0000","last_clean":"2024-09-12T18:00:54.999609+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:00:54.999609+0000","last_undegraded":"2024-09-12T18:00:54.999609+0000","last_fullsized":"2024-09-12T18:00:54.999609+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:11.805325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'249","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.110615+0000","last_change":"2024-09-12T17:21:50.761070+0000","last_active":"2024-09-12T17:59:12.110615+0000","last_peered":"2024-09-12T17:59:12.110615+0000","last_clean":"2024-09-12T17:59:12.110615+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T17:59:12.110615+0000","last_undegraded":"2024-09-12T17:59:12.110615+0000","last_fullsized":"2024-09-12T17:59:12.110615+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:43.740244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4363624,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":359,"num_read_kb":22007,"num_write":882,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009133+0000","last_change":"2024-09-12T17:21:54.755644+0000","last_active":"2024-09-12T17:56:57.009133+0000","last_peered":"2024-09-12T17:56:57.009133+0000","last_clean":"2024-09-12T17:56:57.009133+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T17:56:57.009133+0000","last_undegraded":"2024-09-12T17:56:57.009133+0000","last_fullsized":"2024-09-12T17:56:57.009133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'79","reported_seq":592,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:16.585394+0000","last_change":"2024-09-12T17:21:56.761019+0000","last_active":"2024-09-12T17:58:16.585394+0000","last_peered":"2024-09-12T17:58:16.585394+0000","last_clean":"2024-09-12T17:58:16.585394+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T17:58:16.585394+0000","last_undegraded":"2024-09-12T17:58:16.585394+0000","last_fullsized":"2024-09-12T17:58:16.585394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.371470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'753","reported_seq":2430,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.129874+0000","last_change":"2024-09-12T17:21:58.783309+0000","last_active":"2024-09-12T18:00:56.129874+0000","last_peered":"2024-09-12T18:00:56.129874+0000","last_clean":"2024-09-12T18:00:56.129874+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:00:56.129874+0000","last_undegraded":"2024-09-12T18:00:56.129874+0000","last_fullsized":"2024-09-12T18:00:56.129874+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:14.021972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'111","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.028820+0000","last_change":"2024-09-12T17:22:00.792450+0000","last_active":"2024-09-12T17:59:22.028820+0000","last_peered":"2024-09-12T17:59:22.028820+0000","last_clean":"2024-09-12T17:59:22.028820+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T17:59:22.028820+0000","last_undegraded":"2024-09-12T17:59:22.028820+0000","last_fullsized":"2024-09-12T17:59:22.028820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.275271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'468","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.759665+0000","last_change":"2024-09-12T17:21:52.751365+0000","last_active":"2024-09-12T17:59:34.759665+0000","last_peered":"2024-09-12T17:59:34.759665+0000","last_clean":"2024-09-12T17:59:34.759665+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T17:59:34.759665+0000","last_undegraded":"2024-09-12T17:59:34.759665+0000","last_fullsized":"2024-09-12T17:59:34.759665+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:36.771613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'277","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.240174+0000","last_change":"2024-09-12T17:21:50.768703+0000","last_active":"2024-09-12T17:58:51.240174+0000","last_peered":"2024-09-12T17:58:51.240174+0000","last_clean":"2024-09-12T17:58:51.240174+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T17:58:51.240174+0000","last_undegraded":"2024-09-12T17:58:51.240174+0000","last_fullsized":"2024-09-12T17:58:51.240174+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:26.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16653203,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":406,"num_read_kb":20561,"num_write":1007,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.120023+0000","last_change":"2024-09-12T17:21:54.752741+0000","last_active":"2024-09-12T17:56:57.120023+0000","last_peered":"2024-09-12T17:56:57.120023+0000","last_clean":"2024-09-12T17:56:57.120023+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T17:56:57.120023+0000","last_undegraded":"2024-09-12T17:56:57.120023+0000","last_fullsized":"2024-09-12T17:56:57.120023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:50.651848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:47.038518+0000","last_change":"2024-09-12T17:21:56.771872+0000","last_active":"2024-09-12T18:00:47.038518+0000","last_peered":"2024-09-12T18:00:47.038518+0000","last_clean":"2024-09-12T18:00:47.038518+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:00:47.038518+0000","last_undegraded":"2024-09-12T18:00:47.038518+0000","last_fullsized":"2024-09-12T18:00:47.038518+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:31.183940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60828,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":462,"num_read_kb":940,"num_write":384,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021920+0000","last_change":"2024-09-12T17:21:58.789902+0000","last_active":"2024-09-12T17:58:17.021920+0000","last_peered":"2024-09-12T17:58:17.021920+0000","last_clean":"2024-09-12T17:58:17.021920+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T17:58:17.021920+0000","last_undegraded":"2024-09-12T17:58:17.021920+0000","last_fullsized":"2024-09-12T17:58:17.021920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.777449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'139","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.021593+0000","last_change":"2024-09-12T17:22:00.794282+0000","last_active":"2024-09-12T17:59:34.021593+0000","last_peered":"2024-09-12T17:59:34.021593+0000","last_clean":"2024-09-12T17:59:34.021593+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T17:59:34.021593+0000","last_undegraded":"2024-09-12T17:59:34.021593+0000","last_fullsized":"2024-09-12T17:59:34.021593+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:58.732912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'468","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002055+0000","last_change":"2024-09-12T17:21:52.746743+0000","last_active":"2024-09-12T18:00:55.002055+0000","last_peered":"2024-09-12T18:00:55.002055+0000","last_clean":"2024-09-12T18:00:55.002055+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:00:55.002055+0000","last_undegraded":"2024-09-12T18:00:55.002055+0000","last_fullsized":"2024-09-12T18:00:55.002055+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.604964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'275","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.416272+0000","last_change":"2024-09-12T17:21:50.771314+0000","last_active":"2024-09-12T18:00:54.416272+0000","last_peered":"2024-09-12T18:00:54.416272+0000","last_clean":"2024-09-12T18:00:54.416272+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:00:54.416272+0000","last_undegraded":"2024-09-12T18:00:54.416272+0000","last_fullsized":"2024-09-12T18:00:54.416272+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:28.163181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13097890,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":430,"num_read_kb":60843,"num_write":1041,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160026+0000","last_change":"2024-09-12T17:21:54.754687+0000","last_active":"2024-09-12T17:56:57.160026+0000","last_peered":"2024-09-12T17:56:57.160026+0000","last_clean":"2024-09-12T17:56:57.160026+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T17:56:57.160026+0000","last_undegraded":"2024-09-12T17:56:57.160026+0000","last_fullsized":"2024-09-12T17:56:57.160026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.236794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'248","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.039810+0000","last_change":"2024-09-12T17:21:56.764040+0000","last_active":"2024-09-12T18:00:37.039810+0000","last_peered":"2024-09-12T18:00:37.039810+0000","last_clean":"2024-09-12T18:00:37.039810+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:00:37.039810+0000","last_undegraded":"2024-09-12T18:00:37.039810+0000","last_fullsized":"2024-09-12T18:00:37.039810+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:13.554679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56791,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":411,"num_read_kb":885,"num_write":340,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021541+0000","last_change":"2024-09-12T17:21:58.783726+0000","last_active":"2024-09-12T17:58:22.021541+0000","last_peered":"2024-09-12T17:58:22.021541+0000","last_clean":"2024-09-12T17:58:22.021541+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T17:58:22.021541+0000","last_undegraded":"2024-09-12T17:58:22.021541+0000","last_fullsized":"2024-09-12T17:58:22.021541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'103","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.765064+0000","last_change":"2024-09-12T17:22:00.798683+0000","last_active":"2024-09-12T17:59:34.765064+0000","last_peered":"2024-09-12T17:59:34.765064+0000","last_clean":"2024-09-12T17:59:34.765064+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T17:59:34.765064+0000","last_undegraded":"2024-09-12T17:59:34.765064+0000","last_fullsized":"2024-09-12T17:59:34.765064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:52.343353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840653+0000","last_change":"2024-09-12T17:21:52.750254+0000","last_active":"2024-09-12T17:59:28.840653+0000","last_peered":"2024-09-12T17:59:28.840653+0000","last_clean":"2024-09-12T17:59:28.840653+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T17:59:28.840653+0000","last_undegraded":"2024-09-12T17:59:28.840653+0000","last_fullsized":"2024-09-12T17:59:28.840653+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:42.642542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'333","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.145849+0000","last_change":"2024-09-12T17:21:50.747069+0000","last_active":"2024-09-12T18:01:03.145849+0000","last_peered":"2024-09-12T18:01:03.145849+0000","last_clean":"2024-09-12T18:01:03.145849+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:03.145849+0000","last_undegraded":"2024-09-12T18:01:03.145849+0000","last_fullsized":"2024-09-12T18:01:03.145849+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:49.408880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18570645,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":598,"num_read_kb":67994,"num_write":1172,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.130730+0000","last_change":"2024-09-12T17:21:54.750762+0000","last_active":"2024-09-12T17:58:12.130730+0000","last_peered":"2024-09-12T17:58:12.130730+0000","last_clean":"2024-09-12T17:58:12.130730+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T17:58:12.130730+0000","last_undegraded":"2024-09-12T17:58:12.130730+0000","last_fullsized":"2024-09-12T17:58:12.130730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:35.152406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'226","reported_seq":773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144681+0000","last_change":"2024-09-12T17:21:56.763924+0000","last_active":"2024-09-12T17:59:27.144681+0000","last_peered":"2024-09-12T17:59:27.144681+0000","last_clean":"2024-09-12T17:59:27.144681+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T17:59:27.144681+0000","last_undegraded":"2024-09-12T17:59:27.144681+0000","last_fullsized":"2024-09-12T17:59:27.144681+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.766828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":857,"num_write":324,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.010097+0000","last_change":"2024-09-12T17:21:58.790322+0000","last_active":"2024-09-12T17:57:02.010097+0000","last_peered":"2024-09-12T17:57:02.010097+0000","last_clean":"2024-09-12T17:57:02.010097+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T17:57:02.010097+0000","last_undegraded":"2024-09-12T17:57:02.010097+0000","last_fullsized":"2024-09-12T17:57:02.010097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:02.075930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'218","reported_seq":1317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.414101+0000","last_change":"2024-09-12T17:22:00.798392+0000","last_active":"2024-09-12T17:59:33.414101+0000","last_peered":"2024-09-12T17:59:33.414101+0000","last_clean":"2024-09-12T17:59:33.414101+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T17:59:33.414101+0000","last_undegraded":"2024-09-12T17:59:33.414101+0000","last_fullsized":"2024-09-12T17:59:33.414101+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:00.108534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012393+0000","last_change":"2024-09-12T17:21:52.737742+0000","last_active":"2024-09-12T17:59:19.012393+0000","last_peered":"2024-09-12T17:59:19.012393+0000","last_clean":"2024-09-12T17:59:19.012393+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T17:59:19.012393+0000","last_undegraded":"2024-09-12T17:59:19.012393+0000","last_fullsized":"2024-09-12T17:59:19.012393+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:14.225738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'288","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.128386+0000","last_change":"2024-09-12T17:21:50.755052+0000","last_active":"2024-09-12T18:01:03.128386+0000","last_peered":"2024-09-12T18:01:03.128386+0000","last_clean":"2024-09-12T18:01:03.128386+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:03.128386+0000","last_undegraded":"2024-09-12T18:01:03.128386+0000","last_fullsized":"2024-09-12T18:01:03.128386+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:25.454728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8793260,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":474,"num_read_kb":16565,"num_write":1033,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.022475+0000","last_change":"2024-09-12T17:21:54.758914+0000","last_active":"2024-09-12T17:58:22.022475+0000","last_peered":"2024-09-12T17:58:22.022475+0000","last_clean":"2024-09-12T17:58:22.022475+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T17:58:22.022475+0000","last_undegraded":"2024-09-12T17:58:22.022475+0000","last_fullsized":"2024-09-12T17:58:22.022475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:37.175631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'288","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.029722+0000","last_change":"2024-09-12T17:21:56.770020+0000","last_active":"2024-09-12T17:59:27.029722+0000","last_peered":"2024-09-12T17:59:27.029722+0000","last_clean":"2024-09-12T17:59:27.029722+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T17:59:27.029722+0000","last_undegraded":"2024-09-12T17:59:27.029722+0000","last_fullsized":"2024-09-12T17:59:27.029722+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:51.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":984,"num_write":398,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009822+0000","last_change":"2024-09-12T17:21:58.782815+0000","last_active":"2024-09-12T17:57:02.009822+0000","last_peered":"2024-09-12T17:57:02.009822+0000","last_clean":"2024-09-12T17:57:02.009822+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T17:57:02.009822+0000","last_undegraded":"2024-09-12T17:57:02.009822+0000","last_fullsized":"2024-09-12T17:57:02.009822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:12.520411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'136","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998151+0000","last_change":"2024-09-12T17:22:00.796520+0000","last_active":"2024-09-12T18:00:54.998151+0000","last_peered":"2024-09-12T18:00:54.998151+0000","last_clean":"2024-09-12T18:00:54.998151+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:00:54.998151+0000","last_undegraded":"2024-09-12T18:00:54.998151+0000","last_fullsized":"2024-09-12T18:00:54.998151+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:43.432009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'777","reported_seq":2423,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774914+0000","last_change":"2024-09-12T17:21:52.742859+0000","last_active":"2024-09-12T17:59:18.774914+0000","last_peered":"2024-09-12T17:59:18.774914+0000","last_clean":"2024-09-12T17:59:18.774914+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T17:59:18.774914+0000","last_undegraded":"2024-09-12T17:59:18.774914+0000","last_fullsized":"2024-09-12T17:59:18.774914+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:32.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'301","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.640869+0000","last_change":"2024-09-12T17:21:50.764860+0000","last_active":"2024-09-12T17:59:31.640869+0000","last_peered":"2024-09-12T17:59:31.640869+0000","last_clean":"2024-09-12T17:59:31.640869+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T17:59:31.640869+0000","last_undegraded":"2024-09-12T17:59:31.640869+0000","last_fullsized":"2024-09-12T17:59:31.640869+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:29.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13727362,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":471,"num_read_kb":161127,"num_write":1069,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'469","reported_seq":1778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129978+0000","last_change":"2024-09-12T17:21:52.753034+0000","last_active":"2024-09-12T17:59:18.129978+0000","last_peered":"2024-09-12T17:59:18.129978+0000","last_clean":"2024-09-12T17:59:18.129978+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T17:59:18.129978+0000","last_undegraded":"2024-09-12T17:59:18.129978+0000","last_fullsized":"2024-09-12T17:59:18.129978+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.231475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'393","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.637964+0000","last_change":"2024-09-12T17:21:50.763558+0000","last_active":"2024-09-12T17:59:31.637964+0000","last_peered":"2024-09-12T17:59:31.637964+0000","last_clean":"2024-09-12T17:59:31.637964+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T17:59:31.637964+0000","last_undegraded":"2024-09-12T17:59:31.637964+0000","last_fullsized":"2024-09-12T17:59:31.637964+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:23.906686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7369359,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":754,"num_read_kb":23219,"num_write":1254,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'804","reported_seq":2433,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.260815+0000","last_change":"2024-09-12T17:21:52.750129+0000","last_active":"2024-09-12T17:59:12.260815+0000","last_peered":"2024-09-12T17:59:12.260815+0000","last_clean":"2024-09-12T17:59:12.260815+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T17:59:12.260815+0000","last_undegraded":"2024-09-12T17:59:12.260815+0000","last_fullsized":"2024-09-12T17:59:12.260815+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.542955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'305","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.136362+0000","last_change":"2024-09-12T17:21:50.764053+0000","last_active":"2024-09-12T17:58:51.136362+0000","last_peered":"2024-09-12T17:58:51.136362+0000","last_clean":"2024-09-12T17:58:51.136362+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T17:58:51.136362+0000","last_undegraded":"2024-09-12T17:58:51.136362+0000","last_fullsized":"2024-09-12T17:58:51.136362+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.510424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109542,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":553,"num_read_kb":33088,"num_write":1109,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'920","reported_seq":2559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390034+0000","last_change":"2024-09-12T17:21:52.751702+0000","last_active":"2024-09-12T17:59:16.390034+0000","last_peered":"2024-09-12T17:59:16.390034+0000","last_clean":"2024-09-12T17:59:16.390034+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T17:59:16.390034+0000","last_undegraded":"2024-09-12T17:59:16.390034+0000","last_fullsized":"2024-09-12T17:59:16.390034+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.873565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'342","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.096244+0000","last_change":"2024-09-12T17:21:50.769742+0000","last_active":"2024-09-12T18:01:03.096244+0000","last_peered":"2024-09-12T18:01:03.096244+0000","last_clean":"2024-09-12T18:01:03.096244+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:03.096244+0000","last_undegraded":"2024-09-12T18:01:03.096244+0000","last_fullsized":"2024-09-12T18:01:03.096244+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:23.762144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14992016,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":612,"num_read_kb":28924,"num_write":1282,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'501","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.635643+0000","last_change":"2024-09-12T17:21:52.750068+0000","last_active":"2024-09-12T17:59:15.635643+0000","last_peered":"2024-09-12T17:59:15.635643+0000","last_clean":"2024-09-12T17:59:15.635643+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T17:59:15.635643+0000","last_undegraded":"2024-09-12T17:59:15.635643+0000","last_fullsized":"2024-09-12T17:59:15.635643+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:42.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'285","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:42.138751+0000","last_change":"2024-09-12T17:21:50.777506+0000","last_active":"2024-09-12T17:58:42.138751+0000","last_peered":"2024-09-12T17:58:42.138751+0000","last_clean":"2024-09-12T17:58:42.138751+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T17:58:42.138751+0000","last_undegraded":"2024-09-12T17:58:42.138751+0000","last_fullsized":"2024-09-12T17:58:42.138751+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.155150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8779971,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":449,"num_read_kb":85437,"num_write":1001,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'462","reported_seq":1955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.357110+0000","last_change":"2024-09-12T17:21:52.747550+0000","last_active":"2024-09-12T17:59:34.357110+0000","last_peered":"2024-09-12T17:59:34.357110+0000","last_clean":"2024-09-12T17:59:34.357110+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T17:59:34.357110+0000","last_undegraded":"2024-09-12T17:59:34.357110+0000","last_fullsized":"2024-09-12T17:59:34.357110+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.595623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'250","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.061929+0000","last_change":"2024-09-12T17:21:50.777489+0000","last_active":"2024-09-12T17:59:19.061929+0000","last_peered":"2024-09-12T17:59:19.061929+0000","last_clean":"2024-09-12T17:59:19.061929+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T17:59:19.061929+0000","last_undegraded":"2024-09-12T17:59:19.061929+0000","last_fullsized":"2024-09-12T17:59:19.061929+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:18.905928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11318756,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":460,"num_read_kb":83513,"num_write":980,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'599","reported_seq":2270,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501171+0000","last_change":"2024-09-12T17:21:52.754098+0000","last_active":"2024-09-12T17:59:18.501171+0000","last_peered":"2024-09-12T17:59:18.501171+0000","last_clean":"2024-09-12T17:59:18.501171+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T17:59:18.501171+0000","last_undegraded":"2024-09-12T17:59:18.501171+0000","last_fullsized":"2024-09-12T17:59:18.501171+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:19.357268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'285","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.389755+0000","last_change":"2024-09-12T17:21:50.769098+0000","last_active":"2024-09-12T17:59:12.389755+0000","last_peered":"2024-09-12T17:59:12.389755+0000","last_clean":"2024-09-12T17:59:12.389755+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T17:59:12.389755+0000","last_undegraded":"2024-09-12T17:59:12.389755+0000","last_fullsized":"2024-09-12T17:59:12.389755+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:09.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18149226,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":519,"num_read_kb":100977,"num_write":1026,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'365","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001710+0000","last_change":"2024-09-12T17:21:52.752509+0000","last_active":"2024-09-12T18:00:55.001710+0000","last_peered":"2024-09-12T18:00:55.001710+0000","last_clean":"2024-09-12T18:00:55.001710+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:00:55.001710+0000","last_undegraded":"2024-09-12T18:00:55.001710+0000","last_fullsized":"2024-09-12T18:00:55.001710+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:29.192100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'298","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.138657+0000","last_change":"2024-09-12T17:21:50.771358+0000","last_active":"2024-09-12T18:01:03.138657+0000","last_peered":"2024-09-12T18:01:03.138657+0000","last_clean":"2024-09-12T18:01:03.138657+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:03.138657+0000","last_undegraded":"2024-09-12T18:01:03.138657+0000","last_fullsized":"2024-09-12T18:01:03.138657+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:36.115502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12863539,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":402,"num_read_kb":5744,"num_write":1115,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'855","reported_seq":2396,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001101+0000","last_change":"2024-09-12T17:21:52.755007+0000","last_active":"2024-09-12T18:00:55.001101+0000","last_peered":"2024-09-12T18:00:55.001101+0000","last_clean":"2024-09-12T18:00:55.001101+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:00:55.001101+0000","last_undegraded":"2024-09-12T18:00:55.001101+0000","last_fullsized":"2024-09-12T18:00:55.001101+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:26.620534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'322","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.909744+0000","last_change":"2024-09-12T17:21:50.766664+0000","last_active":"2024-09-12T17:59:09.909744+0000","last_peered":"2024-09-12T17:59:09.909744+0000","last_clean":"2024-09-12T17:59:09.909744+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T17:59:09.909744+0000","last_undegraded":"2024-09-12T17:59:09.909744+0000","last_fullsized":"2024-09-12T17:59:09.909744+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:36.008036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224892,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":554,"num_read_kb":751,"num_write":1207,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'635","reported_seq":2038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.382860+0000","last_change":"2024-09-12T17:21:52.752393+0000","last_active":"2024-09-12T17:59:16.382860+0000","last_peered":"2024-09-12T17:59:16.382860+0000","last_clean":"2024-09-12T17:59:16.382860+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T17:59:16.382860+0000","last_undegraded":"2024-09-12T17:59:16.382860+0000","last_fullsized":"2024-09-12T17:59:16.382860+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:35.883929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'308","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.133941+0000","last_change":"2024-09-12T17:21:50.769891+0000","last_active":"2024-09-12T18:01:03.133941+0000","last_peered":"2024-09-12T18:01:03.133941+0000","last_clean":"2024-09-12T18:01:03.133941+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:03.133941+0000","last_undegraded":"2024-09-12T18:01:03.133941+0000","last_fullsized":"2024-09-12T18:01:03.133941+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:44.325817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13624130,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":17253,"num_write":1086,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'557","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769742+0000","last_change":"2024-09-12T17:21:52.754609+0000","last_active":"2024-09-12T17:59:34.769742+0000","last_peered":"2024-09-12T17:59:34.769742+0000","last_clean":"2024-09-12T17:59:34.769742+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T17:59:34.769742+0000","last_undegraded":"2024-09-12T17:59:34.769742+0000","last_fullsized":"2024-09-12T17:59:34.769742+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.921162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'302","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:50.946309+0000","last_change":"2024-09-12T17:22:26.299370+0000","last_active":"2024-09-12T18:00:50.946309+0000","last_peered":"2024-09-12T18:00:50.946309+0000","last_clean":"2024-09-12T18:00:50.946309+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:00:50.946309+0000","last_undegraded":"2024-09-12T18:00:50.946309+0000","last_fullsized":"2024-09-12T18:00:50.946309+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.880431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7039374,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":500,"num_read_kb":8559,"num_write":1124,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'553","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999194+0000","last_change":"2024-09-12T17:21:52.749942+0000","last_active":"2024-09-12T18:00:54.999194+0000","last_peered":"2024-09-12T18:00:54.999194+0000","last_clean":"2024-09-12T18:00:54.999194+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:00:54.999194+0000","last_undegraded":"2024-09-12T18:00:54.999194+0000","last_fullsized":"2024-09-12T18:00:54.999194+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:15.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'262","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.429027+0000","last_change":"2024-09-12T17:21:50.758098+0000","last_active":"2024-09-12T17:58:38.429027+0000","last_peered":"2024-09-12T17:58:38.429027+0000","last_clean":"2024-09-12T17:58:38.429027+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T17:58:38.429027+0000","last_undegraded":"2024-09-12T17:58:38.429027+0000","last_fullsized":"2024-09-12T17:58:38.429027+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:44.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6990877,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":437,"num_read_kb":7270,"num_write":920,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'495","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012334+0000","last_change":"2024-09-12T17:21:52.755013+0000","last_active":"2024-09-12T17:59:19.012334+0000","last_peered":"2024-09-12T17:59:19.012334+0000","last_clean":"2024-09-12T17:59:19.012334+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T17:59:19.012334+0000","last_undegraded":"2024-09-12T17:59:19.012334+0000","last_fullsized":"2024-09-12T17:59:19.012334+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:03.543775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'304","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.843716+0000","last_change":"2024-09-12T17:21:50.785028+0000","last_active":"2024-09-12T17:59:18.843716+0000","last_peered":"2024-09-12T17:59:18.843716+0000","last_clean":"2024-09-12T17:59:18.843716+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T17:59:18.843716+0000","last_undegraded":"2024-09-12T17:59:18.843716+0000","last_fullsized":"2024-09-12T17:59:18.843716+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:11.230359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318700,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":520,"num_read_kb":1808,"num_write":1157,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'757","reported_seq":2524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365262+0000","last_change":"2024-09-12T17:21:52.751189+0000","last_active":"2024-09-12T17:59:34.365262+0000","last_peered":"2024-09-12T17:59:34.365262+0000","last_clean":"2024-09-12T17:59:34.365262+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T17:59:34.365262+0000","last_undegraded":"2024-09-12T17:59:34.365262+0000","last_fullsized":"2024-09-12T17:59:34.365262+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:44.765214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'272","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.035713+0000","last_change":"2024-09-12T17:21:50.764846+0000","last_active":"2024-09-12T18:00:12.035713+0000","last_peered":"2024-09-12T18:00:12.035713+0000","last_clean":"2024-09-12T18:00:12.035713+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:00:12.035713+0000","last_undegraded":"2024-09-12T18:00:12.035713+0000","last_fullsized":"2024-09-12T18:00:12.035713+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:23.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535045,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":368,"num_read_kb":11532,"num_write":996,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1313","reported_seq":3051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.197533+0000","last_change":"2024-09-12T17:21:52.750173+0000","last_active":"2024-09-12T17:59:17.197533+0000","last_peered":"2024-09-12T17:59:17.197533+0000","last_clean":"2024-09-12T17:59:17.197533+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T17:59:17.197533+0000","last_undegraded":"2024-09-12T17:59:17.197533+0000","last_fullsized":"2024-09-12T17:59:17.197533+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:57.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'358","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.083779+0000","last_change":"2024-09-12T17:21:50.770800+0000","last_active":"2024-09-12T17:59:08.083779+0000","last_peered":"2024-09-12T17:59:08.083779+0000","last_clean":"2024-09-12T17:59:08.083779+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T17:59:08.083779+0000","last_undegraded":"2024-09-12T17:59:08.083779+0000","last_fullsized":"2024-09-12T17:59:08.083779+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:32.517729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5580672,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":760,"num_read_kb":12646,"num_write":1262,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'850","reported_seq":2463,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521273+0000","last_change":"2024-09-12T17:21:52.755424+0000","last_active":"2024-09-12T17:59:17.521273+0000","last_peered":"2024-09-12T17:59:17.521273+0000","last_clean":"2024-09-12T17:59:17.521273+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T17:59:17.521273+0000","last_undegraded":"2024-09-12T17:59:17.521273+0000","last_fullsized":"2024-09-12T17:59:17.521273+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:30.408737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'335","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.097364+0000","last_change":"2024-09-12T17:21:50.770612+0000","last_active":"2024-09-12T17:59:16.097364+0000","last_peered":"2024-09-12T17:59:16.097364+0000","last_clean":"2024-09-12T17:59:16.097364+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T17:59:16.097364+0000","last_undegraded":"2024-09-12T17:59:16.097364+0000","last_fullsized":"2024-09-12T17:59:16.097364+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:10.767250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1283978,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":582,"num_read_kb":21305,"num_write":1223,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'291","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.725936+0000","last_change":"2024-09-12T17:21:50.765427+0000","last_active":"2024-09-12T17:59:12.725936+0000","last_peered":"2024-09-12T17:59:12.725936+0000","last_clean":"2024-09-12T17:59:12.725936+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T17:59:12.725936+0000","last_undegraded":"2024-09-12T17:59:12.725936+0000","last_fullsized":"2024-09-12T17:59:12.725936+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:49.438329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17015302,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":580,"num_read_kb":38619,"num_write":1081,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'583","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.770082+0000","last_change":"2024-09-12T17:21:52.755082+0000","last_active":"2024-09-12T17:59:34.770082+0000","last_peered":"2024-09-12T17:59:34.770082+0000","last_clean":"2024-09-12T17:59:34.770082+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T17:59:34.770082+0000","last_undegraded":"2024-09-12T17:59:34.770082+0000","last_fullsized":"2024-09-12T17:59:34.770082+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:39.922432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'316","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.134077+0000","last_change":"2024-09-12T17:21:50.771898+0000","last_active":"2024-09-12T18:01:03.134077+0000","last_peered":"2024-09-12T18:01:03.134077+0000","last_clean":"2024-09-12T18:01:03.134077+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:03.134077+0000","last_undegraded":"2024-09-12T18:01:03.134077+0000","last_fullsized":"2024-09-12T18:01:03.134077+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.573435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18011618,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":456,"num_read_kb":51643,"num_write":1084,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'402","reported_seq":1963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170642+0000","last_change":"2024-09-12T17:21:52.745958+0000","last_active":"2024-09-12T17:59:16.170642+0000","last_peered":"2024-09-12T17:59:16.170642+0000","last_clean":"2024-09-12T17:59:16.170642+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T17:59:16.170642+0000","last_undegraded":"2024-09-12T17:59:16.170642+0000","last_fullsized":"2024-09-12T17:59:16.170642+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:44.648792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1647,"ondisk_log_size":1647,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":733,"ondisk_log_size":733,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1934577,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16480,"num_read_kb":32225,"num_write":13956,"num_write_kb":11426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3211264,"data_stored":2710927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1993,"ondisk_log_size":1993,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2869,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3984,"ondisk_log_size":3984,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":530444956,"num_objects":4383,"num_object_clones":0,"num_object_copies":17532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4383,"num_whiteouts":0,"num_read":32074,"num_read_kb":1816144,"num_write":68518,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":773279744,"data_stored":773279744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3931,"ondisk_log_size":3931,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59979586,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":134,"num_read_kb":163167,"num_write":157,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122068992,"data_stored":122056324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64173890,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":132,"num_read_kb":167173,"num_write":156,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128360448,"data_stored":128347780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477215,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396852,"kb_used_data":126884,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93974988,"statfs":{"total":96636764160,"available":96230387712,"internally_reserved":0,"allocated":129929216,"data_stored":127890114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509920,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250700,"kb_used_data":147324,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94121140,"statfs":{"total":96636764160,"available":96380047360,"internally_reserved":0,"allocated":150859776,"data_stored":148807094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105839046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509918,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359572,"kb_used_data":125764,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94012268,"statfs":{"total":96636764160,"available":96268562432,"internally_reserved":0,"allocated":128782336,"data_stored":126739892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509919,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":382284,"kb_used_data":148412,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93989556,"statfs":{"total":96636764160,"available":96245305344,"internally_reserved":0,"allocated":151973888,"data_stored":149950624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509921,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272088,"kb_used_data":146504,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94099752,"statfs":{"total":96636764160,"available":96358146048,"internally_reserved":0,"allocated":150020096,"data_stored":148019597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509920,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415468,"kb_used_data":99676,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93956372,"statfs":{"total":96636764160,"available":96211324928,"internally_reserved":0,"allocated":102068224,"data_stored":100031414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":323353029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509919,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237776,"kb_used_data":126080,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94134064,"statfs":{"total":96636764160,"available":96393281536,"internally_reserved":0,"allocated":129105920,"data_stored":127071879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575327,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361332,"kb_used_data":123364,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94010508,"statfs":{"total":96636764160,"available":96266760192,"internally_reserved":0,"allocated":126324736,"data_stored":124309726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114290688,"data_stored":114290688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82055168,"data_stored":82055168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112566272,"data_stored":112566272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":116948992,"data_stored":116948992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":89780224,"data_stored":89780224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":89399296,"data_stored":89399296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":96894976,"data_stored":96894976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71344128,"data_stored":71344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":496950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":480029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":124192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":251717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":381856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":317760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":342581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":315842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1673084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14675968,"data_stored":14675968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16317099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6885376,"data_stored":6884011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18399232,"data_stored":18397867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11591680,"data_stored":11588891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31514624,"data_stored":31511835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27299840,"data_stored":27299025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16781312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23638016,"data_stored":23636651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15953920,"data_stored":15947586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16367616,"data_stored":16363462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23121920,"data_stored":23121105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:06.147 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:01:06.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:01:06.516 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:01:06.518 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1446,"stamp":"2024-09-12T18:01:05.133266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657141058,"num_objects":4909,"num_object_clones":0,"num_object_copies":18584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4909,"num_whiteouts":0,"num_read":285692,"num_read_kb":2395651,"num_write":156840,"num_write_kb":2366905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13537,"ondisk_log_size":13537,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2676072,"kb_used_data":1044008,"kb_used_omap":12,"kb_used_meta":1631923,"kb_avail":752298648,"statfs":{"total":773094113280,"available":770353815552,"internally_reserved":0,"allocated":1069064192,"data_stored":1052820340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1671089712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4838261,"num_objects":-100,"num_object_clones":0,"num_object_copies":-364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-100,"num_whiteouts":0,"num_read":366,"num_read_kb":321,"num_write":131,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006546"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013121+0000","last_change":"2024-09-12T17:49:56.045663+0000","last_active":"2024-09-12T17:57:27.013121+0000","last_peered":"2024-09-12T17:57:27.013121+0000","last_clean":"2024-09-12T17:57:27.013121+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T17:57:27.013121+0000","last_undegraded":"2024-09-12T17:57:27.013121+0000","last_fullsized":"2024-09-12T17:57:27.013121+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:17.001669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.114014+0000","last_change":"2024-09-12T17:38:47.032756+0000","last_active":"2024-09-12T17:56:17.114014+0000","last_peered":"2024-09-12T17:56:17.114014+0000","last_clean":"2024-09-12T17:56:17.114014+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T17:56:17.114014+0000","last_undegraded":"2024-09-12T17:56:17.114014+0000","last_fullsized":"2024-09-12T17:56:17.114014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:43.869294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:15.122813+0000","last_change":"2024-09-12T17:38:43.996174+0000","last_active":"2024-09-12T17:56:15.122813+0000","last_peered":"2024-09-12T17:56:15.122813+0000","last_clean":"2024-09-12T17:56:15.122813+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T17:56:15.122813+0000","last_undegraded":"2024-09-12T17:56:15.122813+0000","last_fullsized":"2024-09-12T17:56:15.122813+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.191809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.019082+0000","last_change":"2024-09-12T17:37:08.657434+0000","last_active":"2024-09-12T17:58:02.019082+0000","last_peered":"2024-09-12T17:58:02.019082+0000","last_clean":"2024-09-12T17:58:02.019082+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T17:58:02.019082+0000","last_undegraded":"2024-09-12T17:58:02.019082+0000","last_fullsized":"2024-09-12T17:58:02.019082+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.018613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128952+0000","last_change":"2024-09-12T17:49:56.047260+0000","last_active":"2024-09-12T17:57:27.128952+0000","last_peered":"2024-09-12T17:57:27.128952+0000","last_clean":"2024-09-12T17:57:27.128952+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T17:57:27.128952+0000","last_undegraded":"2024-09-12T17:57:27.128952+0000","last_fullsized":"2024-09-12T17:57:27.128952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:13.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154633+0000","last_change":"2024-09-12T17:38:47.032526+0000","last_active":"2024-09-12T17:56:17.154633+0000","last_peered":"2024-09-12T17:56:17.154633+0000","last_clean":"2024-09-12T17:56:17.154633+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T17:56:17.154633+0000","last_undegraded":"2024-09-12T17:56:17.154633+0000","last_fullsized":"2024-09-12T17:56:17.154633+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.382669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:13.114703+0000","last_change":"2024-09-12T17:38:43.991731+0000","last_active":"2024-09-12T17:56:13.114703+0000","last_peered":"2024-09-12T17:56:13.114703+0000","last_clean":"2024-09-12T17:56:13.114703+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T17:56:13.114703+0000","last_undegraded":"2024-09-12T17:56:13.114703+0000","last_fullsized":"2024-09-12T17:56:13.114703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.972040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8434971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4142,"num_write":9,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:19.118189+0000","last_change":"2024-09-12T17:37:08.650147+0000","last_active":"2024-09-12T17:58:19.118189+0000","last_peered":"2024-09-12T17:58:19.118189+0000","last_clean":"2024-09-12T17:58:19.118189+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T17:58:19.118189+0000","last_undegraded":"2024-09-12T17:58:19.118189+0000","last_fullsized":"2024-09-12T17:58:19.118189+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:58.755566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.122054+0000","last_change":"2024-09-12T17:49:56.046643+0000","last_active":"2024-09-12T17:57:12.122054+0000","last_peered":"2024-09-12T17:57:12.122054+0000","last_clean":"2024-09-12T17:57:12.122054+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T17:57:12.122054+0000","last_undegraded":"2024-09-12T17:57:12.122054+0000","last_fullsized":"2024-09-12T17:57:12.122054+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.487756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'1","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127968+0000","last_change":"2024-09-12T17:38:47.027090+0000","last_active":"2024-09-12T17:57:33.127968+0000","last_peered":"2024-09-12T17:57:33.127968+0000","last_clean":"2024-09-12T17:57:33.127968+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T17:57:33.127968+0000","last_undegraded":"2024-09-12T17:57:33.127968+0000","last_fullsized":"2024-09-12T17:57:33.127968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:21.352493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144193+0000","last_change":"2024-09-12T17:38:43.992601+0000","last_active":"2024-09-12T17:58:45.144193+0000","last_peered":"2024-09-12T17:58:45.144193+0000","last_clean":"2024-09-12T17:58:45.144193+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T17:58:45.144193+0000","last_undegraded":"2024-09-12T17:58:45.144193+0000","last_fullsized":"2024-09-12T17:58:45.144193+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:05.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":243,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.266547+0000","last_change":"2024-09-12T17:37:08.657551+0000","last_active":"2024-09-12T17:59:07.266547+0000","last_peered":"2024-09-12T17:59:07.266547+0000","last_clean":"2024-09-12T17:59:07.266547+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T17:59:07.266547+0000","last_undegraded":"2024-09-12T17:59:07.266547+0000","last_fullsized":"2024-09-12T17:59:07.266547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:01.832274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:18.125196+0000","last_change":"2024-09-12T17:49:56.040426+0000","last_active":"2024-09-12T17:57:18.125196+0000","last_peered":"2024-09-12T17:57:18.125196+0000","last_clean":"2024-09-12T17:57:18.125196+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T17:57:18.125196+0000","last_undegraded":"2024-09-12T17:57:18.125196+0000","last_fullsized":"2024-09-12T17:57:18.125196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:54.760400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.139311+0000","last_change":"2024-09-12T17:38:47.027638+0000","last_active":"2024-09-12T17:58:53.139311+0000","last_peered":"2024-09-12T17:58:53.139311+0000","last_clean":"2024-09-12T17:58:53.139311+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T17:58:53.139311+0000","last_undegraded":"2024-09-12T17:58:53.139311+0000","last_fullsized":"2024-09-12T17:58:53.139311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:43.893874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12378,"num_write":5,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.124986+0000","last_change":"2024-09-12T17:38:43.990788+0000","last_active":"2024-09-12T17:57:32.124986+0000","last_peered":"2024-09-12T17:57:32.124986+0000","last_clean":"2024-09-12T17:57:32.124986+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T17:57:32.124986+0000","last_undegraded":"2024-09-12T17:57:32.124986+0000","last_fullsized":"2024-09-12T17:57:32.124986+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:59.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":14340,"num_write":5,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126674+0000","last_change":"2024-09-12T17:37:08.653015+0000","last_active":"2024-09-12T17:57:12.126674+0000","last_peered":"2024-09-12T17:57:12.126674+0000","last_clean":"2024-09-12T17:57:12.126674+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T17:57:12.126674+0000","last_undegraded":"2024-09-12T17:57:12.126674+0000","last_fullsized":"2024-09-12T17:57:12.126674+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:29.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137509+0000","last_change":"2024-09-12T17:49:56.043841+0000","last_active":"2024-09-12T17:57:55.137509+0000","last_peered":"2024-09-12T17:57:55.137509+0000","last_clean":"2024-09-12T17:57:55.137509+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T17:57:55.137509+0000","last_undegraded":"2024-09-12T17:57:55.137509+0000","last_fullsized":"2024-09-12T17:57:55.137509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:54.316816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.019362+0000","last_change":"2024-09-12T17:38:47.020351+0000","last_active":"2024-09-12T17:58:12.019362+0000","last_peered":"2024-09-12T17:58:12.019362+0000","last_clean":"2024-09-12T17:58:12.019362+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T17:58:12.019362+0000","last_undegraded":"2024-09-12T17:58:12.019362+0000","last_fullsized":"2024-09-12T17:58:12.019362+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:50.384206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132353+0000","last_change":"2024-09-12T17:38:43.991420+0000","last_active":"2024-09-12T17:58:03.132353+0000","last_peered":"2024-09-12T17:58:03.132353+0000","last_clean":"2024-09-12T17:58:03.132353+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T17:58:03.132353+0000","last_undegraded":"2024-09-12T17:58:03.132353+0000","last_fullsized":"2024-09-12T17:58:03.132353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126614+0000","last_change":"2024-09-12T17:37:08.656898+0000","last_active":"2024-09-12T17:57:12.126614+0000","last_peered":"2024-09-12T17:57:12.126614+0000","last_clean":"2024-09-12T17:57:12.126614+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T17:57:12.126614+0000","last_undegraded":"2024-09-12T17:57:12.126614+0000","last_fullsized":"2024-09-12T17:57:12.126614+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:09.179411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.022015+0000","last_change":"2024-09-12T17:49:56.038230+0000","last_active":"2024-09-12T17:58:17.022015+0000","last_peered":"2024-09-12T17:58:17.022015+0000","last_clean":"2024-09-12T17:58:17.022015+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T17:58:17.022015+0000","last_undegraded":"2024-09-12T17:58:17.022015+0000","last_fullsized":"2024-09-12T17:58:17.022015+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:01.328505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'1","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018999+0000","last_change":"2024-09-12T17:38:47.024390+0000","last_active":"2024-09-12T17:58:07.018999+0000","last_peered":"2024-09-12T17:58:07.018999+0000","last_clean":"2024-09-12T17:58:07.018999+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T17:58:07.018999+0000","last_undegraded":"2024-09-12T17:58:07.018999+0000","last_fullsized":"2024-09-12T17:58:07.018999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:38.074041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020049+0000","last_change":"2024-09-12T17:38:43.992661+0000","last_active":"2024-09-12T17:58:12.020049+0000","last_peered":"2024-09-12T17:58:12.020049+0000","last_clean":"2024-09-12T17:58:12.020049+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T17:58:12.020049+0000","last_undegraded":"2024-09-12T17:58:12.020049+0000","last_fullsized":"2024-09-12T17:58:12.020049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:23.126019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.118389+0000","last_change":"2024-09-12T17:37:08.657360+0000","last_active":"2024-09-12T17:58:29.118389+0000","last_peered":"2024-09-12T17:58:29.118389+0000","last_clean":"2024-09-12T17:58:29.118389+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T17:58:29.118389+0000","last_undegraded":"2024-09-12T17:58:29.118389+0000","last_fullsized":"2024-09-12T17:58:29.118389+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:37.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164252+0000","last_change":"2024-09-12T17:49:56.045176+0000","last_active":"2024-09-12T17:57:27.164252+0000","last_peered":"2024-09-12T17:57:27.164252+0000","last_clean":"2024-09-12T17:57:27.164252+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T17:57:27.164252+0000","last_undegraded":"2024-09-12T17:57:27.164252+0000","last_fullsized":"2024-09-12T17:57:27.164252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:33.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154608+0000","last_change":"2024-09-12T17:38:47.030932+0000","last_active":"2024-09-12T17:56:17.154608+0000","last_peered":"2024-09-12T17:56:17.154608+0000","last_clean":"2024-09-12T17:56:17.154608+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T17:56:17.154608+0000","last_undegraded":"2024-09-12T17:56:17.154608+0000","last_fullsized":"2024-09-12T17:56:17.154608+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:41.271072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.002901+0000","last_change":"2024-09-12T17:38:43.994843+0000","last_active":"2024-09-12T17:56:17.002901+0000","last_peered":"2024-09-12T17:56:17.002901+0000","last_clean":"2024-09-12T17:56:17.002901+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T17:56:17.002901+0000","last_undegraded":"2024-09-12T17:56:17.002901+0000","last_fullsized":"2024-09-12T17:56:17.002901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:41.681786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4663,"num_write":3,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124762+0000","last_change":"2024-09-12T17:37:08.654696+0000","last_active":"2024-09-12T17:56:30.124762+0000","last_peered":"2024-09-12T17:56:30.124762+0000","last_clean":"2024-09-12T17:56:30.124762+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T17:56:30.124762+0000","last_undegraded":"2024-09-12T17:56:30.124762+0000","last_fullsized":"2024-09-12T17:56:30.124762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:03.990843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013188+0000","last_change":"2024-09-12T17:49:56.044511+0000","last_active":"2024-09-12T17:57:27.013188+0000","last_peered":"2024-09-12T17:57:27.013188+0000","last_clean":"2024-09-12T17:57:27.013188+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T17:57:27.013188+0000","last_undegraded":"2024-09-12T17:57:27.013188+0000","last_fullsized":"2024-09-12T17:57:27.013188+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:47.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'6","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:20.123428+0000","last_change":"2024-09-12T17:38:47.024321+0000","last_active":"2024-09-12T17:56:20.123428+0000","last_peered":"2024-09-12T17:56:20.123428+0000","last_clean":"2024-09-12T17:56:20.123428+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T17:56:20.123428+0000","last_undegraded":"2024-09-12T17:56:20.123428+0000","last_fullsized":"2024-09-12T17:56:20.123428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:06.138900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7348224,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":13320,"num_write":16,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'9","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.118833+0000","last_change":"2024-09-12T17:38:43.990416+0000","last_active":"2024-09-12T17:56:17.118833+0000","last_peered":"2024-09-12T17:56:17.118833+0000","last_clean":"2024-09-12T17:56:17.118833+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T17:56:17.118833+0000","last_undegraded":"2024-09-12T17:56:17.118833+0000","last_fullsized":"2024-09-12T17:56:17.118833+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.211902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:40.117649+0000","last_change":"2024-09-12T17:37:08.660746+0000","last_active":"2024-09-12T17:58:40.117649+0000","last_peered":"2024-09-12T17:58:40.117649+0000","last_clean":"2024-09-12T17:58:40.117649+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T17:58:40.117649+0000","last_undegraded":"2024-09-12T17:58:40.117649+0000","last_fullsized":"2024-09-12T17:58:40.117649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:53.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.121922+0000","last_change":"2024-09-12T17:49:56.044578+0000","last_active":"2024-09-12T17:56:58.121922+0000","last_peered":"2024-09-12T17:56:58.121922+0000","last_clean":"2024-09-12T17:56:58.121922+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T17:56:58.121922+0000","last_undegraded":"2024-09-12T17:56:58.121922+0000","last_fullsized":"2024-09-12T17:56:58.121922+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:59.881857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139830+0000","last_change":"2024-09-12T17:38:47.024618+0000","last_active":"2024-09-12T17:58:10.139830+0000","last_peered":"2024-09-12T17:58:10.139830+0000","last_clean":"2024-09-12T17:58:10.139830+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T17:58:10.139830+0000","last_undegraded":"2024-09-12T17:58:10.139830+0000","last_fullsized":"2024-09-12T17:58:10.139830+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:49.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'9","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014371+0000","last_change":"2024-09-12T17:38:43.991705+0000","last_active":"2024-09-12T17:57:32.014371+0000","last_peered":"2024-09-12T17:57:32.014371+0000","last_clean":"2024-09-12T17:57:32.014371+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T17:57:32.014371+0000","last_undegraded":"2024-09-12T17:57:32.014371+0000","last_fullsized":"2024-09-12T17:57:32.014371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.996078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641131,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":4710,"num_write":14,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'113","reported_seq":388,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.275995+0000","last_change":"2024-09-12T17:37:08.655763+0000","last_active":"2024-09-12T17:58:17.275995+0000","last_peered":"2024-09-12T17:58:17.275995+0000","last_clean":"2024-09-12T17:58:17.275995+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T17:58:17.275995+0000","last_undegraded":"2024-09-12T17:58:17.275995+0000","last_fullsized":"2024-09-12T17:58:17.275995+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:41.813693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124631+0000","last_change":"2024-09-12T17:49:56.034209+0000","last_active":"2024-09-12T17:56:57.124631+0000","last_peered":"2024-09-12T17:56:57.124631+0000","last_clean":"2024-09-12T17:56:57.124631+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T17:56:57.124631+0000","last_undegraded":"2024-09-12T17:56:57.124631+0000","last_fullsized":"2024-09-12T17:56:57.124631+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:11.559774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127870+0000","last_change":"2024-09-12T17:38:47.024189+0000","last_active":"2024-09-12T17:57:33.127870+0000","last_peered":"2024-09-12T17:57:33.127870+0000","last_clean":"2024-09-12T17:57:33.127870+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T17:57:33.127870+0000","last_undegraded":"2024-09-12T17:57:33.127870+0000","last_fullsized":"2024-09-12T17:57:33.127870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:12.716839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018494+0000","last_change":"2024-09-12T17:38:43.995454+0000","last_active":"2024-09-12T17:58:07.018494+0000","last_peered":"2024-09-12T17:58:07.018494+0000","last_clean":"2024-09-12T17:58:07.018494+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T17:58:07.018494+0000","last_undegraded":"2024-09-12T17:58:07.018494+0000","last_fullsized":"2024-09-12T17:58:07.018494+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.629425+0000","last_change":"2024-09-12T17:37:08.650302+0000","last_active":"2024-09-12T17:58:28.629425+0000","last_peered":"2024-09-12T17:58:28.629425+0000","last_clean":"2024-09-12T17:58:28.629425+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T17:58:28.629425+0000","last_undegraded":"2024-09-12T17:58:28.629425+0000","last_fullsized":"2024-09-12T17:58:28.629425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:26.087974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159949+0000","last_change":"2024-09-12T17:49:56.037995+0000","last_active":"2024-09-12T17:56:57.159949+0000","last_peered":"2024-09-12T17:56:57.159949+0000","last_clean":"2024-09-12T17:56:57.159949+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T17:56:57.159949+0000","last_undegraded":"2024-09-12T17:56:57.159949+0000","last_fullsized":"2024-09-12T17:56:57.159949+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:04.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139871+0000","last_change":"2024-09-12T17:38:47.016476+0000","last_active":"2024-09-12T17:58:10.139871+0000","last_peered":"2024-09-12T17:58:10.139871+0000","last_clean":"2024-09-12T17:58:10.139871+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T17:58:10.139871+0000","last_undegraded":"2024-09-12T17:58:10.139871+0000","last_fullsized":"2024-09-12T17:58:10.139871+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:05.344871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138926+0000","last_change":"2024-09-12T17:38:43.996222+0000","last_active":"2024-09-12T17:58:05.138926+0000","last_peered":"2024-09-12T17:58:05.138926+0000","last_clean":"2024-09-12T17:58:05.138926+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T17:58:05.138926+0000","last_undegraded":"2024-09-12T17:58:05.138926+0000","last_fullsized":"2024-09-12T17:58:05.138926+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:17.497778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124845+0000","last_change":"2024-09-12T17:37:08.661473+0000","last_active":"2024-09-12T17:56:30.124845+0000","last_peered":"2024-09-12T17:56:30.124845+0000","last_clean":"2024-09-12T17:56:30.124845+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T17:56:30.124845+0000","last_undegraded":"2024-09-12T17:56:30.124845+0000","last_fullsized":"2024-09-12T17:56:30.124845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:03.318444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.008878+0000","last_change":"2024-09-12T17:49:56.045356+0000","last_active":"2024-09-12T17:56:57.008878+0000","last_peered":"2024-09-12T17:56:57.008878+0000","last_clean":"2024-09-12T17:56:57.008878+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T17:56:57.008878+0000","last_undegraded":"2024-09-12T17:56:57.008878+0000","last_fullsized":"2024-09-12T17:56:57.008878+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:33.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'1","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018535+0000","last_change":"2024-09-12T17:38:47.023380+0000","last_active":"2024-09-12T17:58:07.018535+0000","last_peered":"2024-09-12T17:58:07.018535+0000","last_clean":"2024-09-12T17:58:07.018535+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T17:58:07.018535+0000","last_undegraded":"2024-09-12T17:58:07.018535+0000","last_fullsized":"2024-09-12T17:58:07.018535+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.275074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132508+0000","last_change":"2024-09-12T17:38:43.989365+0000","last_active":"2024-09-12T17:58:03.132508+0000","last_peered":"2024-09-12T17:58:03.132508+0000","last_clean":"2024-09-12T17:58:03.132508+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T17:58:03.132508+0000","last_undegraded":"2024-09-12T17:58:03.132508+0000","last_fullsized":"2024-09-12T17:58:03.132508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:53.634008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020922+0000","last_change":"2024-09-12T17:37:08.651846+0000","last_active":"2024-09-12T17:58:17.020922+0000","last_peered":"2024-09-12T17:58:17.020922+0000","last_clean":"2024-09-12T17:58:17.020922+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T17:58:17.020922+0000","last_undegraded":"2024-09-12T17:58:17.020922+0000","last_fullsized":"2024-09-12T17:58:17.020922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:47.950299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:13.124363+0000","last_change":"2024-09-12T17:49:56.042508+0000","last_active":"2024-09-12T17:57:13.124363+0000","last_peered":"2024-09-12T17:57:13.124363+0000","last_clean":"2024-09-12T17:57:13.124363+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T17:57:13.124363+0000","last_undegraded":"2024-09-12T17:57:13.124363+0000","last_fullsized":"2024-09-12T17:57:13.124363+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:56.026526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.127091+0000","last_change":"2024-09-12T17:38:47.028439+0000","last_active":"2024-09-12T17:57:28.127091+0000","last_peered":"2024-09-12T17:57:28.127091+0000","last_clean":"2024-09-12T17:57:28.127091+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T17:57:28.127091+0000","last_undegraded":"2024-09-12T17:57:28.127091+0000","last_fullsized":"2024-09-12T17:57:28.127091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:40.113111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124185+0000","last_change":"2024-09-12T17:38:43.990984+0000","last_active":"2024-09-12T17:57:27.124185+0000","last_peered":"2024-09-12T17:57:27.124185+0000","last_clean":"2024-09-12T17:57:27.124185+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T17:57:27.124185+0000","last_undegraded":"2024-09-12T17:57:27.124185+0000","last_fullsized":"2024-09-12T17:57:27.124185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:55.979807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020118+0000","last_change":"2024-09-12T17:37:08.656056+0000","last_active":"2024-09-12T17:58:12.020118+0000","last_peered":"2024-09-12T17:58:12.020118+0000","last_clean":"2024-09-12T17:58:12.020118+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T17:58:12.020118+0000","last_undegraded":"2024-09-12T17:58:12.020118+0000","last_fullsized":"2024-09-12T17:58:12.020118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:45.733213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126727+0000","last_change":"2024-09-12T17:49:56.042525+0000","last_active":"2024-09-12T17:57:12.126727+0000","last_peered":"2024-09-12T17:57:12.126727+0000","last_clean":"2024-09-12T17:57:12.126727+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T17:57:12.126727+0000","last_undegraded":"2024-09-12T17:57:12.126727+0000","last_fullsized":"2024-09-12T17:57:12.126727+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:07.790123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.147415+0000","last_change":"2024-09-12T17:38:47.030812+0000","last_active":"2024-09-12T17:59:48.147415+0000","last_peered":"2024-09-12T17:59:48.147415+0000","last_clean":"2024-09-12T17:59:48.147415+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T17:59:48.147415+0000","last_undegraded":"2024-09-12T17:59:48.147415+0000","last_fullsized":"2024-09-12T17:59:48.147415+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:21.678813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10258,"num_write":14,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.126144+0000","last_change":"2024-09-12T17:38:43.987476+0000","last_active":"2024-09-12T17:57:23.126144+0000","last_peered":"2024-09-12T17:57:23.126144+0000","last_clean":"2024-09-12T17:57:23.126144+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T17:57:23.126144+0000","last_undegraded":"2024-09-12T17:57:23.126144+0000","last_fullsized":"2024-09-12T17:57:23.126144+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.672726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139794+0000","last_change":"2024-09-12T17:37:08.661575+0000","last_active":"2024-09-12T17:58:10.139794+0000","last_peered":"2024-09-12T17:58:10.139794+0000","last_clean":"2024-09-12T17:58:10.139794+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T17:58:10.139794+0000","last_undegraded":"2024-09-12T17:58:10.139794+0000","last_fullsized":"2024-09-12T17:58:10.139794+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:44.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009869+0000","last_change":"2024-09-12T17:49:56.037386+0000","last_active":"2024-09-12T17:57:02.009869+0000","last_peered":"2024-09-12T17:57:02.009869+0000","last_clean":"2024-09-12T17:57:02.009869+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T17:57:02.009869+0000","last_undegraded":"2024-09-12T17:57:02.009869+0000","last_fullsized":"2024-09-12T17:57:02.009869+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:00.713527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:30.133900+0000","last_change":"2024-09-12T17:38:47.022479+0000","last_active":"2024-09-12T17:57:30.133900+0000","last_peered":"2024-09-12T17:57:30.133900+0000","last_clean":"2024-09-12T17:57:30.133900+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T17:57:30.133900+0000","last_undegraded":"2024-09-12T17:57:30.133900+0000","last_fullsized":"2024-09-12T17:57:30.133900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:49.306337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124233+0000","last_change":"2024-09-12T17:38:43.988889+0000","last_active":"2024-09-12T17:57:27.124233+0000","last_peered":"2024-09-12T17:57:27.124233+0000","last_clean":"2024-09-12T17:57:27.124233+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T17:57:27.124233+0000","last_undegraded":"2024-09-12T17:57:27.124233+0000","last_fullsized":"2024-09-12T17:57:27.124233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:26.795414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7172,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.170376+0000","last_change":"2024-09-12T17:37:08.658663+0000","last_active":"2024-09-12T17:58:12.170376+0000","last_peered":"2024-09-12T17:58:12.170376+0000","last_clean":"2024-09-12T17:58:12.170376+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T17:58:12.170376+0000","last_undegraded":"2024-09-12T17:58:12.170376+0000","last_fullsized":"2024-09-12T17:58:12.170376+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.276415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126695+0000","last_change":"2024-09-12T17:49:56.036857+0000","last_active":"2024-09-12T17:57:12.126695+0000","last_peered":"2024-09-12T17:57:12.126695+0000","last_clean":"2024-09-12T17:57:12.126695+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T17:57:12.126695+0000","last_undegraded":"2024-09-12T17:57:12.126695+0000","last_fullsized":"2024-09-12T17:57:12.126695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:01.304735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013658+0000","last_change":"2024-09-12T17:38:47.019373+0000","last_active":"2024-09-12T17:57:27.013658+0000","last_peered":"2024-09-12T17:57:27.013658+0000","last_clean":"2024-09-12T17:57:27.013658+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T17:57:27.013658+0000","last_undegraded":"2024-09-12T17:57:27.013658+0000","last_fullsized":"2024-09-12T17:57:27.013658+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:16.314152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124255+0000","last_change":"2024-09-12T17:38:43.992720+0000","last_active":"2024-09-12T17:57:27.124255+0000","last_peered":"2024-09-12T17:57:27.124255+0000","last_clean":"2024-09-12T17:57:27.124255+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T17:57:27.124255+0000","last_undegraded":"2024-09-12T17:57:27.124255+0000","last_fullsized":"2024-09-12T17:57:27.124255+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:49.377878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.480567+0000","last_change":"2024-09-12T17:37:08.662089+0000","last_active":"2024-09-12T17:58:18.480567+0000","last_peered":"2024-09-12T17:58:18.480567+0000","last_clean":"2024-09-12T17:58:18.480567+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T17:58:18.480567+0000","last_undegraded":"2024-09-12T17:58:18.480567+0000","last_fullsized":"2024-09-12T17:58:18.480567+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:41.016001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.137350+0000","last_change":"2024-09-12T17:49:56.047641+0000","last_active":"2024-09-12T17:58:43.137350+0000","last_peered":"2024-09-12T17:58:43.137350+0000","last_clean":"2024-09-12T17:58:43.137350+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T17:58:43.137350+0000","last_undegraded":"2024-09-12T17:58:43.137350+0000","last_fullsized":"2024-09-12T17:58:43.137350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:16.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127812+0000","last_change":"2024-09-12T17:38:47.029582+0000","last_active":"2024-09-12T17:56:50.127812+0000","last_peered":"2024-09-12T17:56:50.127812+0000","last_clean":"2024-09-12T17:56:50.127812+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T17:56:50.127812+0000","last_undegraded":"2024-09-12T17:56:50.127812+0000","last_fullsized":"2024-09-12T17:56:50.127812+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.565082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.158658+0000","last_change":"2024-09-12T17:38:43.989865+0000","last_active":"2024-09-12T17:56:47.158658+0000","last_peered":"2024-09-12T17:56:47.158658+0000","last_clean":"2024-09-12T17:56:47.158658+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T17:56:47.158658+0000","last_undegraded":"2024-09-12T17:56:47.158658+0000","last_fullsized":"2024-09-12T17:56:47.158658+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:53.024317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133309+0000","last_change":"2024-09-12T17:37:08.662016+0000","last_active":"2024-09-12T17:57:25.133309+0000","last_peered":"2024-09-12T17:57:25.133309+0000","last_clean":"2024-09-12T17:57:25.133309+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T17:57:25.133309+0000","last_undegraded":"2024-09-12T17:57:25.133309+0000","last_fullsized":"2024-09-12T17:57:25.133309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:38.421910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.117628+0000","last_change":"2024-09-12T17:49:56.049044+0000","last_active":"2024-09-12T17:56:42.117628+0000","last_peered":"2024-09-12T17:56:42.117628+0000","last_clean":"2024-09-12T17:56:42.117628+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T17:56:42.117628+0000","last_undegraded":"2024-09-12T17:56:42.117628+0000","last_fullsized":"2024-09-12T17:56:42.117628+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:10.014418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127772+0000","last_change":"2024-09-12T17:38:47.025348+0000","last_active":"2024-09-12T17:56:50.127772+0000","last_peered":"2024-09-12T17:56:50.127772+0000","last_clean":"2024-09-12T17:56:50.127772+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T17:56:50.127772+0000","last_undegraded":"2024-09-12T17:56:50.127772+0000","last_fullsized":"2024-09-12T17:56:50.127772+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:14.763266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.123070+0000","last_change":"2024-09-12T17:38:43.989723+0000","last_active":"2024-09-12T17:56:47.123070+0000","last_peered":"2024-09-12T17:56:47.123070+0000","last_clean":"2024-09-12T17:56:47.123070+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T17:56:47.123070+0000","last_undegraded":"2024-09-12T17:56:47.123070+0000","last_fullsized":"2024-09-12T17:56:47.123070+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:38.471857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8392704,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":3,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013744+0000","last_change":"2024-09-12T17:37:08.648920+0000","last_active":"2024-09-12T17:57:27.013744+0000","last_peered":"2024-09-12T17:57:27.013744+0000","last_clean":"2024-09-12T17:57:27.013744+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T17:57:27.013744+0000","last_undegraded":"2024-09-12T17:57:27.013744+0000","last_fullsized":"2024-09-12T17:57:27.013744+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.023058+0000","last_change":"2024-09-12T17:49:56.036894+0000","last_active":"2024-09-12T17:58:37.023058+0000","last_peered":"2024-09-12T17:58:37.023058+0000","last_clean":"2024-09-12T17:58:37.023058+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T17:58:37.023058+0000","last_undegraded":"2024-09-12T17:58:37.023058+0000","last_fullsized":"2024-09-12T17:58:37.023058+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:30.781444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'5","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127863+0000","last_change":"2024-09-12T17:38:47.027005+0000","last_active":"2024-09-12T17:56:50.127863+0000","last_peered":"2024-09-12T17:56:50.127863+0000","last_clean":"2024-09-12T17:56:50.127863+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T17:56:50.127863+0000","last_undegraded":"2024-09-12T17:56:50.127863+0000","last_fullsized":"2024-09-12T17:56:50.127863+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:26.959823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10534097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":15452,"num_write":5,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:45.127156+0000","last_change":"2024-09-12T17:38:43.996009+0000","last_active":"2024-09-12T17:56:45.127156+0000","last_peered":"2024-09-12T17:56:45.127156+0000","last_clean":"2024-09-12T17:56:45.127156+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T17:56:45.127156+0000","last_undegraded":"2024-09-12T17:56:45.127156+0000","last_fullsized":"2024-09-12T17:56:45.127156+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.956208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4108,"num_write":5,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124276+0000","last_change":"2024-09-12T17:37:08.653415+0000","last_active":"2024-09-12T17:57:27.124276+0000","last_peered":"2024-09-12T17:57:27.124276+0000","last_clean":"2024-09-12T17:57:27.124276+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T17:57:27.124276+0000","last_undegraded":"2024-09-12T17:57:27.124276+0000","last_fullsized":"2024-09-12T17:57:27.124276+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:16.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.133197+0000","last_change":"2024-09-12T17:49:56.047746+0000","last_active":"2024-09-12T17:58:37.133197+0000","last_peered":"2024-09-12T17:58:37.133197+0000","last_clean":"2024-09-12T17:58:37.133197+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T17:58:37.133197+0000","last_undegraded":"2024-09-12T17:58:37.133197+0000","last_fullsized":"2024-09-12T17:58:37.133197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:19.785797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:48.120271+0000","last_change":"2024-09-12T17:38:47.022037+0000","last_active":"2024-09-12T17:56:48.120271+0000","last_peered":"2024-09-12T17:56:48.120271+0000","last_clean":"2024-09-12T17:56:48.120271+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T17:56:48.120271+0000","last_undegraded":"2024-09-12T17:56:48.120271+0000","last_fullsized":"2024-09-12T17:56:48.120271+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:58.528885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11258,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:45.127205+0000","last_change":"2024-09-12T17:38:43.991999+0000","last_active":"2024-09-12T17:56:45.127205+0000","last_peered":"2024-09-12T17:56:45.127205+0000","last_clean":"2024-09-12T17:56:45.127205+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T17:56:45.127205+0000","last_undegraded":"2024-09-12T17:56:45.127205+0000","last_fullsized":"2024-09-12T17:56:45.127205+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:23.142677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128990+0000","last_change":"2024-09-12T17:37:08.659437+0000","last_active":"2024-09-12T17:57:27.128990+0000","last_peered":"2024-09-12T17:57:27.128990+0000","last_clean":"2024-09-12T17:57:27.128990+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T17:57:27.128990+0000","last_undegraded":"2024-09-12T17:57:27.128990+0000","last_fullsized":"2024-09-12T17:57:27.128990+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:00.942567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:43.119397+0000","last_change":"2024-09-12T17:49:56.045196+0000","last_active":"2024-09-12T17:56:43.119397+0000","last_peered":"2024-09-12T17:56:43.119397+0000","last_clean":"2024-09-12T17:56:43.119397+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T17:56:43.119397+0000","last_undegraded":"2024-09-12T17:56:43.119397+0000","last_fullsized":"2024-09-12T17:56:43.119397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:39.426641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020855+0000","last_change":"2024-09-12T17:38:47.020511+0000","last_active":"2024-09-12T17:58:17.020855+0000","last_peered":"2024-09-12T17:58:17.020855+0000","last_clean":"2024-09-12T17:58:17.020855+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T17:58:17.020855+0000","last_undegraded":"2024-09-12T17:58:17.020855+0000","last_fullsized":"2024-09-12T17:58:17.020855+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.015103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:15.140467+0000","last_change":"2024-09-12T17:38:43.993571+0000","last_active":"2024-09-12T17:58:15.140467+0000","last_peered":"2024-09-12T17:58:15.140467+0000","last_clean":"2024-09-12T17:58:15.140467+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T17:58:15.140467+0000","last_undegraded":"2024-09-12T17:58:15.140467+0000","last_fullsized":"2024-09-12T17:58:15.140467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.884799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128966+0000","last_change":"2024-09-12T17:37:08.656385+0000","last_active":"2024-09-12T17:57:27.128966+0000","last_peered":"2024-09-12T17:57:27.128966+0000","last_clean":"2024-09-12T17:57:27.128966+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T17:57:27.128966+0000","last_undegraded":"2024-09-12T17:57:27.128966+0000","last_fullsized":"2024-09-12T17:57:27.128966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.157975+0000","last_change":"2024-09-12T17:49:56.048011+0000","last_active":"2024-09-12T17:56:42.157975+0000","last_peered":"2024-09-12T17:56:42.157975+0000","last_clean":"2024-09-12T17:56:42.157975+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T17:56:42.157975+0000","last_undegraded":"2024-09-12T17:56:42.157975+0000","last_fullsized":"2024-09-12T17:56:42.157975+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:44.187088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.170917+0000","last_change":"2024-09-12T17:38:47.032812+0000","last_active":"2024-09-12T17:58:17.170917+0000","last_peered":"2024-09-12T17:58:17.170917+0000","last_clean":"2024-09-12T17:58:17.170917+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T17:58:17.170917+0000","last_undegraded":"2024-09-12T17:58:17.170917+0000","last_fullsized":"2024-09-12T17:58:17.170917+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:16.283298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.133853+0000","last_change":"2024-09-12T17:38:43.988490+0000","last_active":"2024-09-12T17:58:13.133853+0000","last_peered":"2024-09-12T17:58:13.133853+0000","last_clean":"2024-09-12T17:58:13.133853+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T17:58:13.133853+0000","last_undegraded":"2024-09-12T17:58:13.133853+0000","last_fullsized":"2024-09-12T17:58:13.133853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.984138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.428411+0000","last_change":"2024-09-12T17:37:08.652495+0000","last_active":"2024-09-12T17:59:07.428411+0000","last_peered":"2024-09-12T17:59:07.428411+0000","last_clean":"2024-09-12T17:59:07.428411+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T17:59:07.428411+0000","last_undegraded":"2024-09-12T17:59:07.428411+0000","last_fullsized":"2024-09-12T17:59:07.428411+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:18.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.006624+0000","last_change":"2024-09-12T17:49:56.045788+0000","last_active":"2024-09-12T17:56:42.006624+0000","last_peered":"2024-09-12T17:56:42.006624+0000","last_clean":"2024-09-12T17:56:42.006624+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T17:56:42.006624+0000","last_undegraded":"2024-09-12T17:56:42.006624+0000","last_fullsized":"2024-09-12T17:56:42.006624+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:29.577491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.123014+0000","last_change":"2024-09-12T17:38:47.030610+0000","last_active":"2024-09-12T17:56:47.123014+0000","last_peered":"2024-09-12T17:56:47.123014+0000","last_clean":"2024-09-12T17:56:47.123014+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T17:56:47.123014+0000","last_undegraded":"2024-09-12T17:56:47.123014+0000","last_fullsized":"2024-09-12T17:56:47.123014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:48.238050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:15.140519+0000","last_change":"2024-09-12T17:38:43.992844+0000","last_active":"2024-09-12T17:58:15.140519+0000","last_peered":"2024-09-12T17:58:15.140519+0000","last_clean":"2024-09-12T17:58:15.140519+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T17:58:15.140519+0000","last_undegraded":"2024-09-12T17:58:15.140519+0000","last_fullsized":"2024-09-12T17:58:15.140519+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:06.166487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":15350,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138340+0000","last_change":"2024-09-12T17:37:08.661047+0000","last_active":"2024-09-12T17:58:48.138340+0000","last_peered":"2024-09-12T17:58:48.138340+0000","last_clean":"2024-09-12T17:58:48.138340+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T17:58:48.138340+0000","last_undegraded":"2024-09-12T17:58:48.138340+0000","last_fullsized":"2024-09-12T17:58:48.138340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:35.362254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:40.126255+0000","last_change":"2024-09-12T17:49:56.045203+0000","last_active":"2024-09-12T17:56:40.126255+0000","last_peered":"2024-09-12T17:56:40.126255+0000","last_clean":"2024-09-12T17:56:40.126255+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T17:56:40.126255+0000","last_undegraded":"2024-09-12T17:56:40.126255+0000","last_fullsized":"2024-09-12T17:56:40.126255+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.690292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.020496+0000","last_change":"2024-09-12T17:38:47.026783+0000","last_active":"2024-09-12T17:58:22.020496+0000","last_peered":"2024-09-12T17:58:22.020496+0000","last_clean":"2024-09-12T17:58:22.020496+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T17:58:22.020496+0000","last_undegraded":"2024-09-12T17:58:22.020496+0000","last_fullsized":"2024-09-12T17:58:22.020496+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:20.362697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.007702+0000","last_change":"2024-09-12T17:38:43.993534+0000","last_active":"2024-09-12T17:56:47.007702+0000","last_peered":"2024-09-12T17:56:47.007702+0000","last_clean":"2024-09-12T17:56:47.007702+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T17:56:47.007702+0000","last_undegraded":"2024-09-12T17:56:47.007702+0000","last_fullsized":"2024-09-12T17:56:47.007702+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:36.199628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.024519+0000","last_change":"2024-09-12T17:37:08.652306+0000","last_active":"2024-09-12T17:58:52.024519+0000","last_peered":"2024-09-12T17:58:52.024519+0000","last_clean":"2024-09-12T17:58:52.024519+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T17:58:52.024519+0000","last_undegraded":"2024-09-12T17:58:52.024519+0000","last_fullsized":"2024-09-12T17:58:52.024519+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.726476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.019998+0000","last_change":"2024-09-12T17:49:56.046641+0000","last_active":"2024-09-12T17:58:17.019998+0000","last_peered":"2024-09-12T17:58:17.019998+0000","last_clean":"2024-09-12T17:58:17.019998+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T17:58:17.019998+0000","last_undegraded":"2024-09-12T17:58:17.019998+0000","last_fullsized":"2024-09-12T17:58:17.019998+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:58.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'7","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:38.128643+0000","last_change":"2024-09-12T17:38:47.030849+0000","last_active":"2024-09-12T17:57:38.128643+0000","last_peered":"2024-09-12T17:57:38.128643+0000","last_clean":"2024-09-12T17:57:38.128643+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T17:57:38.128643+0000","last_undegraded":"2024-09-12T17:57:38.128643+0000","last_fullsized":"2024-09-12T17:57:38.128643+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:33.916148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014388+0000","last_change":"2024-09-12T17:38:43.991595+0000","last_active":"2024-09-12T17:57:32.014388+0000","last_peered":"2024-09-12T17:57:32.014388+0000","last_clean":"2024-09-12T17:57:32.014388+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T17:57:32.014388+0000","last_undegraded":"2024-09-12T17:57:32.014388+0000","last_fullsized":"2024-09-12T17:57:32.014388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.739988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025891+0000","last_change":"2024-09-12T17:37:08.661553+0000","last_active":"2024-09-12T17:58:52.025891+0000","last_peered":"2024-09-12T17:58:52.025891+0000","last_clean":"2024-09-12T17:58:52.025891+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T17:58:52.025891+0000","last_undegraded":"2024-09-12T17:58:52.025891+0000","last_fullsized":"2024-09-12T17:58:52.025891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.649379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020012+0000","last_change":"2024-09-12T17:49:56.041888+0000","last_active":"2024-09-12T17:58:17.020012+0000","last_peered":"2024-09-12T17:58:17.020012+0000","last_clean":"2024-09-12T17:58:17.020012+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T17:58:17.020012+0000","last_undegraded":"2024-09-12T17:58:17.020012+0000","last_fullsized":"2024-09-12T17:58:17.020012+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127910+0000","last_change":"2024-09-12T17:38:47.024913+0000","last_active":"2024-09-12T17:57:33.127910+0000","last_peered":"2024-09-12T17:57:33.127910+0000","last_clean":"2024-09-12T17:57:33.127910+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T17:57:33.127910+0000","last_undegraded":"2024-09-12T17:57:33.127910+0000","last_fullsized":"2024-09-12T17:57:33.127910+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:06.755928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:37.015192+0000","last_change":"2024-09-12T17:38:43.990480+0000","last_active":"2024-09-12T17:57:37.015192+0000","last_peered":"2024-09-12T17:57:37.015192+0000","last_clean":"2024-09-12T17:57:37.015192+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T17:57:37.015192+0000","last_undegraded":"2024-09-12T17:57:37.015192+0000","last_fullsized":"2024-09-12T17:57:37.015192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:13.712977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":20468,"num_write":11,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025154+0000","last_change":"2024-09-12T17:37:08.649723+0000","last_active":"2024-09-12T17:58:52.025154+0000","last_peered":"2024-09-12T17:58:52.025154+0000","last_clean":"2024-09-12T17:58:52.025154+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T17:58:52.025154+0000","last_undegraded":"2024-09-12T17:58:52.025154+0000","last_fullsized":"2024-09-12T17:58:52.025154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.186149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132327+0000","last_change":"2024-09-12T17:49:56.046876+0000","last_active":"2024-09-12T17:58:03.132327+0000","last_peered":"2024-09-12T17:58:03.132327+0000","last_clean":"2024-09-12T17:58:03.132327+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T17:58:03.132327+0000","last_undegraded":"2024-09-12T17:58:03.132327+0000","last_fullsized":"2024-09-12T17:58:03.132327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:45.910023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020050+0000","last_change":"2024-09-12T17:38:47.026137+0000","last_active":"2024-09-12T17:58:17.020050+0000","last_peered":"2024-09-12T17:58:17.020050+0000","last_clean":"2024-09-12T17:58:17.020050+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T17:58:17.020050+0000","last_undegraded":"2024-09-12T17:58:17.020050+0000","last_fullsized":"2024-09-12T17:58:17.020050+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:14.366739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.171001+0000","last_change":"2024-09-12T17:38:43.992358+0000","last_active":"2024-09-12T17:58:17.171001+0000","last_peered":"2024-09-12T17:58:17.171001+0000","last_clean":"2024-09-12T17:58:17.171001+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T17:58:17.171001+0000","last_undegraded":"2024-09-12T17:58:17.171001+0000","last_fullsized":"2024-09-12T17:58:17.171001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:38.097131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.169817+0000","last_change":"2024-09-12T17:37:08.658795+0000","last_active":"2024-09-12T17:58:07.169817+0000","last_peered":"2024-09-12T17:58:07.169817+0000","last_clean":"2024-09-12T17:58:07.169817+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T17:58:07.169817+0000","last_undegraded":"2024-09-12T17:58:07.169817+0000","last_fullsized":"2024-09-12T17:58:07.169817+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.988783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020817+0000","last_change":"2024-09-12T17:49:56.036001+0000","last_active":"2024-09-12T17:58:17.020817+0000","last_peered":"2024-09-12T17:58:17.020817+0000","last_clean":"2024-09-12T17:58:17.020817+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T17:58:17.020817+0000","last_undegraded":"2024-09-12T17:58:17.020817+0000","last_fullsized":"2024-09-12T17:58:17.020817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:20.176376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'4","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021010+0000","last_change":"2024-09-12T17:38:47.021549+0000","last_active":"2024-09-12T17:58:17.021010+0000","last_peered":"2024-09-12T17:58:17.021010+0000","last_clean":"2024-09-12T17:58:17.021010+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T17:58:17.021010+0000","last_undegraded":"2024-09-12T17:58:17.021010+0000","last_fullsized":"2024-09-12T17:58:17.021010+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:06.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5116,"num_write":9,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021033+0000","last_change":"2024-09-12T17:38:43.994549+0000","last_active":"2024-09-12T17:58:17.021033+0000","last_peered":"2024-09-12T17:58:17.021033+0000","last_clean":"2024-09-12T17:58:17.021033+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T17:58:17.021033+0000","last_undegraded":"2024-09-12T17:58:17.021033+0000","last_fullsized":"2024-09-12T17:58:17.021033+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:30.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":171,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.435685+0000","last_change":"2024-09-12T17:37:08.659177+0000","last_active":"2024-09-12T17:59:07.435685+0000","last_peered":"2024-09-12T17:59:07.435685+0000","last_clean":"2024-09-12T17:59:07.435685+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T17:59:07.435685+0000","last_undegraded":"2024-09-12T17:59:07.435685+0000","last_fullsized":"2024-09-12T17:59:07.435685+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:04.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:35.142766+0000","last_change":"2024-09-12T17:49:56.038182+0000","last_active":"2024-09-12T17:58:35.142766+0000","last_peered":"2024-09-12T17:58:35.142766+0000","last_clean":"2024-09-12T17:58:35.142766+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T17:58:35.142766+0000","last_undegraded":"2024-09-12T17:58:35.142766+0000","last_fullsized":"2024-09-12T17:58:35.142766+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:22.086611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014474+0000","last_change":"2024-09-12T17:38:47.026375+0000","last_active":"2024-09-12T17:57:32.014474+0000","last_peered":"2024-09-12T17:57:32.014474+0000","last_clean":"2024-09-12T17:57:32.014474+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T17:57:32.014474+0000","last_undegraded":"2024-09-12T17:57:32.014474+0000","last_fullsized":"2024-09-12T17:57:32.014474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:56.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.175038+0000","last_change":"2024-09-12T17:38:43.992950+0000","last_active":"2024-09-12T17:58:52.175038+0000","last_peered":"2024-09-12T17:58:52.175038+0000","last_clean":"2024-09-12T17:58:52.175038+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T17:58:52.175038+0000","last_undegraded":"2024-09-12T17:58:52.175038+0000","last_fullsized":"2024-09-12T17:58:52.175038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:18.833241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.762077+0000","last_change":"2024-09-12T17:37:08.654619+0000","last_active":"2024-09-12T17:59:07.762077+0000","last_peered":"2024-09-12T17:59:07.762077+0000","last_clean":"2024-09-12T17:59:07.762077+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T17:59:07.762077+0000","last_undegraded":"2024-09-12T17:59:07.762077+0000","last_fullsized":"2024-09-12T17:59:07.762077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:44.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.024006+0000","last_change":"2024-09-12T17:49:56.039258+0000","last_active":"2024-09-12T17:58:37.024006+0000","last_peered":"2024-09-12T17:58:37.024006+0000","last_clean":"2024-09-12T17:58:37.024006+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T17:58:37.024006+0000","last_undegraded":"2024-09-12T17:58:37.024006+0000","last_fullsized":"2024-09-12T17:58:37.024006+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.182004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025035+0000","last_change":"2024-09-12T17:38:47.026063+0000","last_active":"2024-09-12T17:58:52.025035+0000","last_peered":"2024-09-12T17:58:52.025035+0000","last_clean":"2024-09-12T17:58:52.025035+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T17:58:52.025035+0000","last_undegraded":"2024-09-12T17:58:52.025035+0000","last_fullsized":"2024-09-12T17:58:52.025035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.717038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4778667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3651,"num_write":10,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014307+0000","last_change":"2024-09-12T17:38:43.988186+0000","last_active":"2024-09-12T17:57:32.014307+0000","last_peered":"2024-09-12T17:57:32.014307+0000","last_clean":"2024-09-12T17:57:32.014307+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T17:57:32.014307+0000","last_undegraded":"2024-09-12T17:57:32.014307+0000","last_fullsized":"2024-09-12T17:57:32.014307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:03.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.018369+0000","last_change":"2024-09-12T17:37:08.647170+0000","last_active":"2024-09-12T17:58:02.018369+0000","last_peered":"2024-09-12T17:58:02.018369+0000","last_clean":"2024-09-12T17:58:02.018369+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T17:58:02.018369+0000","last_undegraded":"2024-09-12T17:58:02.018369+0000","last_fullsized":"2024-09-12T17:58:02.018369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:33.128612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.134437+0000","last_change":"2024-09-12T17:49:56.044807+0000","last_active":"2024-09-12T17:58:18.134437+0000","last_peered":"2024-09-12T17:58:18.134437+0000","last_clean":"2024-09-12T17:58:18.134437+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T17:58:18.134437+0000","last_undegraded":"2024-09-12T17:58:18.134437+0000","last_fullsized":"2024-09-12T17:58:18.134437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:28.012638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164999+0000","last_change":"2024-09-12T17:38:47.035193+0000","last_active":"2024-09-12T17:57:32.164999+0000","last_peered":"2024-09-12T17:57:32.164999+0000","last_clean":"2024-09-12T17:57:32.164999+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T17:57:32.164999+0000","last_undegraded":"2024-09-12T17:57:32.164999+0000","last_fullsized":"2024-09-12T17:57:32.164999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:54.991568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.129624+0000","last_change":"2024-09-12T17:38:43.993095+0000","last_active":"2024-09-12T17:57:32.129624+0000","last_peered":"2024-09-12T17:57:32.129624+0000","last_clean":"2024-09-12T17:57:32.129624+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T17:57:32.129624+0000","last_undegraded":"2024-09-12T17:57:32.129624+0000","last_fullsized":"2024-09-12T17:57:32.129624+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:07.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4118,"num_write":5,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.571968+0000","last_change":"2024-09-12T17:37:08.656010+0000","last_active":"2024-09-12T17:59:05.571968+0000","last_peered":"2024-09-12T17:59:05.571968+0000","last_clean":"2024-09-12T17:59:05.571968+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T17:59:05.571968+0000","last_undegraded":"2024-09-12T17:59:05.571968+0000","last_fullsized":"2024-09-12T17:59:05.571968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.346921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021616+0000","last_change":"2024-09-12T17:49:56.043230+0000","last_active":"2024-09-12T17:58:22.021616+0000","last_peered":"2024-09-12T17:58:22.021616+0000","last_clean":"2024-09-12T17:58:22.021616+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T17:58:22.021616+0000","last_undegraded":"2024-09-12T17:58:22.021616+0000","last_fullsized":"2024-09-12T17:58:22.021616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:33.627052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164967+0000","last_change":"2024-09-12T17:38:47.029841+0000","last_active":"2024-09-12T17:57:32.164967+0000","last_peered":"2024-09-12T17:57:32.164967+0000","last_clean":"2024-09-12T17:57:32.164967+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T17:57:32.164967+0000","last_undegraded":"2024-09-12T17:57:32.164967+0000","last_fullsized":"2024-09-12T17:57:32.164967+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:16.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.124927+0000","last_change":"2024-09-12T17:38:43.992352+0000","last_active":"2024-09-12T17:57:32.124927+0000","last_peered":"2024-09-12T17:57:32.124927+0000","last_clean":"2024-09-12T17:57:32.124927+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T17:57:32.124927+0000","last_undegraded":"2024-09-12T17:57:32.124927+0000","last_fullsized":"2024-09-12T17:57:32.124927+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:57.443048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.100022+0000","last_change":"2024-09-12T17:37:08.651452+0000","last_active":"2024-09-12T17:58:28.100022+0000","last_peered":"2024-09-12T17:58:28.100022+0000","last_clean":"2024-09-12T17:58:28.100022+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T17:58:28.100022+0000","last_undegraded":"2024-09-12T17:58:28.100022+0000","last_fullsized":"2024-09-12T17:58:28.100022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:02.681669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'268","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.286608+0000","last_change":"2024-09-12T17:21:50.778519+0000","last_active":"2024-09-12T17:59:12.286608+0000","last_peered":"2024-09-12T17:59:12.286608+0000","last_clean":"2024-09-12T17:59:12.286608+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T17:59:12.286608+0000","last_undegraded":"2024-09-12T17:59:12.286608+0000","last_fullsized":"2024-09-12T17:59:12.286608+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.146345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768658,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":415,"num_read_kb":38784,"num_write":991,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'477","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.761716+0000","last_change":"2024-09-12T17:21:52.747415+0000","last_active":"2024-09-12T17:59:34.761716+0000","last_peered":"2024-09-12T17:59:34.761716+0000","last_clean":"2024-09-12T17:59:34.761716+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T17:59:34.761716+0000","last_undegraded":"2024-09-12T17:59:34.761716+0000","last_fullsized":"2024-09-12T17:59:34.761716+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:53.654833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'327","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.023013+0000","last_change":"2024-09-12T17:21:50.769396+0000","last_active":"2024-09-12T18:01:03.023013+0000","last_peered":"2024-09-12T18:01:03.023013+0000","last_clean":"2024-09-12T18:01:03.023013+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:03.023013+0000","last_undegraded":"2024-09-12T18:01:03.023013+0000","last_fullsized":"2024-09-12T18:01:03.023013+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:43.716922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11211288,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":547,"num_read_kb":37148,"num_write":1276,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'544","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501861+0000","last_change":"2024-09-12T17:21:52.746868+0000","last_active":"2024-09-12T17:59:18.501861+0000","last_peered":"2024-09-12T17:59:18.501861+0000","last_clean":"2024-09-12T17:59:18.501861+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T17:59:18.501861+0000","last_undegraded":"2024-09-12T17:59:18.501861+0000","last_fullsized":"2024-09-12T17:59:18.501861+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:06.625492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'256","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.042023+0000","last_change":"2024-09-12T17:21:50.754884+0000","last_active":"2024-09-12T18:01:03.042023+0000","last_peered":"2024-09-12T18:01:03.042023+0000","last_clean":"2024-09-12T18:01:03.042023+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:03.042023+0000","last_undegraded":"2024-09-12T18:01:03.042023+0000","last_fullsized":"2024-09-12T18:01:03.042023+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:00.548422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629626,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":655,"num_read_kb":16802,"num_write":914,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'613","reported_seq":2373,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760782+0000","last_change":"2024-09-12T17:21:52.743802+0000","last_active":"2024-09-12T17:59:34.760782+0000","last_peered":"2024-09-12T17:59:34.760782+0000","last_clean":"2024-09-12T17:59:34.760782+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T17:59:34.760782+0000","last_undegraded":"2024-09-12T17:59:34.760782+0000","last_fullsized":"2024-09-12T17:59:34.760782+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:44.764410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'352","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.900897+0000","last_change":"2024-09-12T17:21:50.773572+0000","last_active":"2024-09-12T17:59:15.900897+0000","last_peered":"2024-09-12T17:59:15.900897+0000","last_clean":"2024-09-12T17:59:15.900897+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T17:59:15.900897+0000","last_undegraded":"2024-09-12T17:59:15.900897+0000","last_fullsized":"2024-09-12T17:59:15.900897+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:19.872303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3074358,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":516,"num_read_kb":16039,"num_write":1242,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952830+0000","last_change":"2024-09-12T17:21:52.744313+0000","last_active":"2024-09-12T17:59:16.952830+0000","last_peered":"2024-09-12T17:59:16.952830+0000","last_clean":"2024-09-12T17:59:16.952830+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T17:59:16.952830+0000","last_undegraded":"2024-09-12T17:59:16.952830+0000","last_fullsized":"2024-09-12T17:59:16.952830+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:36.240139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'222","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.631679+0000","last_change":"2024-09-12T17:21:50.775138+0000","last_active":"2024-09-12T17:59:10.631679+0000","last_peered":"2024-09-12T17:59:10.631679+0000","last_clean":"2024-09-12T17:59:10.631679+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T17:59:10.631679+0000","last_undegraded":"2024-09-12T17:59:10.631679+0000","last_fullsized":"2024-09-12T17:59:10.631679+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.644034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":324,"num_read_kb":5548,"num_write":827,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'843","reported_seq":2503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170215+0000","last_change":"2024-09-12T17:21:52.756513+0000","last_active":"2024-09-12T17:59:16.170215+0000","last_peered":"2024-09-12T17:59:16.170215+0000","last_clean":"2024-09-12T17:59:16.170215+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T17:59:16.170215+0000","last_undegraded":"2024-09-12T17:59:16.170215+0000","last_fullsized":"2024-09-12T17:59:16.170215+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:27.548029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'264","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.450979+0000","last_change":"2024-09-12T17:21:50.777104+0000","last_active":"2024-09-12T17:59:11.450979+0000","last_peered":"2024-09-12T17:59:11.450979+0000","last_clean":"2024-09-12T17:59:11.450979+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T17:59:11.450979+0000","last_undegraded":"2024-09-12T17:59:11.450979+0000","last_fullsized":"2024-09-12T17:59:11.450979+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:28.170918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3186360,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":457,"num_read_kb":30145,"num_write":1023,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'506","reported_seq":2100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002369+0000","last_change":"2024-09-12T17:21:52.754895+0000","last_active":"2024-09-12T18:00:55.002369+0000","last_peered":"2024-09-12T18:00:55.002369+0000","last_clean":"2024-09-12T18:00:55.002369+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:00:55.002369+0000","last_undegraded":"2024-09-12T18:00:55.002369+0000","last_fullsized":"2024-09-12T18:00:55.002369+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:11.896956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'300","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.442228+0000","last_change":"2024-09-12T17:21:50.774992+0000","last_active":"2024-09-12T17:59:15.442228+0000","last_peered":"2024-09-12T17:59:15.442228+0000","last_clean":"2024-09-12T17:59:15.442228+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T17:59:15.442228+0000","last_undegraded":"2024-09-12T17:59:15.442228+0000","last_fullsized":"2024-09-12T17:59:15.442228+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:13.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4147498,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":607,"num_read_kb":10444,"num_write":1069,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'744","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390042+0000","last_change":"2024-09-12T17:21:52.749164+0000","last_active":"2024-09-12T17:59:16.390042+0000","last_peered":"2024-09-12T17:59:16.390042+0000","last_clean":"2024-09-12T17:59:16.390042+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T17:59:16.390042+0000","last_undegraded":"2024-09-12T17:59:16.390042+0000","last_fullsized":"2024-09-12T17:59:16.390042+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:52.169981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'342","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.115367+0000","last_change":"2024-09-12T17:21:50.769398+0000","last_active":"2024-09-12T18:01:03.115367+0000","last_peered":"2024-09-12T18:01:03.115367+0000","last_clean":"2024-09-12T18:01:03.115367+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:03.115367+0000","last_undegraded":"2024-09-12T18:01:03.115367+0000","last_fullsized":"2024-09-12T18:01:03.115367+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:23.356425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4746346,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":506,"num_read_kb":69094,"num_write":1090,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1194","reported_seq":2914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.762595+0000","last_change":"2024-09-12T17:21:52.754000+0000","last_active":"2024-09-12T17:59:34.762595+0000","last_peered":"2024-09-12T17:59:34.762595+0000","last_clean":"2024-09-12T17:59:34.762595+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T17:59:34.762595+0000","last_undegraded":"2024-09-12T17:59:34.762595+0000","last_fullsized":"2024-09-12T17:59:34.762595+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.531613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'489","reported_seq":2037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.359232+0000","last_change":"2024-09-12T17:21:52.751378+0000","last_active":"2024-09-12T17:59:34.359232+0000","last_peered":"2024-09-12T17:59:34.359232+0000","last_clean":"2024-09-12T17:59:34.359232+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T17:59:34.359232+0000","last_undegraded":"2024-09-12T17:59:34.359232+0000","last_fullsized":"2024-09-12T17:59:34.359232+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:04.419740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'326","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:48.080974+0000","last_change":"2024-09-12T17:21:50.764045+0000","last_active":"2024-09-12T18:00:48.080974+0000","last_peered":"2024-09-12T18:00:48.080974+0000","last_clean":"2024-09-12T18:00:48.080974+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:00:48.080974+0000","last_undegraded":"2024-09-12T18:00:48.080974+0000","last_fullsized":"2024-09-12T18:00:48.080974+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:33.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4191997,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":553,"num_read_kb":53764,"num_write":1159,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'445","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.834035+0000","last_change":"2024-09-12T17:21:52.752185+0000","last_active":"2024-09-12T17:59:28.834035+0000","last_peered":"2024-09-12T17:59:28.834035+0000","last_clean":"2024-09-12T17:59:28.834035+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T17:59:28.834035+0000","last_undegraded":"2024-09-12T17:59:28.834035+0000","last_fullsized":"2024-09-12T17:59:28.834035+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:15.912648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'252","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.590358+0000","last_change":"2024-09-12T17:21:50.768025+0000","last_active":"2024-09-12T17:59:17.590358+0000","last_peered":"2024-09-12T17:59:17.590358+0000","last_clean":"2024-09-12T17:59:17.590358+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T17:59:17.590358+0000","last_undegraded":"2024-09-12T17:59:17.590358+0000","last_fullsized":"2024-09-12T17:59:17.590358+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:02.016388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11503118,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":403,"num_read_kb":34593,"num_write":987,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'465","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170603+0000","last_change":"2024-09-12T17:21:52.755703+0000","last_active":"2024-09-12T17:59:16.170603+0000","last_peered":"2024-09-12T17:59:16.170603+0000","last_clean":"2024-09-12T17:59:16.170603+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T17:59:16.170603+0000","last_undegraded":"2024-09-12T17:59:16.170603+0000","last_fullsized":"2024-09-12T17:59:16.170603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:42.867412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'272","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.240675+0000","last_change":"2024-09-12T17:21:50.770163+0000","last_active":"2024-09-12T17:59:16.240675+0000","last_peered":"2024-09-12T17:59:16.240675+0000","last_clean":"2024-09-12T17:59:16.240675+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T17:59:16.240675+0000","last_undegraded":"2024-09-12T17:59:16.240675+0000","last_fullsized":"2024-09-12T17:59:16.240675+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:41.245093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13973510,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":807,"num_read_kb":30506,"num_write":992,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'419","reported_seq":1998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521811+0000","last_change":"2024-09-12T17:21:52.757976+0000","last_active":"2024-09-12T17:59:17.521811+0000","last_peered":"2024-09-12T17:59:17.521811+0000","last_clean":"2024-09-12T17:59:17.521811+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T17:59:17.521811+0000","last_undegraded":"2024-09-12T17:59:17.521811+0000","last_fullsized":"2024-09-12T17:59:17.521811+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:40.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'353","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.043199+0000","last_change":"2024-09-12T17:21:50.770236+0000","last_active":"2024-09-12T17:59:10.043199+0000","last_peered":"2024-09-12T17:59:10.043199+0000","last_clean":"2024-09-12T17:59:10.043199+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T17:59:10.043199+0000","last_undegraded":"2024-09-12T17:59:10.043199+0000","last_fullsized":"2024-09-12T17:59:10.043199+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:22.133455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13731819,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":564,"num_read_kb":18097,"num_write":1236,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1543","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769737+0000","last_change":"2024-09-12T17:21:52.755355+0000","last_active":"2024-09-12T17:59:34.769737+0000","last_peered":"2024-09-12T17:59:34.769737+0000","last_clean":"2024-09-12T17:59:34.769737+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T17:59:34.769737+0000","last_undegraded":"2024-09-12T17:59:34.769737+0000","last_fullsized":"2024-09-12T17:59:34.769737+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.429894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'274","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.871076+0000","last_change":"2024-09-12T17:21:50.767696+0000","last_active":"2024-09-12T17:59:31.871076+0000","last_peered":"2024-09-12T17:59:31.871076+0000","last_clean":"2024-09-12T17:59:31.871076+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T17:59:31.871076+0000","last_undegraded":"2024-09-12T17:59:31.871076+0000","last_fullsized":"2024-09-12T17:59:31.871076+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:07.425923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9819806,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":423,"num_read_kb":18482,"num_write":978,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'787","reported_seq":2365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365184+0000","last_change":"2024-09-12T17:21:52.754058+0000","last_active":"2024-09-12T17:59:34.365184+0000","last_peered":"2024-09-12T17:59:34.365184+0000","last_clean":"2024-09-12T17:59:34.365184+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T17:59:34.365184+0000","last_undegraded":"2024-09-12T17:59:34.365184+0000","last_fullsized":"2024-09-12T17:59:34.365184+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:35.171675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'274","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.655009+0000","last_change":"2024-09-12T17:21:50.754844+0000","last_active":"2024-09-12T17:59:11.655009+0000","last_peered":"2024-09-12T17:59:11.655009+0000","last_clean":"2024-09-12T17:59:11.655009+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T17:59:11.655009+0000","last_undegraded":"2024-09-12T17:59:11.655009+0000","last_fullsized":"2024-09-12T17:59:11.655009+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:01.060374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6721451,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":362,"num_read_kb":4177,"num_write":907,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'172","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.828620+0000","last_change":"2024-09-12T17:22:00.797198+0000","last_active":"2024-09-12T17:59:34.828620+0000","last_peered":"2024-09-12T17:59:34.828620+0000","last_clean":"2024-09-12T17:59:34.828620+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T17:59:34.828620+0000","last_undegraded":"2024-09-12T17:59:34.828620+0000","last_fullsized":"2024-09-12T17:59:34.828620+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.624828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'441","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769810+0000","last_change":"2024-09-12T17:21:52.752268+0000","last_active":"2024-09-12T17:59:34.769810+0000","last_peered":"2024-09-12T17:59:34.769810+0000","last_clean":"2024-09-12T17:59:34.769810+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T17:59:34.769810+0000","last_undegraded":"2024-09-12T17:59:34.769810+0000","last_fullsized":"2024-09-12T17:59:34.769810+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:22.039178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'343","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:39.545004+0000","last_change":"2024-09-12T17:22:25.841354+0000","last_active":"2024-09-12T17:58:39.545004+0000","last_peered":"2024-09-12T17:58:39.545004+0000","last_clean":"2024-09-12T17:58:39.545004+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T17:58:39.545004+0000","last_undegraded":"2024-09-12T17:58:39.545004+0000","last_fullsized":"2024-09-12T17:58:39.545004+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:21.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21655202,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":908,"num_read_kb":57262,"num_write":1296,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020196+0000","last_change":"2024-09-12T17:21:54.756402+0000","last_active":"2024-09-12T17:58:12.020196+0000","last_peered":"2024-09-12T17:58:12.020196+0000","last_clean":"2024-09-12T17:58:12.020196+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T17:58:12.020196+0000","last_undegraded":"2024-09-12T17:58:12.020196+0000","last_fullsized":"2024-09-12T17:58:12.020196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'338","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.039892+0000","last_change":"2024-09-12T17:21:56.762895+0000","last_active":"2024-09-12T18:00:37.039892+0000","last_peered":"2024-09-12T18:00:37.039892+0000","last_clean":"2024-09-12T18:00:37.039892+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:00:37.039892+0000","last_undegraded":"2024-09-12T18:00:37.039892+0000","last_fullsized":"2024-09-12T18:00:37.039892+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:42.017239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":988,"num_write":422,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131391+0000","last_change":"2024-09-12T17:21:58.779492+0000","last_active":"2024-09-12T17:58:17.131391+0000","last_peered":"2024-09-12T17:58:17.131391+0000","last_clean":"2024-09-12T17:58:17.131391+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T17:58:17.131391+0000","last_undegraded":"2024-09-12T17:58:17.131391+0000","last_fullsized":"2024-09-12T17:58:17.131391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:41.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2432","reported_seq":4316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.251478+0000","last_change":"2024-09-12T17:22:00.789480+0000","last_active":"2024-09-12T17:59:33.251478+0000","last_peered":"2024-09-12T17:59:33.251478+0000","last_clean":"2024-09-12T17:59:33.251478+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T17:59:33.251478+0000","last_undegraded":"2024-09-12T17:59:33.251478+0000","last_fullsized":"2024-09-12T17:59:33.251478+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.233355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'790","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998878+0000","last_change":"2024-09-12T17:21:52.750476+0000","last_active":"2024-09-12T18:00:54.998878+0000","last_peered":"2024-09-12T18:00:54.998878+0000","last_clean":"2024-09-12T18:00:54.998878+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:00:54.998878+0000","last_undegraded":"2024-09-12T18:00:54.998878+0000","last_fullsized":"2024-09-12T18:00:54.998878+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:08.162006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'243","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.578837+0000","last_change":"2024-09-12T17:21:50.757901+0000","last_active":"2024-09-12T17:59:17.578837+0000","last_peered":"2024-09-12T17:59:17.578837+0000","last_clean":"2024-09-12T17:59:17.578837+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T17:59:17.578837+0000","last_undegraded":"2024-09-12T17:59:17.578837+0000","last_fullsized":"2024-09-12T17:59:17.578837+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.728223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8553618,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":293,"num_read_kb":2179,"num_write":802,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010650+0000","last_change":"2024-09-12T17:21:54.752252+0000","last_active":"2024-09-12T17:57:07.010650+0000","last_peered":"2024-09-12T17:57:07.010650+0000","last_clean":"2024-09-12T17:57:07.010650+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T17:57:07.010650+0000","last_undegraded":"2024-09-12T17:57:07.010650+0000","last_fullsized":"2024-09-12T17:57:07.010650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.652789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'92","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.607688+0000","last_change":"2024-09-12T17:21:56.763049+0000","last_active":"2024-09-12T17:59:04.607688+0000","last_peered":"2024-09-12T17:59:04.607688+0000","last_clean":"2024-09-12T17:59:04.607688+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T17:59:04.607688+0000","last_undegraded":"2024-09-12T17:59:04.607688+0000","last_fullsized":"2024-09-12T17:59:04.607688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:05.126795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131351+0000","last_change":"2024-09-12T17:21:58.781052+0000","last_active":"2024-09-12T17:58:17.131351+0000","last_peered":"2024-09-12T17:58:17.131351+0000","last_clean":"2024-09-12T17:58:17.131351+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T17:58:17.131351+0000","last_undegraded":"2024-09-12T17:58:17.131351+0000","last_fullsized":"2024-09-12T17:58:17.131351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:41.465265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.645798+0000","last_change":"2024-09-12T17:22:00.795013+0000","last_active":"2024-09-12T17:59:34.645798+0000","last_peered":"2024-09-12T17:59:34.645798+0000","last_clean":"2024-09-12T17:59:34.645798+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T17:59:34.645798+0000","last_undegraded":"2024-09-12T17:59:34.645798+0000","last_fullsized":"2024-09-12T17:59:34.645798+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:11.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1527","reported_seq":3096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129953+0000","last_change":"2024-09-12T17:21:52.757548+0000","last_active":"2024-09-12T17:59:18.129953+0000","last_peered":"2024-09-12T17:59:18.129953+0000","last_clean":"2024-09-12T17:59:18.129953+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T17:59:18.129953+0000","last_undegraded":"2024-09-12T17:59:18.129953+0000","last_fullsized":"2024-09-12T17:59:18.129953+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:17.307943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'280","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.045480+0000","last_change":"2024-09-12T17:21:50.763989+0000","last_active":"2024-09-12T17:59:07.045480+0000","last_peered":"2024-09-12T17:59:07.045480+0000","last_clean":"2024-09-12T17:59:07.045480+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T17:59:07.045480+0000","last_undegraded":"2024-09-12T17:59:07.045480+0000","last_fullsized":"2024-09-12T17:59:07.045480+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:25.544190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11311711,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":405,"num_read_kb":7817,"num_write":1031,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.021331+0000","last_change":"2024-09-12T17:21:54.750735+0000","last_active":"2024-09-12T17:58:12.021331+0000","last_peered":"2024-09-12T17:58:12.021331+0000","last_clean":"2024-09-12T17:58:12.021331+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T17:58:12.021331+0000","last_undegraded":"2024-09-12T17:58:12.021331+0000","last_fullsized":"2024-09-12T17:58:12.021331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.118206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'103","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.030304+0000","last_change":"2024-09-12T17:21:56.760401+0000","last_active":"2024-09-12T17:59:27.030304+0000","last_peered":"2024-09-12T17:59:27.030304+0000","last_clean":"2024-09-12T17:59:27.030304+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T17:59:27.030304+0000","last_undegraded":"2024-09-12T17:59:27.030304+0000","last_fullsized":"2024-09-12T17:59:27.030304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:57.514040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'784","reported_seq":2209,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.132145+0000","last_change":"2024-09-12T17:21:58.790046+0000","last_active":"2024-09-12T18:00:56.132145+0000","last_peered":"2024-09-12T18:00:56.132145+0000","last_clean":"2024-09-12T18:00:56.132145+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:00:56.132145+0000","last_undegraded":"2024-09-12T18:00:56.132145+0000","last_fullsized":"2024-09-12T18:00:56.132145+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:36.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'222","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.951156+0000","last_change":"2024-09-12T17:22:00.795256+0000","last_active":"2024-09-12T18:00:54.951156+0000","last_peered":"2024-09-12T18:00:54.951156+0000","last_clean":"2024-09-12T18:00:54.951156+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:00:54.951156+0000","last_undegraded":"2024-09-12T18:00:54.951156+0000","last_fullsized":"2024-09-12T18:00:54.951156+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:18.506943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'711","reported_seq":1965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.198269+0000","last_change":"2024-09-12T17:21:52.754960+0000","last_active":"2024-09-12T17:59:17.198269+0000","last_peered":"2024-09-12T17:59:17.198269+0000","last_clean":"2024-09-12T17:59:17.198269+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T17:59:17.198269+0000","last_undegraded":"2024-09-12T17:59:17.198269+0000","last_fullsized":"2024-09-12T17:59:17.198269+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":700,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:04.170159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'342","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.089766+0000","last_change":"2024-09-12T17:21:50.763211+0000","last_active":"2024-09-12T17:58:33.089766+0000","last_peered":"2024-09-12T17:58:33.089766+0000","last_clean":"2024-09-12T17:58:33.089766+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T17:58:33.089766+0000","last_undegraded":"2024-09-12T17:58:33.089766+0000","last_fullsized":"2024-09-12T17:58:33.089766+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:09.631310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7337834,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":686,"num_read_kb":18202,"num_write":1393,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020236+0000","last_change":"2024-09-12T17:21:54.755690+0000","last_active":"2024-09-12T17:58:12.020236+0000","last_peered":"2024-09-12T17:58:12.020236+0000","last_clean":"2024-09-12T17:58:12.020236+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T17:58:12.020236+0000","last_undegraded":"2024-09-12T17:58:12.020236+0000","last_fullsized":"2024-09-12T17:58:12.020236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.998087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'273","reported_seq":831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.188619+0000","last_change":"2024-09-12T17:21:56.765160+0000","last_active":"2024-09-12T18:00:37.188619+0000","last_peered":"2024-09-12T18:00:37.188619+0000","last_clean":"2024-09-12T18:00:37.188619+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:00:37.188619+0000","last_undegraded":"2024-09-12T18:00:37.188619+0000","last_fullsized":"2024-09-12T18:00:37.188619+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:14.179700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1004,"num_write":378,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'809","reported_seq":2312,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.905898+0000","last_change":"2024-09-12T17:21:58.787567+0000","last_active":"2024-09-12T18:01:02.905898+0000","last_peered":"2024-09-12T18:01:02.905898+0000","last_clean":"2024-09-12T18:01:02.905898+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:02.905898+0000","last_undegraded":"2024-09-12T18:01:02.905898+0000","last_fullsized":"2024-09-12T18:01:02.905898+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:46.462958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'420","reported_seq":1985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008093+0000","last_change":"2024-09-12T17:21:52.748275+0000","last_active":"2024-09-12T18:00:55.008093+0000","last_peered":"2024-09-12T18:00:55.008093+0000","last_clean":"2024-09-12T18:00:55.008093+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:00:55.008093+0000","last_undegraded":"2024-09-12T18:00:55.008093+0000","last_fullsized":"2024-09-12T18:00:55.008093+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:17.610168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'268","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.149058+0000","last_change":"2024-09-12T17:21:50.783712+0000","last_active":"2024-09-12T17:59:07.149058+0000","last_peered":"2024-09-12T17:59:07.149058+0000","last_clean":"2024-09-12T17:59:07.149058+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T17:59:07.149058+0000","last_undegraded":"2024-09-12T17:59:07.149058+0000","last_fullsized":"2024-09-12T17:59:07.149058+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.656882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6318991,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":377,"num_read_kb":9180,"num_write":967,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'5","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.847177+0000","last_change":"2024-09-12T17:21:54.753421+0000","last_active":"2024-09-12T18:00:55.847177+0000","last_peered":"2024-09-12T18:00:55.847177+0000","last_clean":"2024-09-12T18:00:55.847177+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:00:55.847177+0000","last_undegraded":"2024-09-12T18:00:55.847177+0000","last_fullsized":"2024-09-12T18:00:55.847177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:14.711780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'306","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.025191+0000","last_change":"2024-09-12T17:21:56.772550+0000","last_active":"2024-09-12T17:58:57.025191+0000","last_peered":"2024-09-12T17:58:57.025191+0000","last_clean":"2024-09-12T17:58:57.025191+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T17:58:57.025191+0000","last_undegraded":"2024-09-12T17:58:57.025191+0000","last_fullsized":"2024-09-12T17:58:57.025191+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.672167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56871,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":947,"num_write":400,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133829+0000","last_change":"2024-09-12T17:21:58.785030+0000","last_active":"2024-09-12T17:58:02.133829+0000","last_peered":"2024-09-12T17:58:02.133829+0000","last_clean":"2024-09-12T17:58:02.133829+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T17:58:02.133829+0000","last_undegraded":"2024-09-12T17:58:02.133829+0000","last_fullsized":"2024-09-12T17:58:02.133829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:09.008553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'541","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.118388+0000","last_change":"2024-09-12T17:22:00.792070+0000","last_active":"2024-09-12T18:00:56.118388+0000","last_peered":"2024-09-12T18:00:56.118388+0000","last_clean":"2024-09-12T18:00:56.118388+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:00:56.118388+0000","last_undegraded":"2024-09-12T18:00:56.118388+0000","last_fullsized":"2024-09-12T18:00:56.118388+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:34.644522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'852","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840428+0000","last_change":"2024-09-12T17:21:52.754955+0000","last_active":"2024-09-12T17:59:28.840428+0000","last_peered":"2024-09-12T17:59:28.840428+0000","last_clean":"2024-09-12T17:59:28.840428+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T17:59:28.840428+0000","last_undegraded":"2024-09-12T17:59:28.840428+0000","last_fullsized":"2024-09-12T17:59:28.840428+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:26.586616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'269","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.156948+0000","last_change":"2024-09-12T17:21:50.765891+0000","last_active":"2024-09-12T17:59:18.156948+0000","last_peered":"2024-09-12T17:59:18.156948+0000","last_clean":"2024-09-12T17:59:18.156948+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T17:59:18.156948+0000","last_undegraded":"2024-09-12T17:59:18.156948+0000","last_fullsized":"2024-09-12T17:59:18.156948+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.566299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8970216,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":443,"num_read_kb":25915,"num_write":1024,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.139539+0000","last_change":"2024-09-12T17:21:54.751975+0000","last_active":"2024-09-12T17:58:47.139539+0000","last_peered":"2024-09-12T17:58:47.139539+0000","last_clean":"2024-09-12T17:58:47.139539+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T17:58:47.139539+0000","last_undegraded":"2024-09-12T17:58:47.139539+0000","last_fullsized":"2024-09-12T17:58:47.139539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:39.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'269","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.036581+0000","last_change":"2024-09-12T17:21:56.763953+0000","last_active":"2024-09-12T18:00:12.036581+0000","last_peered":"2024-09-12T18:00:12.036581+0000","last_clean":"2024-09-12T18:00:12.036581+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:00:12.036581+0000","last_undegraded":"2024-09-12T18:00:12.036581+0000","last_fullsized":"2024-09-12T18:00:12.036581+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:57.115467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61195,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":959,"num_write":364,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:52.008193+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:56:52.008193+0000","last_peered":"2024-09-12T17:56:52.008193+0000","last_clean":"2024-09-12T17:56:52.008193+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T17:56:52.008193+0000","last_undegraded":"2024-09-12T17:56:52.008193+0000","last_fullsized":"2024-09-12T17:56:52.008193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'97","reported_seq":580,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.140607+0000","last_change":"2024-09-12T17:22:00.792783+0000","last_active":"2024-09-12T17:59:37.140607+0000","last_peered":"2024-09-12T17:59:37.140607+0000","last_clean":"2024-09-12T17:59:37.140607+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T17:59:37.140607+0000","last_undegraded":"2024-09-12T17:59:37.140607+0000","last_fullsized":"2024-09-12T17:59:37.140607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:57.921660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'380","reported_seq":1851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774821+0000","last_change":"2024-09-12T17:21:52.747363+0000","last_active":"2024-09-12T17:59:18.774821+0000","last_peered":"2024-09-12T17:59:18.774821+0000","last_clean":"2024-09-12T17:59:18.774821+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T17:59:18.774821+0000","last_undegraded":"2024-09-12T17:59:18.774821+0000","last_fullsized":"2024-09-12T17:59:18.774821+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:23.091871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'324","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.131723+0000","last_change":"2024-09-12T17:21:50.762942+0000","last_active":"2024-09-12T17:58:51.131723+0000","last_peered":"2024-09-12T17:58:51.131723+0000","last_clean":"2024-09-12T17:58:51.131723+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T17:58:51.131723+0000","last_undegraded":"2024-09-12T17:58:51.131723+0000","last_fullsized":"2024-09-12T17:58:51.131723+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:36.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4754569,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":687,"num_read_kb":11787,"num_write":1217,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'3","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.669612+0000","last_change":"2024-09-12T17:21:54.749892+0000","last_active":"2024-09-12T18:01:02.669612+0000","last_peered":"2024-09-12T18:01:02.669612+0000","last_clean":"2024-09-12T18:01:02.669612+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:02.669612+0000","last_undegraded":"2024-09-12T18:01:02.669612+0000","last_fullsized":"2024-09-12T18:01:02.669612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:07.627632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'237","reported_seq":810,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.106867+0000","last_change":"2024-09-12T17:21:56.767379+0000","last_active":"2024-09-12T18:00:56.106867+0000","last_peered":"2024-09-12T18:00:56.106867+0000","last_clean":"2024-09-12T18:00:56.106867+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:00:56.106867+0000","last_undegraded":"2024-09-12T18:00:56.106867+0000","last_fullsized":"2024-09-12T18:00:56.106867+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:36.431381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45021,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":757,"num_write":298,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'808","reported_seq":6237,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.907105+0000","last_change":"2024-09-12T17:21:58.786457+0000","last_active":"2024-09-12T18:01:02.907105+0000","last_peered":"2024-09-12T18:01:02.907105+0000","last_clean":"2024-09-12T18:01:02.907105+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:02.907105+0000","last_undegraded":"2024-09-12T18:01:02.907105+0000","last_fullsized":"2024-09-12T18:01:02.907105+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:35.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'97","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.003698+0000","last_change":"2024-09-12T17:22:00.795600+0000","last_active":"2024-09-12T18:00:55.003698+0000","last_peered":"2024-09-12T18:00:55.003698+0000","last_clean":"2024-09-12T18:00:55.003698+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:00:55.003698+0000","last_undegraded":"2024-09-12T18:00:55.003698+0000","last_fullsized":"2024-09-12T18:00:55.003698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:12.865071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'886","reported_seq":2499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012883+0000","last_change":"2024-09-12T17:21:52.754090+0000","last_active":"2024-09-12T17:59:19.012883+0000","last_peered":"2024-09-12T17:59:19.012883+0000","last_clean":"2024-09-12T17:59:19.012883+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T17:59:19.012883+0000","last_undegraded":"2024-09-12T17:59:19.012883+0000","last_fullsized":"2024-09-12T17:59:19.012883+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:08.146246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'268","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.579979+0000","last_change":"2024-09-12T17:21:50.781428+0000","last_active":"2024-09-12T17:59:07.579979+0000","last_peered":"2024-09-12T17:59:07.579979+0000","last_clean":"2024-09-12T17:59:07.579979+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T17:59:07.579979+0000","last_undegraded":"2024-09-12T17:59:07.579979+0000","last_fullsized":"2024-09-12T17:59:07.579979+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:03.976696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8396844,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":397,"num_read_kb":4507,"num_write":972,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.140189+0000","last_change":"2024-09-12T17:21:54.756631+0000","last_active":"2024-09-12T17:58:52.140189+0000","last_peered":"2024-09-12T17:58:52.140189+0000","last_clean":"2024-09-12T17:58:52.140189+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T17:58:52.140189+0000","last_undegraded":"2024-09-12T17:58:52.140189+0000","last_fullsized":"2024-09-12T17:58:52.140189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:30.950089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'449","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.109651+0000","last_change":"2024-09-12T17:21:56.761927+0000","last_active":"2024-09-12T18:00:56.109651+0000","last_peered":"2024-09-12T18:00:56.109651+0000","last_clean":"2024-09-12T18:00:56.109651+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:00:56.109651+0000","last_undegraded":"2024-09-12T18:00:56.109651+0000","last_fullsized":"2024-09-12T18:00:56.109651+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:22.363422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109212,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":798,"num_read_kb":1759,"num_write":668,"num_write_kb":582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138304+0000","last_change":"2024-09-12T17:21:58.789916+0000","last_active":"2024-09-12T17:58:48.138304+0000","last_peered":"2024-09-12T17:58:48.138304+0000","last_clean":"2024-09-12T17:58:48.138304+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T17:58:48.138304+0000","last_undegraded":"2024-09-12T17:58:48.138304+0000","last_fullsized":"2024-09-12T17:58:48.138304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'118","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.360795+0000","last_change":"2024-09-12T17:22:00.797337+0000","last_active":"2024-09-12T17:59:34.360795+0000","last_peered":"2024-09-12T17:59:34.360795+0000","last_clean":"2024-09-12T17:59:34.360795+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T17:59:34.360795+0000","last_undegraded":"2024-09-12T17:59:34.360795+0000","last_fullsized":"2024-09-12T17:59:34.360795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.474417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1094","reported_seq":2455,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.391930+0000","last_change":"2024-09-12T17:21:52.752079+0000","last_active":"2024-09-12T17:59:15.391930+0000","last_peered":"2024-09-12T17:59:15.391930+0000","last_clean":"2024-09-12T17:59:15.391930+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T17:59:15.391930+0000","last_undegraded":"2024-09-12T17:59:15.391930+0000","last_fullsized":"2024-09-12T17:59:15.391930+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1000,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.260009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'317","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.019873+0000","last_change":"2024-09-12T17:21:50.771854+0000","last_active":"2024-09-12T17:59:08.019873+0000","last_peered":"2024-09-12T17:59:08.019873+0000","last_clean":"2024-09-12T17:59:08.019873+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T17:59:08.019873+0000","last_undegraded":"2024-09-12T17:59:08.019873+0000","last_fullsized":"2024-09-12T17:59:08.019873+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:43.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5342730,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":456,"num_read_kb":4065,"num_write":1080,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137482+0000","last_change":"2024-09-12T17:21:54.754091+0000","last_active":"2024-09-12T17:57:55.137482+0000","last_peered":"2024-09-12T17:57:55.137482+0000","last_clean":"2024-09-12T17:57:55.137482+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T17:57:55.137482+0000","last_undegraded":"2024-09-12T17:57:55.137482+0000","last_fullsized":"2024-09-12T17:57:55.137482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:01.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'271","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.144859+0000","last_change":"2024-09-12T17:21:56.766601+0000","last_active":"2024-09-12T18:00:12.144859+0000","last_peered":"2024-09-12T18:00:12.144859+0000","last_clean":"2024-09-12T18:00:12.144859+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:00:12.144859+0000","last_undegraded":"2024-09-12T18:00:12.144859+0000","last_fullsized":"2024-09-12T18:00:12.144859+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:02.002328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57281,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":936,"num_write":424,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138983+0000","last_change":"2024-09-12T17:21:58.780947+0000","last_active":"2024-09-12T17:58:05.138983+0000","last_peered":"2024-09-12T17:58:05.138983+0000","last_clean":"2024-09-12T17:58:05.138983+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T17:58:05.138983+0000","last_undegraded":"2024-09-12T17:58:05.138983+0000","last_fullsized":"2024-09-12T17:58:05.138983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.674014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'125","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:45.147948+0000","last_change":"2024-09-12T17:22:00.794120+0000","last_active":"2024-09-12T18:00:45.147948+0000","last_peered":"2024-09-12T18:00:45.147948+0000","last_clean":"2024-09-12T18:00:45.147948+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:00:45.147948+0000","last_undegraded":"2024-09-12T18:00:45.147948+0000","last_fullsized":"2024-09-12T18:00:45.147948+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.905380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'852","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.130052+0000","last_change":"2024-09-12T17:21:52.744001+0000","last_active":"2024-09-12T17:59:18.130052+0000","last_peered":"2024-09-12T17:59:18.130052+0000","last_clean":"2024-09-12T17:59:18.130052+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T17:59:18.130052+0000","last_undegraded":"2024-09-12T17:59:18.130052+0000","last_fullsized":"2024-09-12T17:59:18.130052+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.116207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'236","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.324527+0000","last_change":"2024-09-12T17:21:50.763216+0000","last_active":"2024-09-12T17:59:18.324527+0000","last_peered":"2024-09-12T17:59:18.324527+0000","last_clean":"2024-09-12T17:59:18.324527+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T17:59:18.324527+0000","last_undegraded":"2024-09-12T17:59:18.324527+0000","last_fullsized":"2024-09-12T17:59:18.324527+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:33.880090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581454,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":379,"num_read_kb":12213,"num_write":903,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.131531+0000","last_change":"2024-09-12T17:21:54.753927+0000","last_active":"2024-09-12T17:57:58.131531+0000","last_peered":"2024-09-12T17:57:58.131531+0000","last_clean":"2024-09-12T17:57:58.131531+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T17:57:58.131531+0000","last_undegraded":"2024-09-12T17:57:58.131531+0000","last_fullsized":"2024-09-12T17:57:58.131531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:03.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'272","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.105905+0000","last_change":"2024-09-12T17:21:56.769847+0000","last_active":"2024-09-12T18:01:03.105905+0000","last_peered":"2024-09-12T18:01:03.105905+0000","last_clean":"2024-09-12T18:01:03.105905+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:03.105905+0000","last_undegraded":"2024-09-12T18:01:03.105905+0000","last_fullsized":"2024-09-12T18:01:03.105905+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:50.849719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53000,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":937,"num_write":357,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'767","reported_seq":2281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.133223+0000","last_change":"2024-09-12T17:21:58.787962+0000","last_active":"2024-09-12T18:00:56.133223+0000","last_peered":"2024-09-12T18:00:56.133223+0000","last_clean":"2024-09-12T18:00:56.133223+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:00:56.133223+0000","last_undegraded":"2024-09-12T18:00:56.133223+0000","last_fullsized":"2024-09-12T18:00:56.133223+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.107541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'91","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.238731+0000","last_change":"2024-09-12T17:22:00.788149+0000","last_active":"2024-09-12T17:59:08.238731+0000","last_peered":"2024-09-12T17:59:08.238731+0000","last_clean":"2024-09-12T17:59:08.238731+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T17:59:08.238731+0000","last_undegraded":"2024-09-12T17:59:08.238731+0000","last_fullsized":"2024-09-12T17:59:08.238731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:52.865371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'393","reported_seq":1796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618253+0000","last_change":"2024-09-12T17:21:52.746636+0000","last_active":"2024-09-12T17:59:16.618253+0000","last_peered":"2024-09-12T17:59:16.618253+0000","last_clean":"2024-09-12T17:59:16.618253+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T17:59:16.618253+0000","last_undegraded":"2024-09-12T17:59:16.618253+0000","last_fullsized":"2024-09-12T17:59:16.618253+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:16.893041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'254","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:10.691518+0000","last_change":"2024-09-12T17:21:50.764044+0000","last_active":"2024-09-12T17:59:10.691518+0000","last_peered":"2024-09-12T17:59:10.691518+0000","last_clean":"2024-09-12T17:59:10.691518+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T17:59:10.691518+0000","last_undegraded":"2024-09-12T17:59:10.691518+0000","last_fullsized":"2024-09-12T17:59:10.691518+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:30.691491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4566413,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":398,"num_read_kb":2736,"num_write":978,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.846903+0000","last_change":"2024-09-12T17:21:54.752963+0000","last_active":"2024-09-12T18:00:55.846903+0000","last_peered":"2024-09-12T18:00:55.846903+0000","last_clean":"2024-09-12T18:00:55.846903+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:00:55.846903+0000","last_undegraded":"2024-09-12T18:00:55.846903+0000","last_fullsized":"2024-09-12T18:00:55.846903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:56.647371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'76","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.935202+0000","last_change":"2024-09-12T17:21:56.766705+0000","last_active":"2024-09-12T17:59:07.935202+0000","last_peered":"2024-09-12T17:59:07.935202+0000","last_clean":"2024-09-12T17:59:07.935202+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T17:59:07.935202+0000","last_undegraded":"2024-09-12T17:59:07.935202+0000","last_fullsized":"2024-09-12T17:59:07.935202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.416717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'802","reported_seq":2225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.134327+0000","last_change":"2024-09-12T17:21:58.775054+0000","last_active":"2024-09-12T18:00:56.134327+0000","last_peered":"2024-09-12T18:00:56.134327+0000","last_clean":"2024-09-12T18:00:56.134327+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:00:56.134327+0000","last_undegraded":"2024-09-12T18:00:56.134327+0000","last_fullsized":"2024-09-12T18:00:56.134327+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:40.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'123","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.753528+0000","last_change":"2024-09-12T17:22:00.796406+0000","last_active":"2024-09-12T17:59:06.753528+0000","last_peered":"2024-09-12T17:59:06.753528+0000","last_clean":"2024-09-12T17:59:06.753528+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T17:59:06.753528+0000","last_undegraded":"2024-09-12T17:59:06.753528+0000","last_fullsized":"2024-09-12T17:59:06.753528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:55.110524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'767","reported_seq":2391,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501638+0000","last_change":"2024-09-12T17:21:52.753271+0000","last_active":"2024-09-12T17:59:18.501638+0000","last_peered":"2024-09-12T17:59:18.501638+0000","last_clean":"2024-09-12T17:59:18.501638+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T17:59:18.501638+0000","last_undegraded":"2024-09-12T17:59:18.501638+0000","last_fullsized":"2024-09-12T17:59:18.501638+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:40.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'230","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.091939+0000","last_change":"2024-09-12T17:21:50.759354+0000","last_active":"2024-09-12T17:59:09.091939+0000","last_peered":"2024-09-12T17:59:09.091939+0000","last_clean":"2024-09-12T17:59:09.091939+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T17:59:09.091939+0000","last_undegraded":"2024-09-12T17:59:09.091939+0000","last_fullsized":"2024-09-12T17:59:09.091939+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:28.652326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40468,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":648,"num_read_kb":10056,"num_write":808,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:57.017784+0000","last_change":"2024-09-12T17:21:54.755944+0000","last_active":"2024-09-12T17:57:57.017784+0000","last_peered":"2024-09-12T17:57:57.017784+0000","last_clean":"2024-09-12T17:57:57.017784+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T17:57:57.017784+0000","last_undegraded":"2024-09-12T17:57:57.017784+0000","last_fullsized":"2024-09-12T17:57:57.017784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:30.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'314","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.144814+0000","last_change":"2024-09-12T17:21:56.769845+0000","last_active":"2024-09-12T18:00:12.144814+0000","last_peered":"2024-09-12T18:00:12.144814+0000","last_clean":"2024-09-12T18:00:12.144814+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:00:12.144814+0000","last_undegraded":"2024-09-12T18:00:12.144814+0000","last_fullsized":"2024-09-12T18:00:12.144814+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.744587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52527,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1087,"num_read_kb":1540,"num_write":1574,"num_write_kb":1456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.169136+0000","last_change":"2024-09-12T17:21:58.783566+0000","last_active":"2024-09-12T17:58:02.169136+0000","last_peered":"2024-09-12T17:58:02.169136+0000","last_clean":"2024-09-12T17:58:02.169136+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T17:58:02.169136+0000","last_undegraded":"2024-09-12T17:58:02.169136+0000","last_fullsized":"2024-09-12T17:58:02.169136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:16.155795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'100","reported_seq":584,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.982177+0000","last_change":"2024-09-12T17:22:00.795820+0000","last_active":"2024-09-12T17:59:06.982177+0000","last_peered":"2024-09-12T17:59:06.982177+0000","last_clean":"2024-09-12T17:59:06.982177+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T17:59:06.982177+0000","last_undegraded":"2024-09-12T17:59:06.982177+0000","last_fullsized":"2024-09-12T17:59:06.982177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:47.982837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'458","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.171017+0000","last_change":"2024-09-12T17:21:52.747649+0000","last_active":"2024-09-12T17:59:16.171017+0000","last_peered":"2024-09-12T17:59:16.171017+0000","last_clean":"2024-09-12T17:59:16.171017+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T17:59:16.171017+0000","last_undegraded":"2024-09-12T17:59:16.171017+0000","last_fullsized":"2024-09-12T17:59:16.171017+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:32.995329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:42.126398+0000","last_change":"2024-09-12T17:21:34.165528+0000","last_active":"2024-09-12T17:57:42.126398+0000","last_peered":"2024-09-12T17:57:42.126398+0000","last_clean":"2024-09-12T17:57:42.126398+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T17:57:42.126398+0000","last_undegraded":"2024-09-12T17:57:42.126398+0000","last_fullsized":"2024-09-12T17:57:42.126398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_clean_scrub_stamp":"2024-09-12T17:21:32.756341+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:27.504316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010866+0000","last_change":"2024-09-12T17:21:41.866930+0000","last_active":"2024-09-12T17:57:07.010866+0000","last_peered":"2024-09-12T17:57:07.010866+0000","last_clean":"2024-09-12T17:57:07.010866+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T17:57:07.010866+0000","last_undegraded":"2024-09-12T17:57:07.010866+0000","last_fullsized":"2024-09-12T17:57:07.010866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:40.562409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'291","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.982742+0000","last_change":"2024-09-12T17:21:50.760757+0000","last_active":"2024-09-12T17:59:14.982742+0000","last_peered":"2024-09-12T17:59:14.982742+0000","last_clean":"2024-09-12T17:59:14.982742+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T17:59:14.982742+0000","last_undegraded":"2024-09-12T17:59:14.982742+0000","last_fullsized":"2024-09-12T17:59:14.982742+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:52.679675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357547,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":570,"num_read_kb":42378,"num_write":1108,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012494+0000","last_change":"2024-09-12T17:21:54.750180+0000","last_active":"2024-09-12T17:57:22.012494+0000","last_peered":"2024-09-12T17:57:22.012494+0000","last_clean":"2024-09-12T17:57:22.012494+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T17:57:22.012494+0000","last_undegraded":"2024-09-12T17:57:22.012494+0000","last_fullsized":"2024-09-12T17:57:22.012494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:24.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'722","reported_seq":1406,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.114358+0000","last_change":"2024-09-12T17:21:56.765494+0000","last_active":"2024-09-12T18:00:56.114358+0000","last_peered":"2024-09-12T18:00:56.114358+0000","last_clean":"2024-09-12T18:00:56.114358+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:00:56.114358+0000","last_undegraded":"2024-09-12T18:00:56.114358+0000","last_fullsized":"2024-09-12T18:00:56.114358+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:08.857619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201009,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1413,"num_read_kb":2992,"num_write":1362,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138445+0000","last_change":"2024-09-12T17:21:58.788291+0000","last_active":"2024-09-12T17:58:48.138445+0000","last_peered":"2024-09-12T17:58:48.138445+0000","last_clean":"2024-09-12T17:58:48.138445+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T17:58:48.138445+0000","last_undegraded":"2024-09-12T17:58:48.138445+0000","last_fullsized":"2024-09-12T17:58:48.138445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:07.437948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'195","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.775559+0000","last_change":"2024-09-12T17:22:00.796574+0000","last_active":"2024-09-12T17:59:34.775559+0000","last_peered":"2024-09-12T17:59:34.775559+0000","last_clean":"2024-09-12T17:59:34.775559+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T17:59:34.775559+0000","last_undegraded":"2024-09-12T17:59:34.775559+0000","last_fullsized":"2024-09-12T17:59:34.775559+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.468190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'468","reported_seq":1992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774603+0000","last_change":"2024-09-12T17:21:52.757096+0000","last_active":"2024-09-12T17:59:18.774603+0000","last_peered":"2024-09-12T17:59:18.774603+0000","last_clean":"2024-09-12T17:59:18.774603+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T17:59:18.774603+0000","last_undegraded":"2024-09-12T17:59:18.774603+0000","last_fullsized":"2024-09-12T17:59:18.774603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.000502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:47.016306+0000","last_change":"2024-09-12T17:21:41.866473+0000","last_active":"2024-09-12T17:57:47.016306+0000","last_peered":"2024-09-12T17:57:47.016306+0000","last_clean":"2024-09-12T17:57:47.016306+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T17:57:47.016306+0000","last_undegraded":"2024-09-12T17:57:47.016306+0000","last_fullsized":"2024-09-12T17:57:47.016306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:12.213846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'330","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:11.867648+0000","last_change":"2024-09-12T17:21:50.757872+0000","last_active":"2024-09-12T17:59:11.867648+0000","last_peered":"2024-09-12T17:59:11.867648+0000","last_clean":"2024-09-12T17:59:11.867648+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T17:59:11.867648+0000","last_undegraded":"2024-09-12T17:59:11.867648+0000","last_fullsized":"2024-09-12T17:59:11.867648+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:09.535999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10884887,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":556,"num_read_kb":13401,"num_write":1298,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.024531+0000","last_change":"2024-09-12T17:21:54.755790+0000","last_active":"2024-09-12T17:58:47.024531+0000","last_peered":"2024-09-12T17:58:47.024531+0000","last_clean":"2024-09-12T17:58:47.024531+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T17:58:47.024531+0000","last_undegraded":"2024-09-12T17:58:47.024531+0000","last_fullsized":"2024-09-12T17:58:47.024531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:59.470297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1231","reported_seq":2612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.128703+0000","last_change":"2024-09-12T17:21:56.768252+0000","last_active":"2024-09-12T18:00:56.128703+0000","last_peered":"2024-09-12T18:00:56.128703+0000","last_clean":"2024-09-12T18:00:56.128703+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:00:56.128703+0000","last_undegraded":"2024-09-12T18:00:56.128703+0000","last_fullsized":"2024-09-12T18:00:56.128703+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":1200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:01.013352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189156,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1940,"num_read_kb":3413,"num_write":1060,"num_write_kb":937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014403+0000","last_change":"2024-09-12T17:21:58.790253+0000","last_active":"2024-09-12T17:57:32.014403+0000","last_peered":"2024-09-12T17:57:32.014403+0000","last_clean":"2024-09-12T17:57:32.014403+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T17:57:32.014403+0000","last_undegraded":"2024-09-12T17:57:32.014403+0000","last_fullsized":"2024-09-12T17:57:32.014403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:47.790212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'133","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.894435+0000","last_change":"2024-09-12T17:22:00.798051+0000","last_active":"2024-09-12T17:59:12.894435+0000","last_peered":"2024-09-12T17:59:12.894435+0000","last_clean":"2024-09-12T17:59:12.894435+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T17:59:12.894435+0000","last_undegraded":"2024-09-12T17:59:12.894435+0000","last_fullsized":"2024-09-12T17:59:12.894435+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:21.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'449","reported_seq":1957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365791+0000","last_change":"2024-09-12T17:21:52.754734+0000","last_active":"2024-09-12T17:59:34.365791+0000","last_peered":"2024-09-12T17:59:34.365791+0000","last_clean":"2024-09-12T17:59:34.365791+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T17:59:34.365791+0000","last_undegraded":"2024-09-12T17:59:34.365791+0000","last_fullsized":"2024-09-12T17:59:34.365791+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:38.929430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:05.130098+0000","last_change":"2024-09-12T17:21:42.043085+0000","last_active":"2024-09-12T17:57:05.130098+0000","last_peered":"2024-09-12T17:57:05.130098+0000","last_clean":"2024-09-12T17:57:05.130098+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T17:57:05.130098+0000","last_undegraded":"2024-09-12T17:57:05.130098+0000","last_fullsized":"2024-09-12T17:57:05.130098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:25.499579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'307","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.079873+0000","last_change":"2024-09-12T17:21:50.744141+0000","last_active":"2024-09-12T18:01:03.079873+0000","last_peered":"2024-09-12T18:01:03.079873+0000","last_clean":"2024-09-12T18:01:03.079873+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:03.079873+0000","last_undegraded":"2024-09-12T18:01:03.079873+0000","last_fullsized":"2024-09-12T18:01:03.079873+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:16.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8349148,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":490,"num_read_kb":34998,"num_write":1087,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144229+0000","last_change":"2024-09-12T17:21:54.756222+0000","last_active":"2024-09-12T17:58:45.144229+0000","last_peered":"2024-09-12T17:58:45.144229+0000","last_clean":"2024-09-12T17:58:45.144229+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T17:58:45.144229+0000","last_undegraded":"2024-09-12T17:58:45.144229+0000","last_fullsized":"2024-09-12T17:58:45.144229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.426990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'196","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.143046+0000","last_change":"2024-09-12T17:21:56.768882+0000","last_active":"2024-09-12T18:00:54.143046+0000","last_peered":"2024-09-12T18:00:54.143046+0000","last_clean":"2024-09-12T18:00:54.143046+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:00:54.143046+0000","last_undegraded":"2024-09-12T18:00:54.143046+0000","last_fullsized":"2024-09-12T18:00:54.143046+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:28.839162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013880+0000","last_change":"2024-09-12T17:21:58.787288+0000","last_active":"2024-09-12T17:57:27.013880+0000","last_peered":"2024-09-12T17:57:27.013880+0000","last_clean":"2024-09-12T17:57:27.013880+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T17:57:27.013880+0000","last_undegraded":"2024-09-12T17:57:27.013880+0000","last_fullsized":"2024-09-12T17:57:27.013880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.278913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'288","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.917584+0000","last_change":"2024-09-12T17:22:00.794526+0000","last_active":"2024-09-12T17:59:34.917584+0000","last_peered":"2024-09-12T17:59:34.917584+0000","last_clean":"2024-09-12T17:59:34.917584+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T17:59:34.917584+0000","last_undegraded":"2024-09-12T17:59:34.917584+0000","last_fullsized":"2024-09-12T17:59:34.917584+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:11.669153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'466","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008227+0000","last_change":"2024-09-12T17:21:52.750831+0000","last_active":"2024-09-12T18:00:55.008227+0000","last_peered":"2024-09-12T18:00:55.008227+0000","last_clean":"2024-09-12T18:00:55.008227+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:00:55.008227+0000","last_undegraded":"2024-09-12T18:00:55.008227+0000","last_fullsized":"2024-09-12T18:00:55.008227+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:37.661922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010821+0000","last_change":"2024-09-12T17:21:41.867476+0000","last_active":"2024-09-12T17:57:07.010821+0000","last_peered":"2024-09-12T17:57:07.010821+0000","last_clean":"2024-09-12T17:57:07.010821+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T17:57:07.010821+0000","last_undegraded":"2024-09-12T17:57:07.010821+0000","last_fullsized":"2024-09-12T17:57:07.010821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:11.414546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'342","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.922185+0000","last_change":"2024-09-12T17:21:50.774438+0000","last_active":"2024-09-12T17:59:06.922185+0000","last_peered":"2024-09-12T17:59:06.922185+0000","last_clean":"2024-09-12T17:59:06.922185+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T17:59:06.922185+0000","last_undegraded":"2024-09-12T17:59:06.922185+0000","last_fullsized":"2024-09-12T17:59:06.922185+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.163145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9638691,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":550,"num_read_kb":11799,"num_write":1294,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133267+0000","last_change":"2024-09-12T17:21:54.752679+0000","last_active":"2024-09-12T17:57:25.133267+0000","last_peered":"2024-09-12T17:57:25.133267+0000","last_clean":"2024-09-12T17:57:25.133267+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T17:57:25.133267+0000","last_undegraded":"2024-09-12T17:57:25.133267+0000","last_fullsized":"2024-09-12T17:57:25.133267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:38.750473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'103","reported_seq":628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.240568+0000","last_change":"2024-09-12T17:21:56.763840+0000","last_active":"2024-09-12T18:00:56.240568+0000","last_peered":"2024-09-12T18:00:56.240568+0000","last_clean":"2024-09-12T18:00:56.240568+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:00:56.240568+0000","last_undegraded":"2024-09-12T18:00:56.240568+0000","last_fullsized":"2024-09-12T18:00:56.240568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:23.362341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025180+0000","last_change":"2024-09-12T17:21:58.789360+0000","last_active":"2024-09-12T17:58:52.025180+0000","last_peered":"2024-09-12T17:58:52.025180+0000","last_clean":"2024-09-12T17:58:52.025180+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T17:58:52.025180+0000","last_undegraded":"2024-09-12T17:58:52.025180+0000","last_fullsized":"2024-09-12T17:58:52.025180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:51.063573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'141","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.497508+0000","last_change":"2024-09-12T17:22:00.788204+0000","last_active":"2024-09-12T17:59:06.497508+0000","last_peered":"2024-09-12T17:59:06.497508+0000","last_clean":"2024-09-12T17:59:06.497508+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T17:59:06.497508+0000","last_undegraded":"2024-09-12T17:59:06.497508+0000","last_fullsized":"2024-09-12T17:59:06.497508+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:34.479482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'875","reported_seq":2704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521421+0000","last_change":"2024-09-12T17:21:52.747529+0000","last_active":"2024-09-12T17:59:17.521421+0000","last_peered":"2024-09-12T17:59:17.521421+0000","last_clean":"2024-09-12T17:59:17.521421+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T17:59:17.521421+0000","last_undegraded":"2024-09-12T17:59:17.521421+0000","last_fullsized":"2024-09-12T17:59:17.521421+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:25.413581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'314","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.008318+0000","last_change":"2024-09-12T17:21:50.763853+0000","last_active":"2024-09-12T17:58:51.008318+0000","last_peered":"2024-09-12T17:58:51.008318+0000","last_clean":"2024-09-12T17:58:51.008318+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T17:58:51.008318+0000","last_undegraded":"2024-09-12T17:58:51.008318+0000","last_fullsized":"2024-09-12T17:58:51.008318+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:50.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12929870,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":536,"num_read_kb":25520,"num_write":1185,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:08.123646+0000","last_change":"2024-09-12T17:21:42.043334+0000","last_active":"2024-09-12T17:57:08.123646+0000","last_peered":"2024-09-12T17:57:08.123646+0000","last_clean":"2024-09-12T17:57:08.123646+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T17:57:08.123646+0000","last_undegraded":"2024-09-12T17:57:08.123646+0000","last_fullsized":"2024-09-12T17:57:08.123646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:38.050118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.013014+0000","last_change":"2024-09-12T17:21:54.755491+0000","last_active":"2024-09-12T17:57:22.013014+0000","last_peered":"2024-09-12T17:57:22.013014+0000","last_clean":"2024-09-12T17:57:22.013014+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T17:57:22.013014+0000","last_undegraded":"2024-09-12T17:57:22.013014+0000","last_fullsized":"2024-09-12T17:57:22.013014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:39.242340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'533","reported_seq":1173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.094727+0000","last_change":"2024-09-12T17:21:56.763880+0000","last_active":"2024-09-12T18:00:56.094727+0000","last_peered":"2024-09-12T18:00:56.094727+0000","last_clean":"2024-09-12T18:00:56.094727+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:00:56.094727+0000","last_undegraded":"2024-09-12T18:00:56.094727+0000","last_fullsized":"2024-09-12T18:00:56.094727+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:59.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131153,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":1991,"num_write":782,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164192+0000","last_change":"2024-09-12T17:21:58.786573+0000","last_active":"2024-09-12T17:57:27.164192+0000","last_peered":"2024-09-12T17:57:27.164192+0000","last_clean":"2024-09-12T17:57:27.164192+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T17:57:27.164192+0000","last_undegraded":"2024-09-12T17:57:27.164192+0000","last_fullsized":"2024-09-12T17:57:27.164192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:30.677838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'166","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.362537+0000","last_change":"2024-09-12T17:22:00.798528+0000","last_active":"2024-09-12T17:59:34.362537+0000","last_peered":"2024-09-12T17:59:34.362537+0000","last_clean":"2024-09-12T17:59:34.362537+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T17:59:34.362537+0000","last_undegraded":"2024-09-12T17:59:34.362537+0000","last_fullsized":"2024-09-12T17:59:34.362537+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:54.854895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'825","reported_seq":2342,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.763003+0000","last_change":"2024-09-12T17:21:52.754209+0000","last_active":"2024-09-12T17:59:34.763003+0000","last_peered":"2024-09-12T17:59:34.763003+0000","last_clean":"2024-09-12T17:59:34.763003+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T17:59:34.763003+0000","last_undegraded":"2024-09-12T17:59:34.763003+0000","last_fullsized":"2024-09-12T17:59:34.763003+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:34.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'318","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.766376+0000","last_change":"2024-09-12T17:21:50.763342+0000","last_active":"2024-09-12T17:59:16.766376+0000","last_peered":"2024-09-12T17:59:16.766376+0000","last_clean":"2024-09-12T17:59:16.766376+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T17:59:16.766376+0000","last_undegraded":"2024-09-12T17:59:16.766376+0000","last_fullsized":"2024-09-12T17:59:16.766376+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:44.497032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2859250,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":521,"num_read_kb":7304,"num_write":1185,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.011523+0000","last_change":"2024-09-12T17:21:41.866466+0000","last_active":"2024-09-12T17:57:12.011523+0000","last_peered":"2024-09-12T17:57:12.011523+0000","last_clean":"2024-09-12T17:57:12.011523+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T17:57:12.011523+0000","last_undegraded":"2024-09-12T17:57:12.011523+0000","last_fullsized":"2024-09-12T17:57:12.011523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:41.352304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012430+0000","last_change":"2024-09-12T17:21:54.751823+0000","last_active":"2024-09-12T17:57:22.012430+0000","last_peered":"2024-09-12T17:57:22.012430+0000","last_clean":"2024-09-12T17:57:22.012430+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T17:57:22.012430+0000","last_undegraded":"2024-09-12T17:57:22.012430+0000","last_fullsized":"2024-09-12T17:57:22.012430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:45.553180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'154","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144606+0000","last_change":"2024-09-12T17:21:56.762425+0000","last_active":"2024-09-12T17:59:27.144606+0000","last_peered":"2024-09-12T17:59:27.144606+0000","last_clean":"2024-09-12T17:59:27.144606+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T17:59:27.144606+0000","last_undegraded":"2024-09-12T17:59:27.144606+0000","last_fullsized":"2024-09-12T17:59:27.144606+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:35.405866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'802","reported_seq":2565,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.130961+0000","last_change":"2024-09-12T17:21:58.782857+0000","last_active":"2024-09-12T18:00:56.130961+0000","last_peered":"2024-09-12T18:00:56.130961+0000","last_clean":"2024-09-12T18:00:56.130961+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:00:56.130961+0000","last_undegraded":"2024-09-12T18:00:56.130961+0000","last_fullsized":"2024-09-12T18:00:56.130961+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:02.049669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'109","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:20.158995+0000","last_change":"2024-09-12T17:22:00.794639+0000","last_active":"2024-09-12T18:00:20.158995+0000","last_peered":"2024-09-12T18:00:20.158995+0000","last_clean":"2024-09-12T18:00:20.158995+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:00:20.158995+0000","last_undegraded":"2024-09-12T18:00:20.158995+0000","last_fullsized":"2024-09-12T18:00:20.158995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:42.302531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'871","reported_seq":2582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.800538+0000","last_change":"2024-09-12T17:21:52.745987+0000","last_active":"2024-09-12T17:59:17.800538+0000","last_peered":"2024-09-12T17:59:17.800538+0000","last_clean":"2024-09-12T17:59:17.800538+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T17:59:17.800538+0000","last_undegraded":"2024-09-12T17:59:17.800538+0000","last_fullsized":"2024-09-12T17:59:17.800538+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:35.780719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'301","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.845137+0000","last_change":"2024-09-12T17:21:50.756194+0000","last_active":"2024-09-12T17:59:18.845137+0000","last_peered":"2024-09-12T17:59:18.845137+0000","last_clean":"2024-09-12T17:59:18.845137+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T17:59:18.845137+0000","last_undegraded":"2024-09-12T17:59:18.845137+0000","last_fullsized":"2024-09-12T17:59:18.845137+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:46.420332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6674336,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":464,"num_read_kb":10322,"num_write":1115,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.023460+0000","last_change":"2024-09-12T17:21:41.865878+0000","last_active":"2024-09-12T17:58:32.023460+0000","last_peered":"2024-09-12T17:58:32.023460+0000","last_clean":"2024-09-12T17:58:32.023460+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T17:58:32.023460+0000","last_undegraded":"2024-09-12T17:58:32.023460+0000","last_fullsized":"2024-09-12T17:58:32.023460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.625705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012930+0000","last_change":"2024-09-12T17:21:54.758563+0000","last_active":"2024-09-12T17:57:22.012930+0000","last_peered":"2024-09-12T17:57:22.012930+0000","last_clean":"2024-09-12T17:57:22.012930+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T17:57:22.012930+0000","last_undegraded":"2024-09-12T17:57:22.012930+0000","last_fullsized":"2024-09-12T17:57:22.012930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:07.608583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'96","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.275920+0000","last_change":"2024-09-12T17:21:56.765131+0000","last_active":"2024-09-12T17:59:06.275920+0000","last_peered":"2024-09-12T17:59:06.275920+0000","last_clean":"2024-09-12T17:59:06.275920+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T17:59:06.275920+0000","last_undegraded":"2024-09-12T17:59:06.275920+0000","last_fullsized":"2024-09-12T17:59:06.275920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:57.138933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'808","reported_seq":2355,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.904669+0000","last_change":"2024-09-12T17:21:58.785486+0000","last_active":"2024-09-12T18:01:02.904669+0000","last_peered":"2024-09-12T18:01:02.904669+0000","last_clean":"2024-09-12T18:01:02.904669+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:02.904669+0000","last_undegraded":"2024-09-12T18:01:02.904669+0000","last_fullsized":"2024-09-12T18:01:02.904669+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:06.317754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'325","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.374584+0000","last_change":"2024-09-12T17:22:00.794801+0000","last_active":"2024-09-12T17:59:34.374584+0000","last_peered":"2024-09-12T17:59:34.374584+0000","last_clean":"2024-09-12T17:59:34.374584+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T17:59:34.374584+0000","last_undegraded":"2024-09-12T17:59:34.374584+0000","last_fullsized":"2024-09-12T17:59:34.374584+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:20.169521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'491","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501739+0000","last_change":"2024-09-12T17:21:52.740621+0000","last_active":"2024-09-12T17:59:18.501739+0000","last_peered":"2024-09-12T17:59:18.501739+0000","last_clean":"2024-09-12T17:59:18.501739+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T17:59:18.501739+0000","last_undegraded":"2024-09-12T17:59:18.501739+0000","last_fullsized":"2024-09-12T17:59:18.501739+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:50.850961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'266","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.861386+0000","last_change":"2024-09-12T17:21:50.759984+0000","last_active":"2024-09-12T17:59:31.861386+0000","last_peered":"2024-09-12T17:59:31.861386+0000","last_clean":"2024-09-12T17:59:31.861386+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T17:59:31.861386+0000","last_undegraded":"2024-09-12T17:59:31.861386+0000","last_fullsized":"2024-09-12T17:59:31.861386+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.213987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4518961,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":476,"num_read_kb":59240,"num_write":949,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.022640+0000","last_change":"2024-09-12T17:21:41.866850+0000","last_active":"2024-09-12T17:58:32.022640+0000","last_peered":"2024-09-12T17:58:32.022640+0000","last_clean":"2024-09-12T17:58:32.022640+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T17:58:32.022640+0000","last_undegraded":"2024-09-12T17:58:32.022640+0000","last_fullsized":"2024-09-12T17:58:32.022640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.746085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.019639+0000","last_change":"2024-09-12T17:21:54.752228+0000","last_active":"2024-09-12T17:58:07.019639+0000","last_peered":"2024-09-12T17:58:07.019639+0000","last_clean":"2024-09-12T17:58:07.019639+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T17:58:07.019639+0000","last_undegraded":"2024-09-12T17:58:07.019639+0000","last_fullsized":"2024-09-12T17:58:07.019639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.871367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'731","reported_seq":1425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.090847+0000","last_change":"2024-09-12T17:21:56.767995+0000","last_active":"2024-09-12T18:00:56.090847+0000","last_peered":"2024-09-12T18:00:56.090847+0000","last_clean":"2024-09-12T18:00:56.090847+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:00:56.090847+0000","last_undegraded":"2024-09-12T18:00:56.090847+0000","last_fullsized":"2024-09-12T18:00:56.090847+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:13.584754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178459,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1281,"num_read_kb":2755,"num_write":1070,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013828+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:57:27.013828+0000","last_peered":"2024-09-12T17:57:27.013828+0000","last_clean":"2024-09-12T17:57:27.013828+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T17:57:27.013828+0000","last_undegraded":"2024-09-12T17:57:27.013828+0000","last_fullsized":"2024-09-12T17:57:27.013828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:01.402224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'132","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.226950+0000","last_change":"2024-09-12T17:22:00.789098+0000","last_active":"2024-09-12T17:59:03.226950+0000","last_peered":"2024-09-12T17:59:03.226950+0000","last_clean":"2024-09-12T17:59:03.226950+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T17:59:03.226950+0000","last_undegraded":"2024-09-12T17:59:03.226950+0000","last_fullsized":"2024-09-12T17:59:03.226950+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.614418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'152","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.424191+0000","last_change":"2024-09-12T17:22:00.786992+0000","last_active":"2024-09-12T17:59:34.424191+0000","last_peered":"2024-09-12T17:59:34.424191+0000","last_clean":"2024-09-12T17:59:34.424191+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T17:59:34.424191+0000","last_undegraded":"2024-09-12T17:59:34.424191+0000","last_fullsized":"2024-09-12T17:59:34.424191+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:08.329121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'468","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.769697+0000","last_change":"2024-09-12T17:21:52.742192+0000","last_active":"2024-09-12T17:59:18.769697+0000","last_peered":"2024-09-12T17:59:18.769697+0000","last_clean":"2024-09-12T17:59:18.769697+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T17:59:18.769697+0000","last_undegraded":"2024-09-12T17:59:18.769697+0000","last_fullsized":"2024-09-12T17:59:18.769697+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:43.783519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'260","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.047773+0000","last_change":"2024-09-12T17:21:50.771110+0000","last_active":"2024-09-12T17:59:19.047773+0000","last_peered":"2024-09-12T17:59:19.047773+0000","last_clean":"2024-09-12T17:59:19.047773+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T17:59:19.047773+0000","last_undegraded":"2024-09-12T17:59:19.047773+0000","last_fullsized":"2024-09-12T17:59:19.047773+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:22.753809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6582477,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":416,"num_read_kb":5950,"num_write":970,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124604+0000","last_change":"2024-09-12T17:21:54.759266+0000","last_active":"2024-09-12T17:56:57.124604+0000","last_peered":"2024-09-12T17:56:57.124604+0000","last_clean":"2024-09-12T17:56:57.124604+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T17:56:57.124604+0000","last_undegraded":"2024-09-12T17:56:57.124604+0000","last_fullsized":"2024-09-12T17:56:57.124604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:37.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'290","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.143175+0000","last_change":"2024-09-12T17:21:56.766802+0000","last_active":"2024-09-12T17:59:17.143175+0000","last_peered":"2024-09-12T17:59:17.143175+0000","last_clean":"2024-09-12T17:59:17.143175+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T17:59:17.143175+0000","last_undegraded":"2024-09-12T17:59:17.143175+0000","last_fullsized":"2024-09-12T17:59:17.143175+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.524361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1042,"num_write":404,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129355+0000","last_change":"2024-09-12T17:21:58.781271+0000","last_active":"2024-09-12T17:57:00.129355+0000","last_peered":"2024-09-12T17:57:00.129355+0000","last_clean":"2024-09-12T17:57:00.129355+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T17:57:00.129355+0000","last_undegraded":"2024-09-12T17:57:00.129355+0000","last_fullsized":"2024-09-12T17:57:00.129355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:44.876899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.826880+0000","last_change":"2024-09-12T17:22:00.795423+0000","last_active":"2024-09-12T17:59:34.826880+0000","last_peered":"2024-09-12T17:59:34.826880+0000","last_clean":"2024-09-12T17:59:34.826880+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T17:59:34.826880+0000","last_undegraded":"2024-09-12T17:59:34.826880+0000","last_fullsized":"2024-09-12T17:59:34.826880+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:51.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'639","reported_seq":2255,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.002741+0000","last_change":"2024-09-12T17:21:52.744060+0000","last_active":"2024-09-12T17:59:16.002741+0000","last_peered":"2024-09-12T17:59:16.002741+0000","last_clean":"2024-09-12T17:59:16.002741+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T17:59:16.002741+0000","last_undegraded":"2024-09-12T17:59:16.002741+0000","last_fullsized":"2024-09-12T17:59:16.002741+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:49.782641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'246","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.122964+0000","last_change":"2024-09-12T17:22:26.296706+0000","last_active":"2024-09-12T18:01:03.122964+0000","last_peered":"2024-09-12T18:01:03.122964+0000","last_clean":"2024-09-12T18:01:03.122964+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:03.122964+0000","last_undegraded":"2024-09-12T18:01:03.122964+0000","last_fullsized":"2024-09-12T18:01:03.122964+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:49.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7374334,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":367,"num_read_kb":12892,"num_write":912,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009094+0000","last_change":"2024-09-12T17:21:54.755356+0000","last_active":"2024-09-12T17:56:57.009094+0000","last_peered":"2024-09-12T17:56:57.009094+0000","last_clean":"2024-09-12T17:56:57.009094+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T17:56:57.009094+0000","last_undegraded":"2024-09-12T17:56:57.009094+0000","last_fullsized":"2024-09-12T17:56:57.009094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:02.209702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":547,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.778422+0000","last_change":"2024-09-12T17:21:56.761388+0000","last_active":"2024-09-12T17:58:38.778422+0000","last_peered":"2024-09-12T17:58:38.778422+0000","last_clean":"2024-09-12T17:58:38.778422+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T17:58:38.778422+0000","last_undegraded":"2024-09-12T17:58:38.778422+0000","last_fullsized":"2024-09-12T17:58:38.778422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:20.116062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160637+0000","last_change":"2024-09-12T17:21:58.779273+0000","last_active":"2024-09-12T17:57:02.160637+0000","last_peered":"2024-09-12T17:57:02.160637+0000","last_clean":"2024-09-12T17:57:02.160637+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T17:57:02.160637+0000","last_undegraded":"2024-09-12T17:57:02.160637+0000","last_fullsized":"2024-09-12T17:57:02.160637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:23.417297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'227","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.355106+0000","last_change":"2024-09-12T17:22:00.795725+0000","last_active":"2024-09-12T17:59:34.355106+0000","last_peered":"2024-09-12T17:59:34.355106+0000","last_clean":"2024-09-12T17:59:34.355106+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T17:59:34.355106+0000","last_undegraded":"2024-09-12T17:59:34.355106+0000","last_fullsized":"2024-09-12T17:59:34.355106+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:25.111700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'387","reported_seq":1863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760420+0000","last_change":"2024-09-12T17:21:52.750349+0000","last_active":"2024-09-12T17:59:34.760420+0000","last_peered":"2024-09-12T17:59:34.760420+0000","last_clean":"2024-09-12T17:59:34.760420+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T17:59:34.760420+0000","last_undegraded":"2024-09-12T17:59:34.760420+0000","last_fullsized":"2024-09-12T17:59:34.760420+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:27.902470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'274","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:39.444565+0000","last_change":"2024-09-12T17:21:50.769491+0000","last_active":"2024-09-12T17:58:39.444565+0000","last_peered":"2024-09-12T17:58:39.444565+0000","last_clean":"2024-09-12T17:58:39.444565+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T17:58:39.444565+0000","last_undegraded":"2024-09-12T17:58:39.444565+0000","last_fullsized":"2024-09-12T17:58:39.444565+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:13.935748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4503077,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":372,"num_read_kb":8586,"num_write":1045,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159979+0000","last_change":"2024-09-12T17:21:54.753914+0000","last_active":"2024-09-12T17:56:57.159979+0000","last_peered":"2024-09-12T17:56:57.159979+0000","last_clean":"2024-09-12T17:56:57.159979+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T17:56:57.159979+0000","last_undegraded":"2024-09-12T17:56:57.159979+0000","last_fullsized":"2024-09-12T17:56:57.159979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.689343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'313","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.367050+0000","last_change":"2024-09-12T17:21:56.766069+0000","last_active":"2024-09-12T17:59:34.367050+0000","last_peered":"2024-09-12T17:59:34.367050+0000","last_clean":"2024-09-12T17:59:34.367050+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T17:59:34.367050+0000","last_undegraded":"2024-09-12T17:59:34.367050+0000","last_fullsized":"2024-09-12T17:59:34.367050+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:38.666434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":1089,"num_write":432,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.120621+0000","last_change":"2024-09-12T17:21:58.781433+0000","last_active":"2024-09-12T17:57:02.120621+0000","last_peered":"2024-09-12T17:57:02.120621+0000","last_clean":"2024-09-12T17:57:02.120621+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T17:57:02.120621+0000","last_undegraded":"2024-09-12T17:57:02.120621+0000","last_fullsized":"2024-09-12T17:57:02.120621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:29.832595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'133","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.970181+0000","last_change":"2024-09-12T17:22:00.797551+0000","last_active":"2024-09-12T17:59:02.970181+0000","last_peered":"2024-09-12T17:59:02.970181+0000","last_clean":"2024-09-12T17:59:02.970181+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T17:59:02.970181+0000","last_undegraded":"2024-09-12T17:59:02.970181+0000","last_fullsized":"2024-09-12T17:59:02.970181+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:41.162485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'740","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.538431+0000","last_change":"2024-09-12T17:21:52.749905+0000","last_active":"2024-09-12T17:59:12.538431+0000","last_peered":"2024-09-12T17:59:12.538431+0000","last_clean":"2024-09-12T17:59:12.538431+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T17:59:12.538431+0000","last_undegraded":"2024-09-12T17:59:12.538431+0000","last_fullsized":"2024-09-12T17:59:12.538431+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:52.822961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'276","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.048928+0000","last_change":"2024-09-12T17:21:50.755503+0000","last_active":"2024-09-12T18:01:03.048928+0000","last_peered":"2024-09-12T18:01:03.048928+0000","last_clean":"2024-09-12T18:01:03.048928+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:03.048928+0000","last_undegraded":"2024-09-12T18:01:03.048928+0000","last_fullsized":"2024-09-12T18:01:03.048928+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:37.883856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406045,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":467,"num_read_kb":5945,"num_write":1155,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009139+0000","last_change":"2024-09-12T17:21:54.758453+0000","last_active":"2024-09-12T17:56:57.009139+0000","last_peered":"2024-09-12T17:56:57.009139+0000","last_clean":"2024-09-12T17:56:57.009139+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T17:56:57.009139+0000","last_undegraded":"2024-09-12T17:56:57.009139+0000","last_fullsized":"2024-09-12T17:56:57.009139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.810118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'249","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.027723+0000","last_change":"2024-09-12T17:21:56.769935+0000","last_active":"2024-09-12T17:59:17.027723+0000","last_peered":"2024-09-12T17:59:17.027723+0000","last_clean":"2024-09-12T17:59:17.027723+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T17:59:17.027723+0000","last_undegraded":"2024-09-12T17:59:17.027723+0000","last_fullsized":"2024-09-12T17:59:17.027723+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:39.633555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60129,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":944,"num_write":362,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129426+0000","last_change":"2024-09-12T17:21:58.785066+0000","last_active":"2024-09-12T17:57:00.129426+0000","last_peered":"2024-09-12T17:57:00.129426+0000","last_clean":"2024-09-12T17:57:00.129426+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T17:57:00.129426+0000","last_undegraded":"2024-09-12T17:57:00.129426+0000","last_fullsized":"2024-09-12T17:57:00.129426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:41.442928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'404","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618747+0000","last_change":"2024-09-12T17:21:52.755203+0000","last_active":"2024-09-12T17:59:16.618747+0000","last_peered":"2024-09-12T17:59:16.618747+0000","last_clean":"2024-09-12T17:59:16.618747+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T17:59:16.618747+0000","last_undegraded":"2024-09-12T17:59:16.618747+0000","last_fullsized":"2024-09-12T17:59:16.618747+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:20.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'254","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.985943+0000","last_change":"2024-09-12T17:21:50.762696+0000","last_active":"2024-09-12T18:01:02.985943+0000","last_peered":"2024-09-12T18:01:02.985943+0000","last_clean":"2024-09-12T18:01:02.985943+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:02.985943+0000","last_undegraded":"2024-09-12T18:01:02.985943+0000","last_fullsized":"2024-09-12T18:01:02.985943+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:29.711995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10435358,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":392,"num_read_kb":25374,"num_write":917,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133894+0000","last_change":"2024-09-12T17:21:54.759183+0000","last_active":"2024-09-12T17:58:02.133894+0000","last_peered":"2024-09-12T17:58:02.133894+0000","last_clean":"2024-09-12T17:58:02.133894+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T17:58:02.133894+0000","last_undegraded":"2024-09-12T17:58:02.133894+0000","last_fullsized":"2024-09-12T17:58:02.133894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:44.448393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'476","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.087281+0000","last_change":"2024-09-12T17:21:56.768691+0000","last_active":"2024-09-12T18:00:56.087281+0000","last_peered":"2024-09-12T18:00:56.087281+0000","last_clean":"2024-09-12T18:00:56.087281+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:00:56.087281+0000","last_undegraded":"2024-09-12T18:00:56.087281+0000","last_fullsized":"2024-09-12T18:00:56.087281+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.730690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116754,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1861,"num_write":748,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160707+0000","last_change":"2024-09-12T17:21:58.784784+0000","last_active":"2024-09-12T17:57:02.160707+0000","last_peered":"2024-09-12T17:57:02.160707+0000","last_clean":"2024-09-12T17:57:02.160707+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T17:57:02.160707+0000","last_undegraded":"2024-09-12T17:57:02.160707+0000","last_fullsized":"2024-09-12T17:57:02.160707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:09.975350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'164","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.836312+0000","last_change":"2024-09-12T17:22:00.798771+0000","last_active":"2024-09-12T17:59:28.836312+0000","last_peered":"2024-09-12T17:59:28.836312+0000","last_clean":"2024-09-12T17:59:28.836312+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T17:59:28.836312+0000","last_undegraded":"2024-09-12T17:59:28.836312+0000","last_fullsized":"2024-09-12T17:59:28.836312+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:10.472501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'420","reported_seq":1885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952594+0000","last_change":"2024-09-12T17:21:52.746392+0000","last_active":"2024-09-12T17:59:16.952594+0000","last_peered":"2024-09-12T17:59:16.952594+0000","last_clean":"2024-09-12T17:59:16.952594+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T17:59:16.952594+0000","last_undegraded":"2024-09-12T17:59:16.952594+0000","last_fullsized":"2024-09-12T17:59:16.952594+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:08.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'275","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.985038+0000","last_change":"2024-09-12T17:21:50.759865+0000","last_active":"2024-09-12T17:59:09.985038+0000","last_peered":"2024-09-12T17:59:09.985038+0000","last_clean":"2024-09-12T17:59:09.985038+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T17:59:09.985038+0000","last_undegraded":"2024-09-12T17:59:09.985038+0000","last_fullsized":"2024-09-12T17:59:09.985038+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:18.154345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7238788,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":454,"num_read_kb":48900,"num_write":991,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.163561+0000","last_change":"2024-09-12T17:21:54.757887+0000","last_active":"2024-09-12T17:57:22.163561+0000","last_peered":"2024-09-12T17:57:22.163561+0000","last_clean":"2024-09-12T17:57:22.163561+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T17:57:22.163561+0000","last_undegraded":"2024-09-12T17:57:22.163561+0000","last_fullsized":"2024-09-12T17:57:22.163561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:57.740295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'290","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.029763+0000","last_change":"2024-09-12T17:21:56.759500+0000","last_active":"2024-09-12T17:59:27.029763+0000","last_peered":"2024-09-12T17:59:27.029763+0000","last_clean":"2024-09-12T17:59:27.029763+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T17:59:27.029763+0000","last_undegraded":"2024-09-12T17:59:27.029763+0000","last_fullsized":"2024-09-12T17:59:27.029763+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:26.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55713,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":962,"num_write":408,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.122006+0000","last_change":"2024-09-12T17:21:58.795399+0000","last_active":"2024-09-12T17:56:58.122006+0000","last_peered":"2024-09-12T17:56:58.122006+0000","last_clean":"2024-09-12T17:56:58.122006+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T17:56:58.122006+0000","last_undegraded":"2024-09-12T17:56:58.122006+0000","last_fullsized":"2024-09-12T17:56:58.122006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:48.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'190","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.181615+0000","last_change":"2024-09-12T17:22:00.794027+0000","last_active":"2024-09-12T17:59:33.181615+0000","last_peered":"2024-09-12T17:59:33.181615+0000","last_clean":"2024-09-12T17:59:33.181615+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T17:59:33.181615+0000","last_undegraded":"2024-09-12T17:59:33.181615+0000","last_fullsized":"2024-09-12T17:59:33.181615+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:17.004717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'853","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.133185+0000","last_change":"2024-09-12T17:21:52.755426+0000","last_active":"2024-09-12T17:59:15.133185+0000","last_peered":"2024-09-12T17:59:15.133185+0000","last_clean":"2024-09-12T17:59:15.133185+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T17:59:15.133185+0000","last_undegraded":"2024-09-12T17:59:15.133185+0000","last_fullsized":"2024-09-12T17:59:15.133185+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:04.598499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'270","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.669418+0000","last_change":"2024-09-12T17:21:50.755856+0000","last_active":"2024-09-12T17:59:15.669418+0000","last_peered":"2024-09-12T17:59:15.669418+0000","last_clean":"2024-09-12T17:59:15.669418+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T17:59:15.669418+0000","last_undegraded":"2024-09-12T17:59:15.669418+0000","last_fullsized":"2024-09-12T17:59:15.669418+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:22.206678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8742585,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":429,"num_read_kb":72608,"num_write":1034,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160042+0000","last_change":"2024-09-12T17:21:54.750383+0000","last_active":"2024-09-12T17:56:57.160042+0000","last_peered":"2024-09-12T17:56:57.160042+0000","last_clean":"2024-09-12T17:56:57.160042+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T17:56:57.160042+0000","last_undegraded":"2024-09-12T17:56:57.160042+0000","last_fullsized":"2024-09-12T17:56:57.160042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'233","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144735+0000","last_change":"2024-09-12T17:21:56.768390+0000","last_active":"2024-09-12T17:59:27.144735+0000","last_peered":"2024-09-12T17:59:27.144735+0000","last_clean":"2024-09-12T17:59:27.144735+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T17:59:27.144735+0000","last_undegraded":"2024-09-12T17:59:27.144735+0000","last_fullsized":"2024-09-12T17:59:27.144735+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:20.766139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56008,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":384,"num_read_kb":808,"num_write":308,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138962+0000","last_change":"2024-09-12T17:21:58.784005+0000","last_active":"2024-09-12T17:58:05.138962+0000","last_peered":"2024-09-12T17:58:05.138962+0000","last_clean":"2024-09-12T17:58:05.138962+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T17:58:05.138962+0000","last_undegraded":"2024-09-12T17:58:05.138962+0000","last_fullsized":"2024-09-12T17:58:05.138962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:02.608599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'111","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.117938+0000","last_change":"2024-09-12T17:22:00.796332+0000","last_active":"2024-09-12T18:00:56.117938+0000","last_peered":"2024-09-12T18:00:56.117938+0000","last_clean":"2024-09-12T18:00:56.117938+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:00:56.117938+0000","last_undegraded":"2024-09-12T18:00:56.117938+0000","last_fullsized":"2024-09-12T18:00:56.117938+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'488","reported_seq":2088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999609+0000","last_change":"2024-09-12T17:21:52.747235+0000","last_active":"2024-09-12T18:00:54.999609+0000","last_peered":"2024-09-12T18:00:54.999609+0000","last_clean":"2024-09-12T18:00:54.999609+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:00:54.999609+0000","last_undegraded":"2024-09-12T18:00:54.999609+0000","last_fullsized":"2024-09-12T18:00:54.999609+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:11.805325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'249","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.110615+0000","last_change":"2024-09-12T17:21:50.761070+0000","last_active":"2024-09-12T17:59:12.110615+0000","last_peered":"2024-09-12T17:59:12.110615+0000","last_clean":"2024-09-12T17:59:12.110615+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T17:59:12.110615+0000","last_undegraded":"2024-09-12T17:59:12.110615+0000","last_fullsized":"2024-09-12T17:59:12.110615+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:43.740244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4363624,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":359,"num_read_kb":22007,"num_write":882,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009133+0000","last_change":"2024-09-12T17:21:54.755644+0000","last_active":"2024-09-12T17:56:57.009133+0000","last_peered":"2024-09-12T17:56:57.009133+0000","last_clean":"2024-09-12T17:56:57.009133+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T17:56:57.009133+0000","last_undegraded":"2024-09-12T17:56:57.009133+0000","last_fullsized":"2024-09-12T17:56:57.009133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'79","reported_seq":592,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:16.585394+0000","last_change":"2024-09-12T17:21:56.761019+0000","last_active":"2024-09-12T17:58:16.585394+0000","last_peered":"2024-09-12T17:58:16.585394+0000","last_clean":"2024-09-12T17:58:16.585394+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T17:58:16.585394+0000","last_undegraded":"2024-09-12T17:58:16.585394+0000","last_fullsized":"2024-09-12T17:58:16.585394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.371470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'753","reported_seq":2430,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.129874+0000","last_change":"2024-09-12T17:21:58.783309+0000","last_active":"2024-09-12T18:00:56.129874+0000","last_peered":"2024-09-12T18:00:56.129874+0000","last_clean":"2024-09-12T18:00:56.129874+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:00:56.129874+0000","last_undegraded":"2024-09-12T18:00:56.129874+0000","last_fullsized":"2024-09-12T18:00:56.129874+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:14.021972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'111","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.028820+0000","last_change":"2024-09-12T17:22:00.792450+0000","last_active":"2024-09-12T17:59:22.028820+0000","last_peered":"2024-09-12T17:59:22.028820+0000","last_clean":"2024-09-12T17:59:22.028820+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T17:59:22.028820+0000","last_undegraded":"2024-09-12T17:59:22.028820+0000","last_fullsized":"2024-09-12T17:59:22.028820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.275271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'468","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.759665+0000","last_change":"2024-09-12T17:21:52.751365+0000","last_active":"2024-09-12T17:59:34.759665+0000","last_peered":"2024-09-12T17:59:34.759665+0000","last_clean":"2024-09-12T17:59:34.759665+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T17:59:34.759665+0000","last_undegraded":"2024-09-12T17:59:34.759665+0000","last_fullsized":"2024-09-12T17:59:34.759665+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:36.771613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'277","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.240174+0000","last_change":"2024-09-12T17:21:50.768703+0000","last_active":"2024-09-12T17:58:51.240174+0000","last_peered":"2024-09-12T17:58:51.240174+0000","last_clean":"2024-09-12T17:58:51.240174+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T17:58:51.240174+0000","last_undegraded":"2024-09-12T17:58:51.240174+0000","last_fullsized":"2024-09-12T17:58:51.240174+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:26.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16653203,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":406,"num_read_kb":20561,"num_write":1007,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.120023+0000","last_change":"2024-09-12T17:21:54.752741+0000","last_active":"2024-09-12T17:56:57.120023+0000","last_peered":"2024-09-12T17:56:57.120023+0000","last_clean":"2024-09-12T17:56:57.120023+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T17:56:57.120023+0000","last_undegraded":"2024-09-12T17:56:57.120023+0000","last_fullsized":"2024-09-12T17:56:57.120023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:50.651848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:47.038518+0000","last_change":"2024-09-12T17:21:56.771872+0000","last_active":"2024-09-12T18:00:47.038518+0000","last_peered":"2024-09-12T18:00:47.038518+0000","last_clean":"2024-09-12T18:00:47.038518+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:00:47.038518+0000","last_undegraded":"2024-09-12T18:00:47.038518+0000","last_fullsized":"2024-09-12T18:00:47.038518+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:31.183940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60828,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":462,"num_read_kb":940,"num_write":384,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021920+0000","last_change":"2024-09-12T17:21:58.789902+0000","last_active":"2024-09-12T17:58:17.021920+0000","last_peered":"2024-09-12T17:58:17.021920+0000","last_clean":"2024-09-12T17:58:17.021920+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T17:58:17.021920+0000","last_undegraded":"2024-09-12T17:58:17.021920+0000","last_fullsized":"2024-09-12T17:58:17.021920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.777449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'139","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.021593+0000","last_change":"2024-09-12T17:22:00.794282+0000","last_active":"2024-09-12T17:59:34.021593+0000","last_peered":"2024-09-12T17:59:34.021593+0000","last_clean":"2024-09-12T17:59:34.021593+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T17:59:34.021593+0000","last_undegraded":"2024-09-12T17:59:34.021593+0000","last_fullsized":"2024-09-12T17:59:34.021593+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:58.732912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'468","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002055+0000","last_change":"2024-09-12T17:21:52.746743+0000","last_active":"2024-09-12T18:00:55.002055+0000","last_peered":"2024-09-12T18:00:55.002055+0000","last_clean":"2024-09-12T18:00:55.002055+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:00:55.002055+0000","last_undegraded":"2024-09-12T18:00:55.002055+0000","last_fullsized":"2024-09-12T18:00:55.002055+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.604964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'275","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.416272+0000","last_change":"2024-09-12T17:21:50.771314+0000","last_active":"2024-09-12T18:00:54.416272+0000","last_peered":"2024-09-12T18:00:54.416272+0000","last_clean":"2024-09-12T18:00:54.416272+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:00:54.416272+0000","last_undegraded":"2024-09-12T18:00:54.416272+0000","last_fullsized":"2024-09-12T18:00:54.416272+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:28.163181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13097890,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":430,"num_read_kb":60843,"num_write":1041,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160026+0000","last_change":"2024-09-12T17:21:54.754687+0000","last_active":"2024-09-12T17:56:57.160026+0000","last_peered":"2024-09-12T17:56:57.160026+0000","last_clean":"2024-09-12T17:56:57.160026+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T17:56:57.160026+0000","last_undegraded":"2024-09-12T17:56:57.160026+0000","last_fullsized":"2024-09-12T17:56:57.160026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.236794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'248","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:37.039810+0000","last_change":"2024-09-12T17:21:56.764040+0000","last_active":"2024-09-12T18:00:37.039810+0000","last_peered":"2024-09-12T18:00:37.039810+0000","last_clean":"2024-09-12T18:00:37.039810+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:00:37.039810+0000","last_undegraded":"2024-09-12T18:00:37.039810+0000","last_fullsized":"2024-09-12T18:00:37.039810+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:13.554679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56791,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":411,"num_read_kb":885,"num_write":340,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021541+0000","last_change":"2024-09-12T17:21:58.783726+0000","last_active":"2024-09-12T17:58:22.021541+0000","last_peered":"2024-09-12T17:58:22.021541+0000","last_clean":"2024-09-12T17:58:22.021541+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T17:58:22.021541+0000","last_undegraded":"2024-09-12T17:58:22.021541+0000","last_fullsized":"2024-09-12T17:58:22.021541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'103","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.765064+0000","last_change":"2024-09-12T17:22:00.798683+0000","last_active":"2024-09-12T17:59:34.765064+0000","last_peered":"2024-09-12T17:59:34.765064+0000","last_clean":"2024-09-12T17:59:34.765064+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T17:59:34.765064+0000","last_undegraded":"2024-09-12T17:59:34.765064+0000","last_fullsized":"2024-09-12T17:59:34.765064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:52.343353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840653+0000","last_change":"2024-09-12T17:21:52.750254+0000","last_active":"2024-09-12T17:59:28.840653+0000","last_peered":"2024-09-12T17:59:28.840653+0000","last_clean":"2024-09-12T17:59:28.840653+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T17:59:28.840653+0000","last_undegraded":"2024-09-12T17:59:28.840653+0000","last_fullsized":"2024-09-12T17:59:28.840653+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:42.642542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'333","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.145849+0000","last_change":"2024-09-12T17:21:50.747069+0000","last_active":"2024-09-12T18:01:03.145849+0000","last_peered":"2024-09-12T18:01:03.145849+0000","last_clean":"2024-09-12T18:01:03.145849+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:03.145849+0000","last_undegraded":"2024-09-12T18:01:03.145849+0000","last_fullsized":"2024-09-12T18:01:03.145849+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:49.408880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18570645,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":598,"num_read_kb":67994,"num_write":1172,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.130730+0000","last_change":"2024-09-12T17:21:54.750762+0000","last_active":"2024-09-12T17:58:12.130730+0000","last_peered":"2024-09-12T17:58:12.130730+0000","last_clean":"2024-09-12T17:58:12.130730+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T17:58:12.130730+0000","last_undegraded":"2024-09-12T17:58:12.130730+0000","last_fullsized":"2024-09-12T17:58:12.130730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:35.152406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'226","reported_seq":773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144681+0000","last_change":"2024-09-12T17:21:56.763924+0000","last_active":"2024-09-12T17:59:27.144681+0000","last_peered":"2024-09-12T17:59:27.144681+0000","last_clean":"2024-09-12T17:59:27.144681+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T17:59:27.144681+0000","last_undegraded":"2024-09-12T17:59:27.144681+0000","last_fullsized":"2024-09-12T17:59:27.144681+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.766828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":857,"num_write":324,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.010097+0000","last_change":"2024-09-12T17:21:58.790322+0000","last_active":"2024-09-12T17:57:02.010097+0000","last_peered":"2024-09-12T17:57:02.010097+0000","last_clean":"2024-09-12T17:57:02.010097+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T17:57:02.010097+0000","last_undegraded":"2024-09-12T17:57:02.010097+0000","last_fullsized":"2024-09-12T17:57:02.010097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:02.075930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'218","reported_seq":1317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.414101+0000","last_change":"2024-09-12T17:22:00.798392+0000","last_active":"2024-09-12T17:59:33.414101+0000","last_peered":"2024-09-12T17:59:33.414101+0000","last_clean":"2024-09-12T17:59:33.414101+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T17:59:33.414101+0000","last_undegraded":"2024-09-12T17:59:33.414101+0000","last_fullsized":"2024-09-12T17:59:33.414101+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:00.108534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012393+0000","last_change":"2024-09-12T17:21:52.737742+0000","last_active":"2024-09-12T17:59:19.012393+0000","last_peered":"2024-09-12T17:59:19.012393+0000","last_clean":"2024-09-12T17:59:19.012393+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T17:59:19.012393+0000","last_undegraded":"2024-09-12T17:59:19.012393+0000","last_fullsized":"2024-09-12T17:59:19.012393+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:14.225738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'288","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.128386+0000","last_change":"2024-09-12T17:21:50.755052+0000","last_active":"2024-09-12T18:01:03.128386+0000","last_peered":"2024-09-12T18:01:03.128386+0000","last_clean":"2024-09-12T18:01:03.128386+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:03.128386+0000","last_undegraded":"2024-09-12T18:01:03.128386+0000","last_fullsized":"2024-09-12T18:01:03.128386+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:25.454728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8793260,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":474,"num_read_kb":16565,"num_write":1033,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.022475+0000","last_change":"2024-09-12T17:21:54.758914+0000","last_active":"2024-09-12T17:58:22.022475+0000","last_peered":"2024-09-12T17:58:22.022475+0000","last_clean":"2024-09-12T17:58:22.022475+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T17:58:22.022475+0000","last_undegraded":"2024-09-12T17:58:22.022475+0000","last_fullsized":"2024-09-12T17:58:22.022475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:37.175631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'288","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.029722+0000","last_change":"2024-09-12T17:21:56.770020+0000","last_active":"2024-09-12T17:59:27.029722+0000","last_peered":"2024-09-12T17:59:27.029722+0000","last_clean":"2024-09-12T17:59:27.029722+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T17:59:27.029722+0000","last_undegraded":"2024-09-12T17:59:27.029722+0000","last_fullsized":"2024-09-12T17:59:27.029722+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:51.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":984,"num_write":398,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009822+0000","last_change":"2024-09-12T17:21:58.782815+0000","last_active":"2024-09-12T17:57:02.009822+0000","last_peered":"2024-09-12T17:57:02.009822+0000","last_clean":"2024-09-12T17:57:02.009822+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T17:57:02.009822+0000","last_undegraded":"2024-09-12T17:57:02.009822+0000","last_fullsized":"2024-09-12T17:57:02.009822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:12.520411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'136","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998151+0000","last_change":"2024-09-12T17:22:00.796520+0000","last_active":"2024-09-12T18:00:54.998151+0000","last_peered":"2024-09-12T18:00:54.998151+0000","last_clean":"2024-09-12T18:00:54.998151+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:00:54.998151+0000","last_undegraded":"2024-09-12T18:00:54.998151+0000","last_fullsized":"2024-09-12T18:00:54.998151+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:43.432009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'777","reported_seq":2423,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774914+0000","last_change":"2024-09-12T17:21:52.742859+0000","last_active":"2024-09-12T17:59:18.774914+0000","last_peered":"2024-09-12T17:59:18.774914+0000","last_clean":"2024-09-12T17:59:18.774914+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T17:59:18.774914+0000","last_undegraded":"2024-09-12T17:59:18.774914+0000","last_fullsized":"2024-09-12T17:59:18.774914+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:32.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'301","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.640869+0000","last_change":"2024-09-12T17:21:50.764860+0000","last_active":"2024-09-12T17:59:31.640869+0000","last_peered":"2024-09-12T17:59:31.640869+0000","last_clean":"2024-09-12T17:59:31.640869+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T17:59:31.640869+0000","last_undegraded":"2024-09-12T17:59:31.640869+0000","last_fullsized":"2024-09-12T17:59:31.640869+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:29.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13727362,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":471,"num_read_kb":161127,"num_write":1069,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'469","reported_seq":1778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129978+0000","last_change":"2024-09-12T17:21:52.753034+0000","last_active":"2024-09-12T17:59:18.129978+0000","last_peered":"2024-09-12T17:59:18.129978+0000","last_clean":"2024-09-12T17:59:18.129978+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T17:59:18.129978+0000","last_undegraded":"2024-09-12T17:59:18.129978+0000","last_fullsized":"2024-09-12T17:59:18.129978+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.231475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'393","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:31.637964+0000","last_change":"2024-09-12T17:21:50.763558+0000","last_active":"2024-09-12T17:59:31.637964+0000","last_peered":"2024-09-12T17:59:31.637964+0000","last_clean":"2024-09-12T17:59:31.637964+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T17:59:31.637964+0000","last_undegraded":"2024-09-12T17:59:31.637964+0000","last_fullsized":"2024-09-12T17:59:31.637964+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:23.906686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7369359,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":754,"num_read_kb":23219,"num_write":1254,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'804","reported_seq":2433,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.260815+0000","last_change":"2024-09-12T17:21:52.750129+0000","last_active":"2024-09-12T17:59:12.260815+0000","last_peered":"2024-09-12T17:59:12.260815+0000","last_clean":"2024-09-12T17:59:12.260815+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T17:59:12.260815+0000","last_undegraded":"2024-09-12T17:59:12.260815+0000","last_fullsized":"2024-09-12T17:59:12.260815+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.542955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'305","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:51.136362+0000","last_change":"2024-09-12T17:21:50.764053+0000","last_active":"2024-09-12T17:58:51.136362+0000","last_peered":"2024-09-12T17:58:51.136362+0000","last_clean":"2024-09-12T17:58:51.136362+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T17:58:51.136362+0000","last_undegraded":"2024-09-12T17:58:51.136362+0000","last_fullsized":"2024-09-12T17:58:51.136362+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.510424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109542,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":553,"num_read_kb":33088,"num_write":1109,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'920","reported_seq":2559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390034+0000","last_change":"2024-09-12T17:21:52.751702+0000","last_active":"2024-09-12T17:59:16.390034+0000","last_peered":"2024-09-12T17:59:16.390034+0000","last_clean":"2024-09-12T17:59:16.390034+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T17:59:16.390034+0000","last_undegraded":"2024-09-12T17:59:16.390034+0000","last_fullsized":"2024-09-12T17:59:16.390034+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.873565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'342","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.096244+0000","last_change":"2024-09-12T17:21:50.769742+0000","last_active":"2024-09-12T18:01:03.096244+0000","last_peered":"2024-09-12T18:01:03.096244+0000","last_clean":"2024-09-12T18:01:03.096244+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:03.096244+0000","last_undegraded":"2024-09-12T18:01:03.096244+0000","last_fullsized":"2024-09-12T18:01:03.096244+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:23.762144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14992016,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":612,"num_read_kb":28924,"num_write":1282,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'501","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.635643+0000","last_change":"2024-09-12T17:21:52.750068+0000","last_active":"2024-09-12T17:59:15.635643+0000","last_peered":"2024-09-12T17:59:15.635643+0000","last_clean":"2024-09-12T17:59:15.635643+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T17:59:15.635643+0000","last_undegraded":"2024-09-12T17:59:15.635643+0000","last_fullsized":"2024-09-12T17:59:15.635643+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:42.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'285","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:42.138751+0000","last_change":"2024-09-12T17:21:50.777506+0000","last_active":"2024-09-12T17:58:42.138751+0000","last_peered":"2024-09-12T17:58:42.138751+0000","last_clean":"2024-09-12T17:58:42.138751+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T17:58:42.138751+0000","last_undegraded":"2024-09-12T17:58:42.138751+0000","last_fullsized":"2024-09-12T17:58:42.138751+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.155150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8779971,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":449,"num_read_kb":85437,"num_write":1001,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'462","reported_seq":1955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.357110+0000","last_change":"2024-09-12T17:21:52.747550+0000","last_active":"2024-09-12T17:59:34.357110+0000","last_peered":"2024-09-12T17:59:34.357110+0000","last_clean":"2024-09-12T17:59:34.357110+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T17:59:34.357110+0000","last_undegraded":"2024-09-12T17:59:34.357110+0000","last_fullsized":"2024-09-12T17:59:34.357110+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.595623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'250","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.061929+0000","last_change":"2024-09-12T17:21:50.777489+0000","last_active":"2024-09-12T17:59:19.061929+0000","last_peered":"2024-09-12T17:59:19.061929+0000","last_clean":"2024-09-12T17:59:19.061929+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T17:59:19.061929+0000","last_undegraded":"2024-09-12T17:59:19.061929+0000","last_fullsized":"2024-09-12T17:59:19.061929+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:18.905928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11318756,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":460,"num_read_kb":83513,"num_write":980,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'599","reported_seq":2270,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501171+0000","last_change":"2024-09-12T17:21:52.754098+0000","last_active":"2024-09-12T17:59:18.501171+0000","last_peered":"2024-09-12T17:59:18.501171+0000","last_clean":"2024-09-12T17:59:18.501171+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T17:59:18.501171+0000","last_undegraded":"2024-09-12T17:59:18.501171+0000","last_fullsized":"2024-09-12T17:59:18.501171+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:19.357268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'285","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.389755+0000","last_change":"2024-09-12T17:21:50.769098+0000","last_active":"2024-09-12T17:59:12.389755+0000","last_peered":"2024-09-12T17:59:12.389755+0000","last_clean":"2024-09-12T17:59:12.389755+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T17:59:12.389755+0000","last_undegraded":"2024-09-12T17:59:12.389755+0000","last_fullsized":"2024-09-12T17:59:12.389755+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:09.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18149226,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":519,"num_read_kb":100977,"num_write":1026,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'365","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001710+0000","last_change":"2024-09-12T17:21:52.752509+0000","last_active":"2024-09-12T18:00:55.001710+0000","last_peered":"2024-09-12T18:00:55.001710+0000","last_clean":"2024-09-12T18:00:55.001710+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:00:55.001710+0000","last_undegraded":"2024-09-12T18:00:55.001710+0000","last_fullsized":"2024-09-12T18:00:55.001710+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:29.192100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'298","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.138657+0000","last_change":"2024-09-12T17:21:50.771358+0000","last_active":"2024-09-12T18:01:03.138657+0000","last_peered":"2024-09-12T18:01:03.138657+0000","last_clean":"2024-09-12T18:01:03.138657+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:03.138657+0000","last_undegraded":"2024-09-12T18:01:03.138657+0000","last_fullsized":"2024-09-12T18:01:03.138657+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:36.115502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12863539,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":402,"num_read_kb":5744,"num_write":1115,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'855","reported_seq":2396,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001101+0000","last_change":"2024-09-12T17:21:52.755007+0000","last_active":"2024-09-12T18:00:55.001101+0000","last_peered":"2024-09-12T18:00:55.001101+0000","last_clean":"2024-09-12T18:00:55.001101+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:00:55.001101+0000","last_undegraded":"2024-09-12T18:00:55.001101+0000","last_fullsized":"2024-09-12T18:00:55.001101+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:26.620534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'322","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.909744+0000","last_change":"2024-09-12T17:21:50.766664+0000","last_active":"2024-09-12T17:59:09.909744+0000","last_peered":"2024-09-12T17:59:09.909744+0000","last_clean":"2024-09-12T17:59:09.909744+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T17:59:09.909744+0000","last_undegraded":"2024-09-12T17:59:09.909744+0000","last_fullsized":"2024-09-12T17:59:09.909744+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:36.008036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224892,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":554,"num_read_kb":751,"num_write":1207,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'635","reported_seq":2038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.382860+0000","last_change":"2024-09-12T17:21:52.752393+0000","last_active":"2024-09-12T17:59:16.382860+0000","last_peered":"2024-09-12T17:59:16.382860+0000","last_clean":"2024-09-12T17:59:16.382860+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T17:59:16.382860+0000","last_undegraded":"2024-09-12T17:59:16.382860+0000","last_fullsized":"2024-09-12T17:59:16.382860+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:35.883929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'308","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.133941+0000","last_change":"2024-09-12T17:21:50.769891+0000","last_active":"2024-09-12T18:01:03.133941+0000","last_peered":"2024-09-12T18:01:03.133941+0000","last_clean":"2024-09-12T18:01:03.133941+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:03.133941+0000","last_undegraded":"2024-09-12T18:01:03.133941+0000","last_fullsized":"2024-09-12T18:01:03.133941+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:44.325817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13624130,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":17253,"num_write":1086,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'557","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769742+0000","last_change":"2024-09-12T17:21:52.754609+0000","last_active":"2024-09-12T17:59:34.769742+0000","last_peered":"2024-09-12T17:59:34.769742+0000","last_clean":"2024-09-12T17:59:34.769742+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T17:59:34.769742+0000","last_undegraded":"2024-09-12T17:59:34.769742+0000","last_fullsized":"2024-09-12T17:59:34.769742+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.921162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'302","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:50.946309+0000","last_change":"2024-09-12T17:22:26.299370+0000","last_active":"2024-09-12T18:00:50.946309+0000","last_peered":"2024-09-12T18:00:50.946309+0000","last_clean":"2024-09-12T18:00:50.946309+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:00:50.946309+0000","last_undegraded":"2024-09-12T18:00:50.946309+0000","last_fullsized":"2024-09-12T18:00:50.946309+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.880431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7039374,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":500,"num_read_kb":8559,"num_write":1124,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'553","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999194+0000","last_change":"2024-09-12T17:21:52.749942+0000","last_active":"2024-09-12T18:00:54.999194+0000","last_peered":"2024-09-12T18:00:54.999194+0000","last_clean":"2024-09-12T18:00:54.999194+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:00:54.999194+0000","last_undegraded":"2024-09-12T18:00:54.999194+0000","last_fullsized":"2024-09-12T18:00:54.999194+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:15.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'262","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.429027+0000","last_change":"2024-09-12T17:21:50.758098+0000","last_active":"2024-09-12T17:58:38.429027+0000","last_peered":"2024-09-12T17:58:38.429027+0000","last_clean":"2024-09-12T17:58:38.429027+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T17:58:38.429027+0000","last_undegraded":"2024-09-12T17:58:38.429027+0000","last_fullsized":"2024-09-12T17:58:38.429027+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:44.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6990877,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":437,"num_read_kb":7270,"num_write":920,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'495","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012334+0000","last_change":"2024-09-12T17:21:52.755013+0000","last_active":"2024-09-12T17:59:19.012334+0000","last_peered":"2024-09-12T17:59:19.012334+0000","last_clean":"2024-09-12T17:59:19.012334+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T17:59:19.012334+0000","last_undegraded":"2024-09-12T17:59:19.012334+0000","last_fullsized":"2024-09-12T17:59:19.012334+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:03.543775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'304","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.843716+0000","last_change":"2024-09-12T17:21:50.785028+0000","last_active":"2024-09-12T17:59:18.843716+0000","last_peered":"2024-09-12T17:59:18.843716+0000","last_clean":"2024-09-12T17:59:18.843716+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T17:59:18.843716+0000","last_undegraded":"2024-09-12T17:59:18.843716+0000","last_fullsized":"2024-09-12T17:59:18.843716+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:11.230359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318700,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":520,"num_read_kb":1808,"num_write":1157,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'757","reported_seq":2524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365262+0000","last_change":"2024-09-12T17:21:52.751189+0000","last_active":"2024-09-12T17:59:34.365262+0000","last_peered":"2024-09-12T17:59:34.365262+0000","last_clean":"2024-09-12T17:59:34.365262+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T17:59:34.365262+0000","last_undegraded":"2024-09-12T17:59:34.365262+0000","last_fullsized":"2024-09-12T17:59:34.365262+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:44.765214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'272","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:12.035713+0000","last_change":"2024-09-12T17:21:50.764846+0000","last_active":"2024-09-12T18:00:12.035713+0000","last_peered":"2024-09-12T18:00:12.035713+0000","last_clean":"2024-09-12T18:00:12.035713+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:00:12.035713+0000","last_undegraded":"2024-09-12T18:00:12.035713+0000","last_fullsized":"2024-09-12T18:00:12.035713+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:23.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535045,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":368,"num_read_kb":11532,"num_write":996,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1313","reported_seq":3051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.197533+0000","last_change":"2024-09-12T17:21:52.750173+0000","last_active":"2024-09-12T17:59:17.197533+0000","last_peered":"2024-09-12T17:59:17.197533+0000","last_clean":"2024-09-12T17:59:17.197533+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T17:59:17.197533+0000","last_undegraded":"2024-09-12T17:59:17.197533+0000","last_fullsized":"2024-09-12T17:59:17.197533+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:57.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'358","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.083779+0000","last_change":"2024-09-12T17:21:50.770800+0000","last_active":"2024-09-12T17:59:08.083779+0000","last_peered":"2024-09-12T17:59:08.083779+0000","last_clean":"2024-09-12T17:59:08.083779+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T17:59:08.083779+0000","last_undegraded":"2024-09-12T17:59:08.083779+0000","last_fullsized":"2024-09-12T17:59:08.083779+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:32.517729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5580672,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":760,"num_read_kb":12646,"num_write":1262,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'850","reported_seq":2463,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521273+0000","last_change":"2024-09-12T17:21:52.755424+0000","last_active":"2024-09-12T17:59:17.521273+0000","last_peered":"2024-09-12T17:59:17.521273+0000","last_clean":"2024-09-12T17:59:17.521273+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T17:59:17.521273+0000","last_undegraded":"2024-09-12T17:59:17.521273+0000","last_fullsized":"2024-09-12T17:59:17.521273+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:30.408737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'335","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.097364+0000","last_change":"2024-09-12T17:21:50.770612+0000","last_active":"2024-09-12T17:59:16.097364+0000","last_peered":"2024-09-12T17:59:16.097364+0000","last_clean":"2024-09-12T17:59:16.097364+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T17:59:16.097364+0000","last_undegraded":"2024-09-12T17:59:16.097364+0000","last_fullsized":"2024-09-12T17:59:16.097364+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:10.767250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1283978,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":582,"num_read_kb":21305,"num_write":1223,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'291","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.725936+0000","last_change":"2024-09-12T17:21:50.765427+0000","last_active":"2024-09-12T17:59:12.725936+0000","last_peered":"2024-09-12T17:59:12.725936+0000","last_clean":"2024-09-12T17:59:12.725936+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T17:59:12.725936+0000","last_undegraded":"2024-09-12T17:59:12.725936+0000","last_fullsized":"2024-09-12T17:59:12.725936+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:49.438329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17015302,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":580,"num_read_kb":38619,"num_write":1081,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'583","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.770082+0000","last_change":"2024-09-12T17:21:52.755082+0000","last_active":"2024-09-12T17:59:34.770082+0000","last_peered":"2024-09-12T17:59:34.770082+0000","last_clean":"2024-09-12T17:59:34.770082+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T17:59:34.770082+0000","last_undegraded":"2024-09-12T17:59:34.770082+0000","last_fullsized":"2024-09-12T17:59:34.770082+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:39.922432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'316","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.134077+0000","last_change":"2024-09-12T17:21:50.771898+0000","last_active":"2024-09-12T18:01:03.134077+0000","last_peered":"2024-09-12T18:01:03.134077+0000","last_clean":"2024-09-12T18:01:03.134077+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:03.134077+0000","last_undegraded":"2024-09-12T18:01:03.134077+0000","last_fullsized":"2024-09-12T18:01:03.134077+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.573435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18011618,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":456,"num_read_kb":51643,"num_write":1084,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'402","reported_seq":1963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170642+0000","last_change":"2024-09-12T17:21:52.745958+0000","last_active":"2024-09-12T17:59:16.170642+0000","last_peered":"2024-09-12T17:59:16.170642+0000","last_clean":"2024-09-12T17:59:16.170642+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T17:59:16.170642+0000","last_undegraded":"2024-09-12T17:59:16.170642+0000","last_fullsized":"2024-09-12T17:59:16.170642+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:44.648792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1647,"ondisk_log_size":1647,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":733,"ondisk_log_size":733,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1934577,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16480,"num_read_kb":32225,"num_write":13956,"num_write_kb":11426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3211264,"data_stored":2710927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1993,"ondisk_log_size":1993,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2869,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3984,"ondisk_log_size":3984,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":530444956,"num_objects":4383,"num_object_clones":0,"num_object_copies":17532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4383,"num_whiteouts":0,"num_read":32074,"num_read_kb":1816144,"num_write":68518,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":773279744,"data_stored":773279744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3931,"ondisk_log_size":3931,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59979586,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":134,"num_read_kb":163167,"num_write":157,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122068992,"data_stored":122056324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64173890,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":132,"num_read_kb":167173,"num_write":156,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128360448,"data_stored":128347780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477215,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396852,"kb_used_data":126884,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93974988,"statfs":{"total":96636764160,"available":96230387712,"internally_reserved":0,"allocated":129929216,"data_stored":127890114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509920,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250700,"kb_used_data":147324,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94121140,"statfs":{"total":96636764160,"available":96380047360,"internally_reserved":0,"allocated":150859776,"data_stored":148807094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105839046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509918,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359572,"kb_used_data":125764,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94012268,"statfs":{"total":96636764160,"available":96268562432,"internally_reserved":0,"allocated":128782336,"data_stored":126739892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509919,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":382284,"kb_used_data":148412,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93989556,"statfs":{"total":96636764160,"available":96245305344,"internally_reserved":0,"allocated":151973888,"data_stored":149950624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509921,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272088,"kb_used_data":146504,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94099752,"statfs":{"total":96636764160,"available":96358146048,"internally_reserved":0,"allocated":150020096,"data_stored":148019597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509920,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415468,"kb_used_data":99676,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93956372,"statfs":{"total":96636764160,"available":96211324928,"internally_reserved":0,"allocated":102068224,"data_stored":100031414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":323353029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509919,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237776,"kb_used_data":126080,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94134064,"statfs":{"total":96636764160,"available":96393281536,"internally_reserved":0,"allocated":129105920,"data_stored":127071879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575327,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361332,"kb_used_data":123364,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94010508,"statfs":{"total":96636764160,"available":96266760192,"internally_reserved":0,"allocated":126324736,"data_stored":124309726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114290688,"data_stored":114290688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82055168,"data_stored":82055168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112566272,"data_stored":112566272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":116948992,"data_stored":116948992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":89780224,"data_stored":89780224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":89399296,"data_stored":89399296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":96894976,"data_stored":96894976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71344128,"data_stored":71344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":496950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":480029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":124192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":251717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":381856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":317760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":342581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":315842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1673084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14675968,"data_stored":14675968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16317099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6885376,"data_stored":6884011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18399232,"data_stored":18397867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11591680,"data_stored":11588891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31514624,"data_stored":31511835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27299840,"data_stored":27299025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16781312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23638016,"data_stored":23636651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15953920,"data_stored":15947586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16367616,"data_stored":16363462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23121920,"data_stored":23121105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:06.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:01:06.868 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":265,"fsid":"40c8ab5f-c624-4f6c-a988-0ddc1f0db948","created":"2024-09-12T17:21:19.931623+0000","modified":"2024-09-12T17:49:57.032293+0000","last_up_change":"2024-09-12T17:21:32.756341+0000","last_in_change":"2024-09-12T17:21:22.297484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:21:32.238457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:21:38.380085+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:21:48.894718+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:21:51.113041+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:21:52.904081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:21:54.816664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:21:56.775236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:21:58.862570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:37:07.393703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:38:42.363937+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:38:45.052569+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T17:49:54.813584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf700c49-6315-49f1-a9fc-b0ace076f8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6809","nonce":4011131089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6811","nonce":4011131089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6815","nonce":4011131089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4011131089},{"type":"v1","addr":"172.21.15.63:6813","nonce":4011131089}]},"public_addr":"172.21.15.63:6809/4011131089","cluster_addr":"172.21.15.63:6811/4011131089","heartbeat_back_addr":"172.21.15.63:6815/4011131089","heartbeat_front_addr":"172.21.15.63:6813/4011131089","state":["exists","up"]},{"osd":1,"uuid":"67ee34cb-38d4-4fff-b754-9c1d5d652c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6801","nonce":101797795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6803","nonce":101797795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6807","nonce":101797795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":101797795},{"type":"v1","addr":"172.21.15.63:6805","nonce":101797795}]},"public_addr":"172.21.15.63:6801/101797795","cluster_addr":"172.21.15.63:6803/101797795","heartbeat_back_addr":"172.21.15.63:6807/101797795","heartbeat_front_addr":"172.21.15.63:6805/101797795","state":["exists","up"]},{"osd":2,"uuid":"7b375013-f20c-4bf8-813a-2f71d7167197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6825","nonce":1777922010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6827","nonce":1777922010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6831","nonce":1777922010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1777922010},{"type":"v1","addr":"172.21.15.63:6829","nonce":1777922010}]},"public_addr":"172.21.15.63:6825/1777922010","cluster_addr":"172.21.15.63:6827/1777922010","heartbeat_back_addr":"172.21.15.63:6831/1777922010","heartbeat_front_addr":"172.21.15.63:6829/1777922010","state":["exists","up"]},{"osd":3,"uuid":"180f047c-136f-46ea-bd8a-cf03aaa497d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6817","nonce":1632744678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6819","nonce":1632744678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6823","nonce":1632744678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1632744678},{"type":"v1","addr":"172.21.15.63:6821","nonce":1632744678}]},"public_addr":"172.21.15.63:6817/1632744678","cluster_addr":"172.21.15.63:6819/1632744678","heartbeat_back_addr":"172.21.15.63:6823/1632744678","heartbeat_front_addr":"172.21.15.63:6821/1632744678","state":["exists","up"]},{"osd":4,"uuid":"edb6a0ae-dca0-46ab-adf8-d7ff4d9d8189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6825","nonce":3370836524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6827","nonce":3370836524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6831","nonce":3370836524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3370836524},{"type":"v1","addr":"172.21.15.82:6829","nonce":3370836524}]},"public_addr":"172.21.15.82:6825/3370836524","cluster_addr":"172.21.15.82:6827/3370836524","heartbeat_back_addr":"172.21.15.82:6831/3370836524","heartbeat_front_addr":"172.21.15.82:6829/3370836524","state":["exists","up"]},{"osd":5,"uuid":"08d6d21d-bda6-4f15-a8d1-961c7edef2f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6817","nonce":4151406223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6819","nonce":4151406223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6823","nonce":4151406223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":4151406223},{"type":"v1","addr":"172.21.15.82:6821","nonce":4151406223}]},"public_addr":"172.21.15.82:6817/4151406223","cluster_addr":"172.21.15.82:6819/4151406223","heartbeat_back_addr":"172.21.15.82:6823/4151406223","heartbeat_front_addr":"172.21.15.82:6821/4151406223","state":["exists","up"]},{"osd":6,"uuid":"195868a1-ad74-421f-a581-6f1589108a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6809","nonce":3312995022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6811","nonce":3312995022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6815","nonce":3312995022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3312995022},{"type":"v1","addr":"172.21.15.82:6813","nonce":3312995022}]},"public_addr":"172.21.15.82:6809/3312995022","cluster_addr":"172.21.15.82:6811/3312995022","heartbeat_back_addr":"172.21.15.82:6815/3312995022","heartbeat_front_addr":"172.21.15.82:6813/3312995022","state":["exists","up"]},{"osd":7,"uuid":"489ffcc8-e25e-4999-aa3a-47b0234e22f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6801","nonce":1774933818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6803","nonce":1774933818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6807","nonce":1774933818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1774933818},{"type":"v1","addr":"172.21.15.82:6805","nonce":1774933818}]},"public_addr":"172.21.15.82:6801/1774933818","cluster_addr":"172.21.15.82:6803/1774933818","heartbeat_back_addr":"172.21.15.82:6807/1774933818","heartbeat_front_addr":"172.21.15.82:6805/1774933818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.400650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.190579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.097688+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.360689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.842046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:29.381685+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:28.859696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:21:27.905922+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":2,"to":5}]},{"pgid":"3.15","mappings":[{"from":0,"to":5}]},{"pgid":"3.2a","mappings":[{"from":2,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:07.882 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:01:07.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:08.039 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:08.040 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:08.040 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:08.051 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:01:08.364 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:01:08.377 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:01:08.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:08.518 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:08.519 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:08.519 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:08.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:01:08.842 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:01:08.856 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:01:08.857 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:08.999 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:08.999 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:09.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:01:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:01:09.338 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T18:01:09.338 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:09.479 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:09.480 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:09.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T18:01:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T18:01:09.816 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T18:01:09.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:09.960 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:09.960 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:09.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T18:01:10.285 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T18:01:10.298 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T18:01:10.298 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:10.440 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:10.440 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:10.441 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:10.451 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T18:01:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T18:01:10.778 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T18:01:10.779 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:10.927 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:10.927 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:10.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T18:01:11.253 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T18:01:11.266 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T18:01:11.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:11.410 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T18:01:11.410 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:11.411 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T18:01:11.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T18:01:11.736 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T18:01:11.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:12.087 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:01:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:01:12.101 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1449,"stamp":"2024-09-12T18:01:11.135873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85355269,"num_objects":842,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":842,"num_whiteouts":0,"num_read":290229,"num_read_kb":2399744,"num_write":161152,"num_write_kb":2366967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13345,"ondisk_log_size":13345,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1850496,"kb_used_data":144808,"kb_used_omap":12,"kb_used_meta":1704115,"kb_avail":753124224,"statfs":{"total":773094113280,"available":771199205376,"internally_reserved":0,"allocated":148283392,"data_stored":132295662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1745014320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-576622913,"num_objects":-4151,"num_object_clones":0,"num_object_copies":-16498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4151,"num_whiteouts":0,"num_read":4633,"num_read_kb":4147,"num_write":4398,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006379"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013121+0000","last_change":"2024-09-12T17:49:56.045663+0000","last_active":"2024-09-12T17:57:27.013121+0000","last_peered":"2024-09-12T17:57:27.013121+0000","last_clean":"2024-09-12T17:57:27.013121+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T17:57:27.013121+0000","last_undegraded":"2024-09-12T17:57:27.013121+0000","last_fullsized":"2024-09-12T17:57:27.013121+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:17.001669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.114014+0000","last_change":"2024-09-12T17:38:47.032756+0000","last_active":"2024-09-12T17:56:17.114014+0000","last_peered":"2024-09-12T17:56:17.114014+0000","last_clean":"2024-09-12T17:56:17.114014+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T17:56:17.114014+0000","last_undegraded":"2024-09-12T17:56:17.114014+0000","last_fullsized":"2024-09-12T17:56:17.114014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:43.869294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:15.122813+0000","last_change":"2024-09-12T17:38:43.996174+0000","last_active":"2024-09-12T17:56:15.122813+0000","last_peered":"2024-09-12T17:56:15.122813+0000","last_clean":"2024-09-12T17:56:15.122813+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T17:56:15.122813+0000","last_undegraded":"2024-09-12T17:56:15.122813+0000","last_fullsized":"2024-09-12T17:56:15.122813+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.191809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.019082+0000","last_change":"2024-09-12T17:37:08.657434+0000","last_active":"2024-09-12T17:58:02.019082+0000","last_peered":"2024-09-12T17:58:02.019082+0000","last_clean":"2024-09-12T17:58:02.019082+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T17:58:02.019082+0000","last_undegraded":"2024-09-12T17:58:02.019082+0000","last_fullsized":"2024-09-12T17:58:02.019082+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.018613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128952+0000","last_change":"2024-09-12T17:49:56.047260+0000","last_active":"2024-09-12T17:57:27.128952+0000","last_peered":"2024-09-12T17:57:27.128952+0000","last_clean":"2024-09-12T17:57:27.128952+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T17:57:27.128952+0000","last_undegraded":"2024-09-12T17:57:27.128952+0000","last_fullsized":"2024-09-12T17:57:27.128952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:13.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154633+0000","last_change":"2024-09-12T17:38:47.032526+0000","last_active":"2024-09-12T17:56:17.154633+0000","last_peered":"2024-09-12T17:56:17.154633+0000","last_clean":"2024-09-12T17:56:17.154633+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T17:56:17.154633+0000","last_undegraded":"2024-09-12T17:56:17.154633+0000","last_fullsized":"2024-09-12T17:56:17.154633+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.382669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.670914+0000","last_change":"2024-09-12T17:38:43.991731+0000","last_active":"2024-09-12T18:01:03.670914+0000","last_peered":"2024-09-12T18:01:03.670914+0000","last_clean":"2024-09-12T18:01:03.670914+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T18:01:03.670914+0000","last_undegraded":"2024-09-12T18:01:03.670914+0000","last_fullsized":"2024-09-12T18:01:03.670914+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.972040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4142,"num_write":12,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:19.118189+0000","last_change":"2024-09-12T17:37:08.650147+0000","last_active":"2024-09-12T17:58:19.118189+0000","last_peered":"2024-09-12T17:58:19.118189+0000","last_clean":"2024-09-12T17:58:19.118189+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T17:58:19.118189+0000","last_undegraded":"2024-09-12T17:58:19.118189+0000","last_fullsized":"2024-09-12T17:58:19.118189+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:58.755566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.122054+0000","last_change":"2024-09-12T17:49:56.046643+0000","last_active":"2024-09-12T17:57:12.122054+0000","last_peered":"2024-09-12T17:57:12.122054+0000","last_clean":"2024-09-12T17:57:12.122054+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T17:57:12.122054+0000","last_undegraded":"2024-09-12T17:57:12.122054+0000","last_fullsized":"2024-09-12T17:57:12.122054+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.487756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.146055+0000","last_change":"2024-09-12T17:38:47.027090+0000","last_active":"2024-09-12T17:59:38.146055+0000","last_peered":"2024-09-12T17:59:38.146055+0000","last_clean":"2024-09-12T17:59:38.146055+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T17:59:38.146055+0000","last_undegraded":"2024-09-12T17:59:38.146055+0000","last_fullsized":"2024-09-12T17:59:38.146055+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:21.352493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:45.162497+0000","last_change":"2024-09-12T17:38:43.992601+0000","last_active":"2024-09-12T18:00:45.162497+0000","last_peered":"2024-09-12T18:00:45.162497+0000","last_clean":"2024-09-12T18:00:45.162497+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T18:00:45.162497+0000","last_undegraded":"2024-09-12T18:00:45.162497+0000","last_fullsized":"2024-09-12T18:00:45.162497+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:05.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":243,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.266547+0000","last_change":"2024-09-12T17:37:08.657551+0000","last_active":"2024-09-12T17:59:07.266547+0000","last_peered":"2024-09-12T17:59:07.266547+0000","last_clean":"2024-09-12T17:59:07.266547+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T17:59:07.266547+0000","last_undegraded":"2024-09-12T17:59:07.266547+0000","last_fullsized":"2024-09-12T17:59:07.266547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:01.832274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:18.125196+0000","last_change":"2024-09-12T17:49:56.040426+0000","last_active":"2024-09-12T17:57:18.125196+0000","last_peered":"2024-09-12T17:57:18.125196+0000","last_clean":"2024-09-12T17:57:18.125196+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T17:57:18.125196+0000","last_undegraded":"2024-09-12T17:57:18.125196+0000","last_fullsized":"2024-09-12T17:57:18.125196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:54.760400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:53.157749+0000","last_change":"2024-09-12T17:38:47.027638+0000","last_active":"2024-09-12T18:00:53.157749+0000","last_peered":"2024-09-12T18:00:53.157749+0000","last_clean":"2024-09-12T18:00:53.157749+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T18:00:53.157749+0000","last_undegraded":"2024-09-12T18:00:53.157749+0000","last_fullsized":"2024-09-12T18:00:53.157749+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:43.893874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.223106+0000","last_change":"2024-09-12T17:38:43.990788+0000","last_active":"2024-09-12T18:01:04.223106+0000","last_peered":"2024-09-12T18:01:04.223106+0000","last_clean":"2024-09-12T18:01:04.223106+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T18:01:04.223106+0000","last_undegraded":"2024-09-12T18:01:04.223106+0000","last_fullsized":"2024-09-12T18:01:04.223106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:59.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14340,"num_write":8,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126674+0000","last_change":"2024-09-12T17:37:08.653015+0000","last_active":"2024-09-12T17:57:12.126674+0000","last_peered":"2024-09-12T17:57:12.126674+0000","last_clean":"2024-09-12T17:57:12.126674+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T17:57:12.126674+0000","last_undegraded":"2024-09-12T17:57:12.126674+0000","last_fullsized":"2024-09-12T17:57:12.126674+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:29.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137509+0000","last_change":"2024-09-12T17:49:56.043841+0000","last_active":"2024-09-12T17:57:55.137509+0000","last_peered":"2024-09-12T17:57:55.137509+0000","last_clean":"2024-09-12T17:57:55.137509+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T17:57:55.137509+0000","last_undegraded":"2024-09-12T17:57:55.137509+0000","last_fullsized":"2024-09-12T17:57:55.137509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:54.316816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.019362+0000","last_change":"2024-09-12T17:38:47.020351+0000","last_active":"2024-09-12T17:58:12.019362+0000","last_peered":"2024-09-12T17:58:12.019362+0000","last_clean":"2024-09-12T17:58:12.019362+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T17:58:12.019362+0000","last_undegraded":"2024-09-12T17:58:12.019362+0000","last_fullsized":"2024-09-12T17:58:12.019362+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:50.384206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132353+0000","last_change":"2024-09-12T17:38:43.991420+0000","last_active":"2024-09-12T17:58:03.132353+0000","last_peered":"2024-09-12T17:58:03.132353+0000","last_clean":"2024-09-12T17:58:03.132353+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T17:58:03.132353+0000","last_undegraded":"2024-09-12T17:58:03.132353+0000","last_fullsized":"2024-09-12T17:58:03.132353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126614+0000","last_change":"2024-09-12T17:37:08.656898+0000","last_active":"2024-09-12T17:57:12.126614+0000","last_peered":"2024-09-12T17:57:12.126614+0000","last_clean":"2024-09-12T17:57:12.126614+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T17:57:12.126614+0000","last_undegraded":"2024-09-12T17:57:12.126614+0000","last_fullsized":"2024-09-12T17:57:12.126614+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:09.179411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.022015+0000","last_change":"2024-09-12T17:49:56.038230+0000","last_active":"2024-09-12T17:58:17.022015+0000","last_peered":"2024-09-12T17:58:17.022015+0000","last_clean":"2024-09-12T17:58:17.022015+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T17:58:17.022015+0000","last_undegraded":"2024-09-12T17:58:17.022015+0000","last_fullsized":"2024-09-12T17:58:17.022015+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:01.328505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:32.038446+0000","last_change":"2024-09-12T17:38:47.024390+0000","last_active":"2024-09-12T18:00:32.038446+0000","last_peered":"2024-09-12T18:00:32.038446+0000","last_clean":"2024-09-12T18:00:32.038446+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T18:00:32.038446+0000","last_undegraded":"2024-09-12T18:00:32.038446+0000","last_fullsized":"2024-09-12T18:00:32.038446+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:38.074041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020049+0000","last_change":"2024-09-12T17:38:43.992661+0000","last_active":"2024-09-12T17:58:12.020049+0000","last_peered":"2024-09-12T17:58:12.020049+0000","last_clean":"2024-09-12T17:58:12.020049+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T17:58:12.020049+0000","last_undegraded":"2024-09-12T17:58:12.020049+0000","last_fullsized":"2024-09-12T17:58:12.020049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:23.126019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.118389+0000","last_change":"2024-09-12T17:37:08.657360+0000","last_active":"2024-09-12T17:58:29.118389+0000","last_peered":"2024-09-12T17:58:29.118389+0000","last_clean":"2024-09-12T17:58:29.118389+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T17:58:29.118389+0000","last_undegraded":"2024-09-12T17:58:29.118389+0000","last_fullsized":"2024-09-12T17:58:29.118389+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:37.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164252+0000","last_change":"2024-09-12T17:49:56.045176+0000","last_active":"2024-09-12T17:57:27.164252+0000","last_peered":"2024-09-12T17:57:27.164252+0000","last_clean":"2024-09-12T17:57:27.164252+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T17:57:27.164252+0000","last_undegraded":"2024-09-12T17:57:27.164252+0000","last_fullsized":"2024-09-12T17:57:27.164252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:33.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:17.154608+0000","last_change":"2024-09-12T17:38:47.030932+0000","last_active":"2024-09-12T17:56:17.154608+0000","last_peered":"2024-09-12T17:56:17.154608+0000","last_clean":"2024-09-12T17:56:17.154608+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T17:56:17.154608+0000","last_undegraded":"2024-09-12T17:56:17.154608+0000","last_fullsized":"2024-09-12T17:56:17.154608+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:41.271072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.023976+0000","last_change":"2024-09-12T17:38:43.994843+0000","last_active":"2024-09-12T17:58:47.023976+0000","last_peered":"2024-09-12T17:58:47.023976+0000","last_clean":"2024-09-12T17:58:47.023976+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T17:58:47.023976+0000","last_undegraded":"2024-09-12T17:58:47.023976+0000","last_fullsized":"2024-09-12T17:58:47.023976+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:41.681786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124762+0000","last_change":"2024-09-12T17:37:08.654696+0000","last_active":"2024-09-12T17:56:30.124762+0000","last_peered":"2024-09-12T17:56:30.124762+0000","last_clean":"2024-09-12T17:56:30.124762+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T17:56:30.124762+0000","last_undegraded":"2024-09-12T17:56:30.124762+0000","last_fullsized":"2024-09-12T17:56:30.124762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:03.990843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013188+0000","last_change":"2024-09-12T17:49:56.044511+0000","last_active":"2024-09-12T17:57:27.013188+0000","last_peered":"2024-09-12T17:57:27.013188+0000","last_clean":"2024-09-12T17:57:27.013188+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T17:57:27.013188+0000","last_undegraded":"2024-09-12T17:57:27.013188+0000","last_fullsized":"2024-09-12T17:57:27.013188+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:47.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'10","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.374132+0000","last_change":"2024-09-12T17:38:47.024321+0000","last_active":"2024-09-12T18:01:04.374132+0000","last_peered":"2024-09-12T18:01:04.374132+0000","last_clean":"2024-09-12T18:01:04.374132+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T18:01:04.374132+0000","last_undegraded":"2024-09-12T18:01:04.374132+0000","last_fullsized":"2024-09-12T18:01:04.374132+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:06.138900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13320,"num_write":20,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'10","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.139591+0000","last_change":"2024-09-12T17:38:43.990416+0000","last_active":"2024-09-12T17:58:47.139591+0000","last_peered":"2024-09-12T17:58:47.139591+0000","last_clean":"2024-09-12T17:58:47.139591+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T17:58:47.139591+0000","last_undegraded":"2024-09-12T17:58:47.139591+0000","last_fullsized":"2024-09-12T17:58:47.139591+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.211902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15362,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:40.117649+0000","last_change":"2024-09-12T17:37:08.660746+0000","last_active":"2024-09-12T17:58:40.117649+0000","last_peered":"2024-09-12T17:58:40.117649+0000","last_clean":"2024-09-12T17:58:40.117649+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T17:58:40.117649+0000","last_undegraded":"2024-09-12T17:58:40.117649+0000","last_fullsized":"2024-09-12T17:58:40.117649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:53.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.121922+0000","last_change":"2024-09-12T17:49:56.044578+0000","last_active":"2024-09-12T17:56:58.121922+0000","last_peered":"2024-09-12T17:56:58.121922+0000","last_clean":"2024-09-12T17:56:58.121922+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T17:56:58.121922+0000","last_undegraded":"2024-09-12T17:56:58.121922+0000","last_fullsized":"2024-09-12T17:56:58.121922+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:59.881857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:35.161243+0000","last_change":"2024-09-12T17:38:47.024618+0000","last_active":"2024-09-12T18:00:35.161243+0000","last_peered":"2024-09-12T18:00:35.161243+0000","last_clean":"2024-09-12T18:00:35.161243+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T18:00:35.161243+0000","last_undegraded":"2024-09-12T18:00:35.161243+0000","last_fullsized":"2024-09-12T18:00:35.161243+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:49.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'11","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.522473+0000","last_change":"2024-09-12T17:38:43.991705+0000","last_active":"2024-09-12T18:01:03.522473+0000","last_peered":"2024-09-12T18:01:03.522473+0000","last_clean":"2024-09-12T18:01:03.522473+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T18:01:03.522473+0000","last_undegraded":"2024-09-12T18:01:03.522473+0000","last_fullsized":"2024-09-12T18:01:03.522473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.996078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4710,"num_write":16,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'113","reported_seq":388,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.275995+0000","last_change":"2024-09-12T17:37:08.655763+0000","last_active":"2024-09-12T17:58:17.275995+0000","last_peered":"2024-09-12T17:58:17.275995+0000","last_clean":"2024-09-12T17:58:17.275995+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T17:58:17.275995+0000","last_undegraded":"2024-09-12T17:58:17.275995+0000","last_fullsized":"2024-09-12T17:58:17.275995+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:41.813693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124631+0000","last_change":"2024-09-12T17:49:56.034209+0000","last_active":"2024-09-12T17:56:57.124631+0000","last_peered":"2024-09-12T17:56:57.124631+0000","last_clean":"2024-09-12T17:56:57.124631+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T17:56:57.124631+0000","last_undegraded":"2024-09-12T17:56:57.124631+0000","last_fullsized":"2024-09-12T17:56:57.124631+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:11.559774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127870+0000","last_change":"2024-09-12T17:38:47.024189+0000","last_active":"2024-09-12T17:57:33.127870+0000","last_peered":"2024-09-12T17:57:33.127870+0000","last_clean":"2024-09-12T17:57:33.127870+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T17:57:33.127870+0000","last_undegraded":"2024-09-12T17:57:33.127870+0000","last_fullsized":"2024-09-12T17:57:33.127870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:12.716839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018494+0000","last_change":"2024-09-12T17:38:43.995454+0000","last_active":"2024-09-12T17:58:07.018494+0000","last_peered":"2024-09-12T17:58:07.018494+0000","last_clean":"2024-09-12T17:58:07.018494+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T17:58:07.018494+0000","last_undegraded":"2024-09-12T17:58:07.018494+0000","last_fullsized":"2024-09-12T17:58:07.018494+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.629425+0000","last_change":"2024-09-12T17:37:08.650302+0000","last_active":"2024-09-12T17:58:28.629425+0000","last_peered":"2024-09-12T17:58:28.629425+0000","last_clean":"2024-09-12T17:58:28.629425+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T17:58:28.629425+0000","last_undegraded":"2024-09-12T17:58:28.629425+0000","last_fullsized":"2024-09-12T17:58:28.629425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:26.087974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159949+0000","last_change":"2024-09-12T17:49:56.037995+0000","last_active":"2024-09-12T17:56:57.159949+0000","last_peered":"2024-09-12T17:56:57.159949+0000","last_clean":"2024-09-12T17:56:57.159949+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T17:56:57.159949+0000","last_undegraded":"2024-09-12T17:56:57.159949+0000","last_fullsized":"2024-09-12T17:56:57.159949+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:04.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139871+0000","last_change":"2024-09-12T17:38:47.016476+0000","last_active":"2024-09-12T17:58:10.139871+0000","last_peered":"2024-09-12T17:58:10.139871+0000","last_clean":"2024-09-12T17:58:10.139871+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T17:58:10.139871+0000","last_undegraded":"2024-09-12T17:58:10.139871+0000","last_fullsized":"2024-09-12T17:58:10.139871+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:05.344871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'6","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.671791+0000","last_change":"2024-09-12T17:38:43.996222+0000","last_active":"2024-09-12T18:01:03.671791+0000","last_peered":"2024-09-12T18:01:03.671791+0000","last_clean":"2024-09-12T18:01:03.671791+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T18:01:03.671791+0000","last_undegraded":"2024-09-12T18:01:03.671791+0000","last_fullsized":"2024-09-12T18:01:03.671791+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:17.497778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:30.124845+0000","last_change":"2024-09-12T17:37:08.661473+0000","last_active":"2024-09-12T17:56:30.124845+0000","last_peered":"2024-09-12T17:56:30.124845+0000","last_clean":"2024-09-12T17:56:30.124845+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T17:56:30.124845+0000","last_undegraded":"2024-09-12T17:56:30.124845+0000","last_fullsized":"2024-09-12T17:56:30.124845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:03.318444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.008878+0000","last_change":"2024-09-12T17:49:56.045356+0000","last_active":"2024-09-12T17:56:57.008878+0000","last_peered":"2024-09-12T17:56:57.008878+0000","last_clean":"2024-09-12T17:56:57.008878+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T17:56:57.008878+0000","last_undegraded":"2024-09-12T17:56:57.008878+0000","last_fullsized":"2024-09-12T17:56:57.008878+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:33.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:32.036641+0000","last_change":"2024-09-12T17:38:47.023380+0000","last_active":"2024-09-12T18:00:32.036641+0000","last_peered":"2024-09-12T18:00:32.036641+0000","last_clean":"2024-09-12T18:00:32.036641+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T18:00:32.036641+0000","last_undegraded":"2024-09-12T18:00:32.036641+0000","last_fullsized":"2024-09-12T18:00:32.036641+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.275074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132508+0000","last_change":"2024-09-12T17:38:43.989365+0000","last_active":"2024-09-12T17:58:03.132508+0000","last_peered":"2024-09-12T17:58:03.132508+0000","last_clean":"2024-09-12T17:58:03.132508+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T17:58:03.132508+0000","last_undegraded":"2024-09-12T17:58:03.132508+0000","last_fullsized":"2024-09-12T17:58:03.132508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:53.634008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020922+0000","last_change":"2024-09-12T17:37:08.651846+0000","last_active":"2024-09-12T17:58:17.020922+0000","last_peered":"2024-09-12T17:58:17.020922+0000","last_clean":"2024-09-12T17:58:17.020922+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T17:58:17.020922+0000","last_undegraded":"2024-09-12T17:58:17.020922+0000","last_fullsized":"2024-09-12T17:58:17.020922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:47.950299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:13.124363+0000","last_change":"2024-09-12T17:49:56.042508+0000","last_active":"2024-09-12T17:57:13.124363+0000","last_peered":"2024-09-12T17:57:13.124363+0000","last_clean":"2024-09-12T17:57:13.124363+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T17:57:13.124363+0000","last_undegraded":"2024-09-12T17:57:13.124363+0000","last_fullsized":"2024-09-12T17:57:13.124363+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:56.026526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.127091+0000","last_change":"2024-09-12T17:38:47.028439+0000","last_active":"2024-09-12T17:57:28.127091+0000","last_peered":"2024-09-12T17:57:28.127091+0000","last_clean":"2024-09-12T17:57:28.127091+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T17:57:28.127091+0000","last_undegraded":"2024-09-12T17:57:28.127091+0000","last_fullsized":"2024-09-12T17:57:28.127091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:40.113111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124185+0000","last_change":"2024-09-12T17:38:43.990984+0000","last_active":"2024-09-12T17:57:27.124185+0000","last_peered":"2024-09-12T17:57:27.124185+0000","last_clean":"2024-09-12T17:57:27.124185+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T17:57:27.124185+0000","last_undegraded":"2024-09-12T17:57:27.124185+0000","last_fullsized":"2024-09-12T17:57:27.124185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:55.979807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020118+0000","last_change":"2024-09-12T17:37:08.656056+0000","last_active":"2024-09-12T17:58:12.020118+0000","last_peered":"2024-09-12T17:58:12.020118+0000","last_clean":"2024-09-12T17:58:12.020118+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T17:58:12.020118+0000","last_undegraded":"2024-09-12T17:58:12.020118+0000","last_fullsized":"2024-09-12T17:58:12.020118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:45.733213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126727+0000","last_change":"2024-09-12T17:49:56.042525+0000","last_active":"2024-09-12T17:57:12.126727+0000","last_peered":"2024-09-12T17:57:12.126727+0000","last_clean":"2024-09-12T17:57:12.126727+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T17:57:12.126727+0000","last_undegraded":"2024-09-12T17:57:12.126727+0000","last_fullsized":"2024-09-12T17:57:12.126727+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:07.790123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'11","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.596225+0000","last_change":"2024-09-12T17:38:47.030812+0000","last_active":"2024-09-12T18:01:03.596225+0000","last_peered":"2024-09-12T18:01:03.596225+0000","last_clean":"2024-09-12T18:01:03.596225+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T18:01:03.596225+0000","last_undegraded":"2024-09-12T18:01:03.596225+0000","last_fullsized":"2024-09-12T18:01:03.596225+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:21.678813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10258,"num_write":16,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.126144+0000","last_change":"2024-09-12T17:38:43.987476+0000","last_active":"2024-09-12T17:57:23.126144+0000","last_peered":"2024-09-12T17:57:23.126144+0000","last_clean":"2024-09-12T17:57:23.126144+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T17:57:23.126144+0000","last_undegraded":"2024-09-12T17:57:23.126144+0000","last_fullsized":"2024-09-12T17:57:23.126144+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.672726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139794+0000","last_change":"2024-09-12T17:37:08.661575+0000","last_active":"2024-09-12T17:58:10.139794+0000","last_peered":"2024-09-12T17:58:10.139794+0000","last_clean":"2024-09-12T17:58:10.139794+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T17:58:10.139794+0000","last_undegraded":"2024-09-12T17:58:10.139794+0000","last_fullsized":"2024-09-12T17:58:10.139794+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:44.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009869+0000","last_change":"2024-09-12T17:49:56.037386+0000","last_active":"2024-09-12T17:57:02.009869+0000","last_peered":"2024-09-12T17:57:02.009869+0000","last_clean":"2024-09-12T17:57:02.009869+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T17:57:02.009869+0000","last_undegraded":"2024-09-12T17:57:02.009869+0000","last_fullsized":"2024-09-12T17:57:02.009869+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:00.713527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:30.133900+0000","last_change":"2024-09-12T17:38:47.022479+0000","last_active":"2024-09-12T17:57:30.133900+0000","last_peered":"2024-09-12T17:57:30.133900+0000","last_clean":"2024-09-12T17:57:30.133900+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T17:57:30.133900+0000","last_undegraded":"2024-09-12T17:57:30.133900+0000","last_fullsized":"2024-09-12T17:57:30.133900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:49.306337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:47.141971+0000","last_change":"2024-09-12T17:38:43.988889+0000","last_active":"2024-09-12T17:59:47.141971+0000","last_peered":"2024-09-12T17:59:47.141971+0000","last_clean":"2024-09-12T17:59:47.141971+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T17:59:47.141971+0000","last_undegraded":"2024-09-12T17:59:47.141971+0000","last_fullsized":"2024-09-12T17:59:47.141971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:26.795414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.170376+0000","last_change":"2024-09-12T17:37:08.658663+0000","last_active":"2024-09-12T17:58:12.170376+0000","last_peered":"2024-09-12T17:58:12.170376+0000","last_clean":"2024-09-12T17:58:12.170376+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T17:58:12.170376+0000","last_undegraded":"2024-09-12T17:58:12.170376+0000","last_fullsized":"2024-09-12T17:58:12.170376+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.276415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126695+0000","last_change":"2024-09-12T17:49:56.036857+0000","last_active":"2024-09-12T17:57:12.126695+0000","last_peered":"2024-09-12T17:57:12.126695+0000","last_clean":"2024-09-12T17:57:12.126695+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T17:57:12.126695+0000","last_undegraded":"2024-09-12T17:57:12.126695+0000","last_fullsized":"2024-09-12T17:57:12.126695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:01.304735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'4","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.109684+0000","last_change":"2024-09-12T17:38:47.019373+0000","last_active":"2024-09-12T18:01:03.109684+0000","last_peered":"2024-09-12T18:01:03.109684+0000","last_clean":"2024-09-12T18:01:03.109684+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T18:01:03.109684+0000","last_undegraded":"2024-09-12T18:01:03.109684+0000","last_fullsized":"2024-09-12T18:01:03.109684+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:16.314152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124255+0000","last_change":"2024-09-12T17:38:43.992720+0000","last_active":"2024-09-12T17:57:27.124255+0000","last_peered":"2024-09-12T17:57:27.124255+0000","last_clean":"2024-09-12T17:57:27.124255+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T17:57:27.124255+0000","last_undegraded":"2024-09-12T17:57:27.124255+0000","last_fullsized":"2024-09-12T17:57:27.124255+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:49.377878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.480567+0000","last_change":"2024-09-12T17:37:08.662089+0000","last_active":"2024-09-12T17:58:18.480567+0000","last_peered":"2024-09-12T17:58:18.480567+0000","last_clean":"2024-09-12T17:58:18.480567+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T17:58:18.480567+0000","last_undegraded":"2024-09-12T17:58:18.480567+0000","last_fullsized":"2024-09-12T17:58:18.480567+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:41.016001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.137350+0000","last_change":"2024-09-12T17:49:56.047641+0000","last_active":"2024-09-12T17:58:43.137350+0000","last_peered":"2024-09-12T17:58:43.137350+0000","last_clean":"2024-09-12T17:58:43.137350+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T17:58:43.137350+0000","last_undegraded":"2024-09-12T17:58:43.137350+0000","last_fullsized":"2024-09-12T17:58:43.137350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:16.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127812+0000","last_change":"2024-09-12T17:38:47.029582+0000","last_active":"2024-09-12T17:56:50.127812+0000","last_peered":"2024-09-12T17:56:50.127812+0000","last_clean":"2024-09-12T17:56:50.127812+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T17:56:50.127812+0000","last_undegraded":"2024-09-12T17:56:50.127812+0000","last_fullsized":"2024-09-12T17:56:50.127812+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.565082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.158658+0000","last_change":"2024-09-12T17:38:43.989865+0000","last_active":"2024-09-12T17:56:47.158658+0000","last_peered":"2024-09-12T17:56:47.158658+0000","last_clean":"2024-09-12T17:56:47.158658+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T17:56:47.158658+0000","last_undegraded":"2024-09-12T17:56:47.158658+0000","last_fullsized":"2024-09-12T17:56:47.158658+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:53.024317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133309+0000","last_change":"2024-09-12T17:37:08.662016+0000","last_active":"2024-09-12T17:57:25.133309+0000","last_peered":"2024-09-12T17:57:25.133309+0000","last_clean":"2024-09-12T17:57:25.133309+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T17:57:25.133309+0000","last_undegraded":"2024-09-12T17:57:25.133309+0000","last_fullsized":"2024-09-12T17:57:25.133309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:38.421910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.117628+0000","last_change":"2024-09-12T17:49:56.049044+0000","last_active":"2024-09-12T17:56:42.117628+0000","last_peered":"2024-09-12T17:56:42.117628+0000","last_clean":"2024-09-12T17:56:42.117628+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T17:56:42.117628+0000","last_undegraded":"2024-09-12T17:56:42.117628+0000","last_fullsized":"2024-09-12T17:56:42.117628+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:10.014418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:50.127772+0000","last_change":"2024-09-12T17:38:47.025348+0000","last_active":"2024-09-12T17:56:50.127772+0000","last_peered":"2024-09-12T17:56:50.127772+0000","last_clean":"2024-09-12T17:56:50.127772+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T17:56:50.127772+0000","last_undegraded":"2024-09-12T17:56:50.127772+0000","last_fullsized":"2024-09-12T17:56:50.127772+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:14.763266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.220702+0000","last_change":"2024-09-12T17:38:43.989723+0000","last_active":"2024-09-12T18:01:04.220702+0000","last_peered":"2024-09-12T18:01:04.220702+0000","last_clean":"2024-09-12T18:01:04.220702+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T18:01:04.220702+0000","last_undegraded":"2024-09-12T18:01:04.220702+0000","last_fullsized":"2024-09-12T18:01:04.220702+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:38.471857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013744+0000","last_change":"2024-09-12T17:37:08.648920+0000","last_active":"2024-09-12T17:57:27.013744+0000","last_peered":"2024-09-12T17:57:27.013744+0000","last_clean":"2024-09-12T17:57:27.013744+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T17:57:27.013744+0000","last_undegraded":"2024-09-12T17:57:27.013744+0000","last_fullsized":"2024-09-12T17:57:27.013744+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.023058+0000","last_change":"2024-09-12T17:49:56.036894+0000","last_active":"2024-09-12T17:58:37.023058+0000","last_peered":"2024-09-12T17:58:37.023058+0000","last_clean":"2024-09-12T17:58:37.023058+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T17:58:37.023058+0000","last_undegraded":"2024-09-12T17:58:37.023058+0000","last_fullsized":"2024-09-12T17:58:37.023058+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:30.781444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'10","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.842575+0000","last_change":"2024-09-12T17:38:47.027005+0000","last_active":"2024-09-12T18:01:04.842575+0000","last_peered":"2024-09-12T18:01:04.842575+0000","last_clean":"2024-09-12T18:01:04.842575+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T18:01:04.842575+0000","last_undegraded":"2024-09-12T18:01:04.842575+0000","last_fullsized":"2024-09-12T18:01:04.842575+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:26.959823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15452,"num_write":10,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:00.146435+0000","last_change":"2024-09-12T17:38:43.996009+0000","last_active":"2024-09-12T17:59:00.146435+0000","last_peered":"2024-09-12T17:59:00.146435+0000","last_clean":"2024-09-12T17:59:00.146435+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T17:59:00.146435+0000","last_undegraded":"2024-09-12T17:59:00.146435+0000","last_fullsized":"2024-09-12T17:59:00.146435+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.956208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4108,"num_write":6,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124276+0000","last_change":"2024-09-12T17:37:08.653415+0000","last_active":"2024-09-12T17:57:27.124276+0000","last_peered":"2024-09-12T17:57:27.124276+0000","last_clean":"2024-09-12T17:57:27.124276+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T17:57:27.124276+0000","last_undegraded":"2024-09-12T17:57:27.124276+0000","last_fullsized":"2024-09-12T17:57:27.124276+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:16.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.133197+0000","last_change":"2024-09-12T17:49:56.047746+0000","last_active":"2024-09-12T17:58:37.133197+0000","last_peered":"2024-09-12T17:58:37.133197+0000","last_clean":"2024-09-12T17:58:37.133197+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T17:58:37.133197+0000","last_undegraded":"2024-09-12T17:58:37.133197+0000","last_fullsized":"2024-09-12T17:58:37.133197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:19.785797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'6","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.140853+0000","last_change":"2024-09-12T17:38:47.022037+0000","last_active":"2024-09-12T17:59:03.140853+0000","last_peered":"2024-09-12T17:59:03.140853+0000","last_clean":"2024-09-12T17:59:03.140853+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T17:59:03.140853+0000","last_undegraded":"2024-09-12T17:59:03.140853+0000","last_fullsized":"2024-09-12T17:59:03.140853+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:58.528885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11258,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:45.127205+0000","last_change":"2024-09-12T17:38:43.991999+0000","last_active":"2024-09-12T17:56:45.127205+0000","last_peered":"2024-09-12T17:56:45.127205+0000","last_clean":"2024-09-12T17:56:45.127205+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T17:56:45.127205+0000","last_undegraded":"2024-09-12T17:56:45.127205+0000","last_fullsized":"2024-09-12T17:56:45.127205+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:23.142677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128990+0000","last_change":"2024-09-12T17:37:08.659437+0000","last_active":"2024-09-12T17:57:27.128990+0000","last_peered":"2024-09-12T17:57:27.128990+0000","last_clean":"2024-09-12T17:57:27.128990+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T17:57:27.128990+0000","last_undegraded":"2024-09-12T17:57:27.128990+0000","last_fullsized":"2024-09-12T17:57:27.128990+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:00.942567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:43.119397+0000","last_change":"2024-09-12T17:49:56.045196+0000","last_active":"2024-09-12T17:56:43.119397+0000","last_peered":"2024-09-12T17:56:43.119397+0000","last_clean":"2024-09-12T17:56:43.119397+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T17:56:43.119397+0000","last_undegraded":"2024-09-12T17:56:43.119397+0000","last_fullsized":"2024-09-12T17:56:43.119397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:39.426641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020855+0000","last_change":"2024-09-12T17:38:47.020511+0000","last_active":"2024-09-12T17:58:17.020855+0000","last_peered":"2024-09-12T17:58:17.020855+0000","last_clean":"2024-09-12T17:58:17.020855+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T17:58:17.020855+0000","last_undegraded":"2024-09-12T17:58:17.020855+0000","last_fullsized":"2024-09-12T17:58:17.020855+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.015103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:25.159742+0000","last_change":"2024-09-12T17:38:43.993571+0000","last_active":"2024-09-12T18:00:25.159742+0000","last_peered":"2024-09-12T18:00:25.159742+0000","last_clean":"2024-09-12T18:00:25.159742+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T18:00:25.159742+0000","last_undegraded":"2024-09-12T18:00:25.159742+0000","last_fullsized":"2024-09-12T18:00:25.159742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.884799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128966+0000","last_change":"2024-09-12T17:37:08.656385+0000","last_active":"2024-09-12T17:57:27.128966+0000","last_peered":"2024-09-12T17:57:27.128966+0000","last_clean":"2024-09-12T17:57:27.128966+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T17:57:27.128966+0000","last_undegraded":"2024-09-12T17:57:27.128966+0000","last_fullsized":"2024-09-12T17:57:27.128966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.157975+0000","last_change":"2024-09-12T17:49:56.048011+0000","last_active":"2024-09-12T17:56:42.157975+0000","last_peered":"2024-09-12T17:56:42.157975+0000","last_clean":"2024-09-12T17:56:42.157975+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T17:56:42.157975+0000","last_undegraded":"2024-09-12T17:56:42.157975+0000","last_fullsized":"2024-09-12T17:56:42.157975+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:44.187088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.187297+0000","last_change":"2024-09-12T17:38:47.032812+0000","last_active":"2024-09-12T18:00:27.187297+0000","last_peered":"2024-09-12T18:00:27.187297+0000","last_clean":"2024-09-12T18:00:27.187297+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T18:00:27.187297+0000","last_undegraded":"2024-09-12T18:00:27.187297+0000","last_fullsized":"2024-09-12T18:00:27.187297+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:16.283298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.133853+0000","last_change":"2024-09-12T17:38:43.988490+0000","last_active":"2024-09-12T17:58:13.133853+0000","last_peered":"2024-09-12T17:58:13.133853+0000","last_clean":"2024-09-12T17:58:13.133853+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T17:58:13.133853+0000","last_undegraded":"2024-09-12T17:58:13.133853+0000","last_fullsized":"2024-09-12T17:58:13.133853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.984138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.431022+0000","last_change":"2024-09-12T17:37:08.652495+0000","last_active":"2024-09-12T17:59:07.431022+0000","last_peered":"2024-09-12T17:59:07.431022+0000","last_clean":"2024-09-12T17:59:07.431022+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T17:59:07.431022+0000","last_undegraded":"2024-09-12T17:59:07.431022+0000","last_fullsized":"2024-09-12T17:59:07.431022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:18.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:42.006624+0000","last_change":"2024-09-12T17:49:56.045788+0000","last_active":"2024-09-12T17:56:42.006624+0000","last_peered":"2024-09-12T17:56:42.006624+0000","last_clean":"2024-09-12T17:56:42.006624+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T17:56:42.006624+0000","last_undegraded":"2024-09-12T17:56:42.006624+0000","last_fullsized":"2024-09-12T17:56:42.006624+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:29.577491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:47.123014+0000","last_change":"2024-09-12T17:38:47.030610+0000","last_active":"2024-09-12T17:56:47.123014+0000","last_peered":"2024-09-12T17:56:47.123014+0000","last_clean":"2024-09-12T17:56:47.123014+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T17:56:47.123014+0000","last_undegraded":"2024-09-12T17:56:47.123014+0000","last_fullsized":"2024-09-12T17:56:47.123014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:48.238050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'9","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.538378+0000","last_change":"2024-09-12T17:38:43.992844+0000","last_active":"2024-09-12T18:01:04.538378+0000","last_peered":"2024-09-12T18:01:04.538378+0000","last_clean":"2024-09-12T18:01:04.538378+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T18:01:04.538378+0000","last_undegraded":"2024-09-12T18:01:04.538378+0000","last_fullsized":"2024-09-12T18:01:04.538378+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:06.166487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138340+0000","last_change":"2024-09-12T17:37:08.661047+0000","last_active":"2024-09-12T17:58:48.138340+0000","last_peered":"2024-09-12T17:58:48.138340+0000","last_clean":"2024-09-12T17:58:48.138340+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T17:58:48.138340+0000","last_undegraded":"2024-09-12T17:58:48.138340+0000","last_fullsized":"2024-09-12T17:58:48.138340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:35.362254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:55.145666+0000","last_change":"2024-09-12T17:49:56.045203+0000","last_active":"2024-09-12T17:58:55.145666+0000","last_peered":"2024-09-12T17:58:55.145666+0000","last_clean":"2024-09-12T17:58:55.145666+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T17:58:55.145666+0000","last_undegraded":"2024-09-12T17:58:55.145666+0000","last_fullsized":"2024-09-12T17:58:55.145666+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.690292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.020496+0000","last_change":"2024-09-12T17:38:47.026783+0000","last_active":"2024-09-12T17:58:22.020496+0000","last_peered":"2024-09-12T17:58:22.020496+0000","last_clean":"2024-09-12T17:58:22.020496+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T17:58:22.020496+0000","last_undegraded":"2024-09-12T17:58:22.020496+0000","last_fullsized":"2024-09-12T17:58:22.020496+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:20.362697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.026387+0000","last_change":"2024-09-12T17:38:43.993534+0000","last_active":"2024-09-12T17:59:02.026387+0000","last_peered":"2024-09-12T17:59:02.026387+0000","last_clean":"2024-09-12T17:59:02.026387+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T17:59:02.026387+0000","last_undegraded":"2024-09-12T17:59:02.026387+0000","last_fullsized":"2024-09-12T17:59:02.026387+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:36.199628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.024519+0000","last_change":"2024-09-12T17:37:08.652306+0000","last_active":"2024-09-12T17:58:52.024519+0000","last_peered":"2024-09-12T17:58:52.024519+0000","last_clean":"2024-09-12T17:58:52.024519+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T17:58:52.024519+0000","last_undegraded":"2024-09-12T17:58:52.024519+0000","last_fullsized":"2024-09-12T17:58:52.024519+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.726476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.019998+0000","last_change":"2024-09-12T17:49:56.046641+0000","last_active":"2024-09-12T17:58:17.019998+0000","last_peered":"2024-09-12T17:58:17.019998+0000","last_clean":"2024-09-12T17:58:17.019998+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T17:58:17.019998+0000","last_undegraded":"2024-09-12T17:58:17.019998+0000","last_fullsized":"2024-09-12T17:58:17.019998+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:58.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'8","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:43.146728+0000","last_change":"2024-09-12T17:38:47.030849+0000","last_active":"2024-09-12T17:59:43.146728+0000","last_peered":"2024-09-12T17:59:43.146728+0000","last_clean":"2024-09-12T17:59:43.146728+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T17:59:43.146728+0000","last_undegraded":"2024-09-12T17:59:43.146728+0000","last_fullsized":"2024-09-12T17:59:43.146728+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:33.916148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014388+0000","last_change":"2024-09-12T17:38:43.991595+0000","last_active":"2024-09-12T17:57:32.014388+0000","last_peered":"2024-09-12T17:57:32.014388+0000","last_clean":"2024-09-12T17:57:32.014388+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T17:57:32.014388+0000","last_undegraded":"2024-09-12T17:57:32.014388+0000","last_fullsized":"2024-09-12T17:57:32.014388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.739988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025891+0000","last_change":"2024-09-12T17:37:08.661553+0000","last_active":"2024-09-12T17:58:52.025891+0000","last_peered":"2024-09-12T17:58:52.025891+0000","last_clean":"2024-09-12T17:58:52.025891+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T17:58:52.025891+0000","last_undegraded":"2024-09-12T17:58:52.025891+0000","last_fullsized":"2024-09-12T17:58:52.025891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.649379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020012+0000","last_change":"2024-09-12T17:49:56.041888+0000","last_active":"2024-09-12T17:58:17.020012+0000","last_peered":"2024-09-12T17:58:17.020012+0000","last_clean":"2024-09-12T17:58:17.020012+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T17:58:17.020012+0000","last_undegraded":"2024-09-12T17:58:17.020012+0000","last_fullsized":"2024-09-12T17:58:17.020012+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127910+0000","last_change":"2024-09-12T17:38:47.024913+0000","last_active":"2024-09-12T17:57:33.127910+0000","last_peered":"2024-09-12T17:57:33.127910+0000","last_clean":"2024-09-12T17:57:33.127910+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T17:57:33.127910+0000","last_undegraded":"2024-09-12T17:57:33.127910+0000","last_fullsized":"2024-09-12T17:57:33.127910+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:06.755928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:42.032374+0000","last_change":"2024-09-12T17:38:43.990480+0000","last_active":"2024-09-12T17:59:42.032374+0000","last_peered":"2024-09-12T17:59:42.032374+0000","last_clean":"2024-09-12T17:59:42.032374+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T17:59:42.032374+0000","last_undegraded":"2024-09-12T17:59:42.032374+0000","last_fullsized":"2024-09-12T17:59:42.032374+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:13.712977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025154+0000","last_change":"2024-09-12T17:37:08.649723+0000","last_active":"2024-09-12T17:58:52.025154+0000","last_peered":"2024-09-12T17:58:52.025154+0000","last_clean":"2024-09-12T17:58:52.025154+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T17:58:52.025154+0000","last_undegraded":"2024-09-12T17:58:52.025154+0000","last_fullsized":"2024-09-12T17:58:52.025154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.186149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132327+0000","last_change":"2024-09-12T17:49:56.046876+0000","last_active":"2024-09-12T17:58:03.132327+0000","last_peered":"2024-09-12T17:58:03.132327+0000","last_clean":"2024-09-12T17:58:03.132327+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T17:58:03.132327+0000","last_undegraded":"2024-09-12T17:58:03.132327+0000","last_fullsized":"2024-09-12T17:58:03.132327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:45.910023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.035900+0000","last_change":"2024-09-12T17:38:47.026137+0000","last_active":"2024-09-12T18:00:27.035900+0000","last_peered":"2024-09-12T18:00:27.035900+0000","last_clean":"2024-09-12T18:00:27.035900+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T18:00:27.035900+0000","last_undegraded":"2024-09-12T18:00:27.035900+0000","last_fullsized":"2024-09-12T18:00:27.035900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:14.366739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.171001+0000","last_change":"2024-09-12T17:38:43.992358+0000","last_active":"2024-09-12T17:58:17.171001+0000","last_peered":"2024-09-12T17:58:17.171001+0000","last_clean":"2024-09-12T17:58:17.171001+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T17:58:17.171001+0000","last_undegraded":"2024-09-12T17:58:17.171001+0000","last_fullsized":"2024-09-12T17:58:17.171001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:38.097131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.169817+0000","last_change":"2024-09-12T17:37:08.658795+0000","last_active":"2024-09-12T17:58:07.169817+0000","last_peered":"2024-09-12T17:58:07.169817+0000","last_clean":"2024-09-12T17:58:07.169817+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T17:58:07.169817+0000","last_undegraded":"2024-09-12T17:58:07.169817+0000","last_fullsized":"2024-09-12T17:58:07.169817+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.988783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020817+0000","last_change":"2024-09-12T17:49:56.036001+0000","last_active":"2024-09-12T17:58:17.020817+0000","last_peered":"2024-09-12T17:58:17.020817+0000","last_clean":"2024-09-12T17:58:17.020817+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T17:58:17.020817+0000","last_undegraded":"2024-09-12T17:58:17.020817+0000","last_fullsized":"2024-09-12T17:58:17.020817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:20.176376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.037880+0000","last_change":"2024-09-12T17:38:47.021549+0000","last_active":"2024-09-12T18:00:27.037880+0000","last_peered":"2024-09-12T18:00:27.037880+0000","last_clean":"2024-09-12T18:00:27.037880+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T18:00:27.037880+0000","last_undegraded":"2024-09-12T18:00:27.037880+0000","last_fullsized":"2024-09-12T18:00:27.037880+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:06.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5116,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021033+0000","last_change":"2024-09-12T17:38:43.994549+0000","last_active":"2024-09-12T17:58:17.021033+0000","last_peered":"2024-09-12T17:58:17.021033+0000","last_clean":"2024-09-12T17:58:17.021033+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T17:58:17.021033+0000","last_undegraded":"2024-09-12T17:58:17.021033+0000","last_fullsized":"2024-09-12T17:58:17.021033+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:30.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":171,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.435685+0000","last_change":"2024-09-12T17:37:08.659177+0000","last_active":"2024-09-12T17:59:07.435685+0000","last_peered":"2024-09-12T17:59:07.435685+0000","last_clean":"2024-09-12T17:59:07.435685+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T17:59:07.435685+0000","last_undegraded":"2024-09-12T17:59:07.435685+0000","last_fullsized":"2024-09-12T17:59:07.435685+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:04.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:35.142766+0000","last_change":"2024-09-12T17:49:56.038182+0000","last_active":"2024-09-12T17:58:35.142766+0000","last_peered":"2024-09-12T17:58:35.142766+0000","last_clean":"2024-09-12T17:58:35.142766+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T17:58:35.142766+0000","last_undegraded":"2024-09-12T17:58:35.142766+0000","last_fullsized":"2024-09-12T17:58:35.142766+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:22.086611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014474+0000","last_change":"2024-09-12T17:38:47.026375+0000","last_active":"2024-09-12T17:57:32.014474+0000","last_peered":"2024-09-12T17:57:32.014474+0000","last_clean":"2024-09-12T17:57:32.014474+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T17:57:32.014474+0000","last_undegraded":"2024-09-12T17:57:32.014474+0000","last_fullsized":"2024-09-12T17:57:32.014474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:56.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:52.190495+0000","last_change":"2024-09-12T17:38:43.992950+0000","last_active":"2024-09-12T18:00:52.190495+0000","last_peered":"2024-09-12T18:00:52.190495+0000","last_clean":"2024-09-12T18:00:52.190495+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T18:00:52.190495+0000","last_undegraded":"2024-09-12T18:00:52.190495+0000","last_fullsized":"2024-09-12T18:00:52.190495+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:18.833241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.762077+0000","last_change":"2024-09-12T17:37:08.654619+0000","last_active":"2024-09-12T17:59:07.762077+0000","last_peered":"2024-09-12T17:59:07.762077+0000","last_clean":"2024-09-12T17:59:07.762077+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T17:59:07.762077+0000","last_undegraded":"2024-09-12T17:59:07.762077+0000","last_fullsized":"2024-09-12T17:59:07.762077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:44.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.024006+0000","last_change":"2024-09-12T17:49:56.039258+0000","last_active":"2024-09-12T17:58:37.024006+0000","last_peered":"2024-09-12T17:58:37.024006+0000","last_clean":"2024-09-12T17:58:37.024006+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T17:58:37.024006+0000","last_undegraded":"2024-09-12T17:58:37.024006+0000","last_fullsized":"2024-09-12T17:58:37.024006+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.182004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'7","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.109469+0000","last_change":"2024-09-12T17:38:47.026063+0000","last_active":"2024-09-12T18:01:03.109469+0000","last_peered":"2024-09-12T18:01:03.109469+0000","last_clean":"2024-09-12T18:01:03.109469+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T18:01:03.109469+0000","last_undegraded":"2024-09-12T18:01:03.109469+0000","last_fullsized":"2024-09-12T18:01:03.109469+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.717038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3651,"num_write":12,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014307+0000","last_change":"2024-09-12T17:38:43.988186+0000","last_active":"2024-09-12T17:57:32.014307+0000","last_peered":"2024-09-12T17:57:32.014307+0000","last_clean":"2024-09-12T17:57:32.014307+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T17:57:32.014307+0000","last_undegraded":"2024-09-12T17:57:32.014307+0000","last_fullsized":"2024-09-12T17:57:32.014307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:03.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.018369+0000","last_change":"2024-09-12T17:37:08.647170+0000","last_active":"2024-09-12T17:58:02.018369+0000","last_peered":"2024-09-12T17:58:02.018369+0000","last_clean":"2024-09-12T17:58:02.018369+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T17:58:02.018369+0000","last_undegraded":"2024-09-12T17:58:02.018369+0000","last_fullsized":"2024-09-12T17:58:02.018369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:33.128612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.134437+0000","last_change":"2024-09-12T17:49:56.044807+0000","last_active":"2024-09-12T17:58:18.134437+0000","last_peered":"2024-09-12T17:58:18.134437+0000","last_clean":"2024-09-12T17:58:18.134437+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T17:58:18.134437+0000","last_undegraded":"2024-09-12T17:58:18.134437+0000","last_fullsized":"2024-09-12T17:58:18.134437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:28.012638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164999+0000","last_change":"2024-09-12T17:38:47.035193+0000","last_active":"2024-09-12T17:57:32.164999+0000","last_peered":"2024-09-12T17:57:32.164999+0000","last_clean":"2024-09-12T17:57:32.164999+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T17:57:32.164999+0000","last_undegraded":"2024-09-12T17:57:32.164999+0000","last_fullsized":"2024-09-12T17:57:32.164999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:54.991568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.145996+0000","last_change":"2024-09-12T17:38:43.993095+0000","last_active":"2024-09-12T17:59:37.145996+0000","last_peered":"2024-09-12T17:59:37.145996+0000","last_clean":"2024-09-12T17:59:37.145996+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T17:59:37.145996+0000","last_undegraded":"2024-09-12T17:59:37.145996+0000","last_fullsized":"2024-09-12T17:59:37.145996+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:07.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4118,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.571968+0000","last_change":"2024-09-12T17:37:08.656010+0000","last_active":"2024-09-12T17:59:05.571968+0000","last_peered":"2024-09-12T17:59:05.571968+0000","last_clean":"2024-09-12T17:59:05.571968+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T17:59:05.571968+0000","last_undegraded":"2024-09-12T17:59:05.571968+0000","last_fullsized":"2024-09-12T17:59:05.571968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.346921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021616+0000","last_change":"2024-09-12T17:49:56.043230+0000","last_active":"2024-09-12T17:58:22.021616+0000","last_peered":"2024-09-12T17:58:22.021616+0000","last_clean":"2024-09-12T17:58:22.021616+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T17:58:22.021616+0000","last_undegraded":"2024-09-12T17:58:22.021616+0000","last_fullsized":"2024-09-12T17:58:22.021616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:33.627052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164967+0000","last_change":"2024-09-12T17:38:47.029841+0000","last_active":"2024-09-12T17:57:32.164967+0000","last_peered":"2024-09-12T17:57:32.164967+0000","last_clean":"2024-09-12T17:57:32.164967+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T17:57:32.164967+0000","last_undegraded":"2024-09-12T17:57:32.164967+0000","last_fullsized":"2024-09-12T17:57:32.164967+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:16.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'6","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.140579+0000","last_change":"2024-09-12T17:38:43.992352+0000","last_active":"2024-09-12T17:59:37.140579+0000","last_peered":"2024-09-12T17:59:37.140579+0000","last_clean":"2024-09-12T17:59:37.140579+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T17:59:37.140579+0000","last_undegraded":"2024-09-12T17:59:37.140579+0000","last_fullsized":"2024-09-12T17:59:37.140579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:57.443048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.100022+0000","last_change":"2024-09-12T17:37:08.651452+0000","last_active":"2024-09-12T17:58:28.100022+0000","last_peered":"2024-09-12T17:58:28.100022+0000","last_clean":"2024-09-12T17:58:28.100022+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T17:58:28.100022+0000","last_undegraded":"2024-09-12T17:58:28.100022+0000","last_fullsized":"2024-09-12T17:58:28.100022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:02.681669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'321","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.171519+0000","last_change":"2024-09-12T17:21:50.778519+0000","last_active":"2024-09-12T18:01:05.171519+0000","last_peered":"2024-09-12T18:01:05.171519+0000","last_clean":"2024-09-12T18:01:05.171519+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T18:01:05.171519+0000","last_undegraded":"2024-09-12T18:01:05.171519+0000","last_fullsized":"2024-09-12T18:01:05.171519+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.146345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399146,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":38786,"num_write":1044,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'477","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.761716+0000","last_change":"2024-09-12T17:21:52.747415+0000","last_active":"2024-09-12T17:59:34.761716+0000","last_peered":"2024-09-12T17:59:34.761716+0000","last_clean":"2024-09-12T17:59:34.761716+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T17:59:34.761716+0000","last_undegraded":"2024-09-12T17:59:34.761716+0000","last_fullsized":"2024-09-12T17:59:34.761716+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:53.654833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'373","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.254091+0000","last_change":"2024-09-12T17:21:50.769396+0000","last_active":"2024-09-12T18:01:05.254091+0000","last_peered":"2024-09-12T18:01:05.254091+0000","last_clean":"2024-09-12T18:01:05.254091+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:05.254091+0000","last_undegraded":"2024-09-12T18:01:05.254091+0000","last_fullsized":"2024-09-12T18:01:05.254091+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:43.716922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":37151,"num_write":1322,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'544","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501861+0000","last_change":"2024-09-12T17:21:52.746868+0000","last_active":"2024-09-12T17:59:18.501861+0000","last_peered":"2024-09-12T17:59:18.501861+0000","last_clean":"2024-09-12T17:59:18.501861+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T17:59:18.501861+0000","last_undegraded":"2024-09-12T17:59:18.501861+0000","last_fullsized":"2024-09-12T17:59:18.501861+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:06.625492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'320","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.220711+0000","last_change":"2024-09-12T17:21:50.754884+0000","last_active":"2024-09-12T18:01:05.220711+0000","last_peered":"2024-09-12T18:01:05.220711+0000","last_clean":"2024-09-12T18:01:05.220711+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:05.220711+0000","last_undegraded":"2024-09-12T18:01:05.220711+0000","last_fullsized":"2024-09-12T18:01:05.220711+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:00.548422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288578,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":719,"num_read_kb":16808,"num_write":978,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'613","reported_seq":2373,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760782+0000","last_change":"2024-09-12T17:21:52.743802+0000","last_active":"2024-09-12T17:59:34.760782+0000","last_peered":"2024-09-12T17:59:34.760782+0000","last_clean":"2024-09-12T17:59:34.760782+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T17:59:34.760782+0000","last_undegraded":"2024-09-12T17:59:34.760782+0000","last_fullsized":"2024-09-12T17:59:34.760782+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:44.764410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'428","reported_seq":1101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.317151+0000","last_change":"2024-09-12T17:21:50.773572+0000","last_active":"2024-09-12T18:01:05.317151+0000","last_peered":"2024-09-12T18:01:05.317151+0000","last_clean":"2024-09-12T18:01:05.317151+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T18:01:05.317151+0000","last_undegraded":"2024-09-12T18:01:05.317151+0000","last_fullsized":"2024-09-12T18:01:05.317151+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:19.872303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355300,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":592,"num_read_kb":16041,"num_write":1318,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952830+0000","last_change":"2024-09-12T17:21:52.744313+0000","last_active":"2024-09-12T17:59:16.952830+0000","last_peered":"2024-09-12T17:59:16.952830+0000","last_clean":"2024-09-12T17:59:16.952830+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T17:59:16.952830+0000","last_undegraded":"2024-09-12T17:59:16.952830+0000","last_fullsized":"2024-09-12T17:59:16.952830+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:36.240139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'286","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.312848+0000","last_change":"2024-09-12T17:21:50.775138+0000","last_active":"2024-09-12T18:01:05.312848+0000","last_peered":"2024-09-12T18:01:05.312848+0000","last_clean":"2024-09-12T18:01:05.312848+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T18:01:05.312848+0000","last_undegraded":"2024-09-12T18:01:05.312848+0000","last_fullsized":"2024-09-12T18:01:05.312848+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.644034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":5548,"num_write":891,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'843","reported_seq":2503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170215+0000","last_change":"2024-09-12T17:21:52.756513+0000","last_active":"2024-09-12T17:59:16.170215+0000","last_peered":"2024-09-12T17:59:16.170215+0000","last_clean":"2024-09-12T17:59:16.170215+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T17:59:16.170215+0000","last_undegraded":"2024-09-12T17:59:16.170215+0000","last_fullsized":"2024-09-12T17:59:16.170215+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:27.548029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'324","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.309299+0000","last_change":"2024-09-12T17:21:50.777104+0000","last_active":"2024-09-12T18:01:05.309299+0000","last_peered":"2024-09-12T18:01:05.309299+0000","last_clean":"2024-09-12T18:01:05.309299+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T18:01:05.309299+0000","last_undegraded":"2024-09-12T18:01:05.309299+0000","last_fullsized":"2024-09-12T18:01:05.309299+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:28.170918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":30145,"num_write":1083,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'506","reported_seq":2100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002369+0000","last_change":"2024-09-12T17:21:52.754895+0000","last_active":"2024-09-12T18:00:55.002369+0000","last_peered":"2024-09-12T18:00:55.002369+0000","last_clean":"2024-09-12T18:00:55.002369+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:00:55.002369+0000","last_undegraded":"2024-09-12T18:00:55.002369+0000","last_fullsized":"2024-09-12T18:00:55.002369+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:11.896956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'367","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.247433+0000","last_change":"2024-09-12T17:21:50.774992+0000","last_active":"2024-09-12T18:01:05.247433+0000","last_peered":"2024-09-12T18:01:05.247433+0000","last_clean":"2024-09-12T18:01:05.247433+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T18:01:05.247433+0000","last_undegraded":"2024-09-12T18:01:05.247433+0000","last_fullsized":"2024-09-12T18:01:05.247433+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:13.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036318,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":10450,"num_write":1136,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'744","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390042+0000","last_change":"2024-09-12T17:21:52.749164+0000","last_active":"2024-09-12T17:59:16.390042+0000","last_peered":"2024-09-12T17:59:16.390042+0000","last_clean":"2024-09-12T17:59:16.390042+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T17:59:16.390042+0000","last_undegraded":"2024-09-12T17:59:16.390042+0000","last_fullsized":"2024-09-12T17:59:16.390042+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:52.169981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'413","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.306645+0000","last_change":"2024-09-12T17:21:50.769398+0000","last_active":"2024-09-12T18:01:05.306645+0000","last_peered":"2024-09-12T18:01:05.306645+0000","last_clean":"2024-09-12T18:01:05.306645+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:05.306645+0000","last_undegraded":"2024-09-12T18:01:05.306645+0000","last_fullsized":"2024-09-12T18:01:05.306645+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:23.356425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":69100,"num_write":1161,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1194","reported_seq":2914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.762595+0000","last_change":"2024-09-12T17:21:52.754000+0000","last_active":"2024-09-12T17:59:34.762595+0000","last_peered":"2024-09-12T17:59:34.762595+0000","last_clean":"2024-09-12T17:59:34.762595+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T17:59:34.762595+0000","last_undegraded":"2024-09-12T17:59:34.762595+0000","last_fullsized":"2024-09-12T17:59:34.762595+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.531613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'489","reported_seq":2037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.359232+0000","last_change":"2024-09-12T17:21:52.751378+0000","last_active":"2024-09-12T17:59:34.359232+0000","last_peered":"2024-09-12T17:59:34.359232+0000","last_clean":"2024-09-12T17:59:34.359232+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T17:59:34.359232+0000","last_undegraded":"2024-09-12T17:59:34.359232+0000","last_fullsized":"2024-09-12T17:59:34.359232+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:04.419740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'383","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.207496+0000","last_change":"2024-09-12T17:21:50.764045+0000","last_active":"2024-09-12T18:01:05.207496+0000","last_peered":"2024-09-12T18:01:05.207496+0000","last_clean":"2024-09-12T18:01:05.207496+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:01:05.207496+0000","last_undegraded":"2024-09-12T18:01:05.207496+0000","last_fullsized":"2024-09-12T18:01:05.207496+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:33.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":53764,"num_write":1216,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'445","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.834035+0000","last_change":"2024-09-12T17:21:52.752185+0000","last_active":"2024-09-12T17:59:28.834035+0000","last_peered":"2024-09-12T17:59:28.834035+0000","last_clean":"2024-09-12T17:59:28.834035+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T17:59:28.834035+0000","last_undegraded":"2024-09-12T17:59:28.834035+0000","last_fullsized":"2024-09-12T17:59:28.834035+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:15.912648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'317","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.231696+0000","last_change":"2024-09-12T17:21:50.768025+0000","last_active":"2024-09-12T18:01:05.231696+0000","last_peered":"2024-09-12T18:01:05.231696+0000","last_clean":"2024-09-12T18:01:05.231696+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T18:01:05.231696+0000","last_undegraded":"2024-09-12T18:01:05.231696+0000","last_fullsized":"2024-09-12T18:01:05.231696+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:02.016388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":34593,"num_write":1052,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'465","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170603+0000","last_change":"2024-09-12T17:21:52.755703+0000","last_active":"2024-09-12T17:59:16.170603+0000","last_peered":"2024-09-12T17:59:16.170603+0000","last_clean":"2024-09-12T17:59:16.170603+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T17:59:16.170603+0000","last_undegraded":"2024-09-12T17:59:16.170603+0000","last_fullsized":"2024-09-12T17:59:16.170603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:42.867412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'341","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.276540+0000","last_change":"2024-09-12T17:21:50.770163+0000","last_active":"2024-09-12T18:01:05.276540+0000","last_peered":"2024-09-12T18:01:05.276540+0000","last_clean":"2024-09-12T18:01:05.276540+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T18:01:05.276540+0000","last_undegraded":"2024-09-12T18:01:05.276540+0000","last_fullsized":"2024-09-12T18:01:05.276540+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:41.245093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":875,"num_read_kb":30506,"num_write":1060,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'419","reported_seq":1998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521811+0000","last_change":"2024-09-12T17:21:52.757976+0000","last_active":"2024-09-12T17:59:17.521811+0000","last_peered":"2024-09-12T17:59:17.521811+0000","last_clean":"2024-09-12T17:59:17.521811+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T17:59:17.521811+0000","last_undegraded":"2024-09-12T17:59:17.521811+0000","last_fullsized":"2024-09-12T17:59:17.521811+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:40.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'419","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.258939+0000","last_change":"2024-09-12T17:21:50.770236+0000","last_active":"2024-09-12T18:01:05.258939+0000","last_peered":"2024-09-12T18:01:05.258939+0000","last_clean":"2024-09-12T18:01:05.258939+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T18:01:05.258939+0000","last_undegraded":"2024-09-12T18:01:05.258939+0000","last_fullsized":"2024-09-12T18:01:05.258939+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:22.133455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":18097,"num_write":1302,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1543","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769737+0000","last_change":"2024-09-12T17:21:52.755355+0000","last_active":"2024-09-12T17:59:34.769737+0000","last_peered":"2024-09-12T17:59:34.769737+0000","last_clean":"2024-09-12T17:59:34.769737+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T17:59:34.769737+0000","last_undegraded":"2024-09-12T17:59:34.769737+0000","last_fullsized":"2024-09-12T17:59:34.769737+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.429894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'346","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.306019+0000","last_change":"2024-09-12T17:21:50.767696+0000","last_active":"2024-09-12T18:01:05.306019+0000","last_peered":"2024-09-12T18:01:05.306019+0000","last_clean":"2024-09-12T18:01:05.306019+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T18:01:05.306019+0000","last_undegraded":"2024-09-12T18:01:05.306019+0000","last_fullsized":"2024-09-12T18:01:05.306019+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:07.425923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":18482,"num_write":1050,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'787","reported_seq":2365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365184+0000","last_change":"2024-09-12T17:21:52.754058+0000","last_active":"2024-09-12T17:59:34.365184+0000","last_peered":"2024-09-12T17:59:34.365184+0000","last_clean":"2024-09-12T17:59:34.365184+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T17:59:34.365184+0000","last_undegraded":"2024-09-12T17:59:34.365184+0000","last_fullsized":"2024-09-12T17:59:34.365184+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:35.171675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.310541+0000","last_change":"2024-09-12T17:21:50.754844+0000","last_active":"2024-09-12T18:01:05.310541+0000","last_peered":"2024-09-12T18:01:05.310541+0000","last_clean":"2024-09-12T18:01:05.310541+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T18:01:05.310541+0000","last_undegraded":"2024-09-12T18:01:05.310541+0000","last_fullsized":"2024-09-12T18:01:05.310541+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:01.060374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399140,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":4177,"num_write":987,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'172","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.828620+0000","last_change":"2024-09-12T17:22:00.797198+0000","last_active":"2024-09-12T17:59:34.828620+0000","last_peered":"2024-09-12T17:59:34.828620+0000","last_clean":"2024-09-12T17:59:34.828620+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T17:59:34.828620+0000","last_undegraded":"2024-09-12T17:59:34.828620+0000","last_fullsized":"2024-09-12T17:59:34.828620+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.624828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'441","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769810+0000","last_change":"2024-09-12T17:21:52.752268+0000","last_active":"2024-09-12T17:59:34.769810+0000","last_peered":"2024-09-12T17:59:34.769810+0000","last_clean":"2024-09-12T17:59:34.769810+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T17:59:34.769810+0000","last_undegraded":"2024-09-12T17:59:34.769810+0000","last_fullsized":"2024-09-12T17:59:34.769810+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:22.039178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'409","reported_seq":1217,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.312543+0000","last_change":"2024-09-12T17:22:25.841354+0000","last_active":"2024-09-12T18:01:05.312543+0000","last_peered":"2024-09-12T18:01:05.312543+0000","last_clean":"2024-09-12T18:01:05.312543+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T18:01:05.312543+0000","last_undegraded":"2024-09-12T18:01:05.312543+0000","last_fullsized":"2024-09-12T18:01:05.312543+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:21.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460277,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":57262,"num_write":1362,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020196+0000","last_change":"2024-09-12T17:21:54.756402+0000","last_active":"2024-09-12T17:58:12.020196+0000","last_peered":"2024-09-12T17:58:12.020196+0000","last_clean":"2024-09-12T17:58:12.020196+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T17:58:12.020196+0000","last_undegraded":"2024-09-12T17:58:12.020196+0000","last_fullsized":"2024-09-12T17:58:12.020196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'343","reported_seq":942,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.530981+0000","last_change":"2024-09-12T17:21:56.762895+0000","last_active":"2024-09-12T18:01:04.530981+0000","last_peered":"2024-09-12T18:01:04.530981+0000","last_clean":"2024-09-12T18:01:04.530981+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:01:04.530981+0000","last_undegraded":"2024-09-12T18:01:04.530981+0000","last_fullsized":"2024-09-12T18:01:04.530981+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:42.017239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":1109,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131391+0000","last_change":"2024-09-12T17:21:58.779492+0000","last_active":"2024-09-12T17:58:17.131391+0000","last_peered":"2024-09-12T17:58:17.131391+0000","last_clean":"2024-09-12T17:58:17.131391+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T17:58:17.131391+0000","last_undegraded":"2024-09-12T17:58:17.131391+0000","last_fullsized":"2024-09-12T17:58:17.131391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:41.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2432","reported_seq":4316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.251478+0000","last_change":"2024-09-12T17:22:00.789480+0000","last_active":"2024-09-12T17:59:33.251478+0000","last_peered":"2024-09-12T17:59:33.251478+0000","last_clean":"2024-09-12T17:59:33.251478+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T17:59:33.251478+0000","last_undegraded":"2024-09-12T17:59:33.251478+0000","last_fullsized":"2024-09-12T17:59:33.251478+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.233355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'790","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998878+0000","last_change":"2024-09-12T17:21:52.750476+0000","last_active":"2024-09-12T18:00:54.998878+0000","last_peered":"2024-09-12T18:00:54.998878+0000","last_clean":"2024-09-12T18:00:54.998878+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:00:54.998878+0000","last_undegraded":"2024-09-12T18:00:54.998878+0000","last_fullsized":"2024-09-12T18:00:54.998878+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:08.162006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'312","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.228801+0000","last_change":"2024-09-12T17:21:50.757901+0000","last_active":"2024-09-12T18:01:05.228801+0000","last_peered":"2024-09-12T18:01:05.228801+0000","last_clean":"2024-09-12T18:01:05.228801+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T18:01:05.228801+0000","last_undegraded":"2024-09-12T18:01:05.228801+0000","last_fullsized":"2024-09-12T18:01:05.228801+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.728223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170284,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":362,"num_read_kb":2179,"num_write":871,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010650+0000","last_change":"2024-09-12T17:21:54.752252+0000","last_active":"2024-09-12T17:57:07.010650+0000","last_peered":"2024-09-12T17:57:07.010650+0000","last_clean":"2024-09-12T17:57:07.010650+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T17:57:07.010650+0000","last_undegraded":"2024-09-12T17:57:07.010650+0000","last_fullsized":"2024-09-12T17:57:07.010650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.652789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'92","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.607688+0000","last_change":"2024-09-12T17:21:56.763049+0000","last_active":"2024-09-12T17:59:04.607688+0000","last_peered":"2024-09-12T17:59:04.607688+0000","last_clean":"2024-09-12T17:59:04.607688+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T17:59:04.607688+0000","last_undegraded":"2024-09-12T17:59:04.607688+0000","last_fullsized":"2024-09-12T17:59:04.607688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:05.126795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131351+0000","last_change":"2024-09-12T17:21:58.781052+0000","last_active":"2024-09-12T17:58:17.131351+0000","last_peered":"2024-09-12T17:58:17.131351+0000","last_clean":"2024-09-12T17:58:17.131351+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T17:58:17.131351+0000","last_undegraded":"2024-09-12T17:58:17.131351+0000","last_fullsized":"2024-09-12T17:58:17.131351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:41.465265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.645798+0000","last_change":"2024-09-12T17:22:00.795013+0000","last_active":"2024-09-12T17:59:34.645798+0000","last_peered":"2024-09-12T17:59:34.645798+0000","last_clean":"2024-09-12T17:59:34.645798+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T17:59:34.645798+0000","last_undegraded":"2024-09-12T17:59:34.645798+0000","last_fullsized":"2024-09-12T17:59:34.645798+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:11.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1527","reported_seq":3096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129953+0000","last_change":"2024-09-12T17:21:52.757548+0000","last_active":"2024-09-12T17:59:18.129953+0000","last_peered":"2024-09-12T17:59:18.129953+0000","last_clean":"2024-09-12T17:59:18.129953+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T17:59:18.129953+0000","last_undegraded":"2024-09-12T17:59:18.129953+0000","last_fullsized":"2024-09-12T17:59:18.129953+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:17.307943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'349","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.242082+0000","last_change":"2024-09-12T17:21:50.763989+0000","last_active":"2024-09-12T18:01:05.242082+0000","last_peered":"2024-09-12T18:01:05.242082+0000","last_clean":"2024-09-12T18:01:05.242082+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T18:01:05.242082+0000","last_undegraded":"2024-09-12T18:01:05.242082+0000","last_fullsized":"2024-09-12T18:01:05.242082+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:25.544190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":7819,"num_write":1100,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.021331+0000","last_change":"2024-09-12T17:21:54.750735+0000","last_active":"2024-09-12T17:58:12.021331+0000","last_peered":"2024-09-12T17:58:12.021331+0000","last_clean":"2024-09-12T17:58:12.021331+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T17:58:12.021331+0000","last_undegraded":"2024-09-12T17:58:12.021331+0000","last_fullsized":"2024-09-12T17:58:12.021331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.118206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'103","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.030304+0000","last_change":"2024-09-12T17:21:56.760401+0000","last_active":"2024-09-12T17:59:27.030304+0000","last_peered":"2024-09-12T17:59:27.030304+0000","last_clean":"2024-09-12T17:59:27.030304+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T17:59:27.030304+0000","last_undegraded":"2024-09-12T17:59:27.030304+0000","last_fullsized":"2024-09-12T17:59:27.030304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:57.514040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'788","reported_seq":2213,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.232005+0000","last_change":"2024-09-12T17:21:58.790046+0000","last_active":"2024-09-12T18:01:03.232005+0000","last_peered":"2024-09-12T18:01:03.232005+0000","last_clean":"2024-09-12T18:01:03.232005+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:01:03.232005+0000","last_undegraded":"2024-09-12T18:01:03.232005+0000","last_fullsized":"2024-09-12T18:01:03.232005+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:36.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'222","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.951156+0000","last_change":"2024-09-12T17:22:00.795256+0000","last_active":"2024-09-12T18:00:54.951156+0000","last_peered":"2024-09-12T18:00:54.951156+0000","last_clean":"2024-09-12T18:00:54.951156+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:00:54.951156+0000","last_undegraded":"2024-09-12T18:00:54.951156+0000","last_fullsized":"2024-09-12T18:00:54.951156+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:18.506943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'711","reported_seq":1965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.198269+0000","last_change":"2024-09-12T17:21:52.754960+0000","last_active":"2024-09-12T17:59:17.198269+0000","last_peered":"2024-09-12T17:59:17.198269+0000","last_clean":"2024-09-12T17:59:17.198269+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T17:59:17.198269+0000","last_undegraded":"2024-09-12T17:59:17.198269+0000","last_fullsized":"2024-09-12T17:59:17.198269+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":700,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:04.170159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'416","reported_seq":1133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.271213+0000","last_change":"2024-09-12T17:21:50.763211+0000","last_active":"2024-09-12T18:01:05.271213+0000","last_peered":"2024-09-12T18:01:05.271213+0000","last_clean":"2024-09-12T18:01:05.271213+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T18:01:05.271213+0000","last_undegraded":"2024-09-12T18:01:05.271213+0000","last_fullsized":"2024-09-12T18:01:05.271213+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:09.631310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":18208,"num_write":1467,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020236+0000","last_change":"2024-09-12T17:21:54.755690+0000","last_active":"2024-09-12T17:58:12.020236+0000","last_peered":"2024-09-12T17:58:12.020236+0000","last_clean":"2024-09-12T17:58:12.020236+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T17:58:12.020236+0000","last_undegraded":"2024-09-12T17:58:12.020236+0000","last_fullsized":"2024-09-12T17:58:12.020236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.998087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'278","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.134043+0000","last_change":"2024-09-12T17:21:56.765160+0000","last_active":"2024-09-12T18:01:04.134043+0000","last_peered":"2024-09-12T18:01:04.134043+0000","last_clean":"2024-09-12T18:01:04.134043+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:01:04.134043+0000","last_undegraded":"2024-09-12T18:01:04.134043+0000","last_fullsized":"2024-09-12T18:01:04.134043+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:14.179700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1135,"num_write":384,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'810","reported_seq":2313,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.907282+0000","last_change":"2024-09-12T17:21:58.787567+0000","last_active":"2024-09-12T18:01:02.907282+0000","last_peered":"2024-09-12T18:01:02.907282+0000","last_clean":"2024-09-12T18:01:02.907282+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:02.907282+0000","last_undegraded":"2024-09-12T18:01:02.907282+0000","last_fullsized":"2024-09-12T18:01:02.907282+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:46.462958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'420","reported_seq":1985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008093+0000","last_change":"2024-09-12T17:21:52.748275+0000","last_active":"2024-09-12T18:00:55.008093+0000","last_peered":"2024-09-12T18:00:55.008093+0000","last_clean":"2024-09-12T18:00:55.008093+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:00:55.008093+0000","last_undegraded":"2024-09-12T18:00:55.008093+0000","last_fullsized":"2024-09-12T18:00:55.008093+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:17.610168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'329","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.280330+0000","last_change":"2024-09-12T17:21:50.783712+0000","last_active":"2024-09-12T18:01:05.280330+0000","last_peered":"2024-09-12T18:01:05.280330+0000","last_clean":"2024-09-12T18:01:05.280330+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T18:01:05.280330+0000","last_undegraded":"2024-09-12T18:01:05.280330+0000","last_fullsized":"2024-09-12T18:01:05.280330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.656882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":438,"num_read_kb":9180,"num_write":1028,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'5","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.668299+0000","last_change":"2024-09-12T17:21:54.753421+0000","last_active":"2024-09-12T18:01:02.668299+0000","last_peered":"2024-09-12T18:01:02.668299+0000","last_clean":"2024-09-12T18:01:02.668299+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:01:02.668299+0000","last_undegraded":"2024-09-12T18:01:02.668299+0000","last_fullsized":"2024-09-12T18:01:02.668299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:14.711780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'311","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.836989+0000","last_change":"2024-09-12T17:21:56.772550+0000","last_active":"2024-09-12T18:01:04.836989+0000","last_peered":"2024-09-12T18:01:04.836989+0000","last_clean":"2024-09-12T18:01:04.836989+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T18:01:04.836989+0000","last_undegraded":"2024-09-12T18:01:04.836989+0000","last_fullsized":"2024-09-12T18:01:04.836989+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.672167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42323,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1094,"num_write":406,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133829+0000","last_change":"2024-09-12T17:21:58.785030+0000","last_active":"2024-09-12T17:58:02.133829+0000","last_peered":"2024-09-12T17:58:02.133829+0000","last_clean":"2024-09-12T17:58:02.133829+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T17:58:02.133829+0000","last_undegraded":"2024-09-12T17:58:02.133829+0000","last_fullsized":"2024-09-12T17:58:02.133829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:09.008553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'541","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.118388+0000","last_change":"2024-09-12T17:22:00.792070+0000","last_active":"2024-09-12T18:00:56.118388+0000","last_peered":"2024-09-12T18:00:56.118388+0000","last_clean":"2024-09-12T18:00:56.118388+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:00:56.118388+0000","last_undegraded":"2024-09-12T18:00:56.118388+0000","last_fullsized":"2024-09-12T18:00:56.118388+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:34.644522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'852","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840428+0000","last_change":"2024-09-12T17:21:52.754955+0000","last_active":"2024-09-12T17:59:28.840428+0000","last_peered":"2024-09-12T17:59:28.840428+0000","last_clean":"2024-09-12T17:59:28.840428+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T17:59:28.840428+0000","last_undegraded":"2024-09-12T17:59:28.840428+0000","last_fullsized":"2024-09-12T17:59:28.840428+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:26.586616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'342","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.290619+0000","last_change":"2024-09-12T17:21:50.765891+0000","last_active":"2024-09-12T18:01:05.290619+0000","last_peered":"2024-09-12T18:01:05.290619+0000","last_clean":"2024-09-12T18:01:05.290619+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T18:01:05.290619+0000","last_undegraded":"2024-09-12T18:01:05.290619+0000","last_fullsized":"2024-09-12T18:01:05.290619+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.566299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372398,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":25919,"num_write":1097,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.139539+0000","last_change":"2024-09-12T17:21:54.751975+0000","last_active":"2024-09-12T17:58:47.139539+0000","last_peered":"2024-09-12T17:58:47.139539+0000","last_clean":"2024-09-12T17:58:47.139539+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T17:58:47.139539+0000","last_undegraded":"2024-09-12T17:58:47.139539+0000","last_fullsized":"2024-09-12T17:58:47.139539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:39.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'274","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.381419+0000","last_change":"2024-09-12T17:21:56.763953+0000","last_active":"2024-09-12T18:01:03.381419+0000","last_peered":"2024-09-12T18:01:03.381419+0000","last_clean":"2024-09-12T18:01:03.381419+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:01:03.381419+0000","last_undegraded":"2024-09-12T18:01:03.381419+0000","last_fullsized":"2024-09-12T18:01:03.381419+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:57.115467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1078,"num_write":370,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:52.008193+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:56:52.008193+0000","last_peered":"2024-09-12T17:56:52.008193+0000","last_clean":"2024-09-12T17:56:52.008193+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T17:56:52.008193+0000","last_undegraded":"2024-09-12T17:56:52.008193+0000","last_fullsized":"2024-09-12T17:56:52.008193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'97","reported_seq":580,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.140607+0000","last_change":"2024-09-12T17:22:00.792783+0000","last_active":"2024-09-12T17:59:37.140607+0000","last_peered":"2024-09-12T17:59:37.140607+0000","last_clean":"2024-09-12T17:59:37.140607+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T17:59:37.140607+0000","last_undegraded":"2024-09-12T17:59:37.140607+0000","last_fullsized":"2024-09-12T17:59:37.140607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:57.921660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'380","reported_seq":1851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774821+0000","last_change":"2024-09-12T17:21:52.747363+0000","last_active":"2024-09-12T17:59:18.774821+0000","last_peered":"2024-09-12T17:59:18.774821+0000","last_clean":"2024-09-12T17:59:18.774821+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T17:59:18.774821+0000","last_undegraded":"2024-09-12T17:59:18.774821+0000","last_fullsized":"2024-09-12T17:59:18.774821+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:23.091871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'389","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.275217+0000","last_change":"2024-09-12T17:21:50.762942+0000","last_active":"2024-09-12T18:01:05.275217+0000","last_peered":"2024-09-12T18:01:05.275217+0000","last_clean":"2024-09-12T18:01:05.275217+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T18:01:05.275217+0000","last_undegraded":"2024-09-12T18:01:05.275217+0000","last_fullsized":"2024-09-12T18:01:05.275217+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:36.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":11787,"num_write":1282,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'3","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.669612+0000","last_change":"2024-09-12T17:21:54.749892+0000","last_active":"2024-09-12T18:01:02.669612+0000","last_peered":"2024-09-12T18:01:02.669612+0000","last_clean":"2024-09-12T18:01:02.669612+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:02.669612+0000","last_undegraded":"2024-09-12T18:01:02.669612+0000","last_fullsized":"2024-09-12T18:01:02.669612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:07.627632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'241","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.973028+0000","last_change":"2024-09-12T17:21:56.767379+0000","last_active":"2024-09-12T18:01:04.973028+0000","last_peered":"2024-09-12T18:01:04.973028+0000","last_clean":"2024-09-12T18:01:04.973028+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:01:04.973028+0000","last_undegraded":"2024-09-12T18:01:04.973028+0000","last_fullsized":"2024-09-12T18:01:04.973028+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:36.431381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14789,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":830,"num_write":302,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'809","reported_seq":6238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.908183+0000","last_change":"2024-09-12T17:21:58.786457+0000","last_active":"2024-09-12T18:01:02.908183+0000","last_peered":"2024-09-12T18:01:02.908183+0000","last_clean":"2024-09-12T18:01:02.908183+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:02.908183+0000","last_undegraded":"2024-09-12T18:01:02.908183+0000","last_fullsized":"2024-09-12T18:01:02.908183+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:35.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'97","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.003698+0000","last_change":"2024-09-12T17:22:00.795600+0000","last_active":"2024-09-12T18:00:55.003698+0000","last_peered":"2024-09-12T18:00:55.003698+0000","last_clean":"2024-09-12T18:00:55.003698+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:00:55.003698+0000","last_undegraded":"2024-09-12T18:00:55.003698+0000","last_fullsized":"2024-09-12T18:00:55.003698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:12.865071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'886","reported_seq":2499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012883+0000","last_change":"2024-09-12T17:21:52.754090+0000","last_active":"2024-09-12T17:59:19.012883+0000","last_peered":"2024-09-12T17:59:19.012883+0000","last_clean":"2024-09-12T17:59:19.012883+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T17:59:19.012883+0000","last_undegraded":"2024-09-12T17:59:19.012883+0000","last_fullsized":"2024-09-12T17:59:19.012883+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:08.146246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'333","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.289367+0000","last_change":"2024-09-12T17:21:50.781428+0000","last_active":"2024-09-12T18:01:05.289367+0000","last_peered":"2024-09-12T18:01:05.289367+0000","last_clean":"2024-09-12T18:01:05.289367+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T18:01:05.289367+0000","last_undegraded":"2024-09-12T18:01:05.289367+0000","last_fullsized":"2024-09-12T18:01:05.289367+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:03.976696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":4507,"num_write":1037,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.140189+0000","last_change":"2024-09-12T17:21:54.756631+0000","last_active":"2024-09-12T17:58:52.140189+0000","last_peered":"2024-09-12T17:58:52.140189+0000","last_clean":"2024-09-12T17:58:52.140189+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T17:58:52.140189+0000","last_undegraded":"2024-09-12T17:58:52.140189+0000","last_fullsized":"2024-09-12T17:58:52.140189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:30.950089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'459","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.117105+0000","last_change":"2024-09-12T17:21:56.761927+0000","last_active":"2024-09-12T18:01:05.117105+0000","last_peered":"2024-09-12T18:01:05.117105+0000","last_clean":"2024-09-12T18:01:05.117105+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:01:05.117105+0000","last_undegraded":"2024-09-12T18:01:05.117105+0000","last_fullsized":"2024-09-12T18:01:05.117105+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:22.363422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91621,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":2003,"num_write":680,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138304+0000","last_change":"2024-09-12T17:21:58.789916+0000","last_active":"2024-09-12T17:58:48.138304+0000","last_peered":"2024-09-12T17:58:48.138304+0000","last_clean":"2024-09-12T17:58:48.138304+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T17:58:48.138304+0000","last_undegraded":"2024-09-12T17:58:48.138304+0000","last_fullsized":"2024-09-12T17:58:48.138304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'118","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.360795+0000","last_change":"2024-09-12T17:22:00.797337+0000","last_active":"2024-09-12T17:59:34.360795+0000","last_peered":"2024-09-12T17:59:34.360795+0000","last_clean":"2024-09-12T17:59:34.360795+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T17:59:34.360795+0000","last_undegraded":"2024-09-12T17:59:34.360795+0000","last_fullsized":"2024-09-12T17:59:34.360795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.474417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1094","reported_seq":2455,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.391930+0000","last_change":"2024-09-12T17:21:52.752079+0000","last_active":"2024-09-12T17:59:15.391930+0000","last_peered":"2024-09-12T17:59:15.391930+0000","last_clean":"2024-09-12T17:59:15.391930+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T17:59:15.391930+0000","last_undegraded":"2024-09-12T17:59:15.391930+0000","last_fullsized":"2024-09-12T17:59:15.391930+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1000,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.260009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'388","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.242333+0000","last_change":"2024-09-12T17:21:50.771854+0000","last_active":"2024-09-12T18:01:05.242333+0000","last_peered":"2024-09-12T18:01:05.242333+0000","last_clean":"2024-09-12T18:01:05.242333+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T18:01:05.242333+0000","last_undegraded":"2024-09-12T18:01:05.242333+0000","last_fullsized":"2024-09-12T18:01:05.242333+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:43.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":4065,"num_write":1151,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137482+0000","last_change":"2024-09-12T17:21:54.754091+0000","last_active":"2024-09-12T17:57:55.137482+0000","last_peered":"2024-09-12T17:57:55.137482+0000","last_clean":"2024-09-12T17:57:55.137482+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T17:57:55.137482+0000","last_undegraded":"2024-09-12T17:57:55.137482+0000","last_fullsized":"2024-09-12T17:57:55.137482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:01.903869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'276","reported_seq":843,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.664588+0000","last_change":"2024-09-12T17:21:56.766601+0000","last_active":"2024-09-12T18:01:03.664588+0000","last_peered":"2024-09-12T18:01:03.664588+0000","last_clean":"2024-09-12T18:01:03.664588+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:01:03.664588+0000","last_undegraded":"2024-09-12T18:01:03.664588+0000","last_fullsized":"2024-09-12T18:01:03.664588+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:02.002328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46038,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":1069,"num_write":430,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138983+0000","last_change":"2024-09-12T17:21:58.780947+0000","last_active":"2024-09-12T17:58:05.138983+0000","last_peered":"2024-09-12T17:58:05.138983+0000","last_clean":"2024-09-12T17:58:05.138983+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T17:58:05.138983+0000","last_undegraded":"2024-09-12T17:58:05.138983+0000","last_fullsized":"2024-09-12T17:58:05.138983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.674014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'125","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:45.147948+0000","last_change":"2024-09-12T17:22:00.794120+0000","last_active":"2024-09-12T18:00:45.147948+0000","last_peered":"2024-09-12T18:00:45.147948+0000","last_clean":"2024-09-12T18:00:45.147948+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:00:45.147948+0000","last_undegraded":"2024-09-12T18:00:45.147948+0000","last_fullsized":"2024-09-12T18:00:45.147948+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.905380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'852","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.130052+0000","last_change":"2024-09-12T17:21:52.744001+0000","last_active":"2024-09-12T17:59:18.130052+0000","last_peered":"2024-09-12T17:59:18.130052+0000","last_clean":"2024-09-12T17:59:18.130052+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T17:59:18.130052+0000","last_undegraded":"2024-09-12T17:59:18.130052+0000","last_fullsized":"2024-09-12T17:59:18.130052+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.116207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'294","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.254215+0000","last_change":"2024-09-12T17:21:50.763216+0000","last_active":"2024-09-12T18:01:05.254215+0000","last_peered":"2024-09-12T18:01:05.254215+0000","last_clean":"2024-09-12T18:01:05.254215+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T18:01:05.254215+0000","last_undegraded":"2024-09-12T18:01:05.254215+0000","last_fullsized":"2024-09-12T18:01:05.254215+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:33.880090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":437,"num_read_kb":12213,"num_write":961,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.131531+0000","last_change":"2024-09-12T17:21:54.753927+0000","last_active":"2024-09-12T17:57:58.131531+0000","last_peered":"2024-09-12T17:57:58.131531+0000","last_clean":"2024-09-12T17:57:58.131531+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T17:57:58.131531+0000","last_undegraded":"2024-09-12T17:57:58.131531+0000","last_fullsized":"2024-09-12T17:57:58.131531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:03.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'275","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.166129+0000","last_change":"2024-09-12T17:21:56.769847+0000","last_active":"2024-09-12T18:01:03.166129+0000","last_peered":"2024-09-12T18:01:03.166129+0000","last_clean":"2024-09-12T18:01:03.166129+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:03.166129+0000","last_undegraded":"2024-09-12T18:01:03.166129+0000","last_fullsized":"2024-09-12T18:01:03.166129+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:50.849719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":997,"num_write":362,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'771","reported_seq":2285,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.001050+0000","last_change":"2024-09-12T17:21:58.787962+0000","last_active":"2024-09-12T18:01:04.001050+0000","last_peered":"2024-09-12T18:01:04.001050+0000","last_clean":"2024-09-12T18:01:04.001050+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:01:04.001050+0000","last_undegraded":"2024-09-12T18:01:04.001050+0000","last_fullsized":"2024-09-12T18:01:04.001050+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.107541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'91","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.238731+0000","last_change":"2024-09-12T17:22:00.788149+0000","last_active":"2024-09-12T17:59:08.238731+0000","last_peered":"2024-09-12T17:59:08.238731+0000","last_clean":"2024-09-12T17:59:08.238731+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T17:59:08.238731+0000","last_undegraded":"2024-09-12T17:59:08.238731+0000","last_fullsized":"2024-09-12T17:59:08.238731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:52.865371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'393","reported_seq":1796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618253+0000","last_change":"2024-09-12T17:21:52.746636+0000","last_active":"2024-09-12T17:59:16.618253+0000","last_peered":"2024-09-12T17:59:16.618253+0000","last_clean":"2024-09-12T17:59:16.618253+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T17:59:16.618253+0000","last_undegraded":"2024-09-12T17:59:16.618253+0000","last_fullsized":"2024-09-12T17:59:16.618253+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:16.893041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.311871+0000","last_change":"2024-09-12T17:21:50.764044+0000","last_active":"2024-09-12T18:01:05.311871+0000","last_peered":"2024-09-12T18:01:05.311871+0000","last_clean":"2024-09-12T18:01:05.311871+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T18:01:05.311871+0000","last_undegraded":"2024-09-12T18:01:05.311871+0000","last_fullsized":"2024-09-12T18:01:05.311871+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:30.691491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":2738,"num_write":1044,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1451,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.680888+0000","last_change":"2024-09-12T17:21:54.752963+0000","last_active":"2024-09-12T18:01:02.680888+0000","last_peered":"2024-09-12T18:01:02.680888+0000","last_clean":"2024-09-12T18:01:02.680888+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:01:02.680888+0000","last_undegraded":"2024-09-12T18:01:02.680888+0000","last_fullsized":"2024-09-12T18:01:02.680888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:56.647371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'76","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.935202+0000","last_change":"2024-09-12T17:21:56.766705+0000","last_active":"2024-09-12T17:59:07.935202+0000","last_peered":"2024-09-12T17:59:07.935202+0000","last_clean":"2024-09-12T17:59:07.935202+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T17:59:07.935202+0000","last_undegraded":"2024-09-12T17:59:07.935202+0000","last_fullsized":"2024-09-12T17:59:07.935202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.416717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.435319+0000","last_change":"2024-09-12T17:21:58.775054+0000","last_active":"2024-09-12T18:01:03.435319+0000","last_peered":"2024-09-12T18:01:03.435319+0000","last_clean":"2024-09-12T18:01:03.435319+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:01:03.435319+0000","last_undegraded":"2024-09-12T18:01:03.435319+0000","last_fullsized":"2024-09-12T18:01:03.435319+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:40.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'123","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.753528+0000","last_change":"2024-09-12T17:22:00.796406+0000","last_active":"2024-09-12T17:59:06.753528+0000","last_peered":"2024-09-12T17:59:06.753528+0000","last_clean":"2024-09-12T17:59:06.753528+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T17:59:06.753528+0000","last_undegraded":"2024-09-12T17:59:06.753528+0000","last_fullsized":"2024-09-12T17:59:06.753528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:55.110524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'767","reported_seq":2391,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501638+0000","last_change":"2024-09-12T17:21:52.753271+0000","last_active":"2024-09-12T17:59:18.501638+0000","last_peered":"2024-09-12T17:59:18.501638+0000","last_clean":"2024-09-12T17:59:18.501638+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T17:59:18.501638+0000","last_undegraded":"2024-09-12T17:59:18.501638+0000","last_fullsized":"2024-09-12T17:59:18.501638+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:40.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.234320+0000","last_change":"2024-09-12T17:21:50.759354+0000","last_active":"2024-09-12T18:01:05.234320+0000","last_peered":"2024-09-12T18:01:05.234320+0000","last_clean":"2024-09-12T18:01:05.234320+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T18:01:05.234320+0000","last_undegraded":"2024-09-12T18:01:05.234320+0000","last_fullsized":"2024-09-12T18:01:05.234320+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:28.652326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":10060,"num_write":877,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:57.017784+0000","last_change":"2024-09-12T17:21:54.755944+0000","last_active":"2024-09-12T17:57:57.017784+0000","last_peered":"2024-09-12T17:57:57.017784+0000","last_clean":"2024-09-12T17:57:57.017784+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T17:57:57.017784+0000","last_undegraded":"2024-09-12T17:57:57.017784+0000","last_fullsized":"2024-09-12T17:57:57.017784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:30.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'319","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.598430+0000","last_change":"2024-09-12T17:21:56.769845+0000","last_active":"2024-09-12T18:01:04.598430+0000","last_peered":"2024-09-12T18:01:04.598430+0000","last_clean":"2024-09-12T18:01:04.598430+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:01:04.598430+0000","last_undegraded":"2024-09-12T18:01:04.598430+0000","last_fullsized":"2024-09-12T18:01:04.598430+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.744587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46691,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1100,"num_read_kb":1651,"num_write":1580,"num_write_kb":1458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.169136+0000","last_change":"2024-09-12T17:21:58.783566+0000","last_active":"2024-09-12T17:58:02.169136+0000","last_peered":"2024-09-12T17:58:02.169136+0000","last_clean":"2024-09-12T17:58:02.169136+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T17:58:02.169136+0000","last_undegraded":"2024-09-12T17:58:02.169136+0000","last_fullsized":"2024-09-12T17:58:02.169136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:16.155795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'100","reported_seq":584,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.982177+0000","last_change":"2024-09-12T17:22:00.795820+0000","last_active":"2024-09-12T17:59:06.982177+0000","last_peered":"2024-09-12T17:59:06.982177+0000","last_clean":"2024-09-12T17:59:06.982177+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T17:59:06.982177+0000","last_undegraded":"2024-09-12T17:59:06.982177+0000","last_fullsized":"2024-09-12T17:59:06.982177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:47.982837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'458","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.171017+0000","last_change":"2024-09-12T17:21:52.747649+0000","last_active":"2024-09-12T17:59:16.171017+0000","last_peered":"2024-09-12T17:59:16.171017+0000","last_clean":"2024-09-12T17:59:16.171017+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T17:59:16.171017+0000","last_undegraded":"2024-09-12T17:59:16.171017+0000","last_fullsized":"2024-09-12T17:59:16.171017+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:32.995329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:42.126398+0000","last_change":"2024-09-12T17:21:34.165528+0000","last_active":"2024-09-12T17:57:42.126398+0000","last_peered":"2024-09-12T17:57:42.126398+0000","last_clean":"2024-09-12T17:57:42.126398+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T17:57:42.126398+0000","last_undegraded":"2024-09-12T17:57:42.126398+0000","last_fullsized":"2024-09-12T17:57:42.126398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:32.756341+0000","last_clean_scrub_stamp":"2024-09-12T17:21:32.756341+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:27.504316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010866+0000","last_change":"2024-09-12T17:21:41.866930+0000","last_active":"2024-09-12T17:57:07.010866+0000","last_peered":"2024-09-12T17:57:07.010866+0000","last_clean":"2024-09-12T17:57:07.010866+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T17:57:07.010866+0000","last_undegraded":"2024-09-12T17:57:07.010866+0000","last_fullsized":"2024-09-12T17:57:07.010866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:40.562409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'352","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.280392+0000","last_change":"2024-09-12T17:21:50.760757+0000","last_active":"2024-09-12T18:01:05.280392+0000","last_peered":"2024-09-12T18:01:05.280392+0000","last_clean":"2024-09-12T18:01:05.280392+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T18:01:05.280392+0000","last_undegraded":"2024-09-12T18:01:05.280392+0000","last_fullsized":"2024-09-12T18:01:05.280392+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:52.679675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2336230,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":631,"num_read_kb":42380,"num_write":1169,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012494+0000","last_change":"2024-09-12T17:21:54.750180+0000","last_active":"2024-09-12T17:57:22.012494+0000","last_peered":"2024-09-12T17:57:22.012494+0000","last_clean":"2024-09-12T17:57:22.012494+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T17:57:22.012494+0000","last_undegraded":"2024-09-12T17:57:22.012494+0000","last_fullsized":"2024-09-12T17:57:22.012494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:24.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'737","reported_seq":1436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.743655+0000","last_change":"2024-09-12T17:21:56.765494+0000","last_active":"2024-09-12T18:01:04.743655+0000","last_peered":"2024-09-12T18:01:04.743655+0000","last_clean":"2024-09-12T18:01:04.743655+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:01:04.743655+0000","last_undegraded":"2024-09-12T18:01:04.743655+0000","last_fullsized":"2024-09-12T18:01:04.743655+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:08.857619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169172,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1452,"num_read_kb":3379,"num_write":1380,"num_write_kb":1257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138445+0000","last_change":"2024-09-12T17:21:58.788291+0000","last_active":"2024-09-12T17:58:48.138445+0000","last_peered":"2024-09-12T17:58:48.138445+0000","last_clean":"2024-09-12T17:58:48.138445+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T17:58:48.138445+0000","last_undegraded":"2024-09-12T17:58:48.138445+0000","last_fullsized":"2024-09-12T17:58:48.138445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:07.437948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'195","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.775559+0000","last_change":"2024-09-12T17:22:00.796574+0000","last_active":"2024-09-12T17:59:34.775559+0000","last_peered":"2024-09-12T17:59:34.775559+0000","last_clean":"2024-09-12T17:59:34.775559+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T17:59:34.775559+0000","last_undegraded":"2024-09-12T17:59:34.775559+0000","last_fullsized":"2024-09-12T17:59:34.775559+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.468190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'468","reported_seq":1992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774603+0000","last_change":"2024-09-12T17:21:52.757096+0000","last_active":"2024-09-12T17:59:18.774603+0000","last_peered":"2024-09-12T17:59:18.774603+0000","last_clean":"2024-09-12T17:59:18.774603+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T17:59:18.774603+0000","last_undegraded":"2024-09-12T17:59:18.774603+0000","last_fullsized":"2024-09-12T17:59:18.774603+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.000502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:47.016306+0000","last_change":"2024-09-12T17:21:41.866473+0000","last_active":"2024-09-12T17:57:47.016306+0000","last_peered":"2024-09-12T17:57:47.016306+0000","last_clean":"2024-09-12T17:57:47.016306+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T17:57:47.016306+0000","last_undegraded":"2024-09-12T17:57:47.016306+0000","last_fullsized":"2024-09-12T17:57:47.016306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:12.213846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'393","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.317147+0000","last_change":"2024-09-12T17:21:50.757872+0000","last_active":"2024-09-12T18:01:05.317147+0000","last_peered":"2024-09-12T18:01:05.317147+0000","last_clean":"2024-09-12T18:01:05.317147+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T18:01:05.317147+0000","last_undegraded":"2024-09-12T18:01:05.317147+0000","last_fullsized":"2024-09-12T18:01:05.317147+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:09.535999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":13401,"num_write":1361,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.024531+0000","last_change":"2024-09-12T17:21:54.755790+0000","last_active":"2024-09-12T17:58:47.024531+0000","last_peered":"2024-09-12T17:58:47.024531+0000","last_clean":"2024-09-12T17:58:47.024531+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T17:58:47.024531+0000","last_undegraded":"2024-09-12T17:58:47.024531+0000","last_fullsized":"2024-09-12T17:58:47.024531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:59.470297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1249","reported_seq":2646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.669780+0000","last_change":"2024-09-12T17:21:56.768252+0000","last_active":"2024-09-12T18:01:04.669780+0000","last_peered":"2024-09-12T18:01:04.669780+0000","last_clean":"2024-09-12T18:01:04.669780+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:01:04.669780+0000","last_undegraded":"2024-09-12T18:01:04.669780+0000","last_fullsized":"2024-09-12T18:01:04.669780+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:01.013352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161465,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1982,"num_read_kb":3789,"num_write":1078,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014403+0000","last_change":"2024-09-12T17:21:58.790253+0000","last_active":"2024-09-12T17:57:32.014403+0000","last_peered":"2024-09-12T17:57:32.014403+0000","last_clean":"2024-09-12T17:57:32.014403+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T17:57:32.014403+0000","last_undegraded":"2024-09-12T17:57:32.014403+0000","last_fullsized":"2024-09-12T17:57:32.014403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:47.790212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'133","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.894435+0000","last_change":"2024-09-12T17:22:00.798051+0000","last_active":"2024-09-12T17:59:12.894435+0000","last_peered":"2024-09-12T17:59:12.894435+0000","last_clean":"2024-09-12T17:59:12.894435+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T17:59:12.894435+0000","last_undegraded":"2024-09-12T17:59:12.894435+0000","last_fullsized":"2024-09-12T17:59:12.894435+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:21.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'449","reported_seq":1957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365791+0000","last_change":"2024-09-12T17:21:52.754734+0000","last_active":"2024-09-12T17:59:34.365791+0000","last_peered":"2024-09-12T17:59:34.365791+0000","last_clean":"2024-09-12T17:59:34.365791+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T17:59:34.365791+0000","last_undegraded":"2024-09-12T17:59:34.365791+0000","last_fullsized":"2024-09-12T17:59:34.365791+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:38.929430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:05.130098+0000","last_change":"2024-09-12T17:21:42.043085+0000","last_active":"2024-09-12T17:57:05.130098+0000","last_peered":"2024-09-12T17:57:05.130098+0000","last_clean":"2024-09-12T17:57:05.130098+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T17:57:05.130098+0000","last_undegraded":"2024-09-12T17:57:05.130098+0000","last_fullsized":"2024-09-12T17:57:05.130098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:25.499579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'374","reported_seq":1088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.161074+0000","last_change":"2024-09-12T17:21:50.744141+0000","last_active":"2024-09-12T18:01:05.161074+0000","last_peered":"2024-09-12T18:01:05.161074+0000","last_clean":"2024-09-12T18:01:05.161074+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:05.161074+0000","last_undegraded":"2024-09-12T18:01:05.161074+0000","last_fullsized":"2024-09-12T18:01:05.161074+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:16.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730187,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":557,"num_read_kb":34998,"num_write":1154,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144229+0000","last_change":"2024-09-12T17:21:54.756222+0000","last_active":"2024-09-12T17:58:45.144229+0000","last_peered":"2024-09-12T17:58:45.144229+0000","last_clean":"2024-09-12T17:58:45.144229+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T17:58:45.144229+0000","last_undegraded":"2024-09-12T17:58:45.144229+0000","last_fullsized":"2024-09-12T17:58:45.144229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.426990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'196","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.143046+0000","last_change":"2024-09-12T17:21:56.768882+0000","last_active":"2024-09-12T18:00:54.143046+0000","last_peered":"2024-09-12T18:00:54.143046+0000","last_clean":"2024-09-12T18:00:54.143046+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:00:54.143046+0000","last_undegraded":"2024-09-12T18:00:54.143046+0000","last_fullsized":"2024-09-12T18:00:54.143046+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:28.839162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013880+0000","last_change":"2024-09-12T17:21:58.787288+0000","last_active":"2024-09-12T17:57:27.013880+0000","last_peered":"2024-09-12T17:57:27.013880+0000","last_clean":"2024-09-12T17:57:27.013880+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T17:57:27.013880+0000","last_undegraded":"2024-09-12T17:57:27.013880+0000","last_fullsized":"2024-09-12T17:57:27.013880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.278913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'288","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.917584+0000","last_change":"2024-09-12T17:22:00.794526+0000","last_active":"2024-09-12T17:59:34.917584+0000","last_peered":"2024-09-12T17:59:34.917584+0000","last_clean":"2024-09-12T17:59:34.917584+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T17:59:34.917584+0000","last_undegraded":"2024-09-12T17:59:34.917584+0000","last_fullsized":"2024-09-12T17:59:34.917584+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:11.669153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'466","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008227+0000","last_change":"2024-09-12T17:21:52.750831+0000","last_active":"2024-09-12T18:00:55.008227+0000","last_peered":"2024-09-12T18:00:55.008227+0000","last_clean":"2024-09-12T18:00:55.008227+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:00:55.008227+0000","last_undegraded":"2024-09-12T18:00:55.008227+0000","last_fullsized":"2024-09-12T18:00:55.008227+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:37.661922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010821+0000","last_change":"2024-09-12T17:21:41.867476+0000","last_active":"2024-09-12T17:57:07.010821+0000","last_peered":"2024-09-12T17:57:07.010821+0000","last_clean":"2024-09-12T17:57:07.010821+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T17:57:07.010821+0000","last_undegraded":"2024-09-12T17:57:07.010821+0000","last_fullsized":"2024-09-12T17:57:07.010821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:11.414546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'409","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.170765+0000","last_change":"2024-09-12T17:21:50.774438+0000","last_active":"2024-09-12T18:01:05.170765+0000","last_peered":"2024-09-12T18:01:05.170765+0000","last_clean":"2024-09-12T18:01:05.170765+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T18:01:05.170765+0000","last_undegraded":"2024-09-12T18:01:05.170765+0000","last_fullsized":"2024-09-12T18:01:05.170765+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.163145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3307398,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":11802,"num_write":1361,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133267+0000","last_change":"2024-09-12T17:21:54.752679+0000","last_active":"2024-09-12T17:57:25.133267+0000","last_peered":"2024-09-12T17:57:25.133267+0000","last_clean":"2024-09-12T17:57:25.133267+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T17:57:25.133267+0000","last_undegraded":"2024-09-12T17:57:25.133267+0000","last_fullsized":"2024-09-12T17:57:25.133267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:38.750473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'103","reported_seq":628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.240568+0000","last_change":"2024-09-12T17:21:56.763840+0000","last_active":"2024-09-12T18:00:56.240568+0000","last_peered":"2024-09-12T18:00:56.240568+0000","last_clean":"2024-09-12T18:00:56.240568+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:00:56.240568+0000","last_undegraded":"2024-09-12T18:00:56.240568+0000","last_fullsized":"2024-09-12T18:00:56.240568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:23.362341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025180+0000","last_change":"2024-09-12T17:21:58.789360+0000","last_active":"2024-09-12T17:58:52.025180+0000","last_peered":"2024-09-12T17:58:52.025180+0000","last_clean":"2024-09-12T17:58:52.025180+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T17:58:52.025180+0000","last_undegraded":"2024-09-12T17:58:52.025180+0000","last_fullsized":"2024-09-12T17:58:52.025180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:51.063573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'141","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.497508+0000","last_change":"2024-09-12T17:22:00.788204+0000","last_active":"2024-09-12T17:59:06.497508+0000","last_peered":"2024-09-12T17:59:06.497508+0000","last_clean":"2024-09-12T17:59:06.497508+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T17:59:06.497508+0000","last_undegraded":"2024-09-12T17:59:06.497508+0000","last_fullsized":"2024-09-12T17:59:06.497508+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:34.479482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'875","reported_seq":2704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521421+0000","last_change":"2024-09-12T17:21:52.747529+0000","last_active":"2024-09-12T17:59:17.521421+0000","last_peered":"2024-09-12T17:59:17.521421+0000","last_clean":"2024-09-12T17:59:17.521421+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T17:59:17.521421+0000","last_undegraded":"2024-09-12T17:59:17.521421+0000","last_fullsized":"2024-09-12T17:59:17.521421+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:25.413581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'375","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.232743+0000","last_change":"2024-09-12T17:21:50.763853+0000","last_active":"2024-09-12T18:01:05.232743+0000","last_peered":"2024-09-12T18:01:05.232743+0000","last_clean":"2024-09-12T18:01:05.232743+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T18:01:05.232743+0000","last_undegraded":"2024-09-12T18:01:05.232743+0000","last_fullsized":"2024-09-12T18:01:05.232743+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:50.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":25520,"num_write":1246,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:08.123646+0000","last_change":"2024-09-12T17:21:42.043334+0000","last_active":"2024-09-12T17:57:08.123646+0000","last_peered":"2024-09-12T17:57:08.123646+0000","last_clean":"2024-09-12T17:57:08.123646+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T17:57:08.123646+0000","last_undegraded":"2024-09-12T17:57:08.123646+0000","last_fullsized":"2024-09-12T17:57:08.123646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:38.050118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.013014+0000","last_change":"2024-09-12T17:21:54.755491+0000","last_active":"2024-09-12T17:57:22.013014+0000","last_peered":"2024-09-12T17:57:22.013014+0000","last_clean":"2024-09-12T17:57:22.013014+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T17:57:22.013014+0000","last_undegraded":"2024-09-12T17:57:22.013014+0000","last_fullsized":"2024-09-12T17:57:22.013014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:39.242340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'543","reported_seq":1193,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.214244+0000","last_change":"2024-09-12T17:21:56.763880+0000","last_active":"2024-09-12T18:01:04.214244+0000","last_peered":"2024-09-12T18:01:04.214244+0000","last_clean":"2024-09-12T18:01:04.214244+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:01:04.214244+0000","last_undegraded":"2024-09-12T18:01:04.214244+0000","last_fullsized":"2024-09-12T18:01:04.214244+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:59.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106777,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":960,"num_read_kb":2265,"num_write":794,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164192+0000","last_change":"2024-09-12T17:21:58.786573+0000","last_active":"2024-09-12T17:57:27.164192+0000","last_peered":"2024-09-12T17:57:27.164192+0000","last_clean":"2024-09-12T17:57:27.164192+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T17:57:27.164192+0000","last_undegraded":"2024-09-12T17:57:27.164192+0000","last_fullsized":"2024-09-12T17:57:27.164192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:30.677838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'166","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.362537+0000","last_change":"2024-09-12T17:22:00.798528+0000","last_active":"2024-09-12T17:59:34.362537+0000","last_peered":"2024-09-12T17:59:34.362537+0000","last_clean":"2024-09-12T17:59:34.362537+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T17:59:34.362537+0000","last_undegraded":"2024-09-12T17:59:34.362537+0000","last_fullsized":"2024-09-12T17:59:34.362537+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:54.854895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'825","reported_seq":2342,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.763003+0000","last_change":"2024-09-12T17:21:52.754209+0000","last_active":"2024-09-12T17:59:34.763003+0000","last_peered":"2024-09-12T17:59:34.763003+0000","last_clean":"2024-09-12T17:59:34.763003+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T17:59:34.763003+0000","last_undegraded":"2024-09-12T17:59:34.763003+0000","last_fullsized":"2024-09-12T17:59:34.763003+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:34.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'375","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.316347+0000","last_change":"2024-09-12T17:21:50.763342+0000","last_active":"2024-09-12T18:01:05.316347+0000","last_peered":"2024-09-12T18:01:05.316347+0000","last_clean":"2024-09-12T18:01:05.316347+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T18:01:05.316347+0000","last_undegraded":"2024-09-12T18:01:05.316347+0000","last_fullsized":"2024-09-12T18:01:05.316347+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:44.497032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":578,"num_read_kb":7304,"num_write":1242,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.011523+0000","last_change":"2024-09-12T17:21:41.866466+0000","last_active":"2024-09-12T17:57:12.011523+0000","last_peered":"2024-09-12T17:57:12.011523+0000","last_clean":"2024-09-12T17:57:12.011523+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T17:57:12.011523+0000","last_undegraded":"2024-09-12T17:57:12.011523+0000","last_fullsized":"2024-09-12T17:57:12.011523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:41.352304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012430+0000","last_change":"2024-09-12T17:21:54.751823+0000","last_active":"2024-09-12T17:57:22.012430+0000","last_peered":"2024-09-12T17:57:22.012430+0000","last_clean":"2024-09-12T17:57:22.012430+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T17:57:22.012430+0000","last_undegraded":"2024-09-12T17:57:22.012430+0000","last_fullsized":"2024-09-12T17:57:22.012430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:45.553180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'154","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144606+0000","last_change":"2024-09-12T17:21:56.762425+0000","last_active":"2024-09-12T17:59:27.144606+0000","last_peered":"2024-09-12T17:59:27.144606+0000","last_clean":"2024-09-12T17:59:27.144606+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T17:59:27.144606+0000","last_undegraded":"2024-09-12T17:59:27.144606+0000","last_fullsized":"2024-09-12T17:59:27.144606+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:35.405866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'806","reported_seq":2569,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.433848+0000","last_change":"2024-09-12T17:21:58.782857+0000","last_active":"2024-09-12T18:01:03.433848+0000","last_peered":"2024-09-12T18:01:03.433848+0000","last_clean":"2024-09-12T18:01:03.433848+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:01:03.433848+0000","last_undegraded":"2024-09-12T18:01:03.433848+0000","last_fullsized":"2024-09-12T18:01:03.433848+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:02.049669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'109","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:20.158995+0000","last_change":"2024-09-12T17:22:00.794639+0000","last_active":"2024-09-12T18:00:20.158995+0000","last_peered":"2024-09-12T18:00:20.158995+0000","last_clean":"2024-09-12T18:00:20.158995+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:00:20.158995+0000","last_undegraded":"2024-09-12T18:00:20.158995+0000","last_fullsized":"2024-09-12T18:00:20.158995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:42.302531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'871","reported_seq":2582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.800538+0000","last_change":"2024-09-12T17:21:52.745987+0000","last_active":"2024-09-12T17:59:17.800538+0000","last_peered":"2024-09-12T17:59:17.800538+0000","last_clean":"2024-09-12T17:59:17.800538+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T17:59:17.800538+0000","last_undegraded":"2024-09-12T17:59:17.800538+0000","last_fullsized":"2024-09-12T17:59:17.800538+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:35.780719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'365","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.270451+0000","last_change":"2024-09-12T17:21:50.756194+0000","last_active":"2024-09-12T18:01:05.270451+0000","last_peered":"2024-09-12T18:01:05.270451+0000","last_clean":"2024-09-12T18:01:05.270451+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T18:01:05.270451+0000","last_undegraded":"2024-09-12T18:01:05.270451+0000","last_fullsized":"2024-09-12T18:01:05.270451+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:46.420332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831558,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":10322,"num_write":1179,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.023460+0000","last_change":"2024-09-12T17:21:41.865878+0000","last_active":"2024-09-12T17:58:32.023460+0000","last_peered":"2024-09-12T17:58:32.023460+0000","last_clean":"2024-09-12T17:58:32.023460+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T17:58:32.023460+0000","last_undegraded":"2024-09-12T17:58:32.023460+0000","last_fullsized":"2024-09-12T17:58:32.023460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.625705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012930+0000","last_change":"2024-09-12T17:21:54.758563+0000","last_active":"2024-09-12T17:57:22.012930+0000","last_peered":"2024-09-12T17:57:22.012930+0000","last_clean":"2024-09-12T17:57:22.012930+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T17:57:22.012930+0000","last_undegraded":"2024-09-12T17:57:22.012930+0000","last_fullsized":"2024-09-12T17:57:22.012930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:07.608583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'96","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.275920+0000","last_change":"2024-09-12T17:21:56.765131+0000","last_active":"2024-09-12T17:59:06.275920+0000","last_peered":"2024-09-12T17:59:06.275920+0000","last_clean":"2024-09-12T17:59:06.275920+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T17:59:06.275920+0000","last_undegraded":"2024-09-12T17:59:06.275920+0000","last_fullsized":"2024-09-12T17:59:06.275920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:57.138933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'809","reported_seq":2356,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.905712+0000","last_change":"2024-09-12T17:21:58.785486+0000","last_active":"2024-09-12T18:01:02.905712+0000","last_peered":"2024-09-12T18:01:02.905712+0000","last_clean":"2024-09-12T18:01:02.905712+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:02.905712+0000","last_undegraded":"2024-09-12T18:01:02.905712+0000","last_fullsized":"2024-09-12T18:01:02.905712+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:06.317754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'325","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.374584+0000","last_change":"2024-09-12T17:22:00.794801+0000","last_active":"2024-09-12T17:59:34.374584+0000","last_peered":"2024-09-12T17:59:34.374584+0000","last_clean":"2024-09-12T17:59:34.374584+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T17:59:34.374584+0000","last_undegraded":"2024-09-12T17:59:34.374584+0000","last_fullsized":"2024-09-12T17:59:34.374584+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:20.169521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'491","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501739+0000","last_change":"2024-09-12T17:21:52.740621+0000","last_active":"2024-09-12T17:59:18.501739+0000","last_peered":"2024-09-12T17:59:18.501739+0000","last_clean":"2024-09-12T17:59:18.501739+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T17:59:18.501739+0000","last_undegraded":"2024-09-12T17:59:18.501739+0000","last_fullsized":"2024-09-12T17:59:18.501739+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:50.850961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'332","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.216838+0000","last_change":"2024-09-12T17:21:50.759984+0000","last_active":"2024-09-12T18:01:05.216838+0000","last_peered":"2024-09-12T18:01:05.216838+0000","last_clean":"2024-09-12T18:01:05.216838+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T18:01:05.216838+0000","last_undegraded":"2024-09-12T18:01:05.216838+0000","last_fullsized":"2024-09-12T18:01:05.216838+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.213987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287862,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59240,"num_write":1015,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:32.022640+0000","last_change":"2024-09-12T17:21:41.866850+0000","last_active":"2024-09-12T17:58:32.022640+0000","last_peered":"2024-09-12T17:58:32.022640+0000","last_clean":"2024-09-12T17:58:32.022640+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T17:58:32.022640+0000","last_undegraded":"2024-09-12T17:58:32.022640+0000","last_fullsized":"2024-09-12T17:58:32.022640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:38.839971+0000","last_clean_scrub_stamp":"2024-09-12T17:21:38.839971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.746085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.019639+0000","last_change":"2024-09-12T17:21:54.752228+0000","last_active":"2024-09-12T17:58:07.019639+0000","last_peered":"2024-09-12T17:58:07.019639+0000","last_clean":"2024-09-12T17:58:07.019639+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T17:58:07.019639+0000","last_undegraded":"2024-09-12T17:58:07.019639+0000","last_fullsized":"2024-09-12T17:58:07.019639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.871367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'746","reported_seq":1455,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.458302+0000","last_change":"2024-09-12T17:21:56.767995+0000","last_active":"2024-09-12T18:01:04.458302+0000","last_peered":"2024-09-12T18:01:04.458302+0000","last_clean":"2024-09-12T18:01:04.458302+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:01:04.458302+0000","last_undegraded":"2024-09-12T18:01:04.458302+0000","last_fullsized":"2024-09-12T18:01:04.458302+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:13.584754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1320,"num_read_kb":3172,"num_write":1088,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013828+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:57:27.013828+0000","last_peered":"2024-09-12T17:57:27.013828+0000","last_clean":"2024-09-12T17:57:27.013828+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T17:57:27.013828+0000","last_undegraded":"2024-09-12T17:57:27.013828+0000","last_fullsized":"2024-09-12T17:57:27.013828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:01.402224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'132","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.226950+0000","last_change":"2024-09-12T17:22:00.789098+0000","last_active":"2024-09-12T17:59:03.226950+0000","last_peered":"2024-09-12T17:59:03.226950+0000","last_clean":"2024-09-12T17:59:03.226950+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T17:59:03.226950+0000","last_undegraded":"2024-09-12T17:59:03.226950+0000","last_fullsized":"2024-09-12T17:59:03.226950+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.614418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'152","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.424191+0000","last_change":"2024-09-12T17:22:00.786992+0000","last_active":"2024-09-12T17:59:34.424191+0000","last_peered":"2024-09-12T17:59:34.424191+0000","last_clean":"2024-09-12T17:59:34.424191+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T17:59:34.424191+0000","last_undegraded":"2024-09-12T17:59:34.424191+0000","last_fullsized":"2024-09-12T17:59:34.424191+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:08.329121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'468","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.769697+0000","last_change":"2024-09-12T17:21:52.742192+0000","last_active":"2024-09-12T17:59:18.769697+0000","last_peered":"2024-09-12T17:59:18.769697+0000","last_clean":"2024-09-12T17:59:18.769697+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T17:59:18.769697+0000","last_undegraded":"2024-09-12T17:59:18.769697+0000","last_fullsized":"2024-09-12T17:59:18.769697+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:43.783519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'322","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.300388+0000","last_change":"2024-09-12T17:21:50.771110+0000","last_active":"2024-09-12T18:01:05.300388+0000","last_peered":"2024-09-12T18:01:05.300388+0000","last_clean":"2024-09-12T18:01:05.300388+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T18:01:05.300388+0000","last_undegraded":"2024-09-12T18:01:05.300388+0000","last_fullsized":"2024-09-12T18:01:05.300388+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:22.753809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":5956,"num_write":1032,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124604+0000","last_change":"2024-09-12T17:21:54.759266+0000","last_active":"2024-09-12T17:56:57.124604+0000","last_peered":"2024-09-12T17:56:57.124604+0000","last_clean":"2024-09-12T17:56:57.124604+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T17:56:57.124604+0000","last_undegraded":"2024-09-12T17:56:57.124604+0000","last_fullsized":"2024-09-12T17:56:57.124604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:37.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'295","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.920200+0000","last_change":"2024-09-12T17:21:56.766802+0000","last_active":"2024-09-12T18:01:04.920200+0000","last_peered":"2024-09-12T18:01:04.920200+0000","last_clean":"2024-09-12T18:01:04.920200+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T18:01:04.920200+0000","last_undegraded":"2024-09-12T18:01:04.920200+0000","last_fullsized":"2024-09-12T18:01:04.920200+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.524361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":1191,"num_write":410,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129355+0000","last_change":"2024-09-12T17:21:58.781271+0000","last_active":"2024-09-12T17:57:00.129355+0000","last_peered":"2024-09-12T17:57:00.129355+0000","last_clean":"2024-09-12T17:57:00.129355+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T17:57:00.129355+0000","last_undegraded":"2024-09-12T17:57:00.129355+0000","last_fullsized":"2024-09-12T17:57:00.129355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:44.876899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.826880+0000","last_change":"2024-09-12T17:22:00.795423+0000","last_active":"2024-09-12T17:59:34.826880+0000","last_peered":"2024-09-12T17:59:34.826880+0000","last_clean":"2024-09-12T17:59:34.826880+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T17:59:34.826880+0000","last_undegraded":"2024-09-12T17:59:34.826880+0000","last_fullsized":"2024-09-12T17:59:34.826880+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:51.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'639","reported_seq":2255,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.002741+0000","last_change":"2024-09-12T17:21:52.744060+0000","last_active":"2024-09-12T17:59:16.002741+0000","last_peered":"2024-09-12T17:59:16.002741+0000","last_clean":"2024-09-12T17:59:16.002741+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T17:59:16.002741+0000","last_undegraded":"2024-09-12T17:59:16.002741+0000","last_fullsized":"2024-09-12T17:59:16.002741+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:49.782641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.304950+0000","last_change":"2024-09-12T17:22:26.296706+0000","last_active":"2024-09-12T18:01:05.304950+0000","last_peered":"2024-09-12T18:01:05.304950+0000","last_clean":"2024-09-12T18:01:05.304950+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:05.304950+0000","last_undegraded":"2024-09-12T18:01:05.304950+0000","last_fullsized":"2024-09-12T18:01:05.304950+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:49.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25542,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":12892,"num_write":966,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009094+0000","last_change":"2024-09-12T17:21:54.755356+0000","last_active":"2024-09-12T17:56:57.009094+0000","last_peered":"2024-09-12T17:56:57.009094+0000","last_clean":"2024-09-12T17:56:57.009094+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T17:56:57.009094+0000","last_undegraded":"2024-09-12T17:56:57.009094+0000","last_fullsized":"2024-09-12T17:56:57.009094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:02.209702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":547,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.778422+0000","last_change":"2024-09-12T17:21:56.761388+0000","last_active":"2024-09-12T17:58:38.778422+0000","last_peered":"2024-09-12T17:58:38.778422+0000","last_clean":"2024-09-12T17:58:38.778422+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T17:58:38.778422+0000","last_undegraded":"2024-09-12T17:58:38.778422+0000","last_fullsized":"2024-09-12T17:58:38.778422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:20.116062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160637+0000","last_change":"2024-09-12T17:21:58.779273+0000","last_active":"2024-09-12T17:57:02.160637+0000","last_peered":"2024-09-12T17:57:02.160637+0000","last_clean":"2024-09-12T17:57:02.160637+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T17:57:02.160637+0000","last_undegraded":"2024-09-12T17:57:02.160637+0000","last_fullsized":"2024-09-12T17:57:02.160637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:23.417297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'227","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.355106+0000","last_change":"2024-09-12T17:22:00.795725+0000","last_active":"2024-09-12T17:59:34.355106+0000","last_peered":"2024-09-12T17:59:34.355106+0000","last_clean":"2024-09-12T17:59:34.355106+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T17:59:34.355106+0000","last_undegraded":"2024-09-12T17:59:34.355106+0000","last_fullsized":"2024-09-12T17:59:34.355106+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:25.111700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'387","reported_seq":1863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760420+0000","last_change":"2024-09-12T17:21:52.750349+0000","last_active":"2024-09-12T17:59:34.760420+0000","last_peered":"2024-09-12T17:59:34.760420+0000","last_clean":"2024-09-12T17:59:34.760420+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T17:59:34.760420+0000","last_undegraded":"2024-09-12T17:59:34.760420+0000","last_fullsized":"2024-09-12T17:59:34.760420+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:27.902470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'337","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.232365+0000","last_change":"2024-09-12T17:21:50.769491+0000","last_active":"2024-09-12T18:01:05.232365+0000","last_peered":"2024-09-12T18:01:05.232365+0000","last_clean":"2024-09-12T18:01:05.232365+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T18:01:05.232365+0000","last_undegraded":"2024-09-12T18:01:05.232365+0000","last_fullsized":"2024-09-12T18:01:05.232365+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:13.935748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":8586,"num_write":1108,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159979+0000","last_change":"2024-09-12T17:21:54.753914+0000","last_active":"2024-09-12T17:56:57.159979+0000","last_peered":"2024-09-12T17:56:57.159979+0000","last_clean":"2024-09-12T17:56:57.159979+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T17:56:57.159979+0000","last_undegraded":"2024-09-12T17:56:57.159979+0000","last_fullsized":"2024-09-12T17:56:57.159979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.689343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'318","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.060792+0000","last_change":"2024-09-12T17:21:56.766069+0000","last_active":"2024-09-12T18:01:04.060792+0000","last_peered":"2024-09-12T18:01:04.060792+0000","last_clean":"2024-09-12T18:01:04.060792+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T18:01:04.060792+0000","last_undegraded":"2024-09-12T18:01:04.060792+0000","last_fullsized":"2024-09-12T18:01:04.060792+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:38.666434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54935,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":1244,"num_write":438,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.120621+0000","last_change":"2024-09-12T17:21:58.781433+0000","last_active":"2024-09-12T17:57:02.120621+0000","last_peered":"2024-09-12T17:57:02.120621+0000","last_clean":"2024-09-12T17:57:02.120621+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T17:57:02.120621+0000","last_undegraded":"2024-09-12T17:57:02.120621+0000","last_fullsized":"2024-09-12T17:57:02.120621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:29.832595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'133","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.970181+0000","last_change":"2024-09-12T17:22:00.797551+0000","last_active":"2024-09-12T17:59:02.970181+0000","last_peered":"2024-09-12T17:59:02.970181+0000","last_clean":"2024-09-12T17:59:02.970181+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T17:59:02.970181+0000","last_undegraded":"2024-09-12T17:59:02.970181+0000","last_fullsized":"2024-09-12T17:59:02.970181+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:41.162485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'740","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.538431+0000","last_change":"2024-09-12T17:21:52.749905+0000","last_active":"2024-09-12T17:59:12.538431+0000","last_peered":"2024-09-12T17:59:12.538431+0000","last_clean":"2024-09-12T17:59:12.538431+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T17:59:12.538431+0000","last_undegraded":"2024-09-12T17:59:12.538431+0000","last_fullsized":"2024-09-12T17:59:12.538431+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:52.822961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'319","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.310565+0000","last_change":"2024-09-12T17:21:50.755503+0000","last_active":"2024-09-12T18:01:05.310565+0000","last_peered":"2024-09-12T18:01:05.310565+0000","last_clean":"2024-09-12T18:01:05.310565+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:05.310565+0000","last_undegraded":"2024-09-12T18:01:05.310565+0000","last_fullsized":"2024-09-12T18:01:05.310565+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:37.883856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":5945,"num_write":1198,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009139+0000","last_change":"2024-09-12T17:21:54.758453+0000","last_active":"2024-09-12T17:56:57.009139+0000","last_peered":"2024-09-12T17:56:57.009139+0000","last_clean":"2024-09-12T17:56:57.009139+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T17:56:57.009139+0000","last_undegraded":"2024-09-12T17:56:57.009139+0000","last_fullsized":"2024-09-12T17:56:57.009139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.810118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'254","reported_seq":816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.820968+0000","last_change":"2024-09-12T17:21:56.769935+0000","last_active":"2024-09-12T18:01:03.820968+0000","last_peered":"2024-09-12T18:01:03.820968+0000","last_clean":"2024-09-12T18:01:03.820968+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T18:01:03.820968+0000","last_undegraded":"2024-09-12T18:01:03.820968+0000","last_fullsized":"2024-09-12T18:01:03.820968+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:39.633555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48942,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":1075,"num_write":368,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129426+0000","last_change":"2024-09-12T17:21:58.785066+0000","last_active":"2024-09-12T17:57:00.129426+0000","last_peered":"2024-09-12T17:57:00.129426+0000","last_clean":"2024-09-12T17:57:00.129426+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T17:57:00.129426+0000","last_undegraded":"2024-09-12T17:57:00.129426+0000","last_fullsized":"2024-09-12T17:57:00.129426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:41.442928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'404","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.618747+0000","last_change":"2024-09-12T17:21:52.755203+0000","last_active":"2024-09-12T17:59:16.618747+0000","last_peered":"2024-09-12T17:59:16.618747+0000","last_clean":"2024-09-12T17:59:16.618747+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T17:59:16.618747+0000","last_undegraded":"2024-09-12T17:59:16.618747+0000","last_fullsized":"2024-09-12T17:59:16.618747+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:20.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'306","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.236608+0000","last_change":"2024-09-12T17:21:50.762696+0000","last_active":"2024-09-12T18:01:05.236608+0000","last_peered":"2024-09-12T18:01:05.236608+0000","last_clean":"2024-09-12T18:01:05.236608+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:05.236608+0000","last_undegraded":"2024-09-12T18:01:05.236608+0000","last_fullsized":"2024-09-12T18:01:05.236608+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:29.711995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6208110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":25374,"num_write":969,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133894+0000","last_change":"2024-09-12T17:21:54.759183+0000","last_active":"2024-09-12T17:58:02.133894+0000","last_peered":"2024-09-12T17:58:02.133894+0000","last_clean":"2024-09-12T17:58:02.133894+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T17:58:02.133894+0000","last_undegraded":"2024-09-12T17:58:02.133894+0000","last_fullsized":"2024-09-12T17:58:02.133894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:44.448393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'486","reported_seq":1107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.333686+0000","last_change":"2024-09-12T17:21:56.768691+0000","last_active":"2024-09-12T18:01:05.333686+0000","last_peered":"2024-09-12T18:01:05.333686+0000","last_clean":"2024-09-12T18:01:05.333686+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:01:05.333686+0000","last_undegraded":"2024-09-12T18:01:05.333686+0000","last_fullsized":"2024-09-12T18:01:05.333686+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.730690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94926,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":2123,"num_write":760,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160707+0000","last_change":"2024-09-12T17:21:58.784784+0000","last_active":"2024-09-12T17:57:02.160707+0000","last_peered":"2024-09-12T17:57:02.160707+0000","last_clean":"2024-09-12T17:57:02.160707+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T17:57:02.160707+0000","last_undegraded":"2024-09-12T17:57:02.160707+0000","last_fullsized":"2024-09-12T17:57:02.160707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:09.975350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'164","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.836312+0000","last_change":"2024-09-12T17:22:00.798771+0000","last_active":"2024-09-12T17:59:28.836312+0000","last_peered":"2024-09-12T17:59:28.836312+0000","last_clean":"2024-09-12T17:59:28.836312+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T17:59:28.836312+0000","last_undegraded":"2024-09-12T17:59:28.836312+0000","last_fullsized":"2024-09-12T17:59:28.836312+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:10.472501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'420","reported_seq":1885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.952594+0000","last_change":"2024-09-12T17:21:52.746392+0000","last_active":"2024-09-12T17:59:16.952594+0000","last_peered":"2024-09-12T17:59:16.952594+0000","last_clean":"2024-09-12T17:59:16.952594+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T17:59:16.952594+0000","last_undegraded":"2024-09-12T17:59:16.952594+0000","last_fullsized":"2024-09-12T17:59:16.952594+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:08.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'338","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.261048+0000","last_change":"2024-09-12T17:21:50.759865+0000","last_active":"2024-09-12T18:01:05.261048+0000","last_peered":"2024-09-12T18:01:05.261048+0000","last_clean":"2024-09-12T18:01:05.261048+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T18:01:05.261048+0000","last_undegraded":"2024-09-12T18:01:05.261048+0000","last_fullsized":"2024-09-12T18:01:05.261048+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:18.154345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":48900,"num_write":1054,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.163561+0000","last_change":"2024-09-12T17:21:54.757887+0000","last_active":"2024-09-12T17:57:22.163561+0000","last_peered":"2024-09-12T17:57:22.163561+0000","last_clean":"2024-09-12T17:57:22.163561+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T17:57:22.163561+0000","last_undegraded":"2024-09-12T17:57:22.163561+0000","last_fullsized":"2024-09-12T17:57:22.163561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:57.740295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'295","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.891539+0000","last_change":"2024-09-12T17:21:56.759500+0000","last_active":"2024-09-12T18:01:03.891539+0000","last_peered":"2024-09-12T18:01:03.891539+0000","last_clean":"2024-09-12T18:01:03.891539+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T18:01:03.891539+0000","last_undegraded":"2024-09-12T18:01:03.891539+0000","last_fullsized":"2024-09-12T18:01:03.891539+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:26.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1077,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.122006+0000","last_change":"2024-09-12T17:21:58.795399+0000","last_active":"2024-09-12T17:56:58.122006+0000","last_peered":"2024-09-12T17:56:58.122006+0000","last_clean":"2024-09-12T17:56:58.122006+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T17:56:58.122006+0000","last_undegraded":"2024-09-12T17:56:58.122006+0000","last_fullsized":"2024-09-12T17:56:58.122006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:48.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'190","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.181615+0000","last_change":"2024-09-12T17:22:00.794027+0000","last_active":"2024-09-12T17:59:33.181615+0000","last_peered":"2024-09-12T17:59:33.181615+0000","last_clean":"2024-09-12T17:59:33.181615+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T17:59:33.181615+0000","last_undegraded":"2024-09-12T17:59:33.181615+0000","last_fullsized":"2024-09-12T17:59:33.181615+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:17.004717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'853","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.133185+0000","last_change":"2024-09-12T17:21:52.755426+0000","last_active":"2024-09-12T17:59:15.133185+0000","last_peered":"2024-09-12T17:59:15.133185+0000","last_clean":"2024-09-12T17:59:15.133185+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T17:59:15.133185+0000","last_undegraded":"2024-09-12T17:59:15.133185+0000","last_fullsized":"2024-09-12T17:59:15.133185+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:04.598499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'322","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.258052+0000","last_change":"2024-09-12T17:21:50.755856+0000","last_active":"2024-09-12T18:01:05.258052+0000","last_peered":"2024-09-12T18:01:05.258052+0000","last_clean":"2024-09-12T18:01:05.258052+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T18:01:05.258052+0000","last_undegraded":"2024-09-12T18:01:05.258052+0000","last_fullsized":"2024-09-12T18:01:05.258052+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:22.206678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287371,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":72608,"num_write":1086,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160042+0000","last_change":"2024-09-12T17:21:54.750383+0000","last_active":"2024-09-12T17:56:57.160042+0000","last_peered":"2024-09-12T17:56:57.160042+0000","last_clean":"2024-09-12T17:56:57.160042+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T17:56:57.160042+0000","last_undegraded":"2024-09-12T17:56:57.160042+0000","last_fullsized":"2024-09-12T17:56:57.160042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'237","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.182117+0000","last_change":"2024-09-12T17:21:56.768390+0000","last_active":"2024-09-12T18:01:05.182117+0000","last_peered":"2024-09-12T18:01:05.182117+0000","last_clean":"2024-09-12T18:01:05.182117+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T18:01:05.182117+0000","last_undegraded":"2024-09-12T18:01:05.182117+0000","last_fullsized":"2024-09-12T18:01:05.182117+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:20.766139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18914,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":895,"num_write":312,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138962+0000","last_change":"2024-09-12T17:21:58.784005+0000","last_active":"2024-09-12T17:58:05.138962+0000","last_peered":"2024-09-12T17:58:05.138962+0000","last_clean":"2024-09-12T17:58:05.138962+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T17:58:05.138962+0000","last_undegraded":"2024-09-12T17:58:05.138962+0000","last_fullsized":"2024-09-12T17:58:05.138962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:02.608599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'111","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.117938+0000","last_change":"2024-09-12T17:22:00.796332+0000","last_active":"2024-09-12T18:00:56.117938+0000","last_peered":"2024-09-12T18:00:56.117938+0000","last_clean":"2024-09-12T18:00:56.117938+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:00:56.117938+0000","last_undegraded":"2024-09-12T18:00:56.117938+0000","last_fullsized":"2024-09-12T18:00:56.117938+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'488","reported_seq":2088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999609+0000","last_change":"2024-09-12T17:21:52.747235+0000","last_active":"2024-09-12T18:00:54.999609+0000","last_peered":"2024-09-12T18:00:54.999609+0000","last_clean":"2024-09-12T18:00:54.999609+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:00:54.999609+0000","last_undegraded":"2024-09-12T18:00:54.999609+0000","last_fullsized":"2024-09-12T18:00:54.999609+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:11.805325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'316","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.290594+0000","last_change":"2024-09-12T17:21:50.761070+0000","last_active":"2024-09-12T18:01:05.290594+0000","last_peered":"2024-09-12T18:01:05.290594+0000","last_clean":"2024-09-12T18:01:05.290594+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T18:01:05.290594+0000","last_undegraded":"2024-09-12T18:01:05.290594+0000","last_fullsized":"2024-09-12T18:01:05.290594+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:43.740244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170477,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":22007,"num_write":949,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009133+0000","last_change":"2024-09-12T17:21:54.755644+0000","last_active":"2024-09-12T17:56:57.009133+0000","last_peered":"2024-09-12T17:56:57.009133+0000","last_clean":"2024-09-12T17:56:57.009133+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T17:56:57.009133+0000","last_undegraded":"2024-09-12T17:56:57.009133+0000","last_fullsized":"2024-09-12T17:56:57.009133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'79","reported_seq":592,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:16.585394+0000","last_change":"2024-09-12T17:21:56.761019+0000","last_active":"2024-09-12T17:58:16.585394+0000","last_peered":"2024-09-12T17:58:16.585394+0000","last_clean":"2024-09-12T17:58:16.585394+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T17:58:16.585394+0000","last_undegraded":"2024-09-12T17:58:16.585394+0000","last_fullsized":"2024-09-12T17:58:16.585394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.371470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'757","reported_seq":2434,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.775252+0000","last_change":"2024-09-12T17:21:58.783309+0000","last_active":"2024-09-12T18:01:04.775252+0000","last_peered":"2024-09-12T18:01:04.775252+0000","last_clean":"2024-09-12T18:01:04.775252+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:01:04.775252+0000","last_undegraded":"2024-09-12T18:01:04.775252+0000","last_fullsized":"2024-09-12T18:01:04.775252+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:14.021972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'111","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.028820+0000","last_change":"2024-09-12T17:22:00.792450+0000","last_active":"2024-09-12T17:59:22.028820+0000","last_peered":"2024-09-12T17:59:22.028820+0000","last_clean":"2024-09-12T17:59:22.028820+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T17:59:22.028820+0000","last_undegraded":"2024-09-12T17:59:22.028820+0000","last_fullsized":"2024-09-12T17:59:22.028820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.275271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'468","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.759665+0000","last_change":"2024-09-12T17:21:52.751365+0000","last_active":"2024-09-12T17:59:34.759665+0000","last_peered":"2024-09-12T17:59:34.759665+0000","last_clean":"2024-09-12T17:59:34.759665+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T17:59:34.759665+0000","last_undegraded":"2024-09-12T17:59:34.759665+0000","last_fullsized":"2024-09-12T17:59:34.759665+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:36.771613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'343","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.285097+0000","last_change":"2024-09-12T17:21:50.768703+0000","last_active":"2024-09-12T18:01:05.285097+0000","last_peered":"2024-09-12T18:01:05.285097+0000","last_clean":"2024-09-12T18:01:05.285097+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T18:01:05.285097+0000","last_undegraded":"2024-09-12T18:01:05.285097+0000","last_fullsized":"2024-09-12T18:01:05.285097+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:26.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2782938,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":20563,"num_write":1073,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.120023+0000","last_change":"2024-09-12T17:21:54.752741+0000","last_active":"2024-09-12T17:56:57.120023+0000","last_peered":"2024-09-12T17:56:57.120023+0000","last_clean":"2024-09-12T17:56:57.120023+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T17:56:57.120023+0000","last_undegraded":"2024-09-12T17:56:57.120023+0000","last_fullsized":"2024-09-12T17:56:57.120023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:50.651848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'293","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.241927+0000","last_change":"2024-09-12T17:21:56.771872+0000","last_active":"2024-09-12T18:01:03.241927+0000","last_peered":"2024-09-12T18:01:03.241927+0000","last_clean":"2024-09-12T18:01:03.241927+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:01:03.241927+0000","last_undegraded":"2024-09-12T18:01:03.241927+0000","last_fullsized":"2024-09-12T18:01:03.241927+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:31.183940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50539,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":1069,"num_write":390,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021920+0000","last_change":"2024-09-12T17:21:58.789902+0000","last_active":"2024-09-12T17:58:17.021920+0000","last_peered":"2024-09-12T17:58:17.021920+0000","last_clean":"2024-09-12T17:58:17.021920+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T17:58:17.021920+0000","last_undegraded":"2024-09-12T17:58:17.021920+0000","last_fullsized":"2024-09-12T17:58:17.021920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.777449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'139","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.021593+0000","last_change":"2024-09-12T17:22:00.794282+0000","last_active":"2024-09-12T17:59:34.021593+0000","last_peered":"2024-09-12T17:59:34.021593+0000","last_clean":"2024-09-12T17:59:34.021593+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T17:59:34.021593+0000","last_undegraded":"2024-09-12T17:59:34.021593+0000","last_fullsized":"2024-09-12T17:59:34.021593+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:58.732912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'468","reported_seq":2076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.002055+0000","last_change":"2024-09-12T17:21:52.746743+0000","last_active":"2024-09-12T18:00:55.002055+0000","last_peered":"2024-09-12T18:00:55.002055+0000","last_clean":"2024-09-12T18:00:55.002055+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:00:55.002055+0000","last_undegraded":"2024-09-12T18:00:55.002055+0000","last_fullsized":"2024-09-12T18:00:55.002055+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.604964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'336","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.255102+0000","last_change":"2024-09-12T17:21:50.771314+0000","last_active":"2024-09-12T18:01:05.255102+0000","last_peered":"2024-09-12T18:01:05.255102+0000","last_clean":"2024-09-12T18:01:05.255102+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:01:05.255102+0000","last_undegraded":"2024-09-12T18:01:05.255102+0000","last_fullsized":"2024-09-12T18:01:05.255102+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:28.163181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":60843,"num_write":1102,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.160026+0000","last_change":"2024-09-12T17:21:54.754687+0000","last_active":"2024-09-12T17:56:57.160026+0000","last_peered":"2024-09-12T17:56:57.160026+0000","last_clean":"2024-09-12T17:56:57.160026+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T17:56:57.160026+0000","last_undegraded":"2024-09-12T17:56:57.160026+0000","last_fullsized":"2024-09-12T17:56:57.160026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.236794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'253","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.313146+0000","last_change":"2024-09-12T17:21:56.764040+0000","last_active":"2024-09-12T18:01:03.313146+0000","last_peered":"2024-09-12T18:01:03.313146+0000","last_clean":"2024-09-12T18:01:03.313146+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:01:03.313146+0000","last_undegraded":"2024-09-12T18:01:03.313146+0000","last_fullsized":"2024-09-12T18:01:03.313146+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:13.554679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":1004,"num_write":346,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021541+0000","last_change":"2024-09-12T17:21:58.783726+0000","last_active":"2024-09-12T17:58:22.021541+0000","last_peered":"2024-09-12T17:58:22.021541+0000","last_clean":"2024-09-12T17:58:22.021541+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T17:58:22.021541+0000","last_undegraded":"2024-09-12T17:58:22.021541+0000","last_fullsized":"2024-09-12T17:58:22.021541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'103","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.765064+0000","last_change":"2024-09-12T17:22:00.798683+0000","last_active":"2024-09-12T17:59:34.765064+0000","last_peered":"2024-09-12T17:59:34.765064+0000","last_clean":"2024-09-12T17:59:34.765064+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T17:59:34.765064+0000","last_undegraded":"2024-09-12T17:59:34.765064+0000","last_fullsized":"2024-09-12T17:59:34.765064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:52.343353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.840653+0000","last_change":"2024-09-12T17:21:52.750254+0000","last_active":"2024-09-12T17:59:28.840653+0000","last_peered":"2024-09-12T17:59:28.840653+0000","last_clean":"2024-09-12T17:59:28.840653+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T17:59:28.840653+0000","last_undegraded":"2024-09-12T17:59:28.840653+0000","last_fullsized":"2024-09-12T17:59:28.840653+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:42.642542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'398","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.271190+0000","last_change":"2024-09-12T17:21:50.747069+0000","last_active":"2024-09-12T18:01:05.271190+0000","last_peered":"2024-09-12T18:01:05.271190+0000","last_clean":"2024-09-12T18:01:05.271190+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:05.271190+0000","last_undegraded":"2024-09-12T18:01:05.271190+0000","last_fullsized":"2024-09-12T18:01:05.271190+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:49.408880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645063,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":663,"num_read_kb":67994,"num_write":1237,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.130730+0000","last_change":"2024-09-12T17:21:54.750762+0000","last_active":"2024-09-12T17:58:12.130730+0000","last_peered":"2024-09-12T17:58:12.130730+0000","last_clean":"2024-09-12T17:58:12.130730+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T17:58:12.130730+0000","last_undegraded":"2024-09-12T17:58:12.130730+0000","last_fullsized":"2024-09-12T17:58:12.130730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:35.152406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'231","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.045674+0000","last_change":"2024-09-12T17:21:56.763924+0000","last_active":"2024-09-12T18:01:05.045674+0000","last_peered":"2024-09-12T18:01:05.045674+0000","last_clean":"2024-09-12T18:01:05.045674+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T18:01:05.045674+0000","last_undegraded":"2024-09-12T18:01:05.045674+0000","last_fullsized":"2024-09-12T18:01:05.045674+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.766828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":330,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.010097+0000","last_change":"2024-09-12T17:21:58.790322+0000","last_active":"2024-09-12T17:57:02.010097+0000","last_peered":"2024-09-12T17:57:02.010097+0000","last_clean":"2024-09-12T17:57:02.010097+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T17:57:02.010097+0000","last_undegraded":"2024-09-12T17:57:02.010097+0000","last_fullsized":"2024-09-12T17:57:02.010097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:02.075930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'218","reported_seq":1317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.414101+0000","last_change":"2024-09-12T17:22:00.798392+0000","last_active":"2024-09-12T17:59:33.414101+0000","last_peered":"2024-09-12T17:59:33.414101+0000","last_clean":"2024-09-12T17:59:33.414101+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T17:59:33.414101+0000","last_undegraded":"2024-09-12T17:59:33.414101+0000","last_fullsized":"2024-09-12T17:59:33.414101+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:00.108534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012393+0000","last_change":"2024-09-12T17:21:52.737742+0000","last_active":"2024-09-12T17:59:19.012393+0000","last_peered":"2024-09-12T17:59:19.012393+0000","last_clean":"2024-09-12T17:59:19.012393+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T17:59:19.012393+0000","last_undegraded":"2024-09-12T17:59:19.012393+0000","last_fullsized":"2024-09-12T17:59:19.012393+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:14.225738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'354","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.288043+0000","last_change":"2024-09-12T17:21:50.755052+0000","last_active":"2024-09-12T18:01:05.288043+0000","last_peered":"2024-09-12T18:01:05.288043+0000","last_clean":"2024-09-12T18:01:05.288043+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:05.288043+0000","last_undegraded":"2024-09-12T18:01:05.288043+0000","last_fullsized":"2024-09-12T18:01:05.288043+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:25.454728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3457436,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":16565,"num_write":1099,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.022475+0000","last_change":"2024-09-12T17:21:54.758914+0000","last_active":"2024-09-12T17:58:22.022475+0000","last_peered":"2024-09-12T17:58:22.022475+0000","last_clean":"2024-09-12T17:58:22.022475+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T17:58:22.022475+0000","last_undegraded":"2024-09-12T17:58:22.022475+0000","last_fullsized":"2024-09-12T17:58:22.022475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:37.175631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'293","reported_seq":871,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.263987+0000","last_change":"2024-09-12T17:21:56.770020+0000","last_active":"2024-09-12T18:01:05.263987+0000","last_peered":"2024-09-12T18:01:05.263987+0000","last_clean":"2024-09-12T18:01:05.263987+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T18:01:05.263987+0000","last_undegraded":"2024-09-12T18:01:05.263987+0000","last_fullsized":"2024-09-12T18:01:05.263987+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:51.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1131,"num_write":404,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009822+0000","last_change":"2024-09-12T17:21:58.782815+0000","last_active":"2024-09-12T17:57:02.009822+0000","last_peered":"2024-09-12T17:57:02.009822+0000","last_clean":"2024-09-12T17:57:02.009822+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T17:57:02.009822+0000","last_undegraded":"2024-09-12T17:57:02.009822+0000","last_fullsized":"2024-09-12T17:57:02.009822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:12.520411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'136","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998151+0000","last_change":"2024-09-12T17:22:00.796520+0000","last_active":"2024-09-12T18:00:54.998151+0000","last_peered":"2024-09-12T18:00:54.998151+0000","last_clean":"2024-09-12T18:00:54.998151+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:00:54.998151+0000","last_undegraded":"2024-09-12T18:00:54.998151+0000","last_fullsized":"2024-09-12T18:00:54.998151+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:43.432009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'777","reported_seq":2423,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.774914+0000","last_change":"2024-09-12T17:21:52.742859+0000","last_active":"2024-09-12T17:59:18.774914+0000","last_peered":"2024-09-12T17:59:18.774914+0000","last_clean":"2024-09-12T17:59:18.774914+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T17:59:18.774914+0000","last_undegraded":"2024-09-12T17:59:18.774914+0000","last_fullsized":"2024-09-12T17:59:18.774914+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:32.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'369","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.208109+0000","last_change":"2024-09-12T17:21:50.764860+0000","last_active":"2024-09-12T18:01:05.208109+0000","last_peered":"2024-09-12T18:01:05.208109+0000","last_clean":"2024-09-12T18:01:05.208109+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T18:01:05.208109+0000","last_undegraded":"2024-09-12T18:01:05.208109+0000","last_fullsized":"2024-09-12T18:01:05.208109+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:29.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6259488,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":161127,"num_write":1137,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'469","reported_seq":1778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.129978+0000","last_change":"2024-09-12T17:21:52.753034+0000","last_active":"2024-09-12T17:59:18.129978+0000","last_peered":"2024-09-12T17:59:18.129978+0000","last_clean":"2024-09-12T17:59:18.129978+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T17:59:18.129978+0000","last_undegraded":"2024-09-12T17:59:18.129978+0000","last_fullsized":"2024-09-12T17:59:18.129978+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.231475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'445","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.304126+0000","last_change":"2024-09-12T17:21:50.763558+0000","last_active":"2024-09-12T18:01:05.304126+0000","last_peered":"2024-09-12T18:01:05.304126+0000","last_clean":"2024-09-12T18:01:05.304126+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T18:01:05.304126+0000","last_undegraded":"2024-09-12T18:01:05.304126+0000","last_fullsized":"2024-09-12T18:01:05.304126+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:23.906686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190265,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":23221,"num_write":1306,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'804","reported_seq":2433,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.260815+0000","last_change":"2024-09-12T17:21:52.750129+0000","last_active":"2024-09-12T17:59:12.260815+0000","last_peered":"2024-09-12T17:59:12.260815+0000","last_clean":"2024-09-12T17:59:12.260815+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T17:59:12.260815+0000","last_undegraded":"2024-09-12T17:59:12.260815+0000","last_fullsized":"2024-09-12T17:59:12.260815+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.542955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'376","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.306364+0000","last_change":"2024-09-12T17:21:50.764053+0000","last_active":"2024-09-12T18:01:05.306364+0000","last_peered":"2024-09-12T18:01:05.306364+0000","last_clean":"2024-09-12T18:01:05.306364+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T18:01:05.306364+0000","last_undegraded":"2024-09-12T18:01:05.306364+0000","last_fullsized":"2024-09-12T18:01:05.306364+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.510424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":33088,"num_write":1180,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'920","reported_seq":2559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390034+0000","last_change":"2024-09-12T17:21:52.751702+0000","last_active":"2024-09-12T17:59:16.390034+0000","last_peered":"2024-09-12T17:59:16.390034+0000","last_clean":"2024-09-12T17:59:16.390034+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T17:59:16.390034+0000","last_undegraded":"2024-09-12T17:59:16.390034+0000","last_fullsized":"2024-09-12T17:59:16.390034+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.873565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'403","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.235854+0000","last_change":"2024-09-12T17:21:50.769742+0000","last_active":"2024-09-12T18:01:05.235854+0000","last_peered":"2024-09-12T18:01:05.235854+0000","last_clean":"2024-09-12T18:01:05.235854+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:05.235854+0000","last_undegraded":"2024-09-12T18:01:05.235854+0000","last_fullsized":"2024-09-12T18:01:05.235854+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:23.762144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254923,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":28930,"num_write":1343,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'501","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.635643+0000","last_change":"2024-09-12T17:21:52.750068+0000","last_active":"2024-09-12T17:59:15.635643+0000","last_peered":"2024-09-12T17:59:15.635643+0000","last_clean":"2024-09-12T17:59:15.635643+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T17:59:15.635643+0000","last_undegraded":"2024-09-12T17:59:15.635643+0000","last_fullsized":"2024-09-12T17:59:15.635643+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:42.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'354","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.226803+0000","last_change":"2024-09-12T17:21:50.777506+0000","last_active":"2024-09-12T18:01:05.226803+0000","last_peered":"2024-09-12T18:01:05.226803+0000","last_clean":"2024-09-12T18:01:05.226803+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T18:01:05.226803+0000","last_undegraded":"2024-09-12T18:01:05.226803+0000","last_fullsized":"2024-09-12T18:01:05.226803+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.155150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":85437,"num_write":1070,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'462","reported_seq":1955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.357110+0000","last_change":"2024-09-12T17:21:52.747550+0000","last_active":"2024-09-12T17:59:34.357110+0000","last_peered":"2024-09-12T17:59:34.357110+0000","last_clean":"2024-09-12T17:59:34.357110+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T17:59:34.357110+0000","last_undegraded":"2024-09-12T17:59:34.357110+0000","last_fullsized":"2024-09-12T17:59:34.357110+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.595623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'299","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.270555+0000","last_change":"2024-09-12T17:21:50.777489+0000","last_active":"2024-09-12T18:01:05.270555+0000","last_peered":"2024-09-12T18:01:05.270555+0000","last_clean":"2024-09-12T18:01:05.270555+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T18:01:05.270555+0000","last_undegraded":"2024-09-12T18:01:05.270555+0000","last_fullsized":"2024-09-12T18:01:05.270555+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:18.905928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830346,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":83513,"num_write":1029,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'599","reported_seq":2270,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501171+0000","last_change":"2024-09-12T17:21:52.754098+0000","last_active":"2024-09-12T17:59:18.501171+0000","last_peered":"2024-09-12T17:59:18.501171+0000","last_clean":"2024-09-12T17:59:18.501171+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T17:59:18.501171+0000","last_undegraded":"2024-09-12T17:59:18.501171+0000","last_fullsized":"2024-09-12T17:59:18.501171+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:19.357268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'349","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.276032+0000","last_change":"2024-09-12T17:21:50.769098+0000","last_active":"2024-09-12T18:01:05.276032+0000","last_peered":"2024-09-12T18:01:05.276032+0000","last_clean":"2024-09-12T18:01:05.276032+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T18:01:05.276032+0000","last_undegraded":"2024-09-12T18:01:05.276032+0000","last_fullsized":"2024-09-12T18:01:05.276032+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:09.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190292,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":100979,"num_write":1090,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'365","reported_seq":1816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001710+0000","last_change":"2024-09-12T17:21:52.752509+0000","last_active":"2024-09-12T18:00:55.001710+0000","last_peered":"2024-09-12T18:00:55.001710+0000","last_clean":"2024-09-12T18:00:55.001710+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:00:55.001710+0000","last_undegraded":"2024-09-12T18:00:55.001710+0000","last_fullsized":"2024-09-12T18:00:55.001710+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:29.192100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'356","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.200648+0000","last_change":"2024-09-12T17:21:50.771358+0000","last_active":"2024-09-12T18:01:05.200648+0000","last_peered":"2024-09-12T18:01:05.200648+0000","last_clean":"2024-09-12T18:01:05.200648+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:05.200648+0000","last_undegraded":"2024-09-12T18:01:05.200648+0000","last_fullsized":"2024-09-12T18:01:05.200648+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:36.115502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262264,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":460,"num_read_kb":5744,"num_write":1173,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'855","reported_seq":2396,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.001101+0000","last_change":"2024-09-12T17:21:52.755007+0000","last_active":"2024-09-12T18:00:55.001101+0000","last_peered":"2024-09-12T18:00:55.001101+0000","last_clean":"2024-09-12T18:00:55.001101+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:00:55.001101+0000","last_undegraded":"2024-09-12T18:00:55.001101+0000","last_fullsized":"2024-09-12T18:00:55.001101+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:26.620534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'380","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.142088+0000","last_change":"2024-09-12T17:21:50.766664+0000","last_active":"2024-09-12T18:01:05.142088+0000","last_peered":"2024-09-12T18:01:05.142088+0000","last_clean":"2024-09-12T18:01:05.142088+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T18:01:05.142088+0000","last_undegraded":"2024-09-12T18:01:05.142088+0000","last_fullsized":"2024-09-12T18:01:05.142088+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:36.008036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49301,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":612,"num_read_kb":751,"num_write":1265,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'635","reported_seq":2038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.382860+0000","last_change":"2024-09-12T17:21:52.752393+0000","last_active":"2024-09-12T17:59:16.382860+0000","last_peered":"2024-09-12T17:59:16.382860+0000","last_clean":"2024-09-12T17:59:16.382860+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T17:59:16.382860+0000","last_undegraded":"2024-09-12T17:59:16.382860+0000","last_fullsized":"2024-09-12T17:59:16.382860+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:35.883929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'374","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.202555+0000","last_change":"2024-09-12T17:21:50.769891+0000","last_active":"2024-09-12T18:01:05.202555+0000","last_peered":"2024-09-12T18:01:05.202555+0000","last_clean":"2024-09-12T18:01:05.202555+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:05.202555+0000","last_undegraded":"2024-09-12T18:01:05.202555+0000","last_fullsized":"2024-09-12T18:01:05.202555+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:44.325817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190224,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":620,"num_read_kb":17255,"num_write":1152,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'557","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769742+0000","last_change":"2024-09-12T17:21:52.754609+0000","last_active":"2024-09-12T17:59:34.769742+0000","last_peered":"2024-09-12T17:59:34.769742+0000","last_clean":"2024-09-12T17:59:34.769742+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T17:59:34.769742+0000","last_undegraded":"2024-09-12T17:59:34.769742+0000","last_fullsized":"2024-09-12T17:59:34.769742+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.921162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'365","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.281093+0000","last_change":"2024-09-12T17:22:26.299370+0000","last_active":"2024-09-12T18:01:05.281093+0000","last_peered":"2024-09-12T18:01:05.281093+0000","last_clean":"2024-09-12T18:01:05.281093+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:01:05.281093+0000","last_undegraded":"2024-09-12T18:01:05.281093+0000","last_fullsized":"2024-09-12T18:01:05.281093+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.880431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":563,"num_read_kb":8561,"num_write":1187,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'553","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.999194+0000","last_change":"2024-09-12T17:21:52.749942+0000","last_active":"2024-09-12T18:00:54.999194+0000","last_peered":"2024-09-12T18:00:54.999194+0000","last_clean":"2024-09-12T18:00:54.999194+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:00:54.999194+0000","last_undegraded":"2024-09-12T18:00:54.999194+0000","last_fullsized":"2024-09-12T18:00:54.999194+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:15.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'316","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.276441+0000","last_change":"2024-09-12T17:21:50.758098+0000","last_active":"2024-09-12T18:01:05.276441+0000","last_peered":"2024-09-12T18:01:05.276441+0000","last_clean":"2024-09-12T18:01:05.276441+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T18:01:05.276441+0000","last_undegraded":"2024-09-12T18:01:05.276441+0000","last_fullsized":"2024-09-12T18:01:05.276441+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:44.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":7270,"num_write":974,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'495","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.012334+0000","last_change":"2024-09-12T17:21:52.755013+0000","last_active":"2024-09-12T17:59:19.012334+0000","last_peered":"2024-09-12T17:59:19.012334+0000","last_clean":"2024-09-12T17:59:19.012334+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T17:59:19.012334+0000","last_undegraded":"2024-09-12T17:59:19.012334+0000","last_fullsized":"2024-09-12T17:59:19.012334+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:03.543775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'365","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.248464+0000","last_change":"2024-09-12T17:21:50.785028+0000","last_active":"2024-09-12T18:01:05.248464+0000","last_peered":"2024-09-12T18:01:05.248464+0000","last_clean":"2024-09-12T18:01:05.248464+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T18:01:05.248464+0000","last_undegraded":"2024-09-12T18:01:05.248464+0000","last_fullsized":"2024-09-12T18:01:05.248464+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:11.230359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":1811,"num_write":1218,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'757","reported_seq":2524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.365262+0000","last_change":"2024-09-12T17:21:52.751189+0000","last_active":"2024-09-12T17:59:34.365262+0000","last_peered":"2024-09-12T17:59:34.365262+0000","last_clean":"2024-09-12T17:59:34.365262+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T17:59:34.365262+0000","last_undegraded":"2024-09-12T17:59:34.365262+0000","last_fullsized":"2024-09-12T17:59:34.365262+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:44.765214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'339","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.253920+0000","last_change":"2024-09-12T17:21:50.764846+0000","last_active":"2024-09-12T18:01:05.253920+0000","last_peered":"2024-09-12T18:01:05.253920+0000","last_clean":"2024-09-12T18:01:05.253920+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:01:05.253920+0000","last_undegraded":"2024-09-12T18:01:05.253920+0000","last_fullsized":"2024-09-12T18:01:05.253920+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:23.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2223469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":11534,"num_write":1063,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1313","reported_seq":3051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.197533+0000","last_change":"2024-09-12T17:21:52.750173+0000","last_active":"2024-09-12T17:59:17.197533+0000","last_peered":"2024-09-12T17:59:17.197533+0000","last_clean":"2024-09-12T17:59:17.197533+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T17:59:17.197533+0000","last_undegraded":"2024-09-12T17:59:17.197533+0000","last_fullsized":"2024-09-12T17:59:17.197533+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:57.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'431","reported_seq":1155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.243070+0000","last_change":"2024-09-12T17:21:50.770800+0000","last_active":"2024-09-12T18:01:05.243070+0000","last_peered":"2024-09-12T18:01:05.243070+0000","last_clean":"2024-09-12T18:01:05.243070+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T18:01:05.243070+0000","last_undegraded":"2024-09-12T18:01:05.243070+0000","last_fullsized":"2024-09-12T18:01:05.243070+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:32.517729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":12654,"num_write":1335,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'850","reported_seq":2463,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.521273+0000","last_change":"2024-09-12T17:21:52.755424+0000","last_active":"2024-09-12T17:59:17.521273+0000","last_peered":"2024-09-12T17:59:17.521273+0000","last_clean":"2024-09-12T17:59:17.521273+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T17:59:17.521273+0000","last_undegraded":"2024-09-12T17:59:17.521273+0000","last_fullsized":"2024-09-12T17:59:17.521273+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:30.408737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'405","reported_seq":1089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.286639+0000","last_change":"2024-09-12T17:21:50.770612+0000","last_active":"2024-09-12T18:01:05.286639+0000","last_peered":"2024-09-12T18:01:05.286639+0000","last_clean":"2024-09-12T18:01:05.286639+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T18:01:05.286639+0000","last_undegraded":"2024-09-12T18:01:05.286639+0000","last_fullsized":"2024-09-12T18:01:05.286639+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:10.767250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111016,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":21305,"num_write":1293,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.285638+0000","last_change":"2024-09-12T17:21:50.765427+0000","last_active":"2024-09-12T18:01:05.285638+0000","last_peered":"2024-09-12T18:01:05.285638+0000","last_clean":"2024-09-12T18:01:05.285638+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T18:01:05.285638+0000","last_undegraded":"2024-09-12T18:01:05.285638+0000","last_fullsized":"2024-09-12T18:01:05.285638+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:49.438329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":645,"num_read_kb":38619,"num_write":1146,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'583","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.770082+0000","last_change":"2024-09-12T17:21:52.755082+0000","last_active":"2024-09-12T17:59:34.770082+0000","last_peered":"2024-09-12T17:59:34.770082+0000","last_clean":"2024-09-12T17:59:34.770082+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T17:59:34.770082+0000","last_undegraded":"2024-09-12T17:59:34.770082+0000","last_fullsized":"2024-09-12T17:59:34.770082+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:39.922432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.326279+0000","last_change":"2024-09-12T17:21:50.771898+0000","last_active":"2024-09-12T18:01:05.326279+0000","last_peered":"2024-09-12T18:01:05.326279+0000","last_clean":"2024-09-12T18:01:05.326279+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:05.326279+0000","last_undegraded":"2024-09-12T18:01:05.326279+0000","last_fullsized":"2024-09-12T18:01:05.326279+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:49.722984+0000","last_clean_scrub_stamp":"2024-09-12T17:21:49.722984+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.573435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364838,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":51644,"num_write":1154,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'402","reported_seq":1963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.170642+0000","last_change":"2024-09-12T17:21:52.745958+0000","last_active":"2024-09-12T17:59:16.170642+0000","last_peered":"2024-09-12T17:59:16.170642+0000","last_clean":"2024-09-12T17:59:16.170642+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T17:59:16.170642+0000","last_undegraded":"2024-09-12T17:59:16.170642+0000","last_fullsized":"2024-09-12T17:59:16.170642+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:44.648792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1647,"ondisk_log_size":1647,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553896,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16885,"num_read_kb":36225,"num_write":14143,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2052,"ondisk_log_size":2052,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2878,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3984,"ondisk_log_size":3984,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83193324,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":36148,"num_read_kb":1816228,"num_write":72592,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113262592,"data_stored":113262592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3606,"ondisk_log_size":3606,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":163167,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":167173,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477216,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286236,"kb_used_data":20276,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94085604,"statfs":{"total":96636764160,"available":96343658496,"internally_reserved":0,"allocated":20762624,"data_stored":18763428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509921,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134088,"kb_used_data":17872,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94237752,"statfs":{"total":96636764160,"available":96499458048,"internally_reserved":0,"allocated":18300928,"data_stored":16277974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":118618566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509919,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245416,"kb_used_data":15680,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94126424,"statfs":{"total":96636764160,"available":96385458176,"internally_reserved":0,"allocated":16056320,"data_stored":14054405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509920,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268512,"kb_used_data":20576,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94103328,"statfs":{"total":96636764160,"available":96361807872,"internally_reserved":0,"allocated":21069824,"data_stored":19072665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509922,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161068,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94210772,"statfs":{"total":96636764160,"available":96471830528,"internally_reserved":0,"allocated":21983232,"data_stored":19991308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509921,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342636,"kb_used_data":14216,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94029204,"statfs":{"total":96636764160,"available":96285904896,"internally_reserved":0,"allocated":14557184,"data_stored":12561929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509920,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146660,"kb_used_data":20944,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94225180,"statfs":{"total":96636764160,"available":96486584320,"internally_reserved":0,"allocated":21446656,"data_stored":19447593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575329,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265880,"kb_used_data":13776,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94105960,"statfs":{"total":96636764160,"available":96364503040,"internally_reserved":0,"allocated":14106624,"data_stored":12126360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17215488,"data_stored":17215488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9740288,"data_stored":9740288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17760256,"data_stored":17760256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16842752,"data_stored":16842752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11821056,"data_stored":11821056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15941632,"data_stored":15941632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":9895936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:12.119 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.119 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.119 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.119 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.120 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.121 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.121 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.121 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.121 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.121 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.121 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.121 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.122 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.123 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.124 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.125 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.126 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.127 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.128 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.129 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.130 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.131 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.132 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.133 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.134 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.135 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.136 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.137 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.138 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.139 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.140 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.141 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.142 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.143 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.144 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:21:32.756341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.145 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.146 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.147 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.148 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.149 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.149 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.149 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.149 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.149 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.149 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.149 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.150 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.150 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.150 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.150 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.151 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.151 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.151 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.151 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.151 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.152 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.152 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.152 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.152 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:21:38.839971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.152 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.153 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.153 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.153 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.153 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.153 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.153 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.153 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.154 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.155 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.156 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.157 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.157 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.157 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.157 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.160 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.161 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.162 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.163 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.164 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.165 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.166 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.167 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.168 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.168 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.168 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.168 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.168 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:21:49.722984+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.168 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:12.168 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:01:32.169 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:01:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:01:32.538 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1459,"stamp":"2024-09-12T18:01:31.145687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85355269,"num_objects":842,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":842,"num_whiteouts":0,"num_read":290229,"num_read_kb":2399744,"num_write":161152,"num_write_kb":2366967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55400,"num_omap_keys":201,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13522,"ondisk_log_size":13522,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1849064,"kb_used_data":144808,"kb_used_omap":12,"kb_used_meta":1704115,"kb_avail":753125656,"statfs":{"total":773094113280,"available":771200671744,"internally_reserved":0,"allocated":148283392,"data_stored":132295662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1745014320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":54033,"num_omap_keys":195,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006135"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013121+0000","last_change":"2024-09-12T17:49:56.045663+0000","last_active":"2024-09-12T17:57:27.013121+0000","last_peered":"2024-09-12T17:57:27.013121+0000","last_clean":"2024-09-12T17:57:27.013121+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T17:57:27.013121+0000","last_undegraded":"2024-09-12T17:57:27.013121+0000","last_fullsized":"2024-09-12T17:57:27.013121+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:17.001669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.134679+0000","last_change":"2024-09-12T17:38:47.032756+0000","last_active":"2024-09-12T17:58:47.134679+0000","last_peered":"2024-09-12T17:58:47.134679+0000","last_clean":"2024-09-12T17:58:47.134679+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T17:58:47.134679+0000","last_undegraded":"2024-09-12T17:58:47.134679+0000","last_fullsized":"2024-09-12T17:58:47.134679+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144138+0000","last_change":"2024-09-12T17:38:43.996174+0000","last_active":"2024-09-12T17:58:45.144138+0000","last_peered":"2024-09-12T17:58:45.144138+0000","last_clean":"2024-09-12T17:58:45.144138+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T17:58:45.144138+0000","last_undegraded":"2024-09-12T17:58:45.144138+0000","last_fullsized":"2024-09-12T17:58:45.144138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.019082+0000","last_change":"2024-09-12T17:37:08.657434+0000","last_active":"2024-09-12T17:58:02.019082+0000","last_peered":"2024-09-12T17:58:02.019082+0000","last_clean":"2024-09-12T17:58:02.019082+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T17:58:02.019082+0000","last_undegraded":"2024-09-12T17:58:02.019082+0000","last_fullsized":"2024-09-12T17:58:02.019082+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.018613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128952+0000","last_change":"2024-09-12T17:49:56.047260+0000","last_active":"2024-09-12T17:57:27.128952+0000","last_peered":"2024-09-12T17:57:27.128952+0000","last_clean":"2024-09-12T17:57:27.128952+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T17:57:27.128952+0000","last_undegraded":"2024-09-12T17:57:27.128952+0000","last_fullsized":"2024-09-12T17:57:27.128952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:13.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.174453+0000","last_change":"2024-09-12T17:38:47.032526+0000","last_active":"2024-09-12T17:58:47.174453+0000","last_peered":"2024-09-12T17:58:47.174453+0000","last_clean":"2024-09-12T17:58:47.174453+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T17:58:47.174453+0000","last_undegraded":"2024-09-12T17:58:47.174453+0000","last_fullsized":"2024-09-12T17:58:47.174453+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.295744+0000","last_change":"2024-09-12T17:38:43.991731+0000","last_active":"2024-09-12T18:01:04.295744+0000","last_peered":"2024-09-12T18:01:04.295744+0000","last_clean":"2024-09-12T18:01:04.295744+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T18:01:04.295744+0000","last_undegraded":"2024-09-12T18:01:04.295744+0000","last_fullsized":"2024-09-12T18:01:04.295744+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4142,"num_write":12,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.028749+0000","last_change":"2024-09-12T17:37:08.650147+0000","last_active":"2024-09-12T17:59:17.028749+0000","last_peered":"2024-09-12T17:59:17.028749+0000","last_clean":"2024-09-12T17:59:17.028749+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T17:59:17.028749+0000","last_undegraded":"2024-09-12T17:59:17.028749+0000","last_fullsized":"2024-09-12T17:59:17.028749+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.122054+0000","last_change":"2024-09-12T17:49:56.046643+0000","last_active":"2024-09-12T17:57:12.122054+0000","last_peered":"2024-09-12T17:57:12.122054+0000","last_clean":"2024-09-12T17:57:12.122054+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T17:57:12.122054+0000","last_undegraded":"2024-09-12T17:57:12.122054+0000","last_fullsized":"2024-09-12T17:57:12.122054+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.487756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.146055+0000","last_change":"2024-09-12T17:38:47.027090+0000","last_active":"2024-09-12T17:59:38.146055+0000","last_peered":"2024-09-12T17:59:38.146055+0000","last_clean":"2024-09-12T17:59:38.146055+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T17:59:38.146055+0000","last_undegraded":"2024-09-12T17:59:38.146055+0000","last_fullsized":"2024-09-12T17:59:38.146055+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:21.352493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:45.162497+0000","last_change":"2024-09-12T17:38:43.992601+0000","last_active":"2024-09-12T18:00:45.162497+0000","last_peered":"2024-09-12T18:00:45.162497+0000","last_clean":"2024-09-12T18:00:45.162497+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T18:00:45.162497+0000","last_undegraded":"2024-09-12T18:00:45.162497+0000","last_fullsized":"2024-09-12T18:00:45.162497+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:05.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":243,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.266547+0000","last_change":"2024-09-12T17:37:08.657551+0000","last_active":"2024-09-12T17:59:07.266547+0000","last_peered":"2024-09-12T17:59:07.266547+0000","last_clean":"2024-09-12T17:59:07.266547+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T17:59:07.266547+0000","last_undegraded":"2024-09-12T17:59:07.266547+0000","last_fullsized":"2024-09-12T17:59:07.266547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:01.832274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:18.125196+0000","last_change":"2024-09-12T17:49:56.040426+0000","last_active":"2024-09-12T17:57:18.125196+0000","last_peered":"2024-09-12T17:57:18.125196+0000","last_clean":"2024-09-12T17:57:18.125196+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T17:57:18.125196+0000","last_undegraded":"2024-09-12T17:57:18.125196+0000","last_fullsized":"2024-09-12T17:57:18.125196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:54.760400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:53.157749+0000","last_change":"2024-09-12T17:38:47.027638+0000","last_active":"2024-09-12T18:00:53.157749+0000","last_peered":"2024-09-12T18:00:53.157749+0000","last_clean":"2024-09-12T18:00:53.157749+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T18:00:53.157749+0000","last_undegraded":"2024-09-12T18:00:53.157749+0000","last_fullsized":"2024-09-12T18:00:53.157749+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:43.893874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.223106+0000","last_change":"2024-09-12T17:38:43.990788+0000","last_active":"2024-09-12T18:01:04.223106+0000","last_peered":"2024-09-12T18:01:04.223106+0000","last_clean":"2024-09-12T18:01:04.223106+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T18:01:04.223106+0000","last_undegraded":"2024-09-12T18:01:04.223106+0000","last_fullsized":"2024-09-12T18:01:04.223106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:59.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14340,"num_write":8,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126674+0000","last_change":"2024-09-12T17:37:08.653015+0000","last_active":"2024-09-12T17:57:12.126674+0000","last_peered":"2024-09-12T17:57:12.126674+0000","last_clean":"2024-09-12T17:57:12.126674+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T17:57:12.126674+0000","last_undegraded":"2024-09-12T17:57:12.126674+0000","last_fullsized":"2024-09-12T17:57:12.126674+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:29.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137509+0000","last_change":"2024-09-12T17:49:56.043841+0000","last_active":"2024-09-12T17:57:55.137509+0000","last_peered":"2024-09-12T17:57:55.137509+0000","last_clean":"2024-09-12T17:57:55.137509+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T17:57:55.137509+0000","last_undegraded":"2024-09-12T17:57:55.137509+0000","last_fullsized":"2024-09-12T17:57:55.137509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:54.316816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.019362+0000","last_change":"2024-09-12T17:38:47.020351+0000","last_active":"2024-09-12T17:58:12.019362+0000","last_peered":"2024-09-12T17:58:12.019362+0000","last_clean":"2024-09-12T17:58:12.019362+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T17:58:12.019362+0000","last_undegraded":"2024-09-12T17:58:12.019362+0000","last_fullsized":"2024-09-12T17:58:12.019362+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:50.384206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132353+0000","last_change":"2024-09-12T17:38:43.991420+0000","last_active":"2024-09-12T17:58:03.132353+0000","last_peered":"2024-09-12T17:58:03.132353+0000","last_clean":"2024-09-12T17:58:03.132353+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T17:58:03.132353+0000","last_undegraded":"2024-09-12T17:58:03.132353+0000","last_fullsized":"2024-09-12T17:58:03.132353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126614+0000","last_change":"2024-09-12T17:37:08.656898+0000","last_active":"2024-09-12T17:57:12.126614+0000","last_peered":"2024-09-12T17:57:12.126614+0000","last_clean":"2024-09-12T17:57:12.126614+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T17:57:12.126614+0000","last_undegraded":"2024-09-12T17:57:12.126614+0000","last_fullsized":"2024-09-12T17:57:12.126614+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:09.179411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.022015+0000","last_change":"2024-09-12T17:49:56.038230+0000","last_active":"2024-09-12T17:58:17.022015+0000","last_peered":"2024-09-12T17:58:17.022015+0000","last_clean":"2024-09-12T17:58:17.022015+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T17:58:17.022015+0000","last_undegraded":"2024-09-12T17:58:17.022015+0000","last_fullsized":"2024-09-12T17:58:17.022015+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:01.328505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:32.038446+0000","last_change":"2024-09-12T17:38:47.024390+0000","last_active":"2024-09-12T18:00:32.038446+0000","last_peered":"2024-09-12T18:00:32.038446+0000","last_clean":"2024-09-12T18:00:32.038446+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T18:00:32.038446+0000","last_undegraded":"2024-09-12T18:00:32.038446+0000","last_fullsized":"2024-09-12T18:00:32.038446+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:38.074041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020049+0000","last_change":"2024-09-12T17:38:43.992661+0000","last_active":"2024-09-12T17:58:12.020049+0000","last_peered":"2024-09-12T17:58:12.020049+0000","last_clean":"2024-09-12T17:58:12.020049+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T17:58:12.020049+0000","last_undegraded":"2024-09-12T17:58:12.020049+0000","last_fullsized":"2024-09-12T17:58:12.020049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:23.126019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.118389+0000","last_change":"2024-09-12T17:37:08.657360+0000","last_active":"2024-09-12T17:58:29.118389+0000","last_peered":"2024-09-12T17:58:29.118389+0000","last_clean":"2024-09-12T17:58:29.118389+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T17:58:29.118389+0000","last_undegraded":"2024-09-12T17:58:29.118389+0000","last_fullsized":"2024-09-12T17:58:29.118389+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:37.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164252+0000","last_change":"2024-09-12T17:49:56.045176+0000","last_active":"2024-09-12T17:57:27.164252+0000","last_peered":"2024-09-12T17:57:27.164252+0000","last_clean":"2024-09-12T17:57:27.164252+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T17:57:27.164252+0000","last_undegraded":"2024-09-12T17:57:27.164252+0000","last_fullsized":"2024-09-12T17:57:27.164252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:33.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.174437+0000","last_change":"2024-09-12T17:38:47.030932+0000","last_active":"2024-09-12T17:58:47.174437+0000","last_peered":"2024-09-12T17:58:47.174437+0000","last_clean":"2024-09-12T17:58:47.174437+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T17:58:47.174437+0000","last_undegraded":"2024-09-12T17:58:47.174437+0000","last_fullsized":"2024-09-12T17:58:47.174437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.141215+0000","last_change":"2024-09-12T17:38:43.994843+0000","last_active":"2024-09-12T18:01:04.141215+0000","last_peered":"2024-09-12T18:01:04.141215+0000","last_clean":"2024-09-12T18:01:04.141215+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T18:01:04.141215+0000","last_undegraded":"2024-09-12T18:01:04.141215+0000","last_fullsized":"2024-09-12T18:01:04.141215+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:55.145586+0000","last_change":"2024-09-12T17:37:08.654696+0000","last_active":"2024-09-12T17:58:55.145586+0000","last_peered":"2024-09-12T17:58:55.145586+0000","last_clean":"2024-09-12T17:58:55.145586+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T17:58:55.145586+0000","last_undegraded":"2024-09-12T17:58:55.145586+0000","last_fullsized":"2024-09-12T17:58:55.145586+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013188+0000","last_change":"2024-09-12T17:49:56.044511+0000","last_active":"2024-09-12T17:57:27.013188+0000","last_peered":"2024-09-12T17:57:27.013188+0000","last_clean":"2024-09-12T17:57:27.013188+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T17:57:27.013188+0000","last_undegraded":"2024-09-12T17:57:27.013188+0000","last_fullsized":"2024-09-12T17:57:27.013188+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:47.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'10","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.374733+0000","last_change":"2024-09-12T17:38:47.024321+0000","last_active":"2024-09-12T18:01:04.374733+0000","last_peered":"2024-09-12T18:01:04.374733+0000","last_clean":"2024-09-12T18:01:04.374733+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T18:01:04.374733+0000","last_undegraded":"2024-09-12T18:01:04.374733+0000","last_fullsized":"2024-09-12T18:01:04.374733+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13320,"num_write":20,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'10","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.140798+0000","last_change":"2024-09-12T17:38:43.990416+0000","last_active":"2024-09-12T18:01:04.140798+0000","last_peered":"2024-09-12T18:01:04.140798+0000","last_clean":"2024-09-12T18:01:04.140798+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T18:01:04.140798+0000","last_undegraded":"2024-09-12T18:01:04.140798+0000","last_fullsized":"2024-09-12T18:01:04.140798+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15362,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":192,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.140977+0000","last_change":"2024-09-12T17:37:08.660746+0000","last_active":"2024-09-12T17:58:57.140977+0000","last_peered":"2024-09-12T17:58:57.140977+0000","last_clean":"2024-09-12T17:58:57.140977+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T17:58:57.140977+0000","last_undegraded":"2024-09-12T17:58:57.140977+0000","last_fullsized":"2024-09-12T17:58:57.140977+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.121922+0000","last_change":"2024-09-12T17:49:56.044578+0000","last_active":"2024-09-12T17:56:58.121922+0000","last_peered":"2024-09-12T17:56:58.121922+0000","last_clean":"2024-09-12T17:56:58.121922+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T17:56:58.121922+0000","last_undegraded":"2024-09-12T17:56:58.121922+0000","last_fullsized":"2024-09-12T17:56:58.121922+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:59.881857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:35.161243+0000","last_change":"2024-09-12T17:38:47.024618+0000","last_active":"2024-09-12T18:00:35.161243+0000","last_peered":"2024-09-12T18:00:35.161243+0000","last_clean":"2024-09-12T18:00:35.161243+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T18:00:35.161243+0000","last_undegraded":"2024-09-12T18:00:35.161243+0000","last_fullsized":"2024-09-12T18:00:35.161243+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:49.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'11","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.522473+0000","last_change":"2024-09-12T17:38:43.991705+0000","last_active":"2024-09-12T18:01:03.522473+0000","last_peered":"2024-09-12T18:01:03.522473+0000","last_clean":"2024-09-12T18:01:03.522473+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T18:01:03.522473+0000","last_undegraded":"2024-09-12T18:01:03.522473+0000","last_fullsized":"2024-09-12T18:01:03.522473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.996078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4710,"num_write":16,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'113","reported_seq":389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.026603+0000","last_change":"2024-09-12T17:37:08.655763+0000","last_active":"2024-09-12T17:58:57.026603+0000","last_peered":"2024-09-12T17:58:57.026603+0000","last_clean":"2024-09-12T17:58:57.026603+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T17:58:57.026603+0000","last_undegraded":"2024-09-12T17:58:57.026603+0000","last_fullsized":"2024-09-12T17:58:57.026603+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124631+0000","last_change":"2024-09-12T17:49:56.034209+0000","last_active":"2024-09-12T17:56:57.124631+0000","last_peered":"2024-09-12T17:56:57.124631+0000","last_clean":"2024-09-12T17:56:57.124631+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T17:56:57.124631+0000","last_undegraded":"2024-09-12T17:56:57.124631+0000","last_fullsized":"2024-09-12T17:56:57.124631+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:11.559774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127870+0000","last_change":"2024-09-12T17:38:47.024189+0000","last_active":"2024-09-12T17:57:33.127870+0000","last_peered":"2024-09-12T17:57:33.127870+0000","last_clean":"2024-09-12T17:57:33.127870+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T17:57:33.127870+0000","last_undegraded":"2024-09-12T17:57:33.127870+0000","last_fullsized":"2024-09-12T17:57:33.127870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:12.716839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.018494+0000","last_change":"2024-09-12T17:38:43.995454+0000","last_active":"2024-09-12T17:58:07.018494+0000","last_peered":"2024-09-12T17:58:07.018494+0000","last_clean":"2024-09-12T17:58:07.018494+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T17:58:07.018494+0000","last_undegraded":"2024-09-12T17:58:07.018494+0000","last_fullsized":"2024-09-12T17:58:07.018494+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.026575+0000","last_change":"2024-09-12T17:37:08.650302+0000","last_active":"2024-09-12T17:58:57.026575+0000","last_peered":"2024-09-12T17:58:57.026575+0000","last_clean":"2024-09-12T17:58:57.026575+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T17:58:57.026575+0000","last_undegraded":"2024-09-12T17:58:57.026575+0000","last_fullsized":"2024-09-12T17:58:57.026575+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.159949+0000","last_change":"2024-09-12T17:49:56.037995+0000","last_active":"2024-09-12T17:56:57.159949+0000","last_peered":"2024-09-12T17:56:57.159949+0000","last_clean":"2024-09-12T17:56:57.159949+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T17:56:57.159949+0000","last_undegraded":"2024-09-12T17:56:57.159949+0000","last_fullsized":"2024-09-12T17:56:57.159949+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:04.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139871+0000","last_change":"2024-09-12T17:38:47.016476+0000","last_active":"2024-09-12T17:58:10.139871+0000","last_peered":"2024-09-12T17:58:10.139871+0000","last_clean":"2024-09-12T17:58:10.139871+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T17:58:10.139871+0000","last_undegraded":"2024-09-12T17:58:10.139871+0000","last_fullsized":"2024-09-12T17:58:10.139871+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:05.344871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'6","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.671791+0000","last_change":"2024-09-12T17:38:43.996222+0000","last_active":"2024-09-12T18:01:03.671791+0000","last_peered":"2024-09-12T18:01:03.671791+0000","last_clean":"2024-09-12T18:01:03.671791+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T18:01:03.671791+0000","last_undegraded":"2024-09-12T18:01:03.671791+0000","last_fullsized":"2024-09-12T18:01:03.671791+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:17.497778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:55.145682+0000","last_change":"2024-09-12T17:37:08.661473+0000","last_active":"2024-09-12T17:58:55.145682+0000","last_peered":"2024-09-12T17:58:55.145682+0000","last_clean":"2024-09-12T17:58:55.145682+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T17:58:55.145682+0000","last_undegraded":"2024-09-12T17:58:55.145682+0000","last_fullsized":"2024-09-12T17:58:55.145682+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.008878+0000","last_change":"2024-09-12T17:49:56.045356+0000","last_active":"2024-09-12T17:56:57.008878+0000","last_peered":"2024-09-12T17:56:57.008878+0000","last_clean":"2024-09-12T17:56:57.008878+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T17:56:57.008878+0000","last_undegraded":"2024-09-12T17:56:57.008878+0000","last_fullsized":"2024-09-12T17:56:57.008878+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:33.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:32.036641+0000","last_change":"2024-09-12T17:38:47.023380+0000","last_active":"2024-09-12T18:00:32.036641+0000","last_peered":"2024-09-12T18:00:32.036641+0000","last_clean":"2024-09-12T18:00:32.036641+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T18:00:32.036641+0000","last_undegraded":"2024-09-12T18:00:32.036641+0000","last_fullsized":"2024-09-12T18:00:32.036641+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.275074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132508+0000","last_change":"2024-09-12T17:38:43.989365+0000","last_active":"2024-09-12T17:58:03.132508+0000","last_peered":"2024-09-12T17:58:03.132508+0000","last_clean":"2024-09-12T17:58:03.132508+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T17:58:03.132508+0000","last_undegraded":"2024-09-12T17:58:03.132508+0000","last_fullsized":"2024-09-12T17:58:03.132508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:53.634008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020922+0000","last_change":"2024-09-12T17:37:08.651846+0000","last_active":"2024-09-12T17:58:17.020922+0000","last_peered":"2024-09-12T17:58:17.020922+0000","last_clean":"2024-09-12T17:58:17.020922+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T17:58:17.020922+0000","last_undegraded":"2024-09-12T17:58:17.020922+0000","last_fullsized":"2024-09-12T17:58:17.020922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:47.950299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:13.124363+0000","last_change":"2024-09-12T17:49:56.042508+0000","last_active":"2024-09-12T17:57:13.124363+0000","last_peered":"2024-09-12T17:57:13.124363+0000","last_clean":"2024-09-12T17:57:13.124363+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T17:57:13.124363+0000","last_undegraded":"2024-09-12T17:57:13.124363+0000","last_fullsized":"2024-09-12T17:57:13.124363+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:56.026526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.127091+0000","last_change":"2024-09-12T17:38:47.028439+0000","last_active":"2024-09-12T17:57:28.127091+0000","last_peered":"2024-09-12T17:57:28.127091+0000","last_clean":"2024-09-12T17:57:28.127091+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T17:57:28.127091+0000","last_undegraded":"2024-09-12T17:57:28.127091+0000","last_fullsized":"2024-09-12T17:57:28.127091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:40.113111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124185+0000","last_change":"2024-09-12T17:38:43.990984+0000","last_active":"2024-09-12T17:57:27.124185+0000","last_peered":"2024-09-12T17:57:27.124185+0000","last_clean":"2024-09-12T17:57:27.124185+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T17:57:27.124185+0000","last_undegraded":"2024-09-12T17:57:27.124185+0000","last_fullsized":"2024-09-12T17:57:27.124185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:55.979807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020118+0000","last_change":"2024-09-12T17:37:08.656056+0000","last_active":"2024-09-12T17:58:12.020118+0000","last_peered":"2024-09-12T17:58:12.020118+0000","last_clean":"2024-09-12T17:58:12.020118+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T17:58:12.020118+0000","last_undegraded":"2024-09-12T17:58:12.020118+0000","last_fullsized":"2024-09-12T17:58:12.020118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:45.733213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126727+0000","last_change":"2024-09-12T17:49:56.042525+0000","last_active":"2024-09-12T17:57:12.126727+0000","last_peered":"2024-09-12T17:57:12.126727+0000","last_clean":"2024-09-12T17:57:12.126727+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T17:57:12.126727+0000","last_undegraded":"2024-09-12T17:57:12.126727+0000","last_fullsized":"2024-09-12T17:57:12.126727+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:07.790123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'11","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.596225+0000","last_change":"2024-09-12T17:38:47.030812+0000","last_active":"2024-09-12T18:01:03.596225+0000","last_peered":"2024-09-12T18:01:03.596225+0000","last_clean":"2024-09-12T18:01:03.596225+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T18:01:03.596225+0000","last_undegraded":"2024-09-12T18:01:03.596225+0000","last_fullsized":"2024-09-12T18:01:03.596225+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:21.678813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10258,"num_write":16,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.126144+0000","last_change":"2024-09-12T17:38:43.987476+0000","last_active":"2024-09-12T17:57:23.126144+0000","last_peered":"2024-09-12T17:57:23.126144+0000","last_clean":"2024-09-12T17:57:23.126144+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T17:57:23.126144+0000","last_undegraded":"2024-09-12T17:57:23.126144+0000","last_fullsized":"2024-09-12T17:57:23.126144+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.672726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139794+0000","last_change":"2024-09-12T17:37:08.661575+0000","last_active":"2024-09-12T17:58:10.139794+0000","last_peered":"2024-09-12T17:58:10.139794+0000","last_clean":"2024-09-12T17:58:10.139794+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T17:58:10.139794+0000","last_undegraded":"2024-09-12T17:58:10.139794+0000","last_fullsized":"2024-09-12T17:58:10.139794+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:44.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009869+0000","last_change":"2024-09-12T17:49:56.037386+0000","last_active":"2024-09-12T17:57:02.009869+0000","last_peered":"2024-09-12T17:57:02.009869+0000","last_clean":"2024-09-12T17:57:02.009869+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T17:57:02.009869+0000","last_undegraded":"2024-09-12T17:57:02.009869+0000","last_fullsized":"2024-09-12T17:57:02.009869+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:00.713527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:30.133900+0000","last_change":"2024-09-12T17:38:47.022479+0000","last_active":"2024-09-12T17:57:30.133900+0000","last_peered":"2024-09-12T17:57:30.133900+0000","last_clean":"2024-09-12T17:57:30.133900+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T17:57:30.133900+0000","last_undegraded":"2024-09-12T17:57:30.133900+0000","last_fullsized":"2024-09-12T17:57:30.133900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:49.306337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:47.141971+0000","last_change":"2024-09-12T17:38:43.988889+0000","last_active":"2024-09-12T17:59:47.141971+0000","last_peered":"2024-09-12T17:59:47.141971+0000","last_clean":"2024-09-12T17:59:47.141971+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T17:59:47.141971+0000","last_undegraded":"2024-09-12T17:59:47.141971+0000","last_fullsized":"2024-09-12T17:59:47.141971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:26.795414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.170376+0000","last_change":"2024-09-12T17:37:08.658663+0000","last_active":"2024-09-12T17:58:12.170376+0000","last_peered":"2024-09-12T17:58:12.170376+0000","last_clean":"2024-09-12T17:58:12.170376+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T17:58:12.170376+0000","last_undegraded":"2024-09-12T17:58:12.170376+0000","last_fullsized":"2024-09-12T17:58:12.170376+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.276415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126695+0000","last_change":"2024-09-12T17:49:56.036857+0000","last_active":"2024-09-12T17:57:12.126695+0000","last_peered":"2024-09-12T17:57:12.126695+0000","last_clean":"2024-09-12T17:57:12.126695+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T17:57:12.126695+0000","last_undegraded":"2024-09-12T17:57:12.126695+0000","last_fullsized":"2024-09-12T17:57:12.126695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:01.304735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'4","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.109684+0000","last_change":"2024-09-12T17:38:47.019373+0000","last_active":"2024-09-12T18:01:03.109684+0000","last_peered":"2024-09-12T18:01:03.109684+0000","last_clean":"2024-09-12T18:01:03.109684+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T18:01:03.109684+0000","last_undegraded":"2024-09-12T18:01:03.109684+0000","last_fullsized":"2024-09-12T18:01:03.109684+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:16.314152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124255+0000","last_change":"2024-09-12T17:38:43.992720+0000","last_active":"2024-09-12T17:57:27.124255+0000","last_peered":"2024-09-12T17:57:27.124255+0000","last_clean":"2024-09-12T17:57:27.124255+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T17:57:27.124255+0000","last_undegraded":"2024-09-12T17:57:27.124255+0000","last_fullsized":"2024-09-12T17:57:27.124255+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:49.377878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.480567+0000","last_change":"2024-09-12T17:37:08.662089+0000","last_active":"2024-09-12T17:58:18.480567+0000","last_peered":"2024-09-12T17:58:18.480567+0000","last_clean":"2024-09-12T17:58:18.480567+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T17:58:18.480567+0000","last_undegraded":"2024-09-12T17:58:18.480567+0000","last_fullsized":"2024-09-12T17:58:18.480567+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:41.016001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.137350+0000","last_change":"2024-09-12T17:49:56.047641+0000","last_active":"2024-09-12T17:58:43.137350+0000","last_peered":"2024-09-12T17:58:43.137350+0000","last_clean":"2024-09-12T17:58:43.137350+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T17:58:43.137350+0000","last_undegraded":"2024-09-12T17:58:43.137350+0000","last_fullsized":"2024-09-12T17:58:43.137350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:16.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.147036+0000","last_change":"2024-09-12T17:38:47.029582+0000","last_active":"2024-09-12T17:59:05.147036+0000","last_peered":"2024-09-12T17:59:05.147036+0000","last_clean":"2024-09-12T17:59:05.147036+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T17:59:05.147036+0000","last_undegraded":"2024-09-12T17:59:05.147036+0000","last_fullsized":"2024-09-12T17:59:05.147036+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.176364+0000","last_change":"2024-09-12T17:38:43.989865+0000","last_active":"2024-09-12T17:59:02.176364+0000","last_peered":"2024-09-12T17:59:02.176364+0000","last_clean":"2024-09-12T17:59:02.176364+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T17:59:02.176364+0000","last_undegraded":"2024-09-12T17:59:02.176364+0000","last_fullsized":"2024-09-12T17:59:02.176364+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:25.133309+0000","last_change":"2024-09-12T17:37:08.662016+0000","last_active":"2024-09-12T17:57:25.133309+0000","last_peered":"2024-09-12T17:57:25.133309+0000","last_clean":"2024-09-12T17:57:25.133309+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T17:57:25.133309+0000","last_undegraded":"2024-09-12T17:57:25.133309+0000","last_fullsized":"2024-09-12T17:57:25.133309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:38.421910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.136210+0000","last_change":"2024-09-12T17:49:56.049044+0000","last_active":"2024-09-12T17:58:57.136210+0000","last_peered":"2024-09-12T17:58:57.136210+0000","last_clean":"2024-09-12T17:58:57.136210+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T17:58:57.136210+0000","last_undegraded":"2024-09-12T17:58:57.136210+0000","last_fullsized":"2024-09-12T17:58:57.136210+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.147006+0000","last_change":"2024-09-12T17:38:47.025348+0000","last_active":"2024-09-12T17:59:05.147006+0000","last_peered":"2024-09-12T17:59:05.147006+0000","last_clean":"2024-09-12T17:59:05.147006+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T17:59:05.147006+0000","last_undegraded":"2024-09-12T17:59:05.147006+0000","last_fullsized":"2024-09-12T17:59:05.147006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.749496+0000","last_change":"2024-09-12T17:38:43.989723+0000","last_active":"2024-09-12T18:01:04.749496+0000","last_peered":"2024-09-12T18:01:04.749496+0000","last_clean":"2024-09-12T18:01:04.749496+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T18:01:04.749496+0000","last_undegraded":"2024-09-12T18:01:04.749496+0000","last_fullsized":"2024-09-12T18:01:04.749496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013744+0000","last_change":"2024-09-12T17:37:08.648920+0000","last_active":"2024-09-12T17:57:27.013744+0000","last_peered":"2024-09-12T17:57:27.013744+0000","last_clean":"2024-09-12T17:57:27.013744+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T17:57:27.013744+0000","last_undegraded":"2024-09-12T17:57:27.013744+0000","last_fullsized":"2024-09-12T17:57:27.013744+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.023058+0000","last_change":"2024-09-12T17:49:56.036894+0000","last_active":"2024-09-12T17:58:37.023058+0000","last_peered":"2024-09-12T17:58:37.023058+0000","last_clean":"2024-09-12T17:58:37.023058+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T17:58:37.023058+0000","last_undegraded":"2024-09-12T17:58:37.023058+0000","last_fullsized":"2024-09-12T17:58:37.023058+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:30.781444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'10","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.844005+0000","last_change":"2024-09-12T17:38:47.027005+0000","last_active":"2024-09-12T18:01:04.844005+0000","last_peered":"2024-09-12T18:01:04.844005+0000","last_clean":"2024-09-12T18:01:04.844005+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T18:01:04.844005+0000","last_undegraded":"2024-09-12T18:01:04.844005+0000","last_fullsized":"2024-09-12T18:01:04.844005+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15452,"num_write":10,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.672174+0000","last_change":"2024-09-12T17:38:43.996009+0000","last_active":"2024-09-12T18:01:03.672174+0000","last_peered":"2024-09-12T18:01:03.672174+0000","last_clean":"2024-09-12T18:01:03.672174+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T18:01:03.672174+0000","last_undegraded":"2024-09-12T18:01:03.672174+0000","last_fullsized":"2024-09-12T18:01:03.672174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4108,"num_write":6,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.124276+0000","last_change":"2024-09-12T17:37:08.653415+0000","last_active":"2024-09-12T17:57:27.124276+0000","last_peered":"2024-09-12T17:57:27.124276+0000","last_clean":"2024-09-12T17:57:27.124276+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T17:57:27.124276+0000","last_undegraded":"2024-09-12T17:57:27.124276+0000","last_fullsized":"2024-09-12T17:57:27.124276+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:16.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.133197+0000","last_change":"2024-09-12T17:49:56.047746+0000","last_active":"2024-09-12T17:58:37.133197+0000","last_peered":"2024-09-12T17:58:37.133197+0000","last_clean":"2024-09-12T17:58:37.133197+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T17:58:37.133197+0000","last_undegraded":"2024-09-12T17:58:37.133197+0000","last_fullsized":"2024-09-12T17:58:37.133197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:19.785797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'6","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.250691+0000","last_change":"2024-09-12T17:38:47.022037+0000","last_active":"2024-09-12T18:01:03.250691+0000","last_peered":"2024-09-12T18:01:03.250691+0000","last_clean":"2024-09-12T18:01:03.250691+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T18:01:03.250691+0000","last_undegraded":"2024-09-12T18:01:03.250691+0000","last_fullsized":"2024-09-12T18:01:03.250691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11258,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:00.146473+0000","last_change":"2024-09-12T17:38:43.991999+0000","last_active":"2024-09-12T17:59:00.146473+0000","last_peered":"2024-09-12T17:59:00.146473+0000","last_clean":"2024-09-12T17:59:00.146473+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T17:59:00.146473+0000","last_undegraded":"2024-09-12T17:59:00.146473+0000","last_fullsized":"2024-09-12T17:59:00.146473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128990+0000","last_change":"2024-09-12T17:37:08.659437+0000","last_active":"2024-09-12T17:57:27.128990+0000","last_peered":"2024-09-12T17:57:27.128990+0000","last_clean":"2024-09-12T17:57:27.128990+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T17:57:27.128990+0000","last_undegraded":"2024-09-12T17:57:27.128990+0000","last_fullsized":"2024-09-12T17:57:27.128990+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:00.942567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:58.140098+0000","last_change":"2024-09-12T17:49:56.045196+0000","last_active":"2024-09-12T17:58:58.140098+0000","last_peered":"2024-09-12T17:58:58.140098+0000","last_clean":"2024-09-12T17:58:58.140098+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T17:58:58.140098+0000","last_undegraded":"2024-09-12T17:58:58.140098+0000","last_fullsized":"2024-09-12T17:58:58.140098+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020855+0000","last_change":"2024-09-12T17:38:47.020511+0000","last_active":"2024-09-12T17:58:17.020855+0000","last_peered":"2024-09-12T17:58:17.020855+0000","last_clean":"2024-09-12T17:58:17.020855+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T17:58:17.020855+0000","last_undegraded":"2024-09-12T17:58:17.020855+0000","last_fullsized":"2024-09-12T17:58:17.020855+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.015103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:25.159742+0000","last_change":"2024-09-12T17:38:43.993571+0000","last_active":"2024-09-12T18:00:25.159742+0000","last_peered":"2024-09-12T18:00:25.159742+0000","last_clean":"2024-09-12T18:00:25.159742+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T18:00:25.159742+0000","last_undegraded":"2024-09-12T18:00:25.159742+0000","last_fullsized":"2024-09-12T18:00:25.159742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.884799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128966+0000","last_change":"2024-09-12T17:37:08.656385+0000","last_active":"2024-09-12T17:57:27.128966+0000","last_peered":"2024-09-12T17:57:27.128966+0000","last_clean":"2024-09-12T17:57:27.128966+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T17:57:27.128966+0000","last_undegraded":"2024-09-12T17:57:27.128966+0000","last_fullsized":"2024-09-12T17:57:27.128966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.175881+0000","last_change":"2024-09-12T17:49:56.048011+0000","last_active":"2024-09-12T17:58:57.175881+0000","last_peered":"2024-09-12T17:58:57.175881+0000","last_clean":"2024-09-12T17:58:57.175881+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T17:58:57.175881+0000","last_undegraded":"2024-09-12T17:58:57.175881+0000","last_fullsized":"2024-09-12T17:58:57.175881+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.187297+0000","last_change":"2024-09-12T17:38:47.032812+0000","last_active":"2024-09-12T18:00:27.187297+0000","last_peered":"2024-09-12T18:00:27.187297+0000","last_clean":"2024-09-12T18:00:27.187297+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T18:00:27.187297+0000","last_undegraded":"2024-09-12T18:00:27.187297+0000","last_fullsized":"2024-09-12T18:00:27.187297+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:16.283298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.133853+0000","last_change":"2024-09-12T17:38:43.988490+0000","last_active":"2024-09-12T17:58:13.133853+0000","last_peered":"2024-09-12T17:58:13.133853+0000","last_clean":"2024-09-12T17:58:13.133853+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T17:58:13.133853+0000","last_undegraded":"2024-09-12T17:58:13.133853+0000","last_fullsized":"2024-09-12T17:58:13.133853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.984138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.431022+0000","last_change":"2024-09-12T17:37:08.652495+0000","last_active":"2024-09-12T17:59:07.431022+0000","last_peered":"2024-09-12T17:59:07.431022+0000","last_clean":"2024-09-12T17:59:07.431022+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T17:59:07.431022+0000","last_undegraded":"2024-09-12T17:59:07.431022+0000","last_fullsized":"2024-09-12T17:59:07.431022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:18.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.025229+0000","last_change":"2024-09-12T17:49:56.045788+0000","last_active":"2024-09-12T17:58:57.025229+0000","last_peered":"2024-09-12T17:58:57.025229+0000","last_clean":"2024-09-12T17:58:57.025229+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T17:58:57.025229+0000","last_undegraded":"2024-09-12T17:58:57.025229+0000","last_fullsized":"2024-09-12T17:58:57.025229+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.141514+0000","last_change":"2024-09-12T17:38:47.030610+0000","last_active":"2024-09-12T17:59:02.141514+0000","last_peered":"2024-09-12T17:59:02.141514+0000","last_clean":"2024-09-12T17:59:02.141514+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T17:59:02.141514+0000","last_undegraded":"2024-09-12T17:59:02.141514+0000","last_fullsized":"2024-09-12T17:59:02.141514+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'9","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.538378+0000","last_change":"2024-09-12T17:38:43.992844+0000","last_active":"2024-09-12T18:01:04.538378+0000","last_peered":"2024-09-12T18:01:04.538378+0000","last_clean":"2024-09-12T18:01:04.538378+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T18:01:04.538378+0000","last_undegraded":"2024-09-12T18:01:04.538378+0000","last_fullsized":"2024-09-12T18:01:04.538378+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:06.166487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138340+0000","last_change":"2024-09-12T17:37:08.661047+0000","last_active":"2024-09-12T17:58:48.138340+0000","last_peered":"2024-09-12T17:58:48.138340+0000","last_clean":"2024-09-12T17:58:48.138340+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T17:58:48.138340+0000","last_undegraded":"2024-09-12T17:58:48.138340+0000","last_fullsized":"2024-09-12T17:58:48.138340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:35.362254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:55.145666+0000","last_change":"2024-09-12T17:49:56.045203+0000","last_active":"2024-09-12T17:58:55.145666+0000","last_peered":"2024-09-12T17:58:55.145666+0000","last_clean":"2024-09-12T17:58:55.145666+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T17:58:55.145666+0000","last_undegraded":"2024-09-12T17:58:55.145666+0000","last_fullsized":"2024-09-12T17:58:55.145666+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.690292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.020496+0000","last_change":"2024-09-12T17:38:47.026783+0000","last_active":"2024-09-12T17:58:22.020496+0000","last_peered":"2024-09-12T17:58:22.020496+0000","last_clean":"2024-09-12T17:58:22.020496+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T17:58:22.020496+0000","last_undegraded":"2024-09-12T17:58:22.020496+0000","last_fullsized":"2024-09-12T17:58:22.020496+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:20.362697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.140824+0000","last_change":"2024-09-12T17:38:43.993534+0000","last_active":"2024-09-12T18:01:04.140824+0000","last_peered":"2024-09-12T18:01:04.140824+0000","last_clean":"2024-09-12T18:01:04.140824+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T18:01:04.140824+0000","last_undegraded":"2024-09-12T18:01:04.140824+0000","last_fullsized":"2024-09-12T18:01:04.140824+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.024519+0000","last_change":"2024-09-12T17:37:08.652306+0000","last_active":"2024-09-12T17:58:52.024519+0000","last_peered":"2024-09-12T17:58:52.024519+0000","last_clean":"2024-09-12T17:58:52.024519+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T17:58:52.024519+0000","last_undegraded":"2024-09-12T17:58:52.024519+0000","last_fullsized":"2024-09-12T17:58:52.024519+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.726476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.019998+0000","last_change":"2024-09-12T17:49:56.046641+0000","last_active":"2024-09-12T17:58:17.019998+0000","last_peered":"2024-09-12T17:58:17.019998+0000","last_clean":"2024-09-12T17:58:17.019998+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T17:58:17.019998+0000","last_undegraded":"2024-09-12T17:58:17.019998+0000","last_fullsized":"2024-09-12T17:58:17.019998+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:58.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'8","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:43.146728+0000","last_change":"2024-09-12T17:38:47.030849+0000","last_active":"2024-09-12T17:59:43.146728+0000","last_peered":"2024-09-12T17:59:43.146728+0000","last_clean":"2024-09-12T17:59:43.146728+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T17:59:43.146728+0000","last_undegraded":"2024-09-12T17:59:43.146728+0000","last_fullsized":"2024-09-12T17:59:43.146728+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:33.916148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014388+0000","last_change":"2024-09-12T17:38:43.991595+0000","last_active":"2024-09-12T17:57:32.014388+0000","last_peered":"2024-09-12T17:57:32.014388+0000","last_clean":"2024-09-12T17:57:32.014388+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T17:57:32.014388+0000","last_undegraded":"2024-09-12T17:57:32.014388+0000","last_fullsized":"2024-09-12T17:57:32.014388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.739988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025891+0000","last_change":"2024-09-12T17:37:08.661553+0000","last_active":"2024-09-12T17:58:52.025891+0000","last_peered":"2024-09-12T17:58:52.025891+0000","last_clean":"2024-09-12T17:58:52.025891+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T17:58:52.025891+0000","last_undegraded":"2024-09-12T17:58:52.025891+0000","last_fullsized":"2024-09-12T17:58:52.025891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.649379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020012+0000","last_change":"2024-09-12T17:49:56.041888+0000","last_active":"2024-09-12T17:58:17.020012+0000","last_peered":"2024-09-12T17:58:17.020012+0000","last_clean":"2024-09-12T17:58:17.020012+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T17:58:17.020012+0000","last_undegraded":"2024-09-12T17:58:17.020012+0000","last_fullsized":"2024-09-12T17:58:17.020012+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127910+0000","last_change":"2024-09-12T17:38:47.024913+0000","last_active":"2024-09-12T17:57:33.127910+0000","last_peered":"2024-09-12T17:57:33.127910+0000","last_clean":"2024-09-12T17:57:33.127910+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T17:57:33.127910+0000","last_undegraded":"2024-09-12T17:57:33.127910+0000","last_fullsized":"2024-09-12T17:57:33.127910+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:06.755928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:42.032374+0000","last_change":"2024-09-12T17:38:43.990480+0000","last_active":"2024-09-12T17:59:42.032374+0000","last_peered":"2024-09-12T17:59:42.032374+0000","last_clean":"2024-09-12T17:59:42.032374+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T17:59:42.032374+0000","last_undegraded":"2024-09-12T17:59:42.032374+0000","last_fullsized":"2024-09-12T17:59:42.032374+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:13.712977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025154+0000","last_change":"2024-09-12T17:37:08.649723+0000","last_active":"2024-09-12T17:58:52.025154+0000","last_peered":"2024-09-12T17:58:52.025154+0000","last_clean":"2024-09-12T17:58:52.025154+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T17:58:52.025154+0000","last_undegraded":"2024-09-12T17:58:52.025154+0000","last_fullsized":"2024-09-12T17:58:52.025154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.186149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132327+0000","last_change":"2024-09-12T17:49:56.046876+0000","last_active":"2024-09-12T17:58:03.132327+0000","last_peered":"2024-09-12T17:58:03.132327+0000","last_clean":"2024-09-12T17:58:03.132327+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T17:58:03.132327+0000","last_undegraded":"2024-09-12T17:58:03.132327+0000","last_fullsized":"2024-09-12T17:58:03.132327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:45.910023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.035900+0000","last_change":"2024-09-12T17:38:47.026137+0000","last_active":"2024-09-12T18:00:27.035900+0000","last_peered":"2024-09-12T18:00:27.035900+0000","last_clean":"2024-09-12T18:00:27.035900+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T18:00:27.035900+0000","last_undegraded":"2024-09-12T18:00:27.035900+0000","last_fullsized":"2024-09-12T18:00:27.035900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:14.366739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.171001+0000","last_change":"2024-09-12T17:38:43.992358+0000","last_active":"2024-09-12T17:58:17.171001+0000","last_peered":"2024-09-12T17:58:17.171001+0000","last_clean":"2024-09-12T17:58:17.171001+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T17:58:17.171001+0000","last_undegraded":"2024-09-12T17:58:17.171001+0000","last_fullsized":"2024-09-12T17:58:17.171001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:38.097131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.169817+0000","last_change":"2024-09-12T17:37:08.658795+0000","last_active":"2024-09-12T17:58:07.169817+0000","last_peered":"2024-09-12T17:58:07.169817+0000","last_clean":"2024-09-12T17:58:07.169817+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T17:58:07.169817+0000","last_undegraded":"2024-09-12T17:58:07.169817+0000","last_fullsized":"2024-09-12T17:58:07.169817+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.988783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020817+0000","last_change":"2024-09-12T17:49:56.036001+0000","last_active":"2024-09-12T17:58:17.020817+0000","last_peered":"2024-09-12T17:58:17.020817+0000","last_clean":"2024-09-12T17:58:17.020817+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T17:58:17.020817+0000","last_undegraded":"2024-09-12T17:58:17.020817+0000","last_fullsized":"2024-09-12T17:58:17.020817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:20.176376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.037880+0000","last_change":"2024-09-12T17:38:47.021549+0000","last_active":"2024-09-12T18:00:27.037880+0000","last_peered":"2024-09-12T18:00:27.037880+0000","last_clean":"2024-09-12T18:00:27.037880+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T18:00:27.037880+0000","last_undegraded":"2024-09-12T18:00:27.037880+0000","last_fullsized":"2024-09-12T18:00:27.037880+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:06.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5116,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021033+0000","last_change":"2024-09-12T17:38:43.994549+0000","last_active":"2024-09-12T17:58:17.021033+0000","last_peered":"2024-09-12T17:58:17.021033+0000","last_clean":"2024-09-12T17:58:17.021033+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T17:58:17.021033+0000","last_undegraded":"2024-09-12T17:58:17.021033+0000","last_fullsized":"2024-09-12T17:58:17.021033+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:30.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":171,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.435685+0000","last_change":"2024-09-12T17:37:08.659177+0000","last_active":"2024-09-12T17:59:07.435685+0000","last_peered":"2024-09-12T17:59:07.435685+0000","last_clean":"2024-09-12T17:59:07.435685+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T17:59:07.435685+0000","last_undegraded":"2024-09-12T17:59:07.435685+0000","last_fullsized":"2024-09-12T17:59:07.435685+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:04.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:35.142766+0000","last_change":"2024-09-12T17:49:56.038182+0000","last_active":"2024-09-12T17:58:35.142766+0000","last_peered":"2024-09-12T17:58:35.142766+0000","last_clean":"2024-09-12T17:58:35.142766+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T17:58:35.142766+0000","last_undegraded":"2024-09-12T17:58:35.142766+0000","last_fullsized":"2024-09-12T17:58:35.142766+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:22.086611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014474+0000","last_change":"2024-09-12T17:38:47.026375+0000","last_active":"2024-09-12T17:57:32.014474+0000","last_peered":"2024-09-12T17:57:32.014474+0000","last_clean":"2024-09-12T17:57:32.014474+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T17:57:32.014474+0000","last_undegraded":"2024-09-12T17:57:32.014474+0000","last_fullsized":"2024-09-12T17:57:32.014474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:56.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:52.190495+0000","last_change":"2024-09-12T17:38:43.992950+0000","last_active":"2024-09-12T18:00:52.190495+0000","last_peered":"2024-09-12T18:00:52.190495+0000","last_clean":"2024-09-12T18:00:52.190495+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T18:00:52.190495+0000","last_undegraded":"2024-09-12T18:00:52.190495+0000","last_fullsized":"2024-09-12T18:00:52.190495+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:18.833241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.762077+0000","last_change":"2024-09-12T17:37:08.654619+0000","last_active":"2024-09-12T17:59:07.762077+0000","last_peered":"2024-09-12T17:59:07.762077+0000","last_clean":"2024-09-12T17:59:07.762077+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T17:59:07.762077+0000","last_undegraded":"2024-09-12T17:59:07.762077+0000","last_fullsized":"2024-09-12T17:59:07.762077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:44.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.024006+0000","last_change":"2024-09-12T17:49:56.039258+0000","last_active":"2024-09-12T17:58:37.024006+0000","last_peered":"2024-09-12T17:58:37.024006+0000","last_clean":"2024-09-12T17:58:37.024006+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T17:58:37.024006+0000","last_undegraded":"2024-09-12T17:58:37.024006+0000","last_fullsized":"2024-09-12T17:58:37.024006+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.182004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'7","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.109469+0000","last_change":"2024-09-12T17:38:47.026063+0000","last_active":"2024-09-12T18:01:03.109469+0000","last_peered":"2024-09-12T18:01:03.109469+0000","last_clean":"2024-09-12T18:01:03.109469+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T18:01:03.109469+0000","last_undegraded":"2024-09-12T18:01:03.109469+0000","last_fullsized":"2024-09-12T18:01:03.109469+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.717038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3651,"num_write":12,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014307+0000","last_change":"2024-09-12T17:38:43.988186+0000","last_active":"2024-09-12T17:57:32.014307+0000","last_peered":"2024-09-12T17:57:32.014307+0000","last_clean":"2024-09-12T17:57:32.014307+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T17:57:32.014307+0000","last_undegraded":"2024-09-12T17:57:32.014307+0000","last_fullsized":"2024-09-12T17:57:32.014307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:03.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.018369+0000","last_change":"2024-09-12T17:37:08.647170+0000","last_active":"2024-09-12T17:58:02.018369+0000","last_peered":"2024-09-12T17:58:02.018369+0000","last_clean":"2024-09-12T17:58:02.018369+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T17:58:02.018369+0000","last_undegraded":"2024-09-12T17:58:02.018369+0000","last_fullsized":"2024-09-12T17:58:02.018369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:33.128612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.134437+0000","last_change":"2024-09-12T17:49:56.044807+0000","last_active":"2024-09-12T17:58:18.134437+0000","last_peered":"2024-09-12T17:58:18.134437+0000","last_clean":"2024-09-12T17:58:18.134437+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T17:58:18.134437+0000","last_undegraded":"2024-09-12T17:58:18.134437+0000","last_fullsized":"2024-09-12T17:58:18.134437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:28.012638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164999+0000","last_change":"2024-09-12T17:38:47.035193+0000","last_active":"2024-09-12T17:57:32.164999+0000","last_peered":"2024-09-12T17:57:32.164999+0000","last_clean":"2024-09-12T17:57:32.164999+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T17:57:32.164999+0000","last_undegraded":"2024-09-12T17:57:32.164999+0000","last_fullsized":"2024-09-12T17:57:32.164999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:54.991568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.145996+0000","last_change":"2024-09-12T17:38:43.993095+0000","last_active":"2024-09-12T17:59:37.145996+0000","last_peered":"2024-09-12T17:59:37.145996+0000","last_clean":"2024-09-12T17:59:37.145996+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T17:59:37.145996+0000","last_undegraded":"2024-09-12T17:59:37.145996+0000","last_fullsized":"2024-09-12T17:59:37.145996+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:07.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4118,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.571968+0000","last_change":"2024-09-12T17:37:08.656010+0000","last_active":"2024-09-12T17:59:05.571968+0000","last_peered":"2024-09-12T17:59:05.571968+0000","last_clean":"2024-09-12T17:59:05.571968+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T17:59:05.571968+0000","last_undegraded":"2024-09-12T17:59:05.571968+0000","last_fullsized":"2024-09-12T17:59:05.571968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.346921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021616+0000","last_change":"2024-09-12T17:49:56.043230+0000","last_active":"2024-09-12T17:58:22.021616+0000","last_peered":"2024-09-12T17:58:22.021616+0000","last_clean":"2024-09-12T17:58:22.021616+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T17:58:22.021616+0000","last_undegraded":"2024-09-12T17:58:22.021616+0000","last_fullsized":"2024-09-12T17:58:22.021616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:33.627052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.164967+0000","last_change":"2024-09-12T17:38:47.029841+0000","last_active":"2024-09-12T17:57:32.164967+0000","last_peered":"2024-09-12T17:57:32.164967+0000","last_clean":"2024-09-12T17:57:32.164967+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T17:57:32.164967+0000","last_undegraded":"2024-09-12T17:57:32.164967+0000","last_fullsized":"2024-09-12T17:57:32.164967+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:16.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'6","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.140579+0000","last_change":"2024-09-12T17:38:43.992352+0000","last_active":"2024-09-12T17:59:37.140579+0000","last_peered":"2024-09-12T17:59:37.140579+0000","last_clean":"2024-09-12T17:59:37.140579+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T17:59:37.140579+0000","last_undegraded":"2024-09-12T17:59:37.140579+0000","last_fullsized":"2024-09-12T17:59:37.140579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:57.443048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.178003+0000","last_change":"2024-09-12T17:37:08.651452+0000","last_active":"2024-09-12T17:59:17.178003+0000","last_peered":"2024-09-12T17:59:17.178003+0000","last_clean":"2024-09-12T17:59:17.178003+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T17:59:17.178003+0000","last_undegraded":"2024-09-12T17:59:17.178003+0000","last_fullsized":"2024-09-12T17:59:17.178003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'321","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.693631+0000","last_change":"2024-09-12T18:01:23.693564+0000","last_active":"2024-09-12T18:01:23.693631+0000","last_peered":"2024-09-12T18:01:23.693631+0000","last_clean":"2024-09-12T18:01:23.693631+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T18:01:23.693631+0000","last_undegraded":"2024-09-12T18:01:23.693631+0000","last_fullsized":"2024-09-12T18:01:23.693631+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.693423+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:45.036692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399146,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":38786,"num_write":1044,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'482","reported_seq":1980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.202958+0000","last_change":"2024-09-12T18:01:23.202958+0000","last_active":"2024-09-12T18:01:23.202958+0000","last_peered":"2024-09-12T18:01:23.202958+0000","last_clean":"2024-09-12T18:01:23.202958+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T18:01:23.202958+0000","last_undegraded":"2024-09-12T18:01:23.202958+0000","last_fullsized":"2024-09-12T18:01:23.202958+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.202855+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:43.946108+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":941,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'373","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.026863+0000","last_change":"2024-09-12T18:01:24.026802+0000","last_active":"2024-09-12T18:01:24.026863+0000","last_peered":"2024-09-12T18:01:24.026863+0000","last_clean":"2024-09-12T18:01:24.026863+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:24.026863+0000","last_undegraded":"2024-09-12T18:01:24.026863+0000","last_fullsized":"2024-09-12T18:01:24.026863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.026638+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.853845+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":37151,"num_write":1322,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'544","reported_seq":2157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.501861+0000","last_change":"2024-09-12T17:21:52.746868+0000","last_active":"2024-09-12T17:59:18.501861+0000","last_peered":"2024-09-12T17:59:18.501861+0000","last_clean":"2024-09-12T17:59:18.501861+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T17:59:18.501861+0000","last_undegraded":"2024-09-12T17:59:18.501861+0000","last_fullsized":"2024-09-12T17:59:18.501861+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:06.625492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'320","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.022949+0000","last_change":"2024-09-12T18:01:23.022871+0000","last_active":"2024-09-12T18:01:23.022949+0000","last_peered":"2024-09-12T18:01:23.022949+0000","last_clean":"2024-09-12T18:01:23.022949+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:23.022949+0000","last_undegraded":"2024-09-12T18:01:23.022949+0000","last_fullsized":"2024-09-12T18:01:23.022949+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.022698+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:20.281089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288578,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":719,"num_read_kb":16808,"num_write":978,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'613","reported_seq":2373,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.760782+0000","last_change":"2024-09-12T17:21:52.743802+0000","last_active":"2024-09-12T17:59:34.760782+0000","last_peered":"2024-09-12T17:59:34.760782+0000","last_clean":"2024-09-12T17:59:34.760782+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T17:59:34.760782+0000","last_undegraded":"2024-09-12T17:59:34.760782+0000","last_fullsized":"2024-09-12T17:59:34.760782+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:44.764410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'428","reported_seq":1109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.900585+0000","last_change":"2024-09-12T18:01:14.900585+0000","last_active":"2024-09-12T18:01:14.900585+0000","last_peered":"2024-09-12T18:01:14.900585+0000","last_clean":"2024-09-12T18:01:14.900585+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T18:01:14.900585+0000","last_undegraded":"2024-09-12T18:01:14.900585+0000","last_fullsized":"2024-09-12T18:01:14.900585+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.900378+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:40.317506+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355300,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":592,"num_read_kb":16041,"num_write":1318,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.874120+0000","last_change":"2024-09-12T18:01:25.874120+0000","last_active":"2024-09-12T18:01:25.874120+0000","last_peered":"2024-09-12T18:01:25.874120+0000","last_clean":"2024-09-12T18:01:25.874120+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T18:01:25.874120+0000","last_undegraded":"2024-09-12T18:01:25.874120+0000","last_fullsized":"2024-09-12T18:01:25.874120+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.874037+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:51.343725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'286","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.715916+0000","last_change":"2024-09-12T18:01:15.715916+0000","last_active":"2024-09-12T18:01:15.715916+0000","last_peered":"2024-09-12T18:01:15.715916+0000","last_clean":"2024-09-12T18:01:15.715916+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T18:01:15.715916+0000","last_undegraded":"2024-09-12T18:01:15.715916+0000","last_fullsized":"2024-09-12T18:01:15.715916+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.715784+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:13.680021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":5548,"num_write":891,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'845","reported_seq":2513,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.658937+0000","last_change":"2024-09-12T18:01:18.658937+0000","last_active":"2024-09-12T18:01:18.658937+0000","last_peered":"2024-09-12T18:01:18.658937+0000","last_clean":"2024-09-12T18:01:18.658937+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T18:01:18.658937+0000","last_undegraded":"2024-09-12T18:01:18.658937+0000","last_fullsized":"2024-09-12T18:01:18.658937+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'845","last_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_deep_scrub":"265'845","last_deep_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.658839+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:56.655053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'324","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.905312+0000","last_change":"2024-09-12T18:01:15.905312+0000","last_active":"2024-09-12T18:01:15.905312+0000","last_peered":"2024-09-12T18:01:15.905312+0000","last_clean":"2024-09-12T18:01:15.905312+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T18:01:15.905312+0000","last_undegraded":"2024-09-12T18:01:15.905312+0000","last_fullsized":"2024-09-12T18:01:15.905312+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.905069+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:23.219539+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":30145,"num_write":1083,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'508","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.724250+0000","last_change":"2024-09-12T18:01:20.724189+0000","last_active":"2024-09-12T18:01:20.724250+0000","last_peered":"2024-09-12T18:01:20.724250+0000","last_clean":"2024-09-12T18:01:20.724250+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:01:20.724250+0000","last_undegraded":"2024-09-12T18:01:20.724250+0000","last_fullsized":"2024-09-12T18:01:20.724250+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'508","last_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_deep_scrub":"265'508","last_deep_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.724105+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:47.581144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'367","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.683331+0000","last_change":"2024-09-12T18:01:21.683331+0000","last_active":"2024-09-12T18:01:21.683331+0000","last_peered":"2024-09-12T18:01:21.683331+0000","last_clean":"2024-09-12T18:01:21.683331+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T18:01:21.683331+0000","last_undegraded":"2024-09-12T18:01:21.683331+0000","last_fullsized":"2024-09-12T18:01:21.683331+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.683187+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.284187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036318,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":10450,"num_write":1136,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'745","reported_seq":2179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.002193+0000","last_change":"2024-09-12T18:01:23.002080+0000","last_active":"2024-09-12T18:01:23.002193+0000","last_peered":"2024-09-12T18:01:23.002193+0000","last_clean":"2024-09-12T18:01:23.002193+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T18:01:23.002193+0000","last_undegraded":"2024-09-12T18:01:23.002193+0000","last_fullsized":"2024-09-12T18:01:23.002193+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.001977+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:23.455291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'413","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.990417+0000","last_change":"2024-09-12T18:01:21.990417+0000","last_active":"2024-09-12T18:01:21.990417+0000","last_peered":"2024-09-12T18:01:21.990417+0000","last_clean":"2024-09-12T18:01:21.990417+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:21.990417+0000","last_undegraded":"2024-09-12T18:01:21.990417+0000","last_fullsized":"2024-09-12T18:01:21.990417+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.990298+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:19.678560+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":69100,"num_write":1161,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1194","reported_seq":2915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.770036+0000","last_change":"2024-09-12T17:21:52.754000+0000","last_active":"2024-09-12T17:59:34.770036+0000","last_peered":"2024-09-12T17:59:34.770036+0000","last_clean":"2024-09-12T17:59:34.770036+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T17:59:34.770036+0000","last_undegraded":"2024-09-12T17:59:34.770036+0000","last_fullsized":"2024-09-12T17:59:34.770036+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":1100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'489","reported_seq":2037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.359232+0000","last_change":"2024-09-12T17:21:52.751378+0000","last_active":"2024-09-12T17:59:34.359232+0000","last_peered":"2024-09-12T17:59:34.359232+0000","last_clean":"2024-09-12T17:59:34.359232+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T17:59:34.359232+0000","last_undegraded":"2024-09-12T17:59:34.359232+0000","last_fullsized":"2024-09-12T17:59:34.359232+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:04.419740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'383","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.180354+0000","last_change":"2024-09-12T18:01:15.180354+0000","last_active":"2024-09-12T18:01:15.180354+0000","last_peered":"2024-09-12T18:01:15.180354+0000","last_clean":"2024-09-12T18:01:15.180354+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:01:15.180354+0000","last_undegraded":"2024-09-12T18:01:15.180354+0000","last_fullsized":"2024-09-12T18:01:15.180354+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.180191+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:38.231795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":53764,"num_write":1216,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'449","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.661599+0000","last_change":"2024-09-12T18:01:22.661599+0000","last_active":"2024-09-12T18:01:22.661599+0000","last_peered":"2024-09-12T18:01:22.661599+0000","last_clean":"2024-09-12T18:01:22.661599+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T18:01:22.661599+0000","last_undegraded":"2024-09-12T18:01:22.661599+0000","last_fullsized":"2024-09-12T18:01:22.661599+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.661510+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:11.348161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'317","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.714065+0000","last_change":"2024-09-12T18:01:14.714065+0000","last_active":"2024-09-12T18:01:14.714065+0000","last_peered":"2024-09-12T18:01:14.714065+0000","last_clean":"2024-09-12T18:01:14.714065+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T18:01:14.714065+0000","last_undegraded":"2024-09-12T18:01:14.714065+0000","last_fullsized":"2024-09-12T18:01:14.714065+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.713905+0000","objects_scrubbed":11,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.647051+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":34593,"num_write":1052,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'469","reported_seq":2171,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.180816+0000","last_change":"2024-09-12T18:01:20.180816+0000","last_active":"2024-09-12T18:01:20.180816+0000","last_peered":"2024-09-12T18:01:20.180816+0000","last_clean":"2024-09-12T18:01:20.180816+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T18:01:20.180816+0000","last_undegraded":"2024-09-12T18:01:20.180816+0000","last_fullsized":"2024-09-12T18:01:20.180816+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'469","last_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_deep_scrub":"265'469","last_deep_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.180664+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.671311+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'341","reported_seq":1172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.821456+0000","last_change":"2024-09-12T18:01:11.821456+0000","last_active":"2024-09-12T18:01:11.821456+0000","last_peered":"2024-09-12T18:01:11.821456+0000","last_clean":"2024-09-12T18:01:11.821456+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T18:01:11.821456+0000","last_undegraded":"2024-09-12T18:01:11.821456+0000","last_fullsized":"2024-09-12T18:01:11.821456+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.821358+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:08.588749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":875,"num_read_kb":30506,"num_write":1060,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'420","reported_seq":2007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.353429+0000","last_change":"2024-09-12T18:01:25.353429+0000","last_active":"2024-09-12T18:01:25.353429+0000","last_peered":"2024-09-12T18:01:25.353429+0000","last_clean":"2024-09-12T18:01:25.353429+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T18:01:25.353429+0000","last_undegraded":"2024-09-12T18:01:25.353429+0000","last_fullsized":"2024-09-12T18:01:25.353429+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.353351+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:54.030926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'419","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.786986+0000","last_change":"2024-09-12T18:01:12.786986+0000","last_active":"2024-09-12T18:01:12.786986+0000","last_peered":"2024-09-12T18:01:12.786986+0000","last_clean":"2024-09-12T18:01:12.786986+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T18:01:12.786986+0000","last_undegraded":"2024-09-12T18:01:12.786986+0000","last_fullsized":"2024-09-12T18:01:12.786986+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.786804+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:13.752525+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":18097,"num_write":1302,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1543","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769737+0000","last_change":"2024-09-12T17:21:52.755355+0000","last_active":"2024-09-12T17:59:34.769737+0000","last_peered":"2024-09-12T17:59:34.769737+0000","last_clean":"2024-09-12T17:59:34.769737+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T17:59:34.769737+0000","last_undegraded":"2024-09-12T17:59:34.769737+0000","last_fullsized":"2024-09-12T17:59:34.769737+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.429894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'346","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.285549+0000","last_change":"2024-09-12T18:01:22.285549+0000","last_active":"2024-09-12T18:01:22.285549+0000","last_peered":"2024-09-12T18:01:22.285549+0000","last_clean":"2024-09-12T18:01:22.285549+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T18:01:22.285549+0000","last_undegraded":"2024-09-12T18:01:22.285549+0000","last_fullsized":"2024-09-12T18:01:22.285549+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.285373+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:53.823367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":18482,"num_write":1050,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'789","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.204231+0000","last_change":"2024-09-12T18:01:21.204231+0000","last_active":"2024-09-12T18:01:21.204231+0000","last_peered":"2024-09-12T18:01:21.204231+0000","last_clean":"2024-09-12T18:01:21.204231+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T18:01:21.204231+0000","last_undegraded":"2024-09-12T18:01:21.204231+0000","last_fullsized":"2024-09-12T18:01:21.204231+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'789","last_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_deep_scrub":"265'789","last_deep_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.204081+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:13.829902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.232834+0000","last_change":"2024-09-12T18:01:16.232834+0000","last_active":"2024-09-12T18:01:16.232834+0000","last_peered":"2024-09-12T18:01:16.232834+0000","last_clean":"2024-09-12T18:01:16.232834+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T18:01:16.232834+0000","last_undegraded":"2024-09-12T18:01:16.232834+0000","last_fullsized":"2024-09-12T18:01:16.232834+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.232719+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.506531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399140,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":4177,"num_write":987,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'172","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.828620+0000","last_change":"2024-09-12T17:22:00.797198+0000","last_active":"2024-09-12T17:59:34.828620+0000","last_peered":"2024-09-12T17:59:34.828620+0000","last_clean":"2024-09-12T17:59:34.828620+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T17:59:34.828620+0000","last_undegraded":"2024-09-12T17:59:34.828620+0000","last_fullsized":"2024-09-12T17:59:34.828620+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.624828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'443","reported_seq":2026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.303906+0000","last_change":"2024-09-12T18:01:23.303906+0000","last_active":"2024-09-12T18:01:23.303906+0000","last_peered":"2024-09-12T18:01:23.303906+0000","last_clean":"2024-09-12T18:01:23.303906+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T18:01:23.303906+0000","last_undegraded":"2024-09-12T18:01:23.303906+0000","last_fullsized":"2024-09-12T18:01:23.303906+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'443","last_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_deep_scrub":"265'443","last_deep_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.303815+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.507190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'409","reported_seq":1225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.577601+0000","last_change":"2024-09-12T18:01:24.577601+0000","last_active":"2024-09-12T18:01:24.577601+0000","last_peered":"2024-09-12T18:01:24.577601+0000","last_clean":"2024-09-12T18:01:24.577601+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T18:01:24.577601+0000","last_undegraded":"2024-09-12T18:01:24.577601+0000","last_fullsized":"2024-09-12T18:01:24.577601+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.577312+0000","objects_scrubbed":11,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:04.271781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460277,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":57262,"num_write":1362,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020196+0000","last_change":"2024-09-12T17:21:54.756402+0000","last_active":"2024-09-12T17:58:12.020196+0000","last_peered":"2024-09-12T17:58:12.020196+0000","last_clean":"2024-09-12T17:58:12.020196+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T17:58:12.020196+0000","last_undegraded":"2024-09-12T17:58:12.020196+0000","last_fullsized":"2024-09-12T17:58:12.020196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'343","reported_seq":942,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.530981+0000","last_change":"2024-09-12T17:21:56.762895+0000","last_active":"2024-09-12T18:01:04.530981+0000","last_peered":"2024-09-12T18:01:04.530981+0000","last_clean":"2024-09-12T18:01:04.530981+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:01:04.530981+0000","last_undegraded":"2024-09-12T18:01:04.530981+0000","last_fullsized":"2024-09-12T18:01:04.530981+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:42.017239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":1109,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131391+0000","last_change":"2024-09-12T17:21:58.779492+0000","last_active":"2024-09-12T17:58:17.131391+0000","last_peered":"2024-09-12T17:58:17.131391+0000","last_clean":"2024-09-12T17:58:17.131391+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T17:58:17.131391+0000","last_undegraded":"2024-09-12T17:58:17.131391+0000","last_fullsized":"2024-09-12T17:58:17.131391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:41.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2432","reported_seq":4316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.251478+0000","last_change":"2024-09-12T17:22:00.789480+0000","last_active":"2024-09-12T17:59:33.251478+0000","last_peered":"2024-09-12T17:59:33.251478+0000","last_clean":"2024-09-12T17:59:33.251478+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T17:59:33.251478+0000","last_undegraded":"2024-09-12T17:59:33.251478+0000","last_fullsized":"2024-09-12T17:59:33.251478+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.233355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'790","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998878+0000","last_change":"2024-09-12T17:21:52.750476+0000","last_active":"2024-09-12T18:00:54.998878+0000","last_peered":"2024-09-12T18:00:54.998878+0000","last_clean":"2024-09-12T18:00:54.998878+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:00:54.998878+0000","last_undegraded":"2024-09-12T18:00:54.998878+0000","last_fullsized":"2024-09-12T18:00:54.998878+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:08.162006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'312","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.189194+0000","last_change":"2024-09-12T18:01:14.189194+0000","last_active":"2024-09-12T18:01:14.189194+0000","last_peered":"2024-09-12T18:01:14.189194+0000","last_clean":"2024-09-12T18:01:14.189194+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T18:01:14.189194+0000","last_undegraded":"2024-09-12T18:01:14.189194+0000","last_fullsized":"2024-09-12T18:01:14.189194+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.189092+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:46.249612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170284,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":362,"num_read_kb":2179,"num_write":871,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:07.010650+0000","last_change":"2024-09-12T17:21:54.752252+0000","last_active":"2024-09-12T17:57:07.010650+0000","last_peered":"2024-09-12T17:57:07.010650+0000","last_clean":"2024-09-12T17:57:07.010650+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T17:57:07.010650+0000","last_undegraded":"2024-09-12T17:57:07.010650+0000","last_fullsized":"2024-09-12T17:57:07.010650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.652789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'92","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.607688+0000","last_change":"2024-09-12T17:21:56.763049+0000","last_active":"2024-09-12T17:59:04.607688+0000","last_peered":"2024-09-12T17:59:04.607688+0000","last_clean":"2024-09-12T17:59:04.607688+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T17:59:04.607688+0000","last_undegraded":"2024-09-12T17:59:04.607688+0000","last_fullsized":"2024-09-12T17:59:04.607688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:05.126795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.131351+0000","last_change":"2024-09-12T17:21:58.781052+0000","last_active":"2024-09-12T17:58:17.131351+0000","last_peered":"2024-09-12T17:58:17.131351+0000","last_clean":"2024-09-12T17:58:17.131351+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T17:58:17.131351+0000","last_undegraded":"2024-09-12T17:58:17.131351+0000","last_fullsized":"2024-09-12T17:58:17.131351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:41.465265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.645798+0000","last_change":"2024-09-12T17:22:00.795013+0000","last_active":"2024-09-12T17:59:34.645798+0000","last_peered":"2024-09-12T17:59:34.645798+0000","last_clean":"2024-09-12T17:59:34.645798+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T17:59:34.645798+0000","last_undegraded":"2024-09-12T17:59:34.645798+0000","last_fullsized":"2024-09-12T17:59:34.645798+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:11.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1531","reported_seq":3108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.124184+0000","last_change":"2024-09-12T18:01:27.124184+0000","last_active":"2024-09-12T18:01:27.124184+0000","last_peered":"2024-09-12T18:01:27.124184+0000","last_clean":"2024-09-12T18:01:27.124184+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T18:01:27.124184+0000","last_undegraded":"2024-09-12T18:01:27.124184+0000","last_fullsized":"2024-09-12T18:01:27.124184+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1531","last_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_deep_scrub":"265'1531","last_deep_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.124084+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":1500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.265522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'349","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.543222+0000","last_change":"2024-09-12T18:01:16.543222+0000","last_active":"2024-09-12T18:01:16.543222+0000","last_peered":"2024-09-12T18:01:16.543222+0000","last_clean":"2024-09-12T18:01:16.543222+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T18:01:16.543222+0000","last_undegraded":"2024-09-12T18:01:16.543222+0000","last_fullsized":"2024-09-12T18:01:16.543222+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.543095+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:40.971401+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":7819,"num_write":1100,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.021331+0000","last_change":"2024-09-12T17:21:54.750735+0000","last_active":"2024-09-12T17:58:12.021331+0000","last_peered":"2024-09-12T17:58:12.021331+0000","last_clean":"2024-09-12T17:58:12.021331+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T17:58:12.021331+0000","last_undegraded":"2024-09-12T17:58:12.021331+0000","last_fullsized":"2024-09-12T17:58:12.021331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.118206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'103","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.030304+0000","last_change":"2024-09-12T17:21:56.760401+0000","last_active":"2024-09-12T17:59:27.030304+0000","last_peered":"2024-09-12T17:59:27.030304+0000","last_clean":"2024-09-12T17:59:27.030304+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T17:59:27.030304+0000","last_undegraded":"2024-09-12T17:59:27.030304+0000","last_fullsized":"2024-09-12T17:59:27.030304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:57.514040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'788","reported_seq":2213,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.232005+0000","last_change":"2024-09-12T17:21:58.790046+0000","last_active":"2024-09-12T18:01:03.232005+0000","last_peered":"2024-09-12T18:01:03.232005+0000","last_clean":"2024-09-12T18:01:03.232005+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:01:03.232005+0000","last_undegraded":"2024-09-12T18:01:03.232005+0000","last_fullsized":"2024-09-12T18:01:03.232005+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:36.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'222","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.951156+0000","last_change":"2024-09-12T17:22:00.795256+0000","last_active":"2024-09-12T18:00:54.951156+0000","last_peered":"2024-09-12T18:00:54.951156+0000","last_clean":"2024-09-12T18:00:54.951156+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:00:54.951156+0000","last_undegraded":"2024-09-12T18:00:54.951156+0000","last_fullsized":"2024-09-12T18:00:54.951156+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:18.506943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'715","reported_seq":1977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.102558+0000","last_change":"2024-09-12T18:01:28.102558+0000","last_active":"2024-09-12T18:01:28.102558+0000","last_peered":"2024-09-12T18:01:28.102558+0000","last_clean":"2024-09-12T18:01:28.102558+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T18:01:28.102558+0000","last_undegraded":"2024-09-12T18:01:28.102558+0000","last_fullsized":"2024-09-12T18:01:28.102558+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'715","last_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_deep_scrub":"265'715","last_deep_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.102443+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:34.202300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'416","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.092314+0000","last_change":"2024-09-12T18:01:11.092314+0000","last_active":"2024-09-12T18:01:11.092314+0000","last_peered":"2024-09-12T18:01:11.092314+0000","last_clean":"2024-09-12T18:01:11.092314+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T18:01:11.092314+0000","last_undegraded":"2024-09-12T18:01:11.092314+0000","last_fullsized":"2024-09-12T18:01:11.092314+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.092136+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:29.744238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":18208,"num_write":1467,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020236+0000","last_change":"2024-09-12T17:21:54.755690+0000","last_active":"2024-09-12T17:58:12.020236+0000","last_peered":"2024-09-12T17:58:12.020236+0000","last_clean":"2024-09-12T17:58:12.020236+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T17:58:12.020236+0000","last_undegraded":"2024-09-12T17:58:12.020236+0000","last_fullsized":"2024-09-12T17:58:12.020236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.998087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'278","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.134043+0000","last_change":"2024-09-12T17:21:56.765160+0000","last_active":"2024-09-12T18:01:04.134043+0000","last_peered":"2024-09-12T18:01:04.134043+0000","last_clean":"2024-09-12T18:01:04.134043+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:01:04.134043+0000","last_undegraded":"2024-09-12T18:01:04.134043+0000","last_fullsized":"2024-09-12T18:01:04.134043+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:14.179700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1135,"num_write":384,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'810","reported_seq":2313,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.907282+0000","last_change":"2024-09-12T17:21:58.787567+0000","last_active":"2024-09-12T18:01:02.907282+0000","last_peered":"2024-09-12T18:01:02.907282+0000","last_clean":"2024-09-12T18:01:02.907282+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:02.907282+0000","last_undegraded":"2024-09-12T18:01:02.907282+0000","last_fullsized":"2024-09-12T18:01:02.907282+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:46.462958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'420","reported_seq":1985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.008093+0000","last_change":"2024-09-12T17:21:52.748275+0000","last_active":"2024-09-12T18:00:55.008093+0000","last_peered":"2024-09-12T18:00:55.008093+0000","last_clean":"2024-09-12T18:00:55.008093+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:00:55.008093+0000","last_undegraded":"2024-09-12T18:00:55.008093+0000","last_fullsized":"2024-09-12T18:00:55.008093+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:17.610168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'329","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.822719+0000","last_change":"2024-09-12T18:01:09.822719+0000","last_active":"2024-09-12T18:01:09.822719+0000","last_peered":"2024-09-12T18:01:09.822719+0000","last_clean":"2024-09-12T18:01:09.822719+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T18:01:09.822719+0000","last_undegraded":"2024-09-12T18:01:09.822719+0000","last_fullsized":"2024-09-12T18:01:09.822719+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.822608+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:13.917726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":438,"num_read_kb":9180,"num_write":1028,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"265'6","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.204893+0000","last_change":"2024-09-12T18:01:24.204893+0000","last_active":"2024-09-12T18:01:24.204893+0000","last_peered":"2024-09-12T18:01:24.204893+0000","last_clean":"2024-09-12T18:01:24.204893+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:01:24.204893+0000","last_undegraded":"2024-09-12T18:01:24.204893+0000","last_fullsized":"2024-09-12T18:01:24.204893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.204776+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.761047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'319","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.723540+0000","last_change":"2024-09-12T18:01:26.723540+0000","last_active":"2024-09-12T18:01:26.723540+0000","last_peered":"2024-09-12T18:01:26.723540+0000","last_clean":"2024-09-12T18:01:26.723540+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T18:01:26.723540+0000","last_undegraded":"2024-09-12T18:01:26.723540+0000","last_fullsized":"2024-09-12T18:01:26.723540+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.723419+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:46.051413+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42323,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1094,"num_write":406,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133829+0000","last_change":"2024-09-12T17:21:58.785030+0000","last_active":"2024-09-12T17:58:02.133829+0000","last_peered":"2024-09-12T17:58:02.133829+0000","last_clean":"2024-09-12T17:58:02.133829+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T17:58:02.133829+0000","last_undegraded":"2024-09-12T17:58:02.133829+0000","last_fullsized":"2024-09-12T17:58:02.133829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:09.008553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'541","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.118388+0000","last_change":"2024-09-12T17:22:00.792070+0000","last_active":"2024-09-12T18:00:56.118388+0000","last_peered":"2024-09-12T18:00:56.118388+0000","last_clean":"2024-09-12T18:00:56.118388+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:00:56.118388+0000","last_undegraded":"2024-09-12T18:00:56.118388+0000","last_fullsized":"2024-09-12T18:00:56.118388+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:34.644522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'854","reported_seq":2404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.150958+0000","last_change":"2024-09-12T18:01:13.150958+0000","last_active":"2024-09-12T18:01:13.150958+0000","last_peered":"2024-09-12T18:01:13.150958+0000","last_clean":"2024-09-12T18:01:13.150958+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T18:01:13.150958+0000","last_undegraded":"2024-09-12T18:01:13.150958+0000","last_fullsized":"2024-09-12T18:01:13.150958+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'854","last_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_deep_scrub":"265'854","last_deep_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.150845+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.897083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'342","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.910415+0000","last_change":"2024-09-12T18:01:10.910415+0000","last_active":"2024-09-12T18:01:10.910415+0000","last_peered":"2024-09-12T18:01:10.910415+0000","last_clean":"2024-09-12T18:01:10.910415+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T18:01:10.910415+0000","last_undegraded":"2024-09-12T18:01:10.910415+0000","last_fullsized":"2024-09-12T18:01:10.910415+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.910294+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:18.320214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372398,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":25919,"num_write":1097,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.139539+0000","last_change":"2024-09-12T17:21:54.751975+0000","last_active":"2024-09-12T17:58:47.139539+0000","last_peered":"2024-09-12T17:58:47.139539+0000","last_clean":"2024-09-12T17:58:47.139539+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T17:58:47.139539+0000","last_undegraded":"2024-09-12T17:58:47.139539+0000","last_fullsized":"2024-09-12T17:58:47.139539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:39.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'274","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.381419+0000","last_change":"2024-09-12T17:21:56.763953+0000","last_active":"2024-09-12T18:01:03.381419+0000","last_peered":"2024-09-12T18:01:03.381419+0000","last_clean":"2024-09-12T18:01:03.381419+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:01:03.381419+0000","last_undegraded":"2024-09-12T18:01:03.381419+0000","last_fullsized":"2024-09-12T18:01:03.381419+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:57.115467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1078,"num_write":370,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.027075+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:59:02.027075+0000","last_peered":"2024-09-12T17:59:02.027075+0000","last_clean":"2024-09-12T17:59:02.027075+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T17:59:02.027075+0000","last_undegraded":"2024-09-12T17:59:02.027075+0000","last_fullsized":"2024-09-12T17:59:02.027075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'97","reported_seq":580,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.140607+0000","last_change":"2024-09-12T17:22:00.792783+0000","last_active":"2024-09-12T17:59:37.140607+0000","last_peered":"2024-09-12T17:59:37.140607+0000","last_clean":"2024-09-12T17:59:37.140607+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T17:59:37.140607+0000","last_undegraded":"2024-09-12T17:59:37.140607+0000","last_fullsized":"2024-09-12T17:59:37.140607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:57.921660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'383","reported_seq":1862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.965058+0000","last_change":"2024-09-12T18:01:19.965058+0000","last_active":"2024-09-12T18:01:19.965058+0000","last_peered":"2024-09-12T18:01:19.965058+0000","last_clean":"2024-09-12T18:01:19.965058+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T18:01:19.965058+0000","last_undegraded":"2024-09-12T18:01:19.965058+0000","last_fullsized":"2024-09-12T18:01:19.965058+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.964971+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:27.371182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'389","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.511378+0000","last_change":"2024-09-12T18:01:20.511378+0000","last_active":"2024-09-12T18:01:20.511378+0000","last_peered":"2024-09-12T18:01:20.511378+0000","last_clean":"2024-09-12T18:01:20.511378+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T18:01:20.511378+0000","last_undegraded":"2024-09-12T18:01:20.511378+0000","last_fullsized":"2024-09-12T18:01:20.511378+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.511198+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:06.731878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":11787,"num_write":1282,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'3","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.669612+0000","last_change":"2024-09-12T17:21:54.749892+0000","last_active":"2024-09-12T18:01:02.669612+0000","last_peered":"2024-09-12T18:01:02.669612+0000","last_clean":"2024-09-12T18:01:02.669612+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:02.669612+0000","last_undegraded":"2024-09-12T18:01:02.669612+0000","last_fullsized":"2024-09-12T18:01:02.669612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:07.627632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'241","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.973028+0000","last_change":"2024-09-12T17:21:56.767379+0000","last_active":"2024-09-12T18:01:04.973028+0000","last_peered":"2024-09-12T18:01:04.973028+0000","last_clean":"2024-09-12T18:01:04.973028+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:01:04.973028+0000","last_undegraded":"2024-09-12T18:01:04.973028+0000","last_fullsized":"2024-09-12T18:01:04.973028+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:36.431381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14789,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":830,"num_write":302,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'809","reported_seq":6238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.908183+0000","last_change":"2024-09-12T17:21:58.786457+0000","last_active":"2024-09-12T18:01:02.908183+0000","last_peered":"2024-09-12T18:01:02.908183+0000","last_clean":"2024-09-12T18:01:02.908183+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:02.908183+0000","last_undegraded":"2024-09-12T18:01:02.908183+0000","last_fullsized":"2024-09-12T18:01:02.908183+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:35.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'97","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:55.003698+0000","last_change":"2024-09-12T17:22:00.795600+0000","last_active":"2024-09-12T18:00:55.003698+0000","last_peered":"2024-09-12T18:00:55.003698+0000","last_clean":"2024-09-12T18:00:55.003698+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:00:55.003698+0000","last_undegraded":"2024-09-12T18:00:55.003698+0000","last_fullsized":"2024-09-12T18:00:55.003698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:12.865071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'888","reported_seq":2509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.082366+0000","last_change":"2024-09-12T18:01:26.082366+0000","last_active":"2024-09-12T18:01:26.082366+0000","last_peered":"2024-09-12T18:01:26.082366+0000","last_clean":"2024-09-12T18:01:26.082366+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T18:01:26.082366+0000","last_undegraded":"2024-09-12T18:01:26.082366+0000","last_fullsized":"2024-09-12T18:01:26.082366+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'888","last_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_deep_scrub":"265'888","last_deep_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.082271+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:57.896478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'333","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.854293+0000","last_change":"2024-09-12T18:01:08.854293+0000","last_active":"2024-09-12T18:01:08.854293+0000","last_peered":"2024-09-12T18:01:08.854293+0000","last_clean":"2024-09-12T18:01:08.854293+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T18:01:08.854293+0000","last_undegraded":"2024-09-12T18:01:08.854293+0000","last_fullsized":"2024-09-12T18:01:08.854293+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_clean_scrub_stamp":"2024-09-12T18:01:08.854202+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:07.060997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":4507,"num_write":1037,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.368958+0000","last_change":"2024-09-12T18:01:26.368958+0000","last_active":"2024-09-12T18:01:26.368958+0000","last_peered":"2024-09-12T18:01:26.368958+0000","last_clean":"2024-09-12T18:01:26.368958+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T18:01:26.368958+0000","last_undegraded":"2024-09-12T18:01:26.368958+0000","last_fullsized":"2024-09-12T18:01:26.368958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.368881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:04.679223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'459","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.117105+0000","last_change":"2024-09-12T17:21:56.761927+0000","last_active":"2024-09-12T18:01:05.117105+0000","last_peered":"2024-09-12T18:01:05.117105+0000","last_clean":"2024-09-12T18:01:05.117105+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:01:05.117105+0000","last_undegraded":"2024-09-12T18:01:05.117105+0000","last_fullsized":"2024-09-12T18:01:05.117105+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:22.363422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91621,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":2003,"num_write":680,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138304+0000","last_change":"2024-09-12T17:21:58.789916+0000","last_active":"2024-09-12T17:58:48.138304+0000","last_peered":"2024-09-12T17:58:48.138304+0000","last_clean":"2024-09-12T17:58:48.138304+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T17:58:48.138304+0000","last_undegraded":"2024-09-12T17:58:48.138304+0000","last_fullsized":"2024-09-12T17:58:48.138304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'118","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.360795+0000","last_change":"2024-09-12T17:22:00.797337+0000","last_active":"2024-09-12T17:59:34.360795+0000","last_peered":"2024-09-12T17:59:34.360795+0000","last_clean":"2024-09-12T17:59:34.360795+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T17:59:34.360795+0000","last_undegraded":"2024-09-12T17:59:34.360795+0000","last_fullsized":"2024-09-12T17:59:34.360795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.474417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1098","reported_seq":2467,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.690325+0000","last_change":"2024-09-12T18:01:16.690325+0000","last_active":"2024-09-12T18:01:16.690325+0000","last_peered":"2024-09-12T18:01:16.690325+0000","last_clean":"2024-09-12T18:01:16.690325+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T18:01:16.690325+0000","last_undegraded":"2024-09-12T18:01:16.690325+0000","last_fullsized":"2024-09-12T18:01:16.690325+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1098","last_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_deep_scrub":"265'1098","last_deep_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.690238+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:56.957860+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'388","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.423542+0000","last_change":"2024-09-12T18:01:13.423542+0000","last_active":"2024-09-12T18:01:13.423542+0000","last_peered":"2024-09-12T18:01:13.423542+0000","last_clean":"2024-09-12T18:01:13.423542+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T18:01:13.423542+0000","last_undegraded":"2024-09-12T18:01:13.423542+0000","last_fullsized":"2024-09-12T18:01:13.423542+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.423366+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.728247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":4065,"num_write":1151,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.459436+0000","last_change":"2024-09-12T18:01:24.459436+0000","last_active":"2024-09-12T18:01:24.459436+0000","last_peered":"2024-09-12T18:01:24.459436+0000","last_clean":"2024-09-12T18:01:24.459436+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T18:01:24.459436+0000","last_undegraded":"2024-09-12T18:01:24.459436+0000","last_fullsized":"2024-09-12T18:01:24.459436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.459346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:56.562856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'276","reported_seq":843,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.664588+0000","last_change":"2024-09-12T17:21:56.766601+0000","last_active":"2024-09-12T18:01:03.664588+0000","last_peered":"2024-09-12T18:01:03.664588+0000","last_clean":"2024-09-12T18:01:03.664588+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:01:03.664588+0000","last_undegraded":"2024-09-12T18:01:03.664588+0000","last_fullsized":"2024-09-12T18:01:03.664588+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:02.002328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46038,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":1069,"num_write":430,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138983+0000","last_change":"2024-09-12T17:21:58.780947+0000","last_active":"2024-09-12T17:58:05.138983+0000","last_peered":"2024-09-12T17:58:05.138983+0000","last_clean":"2024-09-12T17:58:05.138983+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T17:58:05.138983+0000","last_undegraded":"2024-09-12T17:58:05.138983+0000","last_fullsized":"2024-09-12T17:58:05.138983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.674014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'125","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:45.147948+0000","last_change":"2024-09-12T17:22:00.794120+0000","last_active":"2024-09-12T18:00:45.147948+0000","last_peered":"2024-09-12T18:00:45.147948+0000","last_clean":"2024-09-12T18:00:45.147948+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:00:45.147948+0000","last_undegraded":"2024-09-12T18:00:45.147948+0000","last_fullsized":"2024-09-12T18:00:45.147948+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.905380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'852","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.130052+0000","last_change":"2024-09-12T17:21:52.744001+0000","last_active":"2024-09-12T17:59:18.130052+0000","last_peered":"2024-09-12T17:59:18.130052+0000","last_clean":"2024-09-12T17:59:18.130052+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T17:59:18.130052+0000","last_undegraded":"2024-09-12T17:59:18.130052+0000","last_fullsized":"2024-09-12T17:59:18.130052+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.116207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'294","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.520281+0000","last_change":"2024-09-12T18:01:14.520281+0000","last_active":"2024-09-12T18:01:14.520281+0000","last_peered":"2024-09-12T18:01:14.520281+0000","last_clean":"2024-09-12T18:01:14.520281+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T18:01:14.520281+0000","last_undegraded":"2024-09-12T18:01:14.520281+0000","last_fullsized":"2024-09-12T18:01:14.520281+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.520053+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:15.981715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":437,"num_read_kb":12213,"num_write":961,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.131531+0000","last_change":"2024-09-12T17:21:54.753927+0000","last_active":"2024-09-12T17:57:58.131531+0000","last_peered":"2024-09-12T17:57:58.131531+0000","last_clean":"2024-09-12T17:57:58.131531+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T17:57:58.131531+0000","last_undegraded":"2024-09-12T17:57:58.131531+0000","last_fullsized":"2024-09-12T17:57:58.131531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:03.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'275","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.166129+0000","last_change":"2024-09-12T17:21:56.769847+0000","last_active":"2024-09-12T18:01:03.166129+0000","last_peered":"2024-09-12T18:01:03.166129+0000","last_clean":"2024-09-12T18:01:03.166129+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:03.166129+0000","last_undegraded":"2024-09-12T18:01:03.166129+0000","last_fullsized":"2024-09-12T18:01:03.166129+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:50.849719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":997,"num_write":362,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'771","reported_seq":2293,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.357248+0000","last_change":"2024-09-12T18:01:29.357248+0000","last_active":"2024-09-12T18:01:29.357248+0000","last_peered":"2024-09-12T18:01:29.357248+0000","last_clean":"2024-09-12T18:01:29.357248+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:01:29.357248+0000","last_undegraded":"2024-09-12T18:01:29.357248+0000","last_fullsized":"2024-09-12T18:01:29.357248+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.357164+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:53.556672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'91","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.238731+0000","last_change":"2024-09-12T17:22:00.788149+0000","last_active":"2024-09-12T17:59:08.238731+0000","last_peered":"2024-09-12T17:59:08.238731+0000","last_clean":"2024-09-12T17:59:08.238731+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T17:59:08.238731+0000","last_undegraded":"2024-09-12T17:59:08.238731+0000","last_fullsized":"2024-09-12T17:59:08.238731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:52.865371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'396","reported_seq":1807,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.965656+0000","last_change":"2024-09-12T18:01:17.965656+0000","last_active":"2024-09-12T18:01:17.965656+0000","last_peered":"2024-09-12T18:01:17.965656+0000","last_clean":"2024-09-12T18:01:17.965656+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T18:01:17.965656+0000","last_undegraded":"2024-09-12T18:01:17.965656+0000","last_fullsized":"2024-09-12T18:01:17.965656+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.965565+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:50.887093+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.514617+0000","last_change":"2024-09-12T18:01:15.514617+0000","last_active":"2024-09-12T18:01:15.514617+0000","last_peered":"2024-09-12T18:01:15.514617+0000","last_clean":"2024-09-12T18:01:15.514617+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T18:01:15.514617+0000","last_undegraded":"2024-09-12T18:01:15.514617+0000","last_fullsized":"2024-09-12T18:01:15.514617+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.514479+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.305976+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":2738,"num_write":1044,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.223394+0000","last_change":"2024-09-12T18:01:25.223394+0000","last_active":"2024-09-12T18:01:25.223394+0000","last_peered":"2024-09-12T18:01:25.223394+0000","last_clean":"2024-09-12T18:01:25.223394+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:01:25.223394+0000","last_undegraded":"2024-09-12T18:01:25.223394+0000","last_fullsized":"2024-09-12T18:01:25.223394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.223302+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:28.092756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'76","reported_seq":585,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:07.935202+0000","last_change":"2024-09-12T17:21:56.766705+0000","last_active":"2024-09-12T17:59:07.935202+0000","last_peered":"2024-09-12T17:59:07.935202+0000","last_clean":"2024-09-12T17:59:07.935202+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T17:59:07.935202+0000","last_undegraded":"2024-09-12T17:59:07.935202+0000","last_fullsized":"2024-09-12T17:59:07.935202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.416717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.435319+0000","last_change":"2024-09-12T17:21:58.775054+0000","last_active":"2024-09-12T18:01:03.435319+0000","last_peered":"2024-09-12T18:01:03.435319+0000","last_clean":"2024-09-12T18:01:03.435319+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:01:03.435319+0000","last_undegraded":"2024-09-12T18:01:03.435319+0000","last_fullsized":"2024-09-12T18:01:03.435319+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:40.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'123","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.753528+0000","last_change":"2024-09-12T17:22:00.796406+0000","last_active":"2024-09-12T17:59:06.753528+0000","last_peered":"2024-09-12T17:59:06.753528+0000","last_clean":"2024-09-12T17:59:06.753528+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T17:59:06.753528+0000","last_undegraded":"2024-09-12T17:59:06.753528+0000","last_fullsized":"2024-09-12T17:59:06.753528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:55.110524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'768","reported_seq":2400,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.479454+0000","last_change":"2024-09-12T18:01:16.479454+0000","last_active":"2024-09-12T18:01:16.479454+0000","last_peered":"2024-09-12T18:01:16.479454+0000","last_clean":"2024-09-12T18:01:16.479454+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T18:01:16.479454+0000","last_undegraded":"2024-09-12T18:01:16.479454+0000","last_fullsized":"2024-09-12T18:01:16.479454+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'768","last_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_deep_scrub":"265'768","last_deep_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.479358+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:38.320465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.882054+0000","last_change":"2024-09-12T18:01:14.882054+0000","last_active":"2024-09-12T18:01:14.882054+0000","last_peered":"2024-09-12T18:01:14.882054+0000","last_clean":"2024-09-12T18:01:14.882054+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T18:01:14.882054+0000","last_undegraded":"2024-09-12T18:01:14.882054+0000","last_fullsized":"2024-09-12T18:01:14.882054+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.881906+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:47.911992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":10060,"num_write":877,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:57.017784+0000","last_change":"2024-09-12T17:21:54.755944+0000","last_active":"2024-09-12T17:57:57.017784+0000","last_peered":"2024-09-12T17:57:57.017784+0000","last_clean":"2024-09-12T17:57:57.017784+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T17:57:57.017784+0000","last_undegraded":"2024-09-12T17:57:57.017784+0000","last_fullsized":"2024-09-12T17:57:57.017784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:30.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'319","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.598430+0000","last_change":"2024-09-12T17:21:56.769845+0000","last_active":"2024-09-12T18:01:04.598430+0000","last_peered":"2024-09-12T18:01:04.598430+0000","last_clean":"2024-09-12T18:01:04.598430+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:01:04.598430+0000","last_undegraded":"2024-09-12T18:01:04.598430+0000","last_fullsized":"2024-09-12T18:01:04.598430+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.744587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46691,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1100,"num_read_kb":1651,"num_write":1580,"num_write_kb":1458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.169136+0000","last_change":"2024-09-12T17:21:58.783566+0000","last_active":"2024-09-12T17:58:02.169136+0000","last_peered":"2024-09-12T17:58:02.169136+0000","last_clean":"2024-09-12T17:58:02.169136+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T17:58:02.169136+0000","last_undegraded":"2024-09-12T17:58:02.169136+0000","last_fullsized":"2024-09-12T17:58:02.169136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:16.155795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'100","reported_seq":584,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.982177+0000","last_change":"2024-09-12T17:22:00.795820+0000","last_active":"2024-09-12T17:59:06.982177+0000","last_peered":"2024-09-12T17:59:06.982177+0000","last_clean":"2024-09-12T17:59:06.982177+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T17:59:06.982177+0000","last_undegraded":"2024-09-12T17:59:06.982177+0000","last_fullsized":"2024-09-12T17:59:06.982177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:47.982837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'458","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.171017+0000","last_change":"2024-09-12T17:21:52.747649+0000","last_active":"2024-09-12T17:59:16.171017+0000","last_peered":"2024-09-12T17:59:16.171017+0000","last_clean":"2024-09-12T17:59:16.171017+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T17:59:16.171017+0000","last_undegraded":"2024-09-12T17:59:16.171017+0000","last_fullsized":"2024-09-12T17:59:16.171017+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:32.995329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.117716+0000","last_change":"2024-09-12T18:01:09.117716+0000","last_active":"2024-09-12T18:01:09.117716+0000","last_peered":"2024-09-12T18:01:09.117716+0000","last_clean":"2024-09-12T18:01:09.117716+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T18:01:09.117716+0000","last_undegraded":"2024-09-12T18:01:09.117716+0000","last_fullsized":"2024-09-12T18:01:09.117716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.117622+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:48.788505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.420686+0000","last_change":"2024-09-12T18:01:12.420634+0000","last_active":"2024-09-12T18:01:12.420686+0000","last_peered":"2024-09-12T18:01:12.420686+0000","last_clean":"2024-09-12T18:01:12.420686+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T18:01:12.420686+0000","last_undegraded":"2024-09-12T18:01:12.420686+0000","last_fullsized":"2024-09-12T18:01:12.420686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.420560+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:05.743402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'352","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.926268+0000","last_change":"2024-09-12T18:01:10.926183+0000","last_active":"2024-09-12T18:01:10.926268+0000","last_peered":"2024-09-12T18:01:10.926268+0000","last_clean":"2024-09-12T18:01:10.926268+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T18:01:10.926268+0000","last_undegraded":"2024-09-12T18:01:10.926268+0000","last_fullsized":"2024-09-12T18:01:10.926268+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.925996+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.144031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2336230,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":631,"num_read_kb":42380,"num_write":1169,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012494+0000","last_change":"2024-09-12T17:21:54.750180+0000","last_active":"2024-09-12T17:57:22.012494+0000","last_peered":"2024-09-12T17:57:22.012494+0000","last_clean":"2024-09-12T17:57:22.012494+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T17:57:22.012494+0000","last_undegraded":"2024-09-12T17:57:22.012494+0000","last_fullsized":"2024-09-12T17:57:22.012494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:24.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'737","reported_seq":1436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.743655+0000","last_change":"2024-09-12T17:21:56.765494+0000","last_active":"2024-09-12T18:01:04.743655+0000","last_peered":"2024-09-12T18:01:04.743655+0000","last_clean":"2024-09-12T18:01:04.743655+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:01:04.743655+0000","last_undegraded":"2024-09-12T18:01:04.743655+0000","last_fullsized":"2024-09-12T18:01:04.743655+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:08.857619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169172,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1452,"num_read_kb":3379,"num_write":1380,"num_write_kb":1257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138445+0000","last_change":"2024-09-12T17:21:58.788291+0000","last_active":"2024-09-12T17:58:48.138445+0000","last_peered":"2024-09-12T17:58:48.138445+0000","last_clean":"2024-09-12T17:58:48.138445+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T17:58:48.138445+0000","last_undegraded":"2024-09-12T17:58:48.138445+0000","last_fullsized":"2024-09-12T17:58:48.138445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:07.437948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'195","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.775559+0000","last_change":"2024-09-12T17:22:00.796574+0000","last_active":"2024-09-12T17:59:34.775559+0000","last_peered":"2024-09-12T17:59:34.775559+0000","last_clean":"2024-09-12T17:59:34.775559+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T17:59:34.775559+0000","last_undegraded":"2024-09-12T17:59:34.775559+0000","last_fullsized":"2024-09-12T17:59:34.775559+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.468190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'470","reported_seq":2002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.056494+0000","last_change":"2024-09-12T18:01:25.056494+0000","last_active":"2024-09-12T18:01:25.056494+0000","last_peered":"2024-09-12T18:01:25.056494+0000","last_clean":"2024-09-12T18:01:25.056494+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T18:01:25.056494+0000","last_undegraded":"2024-09-12T18:01:25.056494+0000","last_fullsized":"2024-09-12T18:01:25.056494+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.056406+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.664820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.447676+0000","last_change":"2024-09-12T18:01:10.447676+0000","last_active":"2024-09-12T18:01:10.447676+0000","last_peered":"2024-09-12T18:01:10.447676+0000","last_clean":"2024-09-12T18:01:10.447676+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T18:01:10.447676+0000","last_undegraded":"2024-09-12T18:01:10.447676+0000","last_fullsized":"2024-09-12T18:01:10.447676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.447603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.379942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'393","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.197108+0000","last_change":"2024-09-12T18:01:12.197015+0000","last_active":"2024-09-12T18:01:12.197108+0000","last_peered":"2024-09-12T18:01:12.197108+0000","last_clean":"2024-09-12T18:01:12.197108+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T18:01:12.197108+0000","last_undegraded":"2024-09-12T18:01:12.197108+0000","last_fullsized":"2024-09-12T18:01:12.197108+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.196860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:38.459956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":13401,"num_write":1361,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.024531+0000","last_change":"2024-09-12T17:21:54.755790+0000","last_active":"2024-09-12T17:58:47.024531+0000","last_peered":"2024-09-12T17:58:47.024531+0000","last_clean":"2024-09-12T17:58:47.024531+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T17:58:47.024531+0000","last_undegraded":"2024-09-12T17:58:47.024531+0000","last_fullsized":"2024-09-12T17:58:47.024531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:59.470297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.335085+0000","last_change":"2024-09-12T18:01:27.335085+0000","last_active":"2024-09-12T18:01:27.335085+0000","last_peered":"2024-09-12T18:01:27.335085+0000","last_clean":"2024-09-12T18:01:27.335085+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:01:27.335085+0000","last_undegraded":"2024-09-12T18:01:27.335085+0000","last_fullsized":"2024-09-12T18:01:27.335085+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.334961+0000","objects_scrubbed":12,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:37.159404+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161465,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1982,"num_read_kb":3789,"num_write":1078,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:32.014403+0000","last_change":"2024-09-12T17:21:58.790253+0000","last_active":"2024-09-12T17:57:32.014403+0000","last_peered":"2024-09-12T17:57:32.014403+0000","last_clean":"2024-09-12T17:57:32.014403+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T17:57:32.014403+0000","last_undegraded":"2024-09-12T17:57:32.014403+0000","last_fullsized":"2024-09-12T17:57:32.014403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:47.790212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'133","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.899620+0000","last_change":"2024-09-12T17:22:00.798051+0000","last_active":"2024-09-12T17:59:12.899620+0000","last_peered":"2024-09-12T17:59:12.899620+0000","last_clean":"2024-09-12T17:59:12.899620+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T17:59:12.899620+0000","last_undegraded":"2024-09-12T17:59:12.899620+0000","last_fullsized":"2024-09-12T17:59:12.899620+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'450","reported_seq":1966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.237463+0000","last_change":"2024-09-12T18:01:19.237463+0000","last_active":"2024-09-12T18:01:19.237463+0000","last_peered":"2024-09-12T18:01:19.237463+0000","last_clean":"2024-09-12T18:01:19.237463+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T18:01:19.237463+0000","last_undegraded":"2024-09-12T18:01:19.237463+0000","last_fullsized":"2024-09-12T18:01:19.237463+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'450","last_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_deep_scrub":"265'450","last_deep_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.237381+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:11.813533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.385055+0000","last_change":"2024-09-12T18:01:12.385001+0000","last_active":"2024-09-12T18:01:12.385055+0000","last_peered":"2024-09-12T18:01:12.385055+0000","last_clean":"2024-09-12T18:01:12.385055+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T18:01:12.385055+0000","last_undegraded":"2024-09-12T18:01:12.385055+0000","last_fullsized":"2024-09-12T18:01:12.385055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.384902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:54.391667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'374","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.983349+0000","last_change":"2024-09-12T18:01:11.983349+0000","last_active":"2024-09-12T18:01:11.983349+0000","last_peered":"2024-09-12T18:01:11.983349+0000","last_clean":"2024-09-12T18:01:11.983349+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:11.983349+0000","last_undegraded":"2024-09-12T18:01:11.983349+0000","last_fullsized":"2024-09-12T18:01:11.983349+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.983172+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:23.268960+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730187,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":557,"num_read_kb":34998,"num_write":1154,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.411308+0000","last_change":"2024-09-12T18:01:25.411308+0000","last_active":"2024-09-12T18:01:25.411308+0000","last_peered":"2024-09-12T18:01:25.411308+0000","last_clean":"2024-09-12T18:01:25.411308+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T18:01:25.411308+0000","last_undegraded":"2024-09-12T18:01:25.411308+0000","last_fullsized":"2024-09-12T18:01:25.411308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.411217+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:45.178080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'204","reported_seq":1221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.676351+0000","last_change":"2024-09-12T18:01:25.676351+0000","last_active":"2024-09-12T18:01:25.676351+0000","last_peered":"2024-09-12T18:01:25.676351+0000","last_clean":"2024-09-12T18:01:25.676351+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:01:25.676351+0000","last_undegraded":"2024-09-12T18:01:25.676351+0000","last_fullsized":"2024-09-12T18:01:25.676351+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'204","last_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_deep_scrub":"265'204","last_deep_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.676244+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:26.820945+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013880+0000","last_change":"2024-09-12T17:21:58.787288+0000","last_active":"2024-09-12T17:57:27.013880+0000","last_peered":"2024-09-12T17:57:27.013880+0000","last_clean":"2024-09-12T17:57:27.013880+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T17:57:27.013880+0000","last_undegraded":"2024-09-12T17:57:27.013880+0000","last_fullsized":"2024-09-12T17:57:27.013880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.278913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'288","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.917584+0000","last_change":"2024-09-12T17:22:00.794526+0000","last_active":"2024-09-12T17:59:34.917584+0000","last_peered":"2024-09-12T17:59:34.917584+0000","last_clean":"2024-09-12T17:59:34.917584+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T17:59:34.917584+0000","last_undegraded":"2024-09-12T17:59:34.917584+0000","last_fullsized":"2024-09-12T17:59:34.917584+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:11.669153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'471","reported_seq":2090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.224929+0000","last_change":"2024-09-12T18:01:20.224814+0000","last_active":"2024-09-12T18:01:20.224929+0000","last_peered":"2024-09-12T18:01:20.224929+0000","last_clean":"2024-09-12T18:01:20.224929+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:01:20.224929+0000","last_undegraded":"2024-09-12T18:01:20.224929+0000","last_fullsized":"2024-09-12T18:01:20.224929+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.224700+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.621486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2751,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.470570+0000","last_change":"2024-09-12T18:01:11.470497+0000","last_active":"2024-09-12T18:01:11.470570+0000","last_peered":"2024-09-12T18:01:11.470570+0000","last_clean":"2024-09-12T18:01:11.470570+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T18:01:11.470570+0000","last_undegraded":"2024-09-12T18:01:11.470570+0000","last_fullsized":"2024-09-12T18:01:11.470570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.470415+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:45.118041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'409","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.756765+0000","last_change":"2024-09-12T18:01:13.756692+0000","last_active":"2024-09-12T18:01:13.756765+0000","last_peered":"2024-09-12T18:01:13.756765+0000","last_clean":"2024-09-12T18:01:13.756765+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T18:01:13.756765+0000","last_undegraded":"2024-09-12T18:01:13.756765+0000","last_fullsized":"2024-09-12T18:01:13.756765+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.756554+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:52.180446+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3307398,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":11802,"num_write":1361,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.460871+0000","last_change":"2024-09-12T18:01:22.460871+0000","last_active":"2024-09-12T18:01:22.460871+0000","last_peered":"2024-09-12T18:01:22.460871+0000","last_clean":"2024-09-12T18:01:22.460871+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T18:01:22.460871+0000","last_undegraded":"2024-09-12T18:01:22.460871+0000","last_fullsized":"2024-09-12T18:01:22.460871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.460761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:40.754930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'103","reported_seq":628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.240568+0000","last_change":"2024-09-12T17:21:56.763840+0000","last_active":"2024-09-12T18:00:56.240568+0000","last_peered":"2024-09-12T18:00:56.240568+0000","last_clean":"2024-09-12T18:00:56.240568+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:00:56.240568+0000","last_undegraded":"2024-09-12T18:00:56.240568+0000","last_fullsized":"2024-09-12T18:00:56.240568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:23.362341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025180+0000","last_change":"2024-09-12T17:21:58.789360+0000","last_active":"2024-09-12T17:58:52.025180+0000","last_peered":"2024-09-12T17:58:52.025180+0000","last_clean":"2024-09-12T17:58:52.025180+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T17:58:52.025180+0000","last_undegraded":"2024-09-12T17:58:52.025180+0000","last_fullsized":"2024-09-12T17:58:52.025180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:51.063573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'141","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.497508+0000","last_change":"2024-09-12T17:22:00.788204+0000","last_active":"2024-09-12T17:59:06.497508+0000","last_peered":"2024-09-12T17:59:06.497508+0000","last_clean":"2024-09-12T17:59:06.497508+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T17:59:06.497508+0000","last_undegraded":"2024-09-12T17:59:06.497508+0000","last_fullsized":"2024-09-12T17:59:06.497508+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:34.479482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'877","reported_seq":2715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.277456+0000","last_change":"2024-09-12T18:01:18.277389+0000","last_active":"2024-09-12T18:01:18.277456+0000","last_peered":"2024-09-12T18:01:18.277456+0000","last_clean":"2024-09-12T18:01:18.277456+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T18:01:18.277456+0000","last_undegraded":"2024-09-12T18:01:18.277456+0000","last_fullsized":"2024-09-12T18:01:18.277456+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'877","last_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_deep_scrub":"265'877","last_deep_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.277308+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:23.770820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'375","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.954746+0000","last_change":"2024-09-12T18:01:09.954746+0000","last_active":"2024-09-12T18:01:09.954746+0000","last_peered":"2024-09-12T18:01:09.954746+0000","last_clean":"2024-09-12T18:01:09.954746+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T18:01:09.954746+0000","last_undegraded":"2024-09-12T18:01:09.954746+0000","last_fullsized":"2024-09-12T18:01:09.954746+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.954652+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:15.491590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":25520,"num_write":1246,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.942208+0000","last_change":"2024-09-12T18:01:10.942149+0000","last_active":"2024-09-12T18:01:10.942208+0000","last_peered":"2024-09-12T18:01:10.942208+0000","last_clean":"2024-09-12T18:01:10.942208+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T18:01:10.942208+0000","last_undegraded":"2024-09-12T18:01:10.942208+0000","last_fullsized":"2024-09-12T18:01:10.942208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.942018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:03.095012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.013014+0000","last_change":"2024-09-12T17:21:54.755491+0000","last_active":"2024-09-12T17:57:22.013014+0000","last_peered":"2024-09-12T17:57:22.013014+0000","last_clean":"2024-09-12T17:57:22.013014+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T17:57:22.013014+0000","last_undegraded":"2024-09-12T17:57:22.013014+0000","last_fullsized":"2024-09-12T17:57:22.013014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:39.242340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'550","reported_seq":1208,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.376661+0000","last_change":"2024-09-12T18:01:26.376661+0000","last_active":"2024-09-12T18:01:26.376661+0000","last_peered":"2024-09-12T18:01:26.376661+0000","last_clean":"2024-09-12T18:01:26.376661+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:01:26.376661+0000","last_undegraded":"2024-09-12T18:01:26.376661+0000","last_fullsized":"2024-09-12T18:01:26.376661+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.376538+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:29.127764+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106777,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":960,"num_read_kb":2265,"num_write":794,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164192+0000","last_change":"2024-09-12T17:21:58.786573+0000","last_active":"2024-09-12T17:57:27.164192+0000","last_peered":"2024-09-12T17:57:27.164192+0000","last_clean":"2024-09-12T17:57:27.164192+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T17:57:27.164192+0000","last_undegraded":"2024-09-12T17:57:27.164192+0000","last_fullsized":"2024-09-12T17:57:27.164192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:30.677838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'166","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.362537+0000","last_change":"2024-09-12T17:22:00.798528+0000","last_active":"2024-09-12T17:59:34.362537+0000","last_peered":"2024-09-12T17:59:34.362537+0000","last_clean":"2024-09-12T17:59:34.362537+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T17:59:34.362537+0000","last_undegraded":"2024-09-12T17:59:34.362537+0000","last_fullsized":"2024-09-12T17:59:34.362537+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:54.854895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'829","reported_seq":2355,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.342186+0000","last_change":"2024-09-12T18:01:24.342131+0000","last_active":"2024-09-12T18:01:24.342186+0000","last_peered":"2024-09-12T18:01:24.342186+0000","last_clean":"2024-09-12T18:01:24.342186+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T18:01:24.342186+0000","last_undegraded":"2024-09-12T18:01:24.342186+0000","last_fullsized":"2024-09-12T18:01:24.342186+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.342040+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:50.354462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1941,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'375","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.187589+0000","last_change":"2024-09-12T18:01:13.187529+0000","last_active":"2024-09-12T18:01:13.187589+0000","last_peered":"2024-09-12T18:01:13.187589+0000","last_clean":"2024-09-12T18:01:13.187589+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T18:01:13.187589+0000","last_undegraded":"2024-09-12T18:01:13.187589+0000","last_fullsized":"2024-09-12T18:01:13.187589+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.187403+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.594187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":578,"num_read_kb":7304,"num_write":1242,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.501217+0000","last_change":"2024-09-12T18:01:17.501129+0000","last_active":"2024-09-12T18:01:17.501217+0000","last_peered":"2024-09-12T18:01:17.501217+0000","last_clean":"2024-09-12T18:01:17.501217+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T18:01:17.501217+0000","last_undegraded":"2024-09-12T18:01:17.501217+0000","last_fullsized":"2024-09-12T18:01:17.501217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.501027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:12.800178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.665652+0000","last_change":"2024-09-12T18:01:24.665652+0000","last_active":"2024-09-12T18:01:24.665652+0000","last_peered":"2024-09-12T18:01:24.665652+0000","last_clean":"2024-09-12T18:01:24.665652+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T18:01:24.665652+0000","last_undegraded":"2024-09-12T18:01:24.665652+0000","last_fullsized":"2024-09-12T18:01:24.665652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.665551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:34.966186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'154","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.144606+0000","last_change":"2024-09-12T17:21:56.762425+0000","last_active":"2024-09-12T17:59:27.144606+0000","last_peered":"2024-09-12T17:59:27.144606+0000","last_clean":"2024-09-12T17:59:27.144606+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T17:59:27.144606+0000","last_undegraded":"2024-09-12T17:59:27.144606+0000","last_fullsized":"2024-09-12T17:59:27.144606+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:35.405866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'806","reported_seq":2569,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.433848+0000","last_change":"2024-09-12T17:21:58.782857+0000","last_active":"2024-09-12T18:01:03.433848+0000","last_peered":"2024-09-12T18:01:03.433848+0000","last_clean":"2024-09-12T18:01:03.433848+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:01:03.433848+0000","last_undegraded":"2024-09-12T18:01:03.433848+0000","last_fullsized":"2024-09-12T18:01:03.433848+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:02.049669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'109","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:20.158995+0000","last_change":"2024-09-12T17:22:00.794639+0000","last_active":"2024-09-12T18:00:20.158995+0000","last_peered":"2024-09-12T18:00:20.158995+0000","last_clean":"2024-09-12T18:00:20.158995+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:00:20.158995+0000","last_undegraded":"2024-09-12T18:00:20.158995+0000","last_fullsized":"2024-09-12T18:00:20.158995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:42.302531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'875","reported_seq":2594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.833708+0000","last_change":"2024-09-12T18:01:16.833708+0000","last_active":"2024-09-12T18:01:16.833708+0000","last_peered":"2024-09-12T18:01:16.833708+0000","last_clean":"2024-09-12T18:01:16.833708+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T18:01:16.833708+0000","last_undegraded":"2024-09-12T18:01:16.833708+0000","last_fullsized":"2024-09-12T18:01:16.833708+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'875","last_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_deep_scrub":"265'875","last_deep_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.833613+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.664041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":649,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'365","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.878116+0000","last_change":"2024-09-12T18:01:13.878116+0000","last_active":"2024-09-12T18:01:13.878116+0000","last_peered":"2024-09-12T18:01:13.878116+0000","last_clean":"2024-09-12T18:01:13.878116+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T18:01:13.878116+0000","last_undegraded":"2024-09-12T18:01:13.878116+0000","last_fullsized":"2024-09-12T18:01:13.878116+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.877983+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.503105+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831558,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":10322,"num_write":1179,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.894172+0000","last_change":"2024-09-12T18:01:11.894172+0000","last_active":"2024-09-12T18:01:11.894172+0000","last_peered":"2024-09-12T18:01:11.894172+0000","last_clean":"2024-09-12T18:01:11.894172+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T18:01:11.894172+0000","last_undegraded":"2024-09-12T18:01:11.894172+0000","last_fullsized":"2024-09-12T18:01:11.894172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.894084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:44.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.012930+0000","last_change":"2024-09-12T17:21:54.758563+0000","last_active":"2024-09-12T17:57:22.012930+0000","last_peered":"2024-09-12T17:57:22.012930+0000","last_clean":"2024-09-12T17:57:22.012930+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T17:57:22.012930+0000","last_undegraded":"2024-09-12T17:57:22.012930+0000","last_fullsized":"2024-09-12T17:57:22.012930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:07.608583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'96","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:06.275920+0000","last_change":"2024-09-12T17:21:56.765131+0000","last_active":"2024-09-12T17:59:06.275920+0000","last_peered":"2024-09-12T17:59:06.275920+0000","last_clean":"2024-09-12T17:59:06.275920+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T17:59:06.275920+0000","last_undegraded":"2024-09-12T17:59:06.275920+0000","last_fullsized":"2024-09-12T17:59:06.275920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:57.138933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'809","reported_seq":2356,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:02.905712+0000","last_change":"2024-09-12T17:21:58.785486+0000","last_active":"2024-09-12T18:01:02.905712+0000","last_peered":"2024-09-12T18:01:02.905712+0000","last_clean":"2024-09-12T18:01:02.905712+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:02.905712+0000","last_undegraded":"2024-09-12T18:01:02.905712+0000","last_fullsized":"2024-09-12T18:01:02.905712+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:06.317754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'325","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.374584+0000","last_change":"2024-09-12T17:22:00.794801+0000","last_active":"2024-09-12T17:59:34.374584+0000","last_peered":"2024-09-12T17:59:34.374584+0000","last_clean":"2024-09-12T17:59:34.374584+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T17:59:34.374584+0000","last_undegraded":"2024-09-12T17:59:34.374584+0000","last_fullsized":"2024-09-12T17:59:34.374584+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:20.169521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'493","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.925408+0000","last_change":"2024-09-12T18:01:16.925347+0000","last_active":"2024-09-12T18:01:16.925408+0000","last_peered":"2024-09-12T18:01:16.925408+0000","last_clean":"2024-09-12T18:01:16.925408+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T18:01:16.925408+0000","last_undegraded":"2024-09-12T18:01:16.925408+0000","last_fullsized":"2024-09-12T18:01:16.925408+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'493","last_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_deep_scrub":"265'493","last_deep_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.925258+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:35.178082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'332","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.877403+0000","last_change":"2024-09-12T18:01:12.877403+0000","last_active":"2024-09-12T18:01:12.877403+0000","last_peered":"2024-09-12T18:01:12.877403+0000","last_clean":"2024-09-12T18:01:12.877403+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T18:01:12.877403+0000","last_undegraded":"2024-09-12T18:01:12.877403+0000","last_fullsized":"2024-09-12T18:01:12.877403+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.877095+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:51.937844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287862,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59240,"num_write":1015,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.467414+0000","last_change":"2024-09-12T18:01:13.467414+0000","last_active":"2024-09-12T18:01:13.467414+0000","last_peered":"2024-09-12T18:01:13.467414+0000","last_clean":"2024-09-12T18:01:13.467414+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T18:01:13.467414+0000","last_undegraded":"2024-09-12T18:01:13.467414+0000","last_fullsized":"2024-09-12T18:01:13.467414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.467313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.884795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:07.019639+0000","last_change":"2024-09-12T17:21:54.752228+0000","last_active":"2024-09-12T17:58:07.019639+0000","last_peered":"2024-09-12T17:58:07.019639+0000","last_clean":"2024-09-12T17:58:07.019639+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T17:58:07.019639+0000","last_undegraded":"2024-09-12T17:58:07.019639+0000","last_fullsized":"2024-09-12T17:58:07.019639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.871367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'746","reported_seq":1455,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.458302+0000","last_change":"2024-09-12T17:21:56.767995+0000","last_active":"2024-09-12T18:01:04.458302+0000","last_peered":"2024-09-12T18:01:04.458302+0000","last_clean":"2024-09-12T18:01:04.458302+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:01:04.458302+0000","last_undegraded":"2024-09-12T18:01:04.458302+0000","last_fullsized":"2024-09-12T18:01:04.458302+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:13.584754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1320,"num_read_kb":3172,"num_write":1088,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013828+0000","last_change":"2024-09-12T17:21:58.783038+0000","last_active":"2024-09-12T17:57:27.013828+0000","last_peered":"2024-09-12T17:57:27.013828+0000","last_clean":"2024-09-12T17:57:27.013828+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T17:57:27.013828+0000","last_undegraded":"2024-09-12T17:57:27.013828+0000","last_fullsized":"2024-09-12T17:57:27.013828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:01.402224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'132","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.226950+0000","last_change":"2024-09-12T17:22:00.789098+0000","last_active":"2024-09-12T17:59:03.226950+0000","last_peered":"2024-09-12T17:59:03.226950+0000","last_clean":"2024-09-12T17:59:03.226950+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T17:59:03.226950+0000","last_undegraded":"2024-09-12T17:59:03.226950+0000","last_fullsized":"2024-09-12T17:59:03.226950+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:23.614418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'152","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.424191+0000","last_change":"2024-09-12T17:22:00.786992+0000","last_active":"2024-09-12T17:59:34.424191+0000","last_peered":"2024-09-12T17:59:34.424191+0000","last_clean":"2024-09-12T17:59:34.424191+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T17:59:34.424191+0000","last_undegraded":"2024-09-12T17:59:34.424191+0000","last_fullsized":"2024-09-12T17:59:34.424191+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:08.329121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'470","reported_seq":2073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.001546+0000","last_change":"2024-09-12T18:01:19.001546+0000","last_active":"2024-09-12T18:01:19.001546+0000","last_peered":"2024-09-12T18:01:19.001546+0000","last_clean":"2024-09-12T18:01:19.001546+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T18:01:19.001546+0000","last_undegraded":"2024-09-12T18:01:19.001546+0000","last_fullsized":"2024-09-12T18:01:19.001546+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.001453+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:36.748667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'322","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.476752+0000","last_change":"2024-09-12T18:01:18.476752+0000","last_active":"2024-09-12T18:01:18.476752+0000","last_peered":"2024-09-12T18:01:18.476752+0000","last_clean":"2024-09-12T18:01:18.476752+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T18:01:18.476752+0000","last_undegraded":"2024-09-12T18:01:18.476752+0000","last_fullsized":"2024-09-12T18:01:18.476752+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.476604+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.563516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":5956,"num_write":1032,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.124604+0000","last_change":"2024-09-12T17:21:54.759266+0000","last_active":"2024-09-12T17:56:57.124604+0000","last_peered":"2024-09-12T17:56:57.124604+0000","last_clean":"2024-09-12T17:56:57.124604+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T17:56:57.124604+0000","last_undegraded":"2024-09-12T17:56:57.124604+0000","last_fullsized":"2024-09-12T17:56:57.124604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:37.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'295","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.920200+0000","last_change":"2024-09-12T17:21:56.766802+0000","last_active":"2024-09-12T18:01:04.920200+0000","last_peered":"2024-09-12T18:01:04.920200+0000","last_clean":"2024-09-12T18:01:04.920200+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T18:01:04.920200+0000","last_undegraded":"2024-09-12T18:01:04.920200+0000","last_fullsized":"2024-09-12T18:01:04.920200+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.524361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":1191,"num_write":410,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129355+0000","last_change":"2024-09-12T17:21:58.781271+0000","last_active":"2024-09-12T17:57:00.129355+0000","last_peered":"2024-09-12T17:57:00.129355+0000","last_clean":"2024-09-12T17:57:00.129355+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T17:57:00.129355+0000","last_undegraded":"2024-09-12T17:57:00.129355+0000","last_fullsized":"2024-09-12T17:57:00.129355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:44.876899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.826880+0000","last_change":"2024-09-12T17:22:00.795423+0000","last_active":"2024-09-12T17:59:34.826880+0000","last_peered":"2024-09-12T17:59:34.826880+0000","last_clean":"2024-09-12T17:59:34.826880+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T17:59:34.826880+0000","last_undegraded":"2024-09-12T17:59:34.826880+0000","last_fullsized":"2024-09-12T17:59:34.826880+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:51.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'642","reported_seq":2266,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.847253+0000","last_change":"2024-09-12T18:01:18.847253+0000","last_active":"2024-09-12T18:01:18.847253+0000","last_peered":"2024-09-12T18:01:18.847253+0000","last_clean":"2024-09-12T18:01:18.847253+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T18:01:18.847253+0000","last_undegraded":"2024-09-12T18:01:18.847253+0000","last_fullsized":"2024-09-12T18:01:18.847253+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'642","last_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_deep_scrub":"265'642","last_deep_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.847166+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:32.189494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.988551+0000","last_change":"2024-09-12T18:01:12.988551+0000","last_active":"2024-09-12T18:01:12.988551+0000","last_peered":"2024-09-12T18:01:12.988551+0000","last_clean":"2024-09-12T18:01:12.988551+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:12.988551+0000","last_undegraded":"2024-09-12T18:01:12.988551+0000","last_fullsized":"2024-09-12T18:01:12.988551+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.988415+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.161722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25542,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":12892,"num_write":966,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009094+0000","last_change":"2024-09-12T17:21:54.755356+0000","last_active":"2024-09-12T17:56:57.009094+0000","last_peered":"2024-09-12T17:56:57.009094+0000","last_clean":"2024-09-12T17:56:57.009094+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T17:56:57.009094+0000","last_undegraded":"2024-09-12T17:56:57.009094+0000","last_fullsized":"2024-09-12T17:56:57.009094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:02.209702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":547,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:38.778422+0000","last_change":"2024-09-12T17:21:56.761388+0000","last_active":"2024-09-12T17:58:38.778422+0000","last_peered":"2024-09-12T17:58:38.778422+0000","last_clean":"2024-09-12T17:58:38.778422+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T17:58:38.778422+0000","last_undegraded":"2024-09-12T17:58:38.778422+0000","last_fullsized":"2024-09-12T17:58:38.778422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:20.116062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160637+0000","last_change":"2024-09-12T17:21:58.779273+0000","last_active":"2024-09-12T17:57:02.160637+0000","last_peered":"2024-09-12T17:57:02.160637+0000","last_clean":"2024-09-12T17:57:02.160637+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T17:57:02.160637+0000","last_undegraded":"2024-09-12T17:57:02.160637+0000","last_fullsized":"2024-09-12T17:57:02.160637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:23.417297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'227","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.355106+0000","last_change":"2024-09-12T17:22:00.795725+0000","last_active":"2024-09-12T17:59:34.355106+0000","last_peered":"2024-09-12T17:59:34.355106+0000","last_clean":"2024-09-12T17:59:34.355106+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T17:59:34.355106+0000","last_undegraded":"2024-09-12T17:59:34.355106+0000","last_fullsized":"2024-09-12T17:59:34.355106+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:25.111700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'388","reported_seq":1872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.830100+0000","last_change":"2024-09-12T18:01:20.830100+0000","last_active":"2024-09-12T18:01:20.830100+0000","last_peered":"2024-09-12T18:01:20.830100+0000","last_clean":"2024-09-12T18:01:20.830100+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T18:01:20.830100+0000","last_undegraded":"2024-09-12T18:01:20.830100+0000","last_fullsized":"2024-09-12T18:01:20.830100+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.830014+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.815711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'337","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.935172+0000","last_change":"2024-09-12T18:01:12.935172+0000","last_active":"2024-09-12T18:01:12.935172+0000","last_peered":"2024-09-12T18:01:12.935172+0000","last_clean":"2024-09-12T18:01:12.935172+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T18:01:12.935172+0000","last_undegraded":"2024-09-12T18:01:12.935172+0000","last_fullsized":"2024-09-12T18:01:12.935172+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.935024+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:23.088612+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":8586,"num_write":1108,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.015124+0000","last_change":"2024-09-12T18:01:26.015124+0000","last_active":"2024-09-12T18:01:26.015124+0000","last_peered":"2024-09-12T18:01:26.015124+0000","last_clean":"2024-09-12T18:01:26.015124+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T18:01:26.015124+0000","last_undegraded":"2024-09-12T18:01:26.015124+0000","last_fullsized":"2024-09-12T18:01:26.015124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.015036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:53.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'322","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.361686+0000","last_change":"2024-09-12T18:01:28.361686+0000","last_active":"2024-09-12T18:01:28.361686+0000","last_peered":"2024-09-12T18:01:28.361686+0000","last_clean":"2024-09-12T18:01:28.361686+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T18:01:28.361686+0000","last_undegraded":"2024-09-12T18:01:28.361686+0000","last_fullsized":"2024-09-12T18:01:28.361686+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.361576+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:53.552109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54935,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":1244,"num_write":438,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.120621+0000","last_change":"2024-09-12T17:21:58.781433+0000","last_active":"2024-09-12T17:57:02.120621+0000","last_peered":"2024-09-12T17:57:02.120621+0000","last_clean":"2024-09-12T17:57:02.120621+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T17:57:02.120621+0000","last_undegraded":"2024-09-12T17:57:02.120621+0000","last_fullsized":"2024-09-12T17:57:02.120621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:29.832595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'133","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.970181+0000","last_change":"2024-09-12T17:22:00.797551+0000","last_active":"2024-09-12T17:59:02.970181+0000","last_peered":"2024-09-12T17:59:02.970181+0000","last_clean":"2024-09-12T17:59:02.970181+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T17:59:02.970181+0000","last_undegraded":"2024-09-12T17:59:02.970181+0000","last_fullsized":"2024-09-12T17:59:02.970181+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:41.162485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'741","reported_seq":2120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.416829+0000","last_change":"2024-09-12T18:01:21.416829+0000","last_active":"2024-09-12T18:01:21.416829+0000","last_peered":"2024-09-12T18:01:21.416829+0000","last_clean":"2024-09-12T18:01:21.416829+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T18:01:21.416829+0000","last_undegraded":"2024-09-12T18:01:21.416829+0000","last_fullsized":"2024-09-12T18:01:21.416829+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'741","last_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_deep_scrub":"265'741","last_deep_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.416733+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:42.434807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'319","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.025570+0000","last_change":"2024-09-12T18:01:14.025570+0000","last_active":"2024-09-12T18:01:14.025570+0000","last_peered":"2024-09-12T18:01:14.025570+0000","last_clean":"2024-09-12T18:01:14.025570+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:14.025570+0000","last_undegraded":"2024-09-12T18:01:14.025570+0000","last_fullsized":"2024-09-12T18:01:14.025570+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.025424+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:56.638592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":5945,"num_write":1198,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009139+0000","last_change":"2024-09-12T17:21:54.758453+0000","last_active":"2024-09-12T17:56:57.009139+0000","last_peered":"2024-09-12T17:56:57.009139+0000","last_clean":"2024-09-12T17:56:57.009139+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T17:56:57.009139+0000","last_undegraded":"2024-09-12T17:56:57.009139+0000","last_fullsized":"2024-09-12T17:56:57.009139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.810118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'254","reported_seq":816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.820968+0000","last_change":"2024-09-12T17:21:56.769935+0000","last_active":"2024-09-12T18:01:03.820968+0000","last_peered":"2024-09-12T18:01:03.820968+0000","last_clean":"2024-09-12T18:01:03.820968+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T18:01:03.820968+0000","last_undegraded":"2024-09-12T18:01:03.820968+0000","last_fullsized":"2024-09-12T18:01:03.820968+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:39.633555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48942,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":1075,"num_write":368,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:00.129426+0000","last_change":"2024-09-12T17:21:58.785066+0000","last_active":"2024-09-12T17:57:00.129426+0000","last_peered":"2024-09-12T17:57:00.129426+0000","last_clean":"2024-09-12T17:57:00.129426+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T17:57:00.129426+0000","last_undegraded":"2024-09-12T17:57:00.129426+0000","last_fullsized":"2024-09-12T17:57:00.129426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:41.442928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'404","reported_seq":1817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.029074+0000","last_change":"2024-09-12T17:21:52.755203+0000","last_active":"2024-09-12T17:59:22.029074+0000","last_peered":"2024-09-12T17:59:22.029074+0000","last_clean":"2024-09-12T17:59:22.029074+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T17:59:22.029074+0000","last_undegraded":"2024-09-12T17:59:22.029074+0000","last_fullsized":"2024-09-12T17:59:22.029074+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'306","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.017205+0000","last_change":"2024-09-12T18:01:15.017205+0000","last_active":"2024-09-12T18:01:15.017205+0000","last_peered":"2024-09-12T18:01:15.017205+0000","last_clean":"2024-09-12T18:01:15.017205+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:15.017205+0000","last_undegraded":"2024-09-12T18:01:15.017205+0000","last_fullsized":"2024-09-12T18:01:15.017205+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'306","last_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_deep_scrub":"265'306","last_deep_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.017064+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:45.936859+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6208110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":25374,"num_write":969,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.133894+0000","last_change":"2024-09-12T17:21:54.759183+0000","last_active":"2024-09-12T17:58:02.133894+0000","last_peered":"2024-09-12T17:58:02.133894+0000","last_clean":"2024-09-12T17:58:02.133894+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T17:58:02.133894+0000","last_undegraded":"2024-09-12T17:58:02.133894+0000","last_fullsized":"2024-09-12T17:58:02.133894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:44.448393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'486","reported_seq":1107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.333686+0000","last_change":"2024-09-12T17:21:56.768691+0000","last_active":"2024-09-12T18:01:05.333686+0000","last_peered":"2024-09-12T18:01:05.333686+0000","last_clean":"2024-09-12T18:01:05.333686+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:01:05.333686+0000","last_undegraded":"2024-09-12T18:01:05.333686+0000","last_fullsized":"2024-09-12T18:01:05.333686+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.730690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94926,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":2123,"num_write":760,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.160707+0000","last_change":"2024-09-12T17:21:58.784784+0000","last_active":"2024-09-12T17:57:02.160707+0000","last_peered":"2024-09-12T17:57:02.160707+0000","last_clean":"2024-09-12T17:57:02.160707+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T17:57:02.160707+0000","last_undegraded":"2024-09-12T17:57:02.160707+0000","last_fullsized":"2024-09-12T17:57:02.160707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:09.975350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'164","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:28.836312+0000","last_change":"2024-09-12T17:22:00.798771+0000","last_active":"2024-09-12T17:59:28.836312+0000","last_peered":"2024-09-12T17:59:28.836312+0000","last_clean":"2024-09-12T17:59:28.836312+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T17:59:28.836312+0000","last_undegraded":"2024-09-12T17:59:28.836312+0000","last_fullsized":"2024-09-12T17:59:28.836312+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:10.472501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'422","reported_seq":1895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.801339+0000","last_change":"2024-09-12T18:01:19.801339+0000","last_active":"2024-09-12T18:01:19.801339+0000","last_peered":"2024-09-12T18:01:19.801339+0000","last_clean":"2024-09-12T18:01:19.801339+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T18:01:19.801339+0000","last_undegraded":"2024-09-12T18:01:19.801339+0000","last_fullsized":"2024-09-12T18:01:19.801339+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.801241+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.355929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'338","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.856875+0000","last_change":"2024-09-12T18:01:15.856875+0000","last_active":"2024-09-12T18:01:15.856875+0000","last_peered":"2024-09-12T18:01:15.856875+0000","last_clean":"2024-09-12T18:01:15.856875+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T18:01:15.856875+0000","last_undegraded":"2024-09-12T18:01:15.856875+0000","last_fullsized":"2024-09-12T18:01:15.856875+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.856769+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:45.860393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":48900,"num_write":1054,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:22.163561+0000","last_change":"2024-09-12T17:21:54.757887+0000","last_active":"2024-09-12T17:57:22.163561+0000","last_peered":"2024-09-12T17:57:22.163561+0000","last_clean":"2024-09-12T17:57:22.163561+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T17:57:22.163561+0000","last_undegraded":"2024-09-12T17:57:22.163561+0000","last_fullsized":"2024-09-12T17:57:22.163561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:57.740295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'295","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.891539+0000","last_change":"2024-09-12T17:21:56.759500+0000","last_active":"2024-09-12T18:01:03.891539+0000","last_peered":"2024-09-12T18:01:03.891539+0000","last_clean":"2024-09-12T18:01:03.891539+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T18:01:03.891539+0000","last_undegraded":"2024-09-12T18:01:03.891539+0000","last_fullsized":"2024-09-12T18:01:03.891539+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:26.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1077,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:58.122006+0000","last_change":"2024-09-12T17:21:58.795399+0000","last_active":"2024-09-12T17:56:58.122006+0000","last_peered":"2024-09-12T17:56:58.122006+0000","last_clean":"2024-09-12T17:56:58.122006+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T17:56:58.122006+0000","last_undegraded":"2024-09-12T17:56:58.122006+0000","last_fullsized":"2024-09-12T17:56:58.122006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:48.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'190","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.181615+0000","last_change":"2024-09-12T17:22:00.794027+0000","last_active":"2024-09-12T17:59:33.181615+0000","last_peered":"2024-09-12T17:59:33.181615+0000","last_clean":"2024-09-12T17:59:33.181615+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T17:59:33.181615+0000","last_undegraded":"2024-09-12T17:59:33.181615+0000","last_fullsized":"2024-09-12T17:59:33.181615+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:17.004717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'858","reported_seq":2327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.389730+0000","last_change":"2024-09-12T18:01:20.389730+0000","last_active":"2024-09-12T18:01:20.389730+0000","last_peered":"2024-09-12T18:01:20.389730+0000","last_clean":"2024-09-12T18:01:20.389730+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T18:01:20.389730+0000","last_undegraded":"2024-09-12T18:01:20.389730+0000","last_fullsized":"2024-09-12T18:01:20.389730+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'858","last_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_deep_scrub":"265'858","last_deep_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.389628+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:33.344999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.107915+0000","last_change":"2024-09-12T18:01:12.107915+0000","last_active":"2024-09-12T18:01:12.107915+0000","last_peered":"2024-09-12T18:01:12.107915+0000","last_clean":"2024-09-12T18:01:12.107915+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T18:01:12.107915+0000","last_undegraded":"2024-09-12T18:01:12.107915+0000","last_fullsized":"2024-09-12T18:01:12.107915+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.107785+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:13.904898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287371,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":72608,"num_write":1086,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.042699+0000","last_change":"2024-09-12T18:01:27.042699+0000","last_active":"2024-09-12T18:01:27.042699+0000","last_peered":"2024-09-12T18:01:27.042699+0000","last_clean":"2024-09-12T18:01:27.042699+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T18:01:27.042699+0000","last_undegraded":"2024-09-12T18:01:27.042699+0000","last_fullsized":"2024-09-12T18:01:27.042699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.042611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:44.161430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'237","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.182117+0000","last_change":"2024-09-12T17:21:56.768390+0000","last_active":"2024-09-12T18:01:05.182117+0000","last_peered":"2024-09-12T18:01:05.182117+0000","last_clean":"2024-09-12T18:01:05.182117+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T18:01:05.182117+0000","last_undegraded":"2024-09-12T18:01:05.182117+0000","last_fullsized":"2024-09-12T18:01:05.182117+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:20.766139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18914,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":895,"num_write":312,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:05.138962+0000","last_change":"2024-09-12T17:21:58.784005+0000","last_active":"2024-09-12T17:58:05.138962+0000","last_peered":"2024-09-12T17:58:05.138962+0000","last_clean":"2024-09-12T17:58:05.138962+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T17:58:05.138962+0000","last_undegraded":"2024-09-12T17:58:05.138962+0000","last_fullsized":"2024-09-12T17:58:05.138962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:02.608599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'111","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.117938+0000","last_change":"2024-09-12T17:22:00.796332+0000","last_active":"2024-09-12T18:00:56.117938+0000","last_peered":"2024-09-12T18:00:56.117938+0000","last_clean":"2024-09-12T18:00:56.117938+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:00:56.117938+0000","last_undegraded":"2024-09-12T18:00:56.117938+0000","last_fullsized":"2024-09-12T18:00:56.117938+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'490","reported_seq":2098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.896366+0000","last_change":"2024-09-12T18:01:23.896366+0000","last_active":"2024-09-12T18:01:23.896366+0000","last_peered":"2024-09-12T18:01:23.896366+0000","last_clean":"2024-09-12T18:01:23.896366+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:01:23.896366+0000","last_undegraded":"2024-09-12T18:01:23.896366+0000","last_fullsized":"2024-09-12T18:01:23.896366+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.896262+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.890695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'316","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.847748+0000","last_change":"2024-09-12T18:01:17.847748+0000","last_active":"2024-09-12T18:01:17.847748+0000","last_peered":"2024-09-12T18:01:17.847748+0000","last_clean":"2024-09-12T18:01:17.847748+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T18:01:17.847748+0000","last_undegraded":"2024-09-12T18:01:17.847748+0000","last_fullsized":"2024-09-12T18:01:17.847748+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.847650+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:25.676928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170477,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":22007,"num_write":949,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.009133+0000","last_change":"2024-09-12T17:21:54.755644+0000","last_active":"2024-09-12T17:56:57.009133+0000","last_peered":"2024-09-12T17:56:57.009133+0000","last_clean":"2024-09-12T17:56:57.009133+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T17:56:57.009133+0000","last_undegraded":"2024-09-12T17:56:57.009133+0000","last_fullsized":"2024-09-12T17:56:57.009133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'79","reported_seq":592,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:16.585394+0000","last_change":"2024-09-12T17:21:56.761019+0000","last_active":"2024-09-12T17:58:16.585394+0000","last_peered":"2024-09-12T17:58:16.585394+0000","last_clean":"2024-09-12T17:58:16.585394+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T17:58:16.585394+0000","last_undegraded":"2024-09-12T17:58:16.585394+0000","last_fullsized":"2024-09-12T17:58:16.585394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.371470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'757","reported_seq":2434,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.775252+0000","last_change":"2024-09-12T17:21:58.783309+0000","last_active":"2024-09-12T18:01:04.775252+0000","last_peered":"2024-09-12T18:01:04.775252+0000","last_clean":"2024-09-12T18:01:04.775252+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:01:04.775252+0000","last_undegraded":"2024-09-12T18:01:04.775252+0000","last_fullsized":"2024-09-12T18:01:04.775252+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:14.021972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'111","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.028820+0000","last_change":"2024-09-12T17:22:00.792450+0000","last_active":"2024-09-12T17:59:22.028820+0000","last_peered":"2024-09-12T17:59:22.028820+0000","last_clean":"2024-09-12T17:59:22.028820+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T17:59:22.028820+0000","last_undegraded":"2024-09-12T17:59:22.028820+0000","last_fullsized":"2024-09-12T17:59:22.028820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.275271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'473","reported_seq":2106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.009007+0000","last_change":"2024-09-12T18:01:24.009007+0000","last_active":"2024-09-12T18:01:24.009007+0000","last_peered":"2024-09-12T18:01:24.009007+0000","last_clean":"2024-09-12T18:01:24.009007+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T18:01:24.009007+0000","last_undegraded":"2024-09-12T18:01:24.009007+0000","last_fullsized":"2024-09-12T18:01:24.009007+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.008914+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:34.013264+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'343","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.091066+0000","last_change":"2024-09-12T18:01:10.091066+0000","last_active":"2024-09-12T18:01:10.091066+0000","last_peered":"2024-09-12T18:01:10.091066+0000","last_clean":"2024-09-12T18:01:10.091066+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T18:01:10.091066+0000","last_undegraded":"2024-09-12T18:01:10.091066+0000","last_fullsized":"2024-09-12T18:01:10.091066+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.090952+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:28.293870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2782938,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":20563,"num_write":1073,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:56:57.120023+0000","last_change":"2024-09-12T17:21:54.752741+0000","last_active":"2024-09-12T17:56:57.120023+0000","last_peered":"2024-09-12T17:56:57.120023+0000","last_clean":"2024-09-12T17:56:57.120023+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T17:56:57.120023+0000","last_undegraded":"2024-09-12T17:56:57.120023+0000","last_fullsized":"2024-09-12T17:56:57.120023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:50.651848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'293","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.241927+0000","last_change":"2024-09-12T17:21:56.771872+0000","last_active":"2024-09-12T18:01:03.241927+0000","last_peered":"2024-09-12T18:01:03.241927+0000","last_clean":"2024-09-12T18:01:03.241927+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:01:03.241927+0000","last_undegraded":"2024-09-12T18:01:03.241927+0000","last_fullsized":"2024-09-12T18:01:03.241927+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:31.183940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50539,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":1069,"num_write":390,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021920+0000","last_change":"2024-09-12T17:21:58.789902+0000","last_active":"2024-09-12T17:58:17.021920+0000","last_peered":"2024-09-12T17:58:17.021920+0000","last_clean":"2024-09-12T17:58:17.021920+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T17:58:17.021920+0000","last_undegraded":"2024-09-12T17:58:17.021920+0000","last_fullsized":"2024-09-12T17:58:17.021920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.777449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'139","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.021593+0000","last_change":"2024-09-12T17:22:00.794282+0000","last_active":"2024-09-12T17:59:34.021593+0000","last_peered":"2024-09-12T17:59:34.021593+0000","last_clean":"2024-09-12T17:59:34.021593+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T17:59:34.021593+0000","last_undegraded":"2024-09-12T17:59:34.021593+0000","last_fullsized":"2024-09-12T17:59:34.021593+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:58.732912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'473","reported_seq":2089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.961531+0000","last_change":"2024-09-12T18:01:21.961531+0000","last_active":"2024-09-12T18:01:21.961531+0000","last_peered":"2024-09-12T18:01:21.961531+0000","last_clean":"2024-09-12T18:01:21.961531+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:01:21.961531+0000","last_undegraded":"2024-09-12T18:01:21.961531+0000","last_fullsized":"2024-09-12T18:01:21.961531+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.961440+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:47.473255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1157,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'336","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.486325+0000","last_change":"2024-09-12T18:01:22.486325+0000","last_active":"2024-09-12T18:01:22.486325+0000","last_peered":"2024-09-12T18:01:22.486325+0000","last_clean":"2024-09-12T18:01:22.486325+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:01:22.486325+0000","last_undegraded":"2024-09-12T18:01:22.486325+0000","last_fullsized":"2024-09-12T18:01:22.486325+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.486194+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:40.467598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":60843,"num_write":1102,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.002984+0000","last_change":"2024-09-12T18:01:25.002984+0000","last_active":"2024-09-12T18:01:25.002984+0000","last_peered":"2024-09-12T18:01:25.002984+0000","last_clean":"2024-09-12T18:01:25.002984+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T18:01:25.002984+0000","last_undegraded":"2024-09-12T18:01:25.002984+0000","last_fullsized":"2024-09-12T18:01:25.002984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.002885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:05.311567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'253","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.313146+0000","last_change":"2024-09-12T17:21:56.764040+0000","last_active":"2024-09-12T18:01:03.313146+0000","last_peered":"2024-09-12T18:01:03.313146+0000","last_clean":"2024-09-12T18:01:03.313146+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:01:03.313146+0000","last_undegraded":"2024-09-12T18:01:03.313146+0000","last_fullsized":"2024-09-12T18:01:03.313146+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:13.554679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":1004,"num_write":346,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021541+0000","last_change":"2024-09-12T17:21:58.783726+0000","last_active":"2024-09-12T17:58:22.021541+0000","last_peered":"2024-09-12T17:58:22.021541+0000","last_clean":"2024-09-12T17:58:22.021541+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T17:58:22.021541+0000","last_undegraded":"2024-09-12T17:58:22.021541+0000","last_fullsized":"2024-09-12T17:58:22.021541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'103","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.765064+0000","last_change":"2024-09-12T17:22:00.798683+0000","last_active":"2024-09-12T17:59:34.765064+0000","last_peered":"2024-09-12T17:59:34.765064+0000","last_clean":"2024-09-12T17:59:34.765064+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T17:59:34.765064+0000","last_undegraded":"2024-09-12T17:59:34.765064+0000","last_fullsized":"2024-09-12T17:59:34.765064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:52.343353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.460129+0000","last_change":"2024-09-12T18:01:17.460129+0000","last_active":"2024-09-12T18:01:17.460129+0000","last_peered":"2024-09-12T18:01:17.460129+0000","last_clean":"2024-09-12T18:01:17.460129+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T18:01:17.460129+0000","last_undegraded":"2024-09-12T18:01:17.460129+0000","last_fullsized":"2024-09-12T18:01:17.460129+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'915","last_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_deep_scrub":"265'915","last_deep_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.460034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:51.385437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'398","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.993319+0000","last_change":"2024-09-12T18:01:15.993319+0000","last_active":"2024-09-12T18:01:15.993319+0000","last_peered":"2024-09-12T18:01:15.993319+0000","last_clean":"2024-09-12T18:01:15.993319+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:15.993319+0000","last_undegraded":"2024-09-12T18:01:15.993319+0000","last_fullsized":"2024-09-12T18:01:15.993319+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.993142+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:46.642090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645063,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":663,"num_read_kb":67994,"num_write":1237,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.260638+0000","last_change":"2024-09-12T18:01:26.260638+0000","last_active":"2024-09-12T18:01:26.260638+0000","last_peered":"2024-09-12T18:01:26.260638+0000","last_clean":"2024-09-12T18:01:26.260638+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T18:01:26.260638+0000","last_undegraded":"2024-09-12T18:01:26.260638+0000","last_fullsized":"2024-09-12T18:01:26.260638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.260550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:54.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'231","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.045674+0000","last_change":"2024-09-12T17:21:56.763924+0000","last_active":"2024-09-12T18:01:05.045674+0000","last_peered":"2024-09-12T18:01:05.045674+0000","last_clean":"2024-09-12T18:01:05.045674+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T18:01:05.045674+0000","last_undegraded":"2024-09-12T18:01:05.045674+0000","last_fullsized":"2024-09-12T18:01:05.045674+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.766828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":330,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.010097+0000","last_change":"2024-09-12T17:21:58.790322+0000","last_active":"2024-09-12T17:57:02.010097+0000","last_peered":"2024-09-12T17:57:02.010097+0000","last_clean":"2024-09-12T17:57:02.010097+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T17:57:02.010097+0000","last_undegraded":"2024-09-12T17:57:02.010097+0000","last_fullsized":"2024-09-12T17:57:02.010097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:02.075930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'218","reported_seq":1317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.414101+0000","last_change":"2024-09-12T17:22:00.798392+0000","last_active":"2024-09-12T17:59:33.414101+0000","last_peered":"2024-09-12T17:59:33.414101+0000","last_clean":"2024-09-12T17:59:33.414101+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T17:59:33.414101+0000","last_undegraded":"2024-09-12T17:59:33.414101+0000","last_fullsized":"2024-09-12T17:59:33.414101+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:00.108534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.999269+0000","last_change":"2024-09-12T18:01:20.999269+0000","last_active":"2024-09-12T18:01:20.999269+0000","last_peered":"2024-09-12T18:01:20.999269+0000","last_clean":"2024-09-12T18:01:20.999269+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T18:01:20.999269+0000","last_undegraded":"2024-09-12T18:01:20.999269+0000","last_fullsized":"2024-09-12T18:01:20.999269+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'869","last_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_deep_scrub":"265'869","last_deep_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.999172+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:58.536428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'354","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.014469+0000","last_change":"2024-09-12T18:01:17.014403+0000","last_active":"2024-09-12T18:01:17.014469+0000","last_peered":"2024-09-12T18:01:17.014469+0000","last_clean":"2024-09-12T18:01:17.014469+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:17.014469+0000","last_undegraded":"2024-09-12T18:01:17.014469+0000","last_fullsized":"2024-09-12T18:01:17.014469+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.014256+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:50.373551+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3457436,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":16565,"num_write":1099,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.022475+0000","last_change":"2024-09-12T17:21:54.758914+0000","last_active":"2024-09-12T17:58:22.022475+0000","last_peered":"2024-09-12T17:58:22.022475+0000","last_clean":"2024-09-12T17:58:22.022475+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T17:58:22.022475+0000","last_undegraded":"2024-09-12T17:58:22.022475+0000","last_fullsized":"2024-09-12T17:58:22.022475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:37.175631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'293","reported_seq":871,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:05.263987+0000","last_change":"2024-09-12T17:21:56.770020+0000","last_active":"2024-09-12T18:01:05.263987+0000","last_peered":"2024-09-12T18:01:05.263987+0000","last_clean":"2024-09-12T18:01:05.263987+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T18:01:05.263987+0000","last_undegraded":"2024-09-12T18:01:05.263987+0000","last_fullsized":"2024-09-12T18:01:05.263987+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:55.734804+0000","last_clean_scrub_stamp":"2024-09-12T17:21:55.734804+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:51.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1131,"num_write":404,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.009822+0000","last_change":"2024-09-12T17:21:58.782815+0000","last_active":"2024-09-12T17:57:02.009822+0000","last_peered":"2024-09-12T17:57:02.009822+0000","last_clean":"2024-09-12T17:57:02.009822+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T17:57:02.009822+0000","last_undegraded":"2024-09-12T17:57:02.009822+0000","last_fullsized":"2024-09-12T17:57:02.009822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:12.520411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'136","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:54.998151+0000","last_change":"2024-09-12T17:22:00.796520+0000","last_active":"2024-09-12T18:00:54.998151+0000","last_peered":"2024-09-12T18:00:54.998151+0000","last_clean":"2024-09-12T18:00:54.998151+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:00:54.998151+0000","last_undegraded":"2024-09-12T18:00:54.998151+0000","last_fullsized":"2024-09-12T18:00:54.998151+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:43.432009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'780","reported_seq":2434,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.908292+0000","last_change":"2024-09-12T18:01:22.908292+0000","last_active":"2024-09-12T18:01:22.908292+0000","last_peered":"2024-09-12T18:01:22.908292+0000","last_clean":"2024-09-12T18:01:22.908292+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T18:01:22.908292+0000","last_undegraded":"2024-09-12T18:01:22.908292+0000","last_fullsized":"2024-09-12T18:01:22.908292+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'780","last_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_deep_scrub":"265'780","last_deep_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.908162+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.242029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'369","reported_seq":1077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.916743+0000","last_change":"2024-09-12T18:01:11.916679+0000","last_active":"2024-09-12T18:01:11.916743+0000","last_peered":"2024-09-12T18:01:11.916743+0000","last_clean":"2024-09-12T18:01:11.916743+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T18:01:11.916743+0000","last_undegraded":"2024-09-12T18:01:11.916743+0000","last_fullsized":"2024-09-12T18:01:11.916743+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.916584+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:14.976183+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6259488,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":161127,"num_write":1137,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'471","reported_seq":1788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.450694+0000","last_change":"2024-09-12T18:01:18.450694+0000","last_active":"2024-09-12T18:01:18.450694+0000","last_peered":"2024-09-12T18:01:18.450694+0000","last_clean":"2024-09-12T18:01:18.450694+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T18:01:18.450694+0000","last_undegraded":"2024-09-12T18:01:18.450694+0000","last_fullsized":"2024-09-12T18:01:18.450694+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.450603+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.728665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'445","reported_seq":1133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.453039+0000","last_change":"2024-09-12T18:01:14.452969+0000","last_active":"2024-09-12T18:01:14.453039+0000","last_peered":"2024-09-12T18:01:14.453039+0000","last_clean":"2024-09-12T18:01:14.453039+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T18:01:14.453039+0000","last_undegraded":"2024-09-12T18:01:14.453039+0000","last_fullsized":"2024-09-12T18:01:14.453039+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.452866+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:29.422563+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190265,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":23221,"num_write":1306,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'804","reported_seq":2433,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:12.260815+0000","last_change":"2024-09-12T17:21:52.750129+0000","last_active":"2024-09-12T17:59:12.260815+0000","last_peered":"2024-09-12T17:59:12.260815+0000","last_clean":"2024-09-12T17:59:12.260815+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T17:59:12.260815+0000","last_undegraded":"2024-09-12T17:59:12.260815+0000","last_fullsized":"2024-09-12T17:59:12.260815+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.542955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'376","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.484407+0000","last_change":"2024-09-12T18:01:19.484338+0000","last_active":"2024-09-12T18:01:19.484407+0000","last_peered":"2024-09-12T18:01:19.484407+0000","last_clean":"2024-09-12T18:01:19.484407+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T18:01:19.484407+0000","last_undegraded":"2024-09-12T18:01:19.484407+0000","last_fullsized":"2024-09-12T18:01:19.484407+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.484172+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:45.726748+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":33088,"num_write":1180,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'920","reported_seq":2559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.390034+0000","last_change":"2024-09-12T17:21:52.751702+0000","last_active":"2024-09-12T17:59:16.390034+0000","last_peered":"2024-09-12T17:59:16.390034+0000","last_clean":"2024-09-12T17:59:16.390034+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T17:59:16.390034+0000","last_undegraded":"2024-09-12T17:59:16.390034+0000","last_fullsized":"2024-09-12T17:59:16.390034+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.873565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'403","reported_seq":1102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.983754+0000","last_change":"2024-09-12T18:01:18.983754+0000","last_active":"2024-09-12T18:01:18.983754+0000","last_peered":"2024-09-12T18:01:18.983754+0000","last_clean":"2024-09-12T18:01:18.983754+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:18.983754+0000","last_undegraded":"2024-09-12T18:01:18.983754+0000","last_fullsized":"2024-09-12T18:01:18.983754+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.983615+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:27.019267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254923,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":28930,"num_write":1343,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'501","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.635643+0000","last_change":"2024-09-12T17:21:52.750068+0000","last_active":"2024-09-12T17:59:15.635643+0000","last_peered":"2024-09-12T17:59:15.635643+0000","last_clean":"2024-09-12T17:59:15.635643+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T17:59:15.635643+0000","last_undegraded":"2024-09-12T17:59:15.635643+0000","last_fullsized":"2024-09-12T17:59:15.635643+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:42.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'354","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.211578+0000","last_change":"2024-09-12T18:01:15.211578+0000","last_active":"2024-09-12T18:01:15.211578+0000","last_peered":"2024-09-12T18:01:15.211578+0000","last_clean":"2024-09-12T18:01:15.211578+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T18:01:15.211578+0000","last_undegraded":"2024-09-12T18:01:15.211578+0000","last_fullsized":"2024-09-12T18:01:15.211578+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.211486+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:31.451040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":85437,"num_write":1070,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'465","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.678003+0000","last_change":"2024-09-12T18:01:19.677935+0000","last_active":"2024-09-12T18:01:19.678003+0000","last_peered":"2024-09-12T18:01:19.678003+0000","last_clean":"2024-09-12T18:01:19.678003+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T18:01:19.678003+0000","last_undegraded":"2024-09-12T18:01:19.678003+0000","last_fullsized":"2024-09-12T18:01:19.678003+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'465","last_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_deep_scrub":"265'465","last_deep_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.677819+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:45.594108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'299","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.273285+0000","last_change":"2024-09-12T18:01:17.273285+0000","last_active":"2024-09-12T18:01:17.273285+0000","last_peered":"2024-09-12T18:01:17.273285+0000","last_clean":"2024-09-12T18:01:17.273285+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T18:01:17.273285+0000","last_undegraded":"2024-09-12T18:01:17.273285+0000","last_fullsized":"2024-09-12T18:01:17.273285+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.273168+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.449887+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830346,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":83513,"num_write":1029,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'602","reported_seq":2282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.265910+0000","last_change":"2024-09-12T18:01:21.265850+0000","last_active":"2024-09-12T18:01:21.265910+0000","last_peered":"2024-09-12T18:01:21.265910+0000","last_clean":"2024-09-12T18:01:21.265910+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T18:01:21.265910+0000","last_undegraded":"2024-09-12T18:01:21.265910+0000","last_fullsized":"2024-09-12T18:01:21.265910+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'602","last_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_deep_scrub":"265'602","last_deep_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.265759+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:25.389513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.921972+0000","last_change":"2024-09-12T18:01:13.921972+0000","last_active":"2024-09-12T18:01:13.921972+0000","last_peered":"2024-09-12T18:01:13.921972+0000","last_clean":"2024-09-12T18:01:13.921972+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T18:01:13.921972+0000","last_undegraded":"2024-09-12T18:01:13.921972+0000","last_fullsized":"2024-09-12T18:01:13.921972+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.921810+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:44.545643+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190292,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":100979,"num_write":1090,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'368","reported_seq":1828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.198574+0000","last_change":"2024-09-12T18:01:16.198505+0000","last_active":"2024-09-12T18:01:16.198574+0000","last_peered":"2024-09-12T18:01:16.198574+0000","last_clean":"2024-09-12T18:01:16.198574+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:01:16.198574+0000","last_undegraded":"2024-09-12T18:01:16.198574+0000","last_fullsized":"2024-09-12T18:01:16.198574+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.198407+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:23.007746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'356","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.018330+0000","last_change":"2024-09-12T18:01:18.018330+0000","last_active":"2024-09-12T18:01:18.018330+0000","last_peered":"2024-09-12T18:01:18.018330+0000","last_clean":"2024-09-12T18:01:18.018330+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:18.018330+0000","last_undegraded":"2024-09-12T18:01:18.018330+0000","last_fullsized":"2024-09-12T18:01:18.018330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.018155+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:21.152485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262264,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":460,"num_read_kb":5744,"num_write":1173,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'856","reported_seq":2405,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.408597+0000","last_change":"2024-09-12T18:01:19.408597+0000","last_active":"2024-09-12T18:01:19.408597+0000","last_peered":"2024-09-12T18:01:19.408597+0000","last_clean":"2024-09-12T18:01:19.408597+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:01:19.408597+0000","last_undegraded":"2024-09-12T18:01:19.408597+0000","last_fullsized":"2024-09-12T18:01:19.408597+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'856","last_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_deep_scrub":"265'856","last_deep_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.408502+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:03.521178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'380","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.531186+0000","last_change":"2024-09-12T18:01:23.531186+0000","last_active":"2024-09-12T18:01:23.531186+0000","last_peered":"2024-09-12T18:01:23.531186+0000","last_clean":"2024-09-12T18:01:23.531186+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T18:01:23.531186+0000","last_undegraded":"2024-09-12T18:01:23.531186+0000","last_fullsized":"2024-09-12T18:01:23.531186+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.531029+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:11.136174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49301,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":612,"num_read_kb":751,"num_write":1265,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'639","reported_seq":2050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.670293+0000","last_change":"2024-09-12T18:01:17.670293+0000","last_active":"2024-09-12T18:01:17.670293+0000","last_peered":"2024-09-12T18:01:17.670293+0000","last_clean":"2024-09-12T18:01:17.670293+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T18:01:17.670293+0000","last_undegraded":"2024-09-12T18:01:17.670293+0000","last_fullsized":"2024-09-12T18:01:17.670293+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'639","last_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_deep_scrub":"265'639","last_deep_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.670204+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:59.417673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'374","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.973451+0000","last_change":"2024-09-12T18:01:19.973451+0000","last_active":"2024-09-12T18:01:19.973451+0000","last_peered":"2024-09-12T18:01:19.973451+0000","last_clean":"2024-09-12T18:01:19.973451+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:19.973451+0000","last_undegraded":"2024-09-12T18:01:19.973451+0000","last_fullsized":"2024-09-12T18:01:19.973451+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.973298+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:20.876852+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190224,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":620,"num_read_kb":17255,"num_write":1152,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'557","reported_seq":2028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.769742+0000","last_change":"2024-09-12T17:21:52.754609+0000","last_active":"2024-09-12T17:59:34.769742+0000","last_peered":"2024-09-12T17:59:34.769742+0000","last_clean":"2024-09-12T17:59:34.769742+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T17:59:34.769742+0000","last_undegraded":"2024-09-12T17:59:34.769742+0000","last_fullsized":"2024-09-12T17:59:34.769742+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:51.726824+0000","last_clean_scrub_stamp":"2024-09-12T17:21:51.726824+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:08.921162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'365","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.180439+0000","last_change":"2024-09-12T18:01:14.180439+0000","last_active":"2024-09-12T18:01:14.180439+0000","last_peered":"2024-09-12T18:01:14.180439+0000","last_clean":"2024-09-12T18:01:14.180439+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:01:14.180439+0000","last_undegraded":"2024-09-12T18:01:14.180439+0000","last_fullsized":"2024-09-12T18:01:14.180439+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.180323+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:09.461777+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":563,"num_read_kb":8561,"num_write":1187,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'555","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.185003+0000","last_change":"2024-09-12T18:01:19.185003+0000","last_active":"2024-09-12T18:01:19.185003+0000","last_peered":"2024-09-12T18:01:19.185003+0000","last_clean":"2024-09-12T18:01:19.185003+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:01:19.185003+0000","last_undegraded":"2024-09-12T18:01:19.185003+0000","last_fullsized":"2024-09-12T18:01:19.185003+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'555","last_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_deep_scrub":"265'555","last_deep_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.184900+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:52.759777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'316","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.863501+0000","last_change":"2024-09-12T18:01:21.863501+0000","last_active":"2024-09-12T18:01:21.863501+0000","last_peered":"2024-09-12T18:01:21.863501+0000","last_clean":"2024-09-12T18:01:21.863501+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T18:01:21.863501+0000","last_undegraded":"2024-09-12T18:01:21.863501+0000","last_fullsized":"2024-09-12T18:01:21.863501+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.863390+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:47.927583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":7270,"num_write":974,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'497","reported_seq":2144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.169868+0000","last_change":"2024-09-12T18:01:18.169868+0000","last_active":"2024-09-12T18:01:18.169868+0000","last_peered":"2024-09-12T18:01:18.169868+0000","last_clean":"2024-09-12T18:01:18.169868+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T18:01:18.169868+0000","last_undegraded":"2024-09-12T18:01:18.169868+0000","last_fullsized":"2024-09-12T18:01:18.169868+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'497","last_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_deep_scrub":"265'497","last_deep_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.169758+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:34.271652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'365","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.863401+0000","last_change":"2024-09-12T18:01:10.863401+0000","last_active":"2024-09-12T18:01:10.863401+0000","last_peered":"2024-09-12T18:01:10.863401+0000","last_clean":"2024-09-12T18:01:10.863401+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T18:01:10.863401+0000","last_undegraded":"2024-09-12T18:01:10.863401+0000","last_fullsized":"2024-09-12T18:01:10.863401+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.863281+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:12.634167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":1811,"num_write":1218,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'760","reported_seq":2535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.499737+0000","last_change":"2024-09-12T18:01:23.499737+0000","last_active":"2024-09-12T18:01:23.499737+0000","last_peered":"2024-09-12T18:01:23.499737+0000","last_clean":"2024-09-12T18:01:23.499737+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T18:01:23.499737+0000","last_undegraded":"2024-09-12T18:01:23.499737+0000","last_fullsized":"2024-09-12T18:01:23.499737+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'760","last_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_deep_scrub":"265'760","last_deep_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.499647+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:40.989755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'339","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.596545+0000","last_change":"2024-09-12T18:01:26.596545+0000","last_active":"2024-09-12T18:01:26.596545+0000","last_peered":"2024-09-12T18:01:26.596545+0000","last_clean":"2024-09-12T18:01:26.596545+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:01:26.596545+0000","last_undegraded":"2024-09-12T18:01:26.596545+0000","last_fullsized":"2024-09-12T18:01:26.596545+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.596412+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:20.074252+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2223469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":11534,"num_write":1063,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1319","reported_seq":3065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.924077+0000","last_change":"2024-09-12T18:01:24.924077+0000","last_active":"2024-09-12T18:01:24.924077+0000","last_peered":"2024-09-12T18:01:24.924077+0000","last_clean":"2024-09-12T18:01:24.924077+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T18:01:24.924077+0000","last_undegraded":"2024-09-12T18:01:24.924077+0000","last_fullsized":"2024-09-12T18:01:24.924077+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1319","last_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_deep_scrub":"265'1319","last_deep_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.923970+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":1300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:13.855563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3376,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'431","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.487468+0000","last_change":"2024-09-12T18:01:15.487345+0000","last_active":"2024-09-12T18:01:15.487468+0000","last_peered":"2024-09-12T18:01:15.487468+0000","last_clean":"2024-09-12T18:01:15.487468+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T18:01:15.487468+0000","last_undegraded":"2024-09-12T18:01:15.487468+0000","last_fullsized":"2024-09-12T18:01:15.487468+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'431","last_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_deep_scrub":"265'431","last_deep_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.487068+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.782666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":12654,"num_write":1335,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'853","reported_seq":2474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.216187+0000","last_change":"2024-09-12T18:01:17.216187+0000","last_active":"2024-09-12T18:01:17.216187+0000","last_peered":"2024-09-12T18:01:17.216187+0000","last_clean":"2024-09-12T18:01:17.216187+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T18:01:17.216187+0000","last_undegraded":"2024-09-12T18:01:17.216187+0000","last_fullsized":"2024-09-12T18:01:17.216187+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'853","last_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_deep_scrub":"265'853","last_deep_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.216096+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:08.132663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'405","reported_seq":1097,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.507619+0000","last_change":"2024-09-12T18:01:21.507619+0000","last_active":"2024-09-12T18:01:21.507619+0000","last_peered":"2024-09-12T18:01:21.507619+0000","last_clean":"2024-09-12T18:01:21.507619+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T18:01:21.507619+0000","last_undegraded":"2024-09-12T18:01:21.507619+0000","last_fullsized":"2024-09-12T18:01:21.507619+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.507507+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:37.979878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111016,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":21305,"num_write":1293,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.612472+0000","last_change":"2024-09-12T18:01:25.612472+0000","last_active":"2024-09-12T18:01:25.612472+0000","last_peered":"2024-09-12T18:01:25.612472+0000","last_clean":"2024-09-12T18:01:25.612472+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T18:01:25.612472+0000","last_undegraded":"2024-09-12T18:01:25.612472+0000","last_fullsized":"2024-09-12T18:01:25.612472+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.612341+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:10.180395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":645,"num_read_kb":38619,"num_write":1146,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'588","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.909762+0000","last_change":"2024-09-12T18:01:26.909762+0000","last_active":"2024-09-12T18:01:26.909762+0000","last_peered":"2024-09-12T18:01:26.909762+0000","last_clean":"2024-09-12T18:01:26.909762+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T18:01:26.909762+0000","last_undegraded":"2024-09-12T18:01:26.909762+0000","last_fullsized":"2024-09-12T18:01:26.909762+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'588","last_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_deep_scrub":"265'588","last_deep_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.909677+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:37.357766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.006935+0000","last_change":"2024-09-12T18:01:21.006935+0000","last_active":"2024-09-12T18:01:21.006935+0000","last_peered":"2024-09-12T18:01:21.006935+0000","last_clean":"2024-09-12T18:01:21.006935+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:21.006935+0000","last_undegraded":"2024-09-12T18:01:21.006935+0000","last_fullsized":"2024-09-12T18:01:21.006935+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.006814+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:43.121834+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364838,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":51644,"num_write":1154,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'404","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.241009+0000","last_change":"2024-09-12T18:01:22.241009+0000","last_active":"2024-09-12T18:01:22.241009+0000","last_peered":"2024-09-12T18:01:22.241009+0000","last_clean":"2024-09-12T18:01:22.241009+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T18:01:22.241009+0000","last_undegraded":"2024-09-12T18:01:22.241009+0000","last_fullsized":"2024-09-12T18:01:22.241009+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.240903+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:52.955110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1647,"ondisk_log_size":1647,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553896,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16885,"num_read_kb":36225,"num_write":14143,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15034,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2087,"ondisk_log_size":2087,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2878,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40366,"num_omap_keys":165,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4118,"ondisk_log_size":4118,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83193324,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":36148,"num_read_kb":1816228,"num_write":72592,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113262592,"data_stored":113262592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3606,"ondisk_log_size":3606,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":163167,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":167173,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477220,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286084,"kb_used_data":20276,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94085756,"statfs":{"total":96636764160,"available":96343814144,"internally_reserved":0,"allocated":20762624,"data_stored":18763428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509925,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133728,"kb_used_data":17872,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94238112,"statfs":{"total":96636764160,"available":96499826688,"internally_reserved":0,"allocated":18300928,"data_stored":16277974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":118618566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509924,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245328,"kb_used_data":15680,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94126512,"statfs":{"total":96636764160,"available":96385548288,"internally_reserved":0,"allocated":16056320,"data_stored":14054405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509924,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268336,"kb_used_data":20576,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94103504,"statfs":{"total":96636764160,"available":96361988096,"internally_reserved":0,"allocated":21069824,"data_stored":19072665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509926,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160940,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94210900,"statfs":{"total":96636764160,"available":96471961600,"internally_reserved":0,"allocated":21983232,"data_stored":19991308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509925,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342488,"kb_used_data":14216,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94029352,"statfs":{"total":96636764160,"available":96286056448,"internally_reserved":0,"allocated":14557184,"data_stored":12561929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509924,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146528,"kb_used_data":20944,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94225312,"statfs":{"total":96636764160,"available":96486719488,"internally_reserved":0,"allocated":21446656,"data_stored":19447593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575333,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265632,"kb_used_data":13776,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94106208,"statfs":{"total":96636764160,"available":96364756992,"internally_reserved":0,"allocated":14106624,"data_stored":12126360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17215488,"data_stored":17215488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9740288,"data_stored":9740288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17760256,"data_stored":17760256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16842752,"data_stored":16842752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11821056,"data_stored":11821056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15941632,"data_stored":15941632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":9895936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:32.622 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.622 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.623 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.624 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.625 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.626 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.627 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.628 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.629 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.630 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.631 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.631 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.631 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.631 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.631 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.631 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.632 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.633 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.634 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.635 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.636 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.637 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.638 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.638 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.638 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.638 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.638 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.638 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.639 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.639 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.639 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.639 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.639 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.639 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.639 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.640 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.640 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.640 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.640 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.640 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.640 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.640 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.641 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.641 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.641 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.641 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.641 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.641 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.641 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.642 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.642 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.642 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.642 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.642 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.642 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.642 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.643 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.644 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.645 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.645 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.645 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.645 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.645 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.645 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.645 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.646 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.646 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.646 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.646 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.646 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.646 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.647 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.647 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.647 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.647 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.647 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.647 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.647 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.648 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.648 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.648 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.648 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.648 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.648 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.648 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.649 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.650 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.651 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.651 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.651 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.651 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.651 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.651 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.651 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.652 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.652 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.652 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.652 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.652 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.652 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.653 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.653 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.653 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.653 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.654 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.654 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.654 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.654 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.654 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:21:55.734804+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.654 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.655 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.655 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.655 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.655 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.655 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:21:51.726824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:32.656 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:01:52.657 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:53.012 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:01:53.023 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:01:53.025 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1469,"stamp":"2024-09-12T18:01:51.155415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85355269,"num_objects":842,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":842,"num_whiteouts":0,"num_read":290229,"num_read_kb":2399744,"num_write":161152,"num_write_kb":2366967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720170,"num_omap_keys":1753,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13672,"ondisk_log_size":13672,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1836584,"kb_used_data":144808,"kb_used_omap":12,"kb_used_meta":1691635,"kb_avail":753138136,"statfs":{"total":773094113280,"available":771213451264,"internally_reserved":0,"allocated":148283392,"data_stored":132295662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1732234800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":122554,"num_omap_keys":302,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005951"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.821424+0000","last_change":"2024-09-12T18:01:46.821424+0000","last_active":"2024-09-12T18:01:46.821424+0000","last_peered":"2024-09-12T18:01:46.821424+0000","last_clean":"2024-09-12T18:01:46.821424+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T18:01:46.821424+0000","last_undegraded":"2024-09-12T18:01:46.821424+0000","last_fullsized":"2024-09-12T18:01:46.821424+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:46.821337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:46.821337+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.821337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:49.006761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.347923+0000","last_change":"2024-09-12T18:01:46.347923+0000","last_active":"2024-09-12T18:01:46.347923+0000","last_peered":"2024-09-12T18:01:46.347923+0000","last_clean":"2024-09-12T18:01:46.347923+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T18:01:46.347923+0000","last_undegraded":"2024-09-12T18:01:46.347923+0000","last_fullsized":"2024-09-12T18:01:46.347923+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:46.347813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:46.347813+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.347813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.730170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:45.144138+0000","last_change":"2024-09-12T17:38:43.996174+0000","last_active":"2024-09-12T17:58:45.144138+0000","last_peered":"2024-09-12T17:58:45.144138+0000","last_clean":"2024-09-12T17:58:45.144138+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T17:58:45.144138+0000","last_undegraded":"2024-09-12T17:58:45.144138+0000","last_fullsized":"2024-09-12T17:58:45.144138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.019082+0000","last_change":"2024-09-12T17:37:08.657434+0000","last_active":"2024-09-12T17:58:02.019082+0000","last_peered":"2024-09-12T17:58:02.019082+0000","last_clean":"2024-09-12T17:58:02.019082+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T17:58:02.019082+0000","last_undegraded":"2024-09-12T17:58:02.019082+0000","last_fullsized":"2024-09-12T17:58:02.019082+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.018613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.128952+0000","last_change":"2024-09-12T17:49:56.047260+0000","last_active":"2024-09-12T17:57:27.128952+0000","last_peered":"2024-09-12T17:57:27.128952+0000","last_clean":"2024-09-12T17:57:27.128952+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T17:57:27.128952+0000","last_undegraded":"2024-09-12T17:57:27.128952+0000","last_fullsized":"2024-09-12T17:57:27.128952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:13.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.174453+0000","last_change":"2024-09-12T17:38:47.032526+0000","last_active":"2024-09-12T17:58:47.174453+0000","last_peered":"2024-09-12T17:58:47.174453+0000","last_clean":"2024-09-12T17:58:47.174453+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T17:58:47.174453+0000","last_undegraded":"2024-09-12T17:58:47.174453+0000","last_fullsized":"2024-09-12T17:58:47.174453+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.295744+0000","last_change":"2024-09-12T17:38:43.991731+0000","last_active":"2024-09-12T18:01:04.295744+0000","last_peered":"2024-09-12T18:01:04.295744+0000","last_clean":"2024-09-12T18:01:04.295744+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T18:01:04.295744+0000","last_undegraded":"2024-09-12T18:01:04.295744+0000","last_fullsized":"2024-09-12T18:01:04.295744+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4142,"num_write":12,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.028749+0000","last_change":"2024-09-12T17:37:08.650147+0000","last_active":"2024-09-12T17:59:17.028749+0000","last_peered":"2024-09-12T17:59:17.028749+0000","last_clean":"2024-09-12T17:59:17.028749+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T17:59:17.028749+0000","last_undegraded":"2024-09-12T17:59:17.028749+0000","last_fullsized":"2024-09-12T17:59:17.028749+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.122054+0000","last_change":"2024-09-12T17:49:56.046643+0000","last_active":"2024-09-12T17:57:12.122054+0000","last_peered":"2024-09-12T17:57:12.122054+0000","last_clean":"2024-09-12T17:57:12.122054+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T17:57:12.122054+0000","last_undegraded":"2024-09-12T17:57:12.122054+0000","last_fullsized":"2024-09-12T17:57:12.122054+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.487756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.318876+0000","last_change":"2024-09-12T17:38:47.027090+0000","last_active":"2024-09-12T18:01:03.318876+0000","last_peered":"2024-09-12T18:01:03.318876+0000","last_clean":"2024-09-12T18:01:03.318876+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T18:01:03.318876+0000","last_undegraded":"2024-09-12T18:01:03.318876+0000","last_fullsized":"2024-09-12T18:01:03.318876+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.435606+0000","last_change":"2024-09-12T18:01:49.435606+0000","last_active":"2024-09-12T18:01:49.435606+0000","last_peered":"2024-09-12T18:01:49.435606+0000","last_clean":"2024-09-12T18:01:49.435606+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T18:01:49.435606+0000","last_undegraded":"2024-09-12T18:01:49.435606+0000","last_fullsized":"2024-09-12T18:01:49.435606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:49.435472+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:49.435472+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.435472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:46.329069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":251,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.422649+0000","last_change":"2024-09-12T18:01:45.422649+0000","last_active":"2024-09-12T18:01:45.422649+0000","last_peered":"2024-09-12T18:01:45.422649+0000","last_clean":"2024-09-12T18:01:45.422649+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T18:01:45.422649+0000","last_undegraded":"2024-09-12T18:01:45.422649+0000","last_fullsized":"2024-09-12T18:01:45.422649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'75","last_scrub_stamp":"2024-09-12T18:01:45.422564+0000","last_deep_scrub":"265'75","last_deep_scrub_stamp":"2024-09-12T18:01:45.422564+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.422564+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:13.649409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:18.125196+0000","last_change":"2024-09-12T17:49:56.040426+0000","last_active":"2024-09-12T17:57:18.125196+0000","last_peered":"2024-09-12T17:57:18.125196+0000","last_clean":"2024-09-12T17:57:18.125196+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T17:57:18.125196+0000","last_undegraded":"2024-09-12T17:57:18.125196+0000","last_fullsized":"2024-09-12T17:57:18.125196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:54.760400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:53.157749+0000","last_change":"2024-09-12T17:38:47.027638+0000","last_active":"2024-09-12T18:00:53.157749+0000","last_peered":"2024-09-12T18:00:53.157749+0000","last_clean":"2024-09-12T18:00:53.157749+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T18:00:53.157749+0000","last_undegraded":"2024-09-12T18:00:53.157749+0000","last_fullsized":"2024-09-12T18:00:53.157749+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:43.893874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.363414+0000","last_change":"2024-09-12T18:01:45.363414+0000","last_active":"2024-09-12T18:01:45.363414+0000","last_peered":"2024-09-12T18:01:45.363414+0000","last_clean":"2024-09-12T18:01:45.363414+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T18:01:45.363414+0000","last_undegraded":"2024-09-12T18:01:45.363414+0000","last_fullsized":"2024-09-12T18:01:45.363414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:01:45.363319+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:01:45.363319+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.363319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:36.948632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14340,"num_write":8,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.441641+0000","last_change":"2024-09-12T18:01:44.441641+0000","last_active":"2024-09-12T18:01:44.441641+0000","last_peered":"2024-09-12T18:01:44.441641+0000","last_clean":"2024-09-12T18:01:44.441641+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T18:01:44.441641+0000","last_undegraded":"2024-09-12T18:01:44.441641+0000","last_fullsized":"2024-09-12T18:01:44.441641+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T18:01:44.441557+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T18:01:44.441557+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.441557+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.141527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:55.137509+0000","last_change":"2024-09-12T17:49:56.043841+0000","last_active":"2024-09-12T17:57:55.137509+0000","last_peered":"2024-09-12T17:57:55.137509+0000","last_clean":"2024-09-12T17:57:55.137509+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T17:57:55.137509+0000","last_undegraded":"2024-09-12T17:57:55.137509+0000","last_fullsized":"2024-09-12T17:57:55.137509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:54.316816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.765669+0000","last_change":"2024-09-12T18:01:41.765669+0000","last_active":"2024-09-12T18:01:41.765669+0000","last_peered":"2024-09-12T18:01:41.765669+0000","last_clean":"2024-09-12T18:01:41.765669+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T18:01:41.765669+0000","last_undegraded":"2024-09-12T18:01:41.765669+0000","last_fullsized":"2024-09-12T18:01:41.765669+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:41.765575+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:41.765575+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.765575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:26.223860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132353+0000","last_change":"2024-09-12T17:38:43.991420+0000","last_active":"2024-09-12T17:58:03.132353+0000","last_peered":"2024-09-12T17:58:03.132353+0000","last_clean":"2024-09-12T17:58:03.132353+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T17:58:03.132353+0000","last_undegraded":"2024-09-12T17:58:03.132353+0000","last_fullsized":"2024-09-12T17:58:03.132353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126614+0000","last_change":"2024-09-12T17:37:08.656898+0000","last_active":"2024-09-12T17:57:12.126614+0000","last_peered":"2024-09-12T17:57:12.126614+0000","last_clean":"2024-09-12T17:57:12.126614+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T17:57:12.126614+0000","last_undegraded":"2024-09-12T17:57:12.126614+0000","last_fullsized":"2024-09-12T17:57:12.126614+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:09.179411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.022015+0000","last_change":"2024-09-12T17:49:56.038230+0000","last_active":"2024-09-12T17:58:17.022015+0000","last_peered":"2024-09-12T17:58:17.022015+0000","last_clean":"2024-09-12T17:58:17.022015+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T17:58:17.022015+0000","last_undegraded":"2024-09-12T17:58:17.022015+0000","last_fullsized":"2024-09-12T17:58:17.022015+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:01.328505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:32.038446+0000","last_change":"2024-09-12T17:38:47.024390+0000","last_active":"2024-09-12T18:00:32.038446+0000","last_peered":"2024-09-12T18:00:32.038446+0000","last_clean":"2024-09-12T18:00:32.038446+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T18:00:32.038446+0000","last_undegraded":"2024-09-12T18:00:32.038446+0000","last_fullsized":"2024-09-12T18:00:32.038446+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:38.074041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020049+0000","last_change":"2024-09-12T17:38:43.992661+0000","last_active":"2024-09-12T17:58:12.020049+0000","last_peered":"2024-09-12T17:58:12.020049+0000","last_clean":"2024-09-12T17:58:12.020049+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T17:58:12.020049+0000","last_undegraded":"2024-09-12T17:58:12.020049+0000","last_fullsized":"2024-09-12T17:58:12.020049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:23.126019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.940085+0000","last_change":"2024-09-12T18:01:41.940085+0000","last_active":"2024-09-12T18:01:41.940085+0000","last_peered":"2024-09-12T18:01:41.940085+0000","last_clean":"2024-09-12T18:01:41.940085+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T18:01:41.940085+0000","last_undegraded":"2024-09-12T18:01:41.940085+0000","last_fullsized":"2024-09-12T18:01:41.940085+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T18:01:41.939972+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T18:01:41.939972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.939972+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:03.309924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.164252+0000","last_change":"2024-09-12T17:49:56.045176+0000","last_active":"2024-09-12T17:57:27.164252+0000","last_peered":"2024-09-12T17:57:27.164252+0000","last_clean":"2024-09-12T17:57:27.164252+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T17:57:27.164252+0000","last_undegraded":"2024-09-12T17:57:27.164252+0000","last_fullsized":"2024-09-12T17:57:27.164252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:33.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:47.174437+0000","last_change":"2024-09-12T17:38:47.030932+0000","last_active":"2024-09-12T17:58:47.174437+0000","last_peered":"2024-09-12T17:58:47.174437+0000","last_clean":"2024-09-12T17:58:47.174437+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T17:58:47.174437+0000","last_undegraded":"2024-09-12T17:58:47.174437+0000","last_fullsized":"2024-09-12T17:58:47.174437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.788663+0000","last_change":"2024-09-12T18:01:36.788663+0000","last_active":"2024-09-12T18:01:36.788663+0000","last_peered":"2024-09-12T18:01:36.788663+0000","last_clean":"2024-09-12T18:01:36.788663+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T18:01:36.788663+0000","last_undegraded":"2024-09-12T18:01:36.788663+0000","last_fullsized":"2024-09-12T18:01:36.788663+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:36.788573+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:36.788573+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.788573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:40.438428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.396969+0000","last_change":"2024-09-12T18:01:43.396969+0000","last_active":"2024-09-12T18:01:43.396969+0000","last_peered":"2024-09-12T18:01:43.396969+0000","last_clean":"2024-09-12T18:01:43.396969+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T18:01:43.396969+0000","last_undegraded":"2024-09-12T18:01:43.396969+0000","last_fullsized":"2024-09-12T18:01:43.396969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T18:01:43.396878+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T18:01:43.396878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.396878+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:50.986361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.779233+0000","last_change":"2024-09-12T18:01:45.779233+0000","last_active":"2024-09-12T18:01:45.779233+0000","last_peered":"2024-09-12T18:01:45.779233+0000","last_clean":"2024-09-12T18:01:45.779233+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T18:01:45.779233+0000","last_undegraded":"2024-09-12T18:01:45.779233+0000","last_fullsized":"2024-09-12T18:01:45.779233+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.779139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.779139+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.779139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:32.530508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'10","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.374733+0000","last_change":"2024-09-12T17:38:47.024321+0000","last_active":"2024-09-12T18:01:04.374733+0000","last_peered":"2024-09-12T18:01:04.374733+0000","last_clean":"2024-09-12T18:01:04.374733+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T18:01:04.374733+0000","last_undegraded":"2024-09-12T18:01:04.374733+0000","last_fullsized":"2024-09-12T18:01:04.374733+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13320,"num_write":20,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'10","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.140798+0000","last_change":"2024-09-12T17:38:43.990416+0000","last_active":"2024-09-12T18:01:04.140798+0000","last_peered":"2024-09-12T18:01:04.140798+0000","last_clean":"2024-09-12T18:01:04.140798+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T18:01:04.140798+0000","last_undegraded":"2024-09-12T18:01:04.140798+0000","last_fullsized":"2024-09-12T18:01:04.140798+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15362,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.466682+0000","last_change":"2024-09-12T18:01:43.466682+0000","last_active":"2024-09-12T18:01:43.466682+0000","last_peered":"2024-09-12T18:01:43.466682+0000","last_clean":"2024-09-12T18:01:43.466682+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T18:01:43.466682+0000","last_undegraded":"2024-09-12T18:01:43.466682+0000","last_fullsized":"2024-09-12T18:01:43.466682+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T18:01:43.466578+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T18:01:43.466578+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.466578+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:45.668613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.142795+0000","last_change":"2024-09-12T17:49:56.044578+0000","last_active":"2024-09-12T17:59:18.142795+0000","last_peered":"2024-09-12T17:59:18.142795+0000","last_clean":"2024-09-12T17:59:18.142795+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T17:59:18.142795+0000","last_undegraded":"2024-09-12T17:59:18.142795+0000","last_fullsized":"2024-09-12T17:59:18.142795+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:35.161243+0000","last_change":"2024-09-12T17:38:47.024618+0000","last_active":"2024-09-12T18:00:35.161243+0000","last_peered":"2024-09-12T18:00:35.161243+0000","last_clean":"2024-09-12T18:00:35.161243+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T18:00:35.161243+0000","last_undegraded":"2024-09-12T18:00:35.161243+0000","last_fullsized":"2024-09-12T18:00:35.161243+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:49.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'11","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.522473+0000","last_change":"2024-09-12T17:38:43.991705+0000","last_active":"2024-09-12T18:01:03.522473+0000","last_peered":"2024-09-12T18:01:03.522473+0000","last_clean":"2024-09-12T18:01:03.522473+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T18:01:03.522473+0000","last_undegraded":"2024-09-12T18:01:03.522473+0000","last_fullsized":"2024-09-12T18:01:03.522473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.996078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4710,"num_write":16,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'113","reported_seq":389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.026603+0000","last_change":"2024-09-12T17:37:08.655763+0000","last_active":"2024-09-12T17:58:57.026603+0000","last_peered":"2024-09-12T17:58:57.026603+0000","last_clean":"2024-09-12T17:58:57.026603+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T17:58:57.026603+0000","last_undegraded":"2024-09-12T17:58:57.026603+0000","last_fullsized":"2024-09-12T17:58:57.026603+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.143235+0000","last_change":"2024-09-12T17:49:56.034209+0000","last_active":"2024-09-12T17:59:17.143235+0000","last_peered":"2024-09-12T17:59:17.143235+0000","last_clean":"2024-09-12T17:59:17.143235+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T17:59:17.143235+0000","last_undegraded":"2024-09-12T17:59:17.143235+0000","last_fullsized":"2024-09-12T17:59:17.143235+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.127870+0000","last_change":"2024-09-12T17:38:47.024189+0000","last_active":"2024-09-12T17:57:33.127870+0000","last_peered":"2024-09-12T17:57:33.127870+0000","last_clean":"2024-09-12T17:57:33.127870+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T17:57:33.127870+0000","last_undegraded":"2024-09-12T17:57:33.127870+0000","last_fullsized":"2024-09-12T17:57:33.127870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:12.716839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.844260+0000","last_change":"2024-09-12T18:01:34.844260+0000","last_active":"2024-09-12T18:01:34.844260+0000","last_peered":"2024-09-12T18:01:34.844260+0000","last_clean":"2024-09-12T18:01:34.844260+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T18:01:34.844260+0000","last_undegraded":"2024-09-12T18:01:34.844260+0000","last_fullsized":"2024-09-12T18:01:34.844260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:34.844131+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:34.844131+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.844131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:48.050356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.026575+0000","last_change":"2024-09-12T17:37:08.650302+0000","last_active":"2024-09-12T17:58:57.026575+0000","last_peered":"2024-09-12T17:58:57.026575+0000","last_clean":"2024-09-12T17:58:57.026575+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T17:58:57.026575+0000","last_undegraded":"2024-09-12T17:58:57.026575+0000","last_fullsized":"2024-09-12T17:58:57.026575+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:17.177986+0000","last_change":"2024-09-12T17:49:56.037995+0000","last_active":"2024-09-12T17:59:17.177986+0000","last_peered":"2024-09-12T17:59:17.177986+0000","last_clean":"2024-09-12T17:59:17.177986+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T17:59:17.177986+0000","last_undegraded":"2024-09-12T17:59:17.177986+0000","last_fullsized":"2024-09-12T17:59:17.177986+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:10.139871+0000","last_change":"2024-09-12T17:38:47.016476+0000","last_active":"2024-09-12T17:58:10.139871+0000","last_peered":"2024-09-12T17:58:10.139871+0000","last_clean":"2024-09-12T17:58:10.139871+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T17:58:10.139871+0000","last_undegraded":"2024-09-12T17:58:10.139871+0000","last_fullsized":"2024-09-12T17:58:10.139871+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:05.344871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.459283+0000","last_change":"2024-09-12T18:01:48.459283+0000","last_active":"2024-09-12T18:01:48.459283+0000","last_peered":"2024-09-12T18:01:48.459283+0000","last_clean":"2024-09-12T18:01:48.459283+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T18:01:48.459283+0000","last_undegraded":"2024-09-12T18:01:48.459283+0000","last_fullsized":"2024-09-12T18:01:48.459283+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:48.459191+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:48.459191+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.459191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:58.450160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.374692+0000","last_change":"2024-09-12T18:01:42.374692+0000","last_active":"2024-09-12T18:01:42.374692+0000","last_peered":"2024-09-12T18:01:42.374692+0000","last_clean":"2024-09-12T18:01:42.374692+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T18:01:42.374692+0000","last_undegraded":"2024-09-12T18:01:42.374692+0000","last_fullsized":"2024-09-12T18:01:42.374692+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:42.374606+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:42.374606+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.374606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:52.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.794472+0000","last_change":"2024-09-12T18:01:44.794472+0000","last_active":"2024-09-12T18:01:44.794472+0000","last_peered":"2024-09-12T18:01:44.794472+0000","last_clean":"2024-09-12T18:01:44.794472+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T18:01:44.794472+0000","last_undegraded":"2024-09-12T18:01:44.794472+0000","last_fullsized":"2024-09-12T18:01:44.794472+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:44.794380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:44.794380+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.794380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:24.341962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.725963+0000","last_change":"2024-09-12T18:01:40.725963+0000","last_active":"2024-09-12T18:01:40.725963+0000","last_peered":"2024-09-12T18:01:40.725963+0000","last_clean":"2024-09-12T18:01:40.725963+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T18:01:40.725963+0000","last_undegraded":"2024-09-12T18:01:40.725963+0000","last_fullsized":"2024-09-12T18:01:40.725963+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:40.725867+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:40.725867+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.725867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.564911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132508+0000","last_change":"2024-09-12T17:38:43.989365+0000","last_active":"2024-09-12T17:58:03.132508+0000","last_peered":"2024-09-12T17:58:03.132508+0000","last_clean":"2024-09-12T17:58:03.132508+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T17:58:03.132508+0000","last_undegraded":"2024-09-12T17:58:03.132508+0000","last_fullsized":"2024-09-12T17:58:03.132508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:53.634008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020922+0000","last_change":"2024-09-12T17:37:08.651846+0000","last_active":"2024-09-12T17:58:17.020922+0000","last_peered":"2024-09-12T17:58:17.020922+0000","last_clean":"2024-09-12T17:58:17.020922+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T17:58:17.020922+0000","last_undegraded":"2024-09-12T17:58:17.020922+0000","last_fullsized":"2024-09-12T17:58:17.020922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:47.950299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:13.124363+0000","last_change":"2024-09-12T17:49:56.042508+0000","last_active":"2024-09-12T17:57:13.124363+0000","last_peered":"2024-09-12T17:57:13.124363+0000","last_clean":"2024-09-12T17:57:13.124363+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T17:57:13.124363+0000","last_undegraded":"2024-09-12T17:57:13.124363+0000","last_fullsized":"2024-09-12T17:57:13.124363+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:56.026526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.127091+0000","last_change":"2024-09-12T17:38:47.028439+0000","last_active":"2024-09-12T17:57:28.127091+0000","last_peered":"2024-09-12T17:57:28.127091+0000","last_clean":"2024-09-12T17:57:28.127091+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T17:57:28.127091+0000","last_undegraded":"2024-09-12T17:57:28.127091+0000","last_fullsized":"2024-09-12T17:57:28.127091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:40.113111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.336334+0000","last_change":"2024-09-12T18:01:42.336334+0000","last_active":"2024-09-12T18:01:42.336334+0000","last_peered":"2024-09-12T18:01:42.336334+0000","last_clean":"2024-09-12T18:01:42.336334+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T18:01:42.336334+0000","last_undegraded":"2024-09-12T18:01:42.336334+0000","last_fullsized":"2024-09-12T18:01:42.336334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.336239+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:19.424553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020118+0000","last_change":"2024-09-12T17:37:08.656056+0000","last_active":"2024-09-12T17:58:12.020118+0000","last_peered":"2024-09-12T17:58:12.020118+0000","last_clean":"2024-09-12T17:58:12.020118+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T17:58:12.020118+0000","last_undegraded":"2024-09-12T17:58:12.020118+0000","last_fullsized":"2024-09-12T17:58:12.020118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:45.733213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126727+0000","last_change":"2024-09-12T17:49:56.042525+0000","last_active":"2024-09-12T17:57:12.126727+0000","last_peered":"2024-09-12T17:57:12.126727+0000","last_clean":"2024-09-12T17:57:12.126727+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T17:57:12.126727+0000","last_undegraded":"2024-09-12T17:57:12.126727+0000","last_fullsized":"2024-09-12T17:57:12.126727+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:07.790123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'11","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.596225+0000","last_change":"2024-09-12T17:38:47.030812+0000","last_active":"2024-09-12T18:01:03.596225+0000","last_peered":"2024-09-12T18:01:03.596225+0000","last_clean":"2024-09-12T18:01:03.596225+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T18:01:03.596225+0000","last_undegraded":"2024-09-12T18:01:03.596225+0000","last_fullsized":"2024-09-12T18:01:03.596225+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:21.678813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10258,"num_write":16,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.126144+0000","last_change":"2024-09-12T17:38:43.987476+0000","last_active":"2024-09-12T17:57:23.126144+0000","last_peered":"2024-09-12T17:57:23.126144+0000","last_clean":"2024-09-12T17:57:23.126144+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T17:57:23.126144+0000","last_undegraded":"2024-09-12T17:57:23.126144+0000","last_fullsized":"2024-09-12T17:57:23.126144+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.672726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.334479+0000","last_change":"2024-09-12T18:01:41.334479+0000","last_active":"2024-09-12T18:01:41.334479+0000","last_peered":"2024-09-12T18:01:41.334479+0000","last_clean":"2024-09-12T18:01:41.334479+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T18:01:41.334479+0000","last_undegraded":"2024-09-12T18:01:41.334479+0000","last_fullsized":"2024-09-12T18:01:41.334479+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T18:01:41.334373+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T18:01:41.334373+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.334373+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:02.278105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.029595+0000","last_change":"2024-09-12T17:49:56.037386+0000","last_active":"2024-09-12T17:59:22.029595+0000","last_peered":"2024-09-12T17:59:22.029595+0000","last_clean":"2024-09-12T17:59:22.029595+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T17:59:22.029595+0000","last_undegraded":"2024-09-12T17:59:22.029595+0000","last_fullsized":"2024-09-12T17:59:22.029595+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:30.133900+0000","last_change":"2024-09-12T17:38:47.022479+0000","last_active":"2024-09-12T17:57:30.133900+0000","last_peered":"2024-09-12T17:57:30.133900+0000","last_clean":"2024-09-12T17:57:30.133900+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T17:57:30.133900+0000","last_undegraded":"2024-09-12T17:57:30.133900+0000","last_fullsized":"2024-09-12T17:57:30.133900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:49.306337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.383540+0000","last_change":"2024-09-12T18:01:43.383540+0000","last_active":"2024-09-12T18:01:43.383540+0000","last_peered":"2024-09-12T18:01:43.383540+0000","last_clean":"2024-09-12T18:01:43.383540+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T18:01:43.383540+0000","last_undegraded":"2024-09-12T18:01:43.383540+0000","last_fullsized":"2024-09-12T18:01:43.383540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:43.383441+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:43.383441+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.383441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:20.540473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.998149+0000","last_change":"2024-09-12T18:01:39.998149+0000","last_active":"2024-09-12T18:01:39.998149+0000","last_peered":"2024-09-12T18:01:39.998149+0000","last_clean":"2024-09-12T18:01:39.998149+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T18:01:39.998149+0000","last_undegraded":"2024-09-12T18:01:39.998149+0000","last_fullsized":"2024-09-12T18:01:39.998149+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:01:39.998052+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:01:39.998052+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.998052+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:42.987824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:12.126695+0000","last_change":"2024-09-12T17:49:56.036857+0000","last_active":"2024-09-12T17:57:12.126695+0000","last_peered":"2024-09-12T17:57:12.126695+0000","last_clean":"2024-09-12T17:57:12.126695+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T17:57:12.126695+0000","last_undegraded":"2024-09-12T17:57:12.126695+0000","last_fullsized":"2024-09-12T17:57:12.126695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:01.304735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'4","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.109684+0000","last_change":"2024-09-12T17:38:47.019373+0000","last_active":"2024-09-12T18:01:03.109684+0000","last_peered":"2024-09-12T18:01:03.109684+0000","last_clean":"2024-09-12T18:01:03.109684+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T18:01:03.109684+0000","last_undegraded":"2024-09-12T18:01:03.109684+0000","last_fullsized":"2024-09-12T18:01:03.109684+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:16.314152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.371144+0000","last_change":"2024-09-12T18:01:44.371144+0000","last_active":"2024-09-12T18:01:44.371144+0000","last_peered":"2024-09-12T18:01:44.371144+0000","last_clean":"2024-09-12T18:01:44.371144+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T18:01:44.371144+0000","last_undegraded":"2024-09-12T18:01:44.371144+0000","last_fullsized":"2024-09-12T18:01:44.371144+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:44.371039+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:44.371039+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.371039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:56.350409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":213,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.356142+0000","last_change":"2024-09-12T18:01:40.356142+0000","last_active":"2024-09-12T18:01:40.356142+0000","last_peered":"2024-09-12T18:01:40.356142+0000","last_clean":"2024-09-12T18:01:40.356142+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T18:01:40.356142+0000","last_undegraded":"2024-09-12T18:01:40.356142+0000","last_fullsized":"2024-09-12T18:01:40.356142+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T18:01:40.356044+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T18:01:40.356044+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.356044+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:32.536982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.137350+0000","last_change":"2024-09-12T17:49:56.047641+0000","last_active":"2024-09-12T17:58:43.137350+0000","last_peered":"2024-09-12T17:58:43.137350+0000","last_clean":"2024-09-12T17:58:43.137350+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T17:58:43.137350+0000","last_undegraded":"2024-09-12T17:58:43.137350+0000","last_fullsized":"2024-09-12T17:58:43.137350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:16.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.147036+0000","last_change":"2024-09-12T17:38:47.029582+0000","last_active":"2024-09-12T17:59:05.147036+0000","last_peered":"2024-09-12T17:59:05.147036+0000","last_clean":"2024-09-12T17:59:05.147036+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T17:59:05.147036+0000","last_undegraded":"2024-09-12T17:59:05.147036+0000","last_fullsized":"2024-09-12T17:59:05.147036+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.975186+0000","last_change":"2024-09-12T18:01:44.975186+0000","last_active":"2024-09-12T18:01:44.975186+0000","last_peered":"2024-09-12T18:01:44.975186+0000","last_clean":"2024-09-12T18:01:44.975186+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T18:01:44.975186+0000","last_undegraded":"2024-09-12T18:01:44.975186+0000","last_fullsized":"2024-09-12T18:01:44.975186+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:44.975076+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:44.975076+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.975076+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:08.064118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.348463+0000","last_change":"2024-09-12T18:01:39.348463+0000","last_active":"2024-09-12T18:01:39.348463+0000","last_peered":"2024-09-12T18:01:39.348463+0000","last_clean":"2024-09-12T18:01:39.348463+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T18:01:39.348463+0000","last_undegraded":"2024-09-12T18:01:39.348463+0000","last_fullsized":"2024-09-12T18:01:39.348463+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:39.348369+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:39.348369+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.348369+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.540420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.136210+0000","last_change":"2024-09-12T17:49:56.049044+0000","last_active":"2024-09-12T17:58:57.136210+0000","last_peered":"2024-09-12T17:58:57.136210+0000","last_clean":"2024-09-12T17:58:57.136210+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T17:58:57.136210+0000","last_undegraded":"2024-09-12T17:58:57.136210+0000","last_fullsized":"2024-09-12T17:58:57.136210+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.147006+0000","last_change":"2024-09-12T17:38:47.025348+0000","last_active":"2024-09-12T17:59:05.147006+0000","last_peered":"2024-09-12T17:59:05.147006+0000","last_clean":"2024-09-12T17:59:05.147006+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T17:59:05.147006+0000","last_undegraded":"2024-09-12T17:59:05.147006+0000","last_fullsized":"2024-09-12T17:59:05.147006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.749496+0000","last_change":"2024-09-12T17:38:43.989723+0000","last_active":"2024-09-12T18:01:04.749496+0000","last_peered":"2024-09-12T18:01:04.749496+0000","last_clean":"2024-09-12T18:01:04.749496+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T18:01:04.749496+0000","last_undegraded":"2024-09-12T18:01:04.749496+0000","last_fullsized":"2024-09-12T18:01:04.749496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:27.013744+0000","last_change":"2024-09-12T17:37:08.648920+0000","last_active":"2024-09-12T17:57:27.013744+0000","last_peered":"2024-09-12T17:57:27.013744+0000","last_clean":"2024-09-12T17:57:27.013744+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T17:57:27.013744+0000","last_undegraded":"2024-09-12T17:57:27.013744+0000","last_fullsized":"2024-09-12T17:57:27.013744+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.023058+0000","last_change":"2024-09-12T17:49:56.036894+0000","last_active":"2024-09-12T17:58:37.023058+0000","last_peered":"2024-09-12T17:58:37.023058+0000","last_clean":"2024-09-12T17:58:37.023058+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T17:58:37.023058+0000","last_undegraded":"2024-09-12T17:58:37.023058+0000","last_fullsized":"2024-09-12T17:58:37.023058+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:30.781444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'10","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.844005+0000","last_change":"2024-09-12T17:38:47.027005+0000","last_active":"2024-09-12T18:01:04.844005+0000","last_peered":"2024-09-12T18:01:04.844005+0000","last_clean":"2024-09-12T18:01:04.844005+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T18:01:04.844005+0000","last_undegraded":"2024-09-12T18:01:04.844005+0000","last_fullsized":"2024-09-12T18:01:04.844005+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15452,"num_write":10,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.408330+0000","last_change":"2024-09-12T18:01:45.408330+0000","last_active":"2024-09-12T18:01:45.408330+0000","last_peered":"2024-09-12T18:01:45.408330+0000","last_clean":"2024-09-12T18:01:45.408330+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T18:01:45.408330+0000","last_undegraded":"2024-09-12T18:01:45.408330+0000","last_fullsized":"2024-09-12T18:01:45.408330+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:45.408246+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:45.408246+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.408246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:45.591221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4108,"num_write":6,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.347107+0000","last_change":"2024-09-12T18:01:40.347107+0000","last_active":"2024-09-12T18:01:40.347107+0000","last_peered":"2024-09-12T18:01:40.347107+0000","last_clean":"2024-09-12T18:01:40.347107+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T18:01:40.347107+0000","last_undegraded":"2024-09-12T18:01:40.347107+0000","last_fullsized":"2024-09-12T18:01:40.347107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-12T18:01:40.346985+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-12T18:01:40.346985+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.346985+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:14.853137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.133197+0000","last_change":"2024-09-12T17:49:56.047746+0000","last_active":"2024-09-12T17:58:37.133197+0000","last_peered":"2024-09-12T17:58:37.133197+0000","last_clean":"2024-09-12T17:58:37.133197+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T17:58:37.133197+0000","last_undegraded":"2024-09-12T17:58:37.133197+0000","last_fullsized":"2024-09-12T17:58:37.133197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:19.785797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'6","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.250691+0000","last_change":"2024-09-12T17:38:47.022037+0000","last_active":"2024-09-12T18:01:03.250691+0000","last_peered":"2024-09-12T18:01:03.250691+0000","last_clean":"2024-09-12T18:01:03.250691+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T18:01:03.250691+0000","last_undegraded":"2024-09-12T18:01:03.250691+0000","last_fullsized":"2024-09-12T18:01:03.250691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11258,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.435473+0000","last_change":"2024-09-12T18:01:47.435473+0000","last_active":"2024-09-12T18:01:47.435473+0000","last_peered":"2024-09-12T18:01:47.435473+0000","last_clean":"2024-09-12T18:01:47.435473+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T18:01:47.435473+0000","last_undegraded":"2024-09-12T18:01:47.435473+0000","last_fullsized":"2024-09-12T18:01:47.435473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.435362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.435362+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.435362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:08.488931+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.440685+0000","last_change":"2024-09-12T18:01:42.440685+0000","last_active":"2024-09-12T18:01:42.440685+0000","last_peered":"2024-09-12T18:01:42.440685+0000","last_clean":"2024-09-12T18:01:42.440685+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T18:01:42.440685+0000","last_undegraded":"2024-09-12T18:01:42.440685+0000","last_fullsized":"2024-09-12T18:01:42.440685+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:42.440599+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:42.440599+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.440599+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:45.997961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:58.140098+0000","last_change":"2024-09-12T17:49:56.045196+0000","last_active":"2024-09-12T17:58:58.140098+0000","last_peered":"2024-09-12T17:58:58.140098+0000","last_clean":"2024-09-12T17:58:58.140098+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T17:58:58.140098+0000","last_undegraded":"2024-09-12T17:58:58.140098+0000","last_fullsized":"2024-09-12T17:58:58.140098+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020855+0000","last_change":"2024-09-12T17:38:47.020511+0000","last_active":"2024-09-12T17:58:17.020855+0000","last_peered":"2024-09-12T17:58:17.020855+0000","last_clean":"2024-09-12T17:58:17.020855+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T17:58:17.020855+0000","last_undegraded":"2024-09-12T17:58:17.020855+0000","last_fullsized":"2024-09-12T17:58:17.020855+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.015103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.402238+0000","last_change":"2024-09-12T18:01:46.402238+0000","last_active":"2024-09-12T18:01:46.402238+0000","last_peered":"2024-09-12T18:01:46.402238+0000","last_clean":"2024-09-12T18:01:46.402238+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T18:01:46.402238+0000","last_undegraded":"2024-09-12T18:01:46.402238+0000","last_fullsized":"2024-09-12T18:01:46.402238+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:46.402155+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:46.402155+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.402155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:08.664363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.429459+0000","last_change":"2024-09-12T18:01:40.429459+0000","last_active":"2024-09-12T18:01:40.429459+0000","last_peered":"2024-09-12T18:01:40.429459+0000","last_clean":"2024-09-12T18:01:40.429459+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T18:01:40.429459+0000","last_undegraded":"2024-09-12T18:01:40.429459+0000","last_fullsized":"2024-09-12T18:01:40.429459+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:40.429380+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:40.429380+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.429380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:15.701071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:57.175881+0000","last_change":"2024-09-12T17:49:56.048011+0000","last_active":"2024-09-12T17:58:57.175881+0000","last_peered":"2024-09-12T17:58:57.175881+0000","last_clean":"2024-09-12T17:58:57.175881+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T17:58:57.175881+0000","last_undegraded":"2024-09-12T17:58:57.175881+0000","last_fullsized":"2024-09-12T17:58:57.175881+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.187297+0000","last_change":"2024-09-12T17:38:47.032812+0000","last_active":"2024-09-12T18:00:27.187297+0000","last_peered":"2024-09-12T18:00:27.187297+0000","last_clean":"2024-09-12T18:00:27.187297+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T18:00:27.187297+0000","last_undegraded":"2024-09-12T18:00:27.187297+0000","last_fullsized":"2024-09-12T18:00:27.187297+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:16.283298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.133853+0000","last_change":"2024-09-12T17:38:43.988490+0000","last_active":"2024-09-12T17:58:13.133853+0000","last_peered":"2024-09-12T17:58:13.133853+0000","last_clean":"2024-09-12T17:58:13.133853+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T17:58:13.133853+0000","last_undegraded":"2024-09-12T17:58:13.133853+0000","last_fullsized":"2024-09-12T17:58:13.133853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.984138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.007253+0000","last_change":"2024-09-12T18:01:38.007253+0000","last_active":"2024-09-12T18:01:38.007253+0000","last_peered":"2024-09-12T18:01:38.007253+0000","last_clean":"2024-09-12T18:01:38.007253+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T18:01:38.007253+0000","last_undegraded":"2024-09-12T18:01:38.007253+0000","last_fullsized":"2024-09-12T18:01:38.007253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T18:01:38.007151+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T18:01:38.007151+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.007151+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:36.080873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.827854+0000","last_change":"2024-09-12T18:01:43.827854+0000","last_active":"2024-09-12T18:01:43.827854+0000","last_peered":"2024-09-12T18:01:43.827854+0000","last_clean":"2024-09-12T18:01:43.827854+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T18:01:43.827854+0000","last_undegraded":"2024-09-12T18:01:43.827854+0000","last_fullsized":"2024-09-12T18:01:43.827854+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:43.827751+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:43.827751+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.827751+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.232289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.141514+0000","last_change":"2024-09-12T17:38:47.030610+0000","last_active":"2024-09-12T17:59:02.141514+0000","last_peered":"2024-09-12T17:59:02.141514+0000","last_clean":"2024-09-12T17:59:02.141514+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T17:59:02.141514+0000","last_undegraded":"2024-09-12T17:59:02.141514+0000","last_fullsized":"2024-09-12T17:59:02.141514+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'9","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.369700+0000","last_change":"2024-09-12T18:01:44.369700+0000","last_active":"2024-09-12T18:01:44.369700+0000","last_peered":"2024-09-12T18:01:44.369700+0000","last_clean":"2024-09-12T18:01:44.369700+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T18:01:44.369700+0000","last_undegraded":"2024-09-12T18:01:44.369700+0000","last_fullsized":"2024-09-12T18:01:44.369700+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T18:01:44.369597+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T18:01:44.369597+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.369597+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.678045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.138340+0000","last_change":"2024-09-12T17:37:08.661047+0000","last_active":"2024-09-12T17:58:48.138340+0000","last_peered":"2024-09-12T17:58:48.138340+0000","last_clean":"2024-09-12T17:58:48.138340+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T17:58:48.138340+0000","last_undegraded":"2024-09-12T17:58:48.138340+0000","last_fullsized":"2024-09-12T17:58:48.138340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:35.362254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:55.145666+0000","last_change":"2024-09-12T17:49:56.045203+0000","last_active":"2024-09-12T17:58:55.145666+0000","last_peered":"2024-09-12T17:58:55.145666+0000","last_clean":"2024-09-12T17:58:55.145666+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T17:58:55.145666+0000","last_undegraded":"2024-09-12T17:58:55.145666+0000","last_fullsized":"2024-09-12T17:58:55.145666+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.690292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.749932+0000","last_change":"2024-09-12T18:01:39.749932+0000","last_active":"2024-09-12T18:01:39.749932+0000","last_peered":"2024-09-12T18:01:39.749932+0000","last_clean":"2024-09-12T18:01:39.749932+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T18:01:39.749932+0000","last_undegraded":"2024-09-12T18:01:39.749932+0000","last_fullsized":"2024-09-12T18:01:39.749932+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:01:39.749836+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:01:39.749836+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.749836+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:48.388934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.140824+0000","last_change":"2024-09-12T17:38:43.993534+0000","last_active":"2024-09-12T18:01:04.140824+0000","last_peered":"2024-09-12T18:01:04.140824+0000","last_clean":"2024-09-12T18:01:04.140824+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T18:01:04.140824+0000","last_undegraded":"2024-09-12T18:01:04.140824+0000","last_fullsized":"2024-09-12T18:01:04.140824+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.760333+0000","last_change":"2024-09-12T18:01:38.760333+0000","last_active":"2024-09-12T18:01:38.760333+0000","last_peered":"2024-09-12T18:01:38.760333+0000","last_clean":"2024-09-12T18:01:38.760333+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T18:01:38.760333+0000","last_undegraded":"2024-09-12T18:01:38.760333+0000","last_fullsized":"2024-09-12T18:01:38.760333+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'24","last_scrub_stamp":"2024-09-12T18:01:38.760231+0000","last_deep_scrub":"265'24","last_deep_scrub_stamp":"2024-09-12T18:01:38.760231+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.760231+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:14.745699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.777247+0000","last_change":"2024-09-12T18:01:42.777247+0000","last_active":"2024-09-12T18:01:42.777247+0000","last_peered":"2024-09-12T18:01:42.777247+0000","last_clean":"2024-09-12T18:01:42.777247+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T18:01:42.777247+0000","last_undegraded":"2024-09-12T18:01:42.777247+0000","last_fullsized":"2024-09-12T18:01:42.777247+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.777148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.777148+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.777148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:23.964598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'8","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.372856+0000","last_change":"2024-09-12T17:38:47.030849+0000","last_active":"2024-09-12T18:01:04.372856+0000","last_peered":"2024-09-12T18:01:04.372856+0000","last_clean":"2024-09-12T18:01:04.372856+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T18:01:04.372856+0000","last_undegraded":"2024-09-12T18:01:04.372856+0000","last_fullsized":"2024-09-12T18:01:04.372856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.031192+0000","last_change":"2024-09-12T17:38:43.991595+0000","last_active":"2024-09-12T17:59:37.031192+0000","last_peered":"2024-09-12T17:59:37.031192+0000","last_clean":"2024-09-12T17:59:37.031192+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T17:59:37.031192+0000","last_undegraded":"2024-09-12T17:59:37.031192+0000","last_fullsized":"2024-09-12T17:59:37.031192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025891+0000","last_change":"2024-09-12T17:37:08.661553+0000","last_active":"2024-09-12T17:58:52.025891+0000","last_peered":"2024-09-12T17:58:52.025891+0000","last_clean":"2024-09-12T17:58:52.025891+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T17:58:52.025891+0000","last_undegraded":"2024-09-12T17:58:52.025891+0000","last_fullsized":"2024-09-12T17:58:52.025891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.649379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020012+0000","last_change":"2024-09-12T17:49:56.041888+0000","last_active":"2024-09-12T17:58:17.020012+0000","last_peered":"2024-09-12T17:58:17.020012+0000","last_clean":"2024-09-12T17:58:17.020012+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T17:58:17.020012+0000","last_undegraded":"2024-09-12T17:58:17.020012+0000","last_fullsized":"2024-09-12T17:58:17.020012+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.145984+0000","last_change":"2024-09-12T17:38:47.024913+0000","last_active":"2024-09-12T17:59:38.145984+0000","last_peered":"2024-09-12T17:59:38.145984+0000","last_clean":"2024-09-12T17:59:38.145984+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T17:59:38.145984+0000","last_undegraded":"2024-09-12T17:59:38.145984+0000","last_fullsized":"2024-09-12T17:59:38.145984+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:04.749551+0000","last_change":"2024-09-12T17:38:43.990480+0000","last_active":"2024-09-12T18:01:04.749551+0000","last_peered":"2024-09-12T18:01:04.749551+0000","last_clean":"2024-09-12T18:01:04.749551+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T18:01:04.749551+0000","last_undegraded":"2024-09-12T18:01:04.749551+0000","last_fullsized":"2024-09-12T18:01:04.749551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025154+0000","last_change":"2024-09-12T17:37:08.649723+0000","last_active":"2024-09-12T17:58:52.025154+0000","last_peered":"2024-09-12T17:58:52.025154+0000","last_clean":"2024-09-12T17:58:52.025154+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T17:58:52.025154+0000","last_undegraded":"2024-09-12T17:58:52.025154+0000","last_fullsized":"2024-09-12T17:58:52.025154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.186149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.132327+0000","last_change":"2024-09-12T17:49:56.046876+0000","last_active":"2024-09-12T17:58:03.132327+0000","last_peered":"2024-09-12T17:58:03.132327+0000","last_clean":"2024-09-12T17:58:03.132327+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T17:58:03.132327+0000","last_undegraded":"2024-09-12T17:58:03.132327+0000","last_fullsized":"2024-09-12T17:58:03.132327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:45.910023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.761849+0000","last_change":"2024-09-12T18:01:37.761849+0000","last_active":"2024-09-12T18:01:37.761849+0000","last_peered":"2024-09-12T18:01:37.761849+0000","last_clean":"2024-09-12T18:01:37.761849+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T18:01:37.761849+0000","last_undegraded":"2024-09-12T18:01:37.761849+0000","last_fullsized":"2024-09-12T18:01:37.761849+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:37.761746+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:37.761746+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.761746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:15.257841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.937998+0000","last_change":"2024-09-12T18:01:45.937998+0000","last_active":"2024-09-12T18:01:45.937998+0000","last_peered":"2024-09-12T18:01:45.937998+0000","last_clean":"2024-09-12T18:01:45.937998+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T18:01:45.937998+0000","last_undegraded":"2024-09-12T18:01:45.937998+0000","last_fullsized":"2024-09-12T18:01:45.937998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.937900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.937900+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.937900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:45.515046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.035068+0000","last_change":"2024-09-12T18:01:37.035068+0000","last_active":"2024-09-12T18:01:37.035068+0000","last_peered":"2024-09-12T18:01:37.035068+0000","last_clean":"2024-09-12T18:01:37.035068+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T18:01:37.035068+0000","last_undegraded":"2024-09-12T18:01:37.035068+0000","last_fullsized":"2024-09-12T18:01:37.035068+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-12T18:01:37.034978+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-12T18:01:37.034978+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.034978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:12.187790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020817+0000","last_change":"2024-09-12T17:49:56.036001+0000","last_active":"2024-09-12T17:58:17.020817+0000","last_peered":"2024-09-12T17:58:17.020817+0000","last_clean":"2024-09-12T17:58:17.020817+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T17:58:17.020817+0000","last_undegraded":"2024-09-12T17:58:17.020817+0000","last_fullsized":"2024-09-12T17:58:17.020817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:20.176376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:27.037880+0000","last_change":"2024-09-12T17:38:47.021549+0000","last_active":"2024-09-12T18:00:27.037880+0000","last_peered":"2024-09-12T18:00:27.037880+0000","last_clean":"2024-09-12T18:00:27.037880+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T18:00:27.037880+0000","last_undegraded":"2024-09-12T18:00:27.037880+0000","last_fullsized":"2024-09-12T18:00:27.037880+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:06.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5116,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.021033+0000","last_change":"2024-09-12T17:38:43.994549+0000","last_active":"2024-09-12T17:58:17.021033+0000","last_peered":"2024-09-12T17:58:17.021033+0000","last_clean":"2024-09-12T17:58:17.021033+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T17:58:17.021033+0000","last_undegraded":"2024-09-12T17:58:17.021033+0000","last_fullsized":"2024-09-12T17:58:17.021033+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:30.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.306523+0000","last_change":"2024-09-12T18:01:38.306523+0000","last_active":"2024-09-12T18:01:38.306523+0000","last_peered":"2024-09-12T18:01:38.306523+0000","last_clean":"2024-09-12T18:01:38.306523+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T18:01:38.306523+0000","last_undegraded":"2024-09-12T18:01:38.306523+0000","last_fullsized":"2024-09-12T18:01:38.306523+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:38.306404+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:38.306404+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.306404+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:31.601797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:35.142766+0000","last_change":"2024-09-12T17:49:56.038182+0000","last_active":"2024-09-12T17:58:35.142766+0000","last_peered":"2024-09-12T17:58:35.142766+0000","last_clean":"2024-09-12T17:58:35.142766+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T17:58:35.142766+0000","last_undegraded":"2024-09-12T17:58:35.142766+0000","last_fullsized":"2024-09-12T17:58:35.142766+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:22.086611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.031499+0000","last_change":"2024-09-12T17:38:47.026375+0000","last_active":"2024-09-12T17:59:37.031499+0000","last_peered":"2024-09-12T17:59:37.031499+0000","last_clean":"2024-09-12T17:59:37.031499+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T17:59:37.031499+0000","last_undegraded":"2024-09-12T17:59:37.031499+0000","last_fullsized":"2024-09-12T17:59:37.031499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.960951+0000","last_change":"2024-09-12T18:01:43.960951+0000","last_active":"2024-09-12T18:01:43.960951+0000","last_peered":"2024-09-12T18:01:43.960951+0000","last_clean":"2024-09-12T18:01:43.960951+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T18:01:43.960951+0000","last_undegraded":"2024-09-12T18:01:43.960951+0000","last_fullsized":"2024-09-12T18:01:43.960951+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:43.960863+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:43.960863+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.960863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:07.304013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.961552+0000","last_change":"2024-09-12T18:01:42.961552+0000","last_active":"2024-09-12T18:01:42.961552+0000","last_peered":"2024-09-12T18:01:42.961552+0000","last_clean":"2024-09-12T18:01:42.961552+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T18:01:42.961552+0000","last_undegraded":"2024-09-12T18:01:42.961552+0000","last_fullsized":"2024-09-12T18:01:42.961552+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T18:01:42.961462+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T18:01:42.961462+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.961462+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:23.401760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.024006+0000","last_change":"2024-09-12T17:49:56.039258+0000","last_active":"2024-09-12T17:58:37.024006+0000","last_peered":"2024-09-12T17:58:37.024006+0000","last_clean":"2024-09-12T17:58:37.024006+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T17:58:37.024006+0000","last_undegraded":"2024-09-12T17:58:37.024006+0000","last_fullsized":"2024-09-12T17:58:37.024006+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.182004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'7","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.109469+0000","last_change":"2024-09-12T17:38:47.026063+0000","last_active":"2024-09-12T18:01:03.109469+0000","last_peered":"2024-09-12T18:01:03.109469+0000","last_clean":"2024-09-12T18:01:03.109469+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T18:01:03.109469+0000","last_undegraded":"2024-09-12T18:01:03.109469+0000","last_fullsized":"2024-09-12T18:01:03.109469+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.717038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3651,"num_write":12,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.031129+0000","last_change":"2024-09-12T17:38:43.988186+0000","last_active":"2024-09-12T17:59:37.031129+0000","last_peered":"2024-09-12T17:59:37.031129+0000","last_clean":"2024-09-12T17:59:37.031129+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T17:59:37.031129+0000","last_undegraded":"2024-09-12T17:59:37.031129+0000","last_fullsized":"2024-09-12T17:59:37.031129+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:42.966621+0000","last_clean_scrub_stamp":"2024-09-12T17:38:42.966621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:02.018369+0000","last_change":"2024-09-12T17:37:08.647170+0000","last_active":"2024-09-12T17:58:02.018369+0000","last_peered":"2024-09-12T17:58:02.018369+0000","last_clean":"2024-09-12T17:58:02.018369+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T17:58:02.018369+0000","last_undegraded":"2024-09-12T17:58:02.018369+0000","last_fullsized":"2024-09-12T17:58:02.018369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:33.128612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.134437+0000","last_change":"2024-09-12T17:49:56.044807+0000","last_active":"2024-09-12T17:58:18.134437+0000","last_peered":"2024-09-12T17:58:18.134437+0000","last_clean":"2024-09-12T17:58:18.134437+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T17:58:18.134437+0000","last_undegraded":"2024-09-12T17:58:18.134437+0000","last_fullsized":"2024-09-12T17:58:18.134437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:28.012638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.180800+0000","last_change":"2024-09-12T17:38:47.035193+0000","last_active":"2024-09-12T17:59:37.180800+0000","last_peered":"2024-09-12T17:59:37.180800+0000","last_clean":"2024-09-12T17:59:37.180800+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T17:59:37.180800+0000","last_undegraded":"2024-09-12T17:59:37.180800+0000","last_fullsized":"2024-09-12T17:59:37.180800+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.404175+0000","last_change":"2024-09-12T18:01:46.404175+0000","last_active":"2024-09-12T18:01:46.404175+0000","last_peered":"2024-09-12T18:01:46.404175+0000","last_clean":"2024-09-12T18:01:46.404175+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T18:01:46.404175+0000","last_undegraded":"2024-09-12T18:01:46.404175+0000","last_fullsized":"2024-09-12T18:01:46.404175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:46.404077+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:46.404077+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.404077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:52.508125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4118,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.571968+0000","last_change":"2024-09-12T17:37:08.656010+0000","last_active":"2024-09-12T17:59:05.571968+0000","last_peered":"2024-09-12T17:59:05.571968+0000","last_clean":"2024-09-12T17:59:05.571968+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T17:59:05.571968+0000","last_undegraded":"2024-09-12T17:59:05.571968+0000","last_fullsized":"2024-09-12T17:59:05.571968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:37:07.623367+0000","last_clean_scrub_stamp":"2024-09-12T17:37:07.623367+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.346921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021616+0000","last_change":"2024-09-12T17:49:56.043230+0000","last_active":"2024-09-12T17:58:22.021616+0000","last_peered":"2024-09-12T17:58:22.021616+0000","last_clean":"2024-09-12T17:58:22.021616+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T17:58:22.021616+0000","last_undegraded":"2024-09-12T17:58:22.021616+0000","last_fullsized":"2024-09-12T17:58:22.021616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:33.627052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.965307+0000","last_change":"2024-09-12T18:01:46.965307+0000","last_active":"2024-09-12T18:01:46.965307+0000","last_peered":"2024-09-12T18:01:46.965307+0000","last_clean":"2024-09-12T18:01:46.965307+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T18:01:46.965307+0000","last_undegraded":"2024-09-12T18:01:46.965307+0000","last_fullsized":"2024-09-12T18:01:46.965307+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:46.965209+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:46.965209+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.965209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:29.481280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.335597+0000","last_change":"2024-09-12T18:01:41.335530+0000","last_active":"2024-09-12T18:01:41.335597+0000","last_peered":"2024-09-12T18:01:41.335597+0000","last_clean":"2024-09-12T18:01:41.335597+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T18:01:41.335597+0000","last_undegraded":"2024-09-12T18:01:41.335597+0000","last_fullsized":"2024-09-12T18:01:41.335597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:41.335442+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:41.335442+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.335442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:40.801426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.974360+0000","last_change":"2024-09-12T18:01:38.974360+0000","last_active":"2024-09-12T18:01:38.974360+0000","last_peered":"2024-09-12T18:01:38.974360+0000","last_clean":"2024-09-12T18:01:38.974360+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T18:01:38.974360+0000","last_undegraded":"2024-09-12T18:01:38.974360+0000","last_fullsized":"2024-09-12T18:01:38.974360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T18:01:38.974250+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T18:01:38.974250+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.974250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:57.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'321","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.693631+0000","last_change":"2024-09-12T18:01:23.693564+0000","last_active":"2024-09-12T18:01:23.693631+0000","last_peered":"2024-09-12T18:01:23.693631+0000","last_clean":"2024-09-12T18:01:23.693631+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T18:01:23.693631+0000","last_undegraded":"2024-09-12T18:01:23.693631+0000","last_fullsized":"2024-09-12T18:01:23.693631+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.693423+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:45.036692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399146,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":38786,"num_write":1044,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'482","reported_seq":1980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.202958+0000","last_change":"2024-09-12T18:01:23.202958+0000","last_active":"2024-09-12T18:01:23.202958+0000","last_peered":"2024-09-12T18:01:23.202958+0000","last_clean":"2024-09-12T18:01:23.202958+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T18:01:23.202958+0000","last_undegraded":"2024-09-12T18:01:23.202958+0000","last_fullsized":"2024-09-12T18:01:23.202958+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.202855+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:43.946108+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":941,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'373","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.026863+0000","last_change":"2024-09-12T18:01:24.026802+0000","last_active":"2024-09-12T18:01:24.026863+0000","last_peered":"2024-09-12T18:01:24.026863+0000","last_clean":"2024-09-12T18:01:24.026863+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:24.026863+0000","last_undegraded":"2024-09-12T18:01:24.026863+0000","last_fullsized":"2024-09-12T18:01:24.026863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.026638+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.853845+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":37151,"num_write":1322,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'546","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.582483+0000","last_change":"2024-09-12T18:01:34.582483+0000","last_active":"2024-09-12T18:01:34.582483+0000","last_peered":"2024-09-12T18:01:34.582483+0000","last_clean":"2024-09-12T18:01:34.582483+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T18:01:34.582483+0000","last_undegraded":"2024-09-12T18:01:34.582483+0000","last_fullsized":"2024-09-12T18:01:34.582483+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'546","last_scrub_stamp":"2024-09-12T18:01:34.582313+0000","last_deep_scrub":"265'546","last_deep_scrub_stamp":"2024-09-12T18:01:34.582313+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.582313+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:12.771444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":485,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'320","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.022949+0000","last_change":"2024-09-12T18:01:23.022871+0000","last_active":"2024-09-12T18:01:23.022949+0000","last_peered":"2024-09-12T18:01:23.022949+0000","last_clean":"2024-09-12T18:01:23.022949+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:23.022949+0000","last_undegraded":"2024-09-12T18:01:23.022949+0000","last_fullsized":"2024-09-12T18:01:23.022949+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.022698+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:20.281089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288578,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":719,"num_read_kb":16808,"num_write":978,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'615","reported_seq":2383,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.543305+0000","last_change":"2024-09-12T18:01:33.543305+0000","last_active":"2024-09-12T18:01:33.543305+0000","last_peered":"2024-09-12T18:01:33.543305+0000","last_clean":"2024-09-12T18:01:33.543305+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T18:01:33.543305+0000","last_undegraded":"2024-09-12T18:01:33.543305+0000","last_fullsized":"2024-09-12T18:01:33.543305+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'615","last_scrub_stamp":"2024-09-12T18:01:33.543217+0000","last_deep_scrub":"265'615","last_deep_scrub_stamp":"2024-09-12T18:01:33.543217+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.543217+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:40.509832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'428","reported_seq":1109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.900585+0000","last_change":"2024-09-12T18:01:14.900585+0000","last_active":"2024-09-12T18:01:14.900585+0000","last_peered":"2024-09-12T18:01:14.900585+0000","last_clean":"2024-09-12T18:01:14.900585+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T18:01:14.900585+0000","last_undegraded":"2024-09-12T18:01:14.900585+0000","last_fullsized":"2024-09-12T18:01:14.900585+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.900378+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:40.317506+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355300,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":592,"num_read_kb":16041,"num_write":1318,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.874120+0000","last_change":"2024-09-12T18:01:25.874120+0000","last_active":"2024-09-12T18:01:25.874120+0000","last_peered":"2024-09-12T18:01:25.874120+0000","last_clean":"2024-09-12T18:01:25.874120+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T18:01:25.874120+0000","last_undegraded":"2024-09-12T18:01:25.874120+0000","last_fullsized":"2024-09-12T18:01:25.874120+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.874037+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:51.343725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'286","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.715916+0000","last_change":"2024-09-12T18:01:15.715916+0000","last_active":"2024-09-12T18:01:15.715916+0000","last_peered":"2024-09-12T18:01:15.715916+0000","last_clean":"2024-09-12T18:01:15.715916+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T18:01:15.715916+0000","last_undegraded":"2024-09-12T18:01:15.715916+0000","last_fullsized":"2024-09-12T18:01:15.715916+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.715784+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:13.680021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":5548,"num_write":891,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'845","reported_seq":2513,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.658937+0000","last_change":"2024-09-12T18:01:18.658937+0000","last_active":"2024-09-12T18:01:18.658937+0000","last_peered":"2024-09-12T18:01:18.658937+0000","last_clean":"2024-09-12T18:01:18.658937+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T18:01:18.658937+0000","last_undegraded":"2024-09-12T18:01:18.658937+0000","last_fullsized":"2024-09-12T18:01:18.658937+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'845","last_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_deep_scrub":"265'845","last_deep_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.658839+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:56.655053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'324","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.905312+0000","last_change":"2024-09-12T18:01:15.905312+0000","last_active":"2024-09-12T18:01:15.905312+0000","last_peered":"2024-09-12T18:01:15.905312+0000","last_clean":"2024-09-12T18:01:15.905312+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T18:01:15.905312+0000","last_undegraded":"2024-09-12T18:01:15.905312+0000","last_fullsized":"2024-09-12T18:01:15.905312+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.905069+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:23.219539+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":30145,"num_write":1083,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'508","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.724250+0000","last_change":"2024-09-12T18:01:20.724189+0000","last_active":"2024-09-12T18:01:20.724250+0000","last_peered":"2024-09-12T18:01:20.724250+0000","last_clean":"2024-09-12T18:01:20.724250+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:01:20.724250+0000","last_undegraded":"2024-09-12T18:01:20.724250+0000","last_fullsized":"2024-09-12T18:01:20.724250+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'508","last_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_deep_scrub":"265'508","last_deep_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.724105+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:47.581144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'367","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.683331+0000","last_change":"2024-09-12T18:01:21.683331+0000","last_active":"2024-09-12T18:01:21.683331+0000","last_peered":"2024-09-12T18:01:21.683331+0000","last_clean":"2024-09-12T18:01:21.683331+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T18:01:21.683331+0000","last_undegraded":"2024-09-12T18:01:21.683331+0000","last_fullsized":"2024-09-12T18:01:21.683331+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.683187+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.284187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036318,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":10450,"num_write":1136,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'745","reported_seq":2179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.002193+0000","last_change":"2024-09-12T18:01:23.002080+0000","last_active":"2024-09-12T18:01:23.002193+0000","last_peered":"2024-09-12T18:01:23.002193+0000","last_clean":"2024-09-12T18:01:23.002193+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T18:01:23.002193+0000","last_undegraded":"2024-09-12T18:01:23.002193+0000","last_fullsized":"2024-09-12T18:01:23.002193+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.001977+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:23.455291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'413","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.990417+0000","last_change":"2024-09-12T18:01:21.990417+0000","last_active":"2024-09-12T18:01:21.990417+0000","last_peered":"2024-09-12T18:01:21.990417+0000","last_clean":"2024-09-12T18:01:21.990417+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:21.990417+0000","last_undegraded":"2024-09-12T18:01:21.990417+0000","last_fullsized":"2024-09-12T18:01:21.990417+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.990298+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:19.678560+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":69100,"num_write":1161,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1196","reported_seq":2925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.158209+0000","last_change":"2024-09-12T18:01:33.158209+0000","last_active":"2024-09-12T18:01:33.158209+0000","last_peered":"2024-09-12T18:01:33.158209+0000","last_clean":"2024-09-12T18:01:33.158209+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T18:01:33.158209+0000","last_undegraded":"2024-09-12T18:01:33.158209+0000","last_fullsized":"2024-09-12T18:01:33.158209+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1196","last_scrub_stamp":"2024-09-12T18:01:33.158104+0000","last_deep_scrub":"265'1196","last_deep_scrub_stamp":"2024-09-12T18:01:33.158104+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.158104+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:58.782843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'490","reported_seq":2047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.532215+0000","last_change":"2024-09-12T18:01:32.532215+0000","last_active":"2024-09-12T18:01:32.532215+0000","last_peered":"2024-09-12T18:01:32.532215+0000","last_clean":"2024-09-12T18:01:32.532215+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T18:01:32.532215+0000","last_undegraded":"2024-09-12T18:01:32.532215+0000","last_fullsized":"2024-09-12T18:01:32.532215+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:32.532145+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:32.532145+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.532145+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:43.375201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'383","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.180354+0000","last_change":"2024-09-12T18:01:15.180354+0000","last_active":"2024-09-12T18:01:15.180354+0000","last_peered":"2024-09-12T18:01:15.180354+0000","last_clean":"2024-09-12T18:01:15.180354+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:01:15.180354+0000","last_undegraded":"2024-09-12T18:01:15.180354+0000","last_fullsized":"2024-09-12T18:01:15.180354+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.180191+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:38.231795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":53764,"num_write":1216,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'449","reported_seq":2064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.661671+0000","last_change":"2024-09-12T18:01:22.661599+0000","last_active":"2024-09-12T18:01:22.661671+0000","last_peered":"2024-09-12T18:01:22.661671+0000","last_clean":"2024-09-12T18:01:22.661671+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T18:01:22.661671+0000","last_undegraded":"2024-09-12T18:01:22.661671+0000","last_fullsized":"2024-09-12T18:01:22.661671+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.661510+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:11.348161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'317","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.714065+0000","last_change":"2024-09-12T18:01:14.714065+0000","last_active":"2024-09-12T18:01:14.714065+0000","last_peered":"2024-09-12T18:01:14.714065+0000","last_clean":"2024-09-12T18:01:14.714065+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T18:01:14.714065+0000","last_undegraded":"2024-09-12T18:01:14.714065+0000","last_fullsized":"2024-09-12T18:01:14.714065+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.713905+0000","objects_scrubbed":11,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.647051+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":34593,"num_write":1052,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'469","reported_seq":2172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.180905+0000","last_change":"2024-09-12T18:01:20.180816+0000","last_active":"2024-09-12T18:01:20.180905+0000","last_peered":"2024-09-12T18:01:20.180905+0000","last_clean":"2024-09-12T18:01:20.180905+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T18:01:20.180905+0000","last_undegraded":"2024-09-12T18:01:20.180905+0000","last_fullsized":"2024-09-12T18:01:20.180905+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'469","last_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_deep_scrub":"265'469","last_deep_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.180664+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.671311+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'341","reported_seq":1172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.821456+0000","last_change":"2024-09-12T18:01:11.821456+0000","last_active":"2024-09-12T18:01:11.821456+0000","last_peered":"2024-09-12T18:01:11.821456+0000","last_clean":"2024-09-12T18:01:11.821456+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T18:01:11.821456+0000","last_undegraded":"2024-09-12T18:01:11.821456+0000","last_fullsized":"2024-09-12T18:01:11.821456+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.821358+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:08.588749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":875,"num_read_kb":30506,"num_write":1060,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'420","reported_seq":2007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.353429+0000","last_change":"2024-09-12T18:01:25.353429+0000","last_active":"2024-09-12T18:01:25.353429+0000","last_peered":"2024-09-12T18:01:25.353429+0000","last_clean":"2024-09-12T18:01:25.353429+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T18:01:25.353429+0000","last_undegraded":"2024-09-12T18:01:25.353429+0000","last_fullsized":"2024-09-12T18:01:25.353429+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.353351+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:54.030926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'419","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.786986+0000","last_change":"2024-09-12T18:01:12.786986+0000","last_active":"2024-09-12T18:01:12.786986+0000","last_peered":"2024-09-12T18:01:12.786986+0000","last_clean":"2024-09-12T18:01:12.786986+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T18:01:12.786986+0000","last_undegraded":"2024-09-12T18:01:12.786986+0000","last_fullsized":"2024-09-12T18:01:12.786986+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.786804+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:13.752525+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":18097,"num_write":1302,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1544","reported_seq":3166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.151769+0000","last_change":"2024-09-12T18:01:32.151769+0000","last_active":"2024-09-12T18:01:32.151769+0000","last_peered":"2024-09-12T18:01:32.151769+0000","last_clean":"2024-09-12T18:01:32.151769+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T18:01:32.151769+0000","last_undegraded":"2024-09-12T18:01:32.151769+0000","last_fullsized":"2024-09-12T18:01:32.151769+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1544","last_scrub_stamp":"2024-09-12T18:01:32.151645+0000","last_deep_scrub":"265'1544","last_deep_scrub_stamp":"2024-09-12T18:01:32.151645+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.151645+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:18.366283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'346","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.285549+0000","last_change":"2024-09-12T18:01:22.285549+0000","last_active":"2024-09-12T18:01:22.285549+0000","last_peered":"2024-09-12T18:01:22.285549+0000","last_clean":"2024-09-12T18:01:22.285549+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T18:01:22.285549+0000","last_undegraded":"2024-09-12T18:01:22.285549+0000","last_fullsized":"2024-09-12T18:01:22.285549+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.285373+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:53.823367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":18482,"num_write":1050,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'789","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.204231+0000","last_change":"2024-09-12T18:01:21.204231+0000","last_active":"2024-09-12T18:01:21.204231+0000","last_peered":"2024-09-12T18:01:21.204231+0000","last_clean":"2024-09-12T18:01:21.204231+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T18:01:21.204231+0000","last_undegraded":"2024-09-12T18:01:21.204231+0000","last_fullsized":"2024-09-12T18:01:21.204231+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'789","last_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_deep_scrub":"265'789","last_deep_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.204081+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:13.829902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.232895+0000","last_change":"2024-09-12T18:01:16.232834+0000","last_active":"2024-09-12T18:01:16.232895+0000","last_peered":"2024-09-12T18:01:16.232895+0000","last_clean":"2024-09-12T18:01:16.232895+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T18:01:16.232895+0000","last_undegraded":"2024-09-12T18:01:16.232895+0000","last_fullsized":"2024-09-12T18:01:16.232895+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.232719+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.506531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399140,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":4177,"num_write":987,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'175","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.830954+0000","last_change":"2024-09-12T18:01:35.830954+0000","last_active":"2024-09-12T18:01:35.830954+0000","last_peered":"2024-09-12T18:01:35.830954+0000","last_clean":"2024-09-12T18:01:35.830954+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T18:01:35.830954+0000","last_undegraded":"2024-09-12T18:01:35.830954+0000","last_fullsized":"2024-09-12T18:01:35.830954+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T18:01:35.830857+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T18:01:35.830857+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.830857+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:30.622531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'443","reported_seq":2027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.303962+0000","last_change":"2024-09-12T18:01:23.303906+0000","last_active":"2024-09-12T18:01:23.303962+0000","last_peered":"2024-09-12T18:01:23.303962+0000","last_clean":"2024-09-12T18:01:23.303962+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T18:01:23.303962+0000","last_undegraded":"2024-09-12T18:01:23.303962+0000","last_fullsized":"2024-09-12T18:01:23.303962+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'443","last_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_deep_scrub":"265'443","last_deep_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.303815+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.507190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'409","reported_seq":1226,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.577737+0000","last_change":"2024-09-12T18:01:24.577601+0000","last_active":"2024-09-12T18:01:24.577737+0000","last_peered":"2024-09-12T18:01:24.577737+0000","last_clean":"2024-09-12T18:01:24.577737+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T18:01:24.577737+0000","last_undegraded":"2024-09-12T18:01:24.577737+0000","last_fullsized":"2024-09-12T18:01:24.577737+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.577312+0000","objects_scrubbed":11,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:04.271781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460277,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":57262,"num_write":1362,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:12.020196+0000","last_change":"2024-09-12T17:21:54.756402+0000","last_active":"2024-09-12T17:58:12.020196+0000","last_peered":"2024-09-12T17:58:12.020196+0000","last_clean":"2024-09-12T17:58:12.020196+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T17:58:12.020196+0000","last_undegraded":"2024-09-12T17:58:12.020196+0000","last_fullsized":"2024-09-12T17:58:12.020196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:53.730779+0000","last_clean_scrub_stamp":"2024-09-12T17:21:53.730779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'347","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.870078+0000","last_change":"2024-09-12T18:01:38.870078+0000","last_active":"2024-09-12T18:01:38.870078+0000","last_peered":"2024-09-12T18:01:38.870078+0000","last_clean":"2024-09-12T18:01:38.870078+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:01:38.870078+0000","last_undegraded":"2024-09-12T18:01:38.870078+0000","last_fullsized":"2024-09-12T18:01:38.870078+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T18:01:38.869957+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T18:01:38.869957+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.869957+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:20.747422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":1109,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.326416+0000","last_change":"2024-09-12T18:01:37.326416+0000","last_active":"2024-09-12T18:01:37.326416+0000","last_peered":"2024-09-12T18:01:37.326416+0000","last_clean":"2024-09-12T18:01:37.326416+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T18:01:37.326416+0000","last_undegraded":"2024-09-12T18:01:37.326416+0000","last_fullsized":"2024-09-12T18:01:37.326416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:37.326332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:37.326332+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.326332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:29.403460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2434","reported_seq":4326,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.350773+0000","last_change":"2024-09-12T18:01:39.350773+0000","last_active":"2024-09-12T18:01:39.350773+0000","last_peered":"2024-09-12T18:01:39.350773+0000","last_clean":"2024-09-12T18:01:39.350773+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T18:01:39.350773+0000","last_undegraded":"2024-09-12T18:01:39.350773+0000","last_fullsized":"2024-09-12T18:01:39.350773+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2434","last_scrub_stamp":"2024-09-12T18:01:39.350685+0000","last_deep_scrub":"265'2434","last_deep_scrub_stamp":"2024-09-12T18:01:39.350685+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.350685+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":2400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:34.512367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'793","reported_seq":2278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.559926+0000","last_change":"2024-09-12T18:01:30.559926+0000","last_active":"2024-09-12T18:01:30.559926+0000","last_peered":"2024-09-12T18:01:30.559926+0000","last_clean":"2024-09-12T18:01:30.559926+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:01:30.559926+0000","last_undegraded":"2024-09-12T18:01:30.559926+0000","last_fullsized":"2024-09-12T18:01:30.559926+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-12T18:01:30.559816+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-12T18:01:30.559816+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.559816+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:24.626799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'312","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.189266+0000","last_change":"2024-09-12T18:01:14.189194+0000","last_active":"2024-09-12T18:01:14.189266+0000","last_peered":"2024-09-12T18:01:14.189266+0000","last_clean":"2024-09-12T18:01:14.189266+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T18:01:14.189266+0000","last_undegraded":"2024-09-12T18:01:14.189266+0000","last_fullsized":"2024-09-12T18:01:14.189266+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.189092+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:46.249612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170284,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":362,"num_read_kb":2179,"num_write":871,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.916745+0000","last_change":"2024-09-12T18:01:31.916681+0000","last_active":"2024-09-12T18:01:31.916745+0000","last_peered":"2024-09-12T18:01:31.916745+0000","last_clean":"2024-09-12T18:01:31.916745+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T18:01:31.916745+0000","last_undegraded":"2024-09-12T18:01:31.916745+0000","last_fullsized":"2024-09-12T18:01:31.916745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.916560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.916560+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.916560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:06.898966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.245105+0000","last_change":"2024-09-12T18:01:30.245105+0000","last_active":"2024-09-12T18:01:30.245105+0000","last_peered":"2024-09-12T18:01:30.245105+0000","last_clean":"2024-09-12T18:01:30.245105+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T18:01:30.245105+0000","last_undegraded":"2024-09-12T18:01:30.245105+0000","last_fullsized":"2024-09-12T18:01:30.245105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T18:01:30.244973+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T18:01:30.244973+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.244973+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:09.238201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.225558+0000","last_change":"2024-09-12T18:01:34.225558+0000","last_active":"2024-09-12T18:01:34.225558+0000","last_peered":"2024-09-12T18:01:34.225558+0000","last_clean":"2024-09-12T18:01:34.225558+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T18:01:34.225558+0000","last_undegraded":"2024-09-12T18:01:34.225558+0000","last_fullsized":"2024-09-12T18:01:34.225558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:34.225467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:34.225467+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.225467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:10.074549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'131","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.420351+0000","last_change":"2024-09-12T18:01:39.420351+0000","last_active":"2024-09-12T18:01:39.420351+0000","last_peered":"2024-09-12T18:01:39.420351+0000","last_clean":"2024-09-12T18:01:39.420351+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T18:01:39.420351+0000","last_undegraded":"2024-09-12T18:01:39.420351+0000","last_fullsized":"2024-09-12T18:01:39.420351+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T18:01:39.420258+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T18:01:39.420258+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.420258+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:28.166252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1531","reported_seq":3108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.124184+0000","last_change":"2024-09-12T18:01:27.124184+0000","last_active":"2024-09-12T18:01:27.124184+0000","last_peered":"2024-09-12T18:01:27.124184+0000","last_clean":"2024-09-12T18:01:27.124184+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T18:01:27.124184+0000","last_undegraded":"2024-09-12T18:01:27.124184+0000","last_fullsized":"2024-09-12T18:01:27.124184+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1531","last_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_deep_scrub":"265'1531","last_deep_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.124084+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":1500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.265522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'349","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.543288+0000","last_change":"2024-09-12T18:01:16.543222+0000","last_active":"2024-09-12T18:01:16.543288+0000","last_peered":"2024-09-12T18:01:16.543288+0000","last_clean":"2024-09-12T18:01:16.543288+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T18:01:16.543288+0000","last_undegraded":"2024-09-12T18:01:16.543288+0000","last_fullsized":"2024-09-12T18:01:16.543288+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.543095+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:40.971401+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":7819,"num_write":1100,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.906437+0000","last_change":"2024-09-12T18:01:30.906437+0000","last_active":"2024-09-12T18:01:30.906437+0000","last_peered":"2024-09-12T18:01:30.906437+0000","last_clean":"2024-09-12T18:01:30.906437+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T18:01:30.906437+0000","last_undegraded":"2024-09-12T18:01:30.906437+0000","last_fullsized":"2024-09-12T18:01:30.906437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:30.906353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:30.906353+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.906353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:49.215510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'110","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.875575+0000","last_change":"2024-09-12T18:01:37.875476+0000","last_active":"2024-09-12T18:01:37.875575+0000","last_peered":"2024-09-12T18:01:37.875575+0000","last_clean":"2024-09-12T18:01:37.875575+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T18:01:37.875575+0000","last_undegraded":"2024-09-12T18:01:37.875575+0000","last_fullsized":"2024-09-12T18:01:37.875575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T18:01:37.875381+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T18:01:37.875381+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.875381+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.856181+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'788","reported_seq":2213,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.232005+0000","last_change":"2024-09-12T17:21:58.790046+0000","last_active":"2024-09-12T18:01:03.232005+0000","last_peered":"2024-09-12T18:01:03.232005+0000","last_clean":"2024-09-12T18:01:03.232005+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:01:03.232005+0000","last_undegraded":"2024-09-12T18:01:03.232005+0000","last_fullsized":"2024-09-12T18:01:03.232005+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:36.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'224","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.964113+0000","last_change":"2024-09-12T18:01:40.964113+0000","last_active":"2024-09-12T18:01:40.964113+0000","last_peered":"2024-09-12T18:01:40.964113+0000","last_clean":"2024-09-12T18:01:40.964113+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:01:40.964113+0000","last_undegraded":"2024-09-12T18:01:40.964113+0000","last_fullsized":"2024-09-12T18:01:40.964113+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'224","last_scrub_stamp":"2024-09-12T18:01:40.964028+0000","last_deep_scrub":"265'224","last_deep_scrub_stamp":"2024-09-12T18:01:40.964028+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.964028+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:48.429704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'715","reported_seq":1977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.102558+0000","last_change":"2024-09-12T18:01:28.102558+0000","last_active":"2024-09-12T18:01:28.102558+0000","last_peered":"2024-09-12T18:01:28.102558+0000","last_clean":"2024-09-12T18:01:28.102558+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T18:01:28.102558+0000","last_undegraded":"2024-09-12T18:01:28.102558+0000","last_fullsized":"2024-09-12T18:01:28.102558+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'715","last_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_deep_scrub":"265'715","last_deep_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.102443+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:34.202300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'416","reported_seq":1142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.092409+0000","last_change":"2024-09-12T18:01:11.092314+0000","last_active":"2024-09-12T18:01:11.092409+0000","last_peered":"2024-09-12T18:01:11.092409+0000","last_clean":"2024-09-12T18:01:11.092409+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T18:01:11.092409+0000","last_undegraded":"2024-09-12T18:01:11.092409+0000","last_fullsized":"2024-09-12T18:01:11.092409+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.092136+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:29.744238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":18208,"num_write":1467,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.714001+0000","last_change":"2024-09-12T18:01:40.714001+0000","last_active":"2024-09-12T18:01:40.714001+0000","last_peered":"2024-09-12T18:01:40.714001+0000","last_clean":"2024-09-12T18:01:40.714001+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T18:01:40.714001+0000","last_undegraded":"2024-09-12T18:01:40.714001+0000","last_fullsized":"2024-09-12T18:01:40.714001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.713898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.713898+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.713898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:58.178175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'281","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.097066+0000","last_change":"2024-09-12T18:01:30.097066+0000","last_active":"2024-09-12T18:01:30.097066+0000","last_peered":"2024-09-12T18:01:30.097066+0000","last_clean":"2024-09-12T18:01:30.097066+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:01:30.097066+0000","last_undegraded":"2024-09-12T18:01:30.097066+0000","last_fullsized":"2024-09-12T18:01:30.097066+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T18:01:30.096979+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T18:01:30.096979+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.096979+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.426534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1135,"num_write":384,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'811","reported_seq":2323,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.171925+0000","last_change":"2024-09-12T18:01:42.171869+0000","last_active":"2024-09-12T18:01:42.171925+0000","last_peered":"2024-09-12T18:01:42.171925+0000","last_clean":"2024-09-12T18:01:42.171925+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:42.171925+0000","last_undegraded":"2024-09-12T18:01:42.171925+0000","last_fullsized":"2024-09-12T18:01:42.171925+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'811","last_scrub_stamp":"2024-09-12T18:01:42.171786+0000","last_deep_scrub":"265'811","last_deep_scrub_stamp":"2024-09-12T18:01:42.171786+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.171786+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:13.657327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'421","reported_seq":1994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.533263+0000","last_change":"2024-09-12T18:01:28.533263+0000","last_active":"2024-09-12T18:01:28.533263+0000","last_peered":"2024-09-12T18:01:28.533263+0000","last_clean":"2024-09-12T18:01:28.533263+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:01:28.533263+0000","last_undegraded":"2024-09-12T18:01:28.533263+0000","last_fullsized":"2024-09-12T18:01:28.533263+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T18:01:28.533126+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T18:01:28.533126+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.533126+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:59.686316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'329","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.822719+0000","last_change":"2024-09-12T18:01:09.822719+0000","last_active":"2024-09-12T18:01:09.822719+0000","last_peered":"2024-09-12T18:01:09.822719+0000","last_clean":"2024-09-12T18:01:09.822719+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T18:01:09.822719+0000","last_undegraded":"2024-09-12T18:01:09.822719+0000","last_fullsized":"2024-09-12T18:01:09.822719+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.822608+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:13.917726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":438,"num_read_kb":9180,"num_write":1028,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"265'6","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.204893+0000","last_change":"2024-09-12T18:01:24.204893+0000","last_active":"2024-09-12T18:01:24.204893+0000","last_peered":"2024-09-12T18:01:24.204893+0000","last_clean":"2024-09-12T18:01:24.204893+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:01:24.204893+0000","last_undegraded":"2024-09-12T18:01:24.204893+0000","last_fullsized":"2024-09-12T18:01:24.204893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.204776+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.761047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'319","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.723540+0000","last_change":"2024-09-12T18:01:26.723540+0000","last_active":"2024-09-12T18:01:26.723540+0000","last_peered":"2024-09-12T18:01:26.723540+0000","last_clean":"2024-09-12T18:01:26.723540+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T18:01:26.723540+0000","last_undegraded":"2024-09-12T18:01:26.723540+0000","last_fullsized":"2024-09-12T18:01:26.723540+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.723419+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:46.051413+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42323,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1094,"num_write":406,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.406506+0000","last_change":"2024-09-12T18:01:34.406506+0000","last_active":"2024-09-12T18:01:34.406506+0000","last_peered":"2024-09-12T18:01:34.406506+0000","last_clean":"2024-09-12T18:01:34.406506+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T18:01:34.406506+0000","last_undegraded":"2024-09-12T18:01:34.406506+0000","last_fullsized":"2024-09-12T18:01:34.406506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:34.406415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:34.406415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.406415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:03.678153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'545","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.003367+0000","last_change":"2024-09-12T18:01:35.003300+0000","last_active":"2024-09-12T18:01:35.003367+0000","last_peered":"2024-09-12T18:01:35.003367+0000","last_clean":"2024-09-12T18:01:35.003367+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:01:35.003367+0000","last_undegraded":"2024-09-12T18:01:35.003367+0000","last_fullsized":"2024-09-12T18:01:35.003367+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'545","last_scrub_stamp":"2024-09-12T18:01:35.003187+0000","last_deep_scrub":"265'545","last_deep_scrub_stamp":"2024-09-12T18:01:35.003187+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.003187+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:16.023359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'854","reported_seq":2404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.150958+0000","last_change":"2024-09-12T18:01:13.150958+0000","last_active":"2024-09-12T18:01:13.150958+0000","last_peered":"2024-09-12T18:01:13.150958+0000","last_clean":"2024-09-12T18:01:13.150958+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T18:01:13.150958+0000","last_undegraded":"2024-09-12T18:01:13.150958+0000","last_fullsized":"2024-09-12T18:01:13.150958+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'854","last_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_deep_scrub":"265'854","last_deep_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.150845+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.897083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'342","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.910415+0000","last_change":"2024-09-12T18:01:10.910415+0000","last_active":"2024-09-12T18:01:10.910415+0000","last_peered":"2024-09-12T18:01:10.910415+0000","last_clean":"2024-09-12T18:01:10.910415+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T18:01:10.910415+0000","last_undegraded":"2024-09-12T18:01:10.910415+0000","last_fullsized":"2024-09-12T18:01:10.910415+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.910294+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:18.320214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372398,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":25919,"num_write":1097,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.361255+0000","last_change":"2024-09-12T18:01:27.361255+0000","last_active":"2024-09-12T18:01:27.361255+0000","last_peered":"2024-09-12T18:01:27.361255+0000","last_clean":"2024-09-12T18:01:27.361255+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T18:01:27.361255+0000","last_undegraded":"2024-09-12T18:01:27.361255+0000","last_fullsized":"2024-09-12T18:01:27.361255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.361167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.361167+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.361167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:37.186412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'278","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.921489+0000","last_change":"2024-09-12T18:01:34.921489+0000","last_active":"2024-09-12T18:01:34.921489+0000","last_peered":"2024-09-12T18:01:34.921489+0000","last_clean":"2024-09-12T18:01:34.921489+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:01:34.921489+0000","last_undegraded":"2024-09-12T18:01:34.921489+0000","last_fullsized":"2024-09-12T18:01:34.921489+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T18:01:34.921399+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T18:01:34.921399+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.921399+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:47.961172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1078,"num_write":370,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.974204+0000","last_change":"2024-09-12T18:01:42.974204+0000","last_active":"2024-09-12T18:01:42.974204+0000","last_peered":"2024-09-12T18:01:42.974204+0000","last_clean":"2024-09-12T18:01:42.974204+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T18:01:42.974204+0000","last_undegraded":"2024-09-12T18:01:42.974204+0000","last_fullsized":"2024-09-12T18:01:42.974204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.974116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.974116+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.974116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:08.929573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'99","reported_seq":591,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.248594+0000","last_change":"2024-09-12T18:01:35.248524+0000","last_active":"2024-09-12T18:01:35.248594+0000","last_peered":"2024-09-12T18:01:35.248594+0000","last_clean":"2024-09-12T18:01:35.248594+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T18:01:35.248594+0000","last_undegraded":"2024-09-12T18:01:35.248594+0000","last_fullsized":"2024-09-12T18:01:35.248594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-12T18:01:35.248432+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-12T18:01:35.248432+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.248432+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:20.748584+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'383","reported_seq":1862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.965058+0000","last_change":"2024-09-12T18:01:19.965058+0000","last_active":"2024-09-12T18:01:19.965058+0000","last_peered":"2024-09-12T18:01:19.965058+0000","last_clean":"2024-09-12T18:01:19.965058+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T18:01:19.965058+0000","last_undegraded":"2024-09-12T18:01:19.965058+0000","last_fullsized":"2024-09-12T18:01:19.965058+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.964971+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:27.371182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'389","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.511378+0000","last_change":"2024-09-12T18:01:20.511378+0000","last_active":"2024-09-12T18:01:20.511378+0000","last_peered":"2024-09-12T18:01:20.511378+0000","last_clean":"2024-09-12T18:01:20.511378+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T18:01:20.511378+0000","last_undegraded":"2024-09-12T18:01:20.511378+0000","last_fullsized":"2024-09-12T18:01:20.511378+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.511198+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:06.731878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":11787,"num_write":1282,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"265'4","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.181352+0000","last_change":"2024-09-12T18:01:34.181352+0000","last_active":"2024-09-12T18:01:34.181352+0000","last_peered":"2024-09-12T18:01:34.181352+0000","last_clean":"2024-09-12T18:01:34.181352+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:34.181352+0000","last_undegraded":"2024-09-12T18:01:34.181352+0000","last_fullsized":"2024-09-12T18:01:34.181352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:34.181250+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:34.181250+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.181250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:35.922785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'248","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.673268+0000","last_change":"2024-09-12T18:01:43.673268+0000","last_active":"2024-09-12T18:01:43.673268+0000","last_peered":"2024-09-12T18:01:43.673268+0000","last_clean":"2024-09-12T18:01:43.673268+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:01:43.673268+0000","last_undegraded":"2024-09-12T18:01:43.673268+0000","last_fullsized":"2024-09-12T18:01:43.673268+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'248","last_scrub_stamp":"2024-09-12T18:01:43.673158+0000","last_deep_scrub":"265'248","last_deep_scrub_stamp":"2024-09-12T18:01:43.673158+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.673158+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:48.283546+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14789,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":830,"num_write":302,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'810","reported_seq":6247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.215618+0000","last_change":"2024-09-12T18:01:41.215618+0000","last_active":"2024-09-12T18:01:41.215618+0000","last_peered":"2024-09-12T18:01:41.215618+0000","last_clean":"2024-09-12T18:01:41.215618+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:41.215618+0000","last_undegraded":"2024-09-12T18:01:41.215618+0000","last_fullsized":"2024-09-12T18:01:41.215618+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'810","last_scrub_stamp":"2024-09-12T18:01:41.215534+0000","last_deep_scrub":"265'810","last_deep_scrub_stamp":"2024-09-12T18:01:41.215534+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.215534+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:57.602993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'101","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.421982+0000","last_change":"2024-09-12T18:01:38.421982+0000","last_active":"2024-09-12T18:01:38.421982+0000","last_peered":"2024-09-12T18:01:38.421982+0000","last_clean":"2024-09-12T18:01:38.421982+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:01:38.421982+0000","last_undegraded":"2024-09-12T18:01:38.421982+0000","last_fullsized":"2024-09-12T18:01:38.421982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T18:01:38.421862+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T18:01:38.421862+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.421862+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.477867+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'888","reported_seq":2509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.082366+0000","last_change":"2024-09-12T18:01:26.082366+0000","last_active":"2024-09-12T18:01:26.082366+0000","last_peered":"2024-09-12T18:01:26.082366+0000","last_clean":"2024-09-12T18:01:26.082366+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T18:01:26.082366+0000","last_undegraded":"2024-09-12T18:01:26.082366+0000","last_fullsized":"2024-09-12T18:01:26.082366+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'888","last_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_deep_scrub":"265'888","last_deep_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.082271+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:57.896478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'333","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.854293+0000","last_change":"2024-09-12T18:01:08.854293+0000","last_active":"2024-09-12T18:01:08.854293+0000","last_peered":"2024-09-12T18:01:08.854293+0000","last_clean":"2024-09-12T18:01:08.854293+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T18:01:08.854293+0000","last_undegraded":"2024-09-12T18:01:08.854293+0000","last_fullsized":"2024-09-12T18:01:08.854293+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_clean_scrub_stamp":"2024-09-12T18:01:08.854202+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:07.060997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":4507,"num_write":1037,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.368958+0000","last_change":"2024-09-12T18:01:26.368958+0000","last_active":"2024-09-12T18:01:26.368958+0000","last_peered":"2024-09-12T18:01:26.368958+0000","last_clean":"2024-09-12T18:01:26.368958+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T18:01:26.368958+0000","last_undegraded":"2024-09-12T18:01:26.368958+0000","last_fullsized":"2024-09-12T18:01:26.368958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.368881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:04.679223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'464","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.886345+0000","last_change":"2024-09-12T18:01:35.886345+0000","last_active":"2024-09-12T18:01:35.886345+0000","last_peered":"2024-09-12T18:01:35.886345+0000","last_clean":"2024-09-12T18:01:35.886345+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:01:35.886345+0000","last_undegraded":"2024-09-12T18:01:35.886345+0000","last_fullsized":"2024-09-12T18:01:35.886345+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T18:01:35.886257+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T18:01:35.886257+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.886257+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:04.522631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91621,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":2003,"num_write":680,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.165357+0000","last_change":"2024-09-12T18:01:40.165357+0000","last_active":"2024-09-12T18:01:40.165357+0000","last_peered":"2024-09-12T18:01:40.165357+0000","last_clean":"2024-09-12T18:01:40.165357+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T18:01:40.165357+0000","last_undegraded":"2024-09-12T18:01:40.165357+0000","last_fullsized":"2024-09-12T18:01:40.165357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.165272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.165272+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.165272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:13.163122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'119","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.283222+0000","last_change":"2024-09-12T18:01:34.283222+0000","last_active":"2024-09-12T18:01:34.283222+0000","last_peered":"2024-09-12T18:01:34.283222+0000","last_clean":"2024-09-12T18:01:34.283222+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T18:01:34.283222+0000","last_undegraded":"2024-09-12T18:01:34.283222+0000","last_fullsized":"2024-09-12T18:01:34.283222+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T18:01:34.283112+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T18:01:34.283112+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.283112+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:23.561819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1098","reported_seq":2467,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.690325+0000","last_change":"2024-09-12T18:01:16.690325+0000","last_active":"2024-09-12T18:01:16.690325+0000","last_peered":"2024-09-12T18:01:16.690325+0000","last_clean":"2024-09-12T18:01:16.690325+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T18:01:16.690325+0000","last_undegraded":"2024-09-12T18:01:16.690325+0000","last_fullsized":"2024-09-12T18:01:16.690325+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1098","last_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_deep_scrub":"265'1098","last_deep_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.690238+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:56.957860+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'388","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.423542+0000","last_change":"2024-09-12T18:01:13.423542+0000","last_active":"2024-09-12T18:01:13.423542+0000","last_peered":"2024-09-12T18:01:13.423542+0000","last_clean":"2024-09-12T18:01:13.423542+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T18:01:13.423542+0000","last_undegraded":"2024-09-12T18:01:13.423542+0000","last_fullsized":"2024-09-12T18:01:13.423542+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.423366+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.728247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":4065,"num_write":1151,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.459436+0000","last_change":"2024-09-12T18:01:24.459436+0000","last_active":"2024-09-12T18:01:24.459436+0000","last_peered":"2024-09-12T18:01:24.459436+0000","last_clean":"2024-09-12T18:01:24.459436+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T18:01:24.459436+0000","last_undegraded":"2024-09-12T18:01:24.459436+0000","last_fullsized":"2024-09-12T18:01:24.459436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.459346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:56.562856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.287027+0000","last_change":"2024-09-12T18:01:29.287027+0000","last_active":"2024-09-12T18:01:29.287027+0000","last_peered":"2024-09-12T18:01:29.287027+0000","last_clean":"2024-09-12T18:01:29.287027+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:01:29.287027+0000","last_undegraded":"2024-09-12T18:01:29.287027+0000","last_fullsized":"2024-09-12T18:01:29.287027+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T18:01:29.286941+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T18:01:29.286941+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.286941+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:08.866516+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46038,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":1069,"num_write":430,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.311558+0000","last_change":"2024-09-12T18:01:30.311558+0000","last_active":"2024-09-12T18:01:30.311558+0000","last_peered":"2024-09-12T18:01:30.311558+0000","last_clean":"2024-09-12T18:01:30.311558+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T18:01:30.311558+0000","last_undegraded":"2024-09-12T18:01:30.311558+0000","last_fullsized":"2024-09-12T18:01:30.311558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:30.311474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:30.311474+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.311474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:38.716188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'128","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.173172+0000","last_change":"2024-09-12T18:01:44.173172+0000","last_active":"2024-09-12T18:01:44.173172+0000","last_peered":"2024-09-12T18:01:44.173172+0000","last_clean":"2024-09-12T18:01:44.173172+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:01:44.173172+0000","last_undegraded":"2024-09-12T18:01:44.173172+0000","last_fullsized":"2024-09-12T18:01:44.173172+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T18:01:44.173075+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T18:01:44.173075+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.173075+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:11.613716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'854","reported_seq":2442,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.530340+0000","last_change":"2024-09-12T18:01:29.530340+0000","last_active":"2024-09-12T18:01:29.530340+0000","last_peered":"2024-09-12T18:01:29.530340+0000","last_clean":"2024-09-12T18:01:29.530340+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T18:01:29.530340+0000","last_undegraded":"2024-09-12T18:01:29.530340+0000","last_fullsized":"2024-09-12T18:01:29.530340+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'854","last_scrub_stamp":"2024-09-12T18:01:29.530238+0000","last_deep_scrub":"265'854","last_deep_scrub_stamp":"2024-09-12T18:01:29.530238+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.530238+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.790227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'294","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.520281+0000","last_change":"2024-09-12T18:01:14.520281+0000","last_active":"2024-09-12T18:01:14.520281+0000","last_peered":"2024-09-12T18:01:14.520281+0000","last_clean":"2024-09-12T18:01:14.520281+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T18:01:14.520281+0000","last_undegraded":"2024-09-12T18:01:14.520281+0000","last_fullsized":"2024-09-12T18:01:14.520281+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.520053+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:15.981715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":437,"num_read_kb":12213,"num_write":961,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.167605+0000","last_change":"2024-09-12T18:01:36.167605+0000","last_active":"2024-09-12T18:01:36.167605+0000","last_peered":"2024-09-12T18:01:36.167605+0000","last_clean":"2024-09-12T18:01:36.167605+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T18:01:36.167605+0000","last_undegraded":"2024-09-12T18:01:36.167605+0000","last_fullsized":"2024-09-12T18:01:36.167605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:36.167506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:36.167506+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.167506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:29.693639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'282","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.186559+0000","last_change":"2024-09-12T18:01:37.186559+0000","last_active":"2024-09-12T18:01:37.186559+0000","last_peered":"2024-09-12T18:01:37.186559+0000","last_clean":"2024-09-12T18:01:37.186559+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:37.186559+0000","last_undegraded":"2024-09-12T18:01:37.186559+0000","last_fullsized":"2024-09-12T18:01:37.186559+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-12T18:01:37.186454+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-12T18:01:37.186454+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.186454+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:09.115622+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":997,"num_write":362,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'771","reported_seq":2293,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.357248+0000","last_change":"2024-09-12T18:01:29.357248+0000","last_active":"2024-09-12T18:01:29.357248+0000","last_peered":"2024-09-12T18:01:29.357248+0000","last_clean":"2024-09-12T18:01:29.357248+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:01:29.357248+0000","last_undegraded":"2024-09-12T18:01:29.357248+0000","last_fullsized":"2024-09-12T18:01:29.357248+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.357164+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:53.556672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'96","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.434624+0000","last_change":"2024-09-12T18:01:37.434624+0000","last_active":"2024-09-12T18:01:37.434624+0000","last_peered":"2024-09-12T18:01:37.434624+0000","last_clean":"2024-09-12T18:01:37.434624+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T18:01:37.434624+0000","last_undegraded":"2024-09-12T18:01:37.434624+0000","last_fullsized":"2024-09-12T18:01:37.434624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T18:01:37.434524+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T18:01:37.434524+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.434524+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.206978+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'396","reported_seq":1807,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.965656+0000","last_change":"2024-09-12T18:01:17.965656+0000","last_active":"2024-09-12T18:01:17.965656+0000","last_peered":"2024-09-12T18:01:17.965656+0000","last_clean":"2024-09-12T18:01:17.965656+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T18:01:17.965656+0000","last_undegraded":"2024-09-12T18:01:17.965656+0000","last_fullsized":"2024-09-12T18:01:17.965656+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.965565+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:50.887093+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.514617+0000","last_change":"2024-09-12T18:01:15.514617+0000","last_active":"2024-09-12T18:01:15.514617+0000","last_peered":"2024-09-12T18:01:15.514617+0000","last_clean":"2024-09-12T18:01:15.514617+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T18:01:15.514617+0000","last_undegraded":"2024-09-12T18:01:15.514617+0000","last_fullsized":"2024-09-12T18:01:15.514617+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.514479+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.305976+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":2738,"num_write":1044,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.223394+0000","last_change":"2024-09-12T18:01:25.223394+0000","last_active":"2024-09-12T18:01:25.223394+0000","last_peered":"2024-09-12T18:01:25.223394+0000","last_clean":"2024-09-12T18:01:25.223394+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:01:25.223394+0000","last_undegraded":"2024-09-12T18:01:25.223394+0000","last_fullsized":"2024-09-12T18:01:25.223394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.223302+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:28.092756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'81","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.323227+0000","last_change":"2024-09-12T18:01:30.323227+0000","last_active":"2024-09-12T18:01:30.323227+0000","last_peered":"2024-09-12T18:01:30.323227+0000","last_clean":"2024-09-12T18:01:30.323227+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T18:01:30.323227+0000","last_undegraded":"2024-09-12T18:01:30.323227+0000","last_fullsized":"2024-09-12T18:01:30.323227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'81","last_scrub_stamp":"2024-09-12T18:01:30.323110+0000","last_deep_scrub":"265'81","last_deep_scrub_stamp":"2024-09-12T18:01:30.323110+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.323110+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:06.144106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":2237,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.223144+0000","last_change":"2024-09-12T18:01:33.223144+0000","last_active":"2024-09-12T18:01:33.223144+0000","last_peered":"2024-09-12T18:01:33.223144+0000","last_clean":"2024-09-12T18:01:33.223144+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:01:33.223144+0000","last_undegraded":"2024-09-12T18:01:33.223144+0000","last_fullsized":"2024-09-12T18:01:33.223144+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:33.223061+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:33.223061+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.223061+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:43.060671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.967997+0000","last_change":"2024-09-12T18:01:33.967905+0000","last_active":"2024-09-12T18:01:33.967997+0000","last_peered":"2024-09-12T18:01:33.967997+0000","last_clean":"2024-09-12T18:01:33.967997+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T18:01:33.967997+0000","last_undegraded":"2024-09-12T18:01:33.967997+0000","last_fullsized":"2024-09-12T18:01:33.967997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T18:01:33.967774+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T18:01:33.967774+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.967774+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:11.664850+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'768","reported_seq":2400,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.479454+0000","last_change":"2024-09-12T18:01:16.479454+0000","last_active":"2024-09-12T18:01:16.479454+0000","last_peered":"2024-09-12T18:01:16.479454+0000","last_clean":"2024-09-12T18:01:16.479454+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T18:01:16.479454+0000","last_undegraded":"2024-09-12T18:01:16.479454+0000","last_fullsized":"2024-09-12T18:01:16.479454+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'768","last_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_deep_scrub":"265'768","last_deep_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.479358+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:38.320465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.882054+0000","last_change":"2024-09-12T18:01:14.882054+0000","last_active":"2024-09-12T18:01:14.882054+0000","last_peered":"2024-09-12T18:01:14.882054+0000","last_clean":"2024-09-12T18:01:14.882054+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T18:01:14.882054+0000","last_undegraded":"2024-09-12T18:01:14.882054+0000","last_fullsized":"2024-09-12T18:01:14.882054+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.881906+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:47.911992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":10060,"num_write":877,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.690245+0000","last_change":"2024-09-12T18:01:38.690245+0000","last_active":"2024-09-12T18:01:38.690245+0000","last_peered":"2024-09-12T18:01:38.690245+0000","last_clean":"2024-09-12T18:01:38.690245+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T18:01:38.690245+0000","last_undegraded":"2024-09-12T18:01:38.690245+0000","last_fullsized":"2024-09-12T18:01:38.690245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:38.690153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:38.690153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.690153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:05.375887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'327","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.272421+0000","last_change":"2024-09-12T18:01:28.272421+0000","last_active":"2024-09-12T18:01:28.272421+0000","last_peered":"2024-09-12T18:01:28.272421+0000","last_clean":"2024-09-12T18:01:28.272421+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:01:28.272421+0000","last_undegraded":"2024-09-12T18:01:28.272421+0000","last_fullsized":"2024-09-12T18:01:28.272421+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T18:01:28.272327+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T18:01:28.272327+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.272327+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:41.326166+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46691,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1100,"num_read_kb":1651,"num_write":1580,"num_write_kb":1458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.088824+0000","last_change":"2024-09-12T18:01:31.088824+0000","last_active":"2024-09-12T18:01:31.088824+0000","last_peered":"2024-09-12T18:01:31.088824+0000","last_clean":"2024-09-12T18:01:31.088824+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T18:01:31.088824+0000","last_undegraded":"2024-09-12T18:01:31.088824+0000","last_fullsized":"2024-09-12T18:01:31.088824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.088735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.088735+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.088735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:19.017921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'102","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.247970+0000","last_change":"2024-09-12T18:01:35.247970+0000","last_active":"2024-09-12T18:01:35.247970+0000","last_peered":"2024-09-12T18:01:35.247970+0000","last_clean":"2024-09-12T18:01:35.247970+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T18:01:35.247970+0000","last_undegraded":"2024-09-12T18:01:35.247970+0000","last_fullsized":"2024-09-12T18:01:35.247970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T18:01:35.247852+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T18:01:35.247852+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.247852+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:37.446347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'462","reported_seq":2041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.560308+0000","last_change":"2024-09-12T18:01:27.560251+0000","last_active":"2024-09-12T18:01:27.560308+0000","last_peered":"2024-09-12T18:01:27.560308+0000","last_clean":"2024-09-12T18:01:27.560308+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T18:01:27.560308+0000","last_undegraded":"2024-09-12T18:01:27.560308+0000","last_fullsized":"2024-09-12T18:01:27.560308+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T18:01:27.560153+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T18:01:27.560153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.560153+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:20.180962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.117810+0000","last_change":"2024-09-12T18:01:09.117716+0000","last_active":"2024-09-12T18:01:09.117810+0000","last_peered":"2024-09-12T18:01:09.117810+0000","last_clean":"2024-09-12T18:01:09.117810+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T18:01:09.117810+0000","last_undegraded":"2024-09-12T18:01:09.117810+0000","last_fullsized":"2024-09-12T18:01:09.117810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.117622+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:48.788505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.420686+0000","last_change":"2024-09-12T18:01:12.420634+0000","last_active":"2024-09-12T18:01:12.420686+0000","last_peered":"2024-09-12T18:01:12.420686+0000","last_clean":"2024-09-12T18:01:12.420686+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T18:01:12.420686+0000","last_undegraded":"2024-09-12T18:01:12.420686+0000","last_fullsized":"2024-09-12T18:01:12.420686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.420560+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:05.743402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'352","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.926268+0000","last_change":"2024-09-12T18:01:10.926183+0000","last_active":"2024-09-12T18:01:10.926268+0000","last_peered":"2024-09-12T18:01:10.926268+0000","last_clean":"2024-09-12T18:01:10.926268+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T18:01:10.926268+0000","last_undegraded":"2024-09-12T18:01:10.926268+0000","last_fullsized":"2024-09-12T18:01:10.926268+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.925996+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.144031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2336230,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":631,"num_read_kb":42380,"num_write":1169,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.733401+0000","last_change":"2024-09-12T18:01:27.733275+0000","last_active":"2024-09-12T18:01:27.733401+0000","last_peered":"2024-09-12T18:01:27.733401+0000","last_clean":"2024-09-12T18:01:27.733401+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T18:01:27.733401+0000","last_undegraded":"2024-09-12T18:01:27.733401+0000","last_fullsized":"2024-09-12T18:01:27.733401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.733178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.733178+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.733178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:38.417573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'743","reported_seq":1450,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.711411+0000","last_change":"2024-09-12T18:01:42.711411+0000","last_active":"2024-09-12T18:01:42.711411+0000","last_peered":"2024-09-12T18:01:42.711411+0000","last_clean":"2024-09-12T18:01:42.711411+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:01:42.711411+0000","last_undegraded":"2024-09-12T18:01:42.711411+0000","last_fullsized":"2024-09-12T18:01:42.711411+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'743","last_scrub_stamp":"2024-09-12T18:01:42.711315+0000","last_deep_scrub":"265'743","last_deep_scrub_stamp":"2024-09-12T18:01:42.711315+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.711315+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:30.938504+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169172,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1452,"num_read_kb":3379,"num_write":1380,"num_write_kb":1257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106776,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.188799+0000","last_change":"2024-09-12T18:01:39.188799+0000","last_active":"2024-09-12T18:01:39.188799+0000","last_peered":"2024-09-12T18:01:39.188799+0000","last_clean":"2024-09-12T18:01:39.188799+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T18:01:39.188799+0000","last_undegraded":"2024-09-12T18:01:39.188799+0000","last_fullsized":"2024-09-12T18:01:39.188799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:39.188700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:39.188700+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.188700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:27.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.826146+0000","last_change":"2024-09-12T18:01:31.826146+0000","last_active":"2024-09-12T18:01:31.826146+0000","last_peered":"2024-09-12T18:01:31.826146+0000","last_clean":"2024-09-12T18:01:31.826146+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T18:01:31.826146+0000","last_undegraded":"2024-09-12T18:01:31.826146+0000","last_fullsized":"2024-09-12T18:01:31.826146+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T18:01:31.826057+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T18:01:31.826057+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.826057+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:02.628612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'470","reported_seq":2002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.056494+0000","last_change":"2024-09-12T18:01:25.056494+0000","last_active":"2024-09-12T18:01:25.056494+0000","last_peered":"2024-09-12T18:01:25.056494+0000","last_clean":"2024-09-12T18:01:25.056494+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T18:01:25.056494+0000","last_undegraded":"2024-09-12T18:01:25.056494+0000","last_fullsized":"2024-09-12T18:01:25.056494+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.056406+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.664820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.447739+0000","last_change":"2024-09-12T18:01:10.447676+0000","last_active":"2024-09-12T18:01:10.447739+0000","last_peered":"2024-09-12T18:01:10.447739+0000","last_clean":"2024-09-12T18:01:10.447739+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T18:01:10.447739+0000","last_undegraded":"2024-09-12T18:01:10.447739+0000","last_fullsized":"2024-09-12T18:01:10.447739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.447603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.379942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'393","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.197108+0000","last_change":"2024-09-12T18:01:12.197015+0000","last_active":"2024-09-12T18:01:12.197108+0000","last_peered":"2024-09-12T18:01:12.197108+0000","last_clean":"2024-09-12T18:01:12.197108+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T18:01:12.197108+0000","last_undegraded":"2024-09-12T18:01:12.197108+0000","last_fullsized":"2024-09-12T18:01:12.197108+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.196860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:38.459956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":13401,"num_write":1361,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.644723+0000","last_change":"2024-09-12T18:01:37.644723+0000","last_active":"2024-09-12T18:01:37.644723+0000","last_peered":"2024-09-12T18:01:37.644723+0000","last_clean":"2024-09-12T18:01:37.644723+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T18:01:37.644723+0000","last_undegraded":"2024-09-12T18:01:37.644723+0000","last_fullsized":"2024-09-12T18:01:37.644723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:37.644634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:37.644634+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.644634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:18.470045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.335212+0000","last_change":"2024-09-12T18:01:27.335085+0000","last_active":"2024-09-12T18:01:27.335212+0000","last_peered":"2024-09-12T18:01:27.335212+0000","last_clean":"2024-09-12T18:01:27.335212+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:01:27.335212+0000","last_undegraded":"2024-09-12T18:01:27.335212+0000","last_fullsized":"2024-09-12T18:01:27.335212+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.334961+0000","objects_scrubbed":12,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:37.159404+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161465,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1982,"num_read_kb":3789,"num_write":1078,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:37.031207+0000","last_change":"2024-09-12T17:21:58.790253+0000","last_active":"2024-09-12T17:59:37.031207+0000","last_peered":"2024-09-12T17:59:37.031207+0000","last_clean":"2024-09-12T17:59:37.031207+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T17:59:37.031207+0000","last_undegraded":"2024-09-12T17:59:37.031207+0000","last_fullsized":"2024-09-12T17:59:37.031207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.204122+0000","last_change":"2024-09-12T18:01:46.204122+0000","last_active":"2024-09-12T18:01:46.204122+0000","last_peered":"2024-09-12T18:01:46.204122+0000","last_clean":"2024-09-12T18:01:46.204122+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T18:01:46.204122+0000","last_undegraded":"2024-09-12T18:01:46.204122+0000","last_fullsized":"2024-09-12T18:01:46.204122+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T18:01:46.204039+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T18:01:46.204039+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.204039+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:37.330326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'450","reported_seq":1966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.237463+0000","last_change":"2024-09-12T18:01:19.237463+0000","last_active":"2024-09-12T18:01:19.237463+0000","last_peered":"2024-09-12T18:01:19.237463+0000","last_clean":"2024-09-12T18:01:19.237463+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T18:01:19.237463+0000","last_undegraded":"2024-09-12T18:01:19.237463+0000","last_fullsized":"2024-09-12T18:01:19.237463+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'450","last_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_deep_scrub":"265'450","last_deep_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.237381+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:11.813533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.385055+0000","last_change":"2024-09-12T18:01:12.385001+0000","last_active":"2024-09-12T18:01:12.385055+0000","last_peered":"2024-09-12T18:01:12.385055+0000","last_clean":"2024-09-12T18:01:12.385055+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T18:01:12.385055+0000","last_undegraded":"2024-09-12T18:01:12.385055+0000","last_fullsized":"2024-09-12T18:01:12.385055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.384902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:54.391667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'374","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.983349+0000","last_change":"2024-09-12T18:01:11.983349+0000","last_active":"2024-09-12T18:01:11.983349+0000","last_peered":"2024-09-12T18:01:11.983349+0000","last_clean":"2024-09-12T18:01:11.983349+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:11.983349+0000","last_undegraded":"2024-09-12T18:01:11.983349+0000","last_fullsized":"2024-09-12T18:01:11.983349+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.983172+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:23.268960+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730187,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":557,"num_read_kb":34998,"num_write":1154,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.411308+0000","last_change":"2024-09-12T18:01:25.411308+0000","last_active":"2024-09-12T18:01:25.411308+0000","last_peered":"2024-09-12T18:01:25.411308+0000","last_clean":"2024-09-12T18:01:25.411308+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T18:01:25.411308+0000","last_undegraded":"2024-09-12T18:01:25.411308+0000","last_fullsized":"2024-09-12T18:01:25.411308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.411217+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:45.178080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'204","reported_seq":1222,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.676434+0000","last_change":"2024-09-12T18:01:25.676351+0000","last_active":"2024-09-12T18:01:25.676434+0000","last_peered":"2024-09-12T18:01:25.676434+0000","last_clean":"2024-09-12T18:01:25.676434+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:01:25.676434+0000","last_undegraded":"2024-09-12T18:01:25.676434+0000","last_fullsized":"2024-09-12T18:01:25.676434+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'204","last_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_deep_scrub":"265'204","last_deep_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.676244+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:26.820945+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.927846+0000","last_change":"2024-09-12T18:01:41.927846+0000","last_active":"2024-09-12T18:01:41.927846+0000","last_peered":"2024-09-12T18:01:41.927846+0000","last_clean":"2024-09-12T18:01:41.927846+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T18:01:41.927846+0000","last_undegraded":"2024-09-12T18:01:41.927846+0000","last_fullsized":"2024-09-12T18:01:41.927846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:41.927746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:41.927746+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.927746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:22.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'291","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.027003+0000","last_change":"2024-09-12T18:01:46.027003+0000","last_active":"2024-09-12T18:01:46.027003+0000","last_peered":"2024-09-12T18:01:46.027003+0000","last_clean":"2024-09-12T18:01:46.027003+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T18:01:46.027003+0000","last_undegraded":"2024-09-12T18:01:46.027003+0000","last_fullsized":"2024-09-12T18:01:46.027003+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'291","last_scrub_stamp":"2024-09-12T18:01:46.026914+0000","last_deep_scrub":"265'291","last_deep_scrub_stamp":"2024-09-12T18:01:46.026914+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.026914+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:57.882654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'471","reported_seq":2090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.224929+0000","last_change":"2024-09-12T18:01:20.224814+0000","last_active":"2024-09-12T18:01:20.224929+0000","last_peered":"2024-09-12T18:01:20.224929+0000","last_clean":"2024-09-12T18:01:20.224929+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:01:20.224929+0000","last_undegraded":"2024-09-12T18:01:20.224929+0000","last_fullsized":"2024-09-12T18:01:20.224929+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.224700+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.621486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2751,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.470570+0000","last_change":"2024-09-12T18:01:11.470497+0000","last_active":"2024-09-12T18:01:11.470570+0000","last_peered":"2024-09-12T18:01:11.470570+0000","last_clean":"2024-09-12T18:01:11.470570+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T18:01:11.470570+0000","last_undegraded":"2024-09-12T18:01:11.470570+0000","last_fullsized":"2024-09-12T18:01:11.470570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.470415+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:45.118041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'409","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.756765+0000","last_change":"2024-09-12T18:01:13.756692+0000","last_active":"2024-09-12T18:01:13.756765+0000","last_peered":"2024-09-12T18:01:13.756765+0000","last_clean":"2024-09-12T18:01:13.756765+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T18:01:13.756765+0000","last_undegraded":"2024-09-12T18:01:13.756765+0000","last_fullsized":"2024-09-12T18:01:13.756765+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.756554+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:52.180446+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3307398,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":11802,"num_write":1361,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.460960+0000","last_change":"2024-09-12T18:01:22.460871+0000","last_active":"2024-09-12T18:01:22.460960+0000","last_peered":"2024-09-12T18:01:22.460960+0000","last_clean":"2024-09-12T18:01:22.460960+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T18:01:22.460960+0000","last_undegraded":"2024-09-12T18:01:22.460960+0000","last_fullsized":"2024-09-12T18:01:22.460960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.460761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:40.754930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'110","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.204385+0000","last_change":"2024-09-12T18:01:35.204385+0000","last_active":"2024-09-12T18:01:35.204385+0000","last_peered":"2024-09-12T18:01:35.204385+0000","last_clean":"2024-09-12T18:01:35.204385+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:01:35.204385+0000","last_undegraded":"2024-09-12T18:01:35.204385+0000","last_fullsized":"2024-09-12T18:01:35.204385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T18:01:35.204295+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T18:01:35.204295+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.204295+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:10.371257+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:52.025180+0000","last_change":"2024-09-12T17:21:58.789360+0000","last_active":"2024-09-12T17:58:52.025180+0000","last_peered":"2024-09-12T17:58:52.025180+0000","last_clean":"2024-09-12T17:58:52.025180+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T17:58:52.025180+0000","last_undegraded":"2024-09-12T17:58:52.025180+0000","last_fullsized":"2024-09-12T17:58:52.025180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:51.063573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'142","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.279797+0000","last_change":"2024-09-12T18:01:36.279797+0000","last_active":"2024-09-12T18:01:36.279797+0000","last_peered":"2024-09-12T18:01:36.279797+0000","last_clean":"2024-09-12T18:01:36.279797+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T18:01:36.279797+0000","last_undegraded":"2024-09-12T18:01:36.279797+0000","last_fullsized":"2024-09-12T18:01:36.279797+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T18:01:36.279708+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T18:01:36.279708+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.279708+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:09.632880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'877","reported_seq":2715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.277456+0000","last_change":"2024-09-12T18:01:18.277389+0000","last_active":"2024-09-12T18:01:18.277456+0000","last_peered":"2024-09-12T18:01:18.277456+0000","last_clean":"2024-09-12T18:01:18.277456+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T18:01:18.277456+0000","last_undegraded":"2024-09-12T18:01:18.277456+0000","last_fullsized":"2024-09-12T18:01:18.277456+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'877","last_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_deep_scrub":"265'877","last_deep_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.277308+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:23.770820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'375","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.954807+0000","last_change":"2024-09-12T18:01:09.954746+0000","last_active":"2024-09-12T18:01:09.954807+0000","last_peered":"2024-09-12T18:01:09.954807+0000","last_clean":"2024-09-12T18:01:09.954807+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T18:01:09.954807+0000","last_undegraded":"2024-09-12T18:01:09.954807+0000","last_fullsized":"2024-09-12T18:01:09.954807+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.954652+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:15.491590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":25520,"num_write":1246,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.942208+0000","last_change":"2024-09-12T18:01:10.942149+0000","last_active":"2024-09-12T18:01:10.942208+0000","last_peered":"2024-09-12T18:01:10.942208+0000","last_clean":"2024-09-12T18:01:10.942208+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T18:01:10.942208+0000","last_undegraded":"2024-09-12T18:01:10.942208+0000","last_fullsized":"2024-09-12T18:01:10.942208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.942018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:03.095012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.895051+0000","last_change":"2024-09-12T18:01:28.894958+0000","last_active":"2024-09-12T18:01:28.895051+0000","last_peered":"2024-09-12T18:01:28.895051+0000","last_clean":"2024-09-12T18:01:28.895051+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T18:01:28.895051+0000","last_undegraded":"2024-09-12T18:01:28.895051+0000","last_fullsized":"2024-09-12T18:01:28.895051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.894849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.894849+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.894849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:24.705150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'550","reported_seq":1208,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.376661+0000","last_change":"2024-09-12T18:01:26.376661+0000","last_active":"2024-09-12T18:01:26.376661+0000","last_peered":"2024-09-12T18:01:26.376661+0000","last_clean":"2024-09-12T18:01:26.376661+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:01:26.376661+0000","last_undegraded":"2024-09-12T18:01:26.376661+0000","last_fullsized":"2024-09-12T18:01:26.376661+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.376538+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:29.127764+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106777,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":960,"num_read_kb":2265,"num_write":794,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.074722+0000","last_change":"2024-09-12T18:01:28.074662+0000","last_active":"2024-09-12T18:01:28.074722+0000","last_peered":"2024-09-12T18:01:28.074722+0000","last_clean":"2024-09-12T18:01:28.074722+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T18:01:28.074722+0000","last_undegraded":"2024-09-12T18:01:28.074722+0000","last_fullsized":"2024-09-12T18:01:28.074722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.074566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.074566+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.074566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:23.015818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'170","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.121287+0000","last_change":"2024-09-12T18:01:48.121287+0000","last_active":"2024-09-12T18:01:48.121287+0000","last_peered":"2024-09-12T18:01:48.121287+0000","last_clean":"2024-09-12T18:01:48.121287+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T18:01:48.121287+0000","last_undegraded":"2024-09-12T18:01:48.121287+0000","last_fullsized":"2024-09-12T18:01:48.121287+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'170","last_scrub_stamp":"2024-09-12T18:01:48.121192+0000","last_deep_scrub":"265'170","last_deep_scrub_stamp":"2024-09-12T18:01:48.121192+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.121192+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:50.194249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'829","reported_seq":2355,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.342186+0000","last_change":"2024-09-12T18:01:24.342131+0000","last_active":"2024-09-12T18:01:24.342186+0000","last_peered":"2024-09-12T18:01:24.342186+0000","last_clean":"2024-09-12T18:01:24.342186+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T18:01:24.342186+0000","last_undegraded":"2024-09-12T18:01:24.342186+0000","last_fullsized":"2024-09-12T18:01:24.342186+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.342040+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:50.354462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1941,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'375","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.187589+0000","last_change":"2024-09-12T18:01:13.187529+0000","last_active":"2024-09-12T18:01:13.187589+0000","last_peered":"2024-09-12T18:01:13.187589+0000","last_clean":"2024-09-12T18:01:13.187589+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T18:01:13.187589+0000","last_undegraded":"2024-09-12T18:01:13.187589+0000","last_fullsized":"2024-09-12T18:01:13.187589+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.187403+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.594187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":578,"num_read_kb":7304,"num_write":1242,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.501217+0000","last_change":"2024-09-12T18:01:17.501129+0000","last_active":"2024-09-12T18:01:17.501217+0000","last_peered":"2024-09-12T18:01:17.501217+0000","last_clean":"2024-09-12T18:01:17.501217+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T18:01:17.501217+0000","last_undegraded":"2024-09-12T18:01:17.501217+0000","last_fullsized":"2024-09-12T18:01:17.501217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.501027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:12.800178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.665718+0000","last_change":"2024-09-12T18:01:24.665652+0000","last_active":"2024-09-12T18:01:24.665718+0000","last_peered":"2024-09-12T18:01:24.665718+0000","last_clean":"2024-09-12T18:01:24.665718+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T18:01:24.665718+0000","last_undegraded":"2024-09-12T18:01:24.665718+0000","last_fullsized":"2024-09-12T18:01:24.665718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.665551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:34.966186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'162","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.359403+0000","last_change":"2024-09-12T18:01:31.359344+0000","last_active":"2024-09-12T18:01:31.359403+0000","last_peered":"2024-09-12T18:01:31.359403+0000","last_clean":"2024-09-12T18:01:31.359403+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T18:01:31.359403+0000","last_undegraded":"2024-09-12T18:01:31.359403+0000","last_fullsized":"2024-09-12T18:01:31.359403+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T18:01:31.359242+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T18:01:31.359242+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.359242+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:21.065971+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'806","reported_seq":2577,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.250072+0000","last_change":"2024-09-12T18:01:31.250072+0000","last_active":"2024-09-12T18:01:31.250072+0000","last_peered":"2024-09-12T18:01:31.250072+0000","last_clean":"2024-09-12T18:01:31.250072+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:01:31.250072+0000","last_undegraded":"2024-09-12T18:01:31.250072+0000","last_fullsized":"2024-09-12T18:01:31.250072+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:31.249972+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:31.249972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.249972+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:41.476948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'112","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.289661+0000","last_change":"2024-09-12T18:01:36.289661+0000","last_active":"2024-09-12T18:01:36.289661+0000","last_peered":"2024-09-12T18:01:36.289661+0000","last_clean":"2024-09-12T18:01:36.289661+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:01:36.289661+0000","last_undegraded":"2024-09-12T18:01:36.289661+0000","last_fullsized":"2024-09-12T18:01:36.289661+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T18:01:36.289568+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T18:01:36.289568+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.289568+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:21.733683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'875","reported_seq":2594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.833708+0000","last_change":"2024-09-12T18:01:16.833708+0000","last_active":"2024-09-12T18:01:16.833708+0000","last_peered":"2024-09-12T18:01:16.833708+0000","last_clean":"2024-09-12T18:01:16.833708+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T18:01:16.833708+0000","last_undegraded":"2024-09-12T18:01:16.833708+0000","last_fullsized":"2024-09-12T18:01:16.833708+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'875","last_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_deep_scrub":"265'875","last_deep_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.833613+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.664041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":649,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'365","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.878116+0000","last_change":"2024-09-12T18:01:13.878116+0000","last_active":"2024-09-12T18:01:13.878116+0000","last_peered":"2024-09-12T18:01:13.878116+0000","last_clean":"2024-09-12T18:01:13.878116+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T18:01:13.878116+0000","last_undegraded":"2024-09-12T18:01:13.878116+0000","last_fullsized":"2024-09-12T18:01:13.878116+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.877983+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.503105+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831558,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":10322,"num_write":1179,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.894172+0000","last_change":"2024-09-12T18:01:11.894172+0000","last_active":"2024-09-12T18:01:11.894172+0000","last_peered":"2024-09-12T18:01:11.894172+0000","last_clean":"2024-09-12T18:01:11.894172+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T18:01:11.894172+0000","last_undegraded":"2024-09-12T18:01:11.894172+0000","last_fullsized":"2024-09-12T18:01:11.894172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.894084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:44.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.601900+0000","last_change":"2024-09-12T18:01:36.601900+0000","last_active":"2024-09-12T18:01:36.601900+0000","last_peered":"2024-09-12T18:01:36.601900+0000","last_clean":"2024-09-12T18:01:36.601900+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T18:01:36.601900+0000","last_undegraded":"2024-09-12T18:01:36.601900+0000","last_fullsized":"2024-09-12T18:01:36.601900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:36.601800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:36.601800+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.601800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:53.159379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'101","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.728282+0000","last_change":"2024-09-12T18:01:41.728282+0000","last_active":"2024-09-12T18:01:41.728282+0000","last_peered":"2024-09-12T18:01:41.728282+0000","last_clean":"2024-09-12T18:01:41.728282+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T18:01:41.728282+0000","last_undegraded":"2024-09-12T18:01:41.728282+0000","last_fullsized":"2024-09-12T18:01:41.728282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T18:01:41.728189+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T18:01:41.728189+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.728189+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:46.696780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'810","reported_seq":2366,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.150122+0000","last_change":"2024-09-12T18:01:38.150122+0000","last_active":"2024-09-12T18:01:38.150122+0000","last_peered":"2024-09-12T18:01:38.150122+0000","last_clean":"2024-09-12T18:01:38.150122+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:38.150122+0000","last_undegraded":"2024-09-12T18:01:38.150122+0000","last_fullsized":"2024-09-12T18:01:38.150122+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'810","last_scrub_stamp":"2024-09-12T18:01:38.150024+0000","last_deep_scrub":"265'810","last_deep_scrub_stamp":"2024-09-12T18:01:38.150024+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.150024+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:28.471792+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'328","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.198972+0000","last_change":"2024-09-12T18:01:45.198972+0000","last_active":"2024-09-12T18:01:45.198972+0000","last_peered":"2024-09-12T18:01:45.198972+0000","last_clean":"2024-09-12T18:01:45.198972+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T18:01:45.198972+0000","last_undegraded":"2024-09-12T18:01:45.198972+0000","last_fullsized":"2024-09-12T18:01:45.198972+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-12T18:01:45.198878+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-12T18:01:45.198878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.198878+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:42.913988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'493","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.925408+0000","last_change":"2024-09-12T18:01:16.925347+0000","last_active":"2024-09-12T18:01:16.925408+0000","last_peered":"2024-09-12T18:01:16.925408+0000","last_clean":"2024-09-12T18:01:16.925408+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T18:01:16.925408+0000","last_undegraded":"2024-09-12T18:01:16.925408+0000","last_fullsized":"2024-09-12T18:01:16.925408+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'493","last_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_deep_scrub":"265'493","last_deep_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.925258+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:35.178082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'332","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.877403+0000","last_change":"2024-09-12T18:01:12.877403+0000","last_active":"2024-09-12T18:01:12.877403+0000","last_peered":"2024-09-12T18:01:12.877403+0000","last_clean":"2024-09-12T18:01:12.877403+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T18:01:12.877403+0000","last_undegraded":"2024-09-12T18:01:12.877403+0000","last_fullsized":"2024-09-12T18:01:12.877403+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.877095+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:51.937844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287862,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59240,"num_write":1015,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.467414+0000","last_change":"2024-09-12T18:01:13.467414+0000","last_active":"2024-09-12T18:01:13.467414+0000","last_peered":"2024-09-12T18:01:13.467414+0000","last_clean":"2024-09-12T18:01:13.467414+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T18:01:13.467414+0000","last_undegraded":"2024-09-12T18:01:13.467414+0000","last_fullsized":"2024-09-12T18:01:13.467414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.467313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.884795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.917890+0000","last_change":"2024-09-12T18:01:27.917890+0000","last_active":"2024-09-12T18:01:27.917890+0000","last_peered":"2024-09-12T18:01:27.917890+0000","last_clean":"2024-09-12T18:01:27.917890+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T18:01:27.917890+0000","last_undegraded":"2024-09-12T18:01:27.917890+0000","last_fullsized":"2024-09-12T18:01:27.917890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.917798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.917798+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.917798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:37.435561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'752","reported_seq":1470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.754357+0000","last_change":"2024-09-12T18:01:28.754297+0000","last_active":"2024-09-12T18:01:28.754357+0000","last_peered":"2024-09-12T18:01:28.754357+0000","last_clean":"2024-09-12T18:01:28.754357+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:01:28.754357+0000","last_undegraded":"2024-09-12T18:01:28.754357+0000","last_fullsized":"2024-09-12T18:01:28.754357+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'752","last_scrub_stamp":"2024-09-12T18:01:28.754192+0000","last_deep_scrub":"265'752","last_deep_scrub_stamp":"2024-09-12T18:01:28.754192+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.754192+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:15.599654+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1320,"num_read_kb":3172,"num_write":1088,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.909610+0000","last_change":"2024-09-12T18:01:40.909610+0000","last_active":"2024-09-12T18:01:40.909610+0000","last_peered":"2024-09-12T18:01:40.909610+0000","last_clean":"2024-09-12T18:01:40.909610+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T18:01:40.909610+0000","last_undegraded":"2024-09-12T18:01:40.909610+0000","last_fullsized":"2024-09-12T18:01:40.909610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.909516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.909516+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.909516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.372263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'135","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.046514+0000","last_change":"2024-09-12T18:01:36.046514+0000","last_active":"2024-09-12T18:01:36.046514+0000","last_peered":"2024-09-12T18:01:36.046514+0000","last_clean":"2024-09-12T18:01:36.046514+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T18:01:36.046514+0000","last_undegraded":"2024-09-12T18:01:36.046514+0000","last_fullsized":"2024-09-12T18:01:36.046514+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T18:01:36.046428+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T18:01:36.046428+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.046428+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:42.080685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'153","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.038139+0000","last_change":"2024-09-12T18:01:47.038139+0000","last_active":"2024-09-12T18:01:47.038139+0000","last_peered":"2024-09-12T18:01:47.038139+0000","last_clean":"2024-09-12T18:01:47.038139+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T18:01:47.038139+0000","last_undegraded":"2024-09-12T18:01:47.038139+0000","last_fullsized":"2024-09-12T18:01:47.038139+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T18:01:47.038042+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T18:01:47.038042+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.038042+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:07.811045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'470","reported_seq":2074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.001611+0000","last_change":"2024-09-12T18:01:19.001546+0000","last_active":"2024-09-12T18:01:19.001611+0000","last_peered":"2024-09-12T18:01:19.001611+0000","last_clean":"2024-09-12T18:01:19.001611+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T18:01:19.001611+0000","last_undegraded":"2024-09-12T18:01:19.001611+0000","last_fullsized":"2024-09-12T18:01:19.001611+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.001453+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:36.748667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'322","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.476817+0000","last_change":"2024-09-12T18:01:18.476752+0000","last_active":"2024-09-12T18:01:18.476817+0000","last_peered":"2024-09-12T18:01:18.476817+0000","last_clean":"2024-09-12T18:01:18.476817+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T18:01:18.476817+0000","last_undegraded":"2024-09-12T18:01:18.476817+0000","last_fullsized":"2024-09-12T18:01:18.476817+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.476604+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.563516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":5956,"num_write":1032,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.354526+0000","last_change":"2024-09-12T18:01:28.354442+0000","last_active":"2024-09-12T18:01:28.354526+0000","last_peered":"2024-09-12T18:01:28.354526+0000","last_clean":"2024-09-12T18:01:28.354526+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T18:01:28.354526+0000","last_undegraded":"2024-09-12T18:01:28.354526+0000","last_fullsized":"2024-09-12T18:01:28.354526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.354346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.354346+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.354346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:42.021832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'301","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.443607+0000","last_change":"2024-09-12T18:01:36.443550+0000","last_active":"2024-09-12T18:01:36.443607+0000","last_peered":"2024-09-12T18:01:36.443607+0000","last_clean":"2024-09-12T18:01:36.443607+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T18:01:36.443607+0000","last_undegraded":"2024-09-12T18:01:36.443607+0000","last_fullsized":"2024-09-12T18:01:36.443607+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T18:01:36.443460+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T18:01:36.443460+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.443460+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:03.576675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":1191,"num_write":410,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.312192+0000","last_change":"2024-09-12T18:01:31.312137+0000","last_active":"2024-09-12T18:01:31.312192+0000","last_peered":"2024-09-12T18:01:31.312192+0000","last_clean":"2024-09-12T18:01:31.312192+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T18:01:31.312192+0000","last_undegraded":"2024-09-12T18:01:31.312192+0000","last_fullsized":"2024-09-12T18:01:31.312192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.312055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.312055+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.312055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:57.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.283798+0000","last_change":"2024-09-12T18:01:37.283798+0000","last_active":"2024-09-12T18:01:37.283798+0000","last_peered":"2024-09-12T18:01:37.283798+0000","last_clean":"2024-09-12T18:01:37.283798+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T18:01:37.283798+0000","last_undegraded":"2024-09-12T18:01:37.283798+0000","last_fullsized":"2024-09-12T18:01:37.283798+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T18:01:37.283704+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T18:01:37.283704+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.283704+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:48.879058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'642","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.847310+0000","last_change":"2024-09-12T18:01:18.847253+0000","last_active":"2024-09-12T18:01:18.847310+0000","last_peered":"2024-09-12T18:01:18.847310+0000","last_clean":"2024-09-12T18:01:18.847310+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T18:01:18.847310+0000","last_undegraded":"2024-09-12T18:01:18.847310+0000","last_fullsized":"2024-09-12T18:01:18.847310+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'642","last_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_deep_scrub":"265'642","last_deep_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.847166+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:32.189494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.988551+0000","last_change":"2024-09-12T18:01:12.988551+0000","last_active":"2024-09-12T18:01:12.988551+0000","last_peered":"2024-09-12T18:01:12.988551+0000","last_clean":"2024-09-12T18:01:12.988551+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:12.988551+0000","last_undegraded":"2024-09-12T18:01:12.988551+0000","last_fullsized":"2024-09-12T18:01:12.988551+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.988415+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.161722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25542,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":12892,"num_write":966,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.903442+0000","last_change":"2024-09-12T18:01:29.903381+0000","last_active":"2024-09-12T18:01:29.903442+0000","last_peered":"2024-09-12T18:01:29.903442+0000","last_clean":"2024-09-12T18:01:29.903442+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T18:01:29.903442+0000","last_undegraded":"2024-09-12T18:01:29.903442+0000","last_fullsized":"2024-09-12T18:01:29.903442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.903292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.903292+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.903292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:22.696946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'50","reported_seq":559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.916271+0000","last_change":"2024-09-12T18:01:36.916209+0000","last_active":"2024-09-12T18:01:36.916271+0000","last_peered":"2024-09-12T18:01:36.916271+0000","last_clean":"2024-09-12T18:01:36.916271+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T18:01:36.916271+0000","last_undegraded":"2024-09-12T18:01:36.916271+0000","last_fullsized":"2024-09-12T18:01:36.916271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:36.916109+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:36.916109+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.916109+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:23.996232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.006388+0000","last_change":"2024-09-12T18:01:33.006329+0000","last_active":"2024-09-12T18:01:33.006388+0000","last_peered":"2024-09-12T18:01:33.006388+0000","last_clean":"2024-09-12T18:01:33.006388+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T18:01:33.006388+0000","last_undegraded":"2024-09-12T18:01:33.006388+0000","last_fullsized":"2024-09-12T18:01:33.006388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.006261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.006261+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.006261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:19.171367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'231","reported_seq":769,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.407362+0000","last_change":"2024-09-12T18:01:41.407362+0000","last_active":"2024-09-12T18:01:41.407362+0000","last_peered":"2024-09-12T18:01:41.407362+0000","last_clean":"2024-09-12T18:01:41.407362+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T18:01:41.407362+0000","last_undegraded":"2024-09-12T18:01:41.407362+0000","last_fullsized":"2024-09-12T18:01:41.407362+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'231","last_scrub_stamp":"2024-09-12T18:01:41.407267+0000","last_deep_scrub":"265'231","last_deep_scrub_stamp":"2024-09-12T18:01:41.407267+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.407267+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:13.355719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'388","reported_seq":1873,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.830190+0000","last_change":"2024-09-12T18:01:20.830100+0000","last_active":"2024-09-12T18:01:20.830190+0000","last_peered":"2024-09-12T18:01:20.830190+0000","last_clean":"2024-09-12T18:01:20.830190+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T18:01:20.830190+0000","last_undegraded":"2024-09-12T18:01:20.830190+0000","last_fullsized":"2024-09-12T18:01:20.830190+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.830014+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.815711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'337","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.935172+0000","last_change":"2024-09-12T18:01:12.935172+0000","last_active":"2024-09-12T18:01:12.935172+0000","last_peered":"2024-09-12T18:01:12.935172+0000","last_clean":"2024-09-12T18:01:12.935172+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T18:01:12.935172+0000","last_undegraded":"2024-09-12T18:01:12.935172+0000","last_fullsized":"2024-09-12T18:01:12.935172+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.935024+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:23.088612+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":8586,"num_write":1108,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.015175+0000","last_change":"2024-09-12T18:01:26.015124+0000","last_active":"2024-09-12T18:01:26.015175+0000","last_peered":"2024-09-12T18:01:26.015175+0000","last_clean":"2024-09-12T18:01:26.015175+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T18:01:26.015175+0000","last_undegraded":"2024-09-12T18:01:26.015175+0000","last_fullsized":"2024-09-12T18:01:26.015175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.015036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:53.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'322","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.361742+0000","last_change":"2024-09-12T18:01:28.361686+0000","last_active":"2024-09-12T18:01:28.361742+0000","last_peered":"2024-09-12T18:01:28.361742+0000","last_clean":"2024-09-12T18:01:28.361742+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T18:01:28.361742+0000","last_undegraded":"2024-09-12T18:01:28.361742+0000","last_fullsized":"2024-09-12T18:01:28.361742+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.361576+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:53.552109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54935,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":1244,"num_write":438,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.247647+0000","last_change":"2024-09-12T18:01:32.247532+0000","last_active":"2024-09-12T18:01:32.247647+0000","last_peered":"2024-09-12T18:01:32.247647+0000","last_clean":"2024-09-12T18:01:32.247647+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T18:01:32.247647+0000","last_undegraded":"2024-09-12T18:01:32.247647+0000","last_fullsized":"2024-09-12T18:01:32.247647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.247432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.247432+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.247432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'133","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:02.970181+0000","last_change":"2024-09-12T17:22:00.797551+0000","last_active":"2024-09-12T17:59:02.970181+0000","last_peered":"2024-09-12T17:59:02.970181+0000","last_clean":"2024-09-12T17:59:02.970181+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T17:59:02.970181+0000","last_undegraded":"2024-09-12T17:59:02.970181+0000","last_fullsized":"2024-09-12T17:59:02.970181+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:41.162485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'741","reported_seq":2121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.416891+0000","last_change":"2024-09-12T18:01:21.416829+0000","last_active":"2024-09-12T18:01:21.416891+0000","last_peered":"2024-09-12T18:01:21.416891+0000","last_clean":"2024-09-12T18:01:21.416891+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T18:01:21.416891+0000","last_undegraded":"2024-09-12T18:01:21.416891+0000","last_fullsized":"2024-09-12T18:01:21.416891+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'741","last_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_deep_scrub":"265'741","last_deep_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.416733+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:42.434807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'319","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.025570+0000","last_change":"2024-09-12T18:01:14.025570+0000","last_active":"2024-09-12T18:01:14.025570+0000","last_peered":"2024-09-12T18:01:14.025570+0000","last_clean":"2024-09-12T18:01:14.025570+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:14.025570+0000","last_undegraded":"2024-09-12T18:01:14.025570+0000","last_fullsized":"2024-09-12T18:01:14.025570+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.025424+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:56.638592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":5945,"num_write":1198,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.718214+0000","last_change":"2024-09-12T18:01:39.718214+0000","last_active":"2024-09-12T18:01:39.718214+0000","last_peered":"2024-09-12T18:01:39.718214+0000","last_clean":"2024-09-12T18:01:39.718214+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T18:01:39.718214+0000","last_undegraded":"2024-09-12T18:01:39.718214+0000","last_fullsized":"2024-09-12T18:01:39.718214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:39.718115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:39.718115+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.718115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:48.115400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'257","reported_seq":828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.765483+0000","last_change":"2024-09-12T18:01:29.765422+0000","last_active":"2024-09-12T18:01:29.765483+0000","last_peered":"2024-09-12T18:01:29.765483+0000","last_clean":"2024-09-12T18:01:29.765483+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T18:01:29.765483+0000","last_undegraded":"2024-09-12T18:01:29.765483+0000","last_fullsized":"2024-09-12T18:01:29.765483+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'257","last_scrub_stamp":"2024-09-12T18:01:29.765326+0000","last_deep_scrub":"265'257","last_deep_scrub_stamp":"2024-09-12T18:01:29.765326+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.765326+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.854948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48942,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":1075,"num_write":368,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.327176+0000","last_change":"2024-09-12T18:01:33.327099+0000","last_active":"2024-09-12T18:01:33.327176+0000","last_peered":"2024-09-12T18:01:33.327176+0000","last_clean":"2024-09-12T18:01:33.327176+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T18:01:33.327176+0000","last_undegraded":"2024-09-12T18:01:33.327176+0000","last_fullsized":"2024-09-12T18:01:33.327176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.327013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.327013+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.327013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:15.753055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'406","reported_seq":1827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.556024+0000","last_change":"2024-09-12T18:01:31.556024+0000","last_active":"2024-09-12T18:01:31.556024+0000","last_peered":"2024-09-12T18:01:31.556024+0000","last_clean":"2024-09-12T18:01:31.556024+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T18:01:31.556024+0000","last_undegraded":"2024-09-12T18:01:31.556024+0000","last_fullsized":"2024-09-12T18:01:31.556024+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T18:01:31.555902+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T18:01:31.555902+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.555902+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:22.755101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'306","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.017205+0000","last_change":"2024-09-12T18:01:15.017205+0000","last_active":"2024-09-12T18:01:15.017205+0000","last_peered":"2024-09-12T18:01:15.017205+0000","last_clean":"2024-09-12T18:01:15.017205+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:15.017205+0000","last_undegraded":"2024-09-12T18:01:15.017205+0000","last_fullsized":"2024-09-12T18:01:15.017205+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'306","last_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_deep_scrub":"265'306","last_deep_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.017064+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:45.936859+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6208110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":25374,"num_write":969,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.355066+0000","last_change":"2024-09-12T18:01:29.355066+0000","last_active":"2024-09-12T18:01:29.355066+0000","last_peered":"2024-09-12T18:01:29.355066+0000","last_clean":"2024-09-12T18:01:29.355066+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T18:01:29.355066+0000","last_undegraded":"2024-09-12T18:01:29.355066+0000","last_fullsized":"2024-09-12T18:01:29.355066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.354979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.354979+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.354979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.677603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'490","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.385058+0000","last_change":"2024-09-12T18:01:33.385058+0000","last_active":"2024-09-12T18:01:33.385058+0000","last_peered":"2024-09-12T18:01:33.385058+0000","last_clean":"2024-09-12T18:01:33.385058+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:01:33.385058+0000","last_undegraded":"2024-09-12T18:01:33.385058+0000","last_fullsized":"2024-09-12T18:01:33.385058+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:33.384960+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:33.384960+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.384960+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:59.456106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94926,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":2123,"num_write":760,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.055233+0000","last_change":"2024-09-12T18:01:32.055233+0000","last_active":"2024-09-12T18:01:32.055233+0000","last_peered":"2024-09-12T18:01:32.055233+0000","last_clean":"2024-09-12T18:01:32.055233+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T18:01:32.055233+0000","last_undegraded":"2024-09-12T18:01:32.055233+0000","last_fullsized":"2024-09-12T18:01:32.055233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.055142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.055142+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.055142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:15.170698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'168","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.169209+0000","last_change":"2024-09-12T18:01:47.169209+0000","last_active":"2024-09-12T18:01:47.169209+0000","last_peered":"2024-09-12T18:01:47.169209+0000","last_clean":"2024-09-12T18:01:47.169209+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T18:01:47.169209+0000","last_undegraded":"2024-09-12T18:01:47.169209+0000","last_fullsized":"2024-09-12T18:01:47.169209+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T18:01:47.169070+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T18:01:47.169070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.169070+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:31.952309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'422","reported_seq":1895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.801339+0000","last_change":"2024-09-12T18:01:19.801339+0000","last_active":"2024-09-12T18:01:19.801339+0000","last_peered":"2024-09-12T18:01:19.801339+0000","last_clean":"2024-09-12T18:01:19.801339+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T18:01:19.801339+0000","last_undegraded":"2024-09-12T18:01:19.801339+0000","last_fullsized":"2024-09-12T18:01:19.801339+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.801241+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.355929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'338","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.856875+0000","last_change":"2024-09-12T18:01:15.856875+0000","last_active":"2024-09-12T18:01:15.856875+0000","last_peered":"2024-09-12T18:01:15.856875+0000","last_clean":"2024-09-12T18:01:15.856875+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T18:01:15.856875+0000","last_undegraded":"2024-09-12T18:01:15.856875+0000","last_fullsized":"2024-09-12T18:01:15.856875+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.856769+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:45.860393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":48900,"num_write":1054,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.072466+0000","last_change":"2024-09-12T18:01:29.072395+0000","last_active":"2024-09-12T18:01:29.072466+0000","last_peered":"2024-09-12T18:01:29.072466+0000","last_clean":"2024-09-12T18:01:29.072466+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T18:01:29.072466+0000","last_undegraded":"2024-09-12T18:01:29.072466+0000","last_fullsized":"2024-09-12T18:01:29.072466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.072294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.072294+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.072294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:35.429398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'303","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.710912+0000","last_change":"2024-09-12T18:01:44.710912+0000","last_active":"2024-09-12T18:01:44.710912+0000","last_peered":"2024-09-12T18:01:44.710912+0000","last_clean":"2024-09-12T18:01:44.710912+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T18:01:44.710912+0000","last_undegraded":"2024-09-12T18:01:44.710912+0000","last_fullsized":"2024-09-12T18:01:44.710912+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T18:01:44.710795+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T18:01:44.710795+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.710795+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:51.035980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1077,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.141697+0000","last_change":"2024-09-12T18:01:43.141697+0000","last_active":"2024-09-12T18:01:43.141697+0000","last_peered":"2024-09-12T18:01:43.141697+0000","last_clean":"2024-09-12T18:01:43.141697+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T18:01:43.141697+0000","last_undegraded":"2024-09-12T18:01:43.141697+0000","last_fullsized":"2024-09-12T18:01:43.141697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.141601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.141601+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.141601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:34.597861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'190","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.256743+0000","last_change":"2024-09-12T17:22:00.794027+0000","last_active":"2024-09-12T17:59:33.256743+0000","last_peered":"2024-09-12T17:59:33.256743+0000","last_clean":"2024-09-12T17:59:33.256743+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T17:59:33.256743+0000","last_undegraded":"2024-09-12T17:59:33.256743+0000","last_fullsized":"2024-09-12T17:59:33.256743+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'858","reported_seq":2327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.389730+0000","last_change":"2024-09-12T18:01:20.389730+0000","last_active":"2024-09-12T18:01:20.389730+0000","last_peered":"2024-09-12T18:01:20.389730+0000","last_clean":"2024-09-12T18:01:20.389730+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T18:01:20.389730+0000","last_undegraded":"2024-09-12T18:01:20.389730+0000","last_fullsized":"2024-09-12T18:01:20.389730+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'858","last_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_deep_scrub":"265'858","last_deep_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.389628+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:33.344999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.107915+0000","last_change":"2024-09-12T18:01:12.107915+0000","last_active":"2024-09-12T18:01:12.107915+0000","last_peered":"2024-09-12T18:01:12.107915+0000","last_clean":"2024-09-12T18:01:12.107915+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T18:01:12.107915+0000","last_undegraded":"2024-09-12T18:01:12.107915+0000","last_fullsized":"2024-09-12T18:01:12.107915+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.107785+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:13.904898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287371,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":72608,"num_write":1086,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.042699+0000","last_change":"2024-09-12T18:01:27.042699+0000","last_active":"2024-09-12T18:01:27.042699+0000","last_peered":"2024-09-12T18:01:27.042699+0000","last_clean":"2024-09-12T18:01:27.042699+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T18:01:27.042699+0000","last_undegraded":"2024-09-12T18:01:27.042699+0000","last_fullsized":"2024-09-12T18:01:27.042699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.042611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:44.161430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'242","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.417943+0000","last_change":"2024-09-12T18:01:35.417943+0000","last_active":"2024-09-12T18:01:35.417943+0000","last_peered":"2024-09-12T18:01:35.417943+0000","last_clean":"2024-09-12T18:01:35.417943+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T18:01:35.417943+0000","last_undegraded":"2024-09-12T18:01:35.417943+0000","last_fullsized":"2024-09-12T18:01:35.417943+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T18:01:35.417842+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T18:01:35.417842+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.417842+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.551863+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18914,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":895,"num_write":312,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.297910+0000","last_change":"2024-09-12T18:01:32.297910+0000","last_active":"2024-09-12T18:01:32.297910+0000","last_peered":"2024-09-12T18:01:32.297910+0000","last_clean":"2024-09-12T18:01:32.297910+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T18:01:32.297910+0000","last_undegraded":"2024-09-12T18:01:32.297910+0000","last_fullsized":"2024-09-12T18:01:32.297910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.297821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.297821+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.297821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:48.366526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'111","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:56.125578+0000","last_change":"2024-09-12T17:22:00.796332+0000","last_active":"2024-09-12T18:00:56.125578+0000","last_peered":"2024-09-12T18:00:56.125578+0000","last_clean":"2024-09-12T18:00:56.125578+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:00:56.125578+0000","last_undegraded":"2024-09-12T18:00:56.125578+0000","last_fullsized":"2024-09-12T18:00:56.125578+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'490","reported_seq":2098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.896366+0000","last_change":"2024-09-12T18:01:23.896366+0000","last_active":"2024-09-12T18:01:23.896366+0000","last_peered":"2024-09-12T18:01:23.896366+0000","last_clean":"2024-09-12T18:01:23.896366+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:01:23.896366+0000","last_undegraded":"2024-09-12T18:01:23.896366+0000","last_fullsized":"2024-09-12T18:01:23.896366+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.896262+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.890695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'316","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.847748+0000","last_change":"2024-09-12T18:01:17.847748+0000","last_active":"2024-09-12T18:01:17.847748+0000","last_peered":"2024-09-12T18:01:17.847748+0000","last_clean":"2024-09-12T18:01:17.847748+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T18:01:17.847748+0000","last_undegraded":"2024-09-12T18:01:17.847748+0000","last_fullsized":"2024-09-12T18:01:17.847748+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.847650+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:25.676928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170477,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":22007,"num_write":949,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.964235+0000","last_change":"2024-09-12T18:01:33.964235+0000","last_active":"2024-09-12T18:01:33.964235+0000","last_peered":"2024-09-12T18:01:33.964235+0000","last_clean":"2024-09-12T18:01:33.964235+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T18:01:33.964235+0000","last_undegraded":"2024-09-12T18:01:33.964235+0000","last_fullsized":"2024-09-12T18:01:33.964235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.964138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.964138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.964138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:57.373932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'85","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.746573+0000","last_change":"2024-09-12T18:01:46.746573+0000","last_active":"2024-09-12T18:01:46.746573+0000","last_peered":"2024-09-12T18:01:46.746573+0000","last_clean":"2024-09-12T18:01:46.746573+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T18:01:46.746573+0000","last_undegraded":"2024-09-12T18:01:46.746573+0000","last_fullsized":"2024-09-12T18:01:46.746573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-12T18:01:46.746473+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-12T18:01:46.746473+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.746473+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:20.211628+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'757","reported_seq":2443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.846889+0000","last_change":"2024-09-12T18:01:33.846792+0000","last_active":"2024-09-12T18:01:33.846889+0000","last_peered":"2024-09-12T18:01:33.846889+0000","last_clean":"2024-09-12T18:01:33.846889+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:01:33.846889+0000","last_undegraded":"2024-09-12T18:01:33.846889+0000","last_fullsized":"2024-09-12T18:01:33.846889+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'757","last_scrub_stamp":"2024-09-12T18:01:33.846694+0000","last_deep_scrub":"265'757","last_deep_scrub_stamp":"2024-09-12T18:01:33.846694+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.846694+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.845076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'111","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.024797+0000","last_change":"2024-09-12T17:22:00.792450+0000","last_active":"2024-09-12T17:59:34.024797+0000","last_peered":"2024-09-12T17:59:34.024797+0000","last_clean":"2024-09-12T17:59:34.024797+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T17:59:34.024797+0000","last_undegraded":"2024-09-12T17:59:34.024797+0000","last_fullsized":"2024-09-12T17:59:34.024797+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'473","reported_seq":2106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.009007+0000","last_change":"2024-09-12T18:01:24.009007+0000","last_active":"2024-09-12T18:01:24.009007+0000","last_peered":"2024-09-12T18:01:24.009007+0000","last_clean":"2024-09-12T18:01:24.009007+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T18:01:24.009007+0000","last_undegraded":"2024-09-12T18:01:24.009007+0000","last_fullsized":"2024-09-12T18:01:24.009007+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.008914+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:34.013264+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'343","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.091066+0000","last_change":"2024-09-12T18:01:10.091066+0000","last_active":"2024-09-12T18:01:10.091066+0000","last_peered":"2024-09-12T18:01:10.091066+0000","last_clean":"2024-09-12T18:01:10.091066+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T18:01:10.091066+0000","last_undegraded":"2024-09-12T18:01:10.091066+0000","last_fullsized":"2024-09-12T18:01:10.091066+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.090952+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:28.293870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2782938,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":20563,"num_write":1073,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.245348+0000","last_change":"2024-09-12T18:01:27.245348+0000","last_active":"2024-09-12T18:01:27.245348+0000","last_peered":"2024-09-12T18:01:27.245348+0000","last_clean":"2024-09-12T18:01:27.245348+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T18:01:27.245348+0000","last_undegraded":"2024-09-12T18:01:27.245348+0000","last_fullsized":"2024-09-12T18:01:27.245348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.245239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.245239+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.245239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:24.543748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'302","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.781142+0000","last_change":"2024-09-12T18:01:30.781142+0000","last_active":"2024-09-12T18:01:30.781142+0000","last_peered":"2024-09-12T18:01:30.781142+0000","last_clean":"2024-09-12T18:01:30.781142+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:01:30.781142+0000","last_undegraded":"2024-09-12T18:01:30.781142+0000","last_fullsized":"2024-09-12T18:01:30.781142+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T18:01:30.781042+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T18:01:30.781042+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.781042+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:06.795378+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50539,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":1069,"num_write":390,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.973609+0000","last_change":"2024-09-12T18:01:43.973609+0000","last_active":"2024-09-12T18:01:43.973609+0000","last_peered":"2024-09-12T18:01:43.973609+0000","last_clean":"2024-09-12T18:01:43.973609+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T18:01:43.973609+0000","last_undegraded":"2024-09-12T18:01:43.973609+0000","last_fullsized":"2024-09-12T18:01:43.973609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.973531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.973531+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.973531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:16.451484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'141","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.324434+0000","last_change":"2024-09-12T18:01:38.324434+0000","last_active":"2024-09-12T18:01:38.324434+0000","last_peered":"2024-09-12T18:01:38.324434+0000","last_clean":"2024-09-12T18:01:38.324434+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T18:01:38.324434+0000","last_undegraded":"2024-09-12T18:01:38.324434+0000","last_fullsized":"2024-09-12T18:01:38.324434+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'141","last_scrub_stamp":"2024-09-12T18:01:38.324354+0000","last_deep_scrub":"265'141","last_deep_scrub_stamp":"2024-09-12T18:01:38.324354+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.324354+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:23.213982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'473","reported_seq":2089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.961531+0000","last_change":"2024-09-12T18:01:21.961531+0000","last_active":"2024-09-12T18:01:21.961531+0000","last_peered":"2024-09-12T18:01:21.961531+0000","last_clean":"2024-09-12T18:01:21.961531+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:01:21.961531+0000","last_undegraded":"2024-09-12T18:01:21.961531+0000","last_fullsized":"2024-09-12T18:01:21.961531+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.961440+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:47.473255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1157,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'336","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.486325+0000","last_change":"2024-09-12T18:01:22.486325+0000","last_active":"2024-09-12T18:01:22.486325+0000","last_peered":"2024-09-12T18:01:22.486325+0000","last_clean":"2024-09-12T18:01:22.486325+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:01:22.486325+0000","last_undegraded":"2024-09-12T18:01:22.486325+0000","last_fullsized":"2024-09-12T18:01:22.486325+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.486194+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:40.467598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":60843,"num_write":1102,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.002984+0000","last_change":"2024-09-12T18:01:25.002984+0000","last_active":"2024-09-12T18:01:25.002984+0000","last_peered":"2024-09-12T18:01:25.002984+0000","last_clean":"2024-09-12T18:01:25.002984+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T18:01:25.002984+0000","last_undegraded":"2024-09-12T18:01:25.002984+0000","last_fullsized":"2024-09-12T18:01:25.002984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.002885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:05.311567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'257","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.869369+0000","last_change":"2024-09-12T18:01:39.869369+0000","last_active":"2024-09-12T18:01:39.869369+0000","last_peered":"2024-09-12T18:01:39.869369+0000","last_clean":"2024-09-12T18:01:39.869369+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:01:39.869369+0000","last_undegraded":"2024-09-12T18:01:39.869369+0000","last_fullsized":"2024-09-12T18:01:39.869369+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'257","last_scrub_stamp":"2024-09-12T18:01:39.869274+0000","last_deep_scrub":"265'257","last_deep_scrub_stamp":"2024-09-12T18:01:39.869274+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.869274+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.853239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":1004,"num_write":346,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021541+0000","last_change":"2024-09-12T17:21:58.783726+0000","last_active":"2024-09-12T17:58:22.021541+0000","last_peered":"2024-09-12T17:58:22.021541+0000","last_clean":"2024-09-12T17:58:22.021541+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T17:58:22.021541+0000","last_undegraded":"2024-09-12T17:58:22.021541+0000","last_fullsized":"2024-09-12T17:58:22.021541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'103","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:34.765064+0000","last_change":"2024-09-12T17:22:00.798683+0000","last_active":"2024-09-12T17:59:34.765064+0000","last_peered":"2024-09-12T17:59:34.765064+0000","last_clean":"2024-09-12T17:59:34.765064+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T17:59:34.765064+0000","last_undegraded":"2024-09-12T17:59:34.765064+0000","last_fullsized":"2024-09-12T17:59:34.765064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:52.343353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.460129+0000","last_change":"2024-09-12T18:01:17.460129+0000","last_active":"2024-09-12T18:01:17.460129+0000","last_peered":"2024-09-12T18:01:17.460129+0000","last_clean":"2024-09-12T18:01:17.460129+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T18:01:17.460129+0000","last_undegraded":"2024-09-12T18:01:17.460129+0000","last_fullsized":"2024-09-12T18:01:17.460129+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'915","last_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_deep_scrub":"265'915","last_deep_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.460034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:51.385437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'398","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.993319+0000","last_change":"2024-09-12T18:01:15.993319+0000","last_active":"2024-09-12T18:01:15.993319+0000","last_peered":"2024-09-12T18:01:15.993319+0000","last_clean":"2024-09-12T18:01:15.993319+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:15.993319+0000","last_undegraded":"2024-09-12T18:01:15.993319+0000","last_fullsized":"2024-09-12T18:01:15.993319+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.993142+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:46.642090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645063,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":663,"num_read_kb":67994,"num_write":1237,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.260638+0000","last_change":"2024-09-12T18:01:26.260638+0000","last_active":"2024-09-12T18:01:26.260638+0000","last_peered":"2024-09-12T18:01:26.260638+0000","last_clean":"2024-09-12T18:01:26.260638+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T18:01:26.260638+0000","last_undegraded":"2024-09-12T18:01:26.260638+0000","last_fullsized":"2024-09-12T18:01:26.260638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.260550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:54.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'232","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.335831+0000","last_change":"2024-09-12T18:01:32.335831+0000","last_active":"2024-09-12T18:01:32.335831+0000","last_peered":"2024-09-12T18:01:32.335831+0000","last_clean":"2024-09-12T18:01:32.335831+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T18:01:32.335831+0000","last_undegraded":"2024-09-12T18:01:32.335831+0000","last_fullsized":"2024-09-12T18:01:32.335831+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'232","last_scrub_stamp":"2024-09-12T18:01:32.335737+0000","last_deep_scrub":"265'232","last_deep_scrub_stamp":"2024-09-12T18:01:32.335737+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.335737+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":330,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:57:02.010097+0000","last_change":"2024-09-12T17:21:58.790322+0000","last_active":"2024-09-12T17:57:02.010097+0000","last_peered":"2024-09-12T17:57:02.010097+0000","last_clean":"2024-09-12T17:57:02.010097+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T17:57:02.010097+0000","last_undegraded":"2024-09-12T17:57:02.010097+0000","last_fullsized":"2024-09-12T17:57:02.010097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:57.749324+0000","last_clean_scrub_stamp":"2024-09-12T17:21:57.749324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:02.075930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'218","reported_seq":1317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:33.414101+0000","last_change":"2024-09-12T17:22:00.798392+0000","last_active":"2024-09-12T17:59:33.414101+0000","last_peered":"2024-09-12T17:59:33.414101+0000","last_clean":"2024-09-12T17:59:33.414101+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T17:59:33.414101+0000","last_undegraded":"2024-09-12T17:59:33.414101+0000","last_fullsized":"2024-09-12T17:59:33.414101+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:21:59.765150+0000","last_clean_scrub_stamp":"2024-09-12T17:21:59.765150+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:00.108534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.999269+0000","last_change":"2024-09-12T18:01:20.999269+0000","last_active":"2024-09-12T18:01:20.999269+0000","last_peered":"2024-09-12T18:01:20.999269+0000","last_clean":"2024-09-12T18:01:20.999269+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T18:01:20.999269+0000","last_undegraded":"2024-09-12T18:01:20.999269+0000","last_fullsized":"2024-09-12T18:01:20.999269+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'869","last_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_deep_scrub":"265'869","last_deep_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.999172+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:58.536428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'354","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.014469+0000","last_change":"2024-09-12T18:01:17.014403+0000","last_active":"2024-09-12T18:01:17.014469+0000","last_peered":"2024-09-12T18:01:17.014469+0000","last_clean":"2024-09-12T18:01:17.014469+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:17.014469+0000","last_undegraded":"2024-09-12T18:01:17.014469+0000","last_fullsized":"2024-09-12T18:01:17.014469+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.014256+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:50.373551+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3457436,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":16565,"num_write":1099,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.964824+0000","last_change":"2024-09-12T18:01:32.964824+0000","last_active":"2024-09-12T18:01:32.964824+0000","last_peered":"2024-09-12T18:01:32.964824+0000","last_clean":"2024-09-12T18:01:32.964824+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T18:01:32.964824+0000","last_undegraded":"2024-09-12T18:01:32.964824+0000","last_fullsized":"2024-09-12T18:01:32.964824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:32.964708+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:32.964708+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.964708+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:36.523562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'297","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.712978+0000","last_change":"2024-09-12T18:01:45.712978+0000","last_active":"2024-09-12T18:01:45.712978+0000","last_peered":"2024-09-12T18:01:45.712978+0000","last_clean":"2024-09-12T18:01:45.712978+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T18:01:45.712978+0000","last_undegraded":"2024-09-12T18:01:45.712978+0000","last_fullsized":"2024-09-12T18:01:45.712978+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T18:01:45.712884+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T18:01:45.712884+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.712884+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:30.618856+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1131,"num_write":404,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.023206+0000","last_change":"2024-09-12T18:01:45.023206+0000","last_active":"2024-09-12T18:01:45.023206+0000","last_peered":"2024-09-12T18:01:45.023206+0000","last_clean":"2024-09-12T18:01:45.023206+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T18:01:45.023206+0000","last_undegraded":"2024-09-12T18:01:45.023206+0000","last_fullsized":"2024-09-12T18:01:45.023206+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.023118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.023118+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.023118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:15.850247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'138","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.804887+0000","last_change":"2024-09-12T18:01:32.804887+0000","last_active":"2024-09-12T18:01:32.804887+0000","last_peered":"2024-09-12T18:01:32.804887+0000","last_clean":"2024-09-12T18:01:32.804887+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:01:32.804887+0000","last_undegraded":"2024-09-12T18:01:32.804887+0000","last_fullsized":"2024-09-12T18:01:32.804887+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T18:01:32.804809+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T18:01:32.804809+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.804809+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.756403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'780","reported_seq":2434,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.908292+0000","last_change":"2024-09-12T18:01:22.908292+0000","last_active":"2024-09-12T18:01:22.908292+0000","last_peered":"2024-09-12T18:01:22.908292+0000","last_clean":"2024-09-12T18:01:22.908292+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T18:01:22.908292+0000","last_undegraded":"2024-09-12T18:01:22.908292+0000","last_fullsized":"2024-09-12T18:01:22.908292+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'780","last_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_deep_scrub":"265'780","last_deep_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.908162+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.242029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'369","reported_seq":1077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.916743+0000","last_change":"2024-09-12T18:01:11.916679+0000","last_active":"2024-09-12T18:01:11.916743+0000","last_peered":"2024-09-12T18:01:11.916743+0000","last_clean":"2024-09-12T18:01:11.916743+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T18:01:11.916743+0000","last_undegraded":"2024-09-12T18:01:11.916743+0000","last_fullsized":"2024-09-12T18:01:11.916743+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.916584+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:14.976183+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6259488,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":161127,"num_write":1137,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'471","reported_seq":1788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.450694+0000","last_change":"2024-09-12T18:01:18.450694+0000","last_active":"2024-09-12T18:01:18.450694+0000","last_peered":"2024-09-12T18:01:18.450694+0000","last_clean":"2024-09-12T18:01:18.450694+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T18:01:18.450694+0000","last_undegraded":"2024-09-12T18:01:18.450694+0000","last_fullsized":"2024-09-12T18:01:18.450694+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.450603+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.728665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'445","reported_seq":1133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.453039+0000","last_change":"2024-09-12T18:01:14.452969+0000","last_active":"2024-09-12T18:01:14.453039+0000","last_peered":"2024-09-12T18:01:14.453039+0000","last_clean":"2024-09-12T18:01:14.453039+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T18:01:14.453039+0000","last_undegraded":"2024-09-12T18:01:14.453039+0000","last_fullsized":"2024-09-12T18:01:14.453039+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.452866+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:29.422563+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190265,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":23221,"num_write":1306,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'806","reported_seq":2443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.622061+0000","last_change":"2024-09-12T18:01:35.622061+0000","last_active":"2024-09-12T18:01:35.622061+0000","last_peered":"2024-09-12T18:01:35.622061+0000","last_clean":"2024-09-12T18:01:35.622061+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T18:01:35.622061+0000","last_undegraded":"2024-09-12T18:01:35.622061+0000","last_fullsized":"2024-09-12T18:01:35.622061+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:35.621952+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:35.621952+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.621952+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:27.209847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'376","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.484407+0000","last_change":"2024-09-12T18:01:19.484338+0000","last_active":"2024-09-12T18:01:19.484407+0000","last_peered":"2024-09-12T18:01:19.484407+0000","last_clean":"2024-09-12T18:01:19.484407+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T18:01:19.484407+0000","last_undegraded":"2024-09-12T18:01:19.484407+0000","last_fullsized":"2024-09-12T18:01:19.484407+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.484172+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:45.726748+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":33088,"num_write":1180,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'922","reported_seq":2569,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.164426+0000","last_change":"2024-09-12T18:01:31.164426+0000","last_active":"2024-09-12T18:01:31.164426+0000","last_peered":"2024-09-12T18:01:31.164426+0000","last_clean":"2024-09-12T18:01:31.164426+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T18:01:31.164426+0000","last_undegraded":"2024-09-12T18:01:31.164426+0000","last_fullsized":"2024-09-12T18:01:31.164426+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'922","last_scrub_stamp":"2024-09-12T18:01:31.164340+0000","last_deep_scrub":"265'922","last_deep_scrub_stamp":"2024-09-12T18:01:31.164340+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.164340+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:02.147024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1530,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'403","reported_seq":1103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.983825+0000","last_change":"2024-09-12T18:01:18.983754+0000","last_active":"2024-09-12T18:01:18.983825+0000","last_peered":"2024-09-12T18:01:18.983825+0000","last_clean":"2024-09-12T18:01:18.983825+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:18.983825+0000","last_undegraded":"2024-09-12T18:01:18.983825+0000","last_fullsized":"2024-09-12T18:01:18.983825+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.983615+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:27.019267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254923,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":28930,"num_write":1343,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'505","reported_seq":2112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.149749+0000","last_change":"2024-09-12T18:01:29.149657+0000","last_active":"2024-09-12T18:01:29.149749+0000","last_peered":"2024-09-12T18:01:29.149749+0000","last_clean":"2024-09-12T18:01:29.149749+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T18:01:29.149749+0000","last_undegraded":"2024-09-12T18:01:29.149749+0000","last_fullsized":"2024-09-12T18:01:29.149749+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T18:01:29.149537+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T18:01:29.149537+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.149537+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:59.837592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'354","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.211578+0000","last_change":"2024-09-12T18:01:15.211578+0000","last_active":"2024-09-12T18:01:15.211578+0000","last_peered":"2024-09-12T18:01:15.211578+0000","last_clean":"2024-09-12T18:01:15.211578+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T18:01:15.211578+0000","last_undegraded":"2024-09-12T18:01:15.211578+0000","last_fullsized":"2024-09-12T18:01:15.211578+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.211486+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:31.451040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":85437,"num_write":1070,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'465","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.678003+0000","last_change":"2024-09-12T18:01:19.677935+0000","last_active":"2024-09-12T18:01:19.678003+0000","last_peered":"2024-09-12T18:01:19.678003+0000","last_clean":"2024-09-12T18:01:19.678003+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T18:01:19.678003+0000","last_undegraded":"2024-09-12T18:01:19.678003+0000","last_fullsized":"2024-09-12T18:01:19.678003+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'465","last_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_deep_scrub":"265'465","last_deep_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.677819+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:45.594108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'299","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.273285+0000","last_change":"2024-09-12T18:01:17.273285+0000","last_active":"2024-09-12T18:01:17.273285+0000","last_peered":"2024-09-12T18:01:17.273285+0000","last_clean":"2024-09-12T18:01:17.273285+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T18:01:17.273285+0000","last_undegraded":"2024-09-12T18:01:17.273285+0000","last_fullsized":"2024-09-12T18:01:17.273285+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.273168+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.449887+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830346,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":83513,"num_write":1029,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'602","reported_seq":2282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.265910+0000","last_change":"2024-09-12T18:01:21.265850+0000","last_active":"2024-09-12T18:01:21.265910+0000","last_peered":"2024-09-12T18:01:21.265910+0000","last_clean":"2024-09-12T18:01:21.265910+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T18:01:21.265910+0000","last_undegraded":"2024-09-12T18:01:21.265910+0000","last_fullsized":"2024-09-12T18:01:21.265910+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'602","last_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_deep_scrub":"265'602","last_deep_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.265759+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:25.389513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.921972+0000","last_change":"2024-09-12T18:01:13.921972+0000","last_active":"2024-09-12T18:01:13.921972+0000","last_peered":"2024-09-12T18:01:13.921972+0000","last_clean":"2024-09-12T18:01:13.921972+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T18:01:13.921972+0000","last_undegraded":"2024-09-12T18:01:13.921972+0000","last_fullsized":"2024-09-12T18:01:13.921972+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.921810+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:44.545643+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190292,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":100979,"num_write":1090,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'368","reported_seq":1828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.198574+0000","last_change":"2024-09-12T18:01:16.198505+0000","last_active":"2024-09-12T18:01:16.198574+0000","last_peered":"2024-09-12T18:01:16.198574+0000","last_clean":"2024-09-12T18:01:16.198574+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:01:16.198574+0000","last_undegraded":"2024-09-12T18:01:16.198574+0000","last_fullsized":"2024-09-12T18:01:16.198574+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.198407+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:23.007746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'356","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.018330+0000","last_change":"2024-09-12T18:01:18.018330+0000","last_active":"2024-09-12T18:01:18.018330+0000","last_peered":"2024-09-12T18:01:18.018330+0000","last_clean":"2024-09-12T18:01:18.018330+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:18.018330+0000","last_undegraded":"2024-09-12T18:01:18.018330+0000","last_fullsized":"2024-09-12T18:01:18.018330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.018155+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:21.152485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262264,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":460,"num_read_kb":5744,"num_write":1173,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'856","reported_seq":2406,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.408676+0000","last_change":"2024-09-12T18:01:19.408597+0000","last_active":"2024-09-12T18:01:19.408676+0000","last_peered":"2024-09-12T18:01:19.408676+0000","last_clean":"2024-09-12T18:01:19.408676+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:01:19.408676+0000","last_undegraded":"2024-09-12T18:01:19.408676+0000","last_fullsized":"2024-09-12T18:01:19.408676+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'856","last_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_deep_scrub":"265'856","last_deep_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.408502+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:03.521178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'380","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.531186+0000","last_change":"2024-09-12T18:01:23.531186+0000","last_active":"2024-09-12T18:01:23.531186+0000","last_peered":"2024-09-12T18:01:23.531186+0000","last_clean":"2024-09-12T18:01:23.531186+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T18:01:23.531186+0000","last_undegraded":"2024-09-12T18:01:23.531186+0000","last_fullsized":"2024-09-12T18:01:23.531186+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.531029+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:11.136174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49301,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":612,"num_read_kb":751,"num_write":1265,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'639","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.670363+0000","last_change":"2024-09-12T18:01:17.670293+0000","last_active":"2024-09-12T18:01:17.670363+0000","last_peered":"2024-09-12T18:01:17.670363+0000","last_clean":"2024-09-12T18:01:17.670363+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T18:01:17.670363+0000","last_undegraded":"2024-09-12T18:01:17.670363+0000","last_fullsized":"2024-09-12T18:01:17.670363+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'639","last_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_deep_scrub":"265'639","last_deep_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.670204+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:59.417673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'374","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.973451+0000","last_change":"2024-09-12T18:01:19.973451+0000","last_active":"2024-09-12T18:01:19.973451+0000","last_peered":"2024-09-12T18:01:19.973451+0000","last_clean":"2024-09-12T18:01:19.973451+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:19.973451+0000","last_undegraded":"2024-09-12T18:01:19.973451+0000","last_fullsized":"2024-09-12T18:01:19.973451+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.973298+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:20.876852+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190224,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":620,"num_read_kb":17255,"num_write":1152,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'560","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.170760+0000","last_change":"2024-09-12T18:01:30.170760+0000","last_active":"2024-09-12T18:01:30.170760+0000","last_peered":"2024-09-12T18:01:30.170760+0000","last_clean":"2024-09-12T18:01:30.170760+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T18:01:30.170760+0000","last_undegraded":"2024-09-12T18:01:30.170760+0000","last_fullsized":"2024-09-12T18:01:30.170760+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T18:01:30.170670+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T18:01:30.170670+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.170670+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:25.830397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'365","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.180439+0000","last_change":"2024-09-12T18:01:14.180439+0000","last_active":"2024-09-12T18:01:14.180439+0000","last_peered":"2024-09-12T18:01:14.180439+0000","last_clean":"2024-09-12T18:01:14.180439+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:01:14.180439+0000","last_undegraded":"2024-09-12T18:01:14.180439+0000","last_fullsized":"2024-09-12T18:01:14.180439+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.180323+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:09.461777+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":563,"num_read_kb":8561,"num_write":1187,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'555","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.185003+0000","last_change":"2024-09-12T18:01:19.185003+0000","last_active":"2024-09-12T18:01:19.185003+0000","last_peered":"2024-09-12T18:01:19.185003+0000","last_clean":"2024-09-12T18:01:19.185003+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:01:19.185003+0000","last_undegraded":"2024-09-12T18:01:19.185003+0000","last_fullsized":"2024-09-12T18:01:19.185003+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'555","last_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_deep_scrub":"265'555","last_deep_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.184900+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:52.759777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'316","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.863501+0000","last_change":"2024-09-12T18:01:21.863501+0000","last_active":"2024-09-12T18:01:21.863501+0000","last_peered":"2024-09-12T18:01:21.863501+0000","last_clean":"2024-09-12T18:01:21.863501+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T18:01:21.863501+0000","last_undegraded":"2024-09-12T18:01:21.863501+0000","last_fullsized":"2024-09-12T18:01:21.863501+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.863390+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:47.927583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":7270,"num_write":974,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'497","reported_seq":2144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.169868+0000","last_change":"2024-09-12T18:01:18.169868+0000","last_active":"2024-09-12T18:01:18.169868+0000","last_peered":"2024-09-12T18:01:18.169868+0000","last_clean":"2024-09-12T18:01:18.169868+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T18:01:18.169868+0000","last_undegraded":"2024-09-12T18:01:18.169868+0000","last_fullsized":"2024-09-12T18:01:18.169868+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'497","last_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_deep_scrub":"265'497","last_deep_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.169758+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:34.271652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'365","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.863401+0000","last_change":"2024-09-12T18:01:10.863401+0000","last_active":"2024-09-12T18:01:10.863401+0000","last_peered":"2024-09-12T18:01:10.863401+0000","last_clean":"2024-09-12T18:01:10.863401+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T18:01:10.863401+0000","last_undegraded":"2024-09-12T18:01:10.863401+0000","last_fullsized":"2024-09-12T18:01:10.863401+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.863281+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:12.634167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":1811,"num_write":1218,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'760","reported_seq":2535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.499737+0000","last_change":"2024-09-12T18:01:23.499737+0000","last_active":"2024-09-12T18:01:23.499737+0000","last_peered":"2024-09-12T18:01:23.499737+0000","last_clean":"2024-09-12T18:01:23.499737+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T18:01:23.499737+0000","last_undegraded":"2024-09-12T18:01:23.499737+0000","last_fullsized":"2024-09-12T18:01:23.499737+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'760","last_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_deep_scrub":"265'760","last_deep_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.499647+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:40.989755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'339","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.596545+0000","last_change":"2024-09-12T18:01:26.596545+0000","last_active":"2024-09-12T18:01:26.596545+0000","last_peered":"2024-09-12T18:01:26.596545+0000","last_clean":"2024-09-12T18:01:26.596545+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:01:26.596545+0000","last_undegraded":"2024-09-12T18:01:26.596545+0000","last_fullsized":"2024-09-12T18:01:26.596545+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.596412+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:20.074252+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2223469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":11534,"num_write":1063,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1319","reported_seq":3065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.924077+0000","last_change":"2024-09-12T18:01:24.924077+0000","last_active":"2024-09-12T18:01:24.924077+0000","last_peered":"2024-09-12T18:01:24.924077+0000","last_clean":"2024-09-12T18:01:24.924077+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T18:01:24.924077+0000","last_undegraded":"2024-09-12T18:01:24.924077+0000","last_fullsized":"2024-09-12T18:01:24.924077+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1319","last_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_deep_scrub":"265'1319","last_deep_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.923970+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":1300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:13.855563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3376,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'431","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.487468+0000","last_change":"2024-09-12T18:01:15.487345+0000","last_active":"2024-09-12T18:01:15.487468+0000","last_peered":"2024-09-12T18:01:15.487468+0000","last_clean":"2024-09-12T18:01:15.487468+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T18:01:15.487468+0000","last_undegraded":"2024-09-12T18:01:15.487468+0000","last_fullsized":"2024-09-12T18:01:15.487468+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'431","last_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_deep_scrub":"265'431","last_deep_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.487068+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.782666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":12654,"num_write":1335,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'853","reported_seq":2474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.216187+0000","last_change":"2024-09-12T18:01:17.216187+0000","last_active":"2024-09-12T18:01:17.216187+0000","last_peered":"2024-09-12T18:01:17.216187+0000","last_clean":"2024-09-12T18:01:17.216187+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T18:01:17.216187+0000","last_undegraded":"2024-09-12T18:01:17.216187+0000","last_fullsized":"2024-09-12T18:01:17.216187+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'853","last_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_deep_scrub":"265'853","last_deep_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.216096+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:08.132663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'405","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.507694+0000","last_change":"2024-09-12T18:01:21.507619+0000","last_active":"2024-09-12T18:01:21.507694+0000","last_peered":"2024-09-12T18:01:21.507694+0000","last_clean":"2024-09-12T18:01:21.507694+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T18:01:21.507694+0000","last_undegraded":"2024-09-12T18:01:21.507694+0000","last_fullsized":"2024-09-12T18:01:21.507694+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.507507+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:37.979878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111016,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":21305,"num_write":1293,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.612545+0000","last_change":"2024-09-12T18:01:25.612472+0000","last_active":"2024-09-12T18:01:25.612545+0000","last_peered":"2024-09-12T18:01:25.612545+0000","last_clean":"2024-09-12T18:01:25.612545+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T18:01:25.612545+0000","last_undegraded":"2024-09-12T18:01:25.612545+0000","last_fullsized":"2024-09-12T18:01:25.612545+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.612341+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:10.180395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":645,"num_read_kb":38619,"num_write":1146,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'588","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.909762+0000","last_change":"2024-09-12T18:01:26.909762+0000","last_active":"2024-09-12T18:01:26.909762+0000","last_peered":"2024-09-12T18:01:26.909762+0000","last_clean":"2024-09-12T18:01:26.909762+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T18:01:26.909762+0000","last_undegraded":"2024-09-12T18:01:26.909762+0000","last_fullsized":"2024-09-12T18:01:26.909762+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'588","last_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_deep_scrub":"265'588","last_deep_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.909677+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:37.357766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.007007+0000","last_change":"2024-09-12T18:01:21.006935+0000","last_active":"2024-09-12T18:01:21.007007+0000","last_peered":"2024-09-12T18:01:21.007007+0000","last_clean":"2024-09-12T18:01:21.007007+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:21.007007+0000","last_undegraded":"2024-09-12T18:01:21.007007+0000","last_fullsized":"2024-09-12T18:01:21.007007+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.006814+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:43.121834+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364838,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":51644,"num_write":1154,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'404","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.241009+0000","last_change":"2024-09-12T18:01:22.241009+0000","last_active":"2024-09-12T18:01:22.241009+0000","last_peered":"2024-09-12T18:01:22.241009+0000","last_clean":"2024-09-12T18:01:22.241009+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T18:01:22.241009+0000","last_undegraded":"2024-09-12T18:01:22.241009+0000","last_fullsized":"2024-09-12T18:01:22.241009+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.240903+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:52.955110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1616,"ondisk_log_size":1616,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":759,"ondisk_log_size":759,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553896,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16885,"num_read_kb":36225,"num_write":14143,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673122,"num_omap_keys":1554,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2231,"ondisk_log_size":2231,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2878,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44063,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4149,"ondisk_log_size":4149,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83193324,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":36148,"num_read_kb":1816228,"num_write":72592,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113262592,"data_stored":113262592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3606,"ondisk_log_size":3606,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":163167,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":167173,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477224,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286084,"kb_used_data":20276,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94085756,"statfs":{"total":96636764160,"available":96343814144,"internally_reserved":0,"allocated":20762624,"data_stored":18763428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509929,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117088,"kb_used_data":17872,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94254752,"statfs":{"total":96636764160,"available":96516866048,"internally_reserved":0,"allocated":18300928,"data_stored":16277974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509928,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249488,"kb_used_data":15680,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94122352,"statfs":{"total":96636764160,"available":96381288448,"internally_reserved":0,"allocated":16056320,"data_stored":14054405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509928,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268336,"kb_used_data":20576,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94103504,"statfs":{"total":96636764160,"available":96361988096,"internally_reserved":0,"allocated":21069824,"data_stored":19072665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509930,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160940,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94210900,"statfs":{"total":96636764160,"available":96471961600,"internally_reserved":0,"allocated":21983232,"data_stored":19991308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509929,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342488,"kb_used_data":14216,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94029352,"statfs":{"total":96636764160,"available":96286056448,"internally_reserved":0,"allocated":14557184,"data_stored":12561929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509928,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146528,"kb_used_data":20944,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94225312,"statfs":{"total":96636764160,"available":96486719488,"internally_reserved":0,"allocated":21446656,"data_stored":19447593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575337,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265632,"kb_used_data":13776,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94106208,"statfs":{"total":96636764160,"available":96364756992,"internally_reserved":0,"allocated":14106624,"data_stored":12126360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17215488,"data_stored":17215488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9740288,"data_stored":9740288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17760256,"data_stored":17760256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16842752,"data_stored":16842752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11821056,"data_stored":11821056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15941632,"data_stored":15941632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":9895936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:53.039 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.039 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.039 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.039 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.040 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.041 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.042 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.043 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.044 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.045 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.046 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.047 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:38:42.966621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.048 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:37:07.623367+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.049 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.049 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:21:53.730779+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.049 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.053 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.053 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.054 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.054 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.054 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.055 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.055 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.055 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.055 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:21:57.749324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.055 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:21:59.765150+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=21, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:53.056 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:02:13.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:13.410 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:02:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:02:13.425 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1480,"stamp":"2024-09-12T18:02:13.165402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85355269,"num_objects":842,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":842,"num_whiteouts":0,"num_read":290229,"num_read_kb":2399744,"num_write":161152,"num_write_kb":2366967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725118,"num_omap_keys":1771,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13696,"ondisk_log_size":13696,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1836584,"kb_used_data":144808,"kb_used_omap":12,"kb_used_meta":1691635,"kb_avail":753138136,"statfs":{"total":773094113280,"available":771213451264,"internally_reserved":0,"allocated":148283392,"data_stored":132295662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1732234800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005299"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.821424+0000","last_change":"2024-09-12T18:01:46.821424+0000","last_active":"2024-09-12T18:01:46.821424+0000","last_peered":"2024-09-12T18:01:46.821424+0000","last_clean":"2024-09-12T18:01:46.821424+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T18:01:46.821424+0000","last_undegraded":"2024-09-12T18:01:46.821424+0000","last_fullsized":"2024-09-12T18:01:46.821424+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:46.821337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:46.821337+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.821337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:49.006761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.347923+0000","last_change":"2024-09-12T18:01:46.347923+0000","last_active":"2024-09-12T18:01:46.347923+0000","last_peered":"2024-09-12T18:01:46.347923+0000","last_clean":"2024-09-12T18:01:46.347923+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T18:01:46.347923+0000","last_undegraded":"2024-09-12T18:01:46.347923+0000","last_fullsized":"2024-09-12T18:01:46.347923+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:46.347813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:46.347813+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.347813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.730170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.405552+0000","last_change":"2024-09-12T18:01:50.405552+0000","last_active":"2024-09-12T18:01:50.405552+0000","last_peered":"2024-09-12T18:01:50.405552+0000","last_clean":"2024-09-12T18:01:50.405552+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T18:01:50.405552+0000","last_undegraded":"2024-09-12T18:01:50.405552+0000","last_fullsized":"2024-09-12T18:01:50.405552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:50.405461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:50.405461+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.405461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:55.904392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":422,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.074598+0000","last_change":"2024-09-12T18:01:52.074539+0000","last_active":"2024-09-12T18:01:52.074598+0000","last_peered":"2024-09-12T18:01:52.074598+0000","last_clean":"2024-09-12T18:01:52.074598+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T18:01:52.074598+0000","last_undegraded":"2024-09-12T18:01:52.074598+0000","last_fullsized":"2024-09-12T18:01:52.074598+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T18:01:52.074457+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T18:01:52.074457+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.074457+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:14.857030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.338404+0000","last_change":"2024-09-12T18:01:53.338404+0000","last_active":"2024-09-12T18:01:53.338404+0000","last_peered":"2024-09-12T18:01:53.338404+0000","last_clean":"2024-09-12T18:01:53.338404+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T18:01:53.338404+0000","last_undegraded":"2024-09-12T18:01:53.338404+0000","last_fullsized":"2024-09-12T18:01:53.338404+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.338316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.338316+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.338316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:40.441440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.953237+0000","last_change":"2024-09-12T18:01:50.953237+0000","last_active":"2024-09-12T18:01:50.953237+0000","last_peered":"2024-09-12T18:01:50.953237+0000","last_clean":"2024-09-12T18:01:50.953237+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T18:01:50.953237+0000","last_undegraded":"2024-09-12T18:01:50.953237+0000","last_fullsized":"2024-09-12T18:01:50.953237+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:01:50.953141+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:01:50.953141+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.953141+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:03.267747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.251269+0000","last_change":"2024-09-12T18:01:55.251269+0000","last_active":"2024-09-12T18:01:55.251269+0000","last_peered":"2024-09-12T18:01:55.251269+0000","last_clean":"2024-09-12T18:01:55.251269+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T18:01:55.251269+0000","last_undegraded":"2024-09-12T18:01:55.251269+0000","last_fullsized":"2024-09-12T18:01:55.251269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:01:55.251167+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:01:55.251167+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.251167+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:51.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4142,"num_write":12,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.045749+0000","last_change":"2024-09-12T18:01:51.045749+0000","last_active":"2024-09-12T18:01:51.045749+0000","last_peered":"2024-09-12T18:01:51.045749+0000","last_clean":"2024-09-12T18:01:51.045749+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T18:01:51.045749+0000","last_undegraded":"2024-09-12T18:01:51.045749+0000","last_fullsized":"2024-09-12T18:01:51.045749+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'26","last_scrub_stamp":"2024-09-12T18:01:51.045664+0000","last_deep_scrub":"265'26","last_deep_scrub_stamp":"2024-09-12T18:01:51.045664+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.045664+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:45.610588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.272324+0000","last_change":"2024-09-12T18:01:49.272251+0000","last_active":"2024-09-12T18:01:49.272324+0000","last_peered":"2024-09-12T18:01:49.272324+0000","last_clean":"2024-09-12T18:01:49.272324+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T18:01:49.272324+0000","last_undegraded":"2024-09-12T18:01:49.272324+0000","last_fullsized":"2024-09-12T18:01:49.272324+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.272153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.272153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.272153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:41.007454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.144825+0000","last_change":"2024-09-12T18:02:04.144825+0000","last_active":"2024-09-12T18:02:04.144825+0000","last_peered":"2024-09-12T18:02:04.144825+0000","last_clean":"2024-09-12T18:02:04.144825+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T18:02:04.144825+0000","last_undegraded":"2024-09-12T18:02:04.144825+0000","last_fullsized":"2024-09-12T18:02:04.144825+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:02:04.144731+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:02:04.144731+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.144731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:49.934859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.435606+0000","last_change":"2024-09-12T18:01:49.435606+0000","last_active":"2024-09-12T18:01:49.435606+0000","last_peered":"2024-09-12T18:01:49.435606+0000","last_clean":"2024-09-12T18:01:49.435606+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T18:01:49.435606+0000","last_undegraded":"2024-09-12T18:01:49.435606+0000","last_fullsized":"2024-09-12T18:01:49.435606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:49.435472+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:49.435472+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.435472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:46.329069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":252,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.422748+0000","last_change":"2024-09-12T18:01:45.422649+0000","last_active":"2024-09-12T18:01:45.422748+0000","last_peered":"2024-09-12T18:01:45.422748+0000","last_clean":"2024-09-12T18:01:45.422748+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T18:01:45.422748+0000","last_undegraded":"2024-09-12T18:01:45.422748+0000","last_fullsized":"2024-09-12T18:01:45.422748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'75","last_scrub_stamp":"2024-09-12T18:01:45.422564+0000","last_deep_scrub":"265'75","last_deep_scrub_stamp":"2024-09-12T18:01:45.422564+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.422564+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:13.649409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:43.146646+0000","last_change":"2024-09-12T17:49:56.040426+0000","last_active":"2024-09-12T17:59:43.146646+0000","last_peered":"2024-09-12T17:59:43.146646+0000","last_clean":"2024-09-12T17:59:43.146646+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T17:59:43.146646+0000","last_undegraded":"2024-09-12T17:59:43.146646+0000","last_fullsized":"2024-09-12T17:59:43.146646+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.161101+0000","last_change":"2024-09-12T18:02:02.161101+0000","last_active":"2024-09-12T18:02:02.161101+0000","last_peered":"2024-09-12T18:02:02.161101+0000","last_clean":"2024-09-12T18:02:02.161101+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T18:02:02.161101+0000","last_undegraded":"2024-09-12T18:02:02.161101+0000","last_fullsized":"2024-09-12T18:02:02.161101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:02:02.161017+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:02:02.161017+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.161017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:54.417853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.363414+0000","last_change":"2024-09-12T18:01:45.363414+0000","last_active":"2024-09-12T18:01:45.363414+0000","last_peered":"2024-09-12T18:01:45.363414+0000","last_clean":"2024-09-12T18:01:45.363414+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T18:01:45.363414+0000","last_undegraded":"2024-09-12T18:01:45.363414+0000","last_fullsized":"2024-09-12T18:01:45.363414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:01:45.363319+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:01:45.363319+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.363319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:36.948632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14340,"num_write":8,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.441701+0000","last_change":"2024-09-12T18:01:44.441641+0000","last_active":"2024-09-12T18:01:44.441701+0000","last_peered":"2024-09-12T18:01:44.441701+0000","last_clean":"2024-09-12T18:01:44.441701+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T18:01:44.441701+0000","last_undegraded":"2024-09-12T18:01:44.441701+0000","last_fullsized":"2024-09-12T18:01:44.441701+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T18:01:44.441557+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T18:01:44.441557+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.441557+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.141527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.393069+0000","last_change":"2024-09-12T18:02:00.393069+0000","last_active":"2024-09-12T18:02:00.393069+0000","last_peered":"2024-09-12T18:02:00.393069+0000","last_clean":"2024-09-12T18:02:00.393069+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T18:02:00.393069+0000","last_undegraded":"2024-09-12T18:02:00.393069+0000","last_fullsized":"2024-09-12T18:02:00.393069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.392972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.392972+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.392972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:48.780627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.765669+0000","last_change":"2024-09-12T18:01:41.765669+0000","last_active":"2024-09-12T18:01:41.765669+0000","last_peered":"2024-09-12T18:01:41.765669+0000","last_clean":"2024-09-12T18:01:41.765669+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T18:01:41.765669+0000","last_undegraded":"2024-09-12T18:01:41.765669+0000","last_fullsized":"2024-09-12T18:01:41.765669+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:41.765575+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:41.765575+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.765575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:26.223860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.236111+0000","last_change":"2024-09-12T18:01:54.236111+0000","last_active":"2024-09-12T18:01:54.236111+0000","last_peered":"2024-09-12T18:01:54.236111+0000","last_clean":"2024-09-12T18:01:54.236111+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T18:01:54.236111+0000","last_undegraded":"2024-09-12T18:01:54.236111+0000","last_fullsized":"2024-09-12T18:01:54.236111+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.235990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.235990+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.235990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:54.108643+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.421118+0000","last_change":"2024-09-12T18:01:47.421043+0000","last_active":"2024-09-12T18:01:47.421118+0000","last_peered":"2024-09-12T18:01:47.421118+0000","last_clean":"2024-09-12T18:01:47.421118+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T18:01:47.421118+0000","last_undegraded":"2024-09-12T18:01:47.421118+0000","last_fullsized":"2024-09-12T18:01:47.421118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T18:01:47.420962+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T18:01:47.420962+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.420962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:29.607129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.973470+0000","last_change":"2024-09-12T18:01:56.973470+0000","last_active":"2024-09-12T18:01:56.973470+0000","last_peered":"2024-09-12T18:01:56.973470+0000","last_clean":"2024-09-12T18:01:56.973470+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T18:01:56.973470+0000","last_undegraded":"2024-09-12T18:01:56.973470+0000","last_fullsized":"2024-09-12T18:01:56.973470+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:56.973343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:56.973343+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.973343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:47.525299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:00:32.038446+0000","last_change":"2024-09-12T17:38:47.024390+0000","last_active":"2024-09-12T18:00:32.038446+0000","last_peered":"2024-09-12T18:00:32.038446+0000","last_clean":"2024-09-12T18:00:32.038446+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T18:00:32.038446+0000","last_undegraded":"2024-09-12T18:00:32.038446+0000","last_fullsized":"2024-09-12T18:00:32.038446+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:38.074041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.977208+0000","last_change":"2024-09-12T18:02:09.977208+0000","last_active":"2024-09-12T18:02:09.977208+0000","last_peered":"2024-09-12T18:02:09.977208+0000","last_clean":"2024-09-12T18:02:09.977208+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T18:02:09.977208+0000","last_undegraded":"2024-09-12T18:02:09.977208+0000","last_fullsized":"2024-09-12T18:02:09.977208+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:02:09.977112+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:02:09.977112+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.977112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:28.981074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.940150+0000","last_change":"2024-09-12T18:01:41.940085+0000","last_active":"2024-09-12T18:01:41.940150+0000","last_peered":"2024-09-12T18:01:41.940150+0000","last_clean":"2024-09-12T18:01:41.940150+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T18:01:41.940150+0000","last_undegraded":"2024-09-12T18:01:41.940150+0000","last_fullsized":"2024-09-12T18:01:41.940150+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T18:01:41.939972+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T18:01:41.939972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.939972+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:03.309924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.027163+0000","last_change":"2024-09-12T18:01:54.027163+0000","last_active":"2024-09-12T18:01:54.027163+0000","last_peered":"2024-09-12T18:01:54.027163+0000","last_clean":"2024-09-12T18:01:54.027163+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T18:01:54.027163+0000","last_undegraded":"2024-09-12T18:01:54.027163+0000","last_fullsized":"2024-09-12T18:01:54.027163+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:54.027070+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:54.027070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.027070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:59.707415+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.945169+0000","last_change":"2024-09-12T18:01:49.945169+0000","last_active":"2024-09-12T18:01:49.945169+0000","last_peered":"2024-09-12T18:01:49.945169+0000","last_clean":"2024-09-12T18:01:49.945169+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T18:01:49.945169+0000","last_undegraded":"2024-09-12T18:01:49.945169+0000","last_fullsized":"2024-09-12T18:01:49.945169+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:49.945079+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:49.945079+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.945079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.788663+0000","last_change":"2024-09-12T18:01:36.788663+0000","last_active":"2024-09-12T18:01:36.788663+0000","last_peered":"2024-09-12T18:01:36.788663+0000","last_clean":"2024-09-12T18:01:36.788663+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T18:01:36.788663+0000","last_undegraded":"2024-09-12T18:01:36.788663+0000","last_fullsized":"2024-09-12T18:01:36.788663+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:36.788573+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:36.788573+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.788573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:40.438428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.396969+0000","last_change":"2024-09-12T18:01:43.396969+0000","last_active":"2024-09-12T18:01:43.396969+0000","last_peered":"2024-09-12T18:01:43.396969+0000","last_clean":"2024-09-12T18:01:43.396969+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T18:01:43.396969+0000","last_undegraded":"2024-09-12T18:01:43.396969+0000","last_fullsized":"2024-09-12T18:01:43.396969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T18:01:43.396878+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T18:01:43.396878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.396878+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:50.986361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.779233+0000","last_change":"2024-09-12T18:01:45.779233+0000","last_active":"2024-09-12T18:01:45.779233+0000","last_peered":"2024-09-12T18:01:45.779233+0000","last_clean":"2024-09-12T18:01:45.779233+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T18:01:45.779233+0000","last_undegraded":"2024-09-12T18:01:45.779233+0000","last_fullsized":"2024-09-12T18:01:45.779233+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.779139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.779139+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.779139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:32.530508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'10","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.438630+0000","last_change":"2024-09-12T18:01:57.438630+0000","last_active":"2024-09-12T18:01:57.438630+0000","last_peered":"2024-09-12T18:01:57.438630+0000","last_clean":"2024-09-12T18:01:57.438630+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T18:01:57.438630+0000","last_undegraded":"2024-09-12T18:01:57.438630+0000","last_fullsized":"2024-09-12T18:01:57.438630+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:57.438539+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:57.438539+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.438539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13320,"num_write":20,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'10","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.399508+0000","last_change":"2024-09-12T18:01:49.399508+0000","last_active":"2024-09-12T18:01:49.399508+0000","last_peered":"2024-09-12T18:01:49.399508+0000","last_clean":"2024-09-12T18:01:49.399508+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T18:01:49.399508+0000","last_undegraded":"2024-09-12T18:01:49.399508+0000","last_fullsized":"2024-09-12T18:01:49.399508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:49.399427+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:49.399427+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.399427+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:05.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15362,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.466682+0000","last_change":"2024-09-12T18:01:43.466682+0000","last_active":"2024-09-12T18:01:43.466682+0000","last_peered":"2024-09-12T18:01:43.466682+0000","last_clean":"2024-09-12T18:01:43.466682+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T18:01:43.466682+0000","last_undegraded":"2024-09-12T18:01:43.466682+0000","last_fullsized":"2024-09-12T18:01:43.466682+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T18:01:43.466578+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T18:01:43.466578+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.466578+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:45.668613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.096430+0000","last_change":"2024-09-12T18:02:07.096430+0000","last_active":"2024-09-12T18:02:07.096430+0000","last_peered":"2024-09-12T18:02:07.096430+0000","last_clean":"2024-09-12T18:02:07.096430+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T18:02:07.096430+0000","last_undegraded":"2024-09-12T18:02:07.096430+0000","last_fullsized":"2024-09-12T18:02:07.096430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:07.096342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:07.096342+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.096342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:53.956386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.412442+0000","last_change":"2024-09-12T18:01:56.412442+0000","last_active":"2024-09-12T18:01:56.412442+0000","last_peered":"2024-09-12T18:01:56.412442+0000","last_clean":"2024-09-12T18:01:56.412442+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T18:01:56.412442+0000","last_undegraded":"2024-09-12T18:01:56.412442+0000","last_fullsized":"2024-09-12T18:01:56.412442+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:56.412316+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:56.412316+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.412316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:49.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'11","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.977252+0000","last_change":"2024-09-12T18:02:07.977186+0000","last_active":"2024-09-12T18:02:07.977252+0000","last_peered":"2024-09-12T18:02:07.977252+0000","last_clean":"2024-09-12T18:02:07.977252+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T18:02:07.977252+0000","last_undegraded":"2024-09-12T18:02:07.977252+0000","last_fullsized":"2024-09-12T18:02:07.977252+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T18:02:07.977090+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T18:02:07.977090+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.977090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:23.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4710,"num_write":16,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'114","reported_seq":398,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.081077+0000","last_change":"2024-09-12T18:01:50.081077+0000","last_active":"2024-09-12T18:01:50.081077+0000","last_peered":"2024-09-12T18:01:50.081077+0000","last_clean":"2024-09-12T18:01:50.081077+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T18:01:50.081077+0000","last_undegraded":"2024-09-12T18:01:50.081077+0000","last_fullsized":"2024-09-12T18:01:50.081077+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-12T18:01:50.080996+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-12T18:01:50.080996+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.080996+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:28.879363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4008,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.397225+0000","last_change":"2024-09-12T18:01:51.397225+0000","last_active":"2024-09-12T18:01:51.397225+0000","last_peered":"2024-09-12T18:01:51.397225+0000","last_clean":"2024-09-12T18:01:51.397225+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T18:01:51.397225+0000","last_undegraded":"2024-09-12T18:01:51.397225+0000","last_fullsized":"2024-09-12T18:01:51.397225+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:51.397128+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:51.397128+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.397128+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.464821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.177967+0000","last_change":"2024-09-12T18:02:01.177967+0000","last_active":"2024-09-12T18:02:01.177967+0000","last_peered":"2024-09-12T18:02:01.177967+0000","last_clean":"2024-09-12T18:02:01.177967+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T18:02:01.177967+0000","last_undegraded":"2024-09-12T18:02:01.177967+0000","last_fullsized":"2024-09-12T18:02:01.177967+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.177878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.177878+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.177878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:29.425721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.844260+0000","last_change":"2024-09-12T18:01:34.844260+0000","last_active":"2024-09-12T18:01:34.844260+0000","last_peered":"2024-09-12T18:01:34.844260+0000","last_clean":"2024-09-12T18:01:34.844260+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T18:01:34.844260+0000","last_undegraded":"2024-09-12T18:01:34.844260+0000","last_fullsized":"2024-09-12T18:01:34.844260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:34.844131+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:34.844131+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.844131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:48.050356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":97,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.035020+0000","last_change":"2024-09-12T18:01:49.035020+0000","last_active":"2024-09-12T18:01:49.035020+0000","last_peered":"2024-09-12T18:01:49.035020+0000","last_clean":"2024-09-12T18:01:49.035020+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T18:01:49.035020+0000","last_undegraded":"2024-09-12T18:01:49.035020+0000","last_fullsized":"2024-09-12T18:01:49.035020+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T18:01:49.034925+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T18:01:49.034925+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.034925+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:05.277954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.995847+0000","last_change":"2024-09-12T18:01:52.995847+0000","last_active":"2024-09-12T18:01:52.995847+0000","last_peered":"2024-09-12T18:01:52.995847+0000","last_clean":"2024-09-12T18:01:52.995847+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T18:01:52.995847+0000","last_undegraded":"2024-09-12T18:01:52.995847+0000","last_fullsized":"2024-09-12T18:01:52.995847+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:52.995758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:52.995758+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.995758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:00.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.438797+0000","last_change":"2024-09-12T18:01:55.438797+0000","last_active":"2024-09-12T18:01:55.438797+0000","last_peered":"2024-09-12T18:01:55.438797+0000","last_clean":"2024-09-12T18:01:55.438797+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T18:01:55.438797+0000","last_undegraded":"2024-09-12T18:01:55.438797+0000","last_fullsized":"2024-09-12T18:01:55.438797+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.438702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.438702+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.438702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:06.604850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.459283+0000","last_change":"2024-09-12T18:01:48.459283+0000","last_active":"2024-09-12T18:01:48.459283+0000","last_peered":"2024-09-12T18:01:48.459283+0000","last_clean":"2024-09-12T18:01:48.459283+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T18:01:48.459283+0000","last_undegraded":"2024-09-12T18:01:48.459283+0000","last_fullsized":"2024-09-12T18:01:48.459283+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:48.459191+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:48.459191+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.459191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:58.450160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.374692+0000","last_change":"2024-09-12T18:01:42.374692+0000","last_active":"2024-09-12T18:01:42.374692+0000","last_peered":"2024-09-12T18:01:42.374692+0000","last_clean":"2024-09-12T18:01:42.374692+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T18:01:42.374692+0000","last_undegraded":"2024-09-12T18:01:42.374692+0000","last_fullsized":"2024-09-12T18:01:42.374692+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:42.374606+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:42.374606+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.374606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:52.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.794472+0000","last_change":"2024-09-12T18:01:44.794472+0000","last_active":"2024-09-12T18:01:44.794472+0000","last_peered":"2024-09-12T18:01:44.794472+0000","last_clean":"2024-09-12T18:01:44.794472+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T18:01:44.794472+0000","last_undegraded":"2024-09-12T18:01:44.794472+0000","last_fullsized":"2024-09-12T18:01:44.794472+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:44.794380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:44.794380+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.794380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:24.341962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.725963+0000","last_change":"2024-09-12T18:01:40.725963+0000","last_active":"2024-09-12T18:01:40.725963+0000","last_peered":"2024-09-12T18:01:40.725963+0000","last_clean":"2024-09-12T18:01:40.725963+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T18:01:40.725963+0000","last_undegraded":"2024-09-12T18:01:40.725963+0000","last_fullsized":"2024-09-12T18:01:40.725963+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:40.725867+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:40.725867+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.725867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.564911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.216857+0000","last_change":"2024-09-12T18:01:53.216857+0000","last_active":"2024-09-12T18:01:53.216857+0000","last_peered":"2024-09-12T18:01:53.216857+0000","last_clean":"2024-09-12T18:01:53.216857+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T18:01:53.216857+0000","last_undegraded":"2024-09-12T18:01:53.216857+0000","last_fullsized":"2024-09-12T18:01:53.216857+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:53.216755+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:53.216755+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.216755+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:12.788181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.887398+0000","last_change":"2024-09-12T18:01:59.887398+0000","last_active":"2024-09-12T18:01:59.887398+0000","last_peered":"2024-09-12T18:01:59.887398+0000","last_clean":"2024-09-12T18:01:59.887398+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T18:01:59.887398+0000","last_undegraded":"2024-09-12T18:01:59.887398+0000","last_fullsized":"2024-09-12T18:01:59.887398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T18:01:59.887299+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T18:01:59.887299+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.887299+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:46.634027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.146024+0000","last_change":"2024-09-12T17:49:56.042508+0000","last_active":"2024-09-12T17:59:38.146024+0000","last_peered":"2024-09-12T17:59:38.146024+0000","last_clean":"2024-09-12T17:59:38.146024+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T17:59:38.146024+0000","last_undegraded":"2024-09-12T17:59:38.146024+0000","last_fullsized":"2024-09-12T17:59:38.146024+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.195125+0000","last_change":"2024-09-12T18:02:00.195062+0000","last_active":"2024-09-12T18:02:00.195125+0000","last_peered":"2024-09-12T18:02:00.195125+0000","last_clean":"2024-09-12T18:02:00.195125+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T18:02:00.195125+0000","last_undegraded":"2024-09-12T18:02:00.195125+0000","last_fullsized":"2024-09-12T18:02:00.195125+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.194974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.194974+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.194974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:00.089360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.336398+0000","last_change":"2024-09-12T18:01:42.336334+0000","last_active":"2024-09-12T18:01:42.336398+0000","last_peered":"2024-09-12T18:01:42.336398+0000","last_clean":"2024-09-12T18:01:42.336398+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T18:01:42.336398+0000","last_undegraded":"2024-09-12T18:01:42.336398+0000","last_fullsized":"2024-09-12T18:01:42.336398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.336239+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:19.424553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.911445+0000","last_change":"2024-09-12T18:02:00.911445+0000","last_active":"2024-09-12T18:02:00.911445+0000","last_peered":"2024-09-12T18:02:00.911445+0000","last_clean":"2024-09-12T18:02:00.911445+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T18:02:00.911445+0000","last_undegraded":"2024-09-12T18:02:00.911445+0000","last_fullsized":"2024-09-12T18:02:00.911445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T18:02:00.911312+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T18:02:00.911312+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.911312+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:38.429833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.362372+0000","last_change":"2024-09-12T18:01:54.362312+0000","last_active":"2024-09-12T18:01:54.362372+0000","last_peered":"2024-09-12T18:01:54.362372+0000","last_clean":"2024-09-12T18:01:54.362372+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T18:01:54.362372+0000","last_undegraded":"2024-09-12T18:01:54.362372+0000","last_fullsized":"2024-09-12T18:01:54.362372+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.362223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.362223+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.362223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:36.799495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'11","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.218700+0000","last_change":"2024-09-12T18:01:59.218615+0000","last_active":"2024-09-12T18:01:59.218700+0000","last_peered":"2024-09-12T18:01:59.218700+0000","last_clean":"2024-09-12T18:01:59.218700+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T18:01:59.218700+0000","last_undegraded":"2024-09-12T18:01:59.218700+0000","last_fullsized":"2024-09-12T18:01:59.218700+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T18:01:59.218508+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T18:01:59.218508+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.218508+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.930045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10258,"num_write":16,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.192009+0000","last_change":"2024-09-12T18:01:52.191903+0000","last_active":"2024-09-12T18:01:52.192009+0000","last_peered":"2024-09-12T18:01:52.192009+0000","last_clean":"2024-09-12T18:01:52.192009+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T18:01:52.192009+0000","last_undegraded":"2024-09-12T18:01:52.192009+0000","last_fullsized":"2024-09-12T18:01:52.192009+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:01:52.191803+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:01:52.191803+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.191803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:19.402169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.334479+0000","last_change":"2024-09-12T18:01:41.334479+0000","last_active":"2024-09-12T18:01:41.334479+0000","last_peered":"2024-09-12T18:01:41.334479+0000","last_clean":"2024-09-12T18:01:41.334479+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T18:01:41.334479+0000","last_undegraded":"2024-09-12T18:01:41.334479+0000","last_fullsized":"2024-09-12T18:01:41.334479+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T18:01:41.334373+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T18:01:41.334373+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.334373+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:02.278105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.015386+0000","last_change":"2024-09-12T18:01:56.015386+0000","last_active":"2024-09-12T18:01:56.015386+0000","last_peered":"2024-09-12T18:01:56.015386+0000","last_clean":"2024-09-12T18:01:56.015386+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T18:01:56.015386+0000","last_undegraded":"2024-09-12T18:01:56.015386+0000","last_fullsized":"2024-09-12T18:01:56.015386+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:56.015281+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:56.015281+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.015281+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:15.348681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.388179+0000","last_change":"2024-09-12T18:01:53.388122+0000","last_active":"2024-09-12T18:01:53.388179+0000","last_peered":"2024-09-12T18:01:53.388179+0000","last_clean":"2024-09-12T18:01:53.388179+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T18:01:53.388179+0000","last_undegraded":"2024-09-12T18:01:53.388179+0000","last_fullsized":"2024-09-12T18:01:53.388179+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:53.388035+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:53.388035+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.388035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:13.787528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.383609+0000","last_change":"2024-09-12T18:01:43.383540+0000","last_active":"2024-09-12T18:01:43.383609+0000","last_peered":"2024-09-12T18:01:43.383609+0000","last_clean":"2024-09-12T18:01:43.383609+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T18:01:43.383609+0000","last_undegraded":"2024-09-12T18:01:43.383609+0000","last_fullsized":"2024-09-12T18:01:43.383609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:43.383441+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:43.383441+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.383441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:20.540473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.998149+0000","last_change":"2024-09-12T18:01:39.998149+0000","last_active":"2024-09-12T18:01:39.998149+0000","last_peered":"2024-09-12T18:01:39.998149+0000","last_clean":"2024-09-12T18:01:39.998149+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T18:01:39.998149+0000","last_undegraded":"2024-09-12T18:01:39.998149+0000","last_fullsized":"2024-09-12T18:01:39.998149+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:01:39.998052+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:01:39.998052+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.998052+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:42.987824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.387646+0000","last_change":"2024-09-12T18:01:52.387587+0000","last_active":"2024-09-12T18:01:52.387646+0000","last_peered":"2024-09-12T18:01:52.387646+0000","last_clean":"2024-09-12T18:01:52.387646+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T18:01:52.387646+0000","last_undegraded":"2024-09-12T18:01:52.387646+0000","last_fullsized":"2024-09-12T18:01:52.387646+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:52.387504+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:52.387504+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.387504+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:00.384626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'4","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:03.110588+0000","last_change":"2024-09-12T17:38:47.019373+0000","last_active":"2024-09-12T18:01:03.110588+0000","last_peered":"2024-09-12T18:01:03.110588+0000","last_clean":"2024-09-12T18:01:03.110588+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T18:01:03.110588+0000","last_undegraded":"2024-09-12T18:01:03.110588+0000","last_fullsized":"2024-09-12T18:01:03.110588+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.371207+0000","last_change":"2024-09-12T18:01:44.371144+0000","last_active":"2024-09-12T18:01:44.371207+0000","last_peered":"2024-09-12T18:01:44.371207+0000","last_clean":"2024-09-12T18:01:44.371207+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T18:01:44.371207+0000","last_undegraded":"2024-09-12T18:01:44.371207+0000","last_fullsized":"2024-09-12T18:01:44.371207+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:44.371039+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:44.371039+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.371039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:56.350409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":213,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.356142+0000","last_change":"2024-09-12T18:01:40.356142+0000","last_active":"2024-09-12T18:01:40.356142+0000","last_peered":"2024-09-12T18:01:40.356142+0000","last_clean":"2024-09-12T18:01:40.356142+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T18:01:40.356142+0000","last_undegraded":"2024-09-12T18:01:40.356142+0000","last_fullsized":"2024-09-12T18:01:40.356142+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T18:01:40.356044+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T18:01:40.356044+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.356044+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:32.536982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.085511+0000","last_change":"2024-09-12T18:02:06.085511+0000","last_active":"2024-09-12T18:02:06.085511+0000","last_peered":"2024-09-12T18:02:06.085511+0000","last_clean":"2024-09-12T18:02:06.085511+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T18:02:06.085511+0000","last_undegraded":"2024-09-12T18:02:06.085511+0000","last_fullsized":"2024-09-12T18:02:06.085511+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:06.085424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:06.085424+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.085424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:10.985888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.389191+0000","last_change":"2024-09-12T18:01:52.389191+0000","last_active":"2024-09-12T18:01:52.389191+0000","last_peered":"2024-09-12T18:01:52.389191+0000","last_clean":"2024-09-12T18:01:52.389191+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T18:01:52.389191+0000","last_undegraded":"2024-09-12T18:01:52.389191+0000","last_fullsized":"2024-09-12T18:01:52.389191+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:52.389094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:52.389094+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.389094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:22.884023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.975186+0000","last_change":"2024-09-12T18:01:44.975186+0000","last_active":"2024-09-12T18:01:44.975186+0000","last_peered":"2024-09-12T18:01:44.975186+0000","last_clean":"2024-09-12T18:01:44.975186+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T18:01:44.975186+0000","last_undegraded":"2024-09-12T18:01:44.975186+0000","last_fullsized":"2024-09-12T18:01:44.975186+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:44.975076+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:44.975076+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.975076+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:08.064118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.348551+0000","last_change":"2024-09-12T18:01:39.348463+0000","last_active":"2024-09-12T18:01:39.348551+0000","last_peered":"2024-09-12T18:01:39.348551+0000","last_clean":"2024-09-12T18:01:39.348551+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T18:01:39.348551+0000","last_undegraded":"2024-09-12T18:01:39.348551+0000","last_fullsized":"2024-09-12T18:01:39.348551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:39.348369+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:39.348369+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.348369+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.540420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.298028+0000","last_change":"2024-09-12T18:01:48.298028+0000","last_active":"2024-09-12T18:01:48.298028+0000","last_peered":"2024-09-12T18:01:48.298028+0000","last_clean":"2024-09-12T18:01:48.298028+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T18:01:48.298028+0000","last_undegraded":"2024-09-12T18:01:48.298028+0000","last_fullsized":"2024-09-12T18:01:48.298028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:48.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:48.297939+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.297939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:34.814551+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.396829+0000","last_change":"2024-09-12T18:01:51.396829+0000","last_active":"2024-09-12T18:01:51.396829+0000","last_peered":"2024-09-12T18:01:51.396829+0000","last_clean":"2024-09-12T18:01:51.396829+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T18:01:51.396829+0000","last_undegraded":"2024-09-12T18:01:51.396829+0000","last_fullsized":"2024-09-12T18:01:51.396829+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:51.396721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:51.396721+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.396721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:48.332576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.409159+0000","last_change":"2024-09-12T18:01:48.409159+0000","last_active":"2024-09-12T18:01:48.409159+0000","last_peered":"2024-09-12T18:01:48.409159+0000","last_clean":"2024-09-12T18:01:48.409159+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T18:01:48.409159+0000","last_undegraded":"2024-09-12T18:01:48.409159+0000","last_fullsized":"2024-09-12T18:01:48.409159+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:48.409049+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:48.409049+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.409049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:40.718374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":185,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.988503+0000","last_change":"2024-09-12T18:02:08.988503+0000","last_active":"2024-09-12T18:02:08.988503+0000","last_peered":"2024-09-12T18:02:08.988503+0000","last_clean":"2024-09-12T18:02:08.988503+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T18:02:08.988503+0000","last_undegraded":"2024-09-12T18:02:08.988503+0000","last_fullsized":"2024-09-12T18:02:08.988503+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T18:02:08.988408+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T18:02:08.988408+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.988408+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:32.079215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:37.023058+0000","last_change":"2024-09-12T17:49:56.036894+0000","last_active":"2024-09-12T17:58:37.023058+0000","last_peered":"2024-09-12T17:58:37.023058+0000","last_clean":"2024-09-12T17:58:37.023058+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T17:58:37.023058+0000","last_undegraded":"2024-09-12T17:58:37.023058+0000","last_fullsized":"2024-09-12T17:58:37.023058+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:30.781444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'10","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.433072+0000","last_change":"2024-09-12T18:01:54.433072+0000","last_active":"2024-09-12T18:01:54.433072+0000","last_peered":"2024-09-12T18:01:54.433072+0000","last_clean":"2024-09-12T18:01:54.433072+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T18:01:54.433072+0000","last_undegraded":"2024-09-12T18:01:54.433072+0000","last_fullsized":"2024-09-12T18:01:54.433072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:54.432982+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:54.432982+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.432982+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:26.938639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15452,"num_write":10,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.408330+0000","last_change":"2024-09-12T18:01:45.408330+0000","last_active":"2024-09-12T18:01:45.408330+0000","last_peered":"2024-09-12T18:01:45.408330+0000","last_clean":"2024-09-12T18:01:45.408330+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T18:01:45.408330+0000","last_undegraded":"2024-09-12T18:01:45.408330+0000","last_fullsized":"2024-09-12T18:01:45.408330+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:45.408246+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:45.408246+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.408246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:45.591221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4108,"num_write":6,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.347215+0000","last_change":"2024-09-12T18:01:40.347107+0000","last_active":"2024-09-12T18:01:40.347215+0000","last_peered":"2024-09-12T18:01:40.347215+0000","last_clean":"2024-09-12T18:01:40.347215+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T18:01:40.347215+0000","last_undegraded":"2024-09-12T18:01:40.347215+0000","last_fullsized":"2024-09-12T18:01:40.347215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-12T18:01:40.346985+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-12T18:01:40.346985+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.346985+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:14.853137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.326522+0000","last_change":"2024-09-12T18:01:47.326522+0000","last_active":"2024-09-12T18:01:47.326522+0000","last_peered":"2024-09-12T18:01:47.326522+0000","last_clean":"2024-09-12T18:01:47.326522+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T18:01:47.326522+0000","last_undegraded":"2024-09-12T18:01:47.326522+0000","last_fullsized":"2024-09-12T18:01:47.326522+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.326399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.326399+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.326399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:07.862192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.178782+0000","last_change":"2024-09-12T18:01:58.178782+0000","last_active":"2024-09-12T18:01:58.178782+0000","last_peered":"2024-09-12T18:01:58.178782+0000","last_clean":"2024-09-12T18:01:58.178782+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T18:01:58.178782+0000","last_undegraded":"2024-09-12T18:01:58.178782+0000","last_fullsized":"2024-09-12T18:01:58.178782+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:58.178658+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:58.178658+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.178658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:27.715332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11258,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.435473+0000","last_change":"2024-09-12T18:01:47.435473+0000","last_active":"2024-09-12T18:01:47.435473+0000","last_peered":"2024-09-12T18:01:47.435473+0000","last_clean":"2024-09-12T18:01:47.435473+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T18:01:47.435473+0000","last_undegraded":"2024-09-12T18:01:47.435473+0000","last_fullsized":"2024-09-12T18:01:47.435473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.435362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.435362+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.435362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:08.488931+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.440742+0000","last_change":"2024-09-12T18:01:42.440685+0000","last_active":"2024-09-12T18:01:42.440742+0000","last_peered":"2024-09-12T18:01:42.440742+0000","last_clean":"2024-09-12T18:01:42.440742+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T18:01:42.440742+0000","last_undegraded":"2024-09-12T18:01:42.440742+0000","last_fullsized":"2024-09-12T18:01:42.440742+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:42.440599+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:42.440599+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.440599+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:45.997961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.136868+0000","last_change":"2024-09-12T18:02:08.136868+0000","last_active":"2024-09-12T18:02:08.136868+0000","last_peered":"2024-09-12T18:02:08.136868+0000","last_clean":"2024-09-12T18:02:08.136868+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T18:02:08.136868+0000","last_undegraded":"2024-09-12T18:02:08.136868+0000","last_fullsized":"2024-09-12T18:02:08.136868+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.136761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.136761+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.136761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:52.637236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020855+0000","last_change":"2024-09-12T17:38:47.020511+0000","last_active":"2024-09-12T17:58:17.020855+0000","last_peered":"2024-09-12T17:58:17.020855+0000","last_clean":"2024-09-12T17:58:17.020855+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T17:58:17.020855+0000","last_undegraded":"2024-09-12T17:58:17.020855+0000","last_fullsized":"2024-09-12T17:58:17.020855+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:45.990721+0000","last_clean_scrub_stamp":"2024-09-12T17:38:45.990721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.015103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.402238+0000","last_change":"2024-09-12T18:01:46.402238+0000","last_active":"2024-09-12T18:01:46.402238+0000","last_peered":"2024-09-12T18:01:46.402238+0000","last_clean":"2024-09-12T18:01:46.402238+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T18:01:46.402238+0000","last_undegraded":"2024-09-12T18:01:46.402238+0000","last_fullsized":"2024-09-12T18:01:46.402238+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:46.402155+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:46.402155+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.402155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:08.664363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.429518+0000","last_change":"2024-09-12T18:01:40.429459+0000","last_active":"2024-09-12T18:01:40.429518+0000","last_peered":"2024-09-12T18:01:40.429518+0000","last_clean":"2024-09-12T18:01:40.429518+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T18:01:40.429518+0000","last_undegraded":"2024-09-12T18:01:40.429518+0000","last_fullsized":"2024-09-12T18:01:40.429518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:40.429380+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:40.429380+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.429380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:15.701071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.001108+0000","last_change":"2024-09-12T18:01:52.001108+0000","last_active":"2024-09-12T18:01:52.001108+0000","last_peered":"2024-09-12T18:01:52.001108+0000","last_clean":"2024-09-12T18:01:52.001108+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T18:01:52.001108+0000","last_undegraded":"2024-09-12T18:01:52.001108+0000","last_fullsized":"2024-09-12T18:01:52.001108+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:52.001010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:52.001010+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.001010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:47.622634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.993924+0000","last_change":"2024-09-12T18:01:48.993924+0000","last_active":"2024-09-12T18:01:48.993924+0000","last_peered":"2024-09-12T18:01:48.993924+0000","last_clean":"2024-09-12T18:01:48.993924+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T18:01:48.993924+0000","last_undegraded":"2024-09-12T18:01:48.993924+0000","last_fullsized":"2024-09-12T18:01:48.993924+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:48.993817+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:48.993817+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.993817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:40.189737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.197500+0000","last_change":"2024-09-12T18:01:51.197500+0000","last_active":"2024-09-12T18:01:51.197500+0000","last_peered":"2024-09-12T18:01:51.197500+0000","last_clean":"2024-09-12T18:01:51.197500+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T18:01:51.197500+0000","last_undegraded":"2024-09-12T18:01:51.197500+0000","last_fullsized":"2024-09-12T18:01:51.197500+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:51.197409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:51.197409+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.197409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:31.709331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.007253+0000","last_change":"2024-09-12T18:01:38.007253+0000","last_active":"2024-09-12T18:01:38.007253+0000","last_peered":"2024-09-12T18:01:38.007253+0000","last_clean":"2024-09-12T18:01:38.007253+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T18:01:38.007253+0000","last_undegraded":"2024-09-12T18:01:38.007253+0000","last_fullsized":"2024-09-12T18:01:38.007253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T18:01:38.007151+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T18:01:38.007151+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.007151+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:36.080873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.827854+0000","last_change":"2024-09-12T18:01:43.827854+0000","last_active":"2024-09-12T18:01:43.827854+0000","last_peered":"2024-09-12T18:01:43.827854+0000","last_clean":"2024-09-12T18:01:43.827854+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T18:01:43.827854+0000","last_undegraded":"2024-09-12T18:01:43.827854+0000","last_fullsized":"2024-09-12T18:01:43.827854+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:43.827751+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:43.827751+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.827751+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.232289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.382817+0000","last_change":"2024-09-12T18:01:50.382817+0000","last_active":"2024-09-12T18:01:50.382817+0000","last_peered":"2024-09-12T18:01:50.382817+0000","last_clean":"2024-09-12T18:01:50.382817+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T18:01:50.382817+0000","last_undegraded":"2024-09-12T18:01:50.382817+0000","last_fullsized":"2024-09-12T18:01:50.382817+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:50.382712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:50.382712+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.382712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:50.956710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'9","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.369700+0000","last_change":"2024-09-12T18:01:44.369700+0000","last_active":"2024-09-12T18:01:44.369700+0000","last_peered":"2024-09-12T18:01:44.369700+0000","last_clean":"2024-09-12T18:01:44.369700+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T18:01:44.369700+0000","last_undegraded":"2024-09-12T18:01:44.369700+0000","last_fullsized":"2024-09-12T18:01:44.369700+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T18:01:44.369597+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T18:01:44.369597+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.369597+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.678045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":170,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.166560+0000","last_change":"2024-09-12T18:01:50.166560+0000","last_active":"2024-09-12T18:01:50.166560+0000","last_peered":"2024-09-12T18:01:50.166560+0000","last_clean":"2024-09-12T18:01:50.166560+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T18:01:50.166560+0000","last_undegraded":"2024-09-12T18:01:50.166560+0000","last_fullsized":"2024-09-12T18:01:50.166560+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T18:01:50.166480+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T18:01:50.166480+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.166480+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.307474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.432045+0000","last_change":"2024-09-12T18:01:59.432045+0000","last_active":"2024-09-12T18:01:59.432045+0000","last_peered":"2024-09-12T18:01:59.432045+0000","last_clean":"2024-09-12T18:01:59.432045+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T18:01:59.432045+0000","last_undegraded":"2024-09-12T18:01:59.432045+0000","last_fullsized":"2024-09-12T18:01:59.432045+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:59.431956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:59.431956+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.431956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.710188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.749932+0000","last_change":"2024-09-12T18:01:39.749932+0000","last_active":"2024-09-12T18:01:39.749932+0000","last_peered":"2024-09-12T18:01:39.749932+0000","last_clean":"2024-09-12T18:01:39.749932+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T18:01:39.749932+0000","last_undegraded":"2024-09-12T18:01:39.749932+0000","last_fullsized":"2024-09-12T18:01:39.749932+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:01:39.749836+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:01:39.749836+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.749836+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:48.388934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.892447+0000","last_change":"2024-09-12T18:02:05.892447+0000","last_active":"2024-09-12T18:02:05.892447+0000","last_peered":"2024-09-12T18:02:05.892447+0000","last_clean":"2024-09-12T18:02:05.892447+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T18:02:05.892447+0000","last_undegraded":"2024-09-12T18:02:05.892447+0000","last_fullsized":"2024-09-12T18:02:05.892447+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:02:05.892358+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:02:05.892358+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.892358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:16.771372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.760333+0000","last_change":"2024-09-12T18:01:38.760333+0000","last_active":"2024-09-12T18:01:38.760333+0000","last_peered":"2024-09-12T18:01:38.760333+0000","last_clean":"2024-09-12T18:01:38.760333+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T18:01:38.760333+0000","last_undegraded":"2024-09-12T18:01:38.760333+0000","last_fullsized":"2024-09-12T18:01:38.760333+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'24","last_scrub_stamp":"2024-09-12T18:01:38.760231+0000","last_deep_scrub":"265'24","last_deep_scrub_stamp":"2024-09-12T18:01:38.760231+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.760231+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:14.745699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.777247+0000","last_change":"2024-09-12T18:01:42.777247+0000","last_active":"2024-09-12T18:01:42.777247+0000","last_peered":"2024-09-12T18:01:42.777247+0000","last_clean":"2024-09-12T18:01:42.777247+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T18:01:42.777247+0000","last_undegraded":"2024-09-12T18:01:42.777247+0000","last_fullsized":"2024-09-12T18:01:42.777247+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.777148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.777148+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.777148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:23.964598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.228062+0000","last_change":"2024-09-12T18:01:57.228062+0000","last_active":"2024-09-12T18:01:57.228062+0000","last_peered":"2024-09-12T18:01:57.228062+0000","last_clean":"2024-09-12T18:01:57.228062+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T18:01:57.228062+0000","last_undegraded":"2024-09-12T18:01:57.228062+0000","last_fullsized":"2024-09-12T18:01:57.228062+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:01:57.227971+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:01:57.227971+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.227971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:49.921746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.878269+0000","last_change":"2024-09-12T18:02:03.878269+0000","last_active":"2024-09-12T18:02:03.878269+0000","last_peered":"2024-09-12T18:02:03.878269+0000","last_clean":"2024-09-12T18:02:03.878269+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T18:02:03.878269+0000","last_undegraded":"2024-09-12T18:02:03.878269+0000","last_fullsized":"2024-09-12T18:02:03.878269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:03.878167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:03.878167+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.878167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:15.249606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.989848+0000","last_change":"2024-09-12T18:01:47.989848+0000","last_active":"2024-09-12T18:01:47.989848+0000","last_peered":"2024-09-12T18:01:47.989848+0000","last_clean":"2024-09-12T18:01:47.989848+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T18:01:47.989848+0000","last_undegraded":"2024-09-12T18:01:47.989848+0000","last_fullsized":"2024-09-12T18:01:47.989848+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:47.989757+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:47.989757+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.989757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:08.427256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.808365+0000","last_change":"2024-09-12T18:01:47.808365+0000","last_active":"2024-09-12T18:01:47.808365+0000","last_peered":"2024-09-12T18:01:47.808365+0000","last_clean":"2024-09-12T18:01:47.808365+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T18:01:47.808365+0000","last_undegraded":"2024-09-12T18:01:47.808365+0000","last_fullsized":"2024-09-12T18:01:47.808365+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.808273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.808273+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.808273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:07.073318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.205191+0000","last_change":"2024-09-12T18:01:56.205191+0000","last_active":"2024-09-12T18:01:56.205191+0000","last_peered":"2024-09-12T18:01:56.205191+0000","last_clean":"2024-09-12T18:01:56.205191+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T18:01:56.205191+0000","last_undegraded":"2024-09-12T18:01:56.205191+0000","last_fullsized":"2024-09-12T18:01:56.205191+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:01:56.205090+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:01:56.205090+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.205090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:14.305833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.076090+0000","last_change":"2024-09-12T18:01:53.076090+0000","last_active":"2024-09-12T18:01:53.076090+0000","last_peered":"2024-09-12T18:01:53.076090+0000","last_clean":"2024-09-12T18:01:53.076090+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T18:01:53.076090+0000","last_undegraded":"2024-09-12T18:01:53.076090+0000","last_fullsized":"2024-09-12T18:01:53.076090+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:01:53.075965+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:01:53.075965+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.075965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:35.731940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.932464+0000","last_change":"2024-09-12T18:02:06.932464+0000","last_active":"2024-09-12T18:02:06.932464+0000","last_peered":"2024-09-12T18:02:06.932464+0000","last_clean":"2024-09-12T18:02:06.932464+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T18:02:06.932464+0000","last_undegraded":"2024-09-12T18:02:06.932464+0000","last_fullsized":"2024-09-12T18:02:06.932464+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T18:02:06.932362+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T18:02:06.932362+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.932362+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:03.340200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.149077+0000","last_change":"2024-09-12T18:02:03.149022+0000","last_active":"2024-09-12T18:02:03.149077+0000","last_peered":"2024-09-12T18:02:03.149077+0000","last_clean":"2024-09-12T18:02:03.149077+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T18:02:03.149077+0000","last_undegraded":"2024-09-12T18:02:03.149077+0000","last_fullsized":"2024-09-12T18:02:03.149077+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:03.148933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:03.148933+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.148933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:05.274994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.761849+0000","last_change":"2024-09-12T18:01:37.761849+0000","last_active":"2024-09-12T18:01:37.761849+0000","last_peered":"2024-09-12T18:01:37.761849+0000","last_clean":"2024-09-12T18:01:37.761849+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T18:01:37.761849+0000","last_undegraded":"2024-09-12T18:01:37.761849+0000","last_fullsized":"2024-09-12T18:01:37.761849+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:37.761746+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:37.761746+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.761746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:15.257841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.937998+0000","last_change":"2024-09-12T18:01:45.937998+0000","last_active":"2024-09-12T18:01:45.937998+0000","last_peered":"2024-09-12T18:01:45.937998+0000","last_clean":"2024-09-12T18:01:45.937998+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T18:01:45.937998+0000","last_undegraded":"2024-09-12T18:01:45.937998+0000","last_fullsized":"2024-09-12T18:01:45.937998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.937900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.937900+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.937900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:45.515046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.035068+0000","last_change":"2024-09-12T18:01:37.035068+0000","last_active":"2024-09-12T18:01:37.035068+0000","last_peered":"2024-09-12T18:01:37.035068+0000","last_clean":"2024-09-12T18:01:37.035068+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T18:01:37.035068+0000","last_undegraded":"2024-09-12T18:01:37.035068+0000","last_fullsized":"2024-09-12T18:01:37.035068+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-12T18:01:37.034978+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-12T18:01:37.034978+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.034978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:12.187790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:17.020817+0000","last_change":"2024-09-12T17:49:56.036001+0000","last_active":"2024-09-12T17:58:17.020817+0000","last_peered":"2024-09-12T17:58:17.020817+0000","last_clean":"2024-09-12T17:58:17.020817+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T17:58:17.020817+0000","last_undegraded":"2024-09-12T17:58:17.020817+0000","last_fullsized":"2024-09-12T17:58:17.020817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:20.176376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.004885+0000","last_change":"2024-09-12T18:02:12.004885+0000","last_active":"2024-09-12T18:02:12.004885+0000","last_peered":"2024-09-12T18:02:12.004885+0000","last_clean":"2024-09-12T18:02:12.004885+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T18:02:12.004885+0000","last_undegraded":"2024-09-12T18:02:12.004885+0000","last_fullsized":"2024-09-12T18:02:12.004885+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T18:02:12.004782+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T18:02:12.004782+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.004782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:22.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5116,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.910616+0000","last_change":"2024-09-12T18:02:02.910616+0000","last_active":"2024-09-12T18:02:02.910616+0000","last_peered":"2024-09-12T18:02:02.910616+0000","last_clean":"2024-09-12T18:02:02.910616+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T18:02:02.910616+0000","last_undegraded":"2024-09-12T18:02:02.910616+0000","last_fullsized":"2024-09-12T18:02:02.910616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:02.910508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:02.910508+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.910508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:44.940461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.306606+0000","last_change":"2024-09-12T18:01:38.306523+0000","last_active":"2024-09-12T18:01:38.306606+0000","last_peered":"2024-09-12T18:01:38.306606+0000","last_clean":"2024-09-12T18:01:38.306606+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T18:01:38.306606+0000","last_undegraded":"2024-09-12T18:01:38.306606+0000","last_fullsized":"2024-09-12T18:01:38.306606+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:38.306404+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:38.306404+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.306404+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:31.601797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.445612+0000","last_change":"2024-09-12T18:01:58.445612+0000","last_active":"2024-09-12T18:01:58.445612+0000","last_peered":"2024-09-12T18:01:58.445612+0000","last_clean":"2024-09-12T18:01:58.445612+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T18:01:58.445612+0000","last_undegraded":"2024-09-12T18:01:58.445612+0000","last_fullsized":"2024-09-12T18:01:58.445612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:58.445494+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:58.445494+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.445494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:11.151009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.052353+0000","last_change":"2024-09-12T18:01:54.052353+0000","last_active":"2024-09-12T18:01:54.052353+0000","last_peered":"2024-09-12T18:01:54.052353+0000","last_clean":"2024-09-12T18:01:54.052353+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T18:01:54.052353+0000","last_undegraded":"2024-09-12T18:01:54.052353+0000","last_fullsized":"2024-09-12T18:01:54.052353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:54.052270+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:54.052270+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.052270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:07.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.960951+0000","last_change":"2024-09-12T18:01:43.960951+0000","last_active":"2024-09-12T18:01:43.960951+0000","last_peered":"2024-09-12T18:01:43.960951+0000","last_clean":"2024-09-12T18:01:43.960951+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T18:01:43.960951+0000","last_undegraded":"2024-09-12T18:01:43.960951+0000","last_fullsized":"2024-09-12T18:01:43.960951+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:43.960863+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:43.960863+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.960863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:07.304013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.961620+0000","last_change":"2024-09-12T18:01:42.961552+0000","last_active":"2024-09-12T18:01:42.961620+0000","last_peered":"2024-09-12T18:01:42.961620+0000","last_clean":"2024-09-12T18:01:42.961620+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T18:01:42.961620+0000","last_undegraded":"2024-09-12T18:01:42.961620+0000","last_fullsized":"2024-09-12T18:01:42.961620+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T18:01:42.961462+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T18:01:42.961462+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.961462+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:23.401760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.048007+0000","last_change":"2024-09-12T18:01:55.048007+0000","last_active":"2024-09-12T18:01:55.048007+0000","last_peered":"2024-09-12T18:01:55.048007+0000","last_clean":"2024-09-12T18:01:55.048007+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T18:01:55.048007+0000","last_undegraded":"2024-09-12T18:01:55.048007+0000","last_fullsized":"2024-09-12T18:01:55.048007+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.047912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.047912+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.047912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:49.523783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.003214+0000","last_change":"2024-09-12T18:02:11.003214+0000","last_active":"2024-09-12T18:02:11.003214+0000","last_peered":"2024-09-12T18:02:11.003214+0000","last_clean":"2024-09-12T18:02:11.003214+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T18:02:11.003214+0000","last_undegraded":"2024-09-12T18:02:11.003214+0000","last_fullsized":"2024-09-12T18:02:11.003214+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:02:11.003120+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:02:11.003120+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.003120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:44.341948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3651,"num_write":12,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.889149+0000","last_change":"2024-09-12T18:02:01.889149+0000","last_active":"2024-09-12T18:02:01.889149+0000","last_peered":"2024-09-12T18:02:01.889149+0000","last_clean":"2024-09-12T18:02:01.889149+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T18:02:01.889149+0000","last_undegraded":"2024-09-12T18:02:01.889149+0000","last_fullsized":"2024-09-12T18:02:01.889149+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.889054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.889054+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.889054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:13.091076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.858247+0000","last_change":"2024-09-12T18:01:58.858179+0000","last_active":"2024-09-12T18:01:58.858247+0000","last_peered":"2024-09-12T18:01:58.858247+0000","last_clean":"2024-09-12T18:01:58.858247+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T18:01:58.858247+0000","last_undegraded":"2024-09-12T18:01:58.858247+0000","last_fullsized":"2024-09-12T18:01:58.858247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:58.858090+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:58.858090+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.858090+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:29.356864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.118453+0000","last_change":"2024-09-12T18:02:05.118453+0000","last_active":"2024-09-12T18:02:05.118453+0000","last_peered":"2024-09-12T18:02:05.118453+0000","last_clean":"2024-09-12T18:02:05.118453+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T18:02:05.118453+0000","last_undegraded":"2024-09-12T18:02:05.118453+0000","last_fullsized":"2024-09-12T18:02:05.118453+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:05.118357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:05.118357+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.118357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.251668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.944437+0000","last_change":"2024-09-12T18:01:47.944437+0000","last_active":"2024-09-12T18:01:47.944437+0000","last_peered":"2024-09-12T18:01:47.944437+0000","last_clean":"2024-09-12T18:01:47.944437+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T18:01:47.944437+0000","last_undegraded":"2024-09-12T18:01:47.944437+0000","last_fullsized":"2024-09-12T18:01:47.944437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:01:47.944348+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:01:47.944348+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.944348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:35.932936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.404175+0000","last_change":"2024-09-12T18:01:46.404175+0000","last_active":"2024-09-12T18:01:46.404175+0000","last_peered":"2024-09-12T18:01:46.404175+0000","last_clean":"2024-09-12T18:01:46.404175+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T18:01:46.404175+0000","last_undegraded":"2024-09-12T18:01:46.404175+0000","last_fullsized":"2024-09-12T18:01:46.404175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:46.404077+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:46.404077+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.404077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:52.508125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4118,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.842452+0000","last_change":"2024-09-12T18:01:57.842389+0000","last_active":"2024-09-12T18:01:57.842452+0000","last_peered":"2024-09-12T18:01:57.842452+0000","last_clean":"2024-09-12T18:01:57.842452+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T18:01:57.842452+0000","last_undegraded":"2024-09-12T18:01:57.842452+0000","last_fullsized":"2024-09-12T18:01:57.842452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T18:01:57.842293+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T18:01:57.842293+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.842293+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:22.172808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:58:22.021616+0000","last_change":"2024-09-12T17:49:56.043230+0000","last_active":"2024-09-12T17:58:22.021616+0000","last_peered":"2024-09-12T17:58:22.021616+0000","last_clean":"2024-09-12T17:58:22.021616+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T17:58:22.021616+0000","last_undegraded":"2024-09-12T17:58:22.021616+0000","last_fullsized":"2024-09-12T17:58:22.021616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:49:55.016015+0000","last_clean_scrub_stamp":"2024-09-12T17:49:55.016015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:33.627052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.965307+0000","last_change":"2024-09-12T18:01:46.965307+0000","last_active":"2024-09-12T18:01:46.965307+0000","last_peered":"2024-09-12T18:01:46.965307+0000","last_clean":"2024-09-12T18:01:46.965307+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T18:01:46.965307+0000","last_undegraded":"2024-09-12T18:01:46.965307+0000","last_fullsized":"2024-09-12T18:01:46.965307+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:46.965209+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:46.965209+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.965209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:29.481280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.335597+0000","last_change":"2024-09-12T18:01:41.335530+0000","last_active":"2024-09-12T18:01:41.335597+0000","last_peered":"2024-09-12T18:01:41.335597+0000","last_clean":"2024-09-12T18:01:41.335597+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T18:01:41.335597+0000","last_undegraded":"2024-09-12T18:01:41.335597+0000","last_fullsized":"2024-09-12T18:01:41.335597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:41.335442+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:41.335442+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.335442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:40.801426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.974360+0000","last_change":"2024-09-12T18:01:38.974360+0000","last_active":"2024-09-12T18:01:38.974360+0000","last_peered":"2024-09-12T18:01:38.974360+0000","last_clean":"2024-09-12T18:01:38.974360+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T18:01:38.974360+0000","last_undegraded":"2024-09-12T18:01:38.974360+0000","last_fullsized":"2024-09-12T18:01:38.974360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T18:01:38.974250+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T18:01:38.974250+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.974250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:57.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'321","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.693631+0000","last_change":"2024-09-12T18:01:23.693564+0000","last_active":"2024-09-12T18:01:23.693631+0000","last_peered":"2024-09-12T18:01:23.693631+0000","last_clean":"2024-09-12T18:01:23.693631+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T18:01:23.693631+0000","last_undegraded":"2024-09-12T18:01:23.693631+0000","last_fullsized":"2024-09-12T18:01:23.693631+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.693423+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:45.036692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399146,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":38786,"num_write":1044,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'482","reported_seq":1981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.203059+0000","last_change":"2024-09-12T18:01:23.202958+0000","last_active":"2024-09-12T18:01:23.203059+0000","last_peered":"2024-09-12T18:01:23.203059+0000","last_clean":"2024-09-12T18:01:23.203059+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T18:01:23.203059+0000","last_undegraded":"2024-09-12T18:01:23.203059+0000","last_fullsized":"2024-09-12T18:01:23.203059+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.202855+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:43.946108+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":941,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'373","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.026863+0000","last_change":"2024-09-12T18:01:24.026802+0000","last_active":"2024-09-12T18:01:24.026863+0000","last_peered":"2024-09-12T18:01:24.026863+0000","last_clean":"2024-09-12T18:01:24.026863+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:24.026863+0000","last_undegraded":"2024-09-12T18:01:24.026863+0000","last_fullsized":"2024-09-12T18:01:24.026863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.026638+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.853845+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":37151,"num_write":1322,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'546","reported_seq":2168,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.582578+0000","last_change":"2024-09-12T18:01:34.582483+0000","last_active":"2024-09-12T18:01:34.582578+0000","last_peered":"2024-09-12T18:01:34.582578+0000","last_clean":"2024-09-12T18:01:34.582578+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T18:01:34.582578+0000","last_undegraded":"2024-09-12T18:01:34.582578+0000","last_fullsized":"2024-09-12T18:01:34.582578+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'546","last_scrub_stamp":"2024-09-12T18:01:34.582313+0000","last_deep_scrub":"265'546","last_deep_scrub_stamp":"2024-09-12T18:01:34.582313+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.582313+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:12.771444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":485,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'320","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.022949+0000","last_change":"2024-09-12T18:01:23.022871+0000","last_active":"2024-09-12T18:01:23.022949+0000","last_peered":"2024-09-12T18:01:23.022949+0000","last_clean":"2024-09-12T18:01:23.022949+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:23.022949+0000","last_undegraded":"2024-09-12T18:01:23.022949+0000","last_fullsized":"2024-09-12T18:01:23.022949+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.022698+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:20.281089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288578,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":719,"num_read_kb":16808,"num_write":978,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'615","reported_seq":2384,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.543359+0000","last_change":"2024-09-12T18:01:33.543305+0000","last_active":"2024-09-12T18:01:33.543359+0000","last_peered":"2024-09-12T18:01:33.543359+0000","last_clean":"2024-09-12T18:01:33.543359+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T18:01:33.543359+0000","last_undegraded":"2024-09-12T18:01:33.543359+0000","last_fullsized":"2024-09-12T18:01:33.543359+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'615","last_scrub_stamp":"2024-09-12T18:01:33.543217+0000","last_deep_scrub":"265'615","last_deep_scrub_stamp":"2024-09-12T18:01:33.543217+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.543217+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:40.509832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'428","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.900689+0000","last_change":"2024-09-12T18:01:14.900585+0000","last_active":"2024-09-12T18:01:14.900689+0000","last_peered":"2024-09-12T18:01:14.900689+0000","last_clean":"2024-09-12T18:01:14.900689+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T18:01:14.900689+0000","last_undegraded":"2024-09-12T18:01:14.900689+0000","last_fullsized":"2024-09-12T18:01:14.900689+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.900378+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:40.317506+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355300,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":592,"num_read_kb":16041,"num_write":1318,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.874189+0000","last_change":"2024-09-12T18:01:25.874120+0000","last_active":"2024-09-12T18:01:25.874189+0000","last_peered":"2024-09-12T18:01:25.874189+0000","last_clean":"2024-09-12T18:01:25.874189+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T18:01:25.874189+0000","last_undegraded":"2024-09-12T18:01:25.874189+0000","last_fullsized":"2024-09-12T18:01:25.874189+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.874037+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:51.343725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'286","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.715989+0000","last_change":"2024-09-12T18:01:15.715916+0000","last_active":"2024-09-12T18:01:15.715989+0000","last_peered":"2024-09-12T18:01:15.715989+0000","last_clean":"2024-09-12T18:01:15.715989+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T18:01:15.715989+0000","last_undegraded":"2024-09-12T18:01:15.715989+0000","last_fullsized":"2024-09-12T18:01:15.715989+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.715784+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:13.680021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":5548,"num_write":891,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'845","reported_seq":2514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.659043+0000","last_change":"2024-09-12T18:01:18.658937+0000","last_active":"2024-09-12T18:01:18.659043+0000","last_peered":"2024-09-12T18:01:18.659043+0000","last_clean":"2024-09-12T18:01:18.659043+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T18:01:18.659043+0000","last_undegraded":"2024-09-12T18:01:18.659043+0000","last_fullsized":"2024-09-12T18:01:18.659043+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'845","last_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_deep_scrub":"265'845","last_deep_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.658839+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:56.655053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'324","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.905445+0000","last_change":"2024-09-12T18:01:15.905312+0000","last_active":"2024-09-12T18:01:15.905445+0000","last_peered":"2024-09-12T18:01:15.905445+0000","last_clean":"2024-09-12T18:01:15.905445+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T18:01:15.905445+0000","last_undegraded":"2024-09-12T18:01:15.905445+0000","last_fullsized":"2024-09-12T18:01:15.905445+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.905069+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:23.219539+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":30145,"num_write":1083,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'508","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.724250+0000","last_change":"2024-09-12T18:01:20.724189+0000","last_active":"2024-09-12T18:01:20.724250+0000","last_peered":"2024-09-12T18:01:20.724250+0000","last_clean":"2024-09-12T18:01:20.724250+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:01:20.724250+0000","last_undegraded":"2024-09-12T18:01:20.724250+0000","last_fullsized":"2024-09-12T18:01:20.724250+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'508","last_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_deep_scrub":"265'508","last_deep_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.724105+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:47.581144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'367","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.683402+0000","last_change":"2024-09-12T18:01:21.683331+0000","last_active":"2024-09-12T18:01:21.683402+0000","last_peered":"2024-09-12T18:01:21.683402+0000","last_clean":"2024-09-12T18:01:21.683402+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T18:01:21.683402+0000","last_undegraded":"2024-09-12T18:01:21.683402+0000","last_fullsized":"2024-09-12T18:01:21.683402+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.683187+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.284187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036318,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":10450,"num_write":1136,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'745","reported_seq":2179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.002193+0000","last_change":"2024-09-12T18:01:23.002080+0000","last_active":"2024-09-12T18:01:23.002193+0000","last_peered":"2024-09-12T18:01:23.002193+0000","last_clean":"2024-09-12T18:01:23.002193+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T18:01:23.002193+0000","last_undegraded":"2024-09-12T18:01:23.002193+0000","last_fullsized":"2024-09-12T18:01:23.002193+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.001977+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:23.455291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'413","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.990537+0000","last_change":"2024-09-12T18:01:21.990417+0000","last_active":"2024-09-12T18:01:21.990537+0000","last_peered":"2024-09-12T18:01:21.990537+0000","last_clean":"2024-09-12T18:01:21.990537+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:21.990537+0000","last_undegraded":"2024-09-12T18:01:21.990537+0000","last_fullsized":"2024-09-12T18:01:21.990537+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.990298+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:19.678560+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":69100,"num_write":1161,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1196","reported_seq":2925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.158209+0000","last_change":"2024-09-12T18:01:33.158209+0000","last_active":"2024-09-12T18:01:33.158209+0000","last_peered":"2024-09-12T18:01:33.158209+0000","last_clean":"2024-09-12T18:01:33.158209+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T18:01:33.158209+0000","last_undegraded":"2024-09-12T18:01:33.158209+0000","last_fullsized":"2024-09-12T18:01:33.158209+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1196","last_scrub_stamp":"2024-09-12T18:01:33.158104+0000","last_deep_scrub":"265'1196","last_deep_scrub_stamp":"2024-09-12T18:01:33.158104+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.158104+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:58.782843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'490","reported_seq":2047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.532215+0000","last_change":"2024-09-12T18:01:32.532215+0000","last_active":"2024-09-12T18:01:32.532215+0000","last_peered":"2024-09-12T18:01:32.532215+0000","last_clean":"2024-09-12T18:01:32.532215+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T18:01:32.532215+0000","last_undegraded":"2024-09-12T18:01:32.532215+0000","last_fullsized":"2024-09-12T18:01:32.532215+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:32.532145+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:32.532145+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.532145+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:43.375201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'383","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.180354+0000","last_change":"2024-09-12T18:01:15.180354+0000","last_active":"2024-09-12T18:01:15.180354+0000","last_peered":"2024-09-12T18:01:15.180354+0000","last_clean":"2024-09-12T18:01:15.180354+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:01:15.180354+0000","last_undegraded":"2024-09-12T18:01:15.180354+0000","last_fullsized":"2024-09-12T18:01:15.180354+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.180191+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:38.231795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":53764,"num_write":1216,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'449","reported_seq":2064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.661671+0000","last_change":"2024-09-12T18:01:22.661599+0000","last_active":"2024-09-12T18:01:22.661671+0000","last_peered":"2024-09-12T18:01:22.661671+0000","last_clean":"2024-09-12T18:01:22.661671+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T18:01:22.661671+0000","last_undegraded":"2024-09-12T18:01:22.661671+0000","last_fullsized":"2024-09-12T18:01:22.661671+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.661510+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:11.348161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'317","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.714065+0000","last_change":"2024-09-12T18:01:14.714065+0000","last_active":"2024-09-12T18:01:14.714065+0000","last_peered":"2024-09-12T18:01:14.714065+0000","last_clean":"2024-09-12T18:01:14.714065+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T18:01:14.714065+0000","last_undegraded":"2024-09-12T18:01:14.714065+0000","last_fullsized":"2024-09-12T18:01:14.714065+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.713905+0000","objects_scrubbed":11,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.647051+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":34593,"num_write":1052,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'469","reported_seq":2172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.180905+0000","last_change":"2024-09-12T18:01:20.180816+0000","last_active":"2024-09-12T18:01:20.180905+0000","last_peered":"2024-09-12T18:01:20.180905+0000","last_clean":"2024-09-12T18:01:20.180905+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T18:01:20.180905+0000","last_undegraded":"2024-09-12T18:01:20.180905+0000","last_fullsized":"2024-09-12T18:01:20.180905+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'469","last_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_deep_scrub":"265'469","last_deep_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.180664+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.671311+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'341","reported_seq":1172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.821456+0000","last_change":"2024-09-12T18:01:11.821456+0000","last_active":"2024-09-12T18:01:11.821456+0000","last_peered":"2024-09-12T18:01:11.821456+0000","last_clean":"2024-09-12T18:01:11.821456+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T18:01:11.821456+0000","last_undegraded":"2024-09-12T18:01:11.821456+0000","last_fullsized":"2024-09-12T18:01:11.821456+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.821358+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:08.588749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":875,"num_read_kb":30506,"num_write":1060,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'420","reported_seq":2007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.353429+0000","last_change":"2024-09-12T18:01:25.353429+0000","last_active":"2024-09-12T18:01:25.353429+0000","last_peered":"2024-09-12T18:01:25.353429+0000","last_clean":"2024-09-12T18:01:25.353429+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T18:01:25.353429+0000","last_undegraded":"2024-09-12T18:01:25.353429+0000","last_fullsized":"2024-09-12T18:01:25.353429+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.353351+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:54.030926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'419","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.786986+0000","last_change":"2024-09-12T18:01:12.786986+0000","last_active":"2024-09-12T18:01:12.786986+0000","last_peered":"2024-09-12T18:01:12.786986+0000","last_clean":"2024-09-12T18:01:12.786986+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T18:01:12.786986+0000","last_undegraded":"2024-09-12T18:01:12.786986+0000","last_fullsized":"2024-09-12T18:01:12.786986+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.786804+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:13.752525+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":18097,"num_write":1302,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1544","reported_seq":3166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.151769+0000","last_change":"2024-09-12T18:01:32.151769+0000","last_active":"2024-09-12T18:01:32.151769+0000","last_peered":"2024-09-12T18:01:32.151769+0000","last_clean":"2024-09-12T18:01:32.151769+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T18:01:32.151769+0000","last_undegraded":"2024-09-12T18:01:32.151769+0000","last_fullsized":"2024-09-12T18:01:32.151769+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1544","last_scrub_stamp":"2024-09-12T18:01:32.151645+0000","last_deep_scrub":"265'1544","last_deep_scrub_stamp":"2024-09-12T18:01:32.151645+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.151645+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:18.366283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'346","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.285549+0000","last_change":"2024-09-12T18:01:22.285549+0000","last_active":"2024-09-12T18:01:22.285549+0000","last_peered":"2024-09-12T18:01:22.285549+0000","last_clean":"2024-09-12T18:01:22.285549+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T18:01:22.285549+0000","last_undegraded":"2024-09-12T18:01:22.285549+0000","last_fullsized":"2024-09-12T18:01:22.285549+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.285373+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:53.823367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":18482,"num_write":1050,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'789","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.204231+0000","last_change":"2024-09-12T18:01:21.204231+0000","last_active":"2024-09-12T18:01:21.204231+0000","last_peered":"2024-09-12T18:01:21.204231+0000","last_clean":"2024-09-12T18:01:21.204231+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T18:01:21.204231+0000","last_undegraded":"2024-09-12T18:01:21.204231+0000","last_fullsized":"2024-09-12T18:01:21.204231+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'789","last_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_deep_scrub":"265'789","last_deep_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.204081+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:13.829902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.232895+0000","last_change":"2024-09-12T18:01:16.232834+0000","last_active":"2024-09-12T18:01:16.232895+0000","last_peered":"2024-09-12T18:01:16.232895+0000","last_clean":"2024-09-12T18:01:16.232895+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T18:01:16.232895+0000","last_undegraded":"2024-09-12T18:01:16.232895+0000","last_fullsized":"2024-09-12T18:01:16.232895+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.232719+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.506531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399140,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":4177,"num_write":987,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'175","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.830954+0000","last_change":"2024-09-12T18:01:35.830954+0000","last_active":"2024-09-12T18:01:35.830954+0000","last_peered":"2024-09-12T18:01:35.830954+0000","last_clean":"2024-09-12T18:01:35.830954+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T18:01:35.830954+0000","last_undegraded":"2024-09-12T18:01:35.830954+0000","last_fullsized":"2024-09-12T18:01:35.830954+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T18:01:35.830857+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T18:01:35.830857+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.830857+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:30.622531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'443","reported_seq":2027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.303962+0000","last_change":"2024-09-12T18:01:23.303906+0000","last_active":"2024-09-12T18:01:23.303962+0000","last_peered":"2024-09-12T18:01:23.303962+0000","last_clean":"2024-09-12T18:01:23.303962+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T18:01:23.303962+0000","last_undegraded":"2024-09-12T18:01:23.303962+0000","last_fullsized":"2024-09-12T18:01:23.303962+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'443","last_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_deep_scrub":"265'443","last_deep_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.303815+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.507190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'409","reported_seq":1226,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.577737+0000","last_change":"2024-09-12T18:01:24.577601+0000","last_active":"2024-09-12T18:01:24.577737+0000","last_peered":"2024-09-12T18:01:24.577737+0000","last_clean":"2024-09-12T18:01:24.577737+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T18:01:24.577737+0000","last_undegraded":"2024-09-12T18:01:24.577737+0000","last_fullsized":"2024-09-12T18:01:24.577737+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.577312+0000","objects_scrubbed":11,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:04.271781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460277,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":57262,"num_write":1362,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.755868+0000","last_change":"2024-09-12T18:01:51.755868+0000","last_active":"2024-09-12T18:01:51.755868+0000","last_peered":"2024-09-12T18:01:51.755868+0000","last_clean":"2024-09-12T18:01:51.755868+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T18:01:51.755868+0000","last_undegraded":"2024-09-12T18:01:51.755868+0000","last_fullsized":"2024-09-12T18:01:51.755868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:51.755761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:51.755761+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.755761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:46.374444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'347","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.870078+0000","last_change":"2024-09-12T18:01:38.870078+0000","last_active":"2024-09-12T18:01:38.870078+0000","last_peered":"2024-09-12T18:01:38.870078+0000","last_clean":"2024-09-12T18:01:38.870078+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:01:38.870078+0000","last_undegraded":"2024-09-12T18:01:38.870078+0000","last_fullsized":"2024-09-12T18:01:38.870078+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T18:01:38.869957+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T18:01:38.869957+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.869957+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:20.747422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":1109,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.326416+0000","last_change":"2024-09-12T18:01:37.326416+0000","last_active":"2024-09-12T18:01:37.326416+0000","last_peered":"2024-09-12T18:01:37.326416+0000","last_clean":"2024-09-12T18:01:37.326416+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T18:01:37.326416+0000","last_undegraded":"2024-09-12T18:01:37.326416+0000","last_fullsized":"2024-09-12T18:01:37.326416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:37.326332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:37.326332+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.326332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:29.403460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2434","reported_seq":4326,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.350773+0000","last_change":"2024-09-12T18:01:39.350773+0000","last_active":"2024-09-12T18:01:39.350773+0000","last_peered":"2024-09-12T18:01:39.350773+0000","last_clean":"2024-09-12T18:01:39.350773+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T18:01:39.350773+0000","last_undegraded":"2024-09-12T18:01:39.350773+0000","last_fullsized":"2024-09-12T18:01:39.350773+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2434","last_scrub_stamp":"2024-09-12T18:01:39.350685+0000","last_deep_scrub":"265'2434","last_deep_scrub_stamp":"2024-09-12T18:01:39.350685+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.350685+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":2400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:34.512367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'793","reported_seq":2278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.559926+0000","last_change":"2024-09-12T18:01:30.559926+0000","last_active":"2024-09-12T18:01:30.559926+0000","last_peered":"2024-09-12T18:01:30.559926+0000","last_clean":"2024-09-12T18:01:30.559926+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:01:30.559926+0000","last_undegraded":"2024-09-12T18:01:30.559926+0000","last_fullsized":"2024-09-12T18:01:30.559926+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-12T18:01:30.559816+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-12T18:01:30.559816+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.559816+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:24.626799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'312","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.189266+0000","last_change":"2024-09-12T18:01:14.189194+0000","last_active":"2024-09-12T18:01:14.189266+0000","last_peered":"2024-09-12T18:01:14.189266+0000","last_clean":"2024-09-12T18:01:14.189266+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T18:01:14.189266+0000","last_undegraded":"2024-09-12T18:01:14.189266+0000","last_fullsized":"2024-09-12T18:01:14.189266+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.189092+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:46.249612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170284,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":362,"num_read_kb":2179,"num_write":871,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.916745+0000","last_change":"2024-09-12T18:01:31.916681+0000","last_active":"2024-09-12T18:01:31.916745+0000","last_peered":"2024-09-12T18:01:31.916745+0000","last_clean":"2024-09-12T18:01:31.916745+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T18:01:31.916745+0000","last_undegraded":"2024-09-12T18:01:31.916745+0000","last_fullsized":"2024-09-12T18:01:31.916745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.916560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.916560+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.916560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:06.898966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.245105+0000","last_change":"2024-09-12T18:01:30.245105+0000","last_active":"2024-09-12T18:01:30.245105+0000","last_peered":"2024-09-12T18:01:30.245105+0000","last_clean":"2024-09-12T18:01:30.245105+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T18:01:30.245105+0000","last_undegraded":"2024-09-12T18:01:30.245105+0000","last_fullsized":"2024-09-12T18:01:30.245105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T18:01:30.244973+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T18:01:30.244973+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.244973+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:09.238201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.225558+0000","last_change":"2024-09-12T18:01:34.225558+0000","last_active":"2024-09-12T18:01:34.225558+0000","last_peered":"2024-09-12T18:01:34.225558+0000","last_clean":"2024-09-12T18:01:34.225558+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T18:01:34.225558+0000","last_undegraded":"2024-09-12T18:01:34.225558+0000","last_fullsized":"2024-09-12T18:01:34.225558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:34.225467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:34.225467+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.225467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:10.074549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'131","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.420408+0000","last_change":"2024-09-12T18:01:39.420351+0000","last_active":"2024-09-12T18:01:39.420408+0000","last_peered":"2024-09-12T18:01:39.420408+0000","last_clean":"2024-09-12T18:01:39.420408+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T18:01:39.420408+0000","last_undegraded":"2024-09-12T18:01:39.420408+0000","last_fullsized":"2024-09-12T18:01:39.420408+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T18:01:39.420258+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T18:01:39.420258+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.420258+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:28.166252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1531","reported_seq":3108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.124184+0000","last_change":"2024-09-12T18:01:27.124184+0000","last_active":"2024-09-12T18:01:27.124184+0000","last_peered":"2024-09-12T18:01:27.124184+0000","last_clean":"2024-09-12T18:01:27.124184+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T18:01:27.124184+0000","last_undegraded":"2024-09-12T18:01:27.124184+0000","last_fullsized":"2024-09-12T18:01:27.124184+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1531","last_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_deep_scrub":"265'1531","last_deep_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.124084+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":1500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.265522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'349","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.543288+0000","last_change":"2024-09-12T18:01:16.543222+0000","last_active":"2024-09-12T18:01:16.543288+0000","last_peered":"2024-09-12T18:01:16.543288+0000","last_clean":"2024-09-12T18:01:16.543288+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T18:01:16.543288+0000","last_undegraded":"2024-09-12T18:01:16.543288+0000","last_fullsized":"2024-09-12T18:01:16.543288+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.543095+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:40.971401+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":7819,"num_write":1100,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.906437+0000","last_change":"2024-09-12T18:01:30.906437+0000","last_active":"2024-09-12T18:01:30.906437+0000","last_peered":"2024-09-12T18:01:30.906437+0000","last_clean":"2024-09-12T18:01:30.906437+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T18:01:30.906437+0000","last_undegraded":"2024-09-12T18:01:30.906437+0000","last_fullsized":"2024-09-12T18:01:30.906437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:30.906353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:30.906353+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.906353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:49.215510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'110","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.875575+0000","last_change":"2024-09-12T18:01:37.875476+0000","last_active":"2024-09-12T18:01:37.875575+0000","last_peered":"2024-09-12T18:01:37.875575+0000","last_clean":"2024-09-12T18:01:37.875575+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T18:01:37.875575+0000","last_undegraded":"2024-09-12T18:01:37.875575+0000","last_fullsized":"2024-09-12T18:01:37.875575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T18:01:37.875381+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T18:01:37.875381+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.875381+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.856181+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'789","reported_seq":2222,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.860079+0000","last_change":"2024-09-12T18:02:04.860079+0000","last_active":"2024-09-12T18:02:04.860079+0000","last_peered":"2024-09-12T18:02:04.860079+0000","last_clean":"2024-09-12T18:02:04.860079+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:02:04.860079+0000","last_undegraded":"2024-09-12T18:02:04.860079+0000","last_fullsized":"2024-09-12T18:02:04.860079+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'789","last_scrub_stamp":"2024-09-12T18:02:04.859991+0000","last_deep_scrub":"265'789","last_deep_scrub_stamp":"2024-09-12T18:02:04.859991+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.859991+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:04.115216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'224","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.964174+0000","last_change":"2024-09-12T18:01:40.964113+0000","last_active":"2024-09-12T18:01:40.964174+0000","last_peered":"2024-09-12T18:01:40.964174+0000","last_clean":"2024-09-12T18:01:40.964174+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:01:40.964174+0000","last_undegraded":"2024-09-12T18:01:40.964174+0000","last_fullsized":"2024-09-12T18:01:40.964174+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'224","last_scrub_stamp":"2024-09-12T18:01:40.964028+0000","last_deep_scrub":"265'224","last_deep_scrub_stamp":"2024-09-12T18:01:40.964028+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.964028+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:48.429704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'715","reported_seq":1977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.102558+0000","last_change":"2024-09-12T18:01:28.102558+0000","last_active":"2024-09-12T18:01:28.102558+0000","last_peered":"2024-09-12T18:01:28.102558+0000","last_clean":"2024-09-12T18:01:28.102558+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T18:01:28.102558+0000","last_undegraded":"2024-09-12T18:01:28.102558+0000","last_fullsized":"2024-09-12T18:01:28.102558+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'715","last_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_deep_scrub":"265'715","last_deep_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.102443+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:34.202300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'416","reported_seq":1142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.092409+0000","last_change":"2024-09-12T18:01:11.092314+0000","last_active":"2024-09-12T18:01:11.092409+0000","last_peered":"2024-09-12T18:01:11.092409+0000","last_clean":"2024-09-12T18:01:11.092409+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T18:01:11.092409+0000","last_undegraded":"2024-09-12T18:01:11.092409+0000","last_fullsized":"2024-09-12T18:01:11.092409+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.092136+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:29.744238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":18208,"num_write":1467,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.714001+0000","last_change":"2024-09-12T18:01:40.714001+0000","last_active":"2024-09-12T18:01:40.714001+0000","last_peered":"2024-09-12T18:01:40.714001+0000","last_clean":"2024-09-12T18:01:40.714001+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T18:01:40.714001+0000","last_undegraded":"2024-09-12T18:01:40.714001+0000","last_fullsized":"2024-09-12T18:01:40.714001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.713898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.713898+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.713898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:58.178175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'281","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.097066+0000","last_change":"2024-09-12T18:01:30.097066+0000","last_active":"2024-09-12T18:01:30.097066+0000","last_peered":"2024-09-12T18:01:30.097066+0000","last_clean":"2024-09-12T18:01:30.097066+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:01:30.097066+0000","last_undegraded":"2024-09-12T18:01:30.097066+0000","last_fullsized":"2024-09-12T18:01:30.097066+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T18:01:30.096979+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T18:01:30.096979+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.096979+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.426534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1135,"num_write":384,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'811","reported_seq":2323,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.171925+0000","last_change":"2024-09-12T18:01:42.171869+0000","last_active":"2024-09-12T18:01:42.171925+0000","last_peered":"2024-09-12T18:01:42.171925+0000","last_clean":"2024-09-12T18:01:42.171925+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:42.171925+0000","last_undegraded":"2024-09-12T18:01:42.171925+0000","last_fullsized":"2024-09-12T18:01:42.171925+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'811","last_scrub_stamp":"2024-09-12T18:01:42.171786+0000","last_deep_scrub":"265'811","last_deep_scrub_stamp":"2024-09-12T18:01:42.171786+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.171786+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:13.657327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'421","reported_seq":1994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.533263+0000","last_change":"2024-09-12T18:01:28.533263+0000","last_active":"2024-09-12T18:01:28.533263+0000","last_peered":"2024-09-12T18:01:28.533263+0000","last_clean":"2024-09-12T18:01:28.533263+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:01:28.533263+0000","last_undegraded":"2024-09-12T18:01:28.533263+0000","last_fullsized":"2024-09-12T18:01:28.533263+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T18:01:28.533126+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T18:01:28.533126+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.533126+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:59.686316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'329","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.822719+0000","last_change":"2024-09-12T18:01:09.822719+0000","last_active":"2024-09-12T18:01:09.822719+0000","last_peered":"2024-09-12T18:01:09.822719+0000","last_clean":"2024-09-12T18:01:09.822719+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T18:01:09.822719+0000","last_undegraded":"2024-09-12T18:01:09.822719+0000","last_fullsized":"2024-09-12T18:01:09.822719+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.822608+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:13.917726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":438,"num_read_kb":9180,"num_write":1028,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"265'6","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.204893+0000","last_change":"2024-09-12T18:01:24.204893+0000","last_active":"2024-09-12T18:01:24.204893+0000","last_peered":"2024-09-12T18:01:24.204893+0000","last_clean":"2024-09-12T18:01:24.204893+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:01:24.204893+0000","last_undegraded":"2024-09-12T18:01:24.204893+0000","last_fullsized":"2024-09-12T18:01:24.204893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.204776+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.761047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'319","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.723540+0000","last_change":"2024-09-12T18:01:26.723540+0000","last_active":"2024-09-12T18:01:26.723540+0000","last_peered":"2024-09-12T18:01:26.723540+0000","last_clean":"2024-09-12T18:01:26.723540+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T18:01:26.723540+0000","last_undegraded":"2024-09-12T18:01:26.723540+0000","last_fullsized":"2024-09-12T18:01:26.723540+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.723419+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:46.051413+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42323,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1094,"num_write":406,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.406506+0000","last_change":"2024-09-12T18:01:34.406506+0000","last_active":"2024-09-12T18:01:34.406506+0000","last_peered":"2024-09-12T18:01:34.406506+0000","last_clean":"2024-09-12T18:01:34.406506+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T18:01:34.406506+0000","last_undegraded":"2024-09-12T18:01:34.406506+0000","last_fullsized":"2024-09-12T18:01:34.406506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:34.406415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:34.406415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.406415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:03.678153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'545","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.003367+0000","last_change":"2024-09-12T18:01:35.003300+0000","last_active":"2024-09-12T18:01:35.003367+0000","last_peered":"2024-09-12T18:01:35.003367+0000","last_clean":"2024-09-12T18:01:35.003367+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:01:35.003367+0000","last_undegraded":"2024-09-12T18:01:35.003367+0000","last_fullsized":"2024-09-12T18:01:35.003367+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'545","last_scrub_stamp":"2024-09-12T18:01:35.003187+0000","last_deep_scrub":"265'545","last_deep_scrub_stamp":"2024-09-12T18:01:35.003187+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.003187+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:16.023359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'854","reported_seq":2404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.150958+0000","last_change":"2024-09-12T18:01:13.150958+0000","last_active":"2024-09-12T18:01:13.150958+0000","last_peered":"2024-09-12T18:01:13.150958+0000","last_clean":"2024-09-12T18:01:13.150958+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T18:01:13.150958+0000","last_undegraded":"2024-09-12T18:01:13.150958+0000","last_fullsized":"2024-09-12T18:01:13.150958+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'854","last_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_deep_scrub":"265'854","last_deep_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.150845+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.897083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'342","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.910415+0000","last_change":"2024-09-12T18:01:10.910415+0000","last_active":"2024-09-12T18:01:10.910415+0000","last_peered":"2024-09-12T18:01:10.910415+0000","last_clean":"2024-09-12T18:01:10.910415+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T18:01:10.910415+0000","last_undegraded":"2024-09-12T18:01:10.910415+0000","last_fullsized":"2024-09-12T18:01:10.910415+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.910294+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:18.320214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372398,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":25919,"num_write":1097,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.361255+0000","last_change":"2024-09-12T18:01:27.361255+0000","last_active":"2024-09-12T18:01:27.361255+0000","last_peered":"2024-09-12T18:01:27.361255+0000","last_clean":"2024-09-12T18:01:27.361255+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T18:01:27.361255+0000","last_undegraded":"2024-09-12T18:01:27.361255+0000","last_fullsized":"2024-09-12T18:01:27.361255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.361167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.361167+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.361167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:37.186412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'278","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.921489+0000","last_change":"2024-09-12T18:01:34.921489+0000","last_active":"2024-09-12T18:01:34.921489+0000","last_peered":"2024-09-12T18:01:34.921489+0000","last_clean":"2024-09-12T18:01:34.921489+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:01:34.921489+0000","last_undegraded":"2024-09-12T18:01:34.921489+0000","last_fullsized":"2024-09-12T18:01:34.921489+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T18:01:34.921399+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T18:01:34.921399+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.921399+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:47.961172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1078,"num_write":370,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.974204+0000","last_change":"2024-09-12T18:01:42.974204+0000","last_active":"2024-09-12T18:01:42.974204+0000","last_peered":"2024-09-12T18:01:42.974204+0000","last_clean":"2024-09-12T18:01:42.974204+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T18:01:42.974204+0000","last_undegraded":"2024-09-12T18:01:42.974204+0000","last_fullsized":"2024-09-12T18:01:42.974204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.974116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.974116+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.974116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:08.929573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'99","reported_seq":591,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.248594+0000","last_change":"2024-09-12T18:01:35.248524+0000","last_active":"2024-09-12T18:01:35.248594+0000","last_peered":"2024-09-12T18:01:35.248594+0000","last_clean":"2024-09-12T18:01:35.248594+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T18:01:35.248594+0000","last_undegraded":"2024-09-12T18:01:35.248594+0000","last_fullsized":"2024-09-12T18:01:35.248594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-12T18:01:35.248432+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-12T18:01:35.248432+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.248432+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:20.748584+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'383","reported_seq":1862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.965058+0000","last_change":"2024-09-12T18:01:19.965058+0000","last_active":"2024-09-12T18:01:19.965058+0000","last_peered":"2024-09-12T18:01:19.965058+0000","last_clean":"2024-09-12T18:01:19.965058+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T18:01:19.965058+0000","last_undegraded":"2024-09-12T18:01:19.965058+0000","last_fullsized":"2024-09-12T18:01:19.965058+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.964971+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:27.371182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'389","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.511378+0000","last_change":"2024-09-12T18:01:20.511378+0000","last_active":"2024-09-12T18:01:20.511378+0000","last_peered":"2024-09-12T18:01:20.511378+0000","last_clean":"2024-09-12T18:01:20.511378+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T18:01:20.511378+0000","last_undegraded":"2024-09-12T18:01:20.511378+0000","last_fullsized":"2024-09-12T18:01:20.511378+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.511198+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:06.731878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":11787,"num_write":1282,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"265'4","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.181352+0000","last_change":"2024-09-12T18:01:34.181352+0000","last_active":"2024-09-12T18:01:34.181352+0000","last_peered":"2024-09-12T18:01:34.181352+0000","last_clean":"2024-09-12T18:01:34.181352+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:34.181352+0000","last_undegraded":"2024-09-12T18:01:34.181352+0000","last_fullsized":"2024-09-12T18:01:34.181352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:34.181250+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:34.181250+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.181250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:35.922785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'248","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.673268+0000","last_change":"2024-09-12T18:01:43.673268+0000","last_active":"2024-09-12T18:01:43.673268+0000","last_peered":"2024-09-12T18:01:43.673268+0000","last_clean":"2024-09-12T18:01:43.673268+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:01:43.673268+0000","last_undegraded":"2024-09-12T18:01:43.673268+0000","last_fullsized":"2024-09-12T18:01:43.673268+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'248","last_scrub_stamp":"2024-09-12T18:01:43.673158+0000","last_deep_scrub":"265'248","last_deep_scrub_stamp":"2024-09-12T18:01:43.673158+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.673158+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:48.283546+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14789,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":830,"num_write":302,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'810","reported_seq":6247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.215618+0000","last_change":"2024-09-12T18:01:41.215618+0000","last_active":"2024-09-12T18:01:41.215618+0000","last_peered":"2024-09-12T18:01:41.215618+0000","last_clean":"2024-09-12T18:01:41.215618+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:41.215618+0000","last_undegraded":"2024-09-12T18:01:41.215618+0000","last_fullsized":"2024-09-12T18:01:41.215618+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'810","last_scrub_stamp":"2024-09-12T18:01:41.215534+0000","last_deep_scrub":"265'810","last_deep_scrub_stamp":"2024-09-12T18:01:41.215534+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.215534+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:57.602993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'101","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.421982+0000","last_change":"2024-09-12T18:01:38.421982+0000","last_active":"2024-09-12T18:01:38.421982+0000","last_peered":"2024-09-12T18:01:38.421982+0000","last_clean":"2024-09-12T18:01:38.421982+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:01:38.421982+0000","last_undegraded":"2024-09-12T18:01:38.421982+0000","last_fullsized":"2024-09-12T18:01:38.421982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T18:01:38.421862+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T18:01:38.421862+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.421862+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.477867+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'888","reported_seq":2509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.082366+0000","last_change":"2024-09-12T18:01:26.082366+0000","last_active":"2024-09-12T18:01:26.082366+0000","last_peered":"2024-09-12T18:01:26.082366+0000","last_clean":"2024-09-12T18:01:26.082366+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T18:01:26.082366+0000","last_undegraded":"2024-09-12T18:01:26.082366+0000","last_fullsized":"2024-09-12T18:01:26.082366+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'888","last_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_deep_scrub":"265'888","last_deep_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.082271+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:57.896478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'333","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.854293+0000","last_change":"2024-09-12T18:01:08.854293+0000","last_active":"2024-09-12T18:01:08.854293+0000","last_peered":"2024-09-12T18:01:08.854293+0000","last_clean":"2024-09-12T18:01:08.854293+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T18:01:08.854293+0000","last_undegraded":"2024-09-12T18:01:08.854293+0000","last_fullsized":"2024-09-12T18:01:08.854293+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_clean_scrub_stamp":"2024-09-12T18:01:08.854202+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:07.060997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":4507,"num_write":1037,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.368958+0000","last_change":"2024-09-12T18:01:26.368958+0000","last_active":"2024-09-12T18:01:26.368958+0000","last_peered":"2024-09-12T18:01:26.368958+0000","last_clean":"2024-09-12T18:01:26.368958+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T18:01:26.368958+0000","last_undegraded":"2024-09-12T18:01:26.368958+0000","last_fullsized":"2024-09-12T18:01:26.368958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.368881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:04.679223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'464","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.886345+0000","last_change":"2024-09-12T18:01:35.886345+0000","last_active":"2024-09-12T18:01:35.886345+0000","last_peered":"2024-09-12T18:01:35.886345+0000","last_clean":"2024-09-12T18:01:35.886345+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:01:35.886345+0000","last_undegraded":"2024-09-12T18:01:35.886345+0000","last_fullsized":"2024-09-12T18:01:35.886345+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T18:01:35.886257+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T18:01:35.886257+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.886257+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:04.522631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91621,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":2003,"num_write":680,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.165357+0000","last_change":"2024-09-12T18:01:40.165357+0000","last_active":"2024-09-12T18:01:40.165357+0000","last_peered":"2024-09-12T18:01:40.165357+0000","last_clean":"2024-09-12T18:01:40.165357+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T18:01:40.165357+0000","last_undegraded":"2024-09-12T18:01:40.165357+0000","last_fullsized":"2024-09-12T18:01:40.165357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.165272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.165272+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.165272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:13.163122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'119","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.283222+0000","last_change":"2024-09-12T18:01:34.283222+0000","last_active":"2024-09-12T18:01:34.283222+0000","last_peered":"2024-09-12T18:01:34.283222+0000","last_clean":"2024-09-12T18:01:34.283222+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T18:01:34.283222+0000","last_undegraded":"2024-09-12T18:01:34.283222+0000","last_fullsized":"2024-09-12T18:01:34.283222+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T18:01:34.283112+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T18:01:34.283112+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.283112+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:23.561819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1098","reported_seq":2467,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.690325+0000","last_change":"2024-09-12T18:01:16.690325+0000","last_active":"2024-09-12T18:01:16.690325+0000","last_peered":"2024-09-12T18:01:16.690325+0000","last_clean":"2024-09-12T18:01:16.690325+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T18:01:16.690325+0000","last_undegraded":"2024-09-12T18:01:16.690325+0000","last_fullsized":"2024-09-12T18:01:16.690325+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1098","last_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_deep_scrub":"265'1098","last_deep_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.690238+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:56.957860+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'388","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.423542+0000","last_change":"2024-09-12T18:01:13.423542+0000","last_active":"2024-09-12T18:01:13.423542+0000","last_peered":"2024-09-12T18:01:13.423542+0000","last_clean":"2024-09-12T18:01:13.423542+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T18:01:13.423542+0000","last_undegraded":"2024-09-12T18:01:13.423542+0000","last_fullsized":"2024-09-12T18:01:13.423542+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.423366+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.728247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":4065,"num_write":1151,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.459436+0000","last_change":"2024-09-12T18:01:24.459436+0000","last_active":"2024-09-12T18:01:24.459436+0000","last_peered":"2024-09-12T18:01:24.459436+0000","last_clean":"2024-09-12T18:01:24.459436+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T18:01:24.459436+0000","last_undegraded":"2024-09-12T18:01:24.459436+0000","last_fullsized":"2024-09-12T18:01:24.459436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.459346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:56.562856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.287027+0000","last_change":"2024-09-12T18:01:29.287027+0000","last_active":"2024-09-12T18:01:29.287027+0000","last_peered":"2024-09-12T18:01:29.287027+0000","last_clean":"2024-09-12T18:01:29.287027+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:01:29.287027+0000","last_undegraded":"2024-09-12T18:01:29.287027+0000","last_fullsized":"2024-09-12T18:01:29.287027+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T18:01:29.286941+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T18:01:29.286941+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.286941+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:08.866516+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46038,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":1069,"num_write":430,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.311558+0000","last_change":"2024-09-12T18:01:30.311558+0000","last_active":"2024-09-12T18:01:30.311558+0000","last_peered":"2024-09-12T18:01:30.311558+0000","last_clean":"2024-09-12T18:01:30.311558+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T18:01:30.311558+0000","last_undegraded":"2024-09-12T18:01:30.311558+0000","last_fullsized":"2024-09-12T18:01:30.311558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:30.311474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:30.311474+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.311474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:38.716188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'128","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.173172+0000","last_change":"2024-09-12T18:01:44.173172+0000","last_active":"2024-09-12T18:01:44.173172+0000","last_peered":"2024-09-12T18:01:44.173172+0000","last_clean":"2024-09-12T18:01:44.173172+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:01:44.173172+0000","last_undegraded":"2024-09-12T18:01:44.173172+0000","last_fullsized":"2024-09-12T18:01:44.173172+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T18:01:44.173075+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T18:01:44.173075+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.173075+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:11.613716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'854","reported_seq":2442,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.530340+0000","last_change":"2024-09-12T18:01:29.530340+0000","last_active":"2024-09-12T18:01:29.530340+0000","last_peered":"2024-09-12T18:01:29.530340+0000","last_clean":"2024-09-12T18:01:29.530340+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T18:01:29.530340+0000","last_undegraded":"2024-09-12T18:01:29.530340+0000","last_fullsized":"2024-09-12T18:01:29.530340+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'854","last_scrub_stamp":"2024-09-12T18:01:29.530238+0000","last_deep_scrub":"265'854","last_deep_scrub_stamp":"2024-09-12T18:01:29.530238+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.530238+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.790227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'294","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.520281+0000","last_change":"2024-09-12T18:01:14.520281+0000","last_active":"2024-09-12T18:01:14.520281+0000","last_peered":"2024-09-12T18:01:14.520281+0000","last_clean":"2024-09-12T18:01:14.520281+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T18:01:14.520281+0000","last_undegraded":"2024-09-12T18:01:14.520281+0000","last_fullsized":"2024-09-12T18:01:14.520281+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.520053+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:15.981715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":437,"num_read_kb":12213,"num_write":961,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.167605+0000","last_change":"2024-09-12T18:01:36.167605+0000","last_active":"2024-09-12T18:01:36.167605+0000","last_peered":"2024-09-12T18:01:36.167605+0000","last_clean":"2024-09-12T18:01:36.167605+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T18:01:36.167605+0000","last_undegraded":"2024-09-12T18:01:36.167605+0000","last_fullsized":"2024-09-12T18:01:36.167605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:36.167506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:36.167506+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.167506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:29.693639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'282","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.186559+0000","last_change":"2024-09-12T18:01:37.186559+0000","last_active":"2024-09-12T18:01:37.186559+0000","last_peered":"2024-09-12T18:01:37.186559+0000","last_clean":"2024-09-12T18:01:37.186559+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:37.186559+0000","last_undegraded":"2024-09-12T18:01:37.186559+0000","last_fullsized":"2024-09-12T18:01:37.186559+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-12T18:01:37.186454+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-12T18:01:37.186454+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.186454+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:09.115622+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":997,"num_write":362,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'771","reported_seq":2293,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.357248+0000","last_change":"2024-09-12T18:01:29.357248+0000","last_active":"2024-09-12T18:01:29.357248+0000","last_peered":"2024-09-12T18:01:29.357248+0000","last_clean":"2024-09-12T18:01:29.357248+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:01:29.357248+0000","last_undegraded":"2024-09-12T18:01:29.357248+0000","last_fullsized":"2024-09-12T18:01:29.357248+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.357164+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:53.556672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'96","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.434624+0000","last_change":"2024-09-12T18:01:37.434624+0000","last_active":"2024-09-12T18:01:37.434624+0000","last_peered":"2024-09-12T18:01:37.434624+0000","last_clean":"2024-09-12T18:01:37.434624+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T18:01:37.434624+0000","last_undegraded":"2024-09-12T18:01:37.434624+0000","last_fullsized":"2024-09-12T18:01:37.434624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T18:01:37.434524+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T18:01:37.434524+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.434524+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.206978+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'396","reported_seq":1807,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.965656+0000","last_change":"2024-09-12T18:01:17.965656+0000","last_active":"2024-09-12T18:01:17.965656+0000","last_peered":"2024-09-12T18:01:17.965656+0000","last_clean":"2024-09-12T18:01:17.965656+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T18:01:17.965656+0000","last_undegraded":"2024-09-12T18:01:17.965656+0000","last_fullsized":"2024-09-12T18:01:17.965656+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.965565+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:50.887093+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.514617+0000","last_change":"2024-09-12T18:01:15.514617+0000","last_active":"2024-09-12T18:01:15.514617+0000","last_peered":"2024-09-12T18:01:15.514617+0000","last_clean":"2024-09-12T18:01:15.514617+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T18:01:15.514617+0000","last_undegraded":"2024-09-12T18:01:15.514617+0000","last_fullsized":"2024-09-12T18:01:15.514617+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.514479+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.305976+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":2738,"num_write":1044,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.223394+0000","last_change":"2024-09-12T18:01:25.223394+0000","last_active":"2024-09-12T18:01:25.223394+0000","last_peered":"2024-09-12T18:01:25.223394+0000","last_clean":"2024-09-12T18:01:25.223394+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:01:25.223394+0000","last_undegraded":"2024-09-12T18:01:25.223394+0000","last_fullsized":"2024-09-12T18:01:25.223394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.223302+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:28.092756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'81","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.323227+0000","last_change":"2024-09-12T18:01:30.323227+0000","last_active":"2024-09-12T18:01:30.323227+0000","last_peered":"2024-09-12T18:01:30.323227+0000","last_clean":"2024-09-12T18:01:30.323227+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T18:01:30.323227+0000","last_undegraded":"2024-09-12T18:01:30.323227+0000","last_fullsized":"2024-09-12T18:01:30.323227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'81","last_scrub_stamp":"2024-09-12T18:01:30.323110+0000","last_deep_scrub":"265'81","last_deep_scrub_stamp":"2024-09-12T18:01:30.323110+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.323110+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:06.144106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":2237,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.223144+0000","last_change":"2024-09-12T18:01:33.223144+0000","last_active":"2024-09-12T18:01:33.223144+0000","last_peered":"2024-09-12T18:01:33.223144+0000","last_clean":"2024-09-12T18:01:33.223144+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:01:33.223144+0000","last_undegraded":"2024-09-12T18:01:33.223144+0000","last_fullsized":"2024-09-12T18:01:33.223144+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:33.223061+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:33.223061+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.223061+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:43.060671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.967997+0000","last_change":"2024-09-12T18:01:33.967905+0000","last_active":"2024-09-12T18:01:33.967997+0000","last_peered":"2024-09-12T18:01:33.967997+0000","last_clean":"2024-09-12T18:01:33.967997+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T18:01:33.967997+0000","last_undegraded":"2024-09-12T18:01:33.967997+0000","last_fullsized":"2024-09-12T18:01:33.967997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T18:01:33.967774+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T18:01:33.967774+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.967774+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:11.664850+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'768","reported_seq":2400,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.479454+0000","last_change":"2024-09-12T18:01:16.479454+0000","last_active":"2024-09-12T18:01:16.479454+0000","last_peered":"2024-09-12T18:01:16.479454+0000","last_clean":"2024-09-12T18:01:16.479454+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T18:01:16.479454+0000","last_undegraded":"2024-09-12T18:01:16.479454+0000","last_fullsized":"2024-09-12T18:01:16.479454+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'768","last_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_deep_scrub":"265'768","last_deep_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.479358+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:38.320465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.882054+0000","last_change":"2024-09-12T18:01:14.882054+0000","last_active":"2024-09-12T18:01:14.882054+0000","last_peered":"2024-09-12T18:01:14.882054+0000","last_clean":"2024-09-12T18:01:14.882054+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T18:01:14.882054+0000","last_undegraded":"2024-09-12T18:01:14.882054+0000","last_fullsized":"2024-09-12T18:01:14.882054+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.881906+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:47.911992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":10060,"num_write":877,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.690245+0000","last_change":"2024-09-12T18:01:38.690245+0000","last_active":"2024-09-12T18:01:38.690245+0000","last_peered":"2024-09-12T18:01:38.690245+0000","last_clean":"2024-09-12T18:01:38.690245+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T18:01:38.690245+0000","last_undegraded":"2024-09-12T18:01:38.690245+0000","last_fullsized":"2024-09-12T18:01:38.690245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:38.690153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:38.690153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.690153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:05.375887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'327","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.272421+0000","last_change":"2024-09-12T18:01:28.272421+0000","last_active":"2024-09-12T18:01:28.272421+0000","last_peered":"2024-09-12T18:01:28.272421+0000","last_clean":"2024-09-12T18:01:28.272421+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:01:28.272421+0000","last_undegraded":"2024-09-12T18:01:28.272421+0000","last_fullsized":"2024-09-12T18:01:28.272421+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T18:01:28.272327+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T18:01:28.272327+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.272327+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:41.326166+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46691,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1100,"num_read_kb":1651,"num_write":1580,"num_write_kb":1458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.088824+0000","last_change":"2024-09-12T18:01:31.088824+0000","last_active":"2024-09-12T18:01:31.088824+0000","last_peered":"2024-09-12T18:01:31.088824+0000","last_clean":"2024-09-12T18:01:31.088824+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T18:01:31.088824+0000","last_undegraded":"2024-09-12T18:01:31.088824+0000","last_fullsized":"2024-09-12T18:01:31.088824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.088735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.088735+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.088735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:19.017921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'102","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.247970+0000","last_change":"2024-09-12T18:01:35.247970+0000","last_active":"2024-09-12T18:01:35.247970+0000","last_peered":"2024-09-12T18:01:35.247970+0000","last_clean":"2024-09-12T18:01:35.247970+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T18:01:35.247970+0000","last_undegraded":"2024-09-12T18:01:35.247970+0000","last_fullsized":"2024-09-12T18:01:35.247970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T18:01:35.247852+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T18:01:35.247852+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.247852+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:37.446347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'462","reported_seq":2041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.560308+0000","last_change":"2024-09-12T18:01:27.560251+0000","last_active":"2024-09-12T18:01:27.560308+0000","last_peered":"2024-09-12T18:01:27.560308+0000","last_clean":"2024-09-12T18:01:27.560308+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T18:01:27.560308+0000","last_undegraded":"2024-09-12T18:01:27.560308+0000","last_fullsized":"2024-09-12T18:01:27.560308+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T18:01:27.560153+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T18:01:27.560153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.560153+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:20.180962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.117810+0000","last_change":"2024-09-12T18:01:09.117716+0000","last_active":"2024-09-12T18:01:09.117810+0000","last_peered":"2024-09-12T18:01:09.117810+0000","last_clean":"2024-09-12T18:01:09.117810+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T18:01:09.117810+0000","last_undegraded":"2024-09-12T18:01:09.117810+0000","last_fullsized":"2024-09-12T18:01:09.117810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.117622+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:48.788505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.420686+0000","last_change":"2024-09-12T18:01:12.420634+0000","last_active":"2024-09-12T18:01:12.420686+0000","last_peered":"2024-09-12T18:01:12.420686+0000","last_clean":"2024-09-12T18:01:12.420686+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T18:01:12.420686+0000","last_undegraded":"2024-09-12T18:01:12.420686+0000","last_fullsized":"2024-09-12T18:01:12.420686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.420560+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:05.743402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'352","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.926268+0000","last_change":"2024-09-12T18:01:10.926183+0000","last_active":"2024-09-12T18:01:10.926268+0000","last_peered":"2024-09-12T18:01:10.926268+0000","last_clean":"2024-09-12T18:01:10.926268+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T18:01:10.926268+0000","last_undegraded":"2024-09-12T18:01:10.926268+0000","last_fullsized":"2024-09-12T18:01:10.926268+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.925996+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.144031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2336230,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":631,"num_read_kb":42380,"num_write":1169,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.733401+0000","last_change":"2024-09-12T18:01:27.733275+0000","last_active":"2024-09-12T18:01:27.733401+0000","last_peered":"2024-09-12T18:01:27.733401+0000","last_clean":"2024-09-12T18:01:27.733401+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T18:01:27.733401+0000","last_undegraded":"2024-09-12T18:01:27.733401+0000","last_fullsized":"2024-09-12T18:01:27.733401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.733178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.733178+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.733178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:38.417573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'743","reported_seq":1450,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.711411+0000","last_change":"2024-09-12T18:01:42.711411+0000","last_active":"2024-09-12T18:01:42.711411+0000","last_peered":"2024-09-12T18:01:42.711411+0000","last_clean":"2024-09-12T18:01:42.711411+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:01:42.711411+0000","last_undegraded":"2024-09-12T18:01:42.711411+0000","last_fullsized":"2024-09-12T18:01:42.711411+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'743","last_scrub_stamp":"2024-09-12T18:01:42.711315+0000","last_deep_scrub":"265'743","last_deep_scrub_stamp":"2024-09-12T18:01:42.711315+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.711315+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:30.938504+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169172,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1452,"num_read_kb":3379,"num_write":1380,"num_write_kb":1257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106776,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.188799+0000","last_change":"2024-09-12T18:01:39.188799+0000","last_active":"2024-09-12T18:01:39.188799+0000","last_peered":"2024-09-12T18:01:39.188799+0000","last_clean":"2024-09-12T18:01:39.188799+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T18:01:39.188799+0000","last_undegraded":"2024-09-12T18:01:39.188799+0000","last_fullsized":"2024-09-12T18:01:39.188799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:39.188700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:39.188700+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.188700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:27.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.826146+0000","last_change":"2024-09-12T18:01:31.826146+0000","last_active":"2024-09-12T18:01:31.826146+0000","last_peered":"2024-09-12T18:01:31.826146+0000","last_clean":"2024-09-12T18:01:31.826146+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T18:01:31.826146+0000","last_undegraded":"2024-09-12T18:01:31.826146+0000","last_fullsized":"2024-09-12T18:01:31.826146+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T18:01:31.826057+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T18:01:31.826057+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.826057+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:02.628612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'470","reported_seq":2002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.056494+0000","last_change":"2024-09-12T18:01:25.056494+0000","last_active":"2024-09-12T18:01:25.056494+0000","last_peered":"2024-09-12T18:01:25.056494+0000","last_clean":"2024-09-12T18:01:25.056494+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T18:01:25.056494+0000","last_undegraded":"2024-09-12T18:01:25.056494+0000","last_fullsized":"2024-09-12T18:01:25.056494+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.056406+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.664820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.447739+0000","last_change":"2024-09-12T18:01:10.447676+0000","last_active":"2024-09-12T18:01:10.447739+0000","last_peered":"2024-09-12T18:01:10.447739+0000","last_clean":"2024-09-12T18:01:10.447739+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T18:01:10.447739+0000","last_undegraded":"2024-09-12T18:01:10.447739+0000","last_fullsized":"2024-09-12T18:01:10.447739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.447603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.379942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'393","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.197108+0000","last_change":"2024-09-12T18:01:12.197015+0000","last_active":"2024-09-12T18:01:12.197108+0000","last_peered":"2024-09-12T18:01:12.197108+0000","last_clean":"2024-09-12T18:01:12.197108+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T18:01:12.197108+0000","last_undegraded":"2024-09-12T18:01:12.197108+0000","last_fullsized":"2024-09-12T18:01:12.197108+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.196860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:38.459956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":13401,"num_write":1361,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.644723+0000","last_change":"2024-09-12T18:01:37.644723+0000","last_active":"2024-09-12T18:01:37.644723+0000","last_peered":"2024-09-12T18:01:37.644723+0000","last_clean":"2024-09-12T18:01:37.644723+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T18:01:37.644723+0000","last_undegraded":"2024-09-12T18:01:37.644723+0000","last_fullsized":"2024-09-12T18:01:37.644723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:37.644634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:37.644634+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.644634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:18.470045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.335212+0000","last_change":"2024-09-12T18:01:27.335085+0000","last_active":"2024-09-12T18:01:27.335212+0000","last_peered":"2024-09-12T18:01:27.335212+0000","last_clean":"2024-09-12T18:01:27.335212+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:01:27.335212+0000","last_undegraded":"2024-09-12T18:01:27.335212+0000","last_fullsized":"2024-09-12T18:01:27.335212+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.334961+0000","objects_scrubbed":12,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:37.159404+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161465,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1982,"num_read_kb":3789,"num_write":1078,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.756233+0000","last_change":"2024-09-12T18:01:48.756233+0000","last_active":"2024-09-12T18:01:48.756233+0000","last_peered":"2024-09-12T18:01:48.756233+0000","last_clean":"2024-09-12T18:01:48.756233+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T18:01:48.756233+0000","last_undegraded":"2024-09-12T18:01:48.756233+0000","last_fullsized":"2024-09-12T18:01:48.756233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:48.756131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:48.756131+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.756131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:46.782387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.204122+0000","last_change":"2024-09-12T18:01:46.204122+0000","last_active":"2024-09-12T18:01:46.204122+0000","last_peered":"2024-09-12T18:01:46.204122+0000","last_clean":"2024-09-12T18:01:46.204122+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T18:01:46.204122+0000","last_undegraded":"2024-09-12T18:01:46.204122+0000","last_fullsized":"2024-09-12T18:01:46.204122+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T18:01:46.204039+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T18:01:46.204039+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.204039+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:37.330326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'450","reported_seq":1966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.237463+0000","last_change":"2024-09-12T18:01:19.237463+0000","last_active":"2024-09-12T18:01:19.237463+0000","last_peered":"2024-09-12T18:01:19.237463+0000","last_clean":"2024-09-12T18:01:19.237463+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T18:01:19.237463+0000","last_undegraded":"2024-09-12T18:01:19.237463+0000","last_fullsized":"2024-09-12T18:01:19.237463+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'450","last_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_deep_scrub":"265'450","last_deep_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.237381+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:11.813533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.385055+0000","last_change":"2024-09-12T18:01:12.385001+0000","last_active":"2024-09-12T18:01:12.385055+0000","last_peered":"2024-09-12T18:01:12.385055+0000","last_clean":"2024-09-12T18:01:12.385055+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T18:01:12.385055+0000","last_undegraded":"2024-09-12T18:01:12.385055+0000","last_fullsized":"2024-09-12T18:01:12.385055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.384902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:54.391667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'374","reported_seq":1097,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.983438+0000","last_change":"2024-09-12T18:01:11.983349+0000","last_active":"2024-09-12T18:01:11.983438+0000","last_peered":"2024-09-12T18:01:11.983438+0000","last_clean":"2024-09-12T18:01:11.983438+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:11.983438+0000","last_undegraded":"2024-09-12T18:01:11.983438+0000","last_fullsized":"2024-09-12T18:01:11.983438+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.983172+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:23.268960+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730187,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":557,"num_read_kb":34998,"num_write":1154,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.411308+0000","last_change":"2024-09-12T18:01:25.411308+0000","last_active":"2024-09-12T18:01:25.411308+0000","last_peered":"2024-09-12T18:01:25.411308+0000","last_clean":"2024-09-12T18:01:25.411308+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T18:01:25.411308+0000","last_undegraded":"2024-09-12T18:01:25.411308+0000","last_fullsized":"2024-09-12T18:01:25.411308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.411217+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:45.178080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'204","reported_seq":1222,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.676434+0000","last_change":"2024-09-12T18:01:25.676351+0000","last_active":"2024-09-12T18:01:25.676434+0000","last_peered":"2024-09-12T18:01:25.676434+0000","last_clean":"2024-09-12T18:01:25.676434+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:01:25.676434+0000","last_undegraded":"2024-09-12T18:01:25.676434+0000","last_fullsized":"2024-09-12T18:01:25.676434+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'204","last_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_deep_scrub":"265'204","last_deep_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.676244+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:26.820945+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.927846+0000","last_change":"2024-09-12T18:01:41.927846+0000","last_active":"2024-09-12T18:01:41.927846+0000","last_peered":"2024-09-12T18:01:41.927846+0000","last_clean":"2024-09-12T18:01:41.927846+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T18:01:41.927846+0000","last_undegraded":"2024-09-12T18:01:41.927846+0000","last_fullsized":"2024-09-12T18:01:41.927846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:41.927746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:41.927746+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.927746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:22.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'291","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.027003+0000","last_change":"2024-09-12T18:01:46.027003+0000","last_active":"2024-09-12T18:01:46.027003+0000","last_peered":"2024-09-12T18:01:46.027003+0000","last_clean":"2024-09-12T18:01:46.027003+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T18:01:46.027003+0000","last_undegraded":"2024-09-12T18:01:46.027003+0000","last_fullsized":"2024-09-12T18:01:46.027003+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'291","last_scrub_stamp":"2024-09-12T18:01:46.026914+0000","last_deep_scrub":"265'291","last_deep_scrub_stamp":"2024-09-12T18:01:46.026914+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.026914+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:57.882654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'471","reported_seq":2090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.224929+0000","last_change":"2024-09-12T18:01:20.224814+0000","last_active":"2024-09-12T18:01:20.224929+0000","last_peered":"2024-09-12T18:01:20.224929+0000","last_clean":"2024-09-12T18:01:20.224929+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:01:20.224929+0000","last_undegraded":"2024-09-12T18:01:20.224929+0000","last_fullsized":"2024-09-12T18:01:20.224929+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.224700+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.621486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2751,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.470570+0000","last_change":"2024-09-12T18:01:11.470497+0000","last_active":"2024-09-12T18:01:11.470570+0000","last_peered":"2024-09-12T18:01:11.470570+0000","last_clean":"2024-09-12T18:01:11.470570+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T18:01:11.470570+0000","last_undegraded":"2024-09-12T18:01:11.470570+0000","last_fullsized":"2024-09-12T18:01:11.470570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.470415+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:45.118041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'409","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.756765+0000","last_change":"2024-09-12T18:01:13.756692+0000","last_active":"2024-09-12T18:01:13.756765+0000","last_peered":"2024-09-12T18:01:13.756765+0000","last_clean":"2024-09-12T18:01:13.756765+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T18:01:13.756765+0000","last_undegraded":"2024-09-12T18:01:13.756765+0000","last_fullsized":"2024-09-12T18:01:13.756765+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.756554+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:52.180446+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3307398,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":11802,"num_write":1361,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.460960+0000","last_change":"2024-09-12T18:01:22.460871+0000","last_active":"2024-09-12T18:01:22.460960+0000","last_peered":"2024-09-12T18:01:22.460960+0000","last_clean":"2024-09-12T18:01:22.460960+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T18:01:22.460960+0000","last_undegraded":"2024-09-12T18:01:22.460960+0000","last_fullsized":"2024-09-12T18:01:22.460960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.460761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:40.754930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'110","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.204385+0000","last_change":"2024-09-12T18:01:35.204385+0000","last_active":"2024-09-12T18:01:35.204385+0000","last_peered":"2024-09-12T18:01:35.204385+0000","last_clean":"2024-09-12T18:01:35.204385+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:01:35.204385+0000","last_undegraded":"2024-09-12T18:01:35.204385+0000","last_fullsized":"2024-09-12T18:01:35.204385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T18:01:35.204295+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T18:01:35.204295+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.204295+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:10.371257+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.766710+0000","last_change":"2024-09-12T18:01:47.766710+0000","last_active":"2024-09-12T18:01:47.766710+0000","last_peered":"2024-09-12T18:01:47.766710+0000","last_clean":"2024-09-12T18:01:47.766710+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T18:01:47.766710+0000","last_undegraded":"2024-09-12T18:01:47.766710+0000","last_fullsized":"2024-09-12T18:01:47.766710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.766617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.766617+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.766617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:12.165623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'142","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.279797+0000","last_change":"2024-09-12T18:01:36.279797+0000","last_active":"2024-09-12T18:01:36.279797+0000","last_peered":"2024-09-12T18:01:36.279797+0000","last_clean":"2024-09-12T18:01:36.279797+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T18:01:36.279797+0000","last_undegraded":"2024-09-12T18:01:36.279797+0000","last_fullsized":"2024-09-12T18:01:36.279797+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T18:01:36.279708+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T18:01:36.279708+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.279708+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:09.632880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'877","reported_seq":2715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.277456+0000","last_change":"2024-09-12T18:01:18.277389+0000","last_active":"2024-09-12T18:01:18.277456+0000","last_peered":"2024-09-12T18:01:18.277456+0000","last_clean":"2024-09-12T18:01:18.277456+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T18:01:18.277456+0000","last_undegraded":"2024-09-12T18:01:18.277456+0000","last_fullsized":"2024-09-12T18:01:18.277456+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'877","last_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_deep_scrub":"265'877","last_deep_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.277308+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:23.770820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'375","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.954807+0000","last_change":"2024-09-12T18:01:09.954746+0000","last_active":"2024-09-12T18:01:09.954807+0000","last_peered":"2024-09-12T18:01:09.954807+0000","last_clean":"2024-09-12T18:01:09.954807+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T18:01:09.954807+0000","last_undegraded":"2024-09-12T18:01:09.954807+0000","last_fullsized":"2024-09-12T18:01:09.954807+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.954652+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:15.491590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":25520,"num_write":1246,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.942208+0000","last_change":"2024-09-12T18:01:10.942149+0000","last_active":"2024-09-12T18:01:10.942208+0000","last_peered":"2024-09-12T18:01:10.942208+0000","last_clean":"2024-09-12T18:01:10.942208+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T18:01:10.942208+0000","last_undegraded":"2024-09-12T18:01:10.942208+0000","last_fullsized":"2024-09-12T18:01:10.942208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.942018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:03.095012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.895051+0000","last_change":"2024-09-12T18:01:28.894958+0000","last_active":"2024-09-12T18:01:28.895051+0000","last_peered":"2024-09-12T18:01:28.895051+0000","last_clean":"2024-09-12T18:01:28.895051+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T18:01:28.895051+0000","last_undegraded":"2024-09-12T18:01:28.895051+0000","last_fullsized":"2024-09-12T18:01:28.895051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.894849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.894849+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.894849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:24.705150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'550","reported_seq":1209,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.376770+0000","last_change":"2024-09-12T18:01:26.376661+0000","last_active":"2024-09-12T18:01:26.376770+0000","last_peered":"2024-09-12T18:01:26.376770+0000","last_clean":"2024-09-12T18:01:26.376770+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:01:26.376770+0000","last_undegraded":"2024-09-12T18:01:26.376770+0000","last_fullsized":"2024-09-12T18:01:26.376770+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.376538+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:29.127764+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106777,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":960,"num_read_kb":2265,"num_write":794,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.074722+0000","last_change":"2024-09-12T18:01:28.074662+0000","last_active":"2024-09-12T18:01:28.074722+0000","last_peered":"2024-09-12T18:01:28.074722+0000","last_clean":"2024-09-12T18:01:28.074722+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T18:01:28.074722+0000","last_undegraded":"2024-09-12T18:01:28.074722+0000","last_fullsized":"2024-09-12T18:01:28.074722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.074566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.074566+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.074566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:23.015818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'170","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.121287+0000","last_change":"2024-09-12T18:01:48.121287+0000","last_active":"2024-09-12T18:01:48.121287+0000","last_peered":"2024-09-12T18:01:48.121287+0000","last_clean":"2024-09-12T18:01:48.121287+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T18:01:48.121287+0000","last_undegraded":"2024-09-12T18:01:48.121287+0000","last_fullsized":"2024-09-12T18:01:48.121287+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'170","last_scrub_stamp":"2024-09-12T18:01:48.121192+0000","last_deep_scrub":"265'170","last_deep_scrub_stamp":"2024-09-12T18:01:48.121192+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.121192+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:50.194249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'829","reported_seq":2355,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.342186+0000","last_change":"2024-09-12T18:01:24.342131+0000","last_active":"2024-09-12T18:01:24.342186+0000","last_peered":"2024-09-12T18:01:24.342186+0000","last_clean":"2024-09-12T18:01:24.342186+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T18:01:24.342186+0000","last_undegraded":"2024-09-12T18:01:24.342186+0000","last_fullsized":"2024-09-12T18:01:24.342186+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.342040+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:50.354462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1941,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'375","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.187589+0000","last_change":"2024-09-12T18:01:13.187529+0000","last_active":"2024-09-12T18:01:13.187589+0000","last_peered":"2024-09-12T18:01:13.187589+0000","last_clean":"2024-09-12T18:01:13.187589+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T18:01:13.187589+0000","last_undegraded":"2024-09-12T18:01:13.187589+0000","last_fullsized":"2024-09-12T18:01:13.187589+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.187403+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.594187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":578,"num_read_kb":7304,"num_write":1242,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.501217+0000","last_change":"2024-09-12T18:01:17.501129+0000","last_active":"2024-09-12T18:01:17.501217+0000","last_peered":"2024-09-12T18:01:17.501217+0000","last_clean":"2024-09-12T18:01:17.501217+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T18:01:17.501217+0000","last_undegraded":"2024-09-12T18:01:17.501217+0000","last_fullsized":"2024-09-12T18:01:17.501217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.501027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:12.800178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.665718+0000","last_change":"2024-09-12T18:01:24.665652+0000","last_active":"2024-09-12T18:01:24.665718+0000","last_peered":"2024-09-12T18:01:24.665718+0000","last_clean":"2024-09-12T18:01:24.665718+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T18:01:24.665718+0000","last_undegraded":"2024-09-12T18:01:24.665718+0000","last_fullsized":"2024-09-12T18:01:24.665718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.665551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:34.966186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'162","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.359403+0000","last_change":"2024-09-12T18:01:31.359344+0000","last_active":"2024-09-12T18:01:31.359403+0000","last_peered":"2024-09-12T18:01:31.359403+0000","last_clean":"2024-09-12T18:01:31.359403+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T18:01:31.359403+0000","last_undegraded":"2024-09-12T18:01:31.359403+0000","last_fullsized":"2024-09-12T18:01:31.359403+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T18:01:31.359242+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T18:01:31.359242+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.359242+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:21.065971+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'806","reported_seq":2578,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.250149+0000","last_change":"2024-09-12T18:01:31.250072+0000","last_active":"2024-09-12T18:01:31.250149+0000","last_peered":"2024-09-12T18:01:31.250149+0000","last_clean":"2024-09-12T18:01:31.250149+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:01:31.250149+0000","last_undegraded":"2024-09-12T18:01:31.250149+0000","last_fullsized":"2024-09-12T18:01:31.250149+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:31.249972+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:31.249972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.249972+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:41.476948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'112","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.289661+0000","last_change":"2024-09-12T18:01:36.289661+0000","last_active":"2024-09-12T18:01:36.289661+0000","last_peered":"2024-09-12T18:01:36.289661+0000","last_clean":"2024-09-12T18:01:36.289661+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:01:36.289661+0000","last_undegraded":"2024-09-12T18:01:36.289661+0000","last_fullsized":"2024-09-12T18:01:36.289661+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T18:01:36.289568+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T18:01:36.289568+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.289568+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:21.733683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'875","reported_seq":2595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.833785+0000","last_change":"2024-09-12T18:01:16.833708+0000","last_active":"2024-09-12T18:01:16.833785+0000","last_peered":"2024-09-12T18:01:16.833785+0000","last_clean":"2024-09-12T18:01:16.833785+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T18:01:16.833785+0000","last_undegraded":"2024-09-12T18:01:16.833785+0000","last_fullsized":"2024-09-12T18:01:16.833785+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'875","last_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_deep_scrub":"265'875","last_deep_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.833613+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.664041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":649,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'365","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.878116+0000","last_change":"2024-09-12T18:01:13.878116+0000","last_active":"2024-09-12T18:01:13.878116+0000","last_peered":"2024-09-12T18:01:13.878116+0000","last_clean":"2024-09-12T18:01:13.878116+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T18:01:13.878116+0000","last_undegraded":"2024-09-12T18:01:13.878116+0000","last_fullsized":"2024-09-12T18:01:13.878116+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.877983+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.503105+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831558,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":10322,"num_write":1179,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.894172+0000","last_change":"2024-09-12T18:01:11.894172+0000","last_active":"2024-09-12T18:01:11.894172+0000","last_peered":"2024-09-12T18:01:11.894172+0000","last_clean":"2024-09-12T18:01:11.894172+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T18:01:11.894172+0000","last_undegraded":"2024-09-12T18:01:11.894172+0000","last_fullsized":"2024-09-12T18:01:11.894172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.894084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:44.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.601900+0000","last_change":"2024-09-12T18:01:36.601900+0000","last_active":"2024-09-12T18:01:36.601900+0000","last_peered":"2024-09-12T18:01:36.601900+0000","last_clean":"2024-09-12T18:01:36.601900+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T18:01:36.601900+0000","last_undegraded":"2024-09-12T18:01:36.601900+0000","last_fullsized":"2024-09-12T18:01:36.601900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:36.601800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:36.601800+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.601800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:53.159379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'101","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.728282+0000","last_change":"2024-09-12T18:01:41.728282+0000","last_active":"2024-09-12T18:01:41.728282+0000","last_peered":"2024-09-12T18:01:41.728282+0000","last_clean":"2024-09-12T18:01:41.728282+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T18:01:41.728282+0000","last_undegraded":"2024-09-12T18:01:41.728282+0000","last_fullsized":"2024-09-12T18:01:41.728282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T18:01:41.728189+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T18:01:41.728189+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.728189+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:46.696780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'810","reported_seq":2366,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.150122+0000","last_change":"2024-09-12T18:01:38.150122+0000","last_active":"2024-09-12T18:01:38.150122+0000","last_peered":"2024-09-12T18:01:38.150122+0000","last_clean":"2024-09-12T18:01:38.150122+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:38.150122+0000","last_undegraded":"2024-09-12T18:01:38.150122+0000","last_fullsized":"2024-09-12T18:01:38.150122+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'810","last_scrub_stamp":"2024-09-12T18:01:38.150024+0000","last_deep_scrub":"265'810","last_deep_scrub_stamp":"2024-09-12T18:01:38.150024+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.150024+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:28.471792+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'328","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.198972+0000","last_change":"2024-09-12T18:01:45.198972+0000","last_active":"2024-09-12T18:01:45.198972+0000","last_peered":"2024-09-12T18:01:45.198972+0000","last_clean":"2024-09-12T18:01:45.198972+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T18:01:45.198972+0000","last_undegraded":"2024-09-12T18:01:45.198972+0000","last_fullsized":"2024-09-12T18:01:45.198972+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-12T18:01:45.198878+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-12T18:01:45.198878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.198878+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:42.913988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'493","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.925408+0000","last_change":"2024-09-12T18:01:16.925347+0000","last_active":"2024-09-12T18:01:16.925408+0000","last_peered":"2024-09-12T18:01:16.925408+0000","last_clean":"2024-09-12T18:01:16.925408+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T18:01:16.925408+0000","last_undegraded":"2024-09-12T18:01:16.925408+0000","last_fullsized":"2024-09-12T18:01:16.925408+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'493","last_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_deep_scrub":"265'493","last_deep_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.925258+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:35.178082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'332","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.877403+0000","last_change":"2024-09-12T18:01:12.877403+0000","last_active":"2024-09-12T18:01:12.877403+0000","last_peered":"2024-09-12T18:01:12.877403+0000","last_clean":"2024-09-12T18:01:12.877403+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T18:01:12.877403+0000","last_undegraded":"2024-09-12T18:01:12.877403+0000","last_fullsized":"2024-09-12T18:01:12.877403+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.877095+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:51.937844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287862,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59240,"num_write":1015,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.467414+0000","last_change":"2024-09-12T18:01:13.467414+0000","last_active":"2024-09-12T18:01:13.467414+0000","last_peered":"2024-09-12T18:01:13.467414+0000","last_clean":"2024-09-12T18:01:13.467414+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T18:01:13.467414+0000","last_undegraded":"2024-09-12T18:01:13.467414+0000","last_fullsized":"2024-09-12T18:01:13.467414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.467313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.884795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.917945+0000","last_change":"2024-09-12T18:01:27.917890+0000","last_active":"2024-09-12T18:01:27.917945+0000","last_peered":"2024-09-12T18:01:27.917945+0000","last_clean":"2024-09-12T18:01:27.917945+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T18:01:27.917945+0000","last_undegraded":"2024-09-12T18:01:27.917945+0000","last_fullsized":"2024-09-12T18:01:27.917945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.917798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.917798+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.917798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:37.435561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'752","reported_seq":1470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.754357+0000","last_change":"2024-09-12T18:01:28.754297+0000","last_active":"2024-09-12T18:01:28.754357+0000","last_peered":"2024-09-12T18:01:28.754357+0000","last_clean":"2024-09-12T18:01:28.754357+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:01:28.754357+0000","last_undegraded":"2024-09-12T18:01:28.754357+0000","last_fullsized":"2024-09-12T18:01:28.754357+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'752","last_scrub_stamp":"2024-09-12T18:01:28.754192+0000","last_deep_scrub":"265'752","last_deep_scrub_stamp":"2024-09-12T18:01:28.754192+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.754192+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:15.599654+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1320,"num_read_kb":3172,"num_write":1088,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.909610+0000","last_change":"2024-09-12T18:01:40.909610+0000","last_active":"2024-09-12T18:01:40.909610+0000","last_peered":"2024-09-12T18:01:40.909610+0000","last_clean":"2024-09-12T18:01:40.909610+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T18:01:40.909610+0000","last_undegraded":"2024-09-12T18:01:40.909610+0000","last_fullsized":"2024-09-12T18:01:40.909610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.909516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.909516+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.909516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.372263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'135","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.046514+0000","last_change":"2024-09-12T18:01:36.046514+0000","last_active":"2024-09-12T18:01:36.046514+0000","last_peered":"2024-09-12T18:01:36.046514+0000","last_clean":"2024-09-12T18:01:36.046514+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T18:01:36.046514+0000","last_undegraded":"2024-09-12T18:01:36.046514+0000","last_fullsized":"2024-09-12T18:01:36.046514+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T18:01:36.046428+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T18:01:36.046428+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.046428+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:42.080685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'153","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.038139+0000","last_change":"2024-09-12T18:01:47.038139+0000","last_active":"2024-09-12T18:01:47.038139+0000","last_peered":"2024-09-12T18:01:47.038139+0000","last_clean":"2024-09-12T18:01:47.038139+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T18:01:47.038139+0000","last_undegraded":"2024-09-12T18:01:47.038139+0000","last_fullsized":"2024-09-12T18:01:47.038139+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T18:01:47.038042+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T18:01:47.038042+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.038042+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:07.811045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'470","reported_seq":2074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.001611+0000","last_change":"2024-09-12T18:01:19.001546+0000","last_active":"2024-09-12T18:01:19.001611+0000","last_peered":"2024-09-12T18:01:19.001611+0000","last_clean":"2024-09-12T18:01:19.001611+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T18:01:19.001611+0000","last_undegraded":"2024-09-12T18:01:19.001611+0000","last_fullsized":"2024-09-12T18:01:19.001611+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.001453+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:36.748667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'322","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.476817+0000","last_change":"2024-09-12T18:01:18.476752+0000","last_active":"2024-09-12T18:01:18.476817+0000","last_peered":"2024-09-12T18:01:18.476817+0000","last_clean":"2024-09-12T18:01:18.476817+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T18:01:18.476817+0000","last_undegraded":"2024-09-12T18:01:18.476817+0000","last_fullsized":"2024-09-12T18:01:18.476817+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.476604+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.563516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":5956,"num_write":1032,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.354526+0000","last_change":"2024-09-12T18:01:28.354442+0000","last_active":"2024-09-12T18:01:28.354526+0000","last_peered":"2024-09-12T18:01:28.354526+0000","last_clean":"2024-09-12T18:01:28.354526+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T18:01:28.354526+0000","last_undegraded":"2024-09-12T18:01:28.354526+0000","last_fullsized":"2024-09-12T18:01:28.354526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.354346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.354346+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.354346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:42.021832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'301","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.443607+0000","last_change":"2024-09-12T18:01:36.443550+0000","last_active":"2024-09-12T18:01:36.443607+0000","last_peered":"2024-09-12T18:01:36.443607+0000","last_clean":"2024-09-12T18:01:36.443607+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T18:01:36.443607+0000","last_undegraded":"2024-09-12T18:01:36.443607+0000","last_fullsized":"2024-09-12T18:01:36.443607+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T18:01:36.443460+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T18:01:36.443460+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.443460+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:03.576675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":1191,"num_write":410,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.312192+0000","last_change":"2024-09-12T18:01:31.312137+0000","last_active":"2024-09-12T18:01:31.312192+0000","last_peered":"2024-09-12T18:01:31.312192+0000","last_clean":"2024-09-12T18:01:31.312192+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T18:01:31.312192+0000","last_undegraded":"2024-09-12T18:01:31.312192+0000","last_fullsized":"2024-09-12T18:01:31.312192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.312055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.312055+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.312055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:57.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.283880+0000","last_change":"2024-09-12T18:01:37.283798+0000","last_active":"2024-09-12T18:01:37.283880+0000","last_peered":"2024-09-12T18:01:37.283880+0000","last_clean":"2024-09-12T18:01:37.283880+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T18:01:37.283880+0000","last_undegraded":"2024-09-12T18:01:37.283880+0000","last_fullsized":"2024-09-12T18:01:37.283880+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T18:01:37.283704+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T18:01:37.283704+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.283704+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:48.879058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'642","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.847310+0000","last_change":"2024-09-12T18:01:18.847253+0000","last_active":"2024-09-12T18:01:18.847310+0000","last_peered":"2024-09-12T18:01:18.847310+0000","last_clean":"2024-09-12T18:01:18.847310+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T18:01:18.847310+0000","last_undegraded":"2024-09-12T18:01:18.847310+0000","last_fullsized":"2024-09-12T18:01:18.847310+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'642","last_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_deep_scrub":"265'642","last_deep_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.847166+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:32.189494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.988551+0000","last_change":"2024-09-12T18:01:12.988551+0000","last_active":"2024-09-12T18:01:12.988551+0000","last_peered":"2024-09-12T18:01:12.988551+0000","last_clean":"2024-09-12T18:01:12.988551+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:12.988551+0000","last_undegraded":"2024-09-12T18:01:12.988551+0000","last_fullsized":"2024-09-12T18:01:12.988551+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.988415+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.161722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25542,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":12892,"num_write":966,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.903442+0000","last_change":"2024-09-12T18:01:29.903381+0000","last_active":"2024-09-12T18:01:29.903442+0000","last_peered":"2024-09-12T18:01:29.903442+0000","last_clean":"2024-09-12T18:01:29.903442+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T18:01:29.903442+0000","last_undegraded":"2024-09-12T18:01:29.903442+0000","last_fullsized":"2024-09-12T18:01:29.903442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.903292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.903292+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.903292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:22.696946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'50","reported_seq":559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.916271+0000","last_change":"2024-09-12T18:01:36.916209+0000","last_active":"2024-09-12T18:01:36.916271+0000","last_peered":"2024-09-12T18:01:36.916271+0000","last_clean":"2024-09-12T18:01:36.916271+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T18:01:36.916271+0000","last_undegraded":"2024-09-12T18:01:36.916271+0000","last_fullsized":"2024-09-12T18:01:36.916271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:36.916109+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:36.916109+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.916109+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:23.996232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.006388+0000","last_change":"2024-09-12T18:01:33.006329+0000","last_active":"2024-09-12T18:01:33.006388+0000","last_peered":"2024-09-12T18:01:33.006388+0000","last_clean":"2024-09-12T18:01:33.006388+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T18:01:33.006388+0000","last_undegraded":"2024-09-12T18:01:33.006388+0000","last_fullsized":"2024-09-12T18:01:33.006388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.006261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.006261+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.006261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:19.171367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'231","reported_seq":770,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.407418+0000","last_change":"2024-09-12T18:01:41.407362+0000","last_active":"2024-09-12T18:01:41.407418+0000","last_peered":"2024-09-12T18:01:41.407418+0000","last_clean":"2024-09-12T18:01:41.407418+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T18:01:41.407418+0000","last_undegraded":"2024-09-12T18:01:41.407418+0000","last_fullsized":"2024-09-12T18:01:41.407418+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'231","last_scrub_stamp":"2024-09-12T18:01:41.407267+0000","last_deep_scrub":"265'231","last_deep_scrub_stamp":"2024-09-12T18:01:41.407267+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.407267+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:13.355719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'388","reported_seq":1873,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.830190+0000","last_change":"2024-09-12T18:01:20.830100+0000","last_active":"2024-09-12T18:01:20.830190+0000","last_peered":"2024-09-12T18:01:20.830190+0000","last_clean":"2024-09-12T18:01:20.830190+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T18:01:20.830190+0000","last_undegraded":"2024-09-12T18:01:20.830190+0000","last_fullsized":"2024-09-12T18:01:20.830190+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.830014+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.815711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'337","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.935172+0000","last_change":"2024-09-12T18:01:12.935172+0000","last_active":"2024-09-12T18:01:12.935172+0000","last_peered":"2024-09-12T18:01:12.935172+0000","last_clean":"2024-09-12T18:01:12.935172+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T18:01:12.935172+0000","last_undegraded":"2024-09-12T18:01:12.935172+0000","last_fullsized":"2024-09-12T18:01:12.935172+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.935024+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:23.088612+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":8586,"num_write":1108,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.015175+0000","last_change":"2024-09-12T18:01:26.015124+0000","last_active":"2024-09-12T18:01:26.015175+0000","last_peered":"2024-09-12T18:01:26.015175+0000","last_clean":"2024-09-12T18:01:26.015175+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T18:01:26.015175+0000","last_undegraded":"2024-09-12T18:01:26.015175+0000","last_fullsized":"2024-09-12T18:01:26.015175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.015036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:53.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'322","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.361742+0000","last_change":"2024-09-12T18:01:28.361686+0000","last_active":"2024-09-12T18:01:28.361742+0000","last_peered":"2024-09-12T18:01:28.361742+0000","last_clean":"2024-09-12T18:01:28.361742+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T18:01:28.361742+0000","last_undegraded":"2024-09-12T18:01:28.361742+0000","last_fullsized":"2024-09-12T18:01:28.361742+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.361576+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:53.552109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54935,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":1244,"num_write":438,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.247647+0000","last_change":"2024-09-12T18:01:32.247532+0000","last_active":"2024-09-12T18:01:32.247647+0000","last_peered":"2024-09-12T18:01:32.247647+0000","last_clean":"2024-09-12T18:01:32.247647+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T18:01:32.247647+0000","last_undegraded":"2024-09-12T18:01:32.247647+0000","last_fullsized":"2024-09-12T18:01:32.247647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.247432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.247432+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.247432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'134","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.809353+0000","last_change":"2024-09-12T18:01:56.809288+0000","last_active":"2024-09-12T18:01:56.809353+0000","last_peered":"2024-09-12T18:01:56.809353+0000","last_clean":"2024-09-12T18:01:56.809353+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T18:01:56.809353+0000","last_undegraded":"2024-09-12T18:01:56.809353+0000","last_fullsized":"2024-09-12T18:01:56.809353+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T18:01:56.809202+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T18:01:56.809202+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.809202+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:36.079733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'741","reported_seq":2121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.416891+0000","last_change":"2024-09-12T18:01:21.416829+0000","last_active":"2024-09-12T18:01:21.416891+0000","last_peered":"2024-09-12T18:01:21.416891+0000","last_clean":"2024-09-12T18:01:21.416891+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T18:01:21.416891+0000","last_undegraded":"2024-09-12T18:01:21.416891+0000","last_fullsized":"2024-09-12T18:01:21.416891+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'741","last_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_deep_scrub":"265'741","last_deep_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.416733+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:42.434807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'319","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.025570+0000","last_change":"2024-09-12T18:01:14.025570+0000","last_active":"2024-09-12T18:01:14.025570+0000","last_peered":"2024-09-12T18:01:14.025570+0000","last_clean":"2024-09-12T18:01:14.025570+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:14.025570+0000","last_undegraded":"2024-09-12T18:01:14.025570+0000","last_fullsized":"2024-09-12T18:01:14.025570+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.025424+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:56.638592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":5945,"num_write":1198,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.718214+0000","last_change":"2024-09-12T18:01:39.718214+0000","last_active":"2024-09-12T18:01:39.718214+0000","last_peered":"2024-09-12T18:01:39.718214+0000","last_clean":"2024-09-12T18:01:39.718214+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T18:01:39.718214+0000","last_undegraded":"2024-09-12T18:01:39.718214+0000","last_fullsized":"2024-09-12T18:01:39.718214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:39.718115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:39.718115+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.718115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:48.115400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'257","reported_seq":828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.765483+0000","last_change":"2024-09-12T18:01:29.765422+0000","last_active":"2024-09-12T18:01:29.765483+0000","last_peered":"2024-09-12T18:01:29.765483+0000","last_clean":"2024-09-12T18:01:29.765483+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T18:01:29.765483+0000","last_undegraded":"2024-09-12T18:01:29.765483+0000","last_fullsized":"2024-09-12T18:01:29.765483+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'257","last_scrub_stamp":"2024-09-12T18:01:29.765326+0000","last_deep_scrub":"265'257","last_deep_scrub_stamp":"2024-09-12T18:01:29.765326+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.765326+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.854948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48942,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":1075,"num_write":368,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.327176+0000","last_change":"2024-09-12T18:01:33.327099+0000","last_active":"2024-09-12T18:01:33.327176+0000","last_peered":"2024-09-12T18:01:33.327176+0000","last_clean":"2024-09-12T18:01:33.327176+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T18:01:33.327176+0000","last_undegraded":"2024-09-12T18:01:33.327176+0000","last_fullsized":"2024-09-12T18:01:33.327176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.327013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.327013+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.327013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:15.753055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'406","reported_seq":1827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.556024+0000","last_change":"2024-09-12T18:01:31.556024+0000","last_active":"2024-09-12T18:01:31.556024+0000","last_peered":"2024-09-12T18:01:31.556024+0000","last_clean":"2024-09-12T18:01:31.556024+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T18:01:31.556024+0000","last_undegraded":"2024-09-12T18:01:31.556024+0000","last_fullsized":"2024-09-12T18:01:31.556024+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T18:01:31.555902+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T18:01:31.555902+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.555902+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:22.755101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'306","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.017205+0000","last_change":"2024-09-12T18:01:15.017205+0000","last_active":"2024-09-12T18:01:15.017205+0000","last_peered":"2024-09-12T18:01:15.017205+0000","last_clean":"2024-09-12T18:01:15.017205+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:15.017205+0000","last_undegraded":"2024-09-12T18:01:15.017205+0000","last_fullsized":"2024-09-12T18:01:15.017205+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'306","last_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_deep_scrub":"265'306","last_deep_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.017064+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:45.936859+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6208110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":25374,"num_write":969,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.355134+0000","last_change":"2024-09-12T18:01:29.355066+0000","last_active":"2024-09-12T18:01:29.355134+0000","last_peered":"2024-09-12T18:01:29.355134+0000","last_clean":"2024-09-12T18:01:29.355134+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T18:01:29.355134+0000","last_undegraded":"2024-09-12T18:01:29.355134+0000","last_fullsized":"2024-09-12T18:01:29.355134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.354979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.354979+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.354979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.677603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'490","reported_seq":1120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.385114+0000","last_change":"2024-09-12T18:01:33.385058+0000","last_active":"2024-09-12T18:01:33.385114+0000","last_peered":"2024-09-12T18:01:33.385114+0000","last_clean":"2024-09-12T18:01:33.385114+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:01:33.385114+0000","last_undegraded":"2024-09-12T18:01:33.385114+0000","last_fullsized":"2024-09-12T18:01:33.385114+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:33.384960+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:33.384960+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.384960+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:59.456106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94926,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":2123,"num_write":760,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.055303+0000","last_change":"2024-09-12T18:01:32.055233+0000","last_active":"2024-09-12T18:01:32.055303+0000","last_peered":"2024-09-12T18:01:32.055303+0000","last_clean":"2024-09-12T18:01:32.055303+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T18:01:32.055303+0000","last_undegraded":"2024-09-12T18:01:32.055303+0000","last_fullsized":"2024-09-12T18:01:32.055303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.055142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.055142+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.055142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:15.170698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'168","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.169209+0000","last_change":"2024-09-12T18:01:47.169209+0000","last_active":"2024-09-12T18:01:47.169209+0000","last_peered":"2024-09-12T18:01:47.169209+0000","last_clean":"2024-09-12T18:01:47.169209+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T18:01:47.169209+0000","last_undegraded":"2024-09-12T18:01:47.169209+0000","last_fullsized":"2024-09-12T18:01:47.169209+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T18:01:47.169070+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T18:01:47.169070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.169070+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:31.952309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'422","reported_seq":1896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.801398+0000","last_change":"2024-09-12T18:01:19.801339+0000","last_active":"2024-09-12T18:01:19.801398+0000","last_peered":"2024-09-12T18:01:19.801398+0000","last_clean":"2024-09-12T18:01:19.801398+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T18:01:19.801398+0000","last_undegraded":"2024-09-12T18:01:19.801398+0000","last_fullsized":"2024-09-12T18:01:19.801398+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.801241+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.355929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'338","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.856875+0000","last_change":"2024-09-12T18:01:15.856875+0000","last_active":"2024-09-12T18:01:15.856875+0000","last_peered":"2024-09-12T18:01:15.856875+0000","last_clean":"2024-09-12T18:01:15.856875+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T18:01:15.856875+0000","last_undegraded":"2024-09-12T18:01:15.856875+0000","last_fullsized":"2024-09-12T18:01:15.856875+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.856769+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:45.860393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":48900,"num_write":1054,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.072466+0000","last_change":"2024-09-12T18:01:29.072395+0000","last_active":"2024-09-12T18:01:29.072466+0000","last_peered":"2024-09-12T18:01:29.072466+0000","last_clean":"2024-09-12T18:01:29.072466+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T18:01:29.072466+0000","last_undegraded":"2024-09-12T18:01:29.072466+0000","last_fullsized":"2024-09-12T18:01:29.072466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.072294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.072294+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.072294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:35.429398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'303","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.710975+0000","last_change":"2024-09-12T18:01:44.710912+0000","last_active":"2024-09-12T18:01:44.710975+0000","last_peered":"2024-09-12T18:01:44.710975+0000","last_clean":"2024-09-12T18:01:44.710975+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T18:01:44.710975+0000","last_undegraded":"2024-09-12T18:01:44.710975+0000","last_fullsized":"2024-09-12T18:01:44.710975+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T18:01:44.710795+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T18:01:44.710795+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.710795+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:51.035980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1077,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.141797+0000","last_change":"2024-09-12T18:01:43.141697+0000","last_active":"2024-09-12T18:01:43.141797+0000","last_peered":"2024-09-12T18:01:43.141797+0000","last_clean":"2024-09-12T18:01:43.141797+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T18:01:43.141797+0000","last_undegraded":"2024-09-12T18:01:43.141797+0000","last_fullsized":"2024-09-12T18:01:43.141797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.141601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.141601+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.141601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:34.597861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'196","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.791021+0000","last_change":"2024-09-12T18:01:54.791021+0000","last_active":"2024-09-12T18:01:54.791021+0000","last_peered":"2024-09-12T18:01:54.791021+0000","last_clean":"2024-09-12T18:01:54.791021+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T18:01:54.791021+0000","last_undegraded":"2024-09-12T18:01:54.791021+0000","last_fullsized":"2024-09-12T18:01:54.791021+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'196","last_scrub_stamp":"2024-09-12T18:01:54.790910+0000","last_deep_scrub":"265'196","last_deep_scrub_stamp":"2024-09-12T18:01:54.790910+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.790910+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:18.190106+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'858","reported_seq":2328,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.389803+0000","last_change":"2024-09-12T18:01:20.389730+0000","last_active":"2024-09-12T18:01:20.389803+0000","last_peered":"2024-09-12T18:01:20.389803+0000","last_clean":"2024-09-12T18:01:20.389803+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T18:01:20.389803+0000","last_undegraded":"2024-09-12T18:01:20.389803+0000","last_fullsized":"2024-09-12T18:01:20.389803+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'858","last_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_deep_scrub":"265'858","last_deep_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.389628+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:33.344999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'322","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.107988+0000","last_change":"2024-09-12T18:01:12.107915+0000","last_active":"2024-09-12T18:01:12.107988+0000","last_peered":"2024-09-12T18:01:12.107988+0000","last_clean":"2024-09-12T18:01:12.107988+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T18:01:12.107988+0000","last_undegraded":"2024-09-12T18:01:12.107988+0000","last_fullsized":"2024-09-12T18:01:12.107988+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.107785+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:13.904898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287371,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":72608,"num_write":1086,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.042756+0000","last_change":"2024-09-12T18:01:27.042699+0000","last_active":"2024-09-12T18:01:27.042756+0000","last_peered":"2024-09-12T18:01:27.042756+0000","last_clean":"2024-09-12T18:01:27.042756+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T18:01:27.042756+0000","last_undegraded":"2024-09-12T18:01:27.042756+0000","last_fullsized":"2024-09-12T18:01:27.042756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.042611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:44.161430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'242","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.417943+0000","last_change":"2024-09-12T18:01:35.417943+0000","last_active":"2024-09-12T18:01:35.417943+0000","last_peered":"2024-09-12T18:01:35.417943+0000","last_clean":"2024-09-12T18:01:35.417943+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T18:01:35.417943+0000","last_undegraded":"2024-09-12T18:01:35.417943+0000","last_fullsized":"2024-09-12T18:01:35.417943+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T18:01:35.417842+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T18:01:35.417842+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.417842+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.551863+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18914,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":895,"num_write":312,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.297982+0000","last_change":"2024-09-12T18:01:32.297910+0000","last_active":"2024-09-12T18:01:32.297982+0000","last_peered":"2024-09-12T18:01:32.297982+0000","last_clean":"2024-09-12T18:01:32.297982+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T18:01:32.297982+0000","last_undegraded":"2024-09-12T18:01:32.297982+0000","last_fullsized":"2024-09-12T18:01:32.297982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.297821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.297821+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.297821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:48.366526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'115","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.765281+0000","last_change":"2024-09-12T18:01:53.765281+0000","last_active":"2024-09-12T18:01:53.765281+0000","last_peered":"2024-09-12T18:01:53.765281+0000","last_clean":"2024-09-12T18:01:53.765281+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:01:53.765281+0000","last_undegraded":"2024-09-12T18:01:53.765281+0000","last_fullsized":"2024-09-12T18:01:53.765281+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T18:01:53.765207+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T18:01:53.765207+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.765207+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:28.894584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'490","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.896430+0000","last_change":"2024-09-12T18:01:23.896366+0000","last_active":"2024-09-12T18:01:23.896430+0000","last_peered":"2024-09-12T18:01:23.896430+0000","last_clean":"2024-09-12T18:01:23.896430+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:01:23.896430+0000","last_undegraded":"2024-09-12T18:01:23.896430+0000","last_fullsized":"2024-09-12T18:01:23.896430+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.896262+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.890695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'316","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.847830+0000","last_change":"2024-09-12T18:01:17.847748+0000","last_active":"2024-09-12T18:01:17.847830+0000","last_peered":"2024-09-12T18:01:17.847830+0000","last_clean":"2024-09-12T18:01:17.847830+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T18:01:17.847830+0000","last_undegraded":"2024-09-12T18:01:17.847830+0000","last_fullsized":"2024-09-12T18:01:17.847830+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.847650+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:25.676928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170477,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":22007,"num_write":949,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.964300+0000","last_change":"2024-09-12T18:01:33.964235+0000","last_active":"2024-09-12T18:01:33.964300+0000","last_peered":"2024-09-12T18:01:33.964300+0000","last_clean":"2024-09-12T18:01:33.964300+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T18:01:33.964300+0000","last_undegraded":"2024-09-12T18:01:33.964300+0000","last_fullsized":"2024-09-12T18:01:33.964300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.964138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.964138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.964138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:57.373932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'85","reported_seq":607,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.746655+0000","last_change":"2024-09-12T18:01:46.746573+0000","last_active":"2024-09-12T18:01:46.746655+0000","last_peered":"2024-09-12T18:01:46.746655+0000","last_clean":"2024-09-12T18:01:46.746655+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T18:01:46.746655+0000","last_undegraded":"2024-09-12T18:01:46.746655+0000","last_fullsized":"2024-09-12T18:01:46.746655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-12T18:01:46.746473+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-12T18:01:46.746473+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.746473+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:20.211628+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'757","reported_seq":2443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.846889+0000","last_change":"2024-09-12T18:01:33.846792+0000","last_active":"2024-09-12T18:01:33.846889+0000","last_peered":"2024-09-12T18:01:33.846889+0000","last_clean":"2024-09-12T18:01:33.846889+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:01:33.846889+0000","last_undegraded":"2024-09-12T18:01:33.846889+0000","last_fullsized":"2024-09-12T18:01:33.846889+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'757","last_scrub_stamp":"2024-09-12T18:01:33.846694+0000","last_deep_scrub":"265'757","last_deep_scrub_stamp":"2024-09-12T18:01:33.846694+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.846694+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.845076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'112","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.803734+0000","last_change":"2024-09-12T18:01:52.803734+0000","last_active":"2024-09-12T18:01:52.803734+0000","last_peered":"2024-09-12T18:01:52.803734+0000","last_clean":"2024-09-12T18:01:52.803734+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T18:01:52.803734+0000","last_undegraded":"2024-09-12T18:01:52.803734+0000","last_fullsized":"2024-09-12T18:01:52.803734+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T18:01:52.803666+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T18:01:52.803666+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.803666+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:10.791317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'473","reported_seq":2107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.009089+0000","last_change":"2024-09-12T18:01:24.009007+0000","last_active":"2024-09-12T18:01:24.009089+0000","last_peered":"2024-09-12T18:01:24.009089+0000","last_clean":"2024-09-12T18:01:24.009089+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T18:01:24.009089+0000","last_undegraded":"2024-09-12T18:01:24.009089+0000","last_fullsized":"2024-09-12T18:01:24.009089+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.008914+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:34.013264+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'343","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.091118+0000","last_change":"2024-09-12T18:01:10.091066+0000","last_active":"2024-09-12T18:01:10.091118+0000","last_peered":"2024-09-12T18:01:10.091118+0000","last_clean":"2024-09-12T18:01:10.091118+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T18:01:10.091118+0000","last_undegraded":"2024-09-12T18:01:10.091118+0000","last_fullsized":"2024-09-12T18:01:10.091118+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.090952+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:28.293870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2782938,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":20563,"num_write":1073,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.245452+0000","last_change":"2024-09-12T18:01:27.245348+0000","last_active":"2024-09-12T18:01:27.245452+0000","last_peered":"2024-09-12T18:01:27.245452+0000","last_clean":"2024-09-12T18:01:27.245452+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T18:01:27.245452+0000","last_undegraded":"2024-09-12T18:01:27.245452+0000","last_fullsized":"2024-09-12T18:01:27.245452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.245239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.245239+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.245239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:24.543748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'302","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.781142+0000","last_change":"2024-09-12T18:01:30.781142+0000","last_active":"2024-09-12T18:01:30.781142+0000","last_peered":"2024-09-12T18:01:30.781142+0000","last_clean":"2024-09-12T18:01:30.781142+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:01:30.781142+0000","last_undegraded":"2024-09-12T18:01:30.781142+0000","last_fullsized":"2024-09-12T18:01:30.781142+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T18:01:30.781042+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T18:01:30.781042+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.781042+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:06.795378+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50539,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":1069,"num_write":390,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.973609+0000","last_change":"2024-09-12T18:01:43.973609+0000","last_active":"2024-09-12T18:01:43.973609+0000","last_peered":"2024-09-12T18:01:43.973609+0000","last_clean":"2024-09-12T18:01:43.973609+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T18:01:43.973609+0000","last_undegraded":"2024-09-12T18:01:43.973609+0000","last_fullsized":"2024-09-12T18:01:43.973609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.973531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.973531+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.973531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:16.451484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'141","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.324434+0000","last_change":"2024-09-12T18:01:38.324434+0000","last_active":"2024-09-12T18:01:38.324434+0000","last_peered":"2024-09-12T18:01:38.324434+0000","last_clean":"2024-09-12T18:01:38.324434+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T18:01:38.324434+0000","last_undegraded":"2024-09-12T18:01:38.324434+0000","last_fullsized":"2024-09-12T18:01:38.324434+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'141","last_scrub_stamp":"2024-09-12T18:01:38.324354+0000","last_deep_scrub":"265'141","last_deep_scrub_stamp":"2024-09-12T18:01:38.324354+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.324354+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:23.213982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'473","reported_seq":2090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.961585+0000","last_change":"2024-09-12T18:01:21.961531+0000","last_active":"2024-09-12T18:01:21.961585+0000","last_peered":"2024-09-12T18:01:21.961585+0000","last_clean":"2024-09-12T18:01:21.961585+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:01:21.961585+0000","last_undegraded":"2024-09-12T18:01:21.961585+0000","last_fullsized":"2024-09-12T18:01:21.961585+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.961440+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:47.473255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1157,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'336","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.486384+0000","last_change":"2024-09-12T18:01:22.486325+0000","last_active":"2024-09-12T18:01:22.486384+0000","last_peered":"2024-09-12T18:01:22.486384+0000","last_clean":"2024-09-12T18:01:22.486384+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:01:22.486384+0000","last_undegraded":"2024-09-12T18:01:22.486384+0000","last_fullsized":"2024-09-12T18:01:22.486384+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.486194+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:40.467598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":60843,"num_write":1102,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.003042+0000","last_change":"2024-09-12T18:01:25.002984+0000","last_active":"2024-09-12T18:01:25.003042+0000","last_peered":"2024-09-12T18:01:25.003042+0000","last_clean":"2024-09-12T18:01:25.003042+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T18:01:25.003042+0000","last_undegraded":"2024-09-12T18:01:25.003042+0000","last_fullsized":"2024-09-12T18:01:25.003042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.002885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:05.311567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'257","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.869369+0000","last_change":"2024-09-12T18:01:39.869369+0000","last_active":"2024-09-12T18:01:39.869369+0000","last_peered":"2024-09-12T18:01:39.869369+0000","last_clean":"2024-09-12T18:01:39.869369+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:01:39.869369+0000","last_undegraded":"2024-09-12T18:01:39.869369+0000","last_fullsized":"2024-09-12T18:01:39.869369+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'257","last_scrub_stamp":"2024-09-12T18:01:39.869274+0000","last_deep_scrub":"265'257","last_deep_scrub_stamp":"2024-09-12T18:01:39.869274+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.869274+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.853239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":1004,"num_write":346,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.757217+0000","last_change":"2024-09-12T18:01:49.757217+0000","last_active":"2024-09-12T18:01:49.757217+0000","last_peered":"2024-09-12T18:01:49.757217+0000","last_clean":"2024-09-12T18:01:49.757217+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T18:01:49.757217+0000","last_undegraded":"2024-09-12T18:01:49.757217+0000","last_fullsized":"2024-09-12T18:01:49.757217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.757114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.757114+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.757114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:54.659133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'104","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.144979+0000","last_change":"2024-09-12T18:01:49.144979+0000","last_active":"2024-09-12T18:01:49.144979+0000","last_peered":"2024-09-12T18:01:49.144979+0000","last_clean":"2024-09-12T18:01:49.144979+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T18:01:49.144979+0000","last_undegraded":"2024-09-12T18:01:49.144979+0000","last_fullsized":"2024-09-12T18:01:49.144979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T18:01:49.144861+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T18:01:49.144861+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.144861+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:04.908407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.460129+0000","last_change":"2024-09-12T18:01:17.460129+0000","last_active":"2024-09-12T18:01:17.460129+0000","last_peered":"2024-09-12T18:01:17.460129+0000","last_clean":"2024-09-12T18:01:17.460129+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T18:01:17.460129+0000","last_undegraded":"2024-09-12T18:01:17.460129+0000","last_fullsized":"2024-09-12T18:01:17.460129+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'915","last_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_deep_scrub":"265'915","last_deep_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.460034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:51.385437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'398","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.993380+0000","last_change":"2024-09-12T18:01:15.993319+0000","last_active":"2024-09-12T18:01:15.993380+0000","last_peered":"2024-09-12T18:01:15.993380+0000","last_clean":"2024-09-12T18:01:15.993380+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:15.993380+0000","last_undegraded":"2024-09-12T18:01:15.993380+0000","last_fullsized":"2024-09-12T18:01:15.993380+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.993142+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:46.642090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645063,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":663,"num_read_kb":67994,"num_write":1237,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.260638+0000","last_change":"2024-09-12T18:01:26.260638+0000","last_active":"2024-09-12T18:01:26.260638+0000","last_peered":"2024-09-12T18:01:26.260638+0000","last_clean":"2024-09-12T18:01:26.260638+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T18:01:26.260638+0000","last_undegraded":"2024-09-12T18:01:26.260638+0000","last_fullsized":"2024-09-12T18:01:26.260638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.260550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:54.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'232","reported_seq":793,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.335908+0000","last_change":"2024-09-12T18:01:32.335831+0000","last_active":"2024-09-12T18:01:32.335908+0000","last_peered":"2024-09-12T18:01:32.335908+0000","last_clean":"2024-09-12T18:01:32.335908+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T18:01:32.335908+0000","last_undegraded":"2024-09-12T18:01:32.335908+0000","last_fullsized":"2024-09-12T18:01:32.335908+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'232","last_scrub_stamp":"2024-09-12T18:01:32.335737+0000","last_deep_scrub":"265'232","last_deep_scrub_stamp":"2024-09-12T18:01:32.335737+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.335737+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":330,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.765562+0000","last_change":"2024-09-12T18:01:50.765502+0000","last_active":"2024-09-12T18:01:50.765562+0000","last_peered":"2024-09-12T18:01:50.765562+0000","last_clean":"2024-09-12T18:01:50.765562+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T18:01:50.765562+0000","last_undegraded":"2024-09-12T18:01:50.765562+0000","last_fullsized":"2024-09-12T18:01:50.765562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:50.765322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:50.765322+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.765322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:21.226314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'222","reported_seq":1329,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.820494+0000","last_change":"2024-09-12T18:01:55.820494+0000","last_active":"2024-09-12T18:01:55.820494+0000","last_peered":"2024-09-12T18:01:55.820494+0000","last_clean":"2024-09-12T18:01:55.820494+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T18:01:55.820494+0000","last_undegraded":"2024-09-12T18:01:55.820494+0000","last_fullsized":"2024-09-12T18:01:55.820494+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-12T18:01:55.820399+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-12T18:01:55.820399+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.820399+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:18.753999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.999269+0000","last_change":"2024-09-12T18:01:20.999269+0000","last_active":"2024-09-12T18:01:20.999269+0000","last_peered":"2024-09-12T18:01:20.999269+0000","last_clean":"2024-09-12T18:01:20.999269+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T18:01:20.999269+0000","last_undegraded":"2024-09-12T18:01:20.999269+0000","last_fullsized":"2024-09-12T18:01:20.999269+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'869","last_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_deep_scrub":"265'869","last_deep_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.999172+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:58.536428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'354","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.014469+0000","last_change":"2024-09-12T18:01:17.014403+0000","last_active":"2024-09-12T18:01:17.014469+0000","last_peered":"2024-09-12T18:01:17.014469+0000","last_clean":"2024-09-12T18:01:17.014469+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:17.014469+0000","last_undegraded":"2024-09-12T18:01:17.014469+0000","last_fullsized":"2024-09-12T18:01:17.014469+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.014256+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:50.373551+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3457436,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":16565,"num_write":1099,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.964824+0000","last_change":"2024-09-12T18:01:32.964824+0000","last_active":"2024-09-12T18:01:32.964824+0000","last_peered":"2024-09-12T18:01:32.964824+0000","last_clean":"2024-09-12T18:01:32.964824+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T18:01:32.964824+0000","last_undegraded":"2024-09-12T18:01:32.964824+0000","last_fullsized":"2024-09-12T18:01:32.964824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:32.964708+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:32.964708+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.964708+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:36.523562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'297","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.713066+0000","last_change":"2024-09-12T18:01:45.712978+0000","last_active":"2024-09-12T18:01:45.713066+0000","last_peered":"2024-09-12T18:01:45.713066+0000","last_clean":"2024-09-12T18:01:45.713066+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T18:01:45.713066+0000","last_undegraded":"2024-09-12T18:01:45.713066+0000","last_fullsized":"2024-09-12T18:01:45.713066+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T18:01:45.712884+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T18:01:45.712884+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.712884+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:30.618856+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1131,"num_write":404,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.023260+0000","last_change":"2024-09-12T18:01:45.023206+0000","last_active":"2024-09-12T18:01:45.023260+0000","last_peered":"2024-09-12T18:01:45.023260+0000","last_clean":"2024-09-12T18:01:45.023260+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T18:01:45.023260+0000","last_undegraded":"2024-09-12T18:01:45.023260+0000","last_fullsized":"2024-09-12T18:01:45.023260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.023118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.023118+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.023118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:15.850247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'138","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.804948+0000","last_change":"2024-09-12T18:01:32.804887+0000","last_active":"2024-09-12T18:01:32.804948+0000","last_peered":"2024-09-12T18:01:32.804948+0000","last_clean":"2024-09-12T18:01:32.804948+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:01:32.804948+0000","last_undegraded":"2024-09-12T18:01:32.804948+0000","last_fullsized":"2024-09-12T18:01:32.804948+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T18:01:32.804809+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T18:01:32.804809+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.804809+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.756403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'780","reported_seq":2434,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.908292+0000","last_change":"2024-09-12T18:01:22.908292+0000","last_active":"2024-09-12T18:01:22.908292+0000","last_peered":"2024-09-12T18:01:22.908292+0000","last_clean":"2024-09-12T18:01:22.908292+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T18:01:22.908292+0000","last_undegraded":"2024-09-12T18:01:22.908292+0000","last_fullsized":"2024-09-12T18:01:22.908292+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'780","last_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_deep_scrub":"265'780","last_deep_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.908162+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.242029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'369","reported_seq":1077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.916743+0000","last_change":"2024-09-12T18:01:11.916679+0000","last_active":"2024-09-12T18:01:11.916743+0000","last_peered":"2024-09-12T18:01:11.916743+0000","last_clean":"2024-09-12T18:01:11.916743+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T18:01:11.916743+0000","last_undegraded":"2024-09-12T18:01:11.916743+0000","last_fullsized":"2024-09-12T18:01:11.916743+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.916584+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:14.976183+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6259488,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":161127,"num_write":1137,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'471","reported_seq":1788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.450694+0000","last_change":"2024-09-12T18:01:18.450694+0000","last_active":"2024-09-12T18:01:18.450694+0000","last_peered":"2024-09-12T18:01:18.450694+0000","last_clean":"2024-09-12T18:01:18.450694+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T18:01:18.450694+0000","last_undegraded":"2024-09-12T18:01:18.450694+0000","last_fullsized":"2024-09-12T18:01:18.450694+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.450603+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.728665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'445","reported_seq":1133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.453039+0000","last_change":"2024-09-12T18:01:14.452969+0000","last_active":"2024-09-12T18:01:14.453039+0000","last_peered":"2024-09-12T18:01:14.453039+0000","last_clean":"2024-09-12T18:01:14.453039+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T18:01:14.453039+0000","last_undegraded":"2024-09-12T18:01:14.453039+0000","last_fullsized":"2024-09-12T18:01:14.453039+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.452866+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:29.422563+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190265,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":23221,"num_write":1306,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'806","reported_seq":2443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.622061+0000","last_change":"2024-09-12T18:01:35.622061+0000","last_active":"2024-09-12T18:01:35.622061+0000","last_peered":"2024-09-12T18:01:35.622061+0000","last_clean":"2024-09-12T18:01:35.622061+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T18:01:35.622061+0000","last_undegraded":"2024-09-12T18:01:35.622061+0000","last_fullsized":"2024-09-12T18:01:35.622061+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:35.621952+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:35.621952+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.621952+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:27.209847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'376","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.484407+0000","last_change":"2024-09-12T18:01:19.484338+0000","last_active":"2024-09-12T18:01:19.484407+0000","last_peered":"2024-09-12T18:01:19.484407+0000","last_clean":"2024-09-12T18:01:19.484407+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T18:01:19.484407+0000","last_undegraded":"2024-09-12T18:01:19.484407+0000","last_fullsized":"2024-09-12T18:01:19.484407+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.484172+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:45.726748+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":33088,"num_write":1180,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'922","reported_seq":2569,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.164426+0000","last_change":"2024-09-12T18:01:31.164426+0000","last_active":"2024-09-12T18:01:31.164426+0000","last_peered":"2024-09-12T18:01:31.164426+0000","last_clean":"2024-09-12T18:01:31.164426+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T18:01:31.164426+0000","last_undegraded":"2024-09-12T18:01:31.164426+0000","last_fullsized":"2024-09-12T18:01:31.164426+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'922","last_scrub_stamp":"2024-09-12T18:01:31.164340+0000","last_deep_scrub":"265'922","last_deep_scrub_stamp":"2024-09-12T18:01:31.164340+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.164340+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:02.147024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1530,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'403","reported_seq":1103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.983825+0000","last_change":"2024-09-12T18:01:18.983754+0000","last_active":"2024-09-12T18:01:18.983825+0000","last_peered":"2024-09-12T18:01:18.983825+0000","last_clean":"2024-09-12T18:01:18.983825+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:18.983825+0000","last_undegraded":"2024-09-12T18:01:18.983825+0000","last_fullsized":"2024-09-12T18:01:18.983825+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.983615+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:27.019267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254923,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":28930,"num_write":1343,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'505","reported_seq":2112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.149749+0000","last_change":"2024-09-12T18:01:29.149657+0000","last_active":"2024-09-12T18:01:29.149749+0000","last_peered":"2024-09-12T18:01:29.149749+0000","last_clean":"2024-09-12T18:01:29.149749+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T18:01:29.149749+0000","last_undegraded":"2024-09-12T18:01:29.149749+0000","last_fullsized":"2024-09-12T18:01:29.149749+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T18:01:29.149537+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T18:01:29.149537+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.149537+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:59.837592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'354","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.211578+0000","last_change":"2024-09-12T18:01:15.211578+0000","last_active":"2024-09-12T18:01:15.211578+0000","last_peered":"2024-09-12T18:01:15.211578+0000","last_clean":"2024-09-12T18:01:15.211578+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T18:01:15.211578+0000","last_undegraded":"2024-09-12T18:01:15.211578+0000","last_fullsized":"2024-09-12T18:01:15.211578+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.211486+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:31.451040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":85437,"num_write":1070,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'465","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.678003+0000","last_change":"2024-09-12T18:01:19.677935+0000","last_active":"2024-09-12T18:01:19.678003+0000","last_peered":"2024-09-12T18:01:19.678003+0000","last_clean":"2024-09-12T18:01:19.678003+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T18:01:19.678003+0000","last_undegraded":"2024-09-12T18:01:19.678003+0000","last_fullsized":"2024-09-12T18:01:19.678003+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'465","last_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_deep_scrub":"265'465","last_deep_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.677819+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:45.594108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'299","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.273285+0000","last_change":"2024-09-12T18:01:17.273285+0000","last_active":"2024-09-12T18:01:17.273285+0000","last_peered":"2024-09-12T18:01:17.273285+0000","last_clean":"2024-09-12T18:01:17.273285+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T18:01:17.273285+0000","last_undegraded":"2024-09-12T18:01:17.273285+0000","last_fullsized":"2024-09-12T18:01:17.273285+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.273168+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.449887+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830346,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":83513,"num_write":1029,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'602","reported_seq":2282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.265910+0000","last_change":"2024-09-12T18:01:21.265850+0000","last_active":"2024-09-12T18:01:21.265910+0000","last_peered":"2024-09-12T18:01:21.265910+0000","last_clean":"2024-09-12T18:01:21.265910+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T18:01:21.265910+0000","last_undegraded":"2024-09-12T18:01:21.265910+0000","last_fullsized":"2024-09-12T18:01:21.265910+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'602","last_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_deep_scrub":"265'602","last_deep_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.265759+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:25.389513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.921972+0000","last_change":"2024-09-12T18:01:13.921972+0000","last_active":"2024-09-12T18:01:13.921972+0000","last_peered":"2024-09-12T18:01:13.921972+0000","last_clean":"2024-09-12T18:01:13.921972+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T18:01:13.921972+0000","last_undegraded":"2024-09-12T18:01:13.921972+0000","last_fullsized":"2024-09-12T18:01:13.921972+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.921810+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:44.545643+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190292,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":100979,"num_write":1090,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'368","reported_seq":1828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.198574+0000","last_change":"2024-09-12T18:01:16.198505+0000","last_active":"2024-09-12T18:01:16.198574+0000","last_peered":"2024-09-12T18:01:16.198574+0000","last_clean":"2024-09-12T18:01:16.198574+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:01:16.198574+0000","last_undegraded":"2024-09-12T18:01:16.198574+0000","last_fullsized":"2024-09-12T18:01:16.198574+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.198407+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:23.007746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'356","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.018330+0000","last_change":"2024-09-12T18:01:18.018330+0000","last_active":"2024-09-12T18:01:18.018330+0000","last_peered":"2024-09-12T18:01:18.018330+0000","last_clean":"2024-09-12T18:01:18.018330+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:18.018330+0000","last_undegraded":"2024-09-12T18:01:18.018330+0000","last_fullsized":"2024-09-12T18:01:18.018330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.018155+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:21.152485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262264,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":460,"num_read_kb":5744,"num_write":1173,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'856","reported_seq":2406,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.408676+0000","last_change":"2024-09-12T18:01:19.408597+0000","last_active":"2024-09-12T18:01:19.408676+0000","last_peered":"2024-09-12T18:01:19.408676+0000","last_clean":"2024-09-12T18:01:19.408676+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:01:19.408676+0000","last_undegraded":"2024-09-12T18:01:19.408676+0000","last_fullsized":"2024-09-12T18:01:19.408676+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'856","last_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_deep_scrub":"265'856","last_deep_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.408502+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:03.521178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'380","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.531186+0000","last_change":"2024-09-12T18:01:23.531186+0000","last_active":"2024-09-12T18:01:23.531186+0000","last_peered":"2024-09-12T18:01:23.531186+0000","last_clean":"2024-09-12T18:01:23.531186+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T18:01:23.531186+0000","last_undegraded":"2024-09-12T18:01:23.531186+0000","last_fullsized":"2024-09-12T18:01:23.531186+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.531029+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:11.136174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49301,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":612,"num_read_kb":751,"num_write":1265,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'639","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.670363+0000","last_change":"2024-09-12T18:01:17.670293+0000","last_active":"2024-09-12T18:01:17.670363+0000","last_peered":"2024-09-12T18:01:17.670363+0000","last_clean":"2024-09-12T18:01:17.670363+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T18:01:17.670363+0000","last_undegraded":"2024-09-12T18:01:17.670363+0000","last_fullsized":"2024-09-12T18:01:17.670363+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'639","last_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_deep_scrub":"265'639","last_deep_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.670204+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:59.417673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'374","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.973451+0000","last_change":"2024-09-12T18:01:19.973451+0000","last_active":"2024-09-12T18:01:19.973451+0000","last_peered":"2024-09-12T18:01:19.973451+0000","last_clean":"2024-09-12T18:01:19.973451+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:19.973451+0000","last_undegraded":"2024-09-12T18:01:19.973451+0000","last_fullsized":"2024-09-12T18:01:19.973451+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.973298+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:20.876852+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190224,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":620,"num_read_kb":17255,"num_write":1152,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'560","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.170760+0000","last_change":"2024-09-12T18:01:30.170760+0000","last_active":"2024-09-12T18:01:30.170760+0000","last_peered":"2024-09-12T18:01:30.170760+0000","last_clean":"2024-09-12T18:01:30.170760+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T18:01:30.170760+0000","last_undegraded":"2024-09-12T18:01:30.170760+0000","last_fullsized":"2024-09-12T18:01:30.170760+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T18:01:30.170670+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T18:01:30.170670+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.170670+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:25.830397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'365","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.180439+0000","last_change":"2024-09-12T18:01:14.180439+0000","last_active":"2024-09-12T18:01:14.180439+0000","last_peered":"2024-09-12T18:01:14.180439+0000","last_clean":"2024-09-12T18:01:14.180439+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:01:14.180439+0000","last_undegraded":"2024-09-12T18:01:14.180439+0000","last_fullsized":"2024-09-12T18:01:14.180439+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.180323+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:09.461777+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":563,"num_read_kb":8561,"num_write":1187,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'555","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.185003+0000","last_change":"2024-09-12T18:01:19.185003+0000","last_active":"2024-09-12T18:01:19.185003+0000","last_peered":"2024-09-12T18:01:19.185003+0000","last_clean":"2024-09-12T18:01:19.185003+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:01:19.185003+0000","last_undegraded":"2024-09-12T18:01:19.185003+0000","last_fullsized":"2024-09-12T18:01:19.185003+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'555","last_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_deep_scrub":"265'555","last_deep_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.184900+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:52.759777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'316","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.863501+0000","last_change":"2024-09-12T18:01:21.863501+0000","last_active":"2024-09-12T18:01:21.863501+0000","last_peered":"2024-09-12T18:01:21.863501+0000","last_clean":"2024-09-12T18:01:21.863501+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T18:01:21.863501+0000","last_undegraded":"2024-09-12T18:01:21.863501+0000","last_fullsized":"2024-09-12T18:01:21.863501+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.863390+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:47.927583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":7270,"num_write":974,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'497","reported_seq":2144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.169868+0000","last_change":"2024-09-12T18:01:18.169868+0000","last_active":"2024-09-12T18:01:18.169868+0000","last_peered":"2024-09-12T18:01:18.169868+0000","last_clean":"2024-09-12T18:01:18.169868+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T18:01:18.169868+0000","last_undegraded":"2024-09-12T18:01:18.169868+0000","last_fullsized":"2024-09-12T18:01:18.169868+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'497","last_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_deep_scrub":"265'497","last_deep_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.169758+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:34.271652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'365","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.863401+0000","last_change":"2024-09-12T18:01:10.863401+0000","last_active":"2024-09-12T18:01:10.863401+0000","last_peered":"2024-09-12T18:01:10.863401+0000","last_clean":"2024-09-12T18:01:10.863401+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T18:01:10.863401+0000","last_undegraded":"2024-09-12T18:01:10.863401+0000","last_fullsized":"2024-09-12T18:01:10.863401+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.863281+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:12.634167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":1811,"num_write":1218,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'760","reported_seq":2535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.499737+0000","last_change":"2024-09-12T18:01:23.499737+0000","last_active":"2024-09-12T18:01:23.499737+0000","last_peered":"2024-09-12T18:01:23.499737+0000","last_clean":"2024-09-12T18:01:23.499737+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T18:01:23.499737+0000","last_undegraded":"2024-09-12T18:01:23.499737+0000","last_fullsized":"2024-09-12T18:01:23.499737+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'760","last_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_deep_scrub":"265'760","last_deep_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.499647+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:40.989755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'339","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.596545+0000","last_change":"2024-09-12T18:01:26.596545+0000","last_active":"2024-09-12T18:01:26.596545+0000","last_peered":"2024-09-12T18:01:26.596545+0000","last_clean":"2024-09-12T18:01:26.596545+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:01:26.596545+0000","last_undegraded":"2024-09-12T18:01:26.596545+0000","last_fullsized":"2024-09-12T18:01:26.596545+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.596412+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:20.074252+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2223469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":11534,"num_write":1063,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1319","reported_seq":3065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.924077+0000","last_change":"2024-09-12T18:01:24.924077+0000","last_active":"2024-09-12T18:01:24.924077+0000","last_peered":"2024-09-12T18:01:24.924077+0000","last_clean":"2024-09-12T18:01:24.924077+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T18:01:24.924077+0000","last_undegraded":"2024-09-12T18:01:24.924077+0000","last_fullsized":"2024-09-12T18:01:24.924077+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1319","last_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_deep_scrub":"265'1319","last_deep_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.923970+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":1300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:13.855563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3376,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'431","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.487468+0000","last_change":"2024-09-12T18:01:15.487345+0000","last_active":"2024-09-12T18:01:15.487468+0000","last_peered":"2024-09-12T18:01:15.487468+0000","last_clean":"2024-09-12T18:01:15.487468+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T18:01:15.487468+0000","last_undegraded":"2024-09-12T18:01:15.487468+0000","last_fullsized":"2024-09-12T18:01:15.487468+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'431","last_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_deep_scrub":"265'431","last_deep_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.487068+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.782666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":12654,"num_write":1335,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'853","reported_seq":2474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.216187+0000","last_change":"2024-09-12T18:01:17.216187+0000","last_active":"2024-09-12T18:01:17.216187+0000","last_peered":"2024-09-12T18:01:17.216187+0000","last_clean":"2024-09-12T18:01:17.216187+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T18:01:17.216187+0000","last_undegraded":"2024-09-12T18:01:17.216187+0000","last_fullsized":"2024-09-12T18:01:17.216187+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'853","last_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_deep_scrub":"265'853","last_deep_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.216096+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:08.132663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'405","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.507694+0000","last_change":"2024-09-12T18:01:21.507619+0000","last_active":"2024-09-12T18:01:21.507694+0000","last_peered":"2024-09-12T18:01:21.507694+0000","last_clean":"2024-09-12T18:01:21.507694+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T18:01:21.507694+0000","last_undegraded":"2024-09-12T18:01:21.507694+0000","last_fullsized":"2024-09-12T18:01:21.507694+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.507507+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:37.979878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111016,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":21305,"num_write":1293,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.612545+0000","last_change":"2024-09-12T18:01:25.612472+0000","last_active":"2024-09-12T18:01:25.612545+0000","last_peered":"2024-09-12T18:01:25.612545+0000","last_clean":"2024-09-12T18:01:25.612545+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T18:01:25.612545+0000","last_undegraded":"2024-09-12T18:01:25.612545+0000","last_fullsized":"2024-09-12T18:01:25.612545+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.612341+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:10.180395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":645,"num_read_kb":38619,"num_write":1146,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'588","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.909762+0000","last_change":"2024-09-12T18:01:26.909762+0000","last_active":"2024-09-12T18:01:26.909762+0000","last_peered":"2024-09-12T18:01:26.909762+0000","last_clean":"2024-09-12T18:01:26.909762+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T18:01:26.909762+0000","last_undegraded":"2024-09-12T18:01:26.909762+0000","last_fullsized":"2024-09-12T18:01:26.909762+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'588","last_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_deep_scrub":"265'588","last_deep_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.909677+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:37.357766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.007007+0000","last_change":"2024-09-12T18:01:21.006935+0000","last_active":"2024-09-12T18:01:21.007007+0000","last_peered":"2024-09-12T18:01:21.007007+0000","last_clean":"2024-09-12T18:01:21.007007+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:21.007007+0000","last_undegraded":"2024-09-12T18:01:21.007007+0000","last_fullsized":"2024-09-12T18:01:21.007007+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.006814+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:43.121834+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364838,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":51644,"num_write":1154,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'404","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.241009+0000","last_change":"2024-09-12T18:01:22.241009+0000","last_active":"2024-09-12T18:01:22.241009+0000","last_peered":"2024-09-12T18:01:22.241009+0000","last_clean":"2024-09-12T18:01:22.241009+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T18:01:22.241009+0000","last_undegraded":"2024-09-12T18:01:22.241009+0000","last_fullsized":"2024-09-12T18:01:22.241009+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.240903+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:52.955110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4008,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1633,"ondisk_log_size":1633,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":760,"ondisk_log_size":760,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553896,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16885,"num_read_kb":36225,"num_write":14143,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673122,"num_omap_keys":1554,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2231,"ondisk_log_size":2231,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2878,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44063,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4149,"ondisk_log_size":4149,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83193324,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":36148,"num_read_kb":1816228,"num_write":72592,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113262592,"data_stored":113262592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3606,"ondisk_log_size":3606,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":163167,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":167173,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477228,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286084,"kb_used_data":20276,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94085756,"statfs":{"total":96636764160,"available":96343814144,"internally_reserved":0,"allocated":20762624,"data_stored":18763428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509934,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117088,"kb_used_data":17872,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94254752,"statfs":{"total":96636764160,"available":96516866048,"internally_reserved":0,"allocated":18300928,"data_stored":16277974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509933,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249488,"kb_used_data":15680,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94122352,"statfs":{"total":96636764160,"available":96381288448,"internally_reserved":0,"allocated":16056320,"data_stored":14054405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509933,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268336,"kb_used_data":20576,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94103504,"statfs":{"total":96636764160,"available":96361988096,"internally_reserved":0,"allocated":21069824,"data_stored":19072665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509935,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160940,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94210900,"statfs":{"total":96636764160,"available":96471961600,"internally_reserved":0,"allocated":21983232,"data_stored":19991308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509934,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342488,"kb_used_data":14216,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94029352,"statfs":{"total":96636764160,"available":96286056448,"internally_reserved":0,"allocated":14557184,"data_stored":12561929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509933,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146528,"kb_used_data":20944,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94225312,"statfs":{"total":96636764160,"available":96486719488,"internally_reserved":0,"allocated":21446656,"data_stored":19447593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575341,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265632,"kb_used_data":13776,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94106208,"statfs":{"total":96636764160,"available":96364756992,"internally_reserved":0,"allocated":14106624,"data_stored":12126360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17215488,"data_stored":17215488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9740288,"data_stored":9740288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17760256,"data_stored":17760256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16842752,"data_stored":16842752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11821056,"data_stored":11821056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15941632,"data_stored":15941632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":9895936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:13.442 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.443 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.443 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.443 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.444 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.444 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:38:45.990721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.444 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.445 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:49:55.016015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=49, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:13.448 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:02:33.449 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:33.801 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T18:02:33.813 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T18:02:33.816 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":1490,"stamp":"2024-09-12T18:02:33.174468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85355269,"num_objects":842,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":842,"num_whiteouts":0,"num_read":290229,"num_read_kb":2399744,"num_write":161152,"num_write_kb":2366967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":211,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725118,"num_omap_keys":1771,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13696,"ondisk_log_size":13696,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1836584,"kb_used_data":144808,"kb_used_omap":12,"kb_used_meta":1691635,"kb_avail":753138136,"statfs":{"total":773094113280,"available":771213451264,"internally_reserved":0,"allocated":148283392,"data_stored":132295662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1732234800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005095"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.821504+0000","last_change":"2024-09-12T18:01:46.821424+0000","last_active":"2024-09-12T18:01:46.821504+0000","last_peered":"2024-09-12T18:01:46.821504+0000","last_clean":"2024-09-12T18:01:46.821504+0000","last_became_active":"2024-09-12T17:49:56.045007+0000","last_became_peered":"2024-09-12T17:49:56.045007+0000","last_unstale":"2024-09-12T18:01:46.821504+0000","last_undegraded":"2024-09-12T18:01:46.821504+0000","last_fullsized":"2024-09-12T18:01:46.821504+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:46.821337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:46.821337+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.821337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:49.006761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.347923+0000","last_change":"2024-09-12T18:01:46.347923+0000","last_active":"2024-09-12T18:01:46.347923+0000","last_peered":"2024-09-12T18:01:46.347923+0000","last_clean":"2024-09-12T18:01:46.347923+0000","last_became_active":"2024-09-12T17:38:47.032395+0000","last_became_peered":"2024-09-12T17:38:47.032395+0000","last_unstale":"2024-09-12T18:01:46.347923+0000","last_undegraded":"2024-09-12T18:01:46.347923+0000","last_fullsized":"2024-09-12T18:01:46.347923+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:46.347813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:46.347813+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.347813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.730170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.405552+0000","last_change":"2024-09-12T18:01:50.405552+0000","last_active":"2024-09-12T18:01:50.405552+0000","last_peered":"2024-09-12T18:01:50.405552+0000","last_clean":"2024-09-12T18:01:50.405552+0000","last_became_active":"2024-09-12T17:38:43.995837+0000","last_became_peered":"2024-09-12T17:38:43.995837+0000","last_unstale":"2024-09-12T18:01:50.405552+0000","last_undegraded":"2024-09-12T18:01:50.405552+0000","last_fullsized":"2024-09-12T18:01:50.405552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:50.405461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:50.405461+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.405461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:55.904392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'125","reported_seq":422,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.074598+0000","last_change":"2024-09-12T18:01:52.074539+0000","last_active":"2024-09-12T18:01:52.074598+0000","last_peered":"2024-09-12T18:01:52.074598+0000","last_clean":"2024-09-12T18:01:52.074598+0000","last_became_active":"2024-09-12T17:37:08.657167+0000","last_became_peered":"2024-09-12T17:37:08.657167+0000","last_unstale":"2024-09-12T18:01:52.074598+0000","last_undegraded":"2024-09-12T18:01:52.074598+0000","last_fullsized":"2024-09-12T18:01:52.074598+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T18:01:52.074457+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T18:01:52.074457+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.074457+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:14.857030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":600,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.338465+0000","last_change":"2024-09-12T18:01:53.338404+0000","last_active":"2024-09-12T18:01:53.338465+0000","last_peered":"2024-09-12T18:01:53.338465+0000","last_clean":"2024-09-12T18:01:53.338465+0000","last_became_active":"2024-09-12T17:49:56.046832+0000","last_became_peered":"2024-09-12T17:49:56.046832+0000","last_unstale":"2024-09-12T18:01:53.338465+0000","last_undegraded":"2024-09-12T18:01:53.338465+0000","last_fullsized":"2024-09-12T18:01:53.338465+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.338316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.338316+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.338316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:40.441440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.953237+0000","last_change":"2024-09-12T18:01:50.953237+0000","last_active":"2024-09-12T18:01:50.953237+0000","last_peered":"2024-09-12T18:01:50.953237+0000","last_clean":"2024-09-12T18:01:50.953237+0000","last_became_active":"2024-09-12T17:38:47.032186+0000","last_became_peered":"2024-09-12T17:38:47.032186+0000","last_unstale":"2024-09-12T18:01:50.953237+0000","last_undegraded":"2024-09-12T18:01:50.953237+0000","last_fullsized":"2024-09-12T18:01:50.953237+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:01:50.953141+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:01:50.953141+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.953141+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:03.267747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.251269+0000","last_change":"2024-09-12T18:01:55.251269+0000","last_active":"2024-09-12T18:01:55.251269+0000","last_peered":"2024-09-12T18:01:55.251269+0000","last_clean":"2024-09-12T18:01:55.251269+0000","last_became_active":"2024-09-12T17:38:43.991361+0000","last_became_peered":"2024-09-12T17:38:43.991361+0000","last_unstale":"2024-09-12T18:01:55.251269+0000","last_undegraded":"2024-09-12T18:01:55.251269+0000","last_fullsized":"2024-09-12T18:01:55.251269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:01:55.251167+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:01:55.251167+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.251167+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:51.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4142,"num_write":12,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'26","reported_seq":120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.045749+0000","last_change":"2024-09-12T18:01:51.045749+0000","last_active":"2024-09-12T18:01:51.045749+0000","last_peered":"2024-09-12T18:01:51.045749+0000","last_clean":"2024-09-12T18:01:51.045749+0000","last_became_active":"2024-09-12T17:37:08.649865+0000","last_became_peered":"2024-09-12T17:37:08.649865+0000","last_unstale":"2024-09-12T18:01:51.045749+0000","last_undegraded":"2024-09-12T18:01:51.045749+0000","last_fullsized":"2024-09-12T18:01:51.045749+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'26","last_scrub_stamp":"2024-09-12T18:01:51.045664+0000","last_deep_scrub":"265'26","last_deep_scrub_stamp":"2024-09-12T18:01:51.045664+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.045664+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:45.610588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":94,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.272324+0000","last_change":"2024-09-12T18:01:49.272251+0000","last_active":"2024-09-12T18:01:49.272324+0000","last_peered":"2024-09-12T18:01:49.272324+0000","last_clean":"2024-09-12T18:01:49.272324+0000","last_became_active":"2024-09-12T17:49:56.046262+0000","last_became_peered":"2024-09-12T17:49:56.046262+0000","last_unstale":"2024-09-12T18:01:49.272324+0000","last_undegraded":"2024-09-12T18:01:49.272324+0000","last_fullsized":"2024-09-12T18:01:49.272324+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.272153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.272153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.272153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:41.007454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.144825+0000","last_change":"2024-09-12T18:02:04.144825+0000","last_active":"2024-09-12T18:02:04.144825+0000","last_peered":"2024-09-12T18:02:04.144825+0000","last_clean":"2024-09-12T18:02:04.144825+0000","last_became_active":"2024-09-12T17:38:47.026812+0000","last_became_peered":"2024-09-12T17:38:47.026812+0000","last_unstale":"2024-09-12T18:02:04.144825+0000","last_undegraded":"2024-09-12T18:02:04.144825+0000","last_fullsized":"2024-09-12T18:02:04.144825+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:02:04.144731+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:02:04.144731+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.144731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:49.934859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.435606+0000","last_change":"2024-09-12T18:01:49.435606+0000","last_active":"2024-09-12T18:01:49.435606+0000","last_peered":"2024-09-12T18:01:49.435606+0000","last_clean":"2024-09-12T18:01:49.435606+0000","last_became_active":"2024-09-12T17:38:43.992323+0000","last_became_peered":"2024-09-12T17:38:43.992323+0000","last_unstale":"2024-09-12T18:01:49.435606+0000","last_undegraded":"2024-09-12T18:01:49.435606+0000","last_fullsized":"2024-09-12T18:01:49.435606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:49.435472+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:49.435472+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.435472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:46.329069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'75","reported_seq":252,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.422748+0000","last_change":"2024-09-12T18:01:45.422649+0000","last_active":"2024-09-12T18:01:45.422748+0000","last_peered":"2024-09-12T18:01:45.422748+0000","last_clean":"2024-09-12T18:01:45.422748+0000","last_became_active":"2024-09-12T17:37:08.657180+0000","last_became_peered":"2024-09-12T17:37:08.657180+0000","last_unstale":"2024-09-12T18:01:45.422748+0000","last_undegraded":"2024-09-12T18:01:45.422748+0000","last_fullsized":"2024-09-12T18:01:45.422748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'75","last_scrub_stamp":"2024-09-12T18:01:45.422564+0000","last_deep_scrub":"265'75","last_deep_scrub_stamp":"2024-09-12T18:01:45.422564+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.422564+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:13.649409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":266,"num_write":137,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.197151+0000","last_change":"2024-09-12T18:02:10.197151+0000","last_active":"2024-09-12T18:02:10.197151+0000","last_peered":"2024-09-12T18:02:10.197151+0000","last_clean":"2024-09-12T18:02:10.197151+0000","last_became_active":"2024-09-12T17:49:56.040111+0000","last_became_peered":"2024-09-12T17:49:56.040111+0000","last_unstale":"2024-09-12T18:02:10.197151+0000","last_undegraded":"2024-09-12T18:02:10.197151+0000","last_fullsized":"2024-09-12T18:02:10.197151+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.197056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.197056+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.197056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:04.344316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.161101+0000","last_change":"2024-09-12T18:02:02.161101+0000","last_active":"2024-09-12T18:02:02.161101+0000","last_peered":"2024-09-12T18:02:02.161101+0000","last_clean":"2024-09-12T18:02:02.161101+0000","last_became_active":"2024-09-12T17:38:47.027366+0000","last_became_peered":"2024-09-12T17:38:47.027366+0000","last_unstale":"2024-09-12T18:02:02.161101+0000","last_undegraded":"2024-09-12T18:02:02.161101+0000","last_fullsized":"2024-09-12T18:02:02.161101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:02:02.161017+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:02:02.161017+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.161017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:54.417853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.363414+0000","last_change":"2024-09-12T18:01:45.363414+0000","last_active":"2024-09-12T18:01:45.363414+0000","last_peered":"2024-09-12T18:01:45.363414+0000","last_clean":"2024-09-12T18:01:45.363414+0000","last_became_active":"2024-09-12T17:38:43.990448+0000","last_became_peered":"2024-09-12T17:38:43.990448+0000","last_unstale":"2024-09-12T18:01:45.363414+0000","last_undegraded":"2024-09-12T18:01:45.363414+0000","last_fullsized":"2024-09-12T18:01:45.363414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:01:45.363319+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:01:45.363319+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.363319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:36.948632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14340,"num_write":8,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'28","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.441701+0000","last_change":"2024-09-12T18:01:44.441641+0000","last_active":"2024-09-12T18:01:44.441701+0000","last_peered":"2024-09-12T18:01:44.441701+0000","last_clean":"2024-09-12T18:01:44.441701+0000","last_became_active":"2024-09-12T17:37:08.652378+0000","last_became_peered":"2024-09-12T17:37:08.652378+0000","last_unstale":"2024-09-12T18:01:44.441701+0000","last_undegraded":"2024-09-12T18:01:44.441701+0000","last_fullsized":"2024-09-12T18:01:44.441701+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T18:01:44.441557+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T18:01:44.441557+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.441557+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.141527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":103,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.393069+0000","last_change":"2024-09-12T18:02:00.393069+0000","last_active":"2024-09-12T18:02:00.393069+0000","last_peered":"2024-09-12T18:02:00.393069+0000","last_clean":"2024-09-12T18:02:00.393069+0000","last_became_active":"2024-09-12T17:49:56.043556+0000","last_became_peered":"2024-09-12T17:49:56.043556+0000","last_unstale":"2024-09-12T18:02:00.393069+0000","last_undegraded":"2024-09-12T18:02:00.393069+0000","last_fullsized":"2024-09-12T18:02:00.393069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.392972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.392972+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.392972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:48.780627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.765669+0000","last_change":"2024-09-12T18:01:41.765669+0000","last_active":"2024-09-12T18:01:41.765669+0000","last_peered":"2024-09-12T18:01:41.765669+0000","last_clean":"2024-09-12T18:01:41.765669+0000","last_became_active":"2024-09-12T17:38:47.019651+0000","last_became_peered":"2024-09-12T17:38:47.019651+0000","last_unstale":"2024-09-12T18:01:41.765669+0000","last_undegraded":"2024-09-12T18:01:41.765669+0000","last_fullsized":"2024-09-12T18:01:41.765669+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:41.765575+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:41.765575+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.765575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:26.223860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.236111+0000","last_change":"2024-09-12T18:01:54.236111+0000","last_active":"2024-09-12T18:01:54.236111+0000","last_peered":"2024-09-12T18:01:54.236111+0000","last_clean":"2024-09-12T18:01:54.236111+0000","last_became_active":"2024-09-12T17:38:43.991108+0000","last_became_peered":"2024-09-12T17:38:43.991108+0000","last_unstale":"2024-09-12T18:01:54.236111+0000","last_undegraded":"2024-09-12T18:01:54.236111+0000","last_fullsized":"2024-09-12T18:01:54.236111+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.235990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.235990+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.235990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:54.108643+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.421118+0000","last_change":"2024-09-12T18:01:47.421043+0000","last_active":"2024-09-12T18:01:47.421118+0000","last_peered":"2024-09-12T18:01:47.421118+0000","last_clean":"2024-09-12T18:01:47.421118+0000","last_became_active":"2024-09-12T17:37:08.656611+0000","last_became_peered":"2024-09-12T17:37:08.656611+0000","last_unstale":"2024-09-12T18:01:47.421118+0000","last_undegraded":"2024-09-12T18:01:47.421118+0000","last_fullsized":"2024-09-12T18:01:47.421118+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T18:01:47.420962+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T18:01:47.420962+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.420962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:29.607129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.973543+0000","last_change":"2024-09-12T18:01:56.973470+0000","last_active":"2024-09-12T18:01:56.973543+0000","last_peered":"2024-09-12T18:01:56.973543+0000","last_clean":"2024-09-12T18:01:56.973543+0000","last_became_active":"2024-09-12T17:49:56.037950+0000","last_became_peered":"2024-09-12T17:49:56.037950+0000","last_unstale":"2024-09-12T18:01:56.973543+0000","last_undegraded":"2024-09-12T18:01:56.973543+0000","last_fullsized":"2024-09-12T18:01:56.973543+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:56.973343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:56.973343+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.973343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:47.525299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.978317+0000","last_change":"2024-09-12T18:02:14.978317+0000","last_active":"2024-09-12T18:02:14.978317+0000","last_peered":"2024-09-12T18:02:14.978317+0000","last_clean":"2024-09-12T18:02:14.978317+0000","last_became_active":"2024-09-12T17:38:47.024101+0000","last_became_peered":"2024-09-12T17:38:47.024101+0000","last_unstale":"2024-09-12T18:02:14.978317+0000","last_undegraded":"2024-09-12T18:02:14.978317+0000","last_fullsized":"2024-09-12T18:02:14.978317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:02:14.978221+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:02:14.978221+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.978221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.843358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"262'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.977208+0000","last_change":"2024-09-12T18:02:09.977208+0000","last_active":"2024-09-12T18:02:09.977208+0000","last_peered":"2024-09-12T18:02:09.977208+0000","last_clean":"2024-09-12T18:02:09.977208+0000","last_became_active":"2024-09-12T17:38:43.992358+0000","last_became_peered":"2024-09-12T17:38:43.992358+0000","last_unstale":"2024-09-12T18:02:09.977208+0000","last_undegraded":"2024-09-12T18:02:09.977208+0000","last_fullsized":"2024-09-12T18:02:09.977208+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:02:09.977112+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:02:09.977112+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.977112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:28.981074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.940150+0000","last_change":"2024-09-12T18:01:41.940085+0000","last_active":"2024-09-12T18:01:41.940150+0000","last_peered":"2024-09-12T18:01:41.940150+0000","last_clean":"2024-09-12T18:01:41.940150+0000","last_became_active":"2024-09-12T17:37:08.657038+0000","last_became_peered":"2024-09-12T17:37:08.657038+0000","last_unstale":"2024-09-12T18:01:41.940150+0000","last_undegraded":"2024-09-12T18:01:41.940150+0000","last_fullsized":"2024-09-12T18:01:41.940150+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T18:01:41.939972+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T18:01:41.939972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.939972+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:03.309924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.027265+0000","last_change":"2024-09-12T18:01:54.027163+0000","last_active":"2024-09-12T18:01:54.027265+0000","last_peered":"2024-09-12T18:01:54.027265+0000","last_clean":"2024-09-12T18:01:54.027265+0000","last_became_active":"2024-09-12T17:49:56.043318+0000","last_became_peered":"2024-09-12T17:49:56.043318+0000","last_unstale":"2024-09-12T18:01:54.027265+0000","last_undegraded":"2024-09-12T18:01:54.027265+0000","last_fullsized":"2024-09-12T18:01:54.027265+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:54.027070+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:54.027070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.027070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:59.707415+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.945169+0000","last_change":"2024-09-12T18:01:49.945169+0000","last_active":"2024-09-12T18:01:49.945169+0000","last_peered":"2024-09-12T18:01:49.945169+0000","last_clean":"2024-09-12T18:01:49.945169+0000","last_became_active":"2024-09-12T17:38:47.030249+0000","last_became_peered":"2024-09-12T17:38:47.030249+0000","last_unstale":"2024-09-12T18:01:49.945169+0000","last_undegraded":"2024-09-12T18:01:49.945169+0000","last_fullsized":"2024-09-12T18:01:49.945169+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:49.945079+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:49.945079+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.945079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.788663+0000","last_change":"2024-09-12T18:01:36.788663+0000","last_active":"2024-09-12T18:01:36.788663+0000","last_peered":"2024-09-12T18:01:36.788663+0000","last_clean":"2024-09-12T18:01:36.788663+0000","last_became_active":"2024-09-12T17:38:43.994238+0000","last_became_peered":"2024-09-12T17:38:43.994238+0000","last_unstale":"2024-09-12T18:01:36.788663+0000","last_undegraded":"2024-09-12T18:01:36.788663+0000","last_fullsized":"2024-09-12T18:01:36.788663+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:36.788573+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:36.788573+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.788573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:40.438428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.396969+0000","last_change":"2024-09-12T18:01:43.396969+0000","last_active":"2024-09-12T18:01:43.396969+0000","last_peered":"2024-09-12T18:01:43.396969+0000","last_clean":"2024-09-12T18:01:43.396969+0000","last_became_active":"2024-09-12T17:37:08.653199+0000","last_became_peered":"2024-09-12T17:37:08.653199+0000","last_unstale":"2024-09-12T18:01:43.396969+0000","last_undegraded":"2024-09-12T18:01:43.396969+0000","last_fullsized":"2024-09-12T18:01:43.396969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T18:01:43.396878+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T18:01:43.396878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.396878+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:50.986361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":64,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.779300+0000","last_change":"2024-09-12T18:01:45.779233+0000","last_active":"2024-09-12T18:01:45.779300+0000","last_peered":"2024-09-12T18:01:45.779300+0000","last_clean":"2024-09-12T18:01:45.779300+0000","last_became_active":"2024-09-12T17:49:56.044098+0000","last_became_peered":"2024-09-12T17:49:56.044098+0000","last_unstale":"2024-09-12T18:01:45.779300+0000","last_undegraded":"2024-09-12T18:01:45.779300+0000","last_fullsized":"2024-09-12T18:01:45.779300+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.779139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.779139+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.779139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:32.530508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'10","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.438630+0000","last_change":"2024-09-12T18:01:57.438630+0000","last_active":"2024-09-12T18:01:57.438630+0000","last_peered":"2024-09-12T18:01:57.438630+0000","last_clean":"2024-09-12T18:01:57.438630+0000","last_became_active":"2024-09-12T17:38:47.023999+0000","last_became_peered":"2024-09-12T17:38:47.023999+0000","last_unstale":"2024-09-12T18:01:57.438630+0000","last_undegraded":"2024-09-12T18:01:57.438630+0000","last_fullsized":"2024-09-12T18:01:57.438630+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:57.438539+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:57.438539+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.438539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13320,"num_write":20,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"265'10","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.399508+0000","last_change":"2024-09-12T18:01:49.399508+0000","last_active":"2024-09-12T18:01:49.399508+0000","last_peered":"2024-09-12T18:01:49.399508+0000","last_clean":"2024-09-12T18:01:49.399508+0000","last_became_active":"2024-09-12T17:38:43.990136+0000","last_became_peered":"2024-09-12T17:38:43.990136+0000","last_unstale":"2024-09-12T18:01:49.399508+0000","last_undegraded":"2024-09-12T18:01:49.399508+0000","last_fullsized":"2024-09-12T18:01:49.399508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:49.399427+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:49.399427+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.399427+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:05.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15362,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'59","reported_seq":200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.466682+0000","last_change":"2024-09-12T18:01:43.466682+0000","last_active":"2024-09-12T18:01:43.466682+0000","last_peered":"2024-09-12T18:01:43.466682+0000","last_clean":"2024-09-12T18:01:43.466682+0000","last_became_active":"2024-09-12T17:37:08.660405+0000","last_became_peered":"2024-09-12T17:37:08.660405+0000","last_unstale":"2024-09-12T18:01:43.466682+0000","last_undegraded":"2024-09-12T18:01:43.466682+0000","last_fullsized":"2024-09-12T18:01:43.466682+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T18:01:43.466578+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T18:01:43.466578+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.466578+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:45.668613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":193,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.096430+0000","last_change":"2024-09-12T18:02:07.096430+0000","last_active":"2024-09-12T18:02:07.096430+0000","last_peered":"2024-09-12T18:02:07.096430+0000","last_clean":"2024-09-12T18:02:07.096430+0000","last_became_active":"2024-09-12T17:49:56.043187+0000","last_became_peered":"2024-09-12T17:49:56.043187+0000","last_unstale":"2024-09-12T18:02:07.096430+0000","last_undegraded":"2024-09-12T18:02:07.096430+0000","last_fullsized":"2024-09-12T18:02:07.096430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:07.096342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:07.096342+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.096342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:53.956386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.412442+0000","last_change":"2024-09-12T18:01:56.412442+0000","last_active":"2024-09-12T18:01:56.412442+0000","last_peered":"2024-09-12T18:01:56.412442+0000","last_clean":"2024-09-12T18:01:56.412442+0000","last_became_active":"2024-09-12T17:38:47.023969+0000","last_became_peered":"2024-09-12T17:38:47.023969+0000","last_unstale":"2024-09-12T18:01:56.412442+0000","last_undegraded":"2024-09-12T18:01:56.412442+0000","last_fullsized":"2024-09-12T18:01:56.412442+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:56.412316+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:56.412316+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.412316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:49.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"265'11","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.977252+0000","last_change":"2024-09-12T18:02:07.977186+0000","last_active":"2024-09-12T18:02:07.977252+0000","last_peered":"2024-09-12T18:02:07.977252+0000","last_clean":"2024-09-12T18:02:07.977252+0000","last_became_active":"2024-09-12T17:38:43.991123+0000","last_became_peered":"2024-09-12T17:38:43.991123+0000","last_unstale":"2024-09-12T18:02:07.977252+0000","last_undegraded":"2024-09-12T18:02:07.977252+0000","last_fullsized":"2024-09-12T18:02:07.977252+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T18:02:07.977090+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T18:02:07.977090+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.977090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:23.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4710,"num_write":16,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'114","reported_seq":398,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.081077+0000","last_change":"2024-09-12T18:01:50.081077+0000","last_active":"2024-09-12T18:01:50.081077+0000","last_peered":"2024-09-12T18:01:50.081077+0000","last_clean":"2024-09-12T18:01:50.081077+0000","last_became_active":"2024-09-12T17:37:08.655482+0000","last_became_peered":"2024-09-12T17:37:08.655482+0000","last_unstale":"2024-09-12T18:01:50.081077+0000","last_undegraded":"2024-09-12T18:01:50.081077+0000","last_fullsized":"2024-09-12T18:01:50.081077+0000","mapping_epoch":254,"log_start":"262'100","ondisk_log_start":"262'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-12T18:01:50.080996+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-12T18:01:50.080996+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.080996+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:28.879363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":512,"num_write":143,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4008,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.397225+0000","last_change":"2024-09-12T18:01:51.397225+0000","last_active":"2024-09-12T18:01:51.397225+0000","last_peered":"2024-09-12T18:01:51.397225+0000","last_clean":"2024-09-12T18:01:51.397225+0000","last_became_active":"2024-09-12T17:49:56.033936+0000","last_became_peered":"2024-09-12T17:49:56.033936+0000","last_unstale":"2024-09-12T18:01:51.397225+0000","last_undegraded":"2024-09-12T18:01:51.397225+0000","last_fullsized":"2024-09-12T18:01:51.397225+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:51.397128+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:51.397128+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.397128+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.464821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.178028+0000","last_change":"2024-09-12T18:02:01.177967+0000","last_active":"2024-09-12T18:02:01.178028+0000","last_peered":"2024-09-12T18:02:01.178028+0000","last_clean":"2024-09-12T18:02:01.178028+0000","last_became_active":"2024-09-12T17:38:47.023904+0000","last_became_peered":"2024-09-12T17:38:47.023904+0000","last_unstale":"2024-09-12T18:02:01.178028+0000","last_undegraded":"2024-09-12T18:02:01.178028+0000","last_fullsized":"2024-09-12T18:02:01.178028+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.177878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.177878+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.177878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:29.425721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.844260+0000","last_change":"2024-09-12T18:01:34.844260+0000","last_active":"2024-09-12T18:01:34.844260+0000","last_peered":"2024-09-12T18:01:34.844260+0000","last_clean":"2024-09-12T18:01:34.844260+0000","last_became_active":"2024-09-12T17:38:43.995119+0000","last_became_peered":"2024-09-12T17:38:43.995119+0000","last_unstale":"2024-09-12T18:01:34.844260+0000","last_undegraded":"2024-09-12T18:01:34.844260+0000","last_fullsized":"2024-09-12T18:01:34.844260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:34.844131+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:34.844131+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.844131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:48.050356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'17","reported_seq":97,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.035020+0000","last_change":"2024-09-12T18:01:49.035020+0000","last_active":"2024-09-12T18:01:49.035020+0000","last_peered":"2024-09-12T18:01:49.035020+0000","last_clean":"2024-09-12T18:01:49.035020+0000","last_became_active":"2024-09-12T17:37:08.650026+0000","last_became_peered":"2024-09-12T17:37:08.650026+0000","last_unstale":"2024-09-12T18:01:49.035020+0000","last_undegraded":"2024-09-12T18:01:49.035020+0000","last_fullsized":"2024-09-12T18:01:49.035020+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T18:01:49.034925+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T18:01:49.034925+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.034925+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:05.277954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.995847+0000","last_change":"2024-09-12T18:01:52.995847+0000","last_active":"2024-09-12T18:01:52.995847+0000","last_peered":"2024-09-12T18:01:52.995847+0000","last_clean":"2024-09-12T18:01:52.995847+0000","last_became_active":"2024-09-12T17:49:56.037684+0000","last_became_peered":"2024-09-12T17:49:56.037684+0000","last_unstale":"2024-09-12T18:01:52.995847+0000","last_undegraded":"2024-09-12T18:01:52.995847+0000","last_fullsized":"2024-09-12T18:01:52.995847+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:52.995758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:52.995758+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.995758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:00.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.438797+0000","last_change":"2024-09-12T18:01:55.438797+0000","last_active":"2024-09-12T18:01:55.438797+0000","last_peered":"2024-09-12T18:01:55.438797+0000","last_clean":"2024-09-12T18:01:55.438797+0000","last_became_active":"2024-09-12T17:38:47.016159+0000","last_became_peered":"2024-09-12T17:38:47.016159+0000","last_unstale":"2024-09-12T18:01:55.438797+0000","last_undegraded":"2024-09-12T18:01:55.438797+0000","last_fullsized":"2024-09-12T18:01:55.438797+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.438702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.438702+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.438702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:06.604850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.459283+0000","last_change":"2024-09-12T18:01:48.459283+0000","last_active":"2024-09-12T18:01:48.459283+0000","last_peered":"2024-09-12T18:01:48.459283+0000","last_clean":"2024-09-12T18:01:48.459283+0000","last_became_active":"2024-09-12T17:38:43.995893+0000","last_became_peered":"2024-09-12T17:38:43.995893+0000","last_unstale":"2024-09-12T18:01:48.459283+0000","last_undegraded":"2024-09-12T18:01:48.459283+0000","last_fullsized":"2024-09-12T18:01:48.459283+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:48.459191+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:48.459191+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.459191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:58.450160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.374692+0000","last_change":"2024-09-12T18:01:42.374692+0000","last_active":"2024-09-12T18:01:42.374692+0000","last_peered":"2024-09-12T18:01:42.374692+0000","last_clean":"2024-09-12T18:01:42.374692+0000","last_became_active":"2024-09-12T17:37:08.661174+0000","last_became_peered":"2024-09-12T17:37:08.661174+0000","last_unstale":"2024-09-12T18:01:42.374692+0000","last_undegraded":"2024-09-12T18:01:42.374692+0000","last_fullsized":"2024-09-12T18:01:42.374692+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:42.374606+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:42.374606+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.374606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:52.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":48,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.794472+0000","last_change":"2024-09-12T18:01:44.794472+0000","last_active":"2024-09-12T18:01:44.794472+0000","last_peered":"2024-09-12T18:01:44.794472+0000","last_clean":"2024-09-12T18:01:44.794472+0000","last_became_active":"2024-09-12T17:49:56.045051+0000","last_became_peered":"2024-09-12T17:49:56.045051+0000","last_unstale":"2024-09-12T18:01:44.794472+0000","last_undegraded":"2024-09-12T18:01:44.794472+0000","last_fullsized":"2024-09-12T18:01:44.794472+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:44.794380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:44.794380+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.794380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:24.341962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.725963+0000","last_change":"2024-09-12T18:01:40.725963+0000","last_active":"2024-09-12T18:01:40.725963+0000","last_peered":"2024-09-12T18:01:40.725963+0000","last_clean":"2024-09-12T18:01:40.725963+0000","last_became_active":"2024-09-12T17:38:47.023083+0000","last_became_peered":"2024-09-12T17:38:47.023083+0000","last_unstale":"2024-09-12T18:01:40.725963+0000","last_undegraded":"2024-09-12T18:01:40.725963+0000","last_fullsized":"2024-09-12T18:01:40.725963+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:40.725867+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:40.725867+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.725867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.564911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.216857+0000","last_change":"2024-09-12T18:01:53.216857+0000","last_active":"2024-09-12T18:01:53.216857+0000","last_peered":"2024-09-12T18:01:53.216857+0000","last_clean":"2024-09-12T18:01:53.216857+0000","last_became_active":"2024-09-12T17:38:43.989103+0000","last_became_peered":"2024-09-12T17:38:43.989103+0000","last_unstale":"2024-09-12T18:01:53.216857+0000","last_undegraded":"2024-09-12T18:01:53.216857+0000","last_fullsized":"2024-09-12T18:01:53.216857+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:53.216755+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:53.216755+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.216755+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:12.788181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'32","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.887398+0000","last_change":"2024-09-12T18:01:59.887398+0000","last_active":"2024-09-12T18:01:59.887398+0000","last_peered":"2024-09-12T18:01:59.887398+0000","last_clean":"2024-09-12T18:01:59.887398+0000","last_became_active":"2024-09-12T17:37:08.651548+0000","last_became_peered":"2024-09-12T17:37:08.651548+0000","last_unstale":"2024-09-12T18:01:59.887398+0000","last_undegraded":"2024-09-12T18:01:59.887398+0000","last_fullsized":"2024-09-12T18:01:59.887398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T18:01:59.887299+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T18:01:59.887299+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.887299+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:46.634027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.178008+0000","last_change":"2024-09-12T18:02:09.178008+0000","last_active":"2024-09-12T18:02:09.178008+0000","last_peered":"2024-09-12T18:02:09.178008+0000","last_clean":"2024-09-12T18:02:09.178008+0000","last_became_active":"2024-09-12T17:49:56.042234+0000","last_became_peered":"2024-09-12T17:49:56.042234+0000","last_unstale":"2024-09-12T18:02:09.178008+0000","last_undegraded":"2024-09-12T18:02:09.178008+0000","last_fullsized":"2024-09-12T18:02:09.178008+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.177900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.177900+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.177900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:03.172964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.195125+0000","last_change":"2024-09-12T18:02:00.195062+0000","last_active":"2024-09-12T18:02:00.195125+0000","last_peered":"2024-09-12T18:02:00.195125+0000","last_clean":"2024-09-12T18:02:00.195125+0000","last_became_active":"2024-09-12T17:38:47.028140+0000","last_became_peered":"2024-09-12T17:38:47.028140+0000","last_unstale":"2024-09-12T18:02:00.195125+0000","last_undegraded":"2024-09-12T18:02:00.195125+0000","last_fullsized":"2024-09-12T18:02:00.195125+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.194974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.194974+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.194974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:00.089360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.336398+0000","last_change":"2024-09-12T18:01:42.336334+0000","last_active":"2024-09-12T18:01:42.336398+0000","last_peered":"2024-09-12T18:01:42.336398+0000","last_clean":"2024-09-12T18:01:42.336398+0000","last_became_active":"2024-09-12T17:38:43.990638+0000","last_became_peered":"2024-09-12T17:38:43.990638+0000","last_unstale":"2024-09-12T18:01:42.336398+0000","last_undegraded":"2024-09-12T18:01:42.336398+0000","last_fullsized":"2024-09-12T18:01:42.336398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.336239+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:19.424553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'39","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.911445+0000","last_change":"2024-09-12T18:02:00.911445+0000","last_active":"2024-09-12T18:02:00.911445+0000","last_peered":"2024-09-12T18:02:00.911445+0000","last_clean":"2024-09-12T18:02:00.911445+0000","last_became_active":"2024-09-12T17:37:08.655760+0000","last_became_peered":"2024-09-12T17:37:08.655760+0000","last_unstale":"2024-09-12T18:02:00.911445+0000","last_undegraded":"2024-09-12T18:02:00.911445+0000","last_fullsized":"2024-09-12T18:02:00.911445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T18:02:00.911312+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T18:02:00.911312+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.911312+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:38.429833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":141,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.362372+0000","last_change":"2024-09-12T18:01:54.362312+0000","last_active":"2024-09-12T18:01:54.362372+0000","last_peered":"2024-09-12T18:01:54.362372+0000","last_clean":"2024-09-12T18:01:54.362372+0000","last_became_active":"2024-09-12T17:49:56.042238+0000","last_became_peered":"2024-09-12T17:49:56.042238+0000","last_unstale":"2024-09-12T18:01:54.362372+0000","last_undegraded":"2024-09-12T18:01:54.362372+0000","last_fullsized":"2024-09-12T18:01:54.362372+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.362223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.362223+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.362223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:36.799495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'11","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.218700+0000","last_change":"2024-09-12T18:01:59.218615+0000","last_active":"2024-09-12T18:01:59.218700+0000","last_peered":"2024-09-12T18:01:59.218700+0000","last_clean":"2024-09-12T18:01:59.218700+0000","last_became_active":"2024-09-12T17:38:47.030520+0000","last_became_peered":"2024-09-12T17:38:47.030520+0000","last_unstale":"2024-09-12T18:01:59.218700+0000","last_undegraded":"2024-09-12T18:01:59.218700+0000","last_fullsized":"2024-09-12T18:01:59.218700+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T18:01:59.218508+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T18:01:59.218508+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.218508+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.930045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10258,"num_write":16,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.192009+0000","last_change":"2024-09-12T18:01:52.191903+0000","last_active":"2024-09-12T18:01:52.192009+0000","last_peered":"2024-09-12T18:01:52.192009+0000","last_clean":"2024-09-12T18:01:52.192009+0000","last_became_active":"2024-09-12T17:38:43.987206+0000","last_became_peered":"2024-09-12T17:38:43.987206+0000","last_unstale":"2024-09-12T18:01:52.192009+0000","last_undegraded":"2024-09-12T18:01:52.192009+0000","last_fullsized":"2024-09-12T18:01:52.192009+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:01:52.191803+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:01:52.191803+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.191803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:19.402169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'58","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.334479+0000","last_change":"2024-09-12T18:01:41.334479+0000","last_active":"2024-09-12T18:01:41.334479+0000","last_peered":"2024-09-12T18:01:41.334479+0000","last_clean":"2024-09-12T18:01:41.334479+0000","last_became_active":"2024-09-12T17:37:08.661273+0000","last_became_peered":"2024-09-12T17:37:08.661273+0000","last_unstale":"2024-09-12T18:01:41.334479+0000","last_undegraded":"2024-09-12T18:01:41.334479+0000","last_fullsized":"2024-09-12T18:01:41.334479+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T18:01:41.334373+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T18:01:41.334373+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.334373+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:02.278105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":211,"num_write":103,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.015386+0000","last_change":"2024-09-12T18:01:56.015386+0000","last_active":"2024-09-12T18:01:56.015386+0000","last_peered":"2024-09-12T18:01:56.015386+0000","last_clean":"2024-09-12T18:01:56.015386+0000","last_became_active":"2024-09-12T17:49:56.035977+0000","last_became_peered":"2024-09-12T17:49:56.035977+0000","last_unstale":"2024-09-12T18:01:56.015386+0000","last_undegraded":"2024-09-12T18:01:56.015386+0000","last_fullsized":"2024-09-12T18:01:56.015386+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:56.015281+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:56.015281+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.015281+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:15.348681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.388179+0000","last_change":"2024-09-12T18:01:53.388122+0000","last_active":"2024-09-12T18:01:53.388179+0000","last_peered":"2024-09-12T18:01:53.388179+0000","last_clean":"2024-09-12T18:01:53.388179+0000","last_became_active":"2024-09-12T17:38:47.022167+0000","last_became_peered":"2024-09-12T17:38:47.022167+0000","last_unstale":"2024-09-12T18:01:53.388179+0000","last_undegraded":"2024-09-12T18:01:53.388179+0000","last_fullsized":"2024-09-12T18:01:53.388179+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:53.388035+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:53.388035+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.388035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:13.787528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.383609+0000","last_change":"2024-09-12T18:01:43.383540+0000","last_active":"2024-09-12T18:01:43.383609+0000","last_peered":"2024-09-12T18:01:43.383609+0000","last_clean":"2024-09-12T18:01:43.383609+0000","last_became_active":"2024-09-12T17:38:43.988430+0000","last_became_peered":"2024-09-12T17:38:43.988430+0000","last_unstale":"2024-09-12T18:01:43.383609+0000","last_undegraded":"2024-09-12T18:01:43.383609+0000","last_fullsized":"2024-09-12T18:01:43.383609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:43.383441+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:43.383441+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.383441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:20.540473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"262'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.998149+0000","last_change":"2024-09-12T18:01:39.998149+0000","last_active":"2024-09-12T18:01:39.998149+0000","last_peered":"2024-09-12T18:01:39.998149+0000","last_clean":"2024-09-12T18:01:39.998149+0000","last_became_active":"2024-09-12T17:37:08.658351+0000","last_became_peered":"2024-09-12T17:37:08.658351+0000","last_unstale":"2024-09-12T18:01:39.998149+0000","last_undegraded":"2024-09-12T18:01:39.998149+0000","last_fullsized":"2024-09-12T18:01:39.998149+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:01:39.998052+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:01:39.998052+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.998052+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:42.987824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.387646+0000","last_change":"2024-09-12T18:01:52.387587+0000","last_active":"2024-09-12T18:01:52.387646+0000","last_peered":"2024-09-12T18:01:52.387646+0000","last_clean":"2024-09-12T18:01:52.387646+0000","last_became_active":"2024-09-12T17:49:56.036569+0000","last_became_peered":"2024-09-12T17:49:56.036569+0000","last_unstale":"2024-09-12T18:01:52.387646+0000","last_undegraded":"2024-09-12T18:01:52.387646+0000","last_fullsized":"2024-09-12T18:01:52.387646+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:52.387504+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:52.387504+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.387504+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:00.384626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.999571+0000","last_change":"2024-09-12T18:02:13.999571+0000","last_active":"2024-09-12T18:02:13.999571+0000","last_peered":"2024-09-12T18:02:13.999571+0000","last_clean":"2024-09-12T18:02:13.999571+0000","last_became_active":"2024-09-12T17:38:47.018980+0000","last_became_peered":"2024-09-12T17:38:47.018980+0000","last_unstale":"2024-09-12T18:02:13.999571+0000","last_undegraded":"2024-09-12T18:02:13.999571+0000","last_fullsized":"2024-09-12T18:02:13.999571+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:02:13.999493+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:02:13.999493+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.999493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:35.356207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.371207+0000","last_change":"2024-09-12T18:01:44.371144+0000","last_active":"2024-09-12T18:01:44.371207+0000","last_peered":"2024-09-12T18:01:44.371207+0000","last_clean":"2024-09-12T18:01:44.371207+0000","last_became_active":"2024-09-12T17:38:43.992427+0000","last_became_peered":"2024-09-12T17:38:43.992427+0000","last_unstale":"2024-09-12T18:01:44.371207+0000","last_undegraded":"2024-09-12T18:01:44.371207+0000","last_fullsized":"2024-09-12T18:01:44.371207+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:44.371039+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:44.371039+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.371039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:56.350409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'59","reported_seq":213,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.356142+0000","last_change":"2024-09-12T18:01:40.356142+0000","last_active":"2024-09-12T18:01:40.356142+0000","last_peered":"2024-09-12T18:01:40.356142+0000","last_clean":"2024-09-12T18:01:40.356142+0000","last_became_active":"2024-09-12T17:37:08.661804+0000","last_became_peered":"2024-09-12T17:37:08.661804+0000","last_unstale":"2024-09-12T18:01:40.356142+0000","last_undegraded":"2024-09-12T18:01:40.356142+0000","last_fullsized":"2024-09-12T18:01:40.356142+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T18:01:40.356044+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T18:01:40.356044+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.356044+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:32.536982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":228,"num_write":99,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.085511+0000","last_change":"2024-09-12T18:02:06.085511+0000","last_active":"2024-09-12T18:02:06.085511+0000","last_peered":"2024-09-12T18:02:06.085511+0000","last_clean":"2024-09-12T18:02:06.085511+0000","last_became_active":"2024-09-12T17:49:56.047340+0000","last_became_peered":"2024-09-12T17:49:56.047340+0000","last_unstale":"2024-09-12T18:02:06.085511+0000","last_undegraded":"2024-09-12T18:02:06.085511+0000","last_fullsized":"2024-09-12T18:02:06.085511+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:06.085424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:06.085424+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.085424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:10.985888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.389191+0000","last_change":"2024-09-12T18:01:52.389191+0000","last_active":"2024-09-12T18:01:52.389191+0000","last_peered":"2024-09-12T18:01:52.389191+0000","last_clean":"2024-09-12T18:01:52.389191+0000","last_became_active":"2024-09-12T17:38:47.029344+0000","last_became_peered":"2024-09-12T17:38:47.029344+0000","last_unstale":"2024-09-12T18:01:52.389191+0000","last_undegraded":"2024-09-12T18:01:52.389191+0000","last_fullsized":"2024-09-12T18:01:52.389191+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:52.389094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:52.389094+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.389094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:22.884023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.975186+0000","last_change":"2024-09-12T18:01:44.975186+0000","last_active":"2024-09-12T18:01:44.975186+0000","last_peered":"2024-09-12T18:01:44.975186+0000","last_clean":"2024-09-12T18:01:44.975186+0000","last_became_active":"2024-09-12T17:38:43.989559+0000","last_became_peered":"2024-09-12T17:38:43.989559+0000","last_unstale":"2024-09-12T18:01:44.975186+0000","last_undegraded":"2024-09-12T18:01:44.975186+0000","last_fullsized":"2024-09-12T18:01:44.975186+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:44.975076+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:44.975076+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.975076+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:08.064118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'50","reported_seq":189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.348551+0000","last_change":"2024-09-12T18:01:39.348463+0000","last_active":"2024-09-12T18:01:39.348551+0000","last_peered":"2024-09-12T18:01:39.348551+0000","last_clean":"2024-09-12T18:01:39.348551+0000","last_became_active":"2024-09-12T17:37:08.661704+0000","last_became_peered":"2024-09-12T17:37:08.661704+0000","last_unstale":"2024-09-12T18:01:39.348551+0000","last_undegraded":"2024-09-12T18:01:39.348551+0000","last_fullsized":"2024-09-12T18:01:39.348551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:39.348369+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:39.348369+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.348369+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.540420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":202,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.298028+0000","last_change":"2024-09-12T18:01:48.298028+0000","last_active":"2024-09-12T18:01:48.298028+0000","last_peered":"2024-09-12T18:01:48.298028+0000","last_clean":"2024-09-12T18:01:48.298028+0000","last_became_active":"2024-09-12T17:49:56.048712+0000","last_became_peered":"2024-09-12T17:49:56.048712+0000","last_unstale":"2024-09-12T18:01:48.298028+0000","last_undegraded":"2024-09-12T18:01:48.298028+0000","last_fullsized":"2024-09-12T18:01:48.298028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:48.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:48.297939+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.297939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:34.814551+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.396829+0000","last_change":"2024-09-12T18:01:51.396829+0000","last_active":"2024-09-12T18:01:51.396829+0000","last_peered":"2024-09-12T18:01:51.396829+0000","last_clean":"2024-09-12T18:01:51.396829+0000","last_became_active":"2024-09-12T17:38:47.025075+0000","last_became_peered":"2024-09-12T17:38:47.025075+0000","last_unstale":"2024-09-12T18:01:51.396829+0000","last_undegraded":"2024-09-12T18:01:51.396829+0000","last_fullsized":"2024-09-12T18:01:51.396829+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:51.396721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:51.396721+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.396721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:48.332576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.409159+0000","last_change":"2024-09-12T18:01:48.409159+0000","last_active":"2024-09-12T18:01:48.409159+0000","last_peered":"2024-09-12T18:01:48.409159+0000","last_clean":"2024-09-12T18:01:48.409159+0000","last_became_active":"2024-09-12T17:38:43.989368+0000","last_became_peered":"2024-09-12T17:38:43.989368+0000","last_unstale":"2024-09-12T18:01:48.409159+0000","last_undegraded":"2024-09-12T18:01:48.409159+0000","last_fullsized":"2024-09-12T18:01:48.409159+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:48.409049+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:48.409049+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.409049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:40.718374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'49","reported_seq":185,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.988503+0000","last_change":"2024-09-12T18:02:08.988503+0000","last_active":"2024-09-12T18:02:08.988503+0000","last_peered":"2024-09-12T18:02:08.988503+0000","last_clean":"2024-09-12T18:02:08.988503+0000","last_became_active":"2024-09-12T17:37:08.648611+0000","last_became_peered":"2024-09-12T17:37:08.648611+0000","last_unstale":"2024-09-12T18:02:08.988503+0000","last_undegraded":"2024-09-12T18:02:08.988503+0000","last_fullsized":"2024-09-12T18:02:08.988503+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T18:02:08.988408+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T18:02:08.988408+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.988408+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:32.079215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":181,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.910521+0000","last_change":"2024-09-12T18:02:17.910521+0000","last_active":"2024-09-12T18:02:17.910521+0000","last_peered":"2024-09-12T18:02:17.910521+0000","last_clean":"2024-09-12T18:02:17.910521+0000","last_became_active":"2024-09-12T17:49:56.036585+0000","last_became_peered":"2024-09-12T17:49:56.036585+0000","last_unstale":"2024-09-12T18:02:17.910521+0000","last_undegraded":"2024-09-12T18:02:17.910521+0000","last_fullsized":"2024-09-12T18:02:17.910521+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.910427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.910427+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.910427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:03.434078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'10","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.433072+0000","last_change":"2024-09-12T18:01:54.433072+0000","last_active":"2024-09-12T18:01:54.433072+0000","last_peered":"2024-09-12T18:01:54.433072+0000","last_clean":"2024-09-12T18:01:54.433072+0000","last_became_active":"2024-09-12T17:38:47.026726+0000","last_became_peered":"2024-09-12T17:38:47.026726+0000","last_unstale":"2024-09-12T18:01:54.433072+0000","last_undegraded":"2024-09-12T18:01:54.433072+0000","last_fullsized":"2024-09-12T18:01:54.433072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:54.432982+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:54.432982+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.432982+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:26.938639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15452,"num_write":10,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.408330+0000","last_change":"2024-09-12T18:01:45.408330+0000","last_active":"2024-09-12T18:01:45.408330+0000","last_peered":"2024-09-12T18:01:45.408330+0000","last_clean":"2024-09-12T18:01:45.408330+0000","last_became_active":"2024-09-12T17:38:43.995657+0000","last_became_peered":"2024-09-12T17:38:43.995657+0000","last_unstale":"2024-09-12T18:01:45.408330+0000","last_undegraded":"2024-09-12T18:01:45.408330+0000","last_fullsized":"2024-09-12T18:01:45.408330+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:45.408246+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:45.408246+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.408246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:45.591221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4108,"num_write":6,"num_write_kb":5132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'23","reported_seq":112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.347215+0000","last_change":"2024-09-12T18:01:40.347107+0000","last_active":"2024-09-12T18:01:40.347215+0000","last_peered":"2024-09-12T18:01:40.347215+0000","last_clean":"2024-09-12T18:01:40.347215+0000","last_became_active":"2024-09-12T17:37:08.653119+0000","last_became_peered":"2024-09-12T17:37:08.653119+0000","last_unstale":"2024-09-12T18:01:40.347215+0000","last_undegraded":"2024-09-12T18:01:40.347215+0000","last_fullsized":"2024-09-12T18:01:40.347215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-12T18:01:40.346985+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-12T18:01:40.346985+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.346985+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:14.853137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.326522+0000","last_change":"2024-09-12T18:01:47.326522+0000","last_active":"2024-09-12T18:01:47.326522+0000","last_peered":"2024-09-12T18:01:47.326522+0000","last_clean":"2024-09-12T18:01:47.326522+0000","last_became_active":"2024-09-12T17:49:56.046628+0000","last_became_peered":"2024-09-12T17:49:56.046628+0000","last_unstale":"2024-09-12T18:01:47.326522+0000","last_undegraded":"2024-09-12T18:01:47.326522+0000","last_fullsized":"2024-09-12T18:01:47.326522+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.326399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.326399+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.326399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:07.862192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.178782+0000","last_change":"2024-09-12T18:01:58.178782+0000","last_active":"2024-09-12T18:01:58.178782+0000","last_peered":"2024-09-12T18:01:58.178782+0000","last_clean":"2024-09-12T18:01:58.178782+0000","last_became_active":"2024-09-12T17:38:47.021763+0000","last_became_peered":"2024-09-12T17:38:47.021763+0000","last_unstale":"2024-09-12T18:01:58.178782+0000","last_undegraded":"2024-09-12T18:01:58.178782+0000","last_fullsized":"2024-09-12T18:01:58.178782+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:58.178658+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:58.178658+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.178658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:27.715332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11258,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.435473+0000","last_change":"2024-09-12T18:01:47.435473+0000","last_active":"2024-09-12T18:01:47.435473+0000","last_peered":"2024-09-12T18:01:47.435473+0000","last_clean":"2024-09-12T18:01:47.435473+0000","last_became_active":"2024-09-12T17:38:43.991682+0000","last_became_peered":"2024-09-12T17:38:43.991682+0000","last_unstale":"2024-09-12T18:01:47.435473+0000","last_undegraded":"2024-09-12T18:01:47.435473+0000","last_fullsized":"2024-09-12T18:01:47.435473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.435362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.435362+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.435362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:08.488931+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'14","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.440742+0000","last_change":"2024-09-12T18:01:42.440685+0000","last_active":"2024-09-12T18:01:42.440742+0000","last_peered":"2024-09-12T18:01:42.440742+0000","last_clean":"2024-09-12T18:01:42.440742+0000","last_became_active":"2024-09-12T17:37:08.659109+0000","last_became_peered":"2024-09-12T17:37:08.659109+0000","last_unstale":"2024-09-12T18:01:42.440742+0000","last_undegraded":"2024-09-12T18:01:42.440742+0000","last_fullsized":"2024-09-12T18:01:42.440742+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:42.440599+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:42.440599+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.440599+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:45.997961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.136868+0000","last_change":"2024-09-12T18:02:08.136868+0000","last_active":"2024-09-12T18:02:08.136868+0000","last_peered":"2024-09-12T18:02:08.136868+0000","last_clean":"2024-09-12T18:02:08.136868+0000","last_became_active":"2024-09-12T17:49:56.044699+0000","last_became_peered":"2024-09-12T17:49:56.044699+0000","last_unstale":"2024-09-12T18:02:08.136868+0000","last_undegraded":"2024-09-12T18:02:08.136868+0000","last_fullsized":"2024-09-12T18:02:08.136868+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.136761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.136761+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.136761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:52.637236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.967648+0000","last_change":"2024-09-12T18:02:12.967648+0000","last_active":"2024-09-12T18:02:12.967648+0000","last_peered":"2024-09-12T18:02:12.967648+0000","last_clean":"2024-09-12T18:02:12.967648+0000","last_became_active":"2024-09-12T17:38:47.020191+0000","last_became_peered":"2024-09-12T17:38:47.020191+0000","last_unstale":"2024-09-12T18:02:12.967648+0000","last_undegraded":"2024-09-12T18:02:12.967648+0000","last_fullsized":"2024-09-12T18:02:12.967648+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:02:12.967545+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:02:12.967545+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.967545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:48.873948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.402238+0000","last_change":"2024-09-12T18:01:46.402238+0000","last_active":"2024-09-12T18:01:46.402238+0000","last_peered":"2024-09-12T18:01:46.402238+0000","last_clean":"2024-09-12T18:01:46.402238+0000","last_became_active":"2024-09-12T17:38:43.993233+0000","last_became_peered":"2024-09-12T17:38:43.993233+0000","last_unstale":"2024-09-12T18:01:46.402238+0000","last_undegraded":"2024-09-12T18:01:46.402238+0000","last_fullsized":"2024-09-12T18:01:46.402238+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:46.402155+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:46.402155+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.402155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:08.664363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'10","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.429518+0000","last_change":"2024-09-12T18:01:40.429459+0000","last_active":"2024-09-12T18:01:40.429518+0000","last_peered":"2024-09-12T18:01:40.429518+0000","last_clean":"2024-09-12T18:01:40.429518+0000","last_became_active":"2024-09-12T17:37:08.656109+0000","last_became_peered":"2024-09-12T17:37:08.656109+0000","last_unstale":"2024-09-12T18:01:40.429518+0000","last_undegraded":"2024-09-12T18:01:40.429518+0000","last_fullsized":"2024-09-12T18:01:40.429518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T18:01:40.429380+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T18:01:40.429380+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.429380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:15.701071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.001108+0000","last_change":"2024-09-12T18:01:52.001108+0000","last_active":"2024-09-12T18:01:52.001108+0000","last_peered":"2024-09-12T18:01:52.001108+0000","last_clean":"2024-09-12T18:01:52.001108+0000","last_became_active":"2024-09-12T17:49:56.047708+0000","last_became_peered":"2024-09-12T17:49:56.047708+0000","last_unstale":"2024-09-12T18:01:52.001108+0000","last_undegraded":"2024-09-12T18:01:52.001108+0000","last_fullsized":"2024-09-12T18:01:52.001108+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:52.001010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:52.001010+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.001010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:47.622634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.993924+0000","last_change":"2024-09-12T18:01:48.993924+0000","last_active":"2024-09-12T18:01:48.993924+0000","last_peered":"2024-09-12T18:01:48.993924+0000","last_clean":"2024-09-12T18:01:48.993924+0000","last_became_active":"2024-09-12T17:38:47.032465+0000","last_became_peered":"2024-09-12T17:38:47.032465+0000","last_unstale":"2024-09-12T18:01:48.993924+0000","last_undegraded":"2024-09-12T18:01:48.993924+0000","last_fullsized":"2024-09-12T18:01:48.993924+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:48.993817+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:48.993817+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.993817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:40.189737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.197559+0000","last_change":"2024-09-12T18:01:51.197500+0000","last_active":"2024-09-12T18:01:51.197559+0000","last_peered":"2024-09-12T18:01:51.197559+0000","last_clean":"2024-09-12T18:01:51.197559+0000","last_became_active":"2024-09-12T17:38:43.988238+0000","last_became_peered":"2024-09-12T17:38:43.988238+0000","last_unstale":"2024-09-12T18:01:51.197559+0000","last_undegraded":"2024-09-12T18:01:51.197559+0000","last_fullsized":"2024-09-12T18:01:51.197559+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:51.197409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:51.197409+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.197409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:31.709331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'44","reported_seq":167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.007253+0000","last_change":"2024-09-12T18:01:38.007253+0000","last_active":"2024-09-12T18:01:38.007253+0000","last_peered":"2024-09-12T18:01:38.007253+0000","last_clean":"2024-09-12T18:01:38.007253+0000","last_became_active":"2024-09-12T17:37:08.652200+0000","last_became_peered":"2024-09-12T17:37:08.652200+0000","last_unstale":"2024-09-12T18:01:38.007253+0000","last_undegraded":"2024-09-12T18:01:38.007253+0000","last_fullsized":"2024-09-12T18:01:38.007253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T18:01:38.007151+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T18:01:38.007151+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.007151+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:36.080873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.827854+0000","last_change":"2024-09-12T18:01:43.827854+0000","last_active":"2024-09-12T18:01:43.827854+0000","last_peered":"2024-09-12T18:01:43.827854+0000","last_clean":"2024-09-12T18:01:43.827854+0000","last_became_active":"2024-09-12T17:49:56.045153+0000","last_became_peered":"2024-09-12T17:49:56.045153+0000","last_unstale":"2024-09-12T18:01:43.827854+0000","last_undegraded":"2024-09-12T18:01:43.827854+0000","last_fullsized":"2024-09-12T18:01:43.827854+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:43.827751+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:43.827751+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.827751+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.232289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.382817+0000","last_change":"2024-09-12T18:01:50.382817+0000","last_active":"2024-09-12T18:01:50.382817+0000","last_peered":"2024-09-12T18:01:50.382817+0000","last_clean":"2024-09-12T18:01:50.382817+0000","last_became_active":"2024-09-12T17:38:47.030286+0000","last_became_peered":"2024-09-12T17:38:47.030286+0000","last_unstale":"2024-09-12T18:01:50.382817+0000","last_undegraded":"2024-09-12T18:01:50.382817+0000","last_fullsized":"2024-09-12T18:01:50.382817+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:50.382712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:50.382712+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.382712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:50.956710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'9","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.369700+0000","last_change":"2024-09-12T18:01:44.369700+0000","last_active":"2024-09-12T18:01:44.369700+0000","last_peered":"2024-09-12T18:01:44.369700+0000","last_clean":"2024-09-12T18:01:44.369700+0000","last_became_active":"2024-09-12T17:38:43.992528+0000","last_became_peered":"2024-09-12T17:38:43.992528+0000","last_unstale":"2024-09-12T18:01:44.369700+0000","last_undegraded":"2024-09-12T18:01:44.369700+0000","last_fullsized":"2024-09-12T18:01:44.369700+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T18:01:44.369597+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T18:01:44.369597+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.369597+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.678045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'46","reported_seq":170,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.166560+0000","last_change":"2024-09-12T18:01:50.166560+0000","last_active":"2024-09-12T18:01:50.166560+0000","last_peered":"2024-09-12T18:01:50.166560+0000","last_clean":"2024-09-12T18:01:50.166560+0000","last_became_active":"2024-09-12T17:37:08.660747+0000","last_became_peered":"2024-09-12T17:37:08.660747+0000","last_unstale":"2024-09-12T18:01:50.166560+0000","last_undegraded":"2024-09-12T18:01:50.166560+0000","last_fullsized":"2024-09-12T18:01:50.166560+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T18:01:50.166480+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T18:01:50.166480+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.166480+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.307474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":158,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.432045+0000","last_change":"2024-09-12T18:01:59.432045+0000","last_active":"2024-09-12T18:01:59.432045+0000","last_peered":"2024-09-12T18:01:59.432045+0000","last_clean":"2024-09-12T18:01:59.432045+0000","last_became_active":"2024-09-12T17:49:56.044908+0000","last_became_peered":"2024-09-12T17:49:56.044908+0000","last_unstale":"2024-09-12T18:01:59.432045+0000","last_undegraded":"2024-09-12T18:01:59.432045+0000","last_fullsized":"2024-09-12T18:01:59.432045+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:59.431956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:59.431956+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.431956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.710188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"262'9","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.749932+0000","last_change":"2024-09-12T18:01:39.749932+0000","last_active":"2024-09-12T18:01:39.749932+0000","last_peered":"2024-09-12T18:01:39.749932+0000","last_clean":"2024-09-12T18:01:39.749932+0000","last_became_active":"2024-09-12T17:38:47.025411+0000","last_became_peered":"2024-09-12T17:38:47.025411+0000","last_unstale":"2024-09-12T18:01:39.749932+0000","last_undegraded":"2024-09-12T18:01:39.749932+0000","last_fullsized":"2024-09-12T18:01:39.749932+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:01:39.749836+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:01:39.749836+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.749836+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:48.388934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.892447+0000","last_change":"2024-09-12T18:02:05.892447+0000","last_active":"2024-09-12T18:02:05.892447+0000","last_peered":"2024-09-12T18:02:05.892447+0000","last_clean":"2024-09-12T18:02:05.892447+0000","last_became_active":"2024-09-12T17:38:43.993020+0000","last_became_peered":"2024-09-12T17:38:43.993020+0000","last_unstale":"2024-09-12T18:02:05.892447+0000","last_undegraded":"2024-09-12T18:02:05.892447+0000","last_fullsized":"2024-09-12T18:02:05.892447+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:02:05.892358+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:02:05.892358+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.892358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:16.771372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'24","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.760333+0000","last_change":"2024-09-12T18:01:38.760333+0000","last_active":"2024-09-12T18:01:38.760333+0000","last_peered":"2024-09-12T18:01:38.760333+0000","last_clean":"2024-09-12T18:01:38.760333+0000","last_became_active":"2024-09-12T17:37:08.652029+0000","last_became_peered":"2024-09-12T17:37:08.652029+0000","last_unstale":"2024-09-12T18:01:38.760333+0000","last_undegraded":"2024-09-12T18:01:38.760333+0000","last_fullsized":"2024-09-12T18:01:38.760333+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'24","last_scrub_stamp":"2024-09-12T18:01:38.760231+0000","last_deep_scrub":"265'24","last_deep_scrub_stamp":"2024-09-12T18:01:38.760231+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.760231+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:14.745699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":88,"num_write":44,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.777318+0000","last_change":"2024-09-12T18:01:42.777247+0000","last_active":"2024-09-12T18:01:42.777318+0000","last_peered":"2024-09-12T18:01:42.777318+0000","last_clean":"2024-09-12T18:01:42.777318+0000","last_became_active":"2024-09-12T17:49:56.046332+0000","last_became_peered":"2024-09-12T17:49:56.046332+0000","last_unstale":"2024-09-12T18:01:42.777318+0000","last_undegraded":"2024-09-12T18:01:42.777318+0000","last_fullsized":"2024-09-12T18:01:42.777318+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.777148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.777148+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.777148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:23.964598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.228062+0000","last_change":"2024-09-12T18:01:57.228062+0000","last_active":"2024-09-12T18:01:57.228062+0000","last_peered":"2024-09-12T18:01:57.228062+0000","last_clean":"2024-09-12T18:01:57.228062+0000","last_became_active":"2024-09-12T17:38:47.030549+0000","last_became_peered":"2024-09-12T17:38:47.030549+0000","last_unstale":"2024-09-12T18:01:57.228062+0000","last_undegraded":"2024-09-12T18:01:57.228062+0000","last_fullsized":"2024-09-12T18:01:57.228062+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:01:57.227971+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:01:57.227971+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.227971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:49.921746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.878269+0000","last_change":"2024-09-12T18:02:03.878269+0000","last_active":"2024-09-12T18:02:03.878269+0000","last_peered":"2024-09-12T18:02:03.878269+0000","last_clean":"2024-09-12T18:02:03.878269+0000","last_became_active":"2024-09-12T17:38:43.990921+0000","last_became_peered":"2024-09-12T17:38:43.990921+0000","last_unstale":"2024-09-12T18:02:03.878269+0000","last_undegraded":"2024-09-12T18:02:03.878269+0000","last_fullsized":"2024-09-12T18:02:03.878269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:03.878167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:03.878167+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.878167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:15.249606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'4","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.989848+0000","last_change":"2024-09-12T18:01:47.989848+0000","last_active":"2024-09-12T18:01:47.989848+0000","last_peered":"2024-09-12T18:01:47.989848+0000","last_clean":"2024-09-12T18:01:47.989848+0000","last_became_active":"2024-09-12T17:37:08.660961+0000","last_became_peered":"2024-09-12T17:37:08.660961+0000","last_unstale":"2024-09-12T18:01:47.989848+0000","last_undegraded":"2024-09-12T18:01:47.989848+0000","last_fullsized":"2024-09-12T18:01:47.989848+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:47.989757+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:47.989757+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.989757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:08.427256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.808425+0000","last_change":"2024-09-12T18:01:47.808365+0000","last_active":"2024-09-12T18:01:47.808425+0000","last_peered":"2024-09-12T18:01:47.808425+0000","last_clean":"2024-09-12T18:01:47.808425+0000","last_became_active":"2024-09-12T17:49:56.041461+0000","last_became_peered":"2024-09-12T17:49:56.041461+0000","last_unstale":"2024-09-12T18:01:47.808425+0000","last_undegraded":"2024-09-12T18:01:47.808425+0000","last_fullsized":"2024-09-12T18:01:47.808425+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.808273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.808273+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.808273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:07.073318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.205191+0000","last_change":"2024-09-12T18:01:56.205191+0000","last_active":"2024-09-12T18:01:56.205191+0000","last_peered":"2024-09-12T18:01:56.205191+0000","last_clean":"2024-09-12T18:01:56.205191+0000","last_became_active":"2024-09-12T17:38:47.024651+0000","last_became_peered":"2024-09-12T17:38:47.024651+0000","last_unstale":"2024-09-12T18:01:56.205191+0000","last_undegraded":"2024-09-12T18:01:56.205191+0000","last_fullsized":"2024-09-12T18:01:56.205191+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:01:56.205090+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:01:56.205090+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.205090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:14.305833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.076090+0000","last_change":"2024-09-12T18:01:53.076090+0000","last_active":"2024-09-12T18:01:53.076090+0000","last_peered":"2024-09-12T18:01:53.076090+0000","last_clean":"2024-09-12T18:01:53.076090+0000","last_became_active":"2024-09-12T17:38:43.990211+0000","last_became_peered":"2024-09-12T17:38:43.990211+0000","last_unstale":"2024-09-12T18:01:53.076090+0000","last_undegraded":"2024-09-12T18:01:53.076090+0000","last_fullsized":"2024-09-12T18:01:53.076090+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:01:53.075965+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:01:53.075965+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.075965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:35.731940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'32","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.932464+0000","last_change":"2024-09-12T18:02:06.932464+0000","last_active":"2024-09-12T18:02:06.932464+0000","last_peered":"2024-09-12T18:02:06.932464+0000","last_clean":"2024-09-12T18:02:06.932464+0000","last_became_active":"2024-09-12T17:37:08.649446+0000","last_became_peered":"2024-09-12T17:37:08.649446+0000","last_unstale":"2024-09-12T18:02:06.932464+0000","last_undegraded":"2024-09-12T18:02:06.932464+0000","last_fullsized":"2024-09-12T18:02:06.932464+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T18:02:06.932362+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T18:02:06.932362+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.932362+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:03.340200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":124,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.149077+0000","last_change":"2024-09-12T18:02:03.149022+0000","last_active":"2024-09-12T18:02:03.149077+0000","last_peered":"2024-09-12T18:02:03.149077+0000","last_clean":"2024-09-12T18:02:03.149077+0000","last_became_active":"2024-09-12T17:49:56.046589+0000","last_became_peered":"2024-09-12T17:49:56.046589+0000","last_unstale":"2024-09-12T18:02:03.149077+0000","last_undegraded":"2024-09-12T18:02:03.149077+0000","last_fullsized":"2024-09-12T18:02:03.149077+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:03.148933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:03.148933+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.148933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:05.274994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.761849+0000","last_change":"2024-09-12T18:01:37.761849+0000","last_active":"2024-09-12T18:01:37.761849+0000","last_peered":"2024-09-12T18:01:37.761849+0000","last_clean":"2024-09-12T18:01:37.761849+0000","last_became_active":"2024-09-12T17:38:47.025792+0000","last_became_peered":"2024-09-12T17:38:47.025792+0000","last_unstale":"2024-09-12T18:01:37.761849+0000","last_undegraded":"2024-09-12T18:01:37.761849+0000","last_fullsized":"2024-09-12T18:01:37.761849+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:37.761746+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:37.761746+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.761746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:15.257841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.937998+0000","last_change":"2024-09-12T18:01:45.937998+0000","last_active":"2024-09-12T18:01:45.937998+0000","last_peered":"2024-09-12T18:01:45.937998+0000","last_clean":"2024-09-12T18:01:45.937998+0000","last_became_active":"2024-09-12T17:38:43.991646+0000","last_became_peered":"2024-09-12T17:38:43.991646+0000","last_unstale":"2024-09-12T18:01:45.937998+0000","last_undegraded":"2024-09-12T18:01:45.937998+0000","last_fullsized":"2024-09-12T18:01:45.937998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.937900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.937900+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.937900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:45.515046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"262'17","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.035140+0000","last_change":"2024-09-12T18:01:37.035068+0000","last_active":"2024-09-12T18:01:37.035140+0000","last_peered":"2024-09-12T18:01:37.035140+0000","last_clean":"2024-09-12T18:01:37.035140+0000","last_became_active":"2024-09-12T17:37:08.658474+0000","last_became_peered":"2024-09-12T17:37:08.658474+0000","last_unstale":"2024-09-12T18:01:37.035140+0000","last_undegraded":"2024-09-12T18:01:37.035140+0000","last_fullsized":"2024-09-12T18:01:37.035140+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-12T18:01:37.034978+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-12T18:01:37.034978+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.034978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:12.187790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.934734+0000","last_change":"2024-09-12T18:02:15.934673+0000","last_active":"2024-09-12T18:02:15.934734+0000","last_peered":"2024-09-12T18:02:15.934734+0000","last_clean":"2024-09-12T18:02:15.934734+0000","last_became_active":"2024-09-12T17:49:56.035698+0000","last_became_peered":"2024-09-12T17:49:56.035698+0000","last_unstale":"2024-09-12T18:02:15.934734+0000","last_undegraded":"2024-09-12T18:02:15.934734+0000","last_fullsized":"2024-09-12T18:02:15.934734+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:15.934574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:15.934574+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.934574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.684598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.004885+0000","last_change":"2024-09-12T18:02:12.004885+0000","last_active":"2024-09-12T18:02:12.004885+0000","last_peered":"2024-09-12T18:02:12.004885+0000","last_clean":"2024-09-12T18:02:12.004885+0000","last_became_active":"2024-09-12T17:38:47.020643+0000","last_became_peered":"2024-09-12T17:38:47.020643+0000","last_unstale":"2024-09-12T18:02:12.004885+0000","last_undegraded":"2024-09-12T18:02:12.004885+0000","last_fullsized":"2024-09-12T18:02:12.004885+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T18:02:12.004782+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T18:02:12.004782+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.004782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:22.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5116,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.910616+0000","last_change":"2024-09-12T18:02:02.910616+0000","last_active":"2024-09-12T18:02:02.910616+0000","last_peered":"2024-09-12T18:02:02.910616+0000","last_clean":"2024-09-12T18:02:02.910616+0000","last_became_active":"2024-09-12T17:38:43.994289+0000","last_became_peered":"2024-09-12T17:38:43.994289+0000","last_unstale":"2024-09-12T18:02:02.910616+0000","last_undegraded":"2024-09-12T18:02:02.910616+0000","last_fullsized":"2024-09-12T18:02:02.910616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:02.910508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:02.910508+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.910508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:44.940461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'50","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.306606+0000","last_change":"2024-09-12T18:01:38.306523+0000","last_active":"2024-09-12T18:01:38.306606+0000","last_peered":"2024-09-12T18:01:38.306606+0000","last_clean":"2024-09-12T18:01:38.306606+0000","last_became_active":"2024-09-12T17:37:08.658782+0000","last_became_peered":"2024-09-12T17:37:08.658782+0000","last_unstale":"2024-09-12T18:01:38.306606+0000","last_undegraded":"2024-09-12T18:01:38.306606+0000","last_fullsized":"2024-09-12T18:01:38.306606+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:38.306404+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:38.306404+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.306404+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:31.601797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":159,"num_write":99,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.445612+0000","last_change":"2024-09-12T18:01:58.445612+0000","last_active":"2024-09-12T18:01:58.445612+0000","last_peered":"2024-09-12T18:01:58.445612+0000","last_clean":"2024-09-12T18:01:58.445612+0000","last_became_active":"2024-09-12T17:49:56.037881+0000","last_became_peered":"2024-09-12T17:49:56.037881+0000","last_unstale":"2024-09-12T18:01:58.445612+0000","last_undegraded":"2024-09-12T18:01:58.445612+0000","last_fullsized":"2024-09-12T18:01:58.445612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:58.445494+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:58.445494+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.445494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:11.151009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.052353+0000","last_change":"2024-09-12T18:01:54.052353+0000","last_active":"2024-09-12T18:01:54.052353+0000","last_peered":"2024-09-12T18:01:54.052353+0000","last_clean":"2024-09-12T18:01:54.052353+0000","last_became_active":"2024-09-12T17:38:47.025180+0000","last_became_peered":"2024-09-12T17:38:47.025180+0000","last_unstale":"2024-09-12T18:01:54.052353+0000","last_undegraded":"2024-09-12T18:01:54.052353+0000","last_fullsized":"2024-09-12T18:01:54.052353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:01:54.052270+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:01:54.052270+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.052270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:07.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.960951+0000","last_change":"2024-09-12T18:01:43.960951+0000","last_active":"2024-09-12T18:01:43.960951+0000","last_peered":"2024-09-12T18:01:43.960951+0000","last_clean":"2024-09-12T18:01:43.960951+0000","last_became_active":"2024-09-12T17:38:43.992663+0000","last_became_peered":"2024-09-12T17:38:43.992663+0000","last_unstale":"2024-09-12T18:01:43.960951+0000","last_undegraded":"2024-09-12T18:01:43.960951+0000","last_fullsized":"2024-09-12T18:01:43.960951+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:43.960863+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:43.960863+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.960863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:07.304013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.961620+0000","last_change":"2024-09-12T18:01:42.961552+0000","last_active":"2024-09-12T18:01:42.961620+0000","last_peered":"2024-09-12T18:01:42.961620+0000","last_clean":"2024-09-12T18:01:42.961620+0000","last_became_active":"2024-09-12T17:37:08.654310+0000","last_became_peered":"2024-09-12T17:37:08.654310+0000","last_unstale":"2024-09-12T18:01:42.961620+0000","last_undegraded":"2024-09-12T18:01:42.961620+0000","last_fullsized":"2024-09-12T18:01:42.961620+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T18:01:42.961462+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T18:01:42.961462+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.961462+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:23.401760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.048007+0000","last_change":"2024-09-12T18:01:55.048007+0000","last_active":"2024-09-12T18:01:55.048007+0000","last_peered":"2024-09-12T18:01:55.048007+0000","last_clean":"2024-09-12T18:01:55.048007+0000","last_became_active":"2024-09-12T17:49:56.038996+0000","last_became_peered":"2024-09-12T17:49:56.038996+0000","last_unstale":"2024-09-12T18:01:55.048007+0000","last_undegraded":"2024-09-12T18:01:55.048007+0000","last_fullsized":"2024-09-12T18:01:55.048007+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.047912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.047912+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.047912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:49.523783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.003214+0000","last_change":"2024-09-12T18:02:11.003214+0000","last_active":"2024-09-12T18:02:11.003214+0000","last_peered":"2024-09-12T18:02:11.003214+0000","last_clean":"2024-09-12T18:02:11.003214+0000","last_became_active":"2024-09-12T17:38:47.025782+0000","last_became_peered":"2024-09-12T17:38:47.025782+0000","last_unstale":"2024-09-12T18:02:11.003214+0000","last_undegraded":"2024-09-12T18:02:11.003214+0000","last_fullsized":"2024-09-12T18:02:11.003214+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:02:11.003120+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:02:11.003120+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.003120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:44.341948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3651,"num_write":12,"num_write_kb":7747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.889149+0000","last_change":"2024-09-12T18:02:01.889149+0000","last_active":"2024-09-12T18:02:01.889149+0000","last_peered":"2024-09-12T18:02:01.889149+0000","last_clean":"2024-09-12T18:02:01.889149+0000","last_became_active":"2024-09-12T17:38:43.987895+0000","last_became_peered":"2024-09-12T17:38:43.987895+0000","last_unstale":"2024-09-12T18:02:01.889149+0000","last_undegraded":"2024-09-12T18:02:01.889149+0000","last_fullsized":"2024-09-12T18:02:01.889149+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.889054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.889054+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.889054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:13.091076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.858247+0000","last_change":"2024-09-12T18:01:58.858179+0000","last_active":"2024-09-12T18:01:58.858247+0000","last_peered":"2024-09-12T18:01:58.858247+0000","last_clean":"2024-09-12T18:01:58.858247+0000","last_became_active":"2024-09-12T17:37:08.646865+0000","last_became_peered":"2024-09-12T17:37:08.646865+0000","last_unstale":"2024-09-12T18:01:58.858247+0000","last_undegraded":"2024-09-12T18:01:58.858247+0000","last_fullsized":"2024-09-12T18:01:58.858247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T18:01:58.858090+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T18:01:58.858090+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.858090+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:29.356864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.118562+0000","last_change":"2024-09-12T18:02:05.118453+0000","last_active":"2024-09-12T18:02:05.118562+0000","last_peered":"2024-09-12T18:02:05.118562+0000","last_clean":"2024-09-12T18:02:05.118562+0000","last_became_active":"2024-09-12T17:49:56.043876+0000","last_became_peered":"2024-09-12T17:49:56.043876+0000","last_unstale":"2024-09-12T18:02:05.118562+0000","last_undegraded":"2024-09-12T18:02:05.118562+0000","last_fullsized":"2024-09-12T18:02:05.118562+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:05.118357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:05.118357+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.118357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:02.251668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.944437+0000","last_change":"2024-09-12T18:01:47.944437+0000","last_active":"2024-09-12T18:01:47.944437+0000","last_peered":"2024-09-12T18:01:47.944437+0000","last_clean":"2024-09-12T18:01:47.944437+0000","last_became_active":"2024-09-12T17:38:47.034918+0000","last_became_peered":"2024-09-12T17:38:47.034918+0000","last_unstale":"2024-09-12T18:01:47.944437+0000","last_undegraded":"2024-09-12T18:01:47.944437+0000","last_fullsized":"2024-09-12T18:01:47.944437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:01:47.944348+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:01:47.944348+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.944348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:35.932936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5116,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.404175+0000","last_change":"2024-09-12T18:01:46.404175+0000","last_active":"2024-09-12T18:01:46.404175+0000","last_peered":"2024-09-12T18:01:46.404175+0000","last_clean":"2024-09-12T18:01:46.404175+0000","last_became_active":"2024-09-12T17:38:43.992828+0000","last_became_peered":"2024-09-12T17:38:43.992828+0000","last_unstale":"2024-09-12T18:01:46.404175+0000","last_undegraded":"2024-09-12T18:01:46.404175+0000","last_fullsized":"2024-09-12T18:01:46.404175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:46.404077+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:46.404077+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.404077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:52.508125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4118,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'28","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.842452+0000","last_change":"2024-09-12T18:01:57.842389+0000","last_active":"2024-09-12T18:01:57.842452+0000","last_peered":"2024-09-12T18:01:57.842452+0000","last_clean":"2024-09-12T18:01:57.842452+0000","last_became_active":"2024-09-12T17:37:08.655130+0000","last_became_peered":"2024-09-12T17:37:08.655130+0000","last_unstale":"2024-09-12T18:01:57.842452+0000","last_undegraded":"2024-09-12T18:01:57.842452+0000","last_fullsized":"2024-09-12T18:01:57.842452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T18:01:57.842293+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T18:01:57.842293+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.842293+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:22.172808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.901742+0000","last_change":"2024-09-12T18:02:16.901676+0000","last_active":"2024-09-12T18:02:16.901742+0000","last_peered":"2024-09-12T18:02:16.901742+0000","last_clean":"2024-09-12T18:02:16.901742+0000","last_became_active":"2024-09-12T17:49:56.042722+0000","last_became_peered":"2024-09-12T17:49:56.042722+0000","last_unstale":"2024-09-12T18:02:16.901742+0000","last_undegraded":"2024-09-12T18:02:16.901742+0000","last_fullsized":"2024-09-12T18:02:16.901742+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.901578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.901578+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.901578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:40.539231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.965307+0000","last_change":"2024-09-12T18:01:46.965307+0000","last_active":"2024-09-12T18:01:46.965307+0000","last_peered":"2024-09-12T18:01:46.965307+0000","last_clean":"2024-09-12T18:01:46.965307+0000","last_became_active":"2024-09-12T17:38:47.029489+0000","last_became_peered":"2024-09-12T17:38:47.029489+0000","last_unstale":"2024-09-12T18:01:46.965307+0000","last_undegraded":"2024-09-12T18:01:46.965307+0000","last_fullsized":"2024-09-12T18:01:46.965307+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:01:46.965209+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:01:46.965209+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.965209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:29.481280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":10,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.335597+0000","last_change":"2024-09-12T18:01:41.335530+0000","last_active":"2024-09-12T18:01:41.335597+0000","last_peered":"2024-09-12T18:01:41.335597+0000","last_clean":"2024-09-12T18:01:41.335597+0000","last_became_active":"2024-09-12T17:38:43.992066+0000","last_became_peered":"2024-09-12T17:38:43.992066+0000","last_unstale":"2024-09-12T18:01:41.335597+0000","last_undegraded":"2024-09-12T18:01:41.335597+0000","last_fullsized":"2024-09-12T18:01:41.335597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:41.335442+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:41.335442+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.335442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:40.801426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.974360+0000","last_change":"2024-09-12T18:01:38.974360+0000","last_active":"2024-09-12T18:01:38.974360+0000","last_peered":"2024-09-12T18:01:38.974360+0000","last_clean":"2024-09-12T18:01:38.974360+0000","last_became_active":"2024-09-12T17:37:08.651150+0000","last_became_peered":"2024-09-12T17:37:08.651150+0000","last_unstale":"2024-09-12T18:01:38.974360+0000","last_undegraded":"2024-09-12T18:01:38.974360+0000","last_fullsized":"2024-09-12T18:01:38.974360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T18:01:38.974250+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T18:01:38.974250+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.974250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:57.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":66,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'321","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.693631+0000","last_change":"2024-09-12T18:01:23.693564+0000","last_active":"2024-09-12T18:01:23.693631+0000","last_peered":"2024-09-12T18:01:23.693631+0000","last_clean":"2024-09-12T18:01:23.693631+0000","last_became_active":"2024-09-12T17:21:50.777406+0000","last_became_peered":"2024-09-12T17:21:50.777406+0000","last_unstale":"2024-09-12T18:01:23.693631+0000","last_undegraded":"2024-09-12T18:01:23.693631+0000","last_fullsized":"2024-09-12T18:01:23.693631+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T18:01:23.693423+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.693423+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:45.036692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399146,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":38786,"num_write":1044,"num_write_kb":37678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'482","reported_seq":1981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.203059+0000","last_change":"2024-09-12T18:01:23.202958+0000","last_active":"2024-09-12T18:01:23.203059+0000","last_peered":"2024-09-12T18:01:23.203059+0000","last_clean":"2024-09-12T18:01:23.203059+0000","last_became_active":"2024-09-12T17:21:52.747136+0000","last_became_peered":"2024-09-12T17:21:52.747136+0000","last_unstale":"2024-09-12T18:01:23.203059+0000","last_undegraded":"2024-09-12T18:01:23.203059+0000","last_fullsized":"2024-09-12T18:01:23.203059+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T18:01:23.202855+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.202855+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:43.946108+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2480,"num_read_kb":2310,"num_write":576,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":941,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'373","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.026863+0000","last_change":"2024-09-12T18:01:24.026802+0000","last_active":"2024-09-12T18:01:24.026863+0000","last_peered":"2024-09-12T18:01:24.026863+0000","last_clean":"2024-09-12T18:01:24.026863+0000","last_became_active":"2024-09-12T17:21:50.768927+0000","last_became_peered":"2024-09-12T17:21:50.768927+0000","last_unstale":"2024-09-12T18:01:24.026863+0000","last_undegraded":"2024-09-12T18:01:24.026863+0000","last_fullsized":"2024-09-12T18:01:24.026863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T18:01:24.026638+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.026638+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.853845+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":37151,"num_write":1322,"num_write_kb":30349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'546","reported_seq":2168,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.582578+0000","last_change":"2024-09-12T18:01:34.582483+0000","last_active":"2024-09-12T18:01:34.582578+0000","last_peered":"2024-09-12T18:01:34.582578+0000","last_clean":"2024-09-12T18:01:34.582578+0000","last_became_active":"2024-09-12T17:21:52.746517+0000","last_became_peered":"2024-09-12T17:21:52.746517+0000","last_unstale":"2024-09-12T18:01:34.582578+0000","last_undegraded":"2024-09-12T18:01:34.582578+0000","last_fullsized":"2024-09-12T18:01:34.582578+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'546","last_scrub_stamp":"2024-09-12T18:01:34.582313+0000","last_deep_scrub":"265'546","last_deep_scrub_stamp":"2024-09-12T18:01:34.582313+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.582313+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:12.771444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2589,"num_write":678,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":485,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'320","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.022949+0000","last_change":"2024-09-12T18:01:23.022871+0000","last_active":"2024-09-12T18:01:23.022949+0000","last_peered":"2024-09-12T18:01:23.022949+0000","last_clean":"2024-09-12T18:01:23.022949+0000","last_became_active":"2024-09-12T17:21:50.754460+0000","last_became_peered":"2024-09-12T17:21:50.754460+0000","last_unstale":"2024-09-12T18:01:23.022949+0000","last_undegraded":"2024-09-12T18:01:23.022949+0000","last_fullsized":"2024-09-12T18:01:23.022949+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:23.022698+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.022698+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:20.281089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288578,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":719,"num_read_kb":16808,"num_write":978,"num_write_kb":41839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'615","reported_seq":2384,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.543359+0000","last_change":"2024-09-12T18:01:33.543305+0000","last_active":"2024-09-12T18:01:33.543359+0000","last_peered":"2024-09-12T18:01:33.543359+0000","last_clean":"2024-09-12T18:01:33.543359+0000","last_became_active":"2024-09-12T17:21:52.743523+0000","last_became_peered":"2024-09-12T17:21:52.743523+0000","last_unstale":"2024-09-12T18:01:33.543359+0000","last_undegraded":"2024-09-12T18:01:33.543359+0000","last_fullsized":"2024-09-12T18:01:33.543359+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'615","last_scrub_stamp":"2024-09-12T18:01:33.543217+0000","last_deep_scrub":"265'615","last_deep_scrub_stamp":"2024-09-12T18:01:33.543217+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.543217+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:40.509832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3410,"num_read_kb":3189,"num_write":784,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'428","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.900689+0000","last_change":"2024-09-12T18:01:14.900585+0000","last_active":"2024-09-12T18:01:14.900689+0000","last_peered":"2024-09-12T18:01:14.900689+0000","last_clean":"2024-09-12T18:01:14.900689+0000","last_became_active":"2024-09-12T17:21:50.773001+0000","last_became_peered":"2024-09-12T17:21:50.773001+0000","last_unstale":"2024-09-12T18:01:14.900689+0000","last_undegraded":"2024-09-12T18:01:14.900689+0000","last_fullsized":"2024-09-12T18:01:14.900689+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T18:01:14.900378+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.900378+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:40.317506+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355300,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":592,"num_read_kb":16041,"num_write":1318,"num_write_kb":44582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'483","reported_seq":2015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.874189+0000","last_change":"2024-09-12T18:01:25.874120+0000","last_active":"2024-09-12T18:01:25.874189+0000","last_peered":"2024-09-12T18:01:25.874189+0000","last_clean":"2024-09-12T18:01:25.874189+0000","last_became_active":"2024-09-12T17:21:52.742417+0000","last_became_peered":"2024-09-12T17:21:52.742417+0000","last_unstale":"2024-09-12T18:01:25.874189+0000","last_undegraded":"2024-09-12T18:01:25.874189+0000","last_fullsized":"2024-09-12T18:01:25.874189+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-12T18:01:25.874037+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.874037+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:51.343725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2440,"num_read_kb":2278,"num_write":568,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'286","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.715989+0000","last_change":"2024-09-12T18:01:15.715916+0000","last_active":"2024-09-12T18:01:15.715989+0000","last_peered":"2024-09-12T18:01:15.715989+0000","last_clean":"2024-09-12T18:01:15.715989+0000","last_became_active":"2024-09-12T17:21:50.774616+0000","last_became_peered":"2024-09-12T17:21:50.774616+0000","last_unstale":"2024-09-12T18:01:15.715989+0000","last_undegraded":"2024-09-12T18:01:15.715989+0000","last_fullsized":"2024-09-12T18:01:15.715989+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T18:01:15.715784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.715784+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:13.680021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":5548,"num_write":891,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'845","reported_seq":2514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.659043+0000","last_change":"2024-09-12T18:01:18.658937+0000","last_active":"2024-09-12T18:01:18.659043+0000","last_peered":"2024-09-12T18:01:18.659043+0000","last_clean":"2024-09-12T18:01:18.659043+0000","last_became_active":"2024-09-12T17:21:52.756172+0000","last_became_peered":"2024-09-12T17:21:52.756172+0000","last_unstale":"2024-09-12T18:01:18.659043+0000","last_undegraded":"2024-09-12T18:01:18.659043+0000","last_fullsized":"2024-09-12T18:01:18.659043+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'845","last_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_deep_scrub":"265'845","last_deep_scrub_stamp":"2024-09-12T18:01:18.658839+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.658839+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:56.655053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3962,"num_read_kb":3588,"num_write":1065,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'324","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.905445+0000","last_change":"2024-09-12T18:01:15.905312+0000","last_active":"2024-09-12T18:01:15.905445+0000","last_peered":"2024-09-12T18:01:15.905445+0000","last_clean":"2024-09-12T18:01:15.905445+0000","last_became_active":"2024-09-12T17:21:50.776694+0000","last_became_peered":"2024-09-12T17:21:50.776694+0000","last_unstale":"2024-09-12T18:01:15.905445+0000","last_undegraded":"2024-09-12T18:01:15.905445+0000","last_fullsized":"2024-09-12T18:01:15.905445+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T18:01:15.905069+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.905069+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:23.219539+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":30145,"num_write":1083,"num_write_kb":21135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'508","reported_seq":2111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.724250+0000","last_change":"2024-09-12T18:01:20.724189+0000","last_active":"2024-09-12T18:01:20.724250+0000","last_peered":"2024-09-12T18:01:20.724250+0000","last_clean":"2024-09-12T18:01:20.724250+0000","last_became_active":"2024-09-12T17:21:52.754639+0000","last_became_peered":"2024-09-12T17:21:52.754639+0000","last_unstale":"2024-09-12T18:01:20.724250+0000","last_undegraded":"2024-09-12T18:01:20.724250+0000","last_fullsized":"2024-09-12T18:01:20.724250+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'508","last_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_deep_scrub":"265'508","last_deep_scrub_stamp":"2024-09-12T18:01:20.724105+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.724105+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:47.581144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2696,"num_read_kb":2502,"num_write":621,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'367","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.683402+0000","last_change":"2024-09-12T18:01:21.683331+0000","last_active":"2024-09-12T18:01:21.683402+0000","last_peered":"2024-09-12T18:01:21.683402+0000","last_clean":"2024-09-12T18:01:21.683402+0000","last_became_active":"2024-09-12T17:21:50.774565+0000","last_became_peered":"2024-09-12T17:21:50.774565+0000","last_unstale":"2024-09-12T18:01:21.683402+0000","last_undegraded":"2024-09-12T18:01:21.683402+0000","last_fullsized":"2024-09-12T18:01:21.683402+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T18:01:21.683187+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.683187+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.284187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036318,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":10450,"num_write":1136,"num_write_kb":44403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'745","reported_seq":2179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.002193+0000","last_change":"2024-09-12T18:01:23.002080+0000","last_active":"2024-09-12T18:01:23.002193+0000","last_peered":"2024-09-12T18:01:23.002193+0000","last_clean":"2024-09-12T18:01:23.002193+0000","last_became_active":"2024-09-12T17:21:52.748894+0000","last_became_peered":"2024-09-12T17:21:52.748894+0000","last_unstale":"2024-09-12T18:01:23.002193+0000","last_undegraded":"2024-09-12T18:01:23.002193+0000","last_fullsized":"2024-09-12T18:01:23.002193+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T18:01:23.001977+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.001977+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:23.455291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3543,"num_read_kb":3181,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'413","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.990537+0000","last_change":"2024-09-12T18:01:21.990417+0000","last_active":"2024-09-12T18:01:21.990537+0000","last_peered":"2024-09-12T18:01:21.990537+0000","last_clean":"2024-09-12T18:01:21.990537+0000","last_became_active":"2024-09-12T17:21:50.768979+0000","last_became_peered":"2024-09-12T17:21:50.768979+0000","last_unstale":"2024-09-12T18:01:21.990537+0000","last_undegraded":"2024-09-12T18:01:21.990537+0000","last_fullsized":"2024-09-12T18:01:21.990537+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T18:01:21.990298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.990298+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:19.678560+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":69100,"num_write":1161,"num_write_kb":39007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1196","reported_seq":2925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.158209+0000","last_change":"2024-09-12T18:01:33.158209+0000","last_active":"2024-09-12T18:01:33.158209+0000","last_peered":"2024-09-12T18:01:33.158209+0000","last_clean":"2024-09-12T18:01:33.158209+0000","last_became_active":"2024-09-12T17:21:52.753670+0000","last_became_peered":"2024-09-12T17:21:52.753670+0000","last_unstale":"2024-09-12T18:01:33.158209+0000","last_undegraded":"2024-09-12T18:01:33.158209+0000","last_fullsized":"2024-09-12T18:01:33.158209+0000","mapping_epoch":27,"log_start":"265'1100","ondisk_log_start":"265'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1196","last_scrub_stamp":"2024-09-12T18:01:33.158104+0000","last_deep_scrub":"265'1196","last_deep_scrub_stamp":"2024-09-12T18:01:33.158104+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.158104+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:58.782843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4966,"num_write":1724,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'490","reported_seq":2047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.532215+0000","last_change":"2024-09-12T18:01:32.532215+0000","last_active":"2024-09-12T18:01:32.532215+0000","last_peered":"2024-09-12T18:01:32.532215+0000","last_clean":"2024-09-12T18:01:32.532215+0000","last_became_active":"2024-09-12T17:21:52.750883+0000","last_became_peered":"2024-09-12T17:21:52.750883+0000","last_unstale":"2024-09-12T18:01:32.532215+0000","last_undegraded":"2024-09-12T18:01:32.532215+0000","last_fullsized":"2024-09-12T18:01:32.532215+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:32.532145+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:32.532145+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.532145+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:43.375201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2268,"num_write":584,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'383","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.180354+0000","last_change":"2024-09-12T18:01:15.180354+0000","last_active":"2024-09-12T18:01:15.180354+0000","last_peered":"2024-09-12T18:01:15.180354+0000","last_clean":"2024-09-12T18:01:15.180354+0000","last_became_active":"2024-09-12T17:21:50.763654+0000","last_became_peered":"2024-09-12T17:21:50.763654+0000","last_unstale":"2024-09-12T18:01:15.180354+0000","last_undegraded":"2024-09-12T18:01:15.180354+0000","last_fullsized":"2024-09-12T18:01:15.180354+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:15.180191+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.180191+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:38.231795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":53764,"num_write":1216,"num_write_kb":37522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'449","reported_seq":2064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.661671+0000","last_change":"2024-09-12T18:01:22.661599+0000","last_active":"2024-09-12T18:01:22.661671+0000","last_peered":"2024-09-12T18:01:22.661671+0000","last_clean":"2024-09-12T18:01:22.661671+0000","last_became_active":"2024-09-12T17:21:52.751541+0000","last_became_peered":"2024-09-12T17:21:52.751541+0000","last_unstale":"2024-09-12T18:01:22.661671+0000","last_undegraded":"2024-09-12T18:01:22.661671+0000","last_fullsized":"2024-09-12T18:01:22.661671+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T18:01:22.661510+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.661510+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:11.348161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2624,"num_read_kb":2488,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'317","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.714065+0000","last_change":"2024-09-12T18:01:14.714065+0000","last_active":"2024-09-12T18:01:14.714065+0000","last_peered":"2024-09-12T18:01:14.714065+0000","last_clean":"2024-09-12T18:01:14.714065+0000","last_became_active":"2024-09-12T17:21:50.767408+0000","last_became_peered":"2024-09-12T17:21:50.767408+0000","last_unstale":"2024-09-12T18:01:14.714065+0000","last_undegraded":"2024-09-12T18:01:14.714065+0000","last_fullsized":"2024-09-12T18:01:14.714065+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-12T18:01:14.713905+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.713905+0000","objects_scrubbed":11,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.647051+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":34593,"num_write":1052,"num_write_kb":30268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'469","reported_seq":2172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.180905+0000","last_change":"2024-09-12T18:01:20.180816+0000","last_active":"2024-09-12T18:01:20.180905+0000","last_peered":"2024-09-12T18:01:20.180905+0000","last_clean":"2024-09-12T18:01:20.180905+0000","last_became_active":"2024-09-12T17:21:52.755075+0000","last_became_peered":"2024-09-12T17:21:52.755075+0000","last_unstale":"2024-09-12T18:01:20.180905+0000","last_undegraded":"2024-09-12T18:01:20.180905+0000","last_fullsized":"2024-09-12T18:01:20.180905+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'469","last_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_deep_scrub":"265'469","last_deep_scrub_stamp":"2024-09-12T18:01:20.180664+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.180664+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.671311+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2774,"num_read_kb":2618,"num_write":553,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'341","reported_seq":1172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.821456+0000","last_change":"2024-09-12T18:01:11.821456+0000","last_active":"2024-09-12T18:01:11.821456+0000","last_peered":"2024-09-12T18:01:11.821456+0000","last_clean":"2024-09-12T18:01:11.821456+0000","last_became_active":"2024-09-12T17:21:50.769712+0000","last_became_peered":"2024-09-12T17:21:50.769712+0000","last_unstale":"2024-09-12T18:01:11.821456+0000","last_undegraded":"2024-09-12T18:01:11.821456+0000","last_fullsized":"2024-09-12T18:01:11.821456+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T18:01:11.821358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.821358+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:08.588749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":875,"num_read_kb":30506,"num_write":1060,"num_write_kb":54489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'420","reported_seq":2007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.353429+0000","last_change":"2024-09-12T18:01:25.353429+0000","last_active":"2024-09-12T18:01:25.353429+0000","last_peered":"2024-09-12T18:01:25.353429+0000","last_clean":"2024-09-12T18:01:25.353429+0000","last_became_active":"2024-09-12T17:21:52.757645+0000","last_became_peered":"2024-09-12T17:21:52.757645+0000","last_unstale":"2024-09-12T18:01:25.353429+0000","last_undegraded":"2024-09-12T18:01:25.353429+0000","last_fullsized":"2024-09-12T18:01:25.353429+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-12T18:01:25.353351+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.353351+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:54.030926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2448,"num_read_kb":2321,"num_write":501,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'419","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.786986+0000","last_change":"2024-09-12T18:01:12.786986+0000","last_active":"2024-09-12T18:01:12.786986+0000","last_peered":"2024-09-12T18:01:12.786986+0000","last_clean":"2024-09-12T18:01:12.786986+0000","last_became_active":"2024-09-12T17:21:50.768163+0000","last_became_peered":"2024-09-12T17:21:50.768163+0000","last_unstale":"2024-09-12T18:01:12.786986+0000","last_undegraded":"2024-09-12T18:01:12.786986+0000","last_fullsized":"2024-09-12T18:01:12.786986+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T18:01:12.786804+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.786804+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:13.752525+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":18097,"num_write":1302,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'1544","reported_seq":3166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.151769+0000","last_change":"2024-09-12T18:01:32.151769+0000","last_active":"2024-09-12T18:01:32.151769+0000","last_peered":"2024-09-12T18:01:32.151769+0000","last_clean":"2024-09-12T18:01:32.151769+0000","last_became_active":"2024-09-12T17:21:52.754446+0000","last_became_peered":"2024-09-12T17:21:52.754446+0000","last_unstale":"2024-09-12T18:01:32.151769+0000","last_undegraded":"2024-09-12T18:01:32.151769+0000","last_fullsized":"2024-09-12T18:01:32.151769+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1544","last_scrub_stamp":"2024-09-12T18:01:32.151645+0000","last_deep_scrub":"265'1544","last_deep_scrub_stamp":"2024-09-12T18:01:32.151645+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.151645+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:18.366283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6881,"num_read_kb":6009,"num_write":2154,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'346","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.285549+0000","last_change":"2024-09-12T18:01:22.285549+0000","last_active":"2024-09-12T18:01:22.285549+0000","last_peered":"2024-09-12T18:01:22.285549+0000","last_clean":"2024-09-12T18:01:22.285549+0000","last_became_active":"2024-09-12T17:21:50.767291+0000","last_became_peered":"2024-09-12T17:21:50.767291+0000","last_unstale":"2024-09-12T18:01:22.285549+0000","last_undegraded":"2024-09-12T18:01:22.285549+0000","last_fullsized":"2024-09-12T18:01:22.285549+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T18:01:22.285373+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.285373+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:53.823367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":18482,"num_write":1050,"num_write_kb":30991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'789","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.204231+0000","last_change":"2024-09-12T18:01:21.204231+0000","last_active":"2024-09-12T18:01:21.204231+0000","last_peered":"2024-09-12T18:01:21.204231+0000","last_clean":"2024-09-12T18:01:21.204231+0000","last_became_active":"2024-09-12T17:21:52.753727+0000","last_became_peered":"2024-09-12T17:21:52.753727+0000","last_unstale":"2024-09-12T18:01:21.204231+0000","last_undegraded":"2024-09-12T18:01:21.204231+0000","last_fullsized":"2024-09-12T18:01:21.204231+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'789","last_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_deep_scrub":"265'789","last_deep_scrub_stamp":"2024-09-12T18:01:21.204081+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.204081+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:13.829902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3796,"num_read_kb":3449,"num_write":1038,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.232895+0000","last_change":"2024-09-12T18:01:16.232834+0000","last_active":"2024-09-12T18:01:16.232895+0000","last_peered":"2024-09-12T18:01:16.232895+0000","last_clean":"2024-09-12T18:01:16.232895+0000","last_became_active":"2024-09-12T17:21:50.754409+0000","last_became_peered":"2024-09-12T17:21:50.754409+0000","last_unstale":"2024-09-12T18:01:16.232895+0000","last_undegraded":"2024-09-12T18:01:16.232895+0000","last_fullsized":"2024-09-12T18:01:16.232895+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:16.232719+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.232719+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.506531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399140,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":4177,"num_write":987,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'175","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.830954+0000","last_change":"2024-09-12T18:01:35.830954+0000","last_active":"2024-09-12T18:01:35.830954+0000","last_peered":"2024-09-12T18:01:35.830954+0000","last_clean":"2024-09-12T18:01:35.830954+0000","last_became_active":"2024-09-12T17:22:00.796354+0000","last_became_peered":"2024-09-12T17:22:00.796354+0000","last_unstale":"2024-09-12T18:01:35.830954+0000","last_undegraded":"2024-09-12T18:01:35.830954+0000","last_fullsized":"2024-09-12T18:01:35.830954+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T18:01:35.830857+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T18:01:35.830857+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.830857+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:30.622531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":385,"num_write":414,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'443","reported_seq":2027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.303962+0000","last_change":"2024-09-12T18:01:23.303906+0000","last_active":"2024-09-12T18:01:23.303962+0000","last_peered":"2024-09-12T18:01:23.303962+0000","last_clean":"2024-09-12T18:01:23.303962+0000","last_became_active":"2024-09-12T17:21:52.751665+0000","last_became_peered":"2024-09-12T17:21:52.751665+0000","last_unstale":"2024-09-12T18:01:23.303962+0000","last_undegraded":"2024-09-12T18:01:23.303962+0000","last_fullsized":"2024-09-12T18:01:23.303962+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'443","last_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_deep_scrub":"265'443","last_deep_scrub_stamp":"2024-09-12T18:01:23.303815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.303815+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.507190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2300,"num_read_kb":2188,"num_write":507,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'409","reported_seq":1226,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.577737+0000","last_change":"2024-09-12T18:01:24.577601+0000","last_active":"2024-09-12T18:01:24.577737+0000","last_peered":"2024-09-12T18:01:24.577737+0000","last_clean":"2024-09-12T18:01:24.577737+0000","last_became_active":"2024-09-12T17:22:25.840617+0000","last_became_peered":"2024-09-12T17:22:25.840617+0000","last_unstale":"2024-09-12T18:01:24.577737+0000","last_undegraded":"2024-09-12T18:01:24.577737+0000","last_fullsized":"2024-09-12T18:01:24.577737+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:24.577312+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.577312+0000","objects_scrubbed":11,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:04.271781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460277,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":57262,"num_write":1362,"num_write_kb":32583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,4],"acting":[3,0,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.755868+0000","last_change":"2024-09-12T18:01:51.755868+0000","last_active":"2024-09-12T18:01:51.755868+0000","last_peered":"2024-09-12T18:01:51.755868+0000","last_clean":"2024-09-12T18:01:51.755868+0000","last_became_active":"2024-09-12T17:21:54.755862+0000","last_became_peered":"2024-09-12T17:21:54.755862+0000","last_unstale":"2024-09-12T18:01:51.755868+0000","last_undegraded":"2024-09-12T18:01:51.755868+0000","last_fullsized":"2024-09-12T18:01:51.755868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:51.755761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:51.755761+0000","last_clean_scrub_stamp":"2024-09-12T18:01:51.755761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:46.374444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'347","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.870078+0000","last_change":"2024-09-12T18:01:38.870078+0000","last_active":"2024-09-12T18:01:38.870078+0000","last_peered":"2024-09-12T18:01:38.870078+0000","last_clean":"2024-09-12T18:01:38.870078+0000","last_became_active":"2024-09-12T17:21:56.762606+0000","last_became_peered":"2024-09-12T17:21:56.762606+0000","last_unstale":"2024-09-12T18:01:38.870078+0000","last_undegraded":"2024-09-12T18:01:38.870078+0000","last_fullsized":"2024-09-12T18:01:38.870078+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T18:01:38.869957+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T18:01:38.869957+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.869957+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:20.747422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":1109,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.326416+0000","last_change":"2024-09-12T18:01:37.326416+0000","last_active":"2024-09-12T18:01:37.326416+0000","last_peered":"2024-09-12T18:01:37.326416+0000","last_clean":"2024-09-12T18:01:37.326416+0000","last_became_active":"2024-09-12T17:21:58.779176+0000","last_became_peered":"2024-09-12T17:21:58.779176+0000","last_unstale":"2024-09-12T18:01:37.326416+0000","last_undegraded":"2024-09-12T18:01:37.326416+0000","last_fullsized":"2024-09-12T18:01:37.326416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:37.326332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:37.326332+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.326332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:29.403460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2434","reported_seq":4326,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.350773+0000","last_change":"2024-09-12T18:01:39.350773+0000","last_active":"2024-09-12T18:01:39.350773+0000","last_peered":"2024-09-12T18:01:39.350773+0000","last_clean":"2024-09-12T18:01:39.350773+0000","last_became_active":"2024-09-12T17:22:00.789202+0000","last_became_peered":"2024-09-12T17:22:00.789202+0000","last_unstale":"2024-09-12T18:01:39.350773+0000","last_undegraded":"2024-09-12T18:01:39.350773+0000","last_fullsized":"2024-09-12T18:01:39.350773+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2434","last_scrub_stamp":"2024-09-12T18:01:39.350685+0000","last_deep_scrub":"265'2434","last_deep_scrub_stamp":"2024-09-12T18:01:39.350685+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.350685+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":2400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:34.512367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":6135,"num_write":4852,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'793","reported_seq":2278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.559926+0000","last_change":"2024-09-12T18:01:30.559926+0000","last_active":"2024-09-12T18:01:30.559926+0000","last_peered":"2024-09-12T18:01:30.559926+0000","last_clean":"2024-09-12T18:01:30.559926+0000","last_became_active":"2024-09-12T17:21:52.749773+0000","last_became_peered":"2024-09-12T17:21:52.749773+0000","last_unstale":"2024-09-12T18:01:30.559926+0000","last_undegraded":"2024-09-12T18:01:30.559926+0000","last_fullsized":"2024-09-12T18:01:30.559926+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-12T18:01:30.559816+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-12T18:01:30.559816+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.559816+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:24.626799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3319,"num_write":1028,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'312","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.189266+0000","last_change":"2024-09-12T18:01:14.189194+0000","last_active":"2024-09-12T18:01:14.189266+0000","last_peered":"2024-09-12T18:01:14.189266+0000","last_clean":"2024-09-12T18:01:14.189266+0000","last_became_active":"2024-09-12T17:21:50.757532+0000","last_became_peered":"2024-09-12T17:21:50.757532+0000","last_unstale":"2024-09-12T18:01:14.189266+0000","last_undegraded":"2024-09-12T18:01:14.189266+0000","last_fullsized":"2024-09-12T18:01:14.189266+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T18:01:14.189092+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.189092+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:46.249612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170284,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":362,"num_read_kb":2179,"num_write":871,"num_write_kb":28268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.916745+0000","last_change":"2024-09-12T18:01:31.916681+0000","last_active":"2024-09-12T18:01:31.916745+0000","last_peered":"2024-09-12T18:01:31.916745+0000","last_clean":"2024-09-12T18:01:31.916745+0000","last_became_active":"2024-09-12T17:21:54.751971+0000","last_became_peered":"2024-09-12T17:21:54.751971+0000","last_unstale":"2024-09-12T18:01:31.916745+0000","last_undegraded":"2024-09-12T18:01:31.916745+0000","last_fullsized":"2024-09-12T18:01:31.916745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.916560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.916560+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.916560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:06.898966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.245105+0000","last_change":"2024-09-12T18:01:30.245105+0000","last_active":"2024-09-12T18:01:30.245105+0000","last_peered":"2024-09-12T18:01:30.245105+0000","last_clean":"2024-09-12T18:01:30.245105+0000","last_became_active":"2024-09-12T17:21:56.762753+0000","last_became_peered":"2024-09-12T17:21:56.762753+0000","last_unstale":"2024-09-12T18:01:30.245105+0000","last_undegraded":"2024-09-12T18:01:30.245105+0000","last_fullsized":"2024-09-12T18:01:30.245105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T18:01:30.244973+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T18:01:30.244973+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.244973+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:09.238201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.225558+0000","last_change":"2024-09-12T18:01:34.225558+0000","last_active":"2024-09-12T18:01:34.225558+0000","last_peered":"2024-09-12T18:01:34.225558+0000","last_clean":"2024-09-12T18:01:34.225558+0000","last_became_active":"2024-09-12T17:21:58.780741+0000","last_became_peered":"2024-09-12T17:21:58.780741+0000","last_unstale":"2024-09-12T18:01:34.225558+0000","last_undegraded":"2024-09-12T18:01:34.225558+0000","last_fullsized":"2024-09-12T18:01:34.225558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:34.225467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:34.225467+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.225467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:10.074549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'131","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.420408+0000","last_change":"2024-09-12T18:01:39.420351+0000","last_active":"2024-09-12T18:01:39.420408+0000","last_peered":"2024-09-12T18:01:39.420408+0000","last_clean":"2024-09-12T18:01:39.420408+0000","last_became_active":"2024-09-12T17:22:00.794665+0000","last_became_peered":"2024-09-12T17:22:00.794665+0000","last_unstale":"2024-09-12T18:01:39.420408+0000","last_undegraded":"2024-09-12T18:01:39.420408+0000","last_fullsized":"2024-09-12T18:01:39.420408+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T18:01:39.420258+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T18:01:39.420258+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.420258+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:28.166252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'1531","reported_seq":3108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.124184+0000","last_change":"2024-09-12T18:01:27.124184+0000","last_active":"2024-09-12T18:01:27.124184+0000","last_peered":"2024-09-12T18:01:27.124184+0000","last_clean":"2024-09-12T18:01:27.124184+0000","last_became_active":"2024-09-12T17:21:52.757267+0000","last_became_peered":"2024-09-12T17:21:52.757267+0000","last_unstale":"2024-09-12T18:01:27.124184+0000","last_undegraded":"2024-09-12T18:01:27.124184+0000","last_fullsized":"2024-09-12T18:01:27.124184+0000","mapping_epoch":27,"log_start":"265'1500","ondisk_log_start":"265'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1531","last_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_deep_scrub":"265'1531","last_deep_scrub_stamp":"2024-09-12T18:01:27.124084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.124084+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":1500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.265522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6814,"num_read_kb":5934,"num_write":2150,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'349","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.543288+0000","last_change":"2024-09-12T18:01:16.543222+0000","last_active":"2024-09-12T18:01:16.543288+0000","last_peered":"2024-09-12T18:01:16.543288+0000","last_clean":"2024-09-12T18:01:16.543288+0000","last_became_active":"2024-09-12T17:21:50.763556+0000","last_became_peered":"2024-09-12T17:21:50.763556+0000","last_unstale":"2024-09-12T18:01:16.543288+0000","last_undegraded":"2024-09-12T18:01:16.543288+0000","last_fullsized":"2024-09-12T18:01:16.543288+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:16.543095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.543095+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:40.971401+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":7819,"num_write":1100,"num_write_kb":42972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.906437+0000","last_change":"2024-09-12T18:01:30.906437+0000","last_active":"2024-09-12T18:01:30.906437+0000","last_peered":"2024-09-12T18:01:30.906437+0000","last_clean":"2024-09-12T18:01:30.906437+0000","last_became_active":"2024-09-12T17:21:54.750451+0000","last_became_peered":"2024-09-12T17:21:54.750451+0000","last_unstale":"2024-09-12T18:01:30.906437+0000","last_undegraded":"2024-09-12T18:01:30.906437+0000","last_fullsized":"2024-09-12T18:01:30.906437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:30.906353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:30.906353+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.906353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:49.215510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'110","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.875575+0000","last_change":"2024-09-12T18:01:37.875476+0000","last_active":"2024-09-12T18:01:37.875575+0000","last_peered":"2024-09-12T18:01:37.875575+0000","last_clean":"2024-09-12T18:01:37.875575+0000","last_became_active":"2024-09-12T17:21:56.760124+0000","last_became_peered":"2024-09-12T17:21:56.760124+0000","last_unstale":"2024-09-12T18:01:37.875575+0000","last_undegraded":"2024-09-12T18:01:37.875575+0000","last_fullsized":"2024-09-12T18:01:37.875575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T18:01:37.875381+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T18:01:37.875381+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.875381+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.856181+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":80,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'789","reported_seq":2222,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.860079+0000","last_change":"2024-09-12T18:02:04.860079+0000","last_active":"2024-09-12T18:02:04.860079+0000","last_peered":"2024-09-12T18:02:04.860079+0000","last_clean":"2024-09-12T18:02:04.860079+0000","last_became_active":"2024-09-12T17:21:58.788930+0000","last_became_peered":"2024-09-12T17:21:58.788930+0000","last_unstale":"2024-09-12T18:02:04.860079+0000","last_undegraded":"2024-09-12T18:02:04.860079+0000","last_fullsized":"2024-09-12T18:02:04.860079+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'789","last_scrub_stamp":"2024-09-12T18:02:04.859991+0000","last_deep_scrub":"265'789","last_deep_scrub_stamp":"2024-09-12T18:02:04.859991+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.859991+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:04.115216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'224","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.964174+0000","last_change":"2024-09-12T18:01:40.964113+0000","last_active":"2024-09-12T18:01:40.964174+0000","last_peered":"2024-09-12T18:01:40.964174+0000","last_clean":"2024-09-12T18:01:40.964174+0000","last_became_active":"2024-09-12T17:22:00.794267+0000","last_became_peered":"2024-09-12T17:22:00.794267+0000","last_unstale":"2024-09-12T18:01:40.964174+0000","last_undegraded":"2024-09-12T18:01:40.964174+0000","last_fullsized":"2024-09-12T18:01:40.964174+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'224","last_scrub_stamp":"2024-09-12T18:01:40.964028+0000","last_deep_scrub":"265'224","last_deep_scrub_stamp":"2024-09-12T18:01:40.964028+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.964028+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:48.429704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":653,"num_write":482,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'715","reported_seq":1977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.102558+0000","last_change":"2024-09-12T18:01:28.102558+0000","last_active":"2024-09-12T18:01:28.102558+0000","last_peered":"2024-09-12T18:01:28.102558+0000","last_clean":"2024-09-12T18:01:28.102558+0000","last_became_active":"2024-09-12T17:21:52.754693+0000","last_became_peered":"2024-09-12T17:21:52.754693+0000","last_unstale":"2024-09-12T18:01:28.102558+0000","last_undegraded":"2024-09-12T18:01:28.102558+0000","last_fullsized":"2024-09-12T18:01:28.102558+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'715","last_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_deep_scrub":"265'715","last_deep_scrub_stamp":"2024-09-12T18:01:28.102443+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.102443+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:34.202300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3235,"num_read_kb":2885,"num_write":955,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'416","reported_seq":1142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.092409+0000","last_change":"2024-09-12T18:01:11.092314+0000","last_active":"2024-09-12T18:01:11.092409+0000","last_peered":"2024-09-12T18:01:11.092409+0000","last_clean":"2024-09-12T18:01:11.092409+0000","last_became_active":"2024-09-12T17:21:50.762788+0000","last_became_peered":"2024-09-12T17:21:50.762788+0000","last_unstale":"2024-09-12T18:01:11.092409+0000","last_undegraded":"2024-09-12T18:01:11.092409+0000","last_fullsized":"2024-09-12T18:01:11.092409+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T18:01:11.092136+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.092136+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:29.744238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":18208,"num_write":1467,"num_write_kb":36258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.714001+0000","last_change":"2024-09-12T18:01:40.714001+0000","last_active":"2024-09-12T18:01:40.714001+0000","last_peered":"2024-09-12T18:01:40.714001+0000","last_clean":"2024-09-12T18:01:40.714001+0000","last_became_active":"2024-09-12T17:21:54.755408+0000","last_became_peered":"2024-09-12T17:21:54.755408+0000","last_unstale":"2024-09-12T18:01:40.714001+0000","last_undegraded":"2024-09-12T18:01:40.714001+0000","last_fullsized":"2024-09-12T18:01:40.714001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.713898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.713898+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.713898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:58.178175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'281","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.097066+0000","last_change":"2024-09-12T18:01:30.097066+0000","last_active":"2024-09-12T18:01:30.097066+0000","last_peered":"2024-09-12T18:01:30.097066+0000","last_clean":"2024-09-12T18:01:30.097066+0000","last_became_active":"2024-09-12T17:21:56.764855+0000","last_became_peered":"2024-09-12T17:21:56.764855+0000","last_unstale":"2024-09-12T18:01:30.097066+0000","last_undegraded":"2024-09-12T18:01:30.097066+0000","last_fullsized":"2024-09-12T18:01:30.097066+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T18:01:30.096979+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T18:01:30.096979+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.096979+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.426534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1135,"num_write":384,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'811","reported_seq":2323,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.171925+0000","last_change":"2024-09-12T18:01:42.171869+0000","last_active":"2024-09-12T18:01:42.171925+0000","last_peered":"2024-09-12T18:01:42.171925+0000","last_clean":"2024-09-12T18:01:42.171925+0000","last_became_active":"2024-09-12T17:21:58.787183+0000","last_became_peered":"2024-09-12T17:21:58.787183+0000","last_unstale":"2024-09-12T18:01:42.171925+0000","last_undegraded":"2024-09-12T18:01:42.171925+0000","last_fullsized":"2024-09-12T18:01:42.171925+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'811","last_scrub_stamp":"2024-09-12T18:01:42.171786+0000","last_deep_scrub":"265'811","last_deep_scrub_stamp":"2024-09-12T18:01:42.171786+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.171786+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:13.657327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'421","reported_seq":1994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.533263+0000","last_change":"2024-09-12T18:01:28.533263+0000","last_active":"2024-09-12T18:01:28.533263+0000","last_peered":"2024-09-12T18:01:28.533263+0000","last_clean":"2024-09-12T18:01:28.533263+0000","last_became_active":"2024-09-12T17:21:52.748022+0000","last_became_peered":"2024-09-12T17:21:52.748022+0000","last_unstale":"2024-09-12T18:01:28.533263+0000","last_undegraded":"2024-09-12T18:01:28.533263+0000","last_fullsized":"2024-09-12T18:01:28.533263+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T18:01:28.533126+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T18:01:28.533126+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.533126+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:59.686316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2318,"num_read_kb":2206,"num_write":477,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'329","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.822806+0000","last_change":"2024-09-12T18:01:09.822719+0000","last_active":"2024-09-12T18:01:09.822806+0000","last_peered":"2024-09-12T18:01:09.822806+0000","last_clean":"2024-09-12T18:01:09.822806+0000","last_became_active":"2024-09-12T17:21:50.783300+0000","last_became_peered":"2024-09-12T17:21:50.783300+0000","last_unstale":"2024-09-12T18:01:09.822806+0000","last_undegraded":"2024-09-12T18:01:09.822806+0000","last_fullsized":"2024-09-12T18:01:09.822806+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T18:01:09.822608+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.822608+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:13.917726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":438,"num_read_kb":9180,"num_write":1028,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"265'6","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.204893+0000","last_change":"2024-09-12T18:01:24.204893+0000","last_active":"2024-09-12T18:01:24.204893+0000","last_peered":"2024-09-12T18:01:24.204893+0000","last_clean":"2024-09-12T18:01:24.204893+0000","last_became_active":"2024-09-12T17:21:54.753122+0000","last_became_peered":"2024-09-12T17:21:54.753122+0000","last_unstale":"2024-09-12T18:01:24.204893+0000","last_undegraded":"2024-09-12T18:01:24.204893+0000","last_fullsized":"2024-09-12T18:01:24.204893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:01:24.204776+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.204776+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.761047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'319","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.723540+0000","last_change":"2024-09-12T18:01:26.723540+0000","last_active":"2024-09-12T18:01:26.723540+0000","last_peered":"2024-09-12T18:01:26.723540+0000","last_clean":"2024-09-12T18:01:26.723540+0000","last_became_active":"2024-09-12T17:21:56.772234+0000","last_became_peered":"2024-09-12T17:21:56.772234+0000","last_unstale":"2024-09-12T18:01:26.723540+0000","last_undegraded":"2024-09-12T18:01:26.723540+0000","last_fullsized":"2024-09-12T18:01:26.723540+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:26.723419+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.723419+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:46.051413+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42323,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1094,"num_write":406,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.406565+0000","last_change":"2024-09-12T18:01:34.406506+0000","last_active":"2024-09-12T18:01:34.406565+0000","last_peered":"2024-09-12T18:01:34.406565+0000","last_clean":"2024-09-12T18:01:34.406565+0000","last_became_active":"2024-09-12T17:21:58.784652+0000","last_became_peered":"2024-09-12T17:21:58.784652+0000","last_unstale":"2024-09-12T18:01:34.406565+0000","last_undegraded":"2024-09-12T18:01:34.406565+0000","last_fullsized":"2024-09-12T18:01:34.406565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:34.406415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:34.406415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.406415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:03.678153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'545","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.003367+0000","last_change":"2024-09-12T18:01:35.003300+0000","last_active":"2024-09-12T18:01:35.003367+0000","last_peered":"2024-09-12T18:01:35.003367+0000","last_clean":"2024-09-12T18:01:35.003367+0000","last_became_active":"2024-09-12T17:22:00.791703+0000","last_became_peered":"2024-09-12T17:22:00.791703+0000","last_unstale":"2024-09-12T18:01:35.003367+0000","last_undegraded":"2024-09-12T18:01:35.003367+0000","last_fullsized":"2024-09-12T18:01:35.003367+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'545","last_scrub_stamp":"2024-09-12T18:01:35.003187+0000","last_deep_scrub":"265'545","last_deep_scrub_stamp":"2024-09-12T18:01:35.003187+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.003187+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:16.023359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1289,"num_read_kb":1289,"num_write":1112,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'854","reported_seq":2404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.150958+0000","last_change":"2024-09-12T18:01:13.150958+0000","last_active":"2024-09-12T18:01:13.150958+0000","last_peered":"2024-09-12T18:01:13.150958+0000","last_clean":"2024-09-12T18:01:13.150958+0000","last_became_active":"2024-09-12T17:21:52.754646+0000","last_became_peered":"2024-09-12T17:21:52.754646+0000","last_unstale":"2024-09-12T18:01:13.150958+0000","last_undegraded":"2024-09-12T18:01:13.150958+0000","last_fullsized":"2024-09-12T18:01:13.150958+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'854","last_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_deep_scrub":"265'854","last_deep_scrub_stamp":"2024-09-12T18:01:13.150845+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.150845+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.897083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4176,"num_read_kb":3747,"num_write":1158,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'342","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.910480+0000","last_change":"2024-09-12T18:01:10.910415+0000","last_active":"2024-09-12T18:01:10.910480+0000","last_peered":"2024-09-12T18:01:10.910480+0000","last_clean":"2024-09-12T18:01:10.910480+0000","last_became_active":"2024-09-12T17:21:50.765462+0000","last_became_peered":"2024-09-12T17:21:50.765462+0000","last_unstale":"2024-09-12T18:01:10.910480+0000","last_undegraded":"2024-09-12T18:01:10.910480+0000","last_fullsized":"2024-09-12T18:01:10.910480+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T18:01:10.910294+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.910294+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:18.320214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372398,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":25919,"num_write":1097,"num_write_kb":27253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.361255+0000","last_change":"2024-09-12T18:01:27.361255+0000","last_active":"2024-09-12T18:01:27.361255+0000","last_peered":"2024-09-12T18:01:27.361255+0000","last_clean":"2024-09-12T18:01:27.361255+0000","last_became_active":"2024-09-12T17:21:54.751693+0000","last_became_peered":"2024-09-12T17:21:54.751693+0000","last_unstale":"2024-09-12T18:01:27.361255+0000","last_undegraded":"2024-09-12T18:01:27.361255+0000","last_fullsized":"2024-09-12T18:01:27.361255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.361167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.361167+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.361167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:37.186412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'278","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.921555+0000","last_change":"2024-09-12T18:01:34.921489+0000","last_active":"2024-09-12T18:01:34.921555+0000","last_peered":"2024-09-12T18:01:34.921555+0000","last_clean":"2024-09-12T18:01:34.921555+0000","last_became_active":"2024-09-12T17:21:56.763254+0000","last_became_peered":"2024-09-12T17:21:56.763254+0000","last_unstale":"2024-09-12T18:01:34.921555+0000","last_undegraded":"2024-09-12T18:01:34.921555+0000","last_fullsized":"2024-09-12T18:01:34.921555+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T18:01:34.921399+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T18:01:34.921399+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.921399+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:47.961172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1078,"num_write":370,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.974204+0000","last_change":"2024-09-12T18:01:42.974204+0000","last_active":"2024-09-12T18:01:42.974204+0000","last_peered":"2024-09-12T18:01:42.974204+0000","last_clean":"2024-09-12T18:01:42.974204+0000","last_became_active":"2024-09-12T17:21:58.782736+0000","last_became_peered":"2024-09-12T17:21:58.782736+0000","last_unstale":"2024-09-12T18:01:42.974204+0000","last_undegraded":"2024-09-12T18:01:42.974204+0000","last_fullsized":"2024-09-12T18:01:42.974204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:42.974116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:42.974116+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.974116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:08.929573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'99","reported_seq":591,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.248594+0000","last_change":"2024-09-12T18:01:35.248524+0000","last_active":"2024-09-12T18:01:35.248594+0000","last_peered":"2024-09-12T18:01:35.248594+0000","last_clean":"2024-09-12T18:01:35.248594+0000","last_became_active":"2024-09-12T17:22:00.792453+0000","last_became_peered":"2024-09-12T17:22:00.792453+0000","last_unstale":"2024-09-12T18:01:35.248594+0000","last_undegraded":"2024-09-12T18:01:35.248594+0000","last_fullsized":"2024-09-12T18:01:35.248594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-12T18:01:35.248432+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-12T18:01:35.248432+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.248432+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:20.748584+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":242,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'383","reported_seq":1862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.965058+0000","last_change":"2024-09-12T18:01:19.965058+0000","last_active":"2024-09-12T18:01:19.965058+0000","last_peered":"2024-09-12T18:01:19.965058+0000","last_clean":"2024-09-12T18:01:19.965058+0000","last_became_active":"2024-09-12T17:21:52.747116+0000","last_became_peered":"2024-09-12T17:21:52.747116+0000","last_unstale":"2024-09-12T18:01:19.965058+0000","last_undegraded":"2024-09-12T18:01:19.965058+0000","last_fullsized":"2024-09-12T18:01:19.965058+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T18:01:19.964971+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.964971+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:27.371182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2074,"num_read_kb":1976,"num_write":428,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'389","reported_seq":1122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.511469+0000","last_change":"2024-09-12T18:01:20.511378+0000","last_active":"2024-09-12T18:01:20.511469+0000","last_peered":"2024-09-12T18:01:20.511469+0000","last_clean":"2024-09-12T18:01:20.511469+0000","last_became_active":"2024-09-12T17:21:50.762492+0000","last_became_peered":"2024-09-12T17:21:50.762492+0000","last_unstale":"2024-09-12T18:01:20.511469+0000","last_undegraded":"2024-09-12T18:01:20.511469+0000","last_fullsized":"2024-09-12T18:01:20.511469+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T18:01:20.511198+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.511198+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:06.731878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":11787,"num_write":1282,"num_write_kb":27795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"265'4","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.181418+0000","last_change":"2024-09-12T18:01:34.181352+0000","last_active":"2024-09-12T18:01:34.181418+0000","last_peered":"2024-09-12T18:01:34.181418+0000","last_clean":"2024-09-12T18:01:34.181418+0000","last_became_active":"2024-09-12T17:21:54.749609+0000","last_became_peered":"2024-09-12T17:21:54.749609+0000","last_unstale":"2024-09-12T18:01:34.181418+0000","last_undegraded":"2024-09-12T18:01:34.181418+0000","last_fullsized":"2024-09-12T18:01:34.181418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:34.181250+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:34.181250+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.181250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:35.922785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'248","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.673268+0000","last_change":"2024-09-12T18:01:43.673268+0000","last_active":"2024-09-12T18:01:43.673268+0000","last_peered":"2024-09-12T18:01:43.673268+0000","last_clean":"2024-09-12T18:01:43.673268+0000","last_became_active":"2024-09-12T17:21:56.767085+0000","last_became_peered":"2024-09-12T17:21:56.767085+0000","last_unstale":"2024-09-12T18:01:43.673268+0000","last_undegraded":"2024-09-12T18:01:43.673268+0000","last_fullsized":"2024-09-12T18:01:43.673268+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'248","last_scrub_stamp":"2024-09-12T18:01:43.673158+0000","last_deep_scrub":"265'248","last_deep_scrub_stamp":"2024-09-12T18:01:43.673158+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.673158+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:48.283546+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14789,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":830,"num_write":302,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'810","reported_seq":6247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.215618+0000","last_change":"2024-09-12T18:01:41.215618+0000","last_active":"2024-09-12T18:01:41.215618+0000","last_peered":"2024-09-12T18:01:41.215618+0000","last_clean":"2024-09-12T18:01:41.215618+0000","last_became_active":"2024-09-12T17:21:58.786040+0000","last_became_peered":"2024-09-12T17:21:58.786040+0000","last_unstale":"2024-09-12T18:01:41.215618+0000","last_undegraded":"2024-09-12T18:01:41.215618+0000","last_fullsized":"2024-09-12T18:01:41.215618+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'810","last_scrub_stamp":"2024-09-12T18:01:41.215534+0000","last_deep_scrub":"265'810","last_deep_scrub_stamp":"2024-09-12T18:01:41.215534+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.215534+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:57.602993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'101","reported_seq":597,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.421982+0000","last_change":"2024-09-12T18:01:38.421982+0000","last_active":"2024-09-12T18:01:38.421982+0000","last_peered":"2024-09-12T18:01:38.421982+0000","last_clean":"2024-09-12T18:01:38.421982+0000","last_became_active":"2024-09-12T17:22:00.795311+0000","last_became_peered":"2024-09-12T17:22:00.795311+0000","last_unstale":"2024-09-12T18:01:38.421982+0000","last_undegraded":"2024-09-12T18:01:38.421982+0000","last_fullsized":"2024-09-12T18:01:38.421982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T18:01:38.421862+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T18:01:38.421862+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.421862+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.477867+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":226,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'888","reported_seq":2510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.082421+0000","last_change":"2024-09-12T18:01:26.082366+0000","last_active":"2024-09-12T18:01:26.082421+0000","last_peered":"2024-09-12T18:01:26.082421+0000","last_clean":"2024-09-12T18:01:26.082421+0000","last_became_active":"2024-09-12T17:21:52.753823+0000","last_became_peered":"2024-09-12T17:21:52.753823+0000","last_unstale":"2024-09-12T18:01:26.082421+0000","last_undegraded":"2024-09-12T18:01:26.082421+0000","last_fullsized":"2024-09-12T18:01:26.082421+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'888","last_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_deep_scrub":"265'888","last_deep_scrub_stamp":"2024-09-12T18:01:26.082271+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.082271+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:57.896478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4043,"num_read_kb":3631,"num_write":1150,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'333","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.854343+0000","last_change":"2024-09-12T18:01:08.854293+0000","last_active":"2024-09-12T18:01:08.854343+0000","last_peered":"2024-09-12T18:01:08.854343+0000","last_clean":"2024-09-12T18:01:08.854343+0000","last_became_active":"2024-09-12T17:21:50.780992+0000","last_became_peered":"2024-09-12T17:21:50.780992+0000","last_unstale":"2024-09-12T18:01:08.854343+0000","last_undegraded":"2024-09-12T18:01:08.854343+0000","last_fullsized":"2024-09-12T18:01:08.854343+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T18:01:08.854202+0000","last_clean_scrub_stamp":"2024-09-12T18:01:08.854202+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:07.060997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":4507,"num_write":1037,"num_write_kb":26903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.368958+0000","last_change":"2024-09-12T18:01:26.368958+0000","last_active":"2024-09-12T18:01:26.368958+0000","last_peered":"2024-09-12T18:01:26.368958+0000","last_clean":"2024-09-12T18:01:26.368958+0000","last_became_active":"2024-09-12T17:21:54.756304+0000","last_became_peered":"2024-09-12T17:21:54.756304+0000","last_unstale":"2024-09-12T18:01:26.368958+0000","last_undegraded":"2024-09-12T18:01:26.368958+0000","last_fullsized":"2024-09-12T18:01:26.368958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.368881+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.368881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:04.679223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'464","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.886345+0000","last_change":"2024-09-12T18:01:35.886345+0000","last_active":"2024-09-12T18:01:35.886345+0000","last_peered":"2024-09-12T18:01:35.886345+0000","last_clean":"2024-09-12T18:01:35.886345+0000","last_became_active":"2024-09-12T17:21:56.761635+0000","last_became_peered":"2024-09-12T17:21:56.761635+0000","last_unstale":"2024-09-12T18:01:35.886345+0000","last_undegraded":"2024-09-12T18:01:35.886345+0000","last_fullsized":"2024-09-12T18:01:35.886345+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T18:01:35.886257+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T18:01:35.886257+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.886257+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:04.522631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91621,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":2003,"num_write":680,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.165357+0000","last_change":"2024-09-12T18:01:40.165357+0000","last_active":"2024-09-12T18:01:40.165357+0000","last_peered":"2024-09-12T18:01:40.165357+0000","last_clean":"2024-09-12T18:01:40.165357+0000","last_became_active":"2024-09-12T17:21:58.789510+0000","last_became_peered":"2024-09-12T17:21:58.789510+0000","last_unstale":"2024-09-12T18:01:40.165357+0000","last_undegraded":"2024-09-12T18:01:40.165357+0000","last_fullsized":"2024-09-12T18:01:40.165357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.165272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.165272+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.165272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:13.163122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'119","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.283222+0000","last_change":"2024-09-12T18:01:34.283222+0000","last_active":"2024-09-12T18:01:34.283222+0000","last_peered":"2024-09-12T18:01:34.283222+0000","last_clean":"2024-09-12T18:01:34.283222+0000","last_became_active":"2024-09-12T17:22:00.797030+0000","last_became_peered":"2024-09-12T17:22:00.797030+0000","last_unstale":"2024-09-12T18:01:34.283222+0000","last_undegraded":"2024-09-12T18:01:34.283222+0000","last_fullsized":"2024-09-12T18:01:34.283222+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T18:01:34.283112+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T18:01:34.283112+0000","last_clean_scrub_stamp":"2024-09-12T18:01:34.283112+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:23.561819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":186,"num_read_kb":173,"num_write":261,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1098","reported_seq":2468,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.690388+0000","last_change":"2024-09-12T18:01:16.690325+0000","last_active":"2024-09-12T18:01:16.690388+0000","last_peered":"2024-09-12T18:01:16.690388+0000","last_clean":"2024-09-12T18:01:16.690388+0000","last_became_active":"2024-09-12T17:21:52.751783+0000","last_became_peered":"2024-09-12T17:21:52.751783+0000","last_unstale":"2024-09-12T18:01:16.690388+0000","last_undegraded":"2024-09-12T18:01:16.690388+0000","last_fullsized":"2024-09-12T18:01:16.690388+0000","mapping_epoch":27,"log_start":"265'1000","ondisk_log_start":"265'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1098","last_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_deep_scrub":"265'1098","last_deep_scrub_stamp":"2024-09-12T18:01:16.690238+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.690238+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:56.957860+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4789,"num_read_kb":4197,"num_write":1496,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'388","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.423609+0000","last_change":"2024-09-12T18:01:13.423542+0000","last_active":"2024-09-12T18:01:13.423609+0000","last_peered":"2024-09-12T18:01:13.423609+0000","last_clean":"2024-09-12T18:01:13.423609+0000","last_became_active":"2024-09-12T17:21:50.771442+0000","last_became_peered":"2024-09-12T17:21:50.771442+0000","last_unstale":"2024-09-12T18:01:13.423609+0000","last_undegraded":"2024-09-12T18:01:13.423609+0000","last_fullsized":"2024-09-12T18:01:13.423609+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:13.423366+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.423366+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.728247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":4065,"num_write":1151,"num_write_kb":34773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.459488+0000","last_change":"2024-09-12T18:01:24.459436+0000","last_active":"2024-09-12T18:01:24.459488+0000","last_peered":"2024-09-12T18:01:24.459488+0000","last_clean":"2024-09-12T18:01:24.459488+0000","last_became_active":"2024-09-12T17:21:54.753769+0000","last_became_peered":"2024-09-12T17:21:54.753769+0000","last_unstale":"2024-09-12T18:01:24.459488+0000","last_undegraded":"2024-09-12T18:01:24.459488+0000","last_fullsized":"2024-09-12T18:01:24.459488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.459346+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.459346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:56.562856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.287086+0000","last_change":"2024-09-12T18:01:29.287027+0000","last_active":"2024-09-12T18:01:29.287086+0000","last_peered":"2024-09-12T18:01:29.287086+0000","last_clean":"2024-09-12T18:01:29.287086+0000","last_became_active":"2024-09-12T17:21:56.766178+0000","last_became_peered":"2024-09-12T17:21:56.766178+0000","last_unstale":"2024-09-12T18:01:29.287086+0000","last_undegraded":"2024-09-12T18:01:29.287086+0000","last_fullsized":"2024-09-12T18:01:29.287086+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T18:01:29.286941+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T18:01:29.286941+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.286941+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:08.866516+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46038,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":1069,"num_write":430,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.311558+0000","last_change":"2024-09-12T18:01:30.311558+0000","last_active":"2024-09-12T18:01:30.311558+0000","last_peered":"2024-09-12T18:01:30.311558+0000","last_clean":"2024-09-12T18:01:30.311558+0000","last_became_active":"2024-09-12T17:21:58.780641+0000","last_became_peered":"2024-09-12T17:21:58.780641+0000","last_unstale":"2024-09-12T18:01:30.311558+0000","last_undegraded":"2024-09-12T18:01:30.311558+0000","last_fullsized":"2024-09-12T18:01:30.311558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:30.311474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:30.311474+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.311474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:38.716188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'128","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.173231+0000","last_change":"2024-09-12T18:01:44.173172+0000","last_active":"2024-09-12T18:01:44.173231+0000","last_peered":"2024-09-12T18:01:44.173231+0000","last_clean":"2024-09-12T18:01:44.173231+0000","last_became_active":"2024-09-12T17:22:00.793813+0000","last_became_peered":"2024-09-12T17:22:00.793813+0000","last_unstale":"2024-09-12T18:01:44.173231+0000","last_undegraded":"2024-09-12T18:01:44.173231+0000","last_fullsized":"2024-09-12T18:01:44.173231+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T18:01:44.173075+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T18:01:44.173075+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.173075+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:11.613716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":163,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'854","reported_seq":2443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.530416+0000","last_change":"2024-09-12T18:01:29.530340+0000","last_active":"2024-09-12T18:01:29.530416+0000","last_peered":"2024-09-12T18:01:29.530416+0000","last_clean":"2024-09-12T18:01:29.530416+0000","last_became_active":"2024-09-12T17:21:52.743721+0000","last_became_peered":"2024-09-12T17:21:52.743721+0000","last_unstale":"2024-09-12T18:01:29.530416+0000","last_undegraded":"2024-09-12T18:01:29.530416+0000","last_fullsized":"2024-09-12T18:01:29.530416+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'854","last_scrub_stamp":"2024-09-12T18:01:29.530238+0000","last_deep_scrub":"265'854","last_deep_scrub_stamp":"2024-09-12T18:01:29.530238+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.530238+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.790227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4031,"num_read_kb":3637,"num_write":1149,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'294","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.520281+0000","last_change":"2024-09-12T18:01:14.520281+0000","last_active":"2024-09-12T18:01:14.520281+0000","last_peered":"2024-09-12T18:01:14.520281+0000","last_clean":"2024-09-12T18:01:14.520281+0000","last_became_active":"2024-09-12T17:21:50.762794+0000","last_became_peered":"2024-09-12T17:21:50.762794+0000","last_unstale":"2024-09-12T18:01:14.520281+0000","last_undegraded":"2024-09-12T18:01:14.520281+0000","last_fullsized":"2024-09-12T18:01:14.520281+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T18:01:14.520053+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.520053+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:15.981715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":437,"num_read_kb":12213,"num_write":961,"num_write_kb":19933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.167672+0000","last_change":"2024-09-12T18:01:36.167605+0000","last_active":"2024-09-12T18:01:36.167672+0000","last_peered":"2024-09-12T18:01:36.167672+0000","last_clean":"2024-09-12T18:01:36.167672+0000","last_became_active":"2024-09-12T17:21:54.753615+0000","last_became_peered":"2024-09-12T17:21:54.753615+0000","last_unstale":"2024-09-12T18:01:36.167672+0000","last_undegraded":"2024-09-12T18:01:36.167672+0000","last_fullsized":"2024-09-12T18:01:36.167672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:36.167506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:36.167506+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.167506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:29.693639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'282","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.186559+0000","last_change":"2024-09-12T18:01:37.186559+0000","last_active":"2024-09-12T18:01:37.186559+0000","last_peered":"2024-09-12T18:01:37.186559+0000","last_clean":"2024-09-12T18:01:37.186559+0000","last_became_active":"2024-09-12T17:21:56.769509+0000","last_became_peered":"2024-09-12T17:21:56.769509+0000","last_unstale":"2024-09-12T18:01:37.186559+0000","last_undegraded":"2024-09-12T18:01:37.186559+0000","last_fullsized":"2024-09-12T18:01:37.186559+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-12T18:01:37.186454+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-12T18:01:37.186454+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.186454+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:09.115622+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":997,"num_write":362,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'771","reported_seq":2294,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.357302+0000","last_change":"2024-09-12T18:01:29.357248+0000","last_active":"2024-09-12T18:01:29.357302+0000","last_peered":"2024-09-12T18:01:29.357302+0000","last_clean":"2024-09-12T18:01:29.357302+0000","last_became_active":"2024-09-12T17:21:58.787646+0000","last_became_peered":"2024-09-12T17:21:58.787646+0000","last_unstale":"2024-09-12T18:01:29.357302+0000","last_undegraded":"2024-09-12T18:01:29.357302+0000","last_fullsized":"2024-09-12T18:01:29.357302+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T18:01:29.357164+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.357164+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:53.556672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'96","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.434624+0000","last_change":"2024-09-12T18:01:37.434624+0000","last_active":"2024-09-12T18:01:37.434624+0000","last_peered":"2024-09-12T18:01:37.434624+0000","last_clean":"2024-09-12T18:01:37.434624+0000","last_became_active":"2024-09-12T17:22:00.787856+0000","last_became_peered":"2024-09-12T17:22:00.787856+0000","last_unstale":"2024-09-12T18:01:37.434624+0000","last_undegraded":"2024-09-12T18:01:37.434624+0000","last_fullsized":"2024-09-12T18:01:37.434624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T18:01:37.434524+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T18:01:37.434524+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.434524+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.206978+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'396","reported_seq":1808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.965735+0000","last_change":"2024-09-12T18:01:17.965656+0000","last_active":"2024-09-12T18:01:17.965735+0000","last_peered":"2024-09-12T18:01:17.965735+0000","last_clean":"2024-09-12T18:01:17.965735+0000","last_became_active":"2024-09-12T17:21:52.746323+0000","last_became_peered":"2024-09-12T17:21:52.746323+0000","last_unstale":"2024-09-12T18:01:17.965735+0000","last_undegraded":"2024-09-12T18:01:17.965735+0000","last_fullsized":"2024-09-12T18:01:17.965735+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T18:01:17.965565+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.965565+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:50.887093+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1971,"num_read_kb":1861,"num_write":415,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.514617+0000","last_change":"2024-09-12T18:01:15.514617+0000","last_active":"2024-09-12T18:01:15.514617+0000","last_peered":"2024-09-12T18:01:15.514617+0000","last_clean":"2024-09-12T18:01:15.514617+0000","last_became_active":"2024-09-12T17:21:50.763526+0000","last_became_peered":"2024-09-12T17:21:50.763526+0000","last_unstale":"2024-09-12T18:01:15.514617+0000","last_undegraded":"2024-09-12T18:01:15.514617+0000","last_fullsized":"2024-09-12T18:01:15.514617+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T18:01:15.514479+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.514479+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.305976+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":2738,"num_write":1044,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1462,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.223461+0000","last_change":"2024-09-12T18:01:25.223394+0000","last_active":"2024-09-12T18:01:25.223461+0000","last_peered":"2024-09-12T18:01:25.223461+0000","last_clean":"2024-09-12T18:01:25.223461+0000","last_became_active":"2024-09-12T17:21:54.752672+0000","last_became_peered":"2024-09-12T17:21:54.752672+0000","last_unstale":"2024-09-12T18:01:25.223461+0000","last_undegraded":"2024-09-12T18:01:25.223461+0000","last_fullsized":"2024-09-12T18:01:25.223461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:01:25.223302+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.223302+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:28.092756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'81","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.323304+0000","last_change":"2024-09-12T18:01:30.323227+0000","last_active":"2024-09-12T18:01:30.323304+0000","last_peered":"2024-09-12T18:01:30.323304+0000","last_clean":"2024-09-12T18:01:30.323304+0000","last_became_active":"2024-09-12T17:21:56.766360+0000","last_became_peered":"2024-09-12T17:21:56.766360+0000","last_unstale":"2024-09-12T18:01:30.323304+0000","last_undegraded":"2024-09-12T18:01:30.323304+0000","last_fullsized":"2024-09-12T18:01:30.323304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'81","last_scrub_stamp":"2024-09-12T18:01:30.323110+0000","last_deep_scrub":"265'81","last_deep_scrub_stamp":"2024-09-12T18:01:30.323110+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.323110+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:06.144106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":2238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.223206+0000","last_change":"2024-09-12T18:01:33.223144+0000","last_active":"2024-09-12T18:01:33.223206+0000","last_peered":"2024-09-12T18:01:33.223206+0000","last_clean":"2024-09-12T18:01:33.223206+0000","last_became_active":"2024-09-12T17:21:58.774723+0000","last_became_peered":"2024-09-12T17:21:58.774723+0000","last_unstale":"2024-09-12T18:01:33.223206+0000","last_undegraded":"2024-09-12T18:01:33.223206+0000","last_fullsized":"2024-09-12T18:01:33.223206+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:33.223061+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:33.223061+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.223061+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:43.060671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.967997+0000","last_change":"2024-09-12T18:01:33.967905+0000","last_active":"2024-09-12T18:01:33.967997+0000","last_peered":"2024-09-12T18:01:33.967997+0000","last_clean":"2024-09-12T18:01:33.967997+0000","last_became_active":"2024-09-12T17:22:00.796108+0000","last_became_peered":"2024-09-12T17:22:00.796108+0000","last_unstale":"2024-09-12T18:01:33.967997+0000","last_undegraded":"2024-09-12T18:01:33.967997+0000","last_fullsized":"2024-09-12T18:01:33.967997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T18:01:33.967774+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T18:01:33.967774+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.967774+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:11.664850+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":288,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'768","reported_seq":2401,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.479537+0000","last_change":"2024-09-12T18:01:16.479454+0000","last_active":"2024-09-12T18:01:16.479537+0000","last_peered":"2024-09-12T18:01:16.479537+0000","last_clean":"2024-09-12T18:01:16.479537+0000","last_became_active":"2024-09-12T17:21:52.752926+0000","last_became_peered":"2024-09-12T17:21:52.752926+0000","last_unstale":"2024-09-12T18:01:16.479537+0000","last_undegraded":"2024-09-12T18:01:16.479537+0000","last_fullsized":"2024-09-12T18:01:16.479537+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'768","last_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_deep_scrub":"265'768","last_deep_scrub_stamp":"2024-09-12T18:01:16.479358+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.479358+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:38.320465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3758,"num_read_kb":3427,"num_write":1000,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.882054+0000","last_change":"2024-09-12T18:01:14.882054+0000","last_active":"2024-09-12T18:01:14.882054+0000","last_peered":"2024-09-12T18:01:14.882054+0000","last_clean":"2024-09-12T18:01:14.882054+0000","last_became_active":"2024-09-12T17:21:50.758901+0000","last_became_peered":"2024-09-12T17:21:50.758901+0000","last_unstale":"2024-09-12T18:01:14.882054+0000","last_undegraded":"2024-09-12T18:01:14.882054+0000","last_fullsized":"2024-09-12T18:01:14.882054+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:14.881906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.881906+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:47.911992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":10060,"num_write":877,"num_write_kb":19245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.690315+0000","last_change":"2024-09-12T18:01:38.690245+0000","last_active":"2024-09-12T18:01:38.690315+0000","last_peered":"2024-09-12T18:01:38.690315+0000","last_clean":"2024-09-12T18:01:38.690315+0000","last_became_active":"2024-09-12T17:21:54.754988+0000","last_became_peered":"2024-09-12T17:21:54.754988+0000","last_unstale":"2024-09-12T18:01:38.690315+0000","last_undegraded":"2024-09-12T18:01:38.690315+0000","last_fullsized":"2024-09-12T18:01:38.690315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:38.690153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:38.690153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.690153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:05.375887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'327","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.272490+0000","last_change":"2024-09-12T18:01:28.272421+0000","last_active":"2024-09-12T18:01:28.272490+0000","last_peered":"2024-09-12T18:01:28.272490+0000","last_clean":"2024-09-12T18:01:28.272490+0000","last_became_active":"2024-09-12T17:21:56.769560+0000","last_became_peered":"2024-09-12T17:21:56.769560+0000","last_unstale":"2024-09-12T18:01:28.272490+0000","last_undegraded":"2024-09-12T18:01:28.272490+0000","last_fullsized":"2024-09-12T18:01:28.272490+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T18:01:28.272327+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T18:01:28.272327+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.272327+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:41.326166+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46691,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1100,"num_read_kb":1651,"num_write":1580,"num_write_kb":1458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.088890+0000","last_change":"2024-09-12T18:01:31.088824+0000","last_active":"2024-09-12T18:01:31.088890+0000","last_peered":"2024-09-12T18:01:31.088890+0000","last_clean":"2024-09-12T18:01:31.088890+0000","last_became_active":"2024-09-12T17:21:58.783290+0000","last_became_peered":"2024-09-12T17:21:58.783290+0000","last_unstale":"2024-09-12T18:01:31.088890+0000","last_undegraded":"2024-09-12T18:01:31.088890+0000","last_fullsized":"2024-09-12T18:01:31.088890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.088735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.088735+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.088735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:19.017921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'102","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.247970+0000","last_change":"2024-09-12T18:01:35.247970+0000","last_active":"2024-09-12T18:01:35.247970+0000","last_peered":"2024-09-12T18:01:35.247970+0000","last_clean":"2024-09-12T18:01:35.247970+0000","last_became_active":"2024-09-12T17:22:00.795445+0000","last_became_peered":"2024-09-12T17:22:00.795445+0000","last_unstale":"2024-09-12T18:01:35.247970+0000","last_undegraded":"2024-09-12T18:01:35.247970+0000","last_fullsized":"2024-09-12T18:01:35.247970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T18:01:35.247852+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T18:01:35.247852+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.247852+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:37.446347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":128,"num_write":238,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'462","reported_seq":2041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.560308+0000","last_change":"2024-09-12T18:01:27.560251+0000","last_active":"2024-09-12T18:01:27.560308+0000","last_peered":"2024-09-12T18:01:27.560308+0000","last_clean":"2024-09-12T18:01:27.560308+0000","last_became_active":"2024-09-12T17:21:52.747385+0000","last_became_peered":"2024-09-12T17:21:52.747385+0000","last_unstale":"2024-09-12T18:01:27.560308+0000","last_undegraded":"2024-09-12T18:01:27.560308+0000","last_fullsized":"2024-09-12T18:01:27.560308+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T18:01:27.560153+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T18:01:27.560153+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.560153+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:20.180962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2385,"num_read_kb":2251,"num_write":528,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.117810+0000","last_change":"2024-09-12T18:01:09.117716+0000","last_active":"2024-09-12T18:01:09.117810+0000","last_peered":"2024-09-12T18:01:09.117810+0000","last_clean":"2024-09-12T18:01:09.117810+0000","last_became_active":"2024-09-12T17:21:34.164193+0000","last_became_peered":"2024-09-12T17:21:34.164193+0000","last_unstale":"2024-09-12T18:01:09.117810+0000","last_undegraded":"2024-09-12T18:01:09.117810+0000","last_fullsized":"2024-09-12T18:01:09.117810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T18:01:09.117622+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.117622+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:48.788505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.420686+0000","last_change":"2024-09-12T18:01:12.420634+0000","last_active":"2024-09-12T18:01:12.420686+0000","last_peered":"2024-09-12T18:01:12.420686+0000","last_clean":"2024-09-12T18:01:12.420686+0000","last_became_active":"2024-09-12T17:21:39.860544+0000","last_became_peered":"2024-09-12T17:21:39.860544+0000","last_unstale":"2024-09-12T18:01:12.420686+0000","last_undegraded":"2024-09-12T18:01:12.420686+0000","last_fullsized":"2024-09-12T18:01:12.420686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:12.420560+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.420560+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:05.743402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0013917910000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'352","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.926268+0000","last_change":"2024-09-12T18:01:10.926183+0000","last_active":"2024-09-12T18:01:10.926268+0000","last_peered":"2024-09-12T18:01:10.926268+0000","last_clean":"2024-09-12T18:01:10.926268+0000","last_became_active":"2024-09-12T17:21:50.760313+0000","last_became_peered":"2024-09-12T17:21:50.760313+0000","last_unstale":"2024-09-12T18:01:10.926268+0000","last_undegraded":"2024-09-12T18:01:10.926268+0000","last_fullsized":"2024-09-12T18:01:10.926268+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T18:01:10.925996+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.925996+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.144031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2336230,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":631,"num_read_kb":42380,"num_write":1169,"num_write_kb":26733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.733401+0000","last_change":"2024-09-12T18:01:27.733275+0000","last_active":"2024-09-12T18:01:27.733401+0000","last_peered":"2024-09-12T18:01:27.733401+0000","last_clean":"2024-09-12T18:01:27.733401+0000","last_became_active":"2024-09-12T17:21:54.749572+0000","last_became_peered":"2024-09-12T17:21:54.749572+0000","last_unstale":"2024-09-12T18:01:27.733401+0000","last_undegraded":"2024-09-12T18:01:27.733401+0000","last_fullsized":"2024-09-12T18:01:27.733401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.733178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.733178+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.733178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:38.417573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'743","reported_seq":1450,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.711411+0000","last_change":"2024-09-12T18:01:42.711411+0000","last_active":"2024-09-12T18:01:42.711411+0000","last_peered":"2024-09-12T18:01:42.711411+0000","last_clean":"2024-09-12T18:01:42.711411+0000","last_became_active":"2024-09-12T17:21:56.765172+0000","last_became_peered":"2024-09-12T17:21:56.765172+0000","last_unstale":"2024-09-12T18:01:42.711411+0000","last_undegraded":"2024-09-12T18:01:42.711411+0000","last_fullsized":"2024-09-12T18:01:42.711411+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'743","last_scrub_stamp":"2024-09-12T18:01:42.711315+0000","last_deep_scrub":"265'743","last_deep_scrub_stamp":"2024-09-12T18:01:42.711315+0000","last_clean_scrub_stamp":"2024-09-12T18:01:42.711315+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:30.938504+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169172,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1452,"num_read_kb":3379,"num_write":1380,"num_write_kb":1257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106776,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.188799+0000","last_change":"2024-09-12T18:01:39.188799+0000","last_active":"2024-09-12T18:01:39.188799+0000","last_peered":"2024-09-12T18:01:39.188799+0000","last_clean":"2024-09-12T18:01:39.188799+0000","last_became_active":"2024-09-12T17:21:58.788042+0000","last_became_peered":"2024-09-12T17:21:58.788042+0000","last_unstale":"2024-09-12T18:01:39.188799+0000","last_undegraded":"2024-09-12T18:01:39.188799+0000","last_fullsized":"2024-09-12T18:01:39.188799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:39.188700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:39.188700+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.188700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:27.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.826146+0000","last_change":"2024-09-12T18:01:31.826146+0000","last_active":"2024-09-12T18:01:31.826146+0000","last_peered":"2024-09-12T18:01:31.826146+0000","last_clean":"2024-09-12T18:01:31.826146+0000","last_became_active":"2024-09-12T17:22:00.796274+0000","last_became_peered":"2024-09-12T17:22:00.796274+0000","last_unstale":"2024-09-12T18:01:31.826146+0000","last_undegraded":"2024-09-12T18:01:31.826146+0000","last_fullsized":"2024-09-12T18:01:31.826146+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T18:01:31.826057+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T18:01:31.826057+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.826057+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:02.628612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":471,"num_write":419,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'470","reported_seq":2002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.056494+0000","last_change":"2024-09-12T18:01:25.056494+0000","last_active":"2024-09-12T18:01:25.056494+0000","last_peered":"2024-09-12T18:01:25.056494+0000","last_clean":"2024-09-12T18:01:25.056494+0000","last_became_active":"2024-09-12T17:21:52.756810+0000","last_became_peered":"2024-09-12T17:21:52.756810+0000","last_unstale":"2024-09-12T18:01:25.056494+0000","last_undegraded":"2024-09-12T18:01:25.056494+0000","last_fullsized":"2024-09-12T18:01:25.056494+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:25.056406+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.056406+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.664820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2424,"num_read_kb":2267,"num_write":556,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.447739+0000","last_change":"2024-09-12T18:01:10.447676+0000","last_active":"2024-09-12T18:01:10.447739+0000","last_peered":"2024-09-12T18:01:10.447739+0000","last_clean":"2024-09-12T18:01:10.447739+0000","last_became_active":"2024-09-12T17:21:39.860943+0000","last_became_peered":"2024-09-12T17:21:39.860943+0000","last_unstale":"2024-09-12T18:01:10.447739+0000","last_undegraded":"2024-09-12T18:01:10.447739+0000","last_fullsized":"2024-09-12T18:01:10.447739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.447603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.447603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.379942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000973481,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'393","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.197108+0000","last_change":"2024-09-12T18:01:12.197015+0000","last_active":"2024-09-12T18:01:12.197108+0000","last_peered":"2024-09-12T18:01:12.197108+0000","last_clean":"2024-09-12T18:01:12.197108+0000","last_became_active":"2024-09-12T17:21:50.757426+0000","last_became_peered":"2024-09-12T17:21:50.757426+0000","last_unstale":"2024-09-12T18:01:12.197108+0000","last_undegraded":"2024-09-12T18:01:12.197108+0000","last_fullsized":"2024-09-12T18:01:12.197108+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T18:01:12.196860+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.196860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:38.459956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":13401,"num_write":1361,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.644723+0000","last_change":"2024-09-12T18:01:37.644723+0000","last_active":"2024-09-12T18:01:37.644723+0000","last_peered":"2024-09-12T18:01:37.644723+0000","last_clean":"2024-09-12T18:01:37.644723+0000","last_became_active":"2024-09-12T17:21:54.755285+0000","last_became_peered":"2024-09-12T17:21:54.755285+0000","last_unstale":"2024-09-12T18:01:37.644723+0000","last_undegraded":"2024-09-12T18:01:37.644723+0000","last_fullsized":"2024-09-12T18:01:37.644723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:37.644634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:37.644634+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.644634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:18.470045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.335212+0000","last_change":"2024-09-12T18:01:27.335085+0000","last_active":"2024-09-12T18:01:27.335212+0000","last_peered":"2024-09-12T18:01:27.335212+0000","last_clean":"2024-09-12T18:01:27.335212+0000","last_became_active":"2024-09-12T17:21:56.767925+0000","last_became_peered":"2024-09-12T17:21:56.767925+0000","last_unstale":"2024-09-12T18:01:27.335212+0000","last_undegraded":"2024-09-12T18:01:27.335212+0000","last_fullsized":"2024-09-12T18:01:27.335212+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T18:01:27.334961+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.334961+0000","objects_scrubbed":12,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:37.159404+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161465,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1982,"num_read_kb":3789,"num_write":1078,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.756233+0000","last_change":"2024-09-12T18:01:48.756233+0000","last_active":"2024-09-12T18:01:48.756233+0000","last_peered":"2024-09-12T18:01:48.756233+0000","last_clean":"2024-09-12T18:01:48.756233+0000","last_became_active":"2024-09-12T17:21:58.789271+0000","last_became_peered":"2024-09-12T17:21:58.789271+0000","last_unstale":"2024-09-12T18:01:48.756233+0000","last_undegraded":"2024-09-12T18:01:48.756233+0000","last_fullsized":"2024-09-12T18:01:48.756233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:48.756131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:48.756131+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.756131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:46.782387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.204122+0000","last_change":"2024-09-12T18:01:46.204122+0000","last_active":"2024-09-12T18:01:46.204122+0000","last_peered":"2024-09-12T18:01:46.204122+0000","last_clean":"2024-09-12T18:01:46.204122+0000","last_became_active":"2024-09-12T17:22:00.797650+0000","last_became_peered":"2024-09-12T17:22:00.797650+0000","last_unstale":"2024-09-12T18:01:46.204122+0000","last_undegraded":"2024-09-12T18:01:46.204122+0000","last_fullsized":"2024-09-12T18:01:46.204122+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T18:01:46.204039+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T18:01:46.204039+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.204039+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:37.330326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'450","reported_seq":1966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.237463+0000","last_change":"2024-09-12T18:01:19.237463+0000","last_active":"2024-09-12T18:01:19.237463+0000","last_peered":"2024-09-12T18:01:19.237463+0000","last_clean":"2024-09-12T18:01:19.237463+0000","last_became_active":"2024-09-12T17:21:52.754449+0000","last_became_peered":"2024-09-12T17:21:52.754449+0000","last_unstale":"2024-09-12T18:01:19.237463+0000","last_undegraded":"2024-09-12T18:01:19.237463+0000","last_fullsized":"2024-09-12T18:01:19.237463+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'450","last_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_deep_scrub":"265'450","last_deep_scrub_stamp":"2024-09-12T18:01:19.237381+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.237381+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:11.813533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2673,"num_read_kb":2497,"num_write":559,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.385055+0000","last_change":"2024-09-12T18:01:12.385001+0000","last_active":"2024-09-12T18:01:12.385055+0000","last_peered":"2024-09-12T18:01:12.385055+0000","last_clean":"2024-09-12T18:01:12.385055+0000","last_became_active":"2024-09-12T17:21:39.860920+0000","last_became_peered":"2024-09-12T17:21:39.860920+0000","last_unstale":"2024-09-12T18:01:12.385055+0000","last_undegraded":"2024-09-12T18:01:12.385055+0000","last_fullsized":"2024-09-12T18:01:12.385055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:12.384902+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.384902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:54.391667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049778699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'374","reported_seq":1097,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.983438+0000","last_change":"2024-09-12T18:01:11.983349+0000","last_active":"2024-09-12T18:01:11.983438+0000","last_peered":"2024-09-12T18:01:11.983438+0000","last_clean":"2024-09-12T18:01:11.983438+0000","last_became_active":"2024-09-12T17:21:50.743763+0000","last_became_peered":"2024-09-12T17:21:50.743763+0000","last_unstale":"2024-09-12T18:01:11.983438+0000","last_undegraded":"2024-09-12T18:01:11.983438+0000","last_fullsized":"2024-09-12T18:01:11.983438+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:11.983172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.983172+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:23.268960+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730187,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":557,"num_read_kb":34998,"num_write":1154,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.411308+0000","last_change":"2024-09-12T18:01:25.411308+0000","last_active":"2024-09-12T18:01:25.411308+0000","last_peered":"2024-09-12T18:01:25.411308+0000","last_clean":"2024-09-12T18:01:25.411308+0000","last_became_active":"2024-09-12T17:21:54.755941+0000","last_became_peered":"2024-09-12T17:21:54.755941+0000","last_unstale":"2024-09-12T18:01:25.411308+0000","last_undegraded":"2024-09-12T18:01:25.411308+0000","last_fullsized":"2024-09-12T18:01:25.411308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:25.411217+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.411217+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:45.178080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'204","reported_seq":1222,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.676434+0000","last_change":"2024-09-12T18:01:25.676351+0000","last_active":"2024-09-12T18:01:25.676434+0000","last_peered":"2024-09-12T18:01:25.676434+0000","last_clean":"2024-09-12T18:01:25.676434+0000","last_became_active":"2024-09-12T17:21:56.768559+0000","last_became_peered":"2024-09-12T17:21:56.768559+0000","last_unstale":"2024-09-12T18:01:25.676434+0000","last_undegraded":"2024-09-12T18:01:25.676434+0000","last_fullsized":"2024-09-12T18:01:25.676434+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'204","last_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_deep_scrub":"265'204","last_deep_scrub_stamp":"2024-09-12T18:01:25.676244+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.676244+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:26.820945+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.927846+0000","last_change":"2024-09-12T18:01:41.927846+0000","last_active":"2024-09-12T18:01:41.927846+0000","last_peered":"2024-09-12T18:01:41.927846+0000","last_clean":"2024-09-12T18:01:41.927846+0000","last_became_active":"2024-09-12T17:21:58.786927+0000","last_became_peered":"2024-09-12T17:21:58.786927+0000","last_unstale":"2024-09-12T18:01:41.927846+0000","last_undegraded":"2024-09-12T18:01:41.927846+0000","last_fullsized":"2024-09-12T18:01:41.927846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:41.927746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:41.927746+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.927746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:22.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'291","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.027073+0000","last_change":"2024-09-12T18:01:46.027003+0000","last_active":"2024-09-12T18:01:46.027073+0000","last_peered":"2024-09-12T18:01:46.027073+0000","last_clean":"2024-09-12T18:01:46.027073+0000","last_became_active":"2024-09-12T17:22:00.794147+0000","last_became_peered":"2024-09-12T17:22:00.794147+0000","last_unstale":"2024-09-12T18:01:46.027073+0000","last_undegraded":"2024-09-12T18:01:46.027073+0000","last_fullsized":"2024-09-12T18:01:46.027073+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'291","last_scrub_stamp":"2024-09-12T18:01:46.026914+0000","last_deep_scrub":"265'291","last_deep_scrub_stamp":"2024-09-12T18:01:46.026914+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.026914+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:57.882654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":636,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'471","reported_seq":2090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.224929+0000","last_change":"2024-09-12T18:01:20.224814+0000","last_active":"2024-09-12T18:01:20.224929+0000","last_peered":"2024-09-12T18:01:20.224929+0000","last_clean":"2024-09-12T18:01:20.224929+0000","last_became_active":"2024-09-12T17:21:52.750509+0000","last_became_peered":"2024-09-12T17:21:52.750509+0000","last_unstale":"2024-09-12T18:01:20.224929+0000","last_undegraded":"2024-09-12T18:01:20.224929+0000","last_fullsized":"2024-09-12T18:01:20.224929+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:20.224700+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.224700+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.621486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2553,"num_read_kb":2414,"num_write":521,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2751,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.470570+0000","last_change":"2024-09-12T18:01:11.470497+0000","last_active":"2024-09-12T18:01:11.470570+0000","last_peered":"2024-09-12T18:01:11.470570+0000","last_clean":"2024-09-12T18:01:11.470570+0000","last_became_active":"2024-09-12T17:21:39.947376+0000","last_became_peered":"2024-09-12T17:21:39.947376+0000","last_unstale":"2024-09-12T18:01:11.470570+0000","last_undegraded":"2024-09-12T18:01:11.470570+0000","last_fullsized":"2024-09-12T18:01:11.470570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:01:11.470415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.470415+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:45.118041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001638067,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'409","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.756765+0000","last_change":"2024-09-12T18:01:13.756692+0000","last_active":"2024-09-12T18:01:13.756765+0000","last_peered":"2024-09-12T18:01:13.756765+0000","last_clean":"2024-09-12T18:01:13.756765+0000","last_became_active":"2024-09-12T17:21:50.768315+0000","last_became_peered":"2024-09-12T17:21:50.768315+0000","last_unstale":"2024-09-12T18:01:13.756765+0000","last_undegraded":"2024-09-12T18:01:13.756765+0000","last_fullsized":"2024-09-12T18:01:13.756765+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T18:01:13.756554+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.756554+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:52.180446+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3307398,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":11802,"num_write":1361,"num_write_kb":36372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.460960+0000","last_change":"2024-09-12T18:01:22.460871+0000","last_active":"2024-09-12T18:01:22.460960+0000","last_peered":"2024-09-12T18:01:22.460960+0000","last_clean":"2024-09-12T18:01:22.460960+0000","last_became_active":"2024-09-12T17:21:54.752410+0000","last_became_peered":"2024-09-12T17:21:54.752410+0000","last_unstale":"2024-09-12T18:01:22.460960+0000","last_undegraded":"2024-09-12T18:01:22.460960+0000","last_fullsized":"2024-09-12T18:01:22.460960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:22.460761+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.460761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:40.754930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'110","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.204385+0000","last_change":"2024-09-12T18:01:35.204385+0000","last_active":"2024-09-12T18:01:35.204385+0000","last_peered":"2024-09-12T18:01:35.204385+0000","last_clean":"2024-09-12T18:01:35.204385+0000","last_became_active":"2024-09-12T17:21:56.763541+0000","last_became_peered":"2024-09-12T17:21:56.763541+0000","last_unstale":"2024-09-12T18:01:35.204385+0000","last_undegraded":"2024-09-12T18:01:35.204385+0000","last_fullsized":"2024-09-12T18:01:35.204385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T18:01:35.204295+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T18:01:35.204295+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.204295+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:10.371257+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.766710+0000","last_change":"2024-09-12T18:01:47.766710+0000","last_active":"2024-09-12T18:01:47.766710+0000","last_peered":"2024-09-12T18:01:47.766710+0000","last_clean":"2024-09-12T18:01:47.766710+0000","last_became_active":"2024-09-12T17:21:58.789029+0000","last_became_peered":"2024-09-12T17:21:58.789029+0000","last_unstale":"2024-09-12T18:01:47.766710+0000","last_undegraded":"2024-09-12T18:01:47.766710+0000","last_fullsized":"2024-09-12T18:01:47.766710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:47.766617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:47.766617+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.766617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:12.165623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'142","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.279797+0000","last_change":"2024-09-12T18:01:36.279797+0000","last_active":"2024-09-12T18:01:36.279797+0000","last_peered":"2024-09-12T18:01:36.279797+0000","last_clean":"2024-09-12T18:01:36.279797+0000","last_became_active":"2024-09-12T17:22:00.787869+0000","last_became_peered":"2024-09-12T17:22:00.787869+0000","last_unstale":"2024-09-12T18:01:36.279797+0000","last_undegraded":"2024-09-12T18:01:36.279797+0000","last_fullsized":"2024-09-12T18:01:36.279797+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T18:01:36.279708+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T18:01:36.279708+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.279708+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:09.632880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'877","reported_seq":2715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.277456+0000","last_change":"2024-09-12T18:01:18.277389+0000","last_active":"2024-09-12T18:01:18.277456+0000","last_peered":"2024-09-12T18:01:18.277456+0000","last_clean":"2024-09-12T18:01:18.277456+0000","last_became_active":"2024-09-12T17:21:52.747297+0000","last_became_peered":"2024-09-12T17:21:52.747297+0000","last_unstale":"2024-09-12T18:01:18.277456+0000","last_undegraded":"2024-09-12T18:01:18.277456+0000","last_fullsized":"2024-09-12T18:01:18.277456+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'877","last_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_deep_scrub":"265'877","last_deep_scrub_stamp":"2024-09-12T18:01:18.277308+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.277308+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:23.770820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4174,"num_read_kb":3811,"num_write":1089,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'375","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:09.954807+0000","last_change":"2024-09-12T18:01:09.954746+0000","last_active":"2024-09-12T18:01:09.954807+0000","last_peered":"2024-09-12T18:01:09.954807+0000","last_clean":"2024-09-12T18:01:09.954807+0000","last_became_active":"2024-09-12T17:21:50.763456+0000","last_became_peered":"2024-09-12T17:21:50.763456+0000","last_unstale":"2024-09-12T18:01:09.954807+0000","last_undegraded":"2024-09-12T18:01:09.954807+0000","last_fullsized":"2024-09-12T18:01:09.954807+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:09.954652+0000","last_clean_scrub_stamp":"2024-09-12T18:01:09.954652+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:15.491590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":25520,"num_write":1246,"num_write_kb":29901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.942208+0000","last_change":"2024-09-12T18:01:10.942149+0000","last_active":"2024-09-12T18:01:10.942208+0000","last_peered":"2024-09-12T18:01:10.942208+0000","last_clean":"2024-09-12T18:01:10.942208+0000","last_became_active":"2024-09-12T17:21:39.947268+0000","last_became_peered":"2024-09-12T17:21:39.947268+0000","last_unstale":"2024-09-12T18:01:10.942208+0000","last_undegraded":"2024-09-12T18:01:10.942208+0000","last_fullsized":"2024-09-12T18:01:10.942208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:10.942018+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.942018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:03.095012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044864500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.895051+0000","last_change":"2024-09-12T18:01:28.894958+0000","last_active":"2024-09-12T18:01:28.895051+0000","last_peered":"2024-09-12T18:01:28.895051+0000","last_clean":"2024-09-12T18:01:28.895051+0000","last_became_active":"2024-09-12T17:21:54.755212+0000","last_became_peered":"2024-09-12T17:21:54.755212+0000","last_unstale":"2024-09-12T18:01:28.895051+0000","last_undegraded":"2024-09-12T18:01:28.895051+0000","last_fullsized":"2024-09-12T18:01:28.895051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.894849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.894849+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.894849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:24.705150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'550","reported_seq":1209,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.376770+0000","last_change":"2024-09-12T18:01:26.376661+0000","last_active":"2024-09-12T18:01:26.376770+0000","last_peered":"2024-09-12T18:01:26.376770+0000","last_clean":"2024-09-12T18:01:26.376770+0000","last_became_active":"2024-09-12T17:21:56.763490+0000","last_became_peered":"2024-09-12T17:21:56.763490+0000","last_unstale":"2024-09-12T18:01:26.376770+0000","last_undegraded":"2024-09-12T18:01:26.376770+0000","last_fullsized":"2024-09-12T18:01:26.376770+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T18:01:26.376538+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.376538+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:29.127764+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106777,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":960,"num_read_kb":2265,"num_write":794,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.074722+0000","last_change":"2024-09-12T18:01:28.074662+0000","last_active":"2024-09-12T18:01:28.074722+0000","last_peered":"2024-09-12T18:01:28.074722+0000","last_clean":"2024-09-12T18:01:28.074722+0000","last_became_active":"2024-09-12T17:21:58.786289+0000","last_became_peered":"2024-09-12T17:21:58.786289+0000","last_unstale":"2024-09-12T18:01:28.074722+0000","last_undegraded":"2024-09-12T18:01:28.074722+0000","last_fullsized":"2024-09-12T18:01:28.074722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.074566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.074566+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.074566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:23.015818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'170","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.121341+0000","last_change":"2024-09-12T18:01:48.121287+0000","last_active":"2024-09-12T18:01:48.121341+0000","last_peered":"2024-09-12T18:01:48.121341+0000","last_clean":"2024-09-12T18:01:48.121341+0000","last_became_active":"2024-09-12T17:22:00.798263+0000","last_became_peered":"2024-09-12T17:22:00.798263+0000","last_unstale":"2024-09-12T18:01:48.121341+0000","last_undegraded":"2024-09-12T18:01:48.121341+0000","last_fullsized":"2024-09-12T18:01:48.121341+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'170","last_scrub_stamp":"2024-09-12T18:01:48.121192+0000","last_deep_scrub":"265'170","last_deep_scrub_stamp":"2024-09-12T18:01:48.121192+0000","last_clean_scrub_stamp":"2024-09-12T18:01:48.121192+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:50.194249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":416,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'829","reported_seq":2355,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.342186+0000","last_change":"2024-09-12T18:01:24.342131+0000","last_active":"2024-09-12T18:01:24.342186+0000","last_peered":"2024-09-12T18:01:24.342186+0000","last_clean":"2024-09-12T18:01:24.342186+0000","last_became_active":"2024-09-12T17:21:52.753933+0000","last_became_peered":"2024-09-12T17:21:52.753933+0000","last_unstale":"2024-09-12T18:01:24.342186+0000","last_undegraded":"2024-09-12T18:01:24.342186+0000","last_fullsized":"2024-09-12T18:01:24.342186+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T18:01:24.342040+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.342040+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:50.354462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1088,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1941,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'375","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.187589+0000","last_change":"2024-09-12T18:01:13.187529+0000","last_active":"2024-09-12T18:01:13.187589+0000","last_peered":"2024-09-12T18:01:13.187589+0000","last_clean":"2024-09-12T18:01:13.187589+0000","last_became_active":"2024-09-12T17:21:50.762918+0000","last_became_peered":"2024-09-12T17:21:50.762918+0000","last_unstale":"2024-09-12T18:01:13.187589+0000","last_undegraded":"2024-09-12T18:01:13.187589+0000","last_fullsized":"2024-09-12T18:01:13.187589+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T18:01:13.187403+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.187403+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:20.594187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":578,"num_read_kb":7304,"num_write":1242,"num_write_kb":36735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.501217+0000","last_change":"2024-09-12T18:01:17.501129+0000","last_active":"2024-09-12T18:01:17.501217+0000","last_peered":"2024-09-12T18:01:17.501217+0000","last_clean":"2024-09-12T18:01:17.501217+0000","last_became_active":"2024-09-12T17:21:39.860865+0000","last_became_peered":"2024-09-12T17:21:39.860865+0000","last_unstale":"2024-09-12T18:01:17.501217+0000","last_undegraded":"2024-09-12T18:01:17.501217+0000","last_fullsized":"2024-09-12T18:01:17.501217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:17.501027+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.501027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:12.800178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00093969099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.665718+0000","last_change":"2024-09-12T18:01:24.665652+0000","last_active":"2024-09-12T18:01:24.665718+0000","last_peered":"2024-09-12T18:01:24.665718+0000","last_clean":"2024-09-12T18:01:24.665718+0000","last_became_active":"2024-09-12T17:21:54.750121+0000","last_became_peered":"2024-09-12T17:21:54.750121+0000","last_unstale":"2024-09-12T18:01:24.665718+0000","last_undegraded":"2024-09-12T18:01:24.665718+0000","last_fullsized":"2024-09-12T18:01:24.665718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:24.665551+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.665551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:34.966186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'162","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.359403+0000","last_change":"2024-09-12T18:01:31.359344+0000","last_active":"2024-09-12T18:01:31.359403+0000","last_peered":"2024-09-12T18:01:31.359403+0000","last_clean":"2024-09-12T18:01:31.359403+0000","last_became_active":"2024-09-12T17:21:56.762129+0000","last_became_peered":"2024-09-12T17:21:56.762129+0000","last_unstale":"2024-09-12T18:01:31.359403+0000","last_undegraded":"2024-09-12T18:01:31.359403+0000","last_fullsized":"2024-09-12T18:01:31.359403+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T18:01:31.359242+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T18:01:31.359242+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.359242+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:21.065971+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":194,"num_read_kb":186,"num_write":154,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'806","reported_seq":2578,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.250149+0000","last_change":"2024-09-12T18:01:31.250072+0000","last_active":"2024-09-12T18:01:31.250149+0000","last_peered":"2024-09-12T18:01:31.250149+0000","last_clean":"2024-09-12T18:01:31.250149+0000","last_became_active":"2024-09-12T17:21:58.782569+0000","last_became_peered":"2024-09-12T17:21:58.782569+0000","last_unstale":"2024-09-12T18:01:31.250149+0000","last_undegraded":"2024-09-12T18:01:31.250149+0000","last_fullsized":"2024-09-12T18:01:31.250149+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:31.249972+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:31.249972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.249972+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:41.476948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'112","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.289661+0000","last_change":"2024-09-12T18:01:36.289661+0000","last_active":"2024-09-12T18:01:36.289661+0000","last_peered":"2024-09-12T18:01:36.289661+0000","last_clean":"2024-09-12T18:01:36.289661+0000","last_became_active":"2024-09-12T17:22:00.794323+0000","last_became_peered":"2024-09-12T17:22:00.794323+0000","last_unstale":"2024-09-12T18:01:36.289661+0000","last_undegraded":"2024-09-12T18:01:36.289661+0000","last_fullsized":"2024-09-12T18:01:36.289661+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T18:01:36.289568+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T18:01:36.289568+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.289568+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:21.733683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":173,"num_read_kb":156,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'875","reported_seq":2595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.833785+0000","last_change":"2024-09-12T18:01:16.833708+0000","last_active":"2024-09-12T18:01:16.833785+0000","last_peered":"2024-09-12T18:01:16.833785+0000","last_clean":"2024-09-12T18:01:16.833785+0000","last_became_active":"2024-09-12T17:21:52.744795+0000","last_became_peered":"2024-09-12T17:21:52.744795+0000","last_unstale":"2024-09-12T18:01:16.833785+0000","last_undegraded":"2024-09-12T18:01:16.833785+0000","last_fullsized":"2024-09-12T18:01:16.833785+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'875","last_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_deep_scrub":"265'875","last_deep_scrub_stamp":"2024-09-12T18:01:16.833613+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.833613+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.664041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4664,"num_read_kb":4221,"num_write":1207,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":649,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'365","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.878116+0000","last_change":"2024-09-12T18:01:13.878116+0000","last_active":"2024-09-12T18:01:13.878116+0000","last_peered":"2024-09-12T18:01:13.878116+0000","last_clean":"2024-09-12T18:01:13.878116+0000","last_became_active":"2024-09-12T17:21:50.755785+0000","last_became_peered":"2024-09-12T17:21:50.755785+0000","last_unstale":"2024-09-12T18:01:13.878116+0000","last_undegraded":"2024-09-12T18:01:13.878116+0000","last_fullsized":"2024-09-12T18:01:13.878116+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:13.877983+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.877983+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.503105+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831558,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":10322,"num_write":1179,"num_write_kb":46489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.894172+0000","last_change":"2024-09-12T18:01:11.894172+0000","last_active":"2024-09-12T18:01:11.894172+0000","last_peered":"2024-09-12T18:01:11.894172+0000","last_clean":"2024-09-12T18:01:11.894172+0000","last_became_active":"2024-09-12T17:21:39.948601+0000","last_became_peered":"2024-09-12T17:21:39.948601+0000","last_unstale":"2024-09-12T18:01:11.894172+0000","last_undegraded":"2024-09-12T18:01:11.894172+0000","last_fullsized":"2024-09-12T18:01:11.894172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:11.894084+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.894084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:44.249082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045226199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.601900+0000","last_change":"2024-09-12T18:01:36.601900+0000","last_active":"2024-09-12T18:01:36.601900+0000","last_peered":"2024-09-12T18:01:36.601900+0000","last_clean":"2024-09-12T18:01:36.601900+0000","last_became_active":"2024-09-12T17:21:54.758259+0000","last_became_peered":"2024-09-12T17:21:54.758259+0000","last_unstale":"2024-09-12T18:01:36.601900+0000","last_undegraded":"2024-09-12T18:01:36.601900+0000","last_fullsized":"2024-09-12T18:01:36.601900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:36.601800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:36.601800+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.601800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:53.159379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'101","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.728282+0000","last_change":"2024-09-12T18:01:41.728282+0000","last_active":"2024-09-12T18:01:41.728282+0000","last_peered":"2024-09-12T18:01:41.728282+0000","last_clean":"2024-09-12T18:01:41.728282+0000","last_became_active":"2024-09-12T17:21:56.764470+0000","last_became_peered":"2024-09-12T17:21:56.764470+0000","last_unstale":"2024-09-12T18:01:41.728282+0000","last_undegraded":"2024-09-12T18:01:41.728282+0000","last_fullsized":"2024-09-12T18:01:41.728282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T18:01:41.728189+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T18:01:41.728189+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.728189+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:46.696780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'810","reported_seq":2366,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.150122+0000","last_change":"2024-09-12T18:01:38.150122+0000","last_active":"2024-09-12T18:01:38.150122+0000","last_peered":"2024-09-12T18:01:38.150122+0000","last_clean":"2024-09-12T18:01:38.150122+0000","last_became_active":"2024-09-12T17:21:58.785191+0000","last_became_peered":"2024-09-12T17:21:58.785191+0000","last_unstale":"2024-09-12T18:01:38.150122+0000","last_undegraded":"2024-09-12T18:01:38.150122+0000","last_fullsized":"2024-09-12T18:01:38.150122+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'810","last_scrub_stamp":"2024-09-12T18:01:38.150024+0000","last_deep_scrub":"265'810","last_deep_scrub_stamp":"2024-09-12T18:01:38.150024+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.150024+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:28.471792+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'328","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.199049+0000","last_change":"2024-09-12T18:01:45.198972+0000","last_active":"2024-09-12T18:01:45.199049+0000","last_peered":"2024-09-12T18:01:45.199049+0000","last_clean":"2024-09-12T18:01:45.199049+0000","last_became_active":"2024-09-12T17:22:00.794279+0000","last_became_peered":"2024-09-12T17:22:00.794279+0000","last_unstale":"2024-09-12T18:01:45.199049+0000","last_undegraded":"2024-09-12T18:01:45.199049+0000","last_fullsized":"2024-09-12T18:01:45.199049+0000","mapping_epoch":35,"log_start":"265'300","ondisk_log_start":"265'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-12T18:01:45.198878+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-12T18:01:45.198878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.198878+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:42.913988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":457,"num_write":667,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'493","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.925408+0000","last_change":"2024-09-12T18:01:16.925347+0000","last_active":"2024-09-12T18:01:16.925408+0000","last_peered":"2024-09-12T18:01:16.925408+0000","last_clean":"2024-09-12T18:01:16.925408+0000","last_became_active":"2024-09-12T17:21:52.740279+0000","last_became_peered":"2024-09-12T17:21:52.740279+0000","last_unstale":"2024-09-12T18:01:16.925408+0000","last_undegraded":"2024-09-12T18:01:16.925408+0000","last_fullsized":"2024-09-12T18:01:16.925408+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'493","last_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_deep_scrub":"265'493","last_deep_scrub_stamp":"2024-09-12T18:01:16.925258+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.925258+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:35.178082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2479,"num_read_kb":2337,"num_write":590,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'332","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.877403+0000","last_change":"2024-09-12T18:01:12.877403+0000","last_active":"2024-09-12T18:01:12.877403+0000","last_peered":"2024-09-12T18:01:12.877403+0000","last_clean":"2024-09-12T18:01:12.877403+0000","last_became_active":"2024-09-12T17:21:50.759537+0000","last_became_peered":"2024-09-12T17:21:50.759537+0000","last_unstale":"2024-09-12T18:01:12.877403+0000","last_undegraded":"2024-09-12T18:01:12.877403+0000","last_fullsized":"2024-09-12T18:01:12.877403+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T18:01:12.877095+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.877095+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:51.937844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287862,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59240,"num_write":1015,"num_write_kb":30879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.467414+0000","last_change":"2024-09-12T18:01:13.467414+0000","last_active":"2024-09-12T18:01:13.467414+0000","last_peered":"2024-09-12T18:01:13.467414+0000","last_clean":"2024-09-12T18:01:13.467414+0000","last_became_active":"2024-09-12T17:21:39.948471+0000","last_became_peered":"2024-09-12T17:21:39.948471+0000","last_unstale":"2024-09-12T18:01:13.467414+0000","last_undegraded":"2024-09-12T18:01:13.467414+0000","last_fullsized":"2024-09-12T18:01:13.467414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:13.467313+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.467313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.884795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012880890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.917945+0000","last_change":"2024-09-12T18:01:27.917890+0000","last_active":"2024-09-12T18:01:27.917945+0000","last_peered":"2024-09-12T18:01:27.917945+0000","last_clean":"2024-09-12T18:01:27.917945+0000","last_became_active":"2024-09-12T17:21:54.751942+0000","last_became_peered":"2024-09-12T17:21:54.751942+0000","last_unstale":"2024-09-12T18:01:27.917945+0000","last_undegraded":"2024-09-12T18:01:27.917945+0000","last_fullsized":"2024-09-12T18:01:27.917945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.917798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.917798+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.917798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:37.435561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'752","reported_seq":1470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.754357+0000","last_change":"2024-09-12T18:01:28.754297+0000","last_active":"2024-09-12T18:01:28.754357+0000","last_peered":"2024-09-12T18:01:28.754357+0000","last_clean":"2024-09-12T18:01:28.754357+0000","last_became_active":"2024-09-12T17:21:56.767704+0000","last_became_peered":"2024-09-12T17:21:56.767704+0000","last_unstale":"2024-09-12T18:01:28.754357+0000","last_undegraded":"2024-09-12T18:01:28.754357+0000","last_fullsized":"2024-09-12T18:01:28.754357+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'752","last_scrub_stamp":"2024-09-12T18:01:28.754192+0000","last_deep_scrub":"265'752","last_deep_scrub_stamp":"2024-09-12T18:01:28.754192+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.754192+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:15.599654+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1320,"num_read_kb":3172,"num_write":1088,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.909610+0000","last_change":"2024-09-12T18:01:40.909610+0000","last_active":"2024-09-12T18:01:40.909610+0000","last_peered":"2024-09-12T18:01:40.909610+0000","last_clean":"2024-09-12T18:01:40.909610+0000","last_became_active":"2024-09-12T17:21:58.782747+0000","last_became_peered":"2024-09-12T17:21:58.782747+0000","last_unstale":"2024-09-12T18:01:40.909610+0000","last_undegraded":"2024-09-12T18:01:40.909610+0000","last_fullsized":"2024-09-12T18:01:40.909610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:40.909516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:40.909516+0000","last_clean_scrub_stamp":"2024-09-12T18:01:40.909516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.372263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'135","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.046581+0000","last_change":"2024-09-12T18:01:36.046514+0000","last_active":"2024-09-12T18:01:36.046581+0000","last_peered":"2024-09-12T18:01:36.046581+0000","last_clean":"2024-09-12T18:01:36.046581+0000","last_became_active":"2024-09-12T17:22:00.788701+0000","last_became_peered":"2024-09-12T17:22:00.788701+0000","last_unstale":"2024-09-12T18:01:36.046581+0000","last_undegraded":"2024-09-12T18:01:36.046581+0000","last_fullsized":"2024-09-12T18:01:36.046581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T18:01:36.046428+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T18:01:36.046428+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.046428+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:42.080685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":218,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'153","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.038139+0000","last_change":"2024-09-12T18:01:47.038139+0000","last_active":"2024-09-12T18:01:47.038139+0000","last_peered":"2024-09-12T18:01:47.038139+0000","last_clean":"2024-09-12T18:01:47.038139+0000","last_became_active":"2024-09-12T17:22:00.786680+0000","last_became_peered":"2024-09-12T17:22:00.786680+0000","last_unstale":"2024-09-12T18:01:47.038139+0000","last_undegraded":"2024-09-12T18:01:47.038139+0000","last_fullsized":"2024-09-12T18:01:47.038139+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T18:01:47.038042+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T18:01:47.038042+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.038042+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:07.811045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":279,"num_write":374,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'470","reported_seq":2074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.001611+0000","last_change":"2024-09-12T18:01:19.001546+0000","last_active":"2024-09-12T18:01:19.001611+0000","last_peered":"2024-09-12T18:01:19.001611+0000","last_clean":"2024-09-12T18:01:19.001611+0000","last_became_active":"2024-09-12T17:21:52.741915+0000","last_became_peered":"2024-09-12T17:21:52.741915+0000","last_unstale":"2024-09-12T18:01:19.001611+0000","last_undegraded":"2024-09-12T18:01:19.001611+0000","last_fullsized":"2024-09-12T18:01:19.001611+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'470","last_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_deep_scrub":"265'470","last_deep_scrub_stamp":"2024-09-12T18:01:19.001453+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.001453+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:36.748667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2625,"num_read_kb":2472,"num_write":561,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'322","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.476817+0000","last_change":"2024-09-12T18:01:18.476752+0000","last_active":"2024-09-12T18:01:18.476817+0000","last_peered":"2024-09-12T18:01:18.476817+0000","last_clean":"2024-09-12T18:01:18.476817+0000","last_became_active":"2024-09-12T17:21:50.769624+0000","last_became_peered":"2024-09-12T17:21:50.769624+0000","last_unstale":"2024-09-12T18:01:18.476817+0000","last_undegraded":"2024-09-12T18:01:18.476817+0000","last_fullsized":"2024-09-12T18:01:18.476817+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:18.476604+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.476604+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:40.563516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":5956,"num_write":1032,"num_write_kb":27220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.354526+0000","last_change":"2024-09-12T18:01:28.354442+0000","last_active":"2024-09-12T18:01:28.354526+0000","last_peered":"2024-09-12T18:01:28.354526+0000","last_clean":"2024-09-12T18:01:28.354526+0000","last_became_active":"2024-09-12T17:21:54.758923+0000","last_became_peered":"2024-09-12T17:21:54.758923+0000","last_unstale":"2024-09-12T18:01:28.354526+0000","last_undegraded":"2024-09-12T18:01:28.354526+0000","last_fullsized":"2024-09-12T18:01:28.354526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:28.354346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:28.354346+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.354346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:42.021832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'301","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.443607+0000","last_change":"2024-09-12T18:01:36.443550+0000","last_active":"2024-09-12T18:01:36.443607+0000","last_peered":"2024-09-12T18:01:36.443607+0000","last_clean":"2024-09-12T18:01:36.443607+0000","last_became_active":"2024-09-12T17:21:56.766400+0000","last_became_peered":"2024-09-12T17:21:56.766400+0000","last_unstale":"2024-09-12T18:01:36.443607+0000","last_undegraded":"2024-09-12T18:01:36.443607+0000","last_fullsized":"2024-09-12T18:01:36.443607+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T18:01:36.443460+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T18:01:36.443460+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.443460+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:03.576675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":1191,"num_write":410,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.312192+0000","last_change":"2024-09-12T18:01:31.312137+0000","last_active":"2024-09-12T18:01:31.312192+0000","last_peered":"2024-09-12T18:01:31.312192+0000","last_clean":"2024-09-12T18:01:31.312192+0000","last_became_active":"2024-09-12T17:21:58.780981+0000","last_became_peered":"2024-09-12T17:21:58.780981+0000","last_unstale":"2024-09-12T18:01:31.312192+0000","last_undegraded":"2024-09-12T18:01:31.312192+0000","last_fullsized":"2024-09-12T18:01:31.312192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:31.312055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:31.312055+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.312055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:57.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'131","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:37.283880+0000","last_change":"2024-09-12T18:01:37.283798+0000","last_active":"2024-09-12T18:01:37.283880+0000","last_peered":"2024-09-12T18:01:37.283880+0000","last_clean":"2024-09-12T18:01:37.283880+0000","last_became_active":"2024-09-12T17:22:00.794457+0000","last_became_peered":"2024-09-12T17:22:00.794457+0000","last_unstale":"2024-09-12T18:01:37.283880+0000","last_undegraded":"2024-09-12T18:01:37.283880+0000","last_fullsized":"2024-09-12T18:01:37.283880+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T18:01:37.283704+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T18:01:37.283704+0000","last_clean_scrub_stamp":"2024-09-12T18:01:37.283704+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:48.879058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":315,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'642","reported_seq":2267,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.847310+0000","last_change":"2024-09-12T18:01:18.847253+0000","last_active":"2024-09-12T18:01:18.847310+0000","last_peered":"2024-09-12T18:01:18.847310+0000","last_clean":"2024-09-12T18:01:18.847310+0000","last_became_active":"2024-09-12T17:21:52.743733+0000","last_became_peered":"2024-09-12T17:21:52.743733+0000","last_unstale":"2024-09-12T18:01:18.847310+0000","last_undegraded":"2024-09-12T18:01:18.847310+0000","last_fullsized":"2024-09-12T18:01:18.847310+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'642","last_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_deep_scrub":"265'642","last_deep_scrub_stamp":"2024-09-12T18:01:18.847166+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.847166+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:32.189494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3382,"num_read_kb":3070,"num_write":942,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.988551+0000","last_change":"2024-09-12T18:01:12.988551+0000","last_active":"2024-09-12T18:01:12.988551+0000","last_peered":"2024-09-12T18:01:12.988551+0000","last_clean":"2024-09-12T18:01:12.988551+0000","last_became_active":"2024-09-12T17:22:26.296248+0000","last_became_peered":"2024-09-12T17:22:26.296248+0000","last_unstale":"2024-09-12T18:01:12.988551+0000","last_undegraded":"2024-09-12T18:01:12.988551+0000","last_fullsized":"2024-09-12T18:01:12.988551+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T18:01:12.988415+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.988415+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.161722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25542,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":12892,"num_write":966,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,2],"acting":[5,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.903442+0000","last_change":"2024-09-12T18:01:29.903381+0000","last_active":"2024-09-12T18:01:29.903442+0000","last_peered":"2024-09-12T18:01:29.903442+0000","last_clean":"2024-09-12T18:01:29.903442+0000","last_became_active":"2024-09-12T17:21:54.755110+0000","last_became_peered":"2024-09-12T17:21:54.755110+0000","last_unstale":"2024-09-12T18:01:29.903442+0000","last_undegraded":"2024-09-12T18:01:29.903442+0000","last_fullsized":"2024-09-12T18:01:29.903442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.903292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.903292+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.903292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:22.696946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'50","reported_seq":559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.916271+0000","last_change":"2024-09-12T18:01:36.916209+0000","last_active":"2024-09-12T18:01:36.916271+0000","last_peered":"2024-09-12T18:01:36.916271+0000","last_clean":"2024-09-12T18:01:36.916271+0000","last_became_active":"2024-09-12T17:21:56.761126+0000","last_became_peered":"2024-09-12T17:21:56.761126+0000","last_unstale":"2024-09-12T18:01:36.916271+0000","last_undegraded":"2024-09-12T18:01:36.916271+0000","last_fullsized":"2024-09-12T18:01:36.916271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T18:01:36.916109+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T18:01:36.916109+0000","last_clean_scrub_stamp":"2024-09-12T18:01:36.916109+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:23.996232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.006388+0000","last_change":"2024-09-12T18:01:33.006329+0000","last_active":"2024-09-12T18:01:33.006388+0000","last_peered":"2024-09-12T18:01:33.006388+0000","last_clean":"2024-09-12T18:01:33.006388+0000","last_became_active":"2024-09-12T17:21:58.778977+0000","last_became_peered":"2024-09-12T17:21:58.778977+0000","last_unstale":"2024-09-12T18:01:33.006388+0000","last_undegraded":"2024-09-12T18:01:33.006388+0000","last_fullsized":"2024-09-12T18:01:33.006388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.006261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.006261+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.006261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:19.171367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'231","reported_seq":770,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.407418+0000","last_change":"2024-09-12T18:01:41.407362+0000","last_active":"2024-09-12T18:01:41.407418+0000","last_peered":"2024-09-12T18:01:41.407418+0000","last_clean":"2024-09-12T18:01:41.407418+0000","last_became_active":"2024-09-12T17:22:00.795417+0000","last_became_peered":"2024-09-12T17:22:00.795417+0000","last_unstale":"2024-09-12T18:01:41.407418+0000","last_undegraded":"2024-09-12T18:01:41.407418+0000","last_fullsized":"2024-09-12T18:01:41.407418+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'231","last_scrub_stamp":"2024-09-12T18:01:41.407267+0000","last_deep_scrub":"265'231","last_deep_scrub_stamp":"2024-09-12T18:01:41.407267+0000","last_clean_scrub_stamp":"2024-09-12T18:01:41.407267+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:13.355719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":856,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":409,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'388","reported_seq":1873,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.830190+0000","last_change":"2024-09-12T18:01:20.830100+0000","last_active":"2024-09-12T18:01:20.830190+0000","last_peered":"2024-09-12T18:01:20.830190+0000","last_clean":"2024-09-12T18:01:20.830190+0000","last_became_active":"2024-09-12T17:21:52.750046+0000","last_became_peered":"2024-09-12T17:21:52.750046+0000","last_unstale":"2024-09-12T18:01:20.830190+0000","last_undegraded":"2024-09-12T18:01:20.830190+0000","last_fullsized":"2024-09-12T18:01:20.830190+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T18:01:20.830014+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.830014+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.815711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2084,"num_read_kb":1986,"num_write":442,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'337","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.935172+0000","last_change":"2024-09-12T18:01:12.935172+0000","last_active":"2024-09-12T18:01:12.935172+0000","last_peered":"2024-09-12T18:01:12.935172+0000","last_clean":"2024-09-12T18:01:12.935172+0000","last_became_active":"2024-09-12T17:21:50.766577+0000","last_became_peered":"2024-09-12T17:21:50.766577+0000","last_unstale":"2024-09-12T18:01:12.935172+0000","last_undegraded":"2024-09-12T18:01:12.935172+0000","last_fullsized":"2024-09-12T18:01:12.935172+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T18:01:12.935024+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.935024+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:23.088612+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":8586,"num_write":1108,"num_write_kb":34866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.015175+0000","last_change":"2024-09-12T18:01:26.015124+0000","last_active":"2024-09-12T18:01:26.015175+0000","last_peered":"2024-09-12T18:01:26.015175+0000","last_clean":"2024-09-12T18:01:26.015175+0000","last_became_active":"2024-09-12T17:21:54.753434+0000","last_became_peered":"2024-09-12T17:21:54.753434+0000","last_unstale":"2024-09-12T18:01:26.015175+0000","last_undegraded":"2024-09-12T18:01:26.015175+0000","last_fullsized":"2024-09-12T18:01:26.015175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.015036+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.015036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:53.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'322","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:28.361742+0000","last_change":"2024-09-12T18:01:28.361686+0000","last_active":"2024-09-12T18:01:28.361742+0000","last_peered":"2024-09-12T18:01:28.361742+0000","last_clean":"2024-09-12T18:01:28.361742+0000","last_became_active":"2024-09-12T17:21:56.765763+0000","last_became_peered":"2024-09-12T17:21:56.765763+0000","last_unstale":"2024-09-12T18:01:28.361742+0000","last_undegraded":"2024-09-12T18:01:28.361742+0000","last_fullsized":"2024-09-12T18:01:28.361742+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:28.361576+0000","last_clean_scrub_stamp":"2024-09-12T18:01:28.361576+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:53.552109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54935,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":1244,"num_write":438,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.247647+0000","last_change":"2024-09-12T18:01:32.247532+0000","last_active":"2024-09-12T18:01:32.247647+0000","last_peered":"2024-09-12T18:01:32.247647+0000","last_clean":"2024-09-12T18:01:32.247647+0000","last_became_active":"2024-09-12T17:21:58.781133+0000","last_became_peered":"2024-09-12T17:21:58.781133+0000","last_unstale":"2024-09-12T18:01:32.247647+0000","last_undegraded":"2024-09-12T18:01:32.247647+0000","last_fullsized":"2024-09-12T18:01:32.247647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.247432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.247432+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.247432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'134","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.809353+0000","last_change":"2024-09-12T18:01:56.809288+0000","last_active":"2024-09-12T18:01:56.809353+0000","last_peered":"2024-09-12T18:01:56.809353+0000","last_clean":"2024-09-12T18:01:56.809353+0000","last_became_active":"2024-09-12T17:22:00.797273+0000","last_became_peered":"2024-09-12T17:22:00.797273+0000","last_unstale":"2024-09-12T18:01:56.809353+0000","last_undegraded":"2024-09-12T18:01:56.809353+0000","last_fullsized":"2024-09-12T18:01:56.809353+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T18:01:56.809202+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T18:01:56.809202+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.809202+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:36.079733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'741","reported_seq":2121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.416891+0000","last_change":"2024-09-12T18:01:21.416829+0000","last_active":"2024-09-12T18:01:21.416891+0000","last_peered":"2024-09-12T18:01:21.416891+0000","last_clean":"2024-09-12T18:01:21.416891+0000","last_became_active":"2024-09-12T17:21:52.749629+0000","last_became_peered":"2024-09-12T17:21:52.749629+0000","last_unstale":"2024-09-12T18:01:21.416891+0000","last_undegraded":"2024-09-12T18:01:21.416891+0000","last_fullsized":"2024-09-12T18:01:21.416891+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'741","last_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_deep_scrub":"265'741","last_deep_scrub_stamp":"2024-09-12T18:01:21.416733+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.416733+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:42.434807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3054,"num_write":980,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'319","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.025570+0000","last_change":"2024-09-12T18:01:14.025570+0000","last_active":"2024-09-12T18:01:14.025570+0000","last_peered":"2024-09-12T18:01:14.025570+0000","last_clean":"2024-09-12T18:01:14.025570+0000","last_became_active":"2024-09-12T17:21:50.754499+0000","last_became_peered":"2024-09-12T17:21:50.754499+0000","last_unstale":"2024-09-12T18:01:14.025570+0000","last_undegraded":"2024-09-12T18:01:14.025570+0000","last_fullsized":"2024-09-12T18:01:14.025570+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T18:01:14.025424+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.025424+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:56.638592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":5945,"num_write":1198,"num_write_kb":26357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.718214+0000","last_change":"2024-09-12T18:01:39.718214+0000","last_active":"2024-09-12T18:01:39.718214+0000","last_peered":"2024-09-12T18:01:39.718214+0000","last_clean":"2024-09-12T18:01:39.718214+0000","last_became_active":"2024-09-12T17:21:54.758151+0000","last_became_peered":"2024-09-12T17:21:54.758151+0000","last_unstale":"2024-09-12T18:01:39.718214+0000","last_undegraded":"2024-09-12T18:01:39.718214+0000","last_fullsized":"2024-09-12T18:01:39.718214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:39.718115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:39.718115+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.718115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:48.115400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'257","reported_seq":828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.765483+0000","last_change":"2024-09-12T18:01:29.765422+0000","last_active":"2024-09-12T18:01:29.765483+0000","last_peered":"2024-09-12T18:01:29.765483+0000","last_clean":"2024-09-12T18:01:29.765483+0000","last_became_active":"2024-09-12T17:21:56.769335+0000","last_became_peered":"2024-09-12T17:21:56.769335+0000","last_unstale":"2024-09-12T18:01:29.765483+0000","last_undegraded":"2024-09-12T18:01:29.765483+0000","last_fullsized":"2024-09-12T18:01:29.765483+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'257","last_scrub_stamp":"2024-09-12T18:01:29.765326+0000","last_deep_scrub":"265'257","last_deep_scrub_stamp":"2024-09-12T18:01:29.765326+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.765326+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.854948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48942,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":1075,"num_write":368,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.327176+0000","last_change":"2024-09-12T18:01:33.327099+0000","last_active":"2024-09-12T18:01:33.327176+0000","last_peered":"2024-09-12T18:01:33.327176+0000","last_clean":"2024-09-12T18:01:33.327176+0000","last_became_active":"2024-09-12T17:21:58.784770+0000","last_became_peered":"2024-09-12T17:21:58.784770+0000","last_unstale":"2024-09-12T18:01:33.327176+0000","last_undegraded":"2024-09-12T18:01:33.327176+0000","last_fullsized":"2024-09-12T18:01:33.327176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.327013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.327013+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.327013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:15.753055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'406","reported_seq":1827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.556024+0000","last_change":"2024-09-12T18:01:31.556024+0000","last_active":"2024-09-12T18:01:31.556024+0000","last_peered":"2024-09-12T18:01:31.556024+0000","last_clean":"2024-09-12T18:01:31.556024+0000","last_became_active":"2024-09-12T17:21:52.754837+0000","last_became_peered":"2024-09-12T17:21:52.754837+0000","last_unstale":"2024-09-12T18:01:31.556024+0000","last_undegraded":"2024-09-12T18:01:31.556024+0000","last_fullsized":"2024-09-12T18:01:31.556024+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T18:01:31.555902+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T18:01:31.555902+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.555902+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:22.755101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2061,"num_read_kb":1941,"num_write":478,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'306","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.017205+0000","last_change":"2024-09-12T18:01:15.017205+0000","last_active":"2024-09-12T18:01:15.017205+0000","last_peered":"2024-09-12T18:01:15.017205+0000","last_clean":"2024-09-12T18:01:15.017205+0000","last_became_active":"2024-09-12T17:21:50.762124+0000","last_became_peered":"2024-09-12T17:21:50.762124+0000","last_unstale":"2024-09-12T18:01:15.017205+0000","last_undegraded":"2024-09-12T18:01:15.017205+0000","last_fullsized":"2024-09-12T18:01:15.017205+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'306","last_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_deep_scrub":"265'306","last_deep_scrub_stamp":"2024-09-12T18:01:15.017064+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.017064+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:45.936859+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6208110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":25374,"num_write":969,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.355134+0000","last_change":"2024-09-12T18:01:29.355066+0000","last_active":"2024-09-12T18:01:29.355134+0000","last_peered":"2024-09-12T18:01:29.355134+0000","last_clean":"2024-09-12T18:01:29.355134+0000","last_became_active":"2024-09-12T17:21:54.758867+0000","last_became_peered":"2024-09-12T17:21:54.758867+0000","last_unstale":"2024-09-12T18:01:29.355134+0000","last_undegraded":"2024-09-12T18:01:29.355134+0000","last_fullsized":"2024-09-12T18:01:29.355134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.354979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.354979+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.354979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.677603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'490","reported_seq":1120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.385114+0000","last_change":"2024-09-12T18:01:33.385058+0000","last_active":"2024-09-12T18:01:33.385114+0000","last_peered":"2024-09-12T18:01:33.385114+0000","last_clean":"2024-09-12T18:01:33.385114+0000","last_became_active":"2024-09-12T17:21:56.768404+0000","last_became_peered":"2024-09-12T17:21:56.768404+0000","last_unstale":"2024-09-12T18:01:33.385114+0000","last_undegraded":"2024-09-12T18:01:33.385114+0000","last_fullsized":"2024-09-12T18:01:33.385114+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:33.384960+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:33.384960+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.384960+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:59.456106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94926,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":2123,"num_write":760,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.055303+0000","last_change":"2024-09-12T18:01:32.055233+0000","last_active":"2024-09-12T18:01:32.055303+0000","last_peered":"2024-09-12T18:01:32.055303+0000","last_clean":"2024-09-12T18:01:32.055303+0000","last_became_active":"2024-09-12T17:21:58.784504+0000","last_became_peered":"2024-09-12T17:21:58.784504+0000","last_unstale":"2024-09-12T18:01:32.055303+0000","last_undegraded":"2024-09-12T18:01:32.055303+0000","last_fullsized":"2024-09-12T18:01:32.055303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.055142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.055142+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.055142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:15.170698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'168","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:47.169209+0000","last_change":"2024-09-12T18:01:47.169209+0000","last_active":"2024-09-12T18:01:47.169209+0000","last_peered":"2024-09-12T18:01:47.169209+0000","last_clean":"2024-09-12T18:01:47.169209+0000","last_became_active":"2024-09-12T17:22:00.798315+0000","last_became_peered":"2024-09-12T17:22:00.798315+0000","last_unstale":"2024-09-12T18:01:47.169209+0000","last_undegraded":"2024-09-12T18:01:47.169209+0000","last_fullsized":"2024-09-12T18:01:47.169209+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T18:01:47.169070+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T18:01:47.169070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:47.169070+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:31.952309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1481,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":263,"num_write":389,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'422","reported_seq":1896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.801398+0000","last_change":"2024-09-12T18:01:19.801339+0000","last_active":"2024-09-12T18:01:19.801398+0000","last_peered":"2024-09-12T18:01:19.801398+0000","last_clean":"2024-09-12T18:01:19.801398+0000","last_became_active":"2024-09-12T17:21:52.746098+0000","last_became_peered":"2024-09-12T17:21:52.746098+0000","last_unstale":"2024-09-12T18:01:19.801398+0000","last_undegraded":"2024-09-12T18:01:19.801398+0000","last_fullsized":"2024-09-12T18:01:19.801398+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-12T18:01:19.801241+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.801241+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.355929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2209,"num_read_kb":2083,"num_write":481,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'338","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.856875+0000","last_change":"2024-09-12T18:01:15.856875+0000","last_active":"2024-09-12T18:01:15.856875+0000","last_peered":"2024-09-12T18:01:15.856875+0000","last_clean":"2024-09-12T18:01:15.856875+0000","last_became_active":"2024-09-12T17:21:50.759447+0000","last_became_peered":"2024-09-12T17:21:50.759447+0000","last_unstale":"2024-09-12T18:01:15.856875+0000","last_undegraded":"2024-09-12T18:01:15.856875+0000","last_fullsized":"2024-09-12T18:01:15.856875+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T18:01:15.856769+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.856769+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:45.860393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":48900,"num_write":1054,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.072466+0000","last_change":"2024-09-12T18:01:29.072395+0000","last_active":"2024-09-12T18:01:29.072466+0000","last_peered":"2024-09-12T18:01:29.072466+0000","last_clean":"2024-09-12T18:01:29.072466+0000","last_became_active":"2024-09-12T17:21:54.757527+0000","last_became_peered":"2024-09-12T17:21:54.757527+0000","last_unstale":"2024-09-12T18:01:29.072466+0000","last_undegraded":"2024-09-12T18:01:29.072466+0000","last_fullsized":"2024-09-12T18:01:29.072466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:29.072294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:29.072294+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.072294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:35.429398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'303","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:44.710975+0000","last_change":"2024-09-12T18:01:44.710912+0000","last_active":"2024-09-12T18:01:44.710975+0000","last_peered":"2024-09-12T18:01:44.710975+0000","last_clean":"2024-09-12T18:01:44.710975+0000","last_became_active":"2024-09-12T17:21:56.759194+0000","last_became_peered":"2024-09-12T17:21:56.759194+0000","last_unstale":"2024-09-12T18:01:44.710975+0000","last_undegraded":"2024-09-12T18:01:44.710975+0000","last_fullsized":"2024-09-12T18:01:44.710975+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T18:01:44.710795+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T18:01:44.710795+0000","last_clean_scrub_stamp":"2024-09-12T18:01:44.710795+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:51.035980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1077,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.141797+0000","last_change":"2024-09-12T18:01:43.141697+0000","last_active":"2024-09-12T18:01:43.141797+0000","last_peered":"2024-09-12T18:01:43.141797+0000","last_clean":"2024-09-12T18:01:43.141797+0000","last_became_active":"2024-09-12T17:21:58.795162+0000","last_became_peered":"2024-09-12T17:21:58.795162+0000","last_unstale":"2024-09-12T18:01:43.141797+0000","last_undegraded":"2024-09-12T18:01:43.141797+0000","last_fullsized":"2024-09-12T18:01:43.141797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.141601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.141601+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.141601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:34.597861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'196","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.791021+0000","last_change":"2024-09-12T18:01:54.791021+0000","last_active":"2024-09-12T18:01:54.791021+0000","last_peered":"2024-09-12T18:01:54.791021+0000","last_clean":"2024-09-12T18:01:54.791021+0000","last_became_active":"2024-09-12T17:22:00.793656+0000","last_became_peered":"2024-09-12T17:22:00.793656+0000","last_unstale":"2024-09-12T18:01:54.791021+0000","last_undegraded":"2024-09-12T18:01:54.791021+0000","last_fullsized":"2024-09-12T18:01:54.791021+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'196","last_scrub_stamp":"2024-09-12T18:01:54.790910+0000","last_deep_scrub":"265'196","last_deep_scrub_stamp":"2024-09-12T18:01:54.790910+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.790910+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:18.190106+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":628,"num_write":545,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'858","reported_seq":2328,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.389803+0000","last_change":"2024-09-12T18:01:20.389730+0000","last_active":"2024-09-12T18:01:20.389803+0000","last_peered":"2024-09-12T18:01:20.389803+0000","last_clean":"2024-09-12T18:01:20.389803+0000","last_became_active":"2024-09-12T17:21:52.755126+0000","last_became_peered":"2024-09-12T17:21:52.755126+0000","last_unstale":"2024-09-12T18:01:20.389803+0000","last_undegraded":"2024-09-12T18:01:20.389803+0000","last_fullsized":"2024-09-12T18:01:20.389803+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'858","last_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_deep_scrub":"265'858","last_deep_scrub_stamp":"2024-09-12T18:01:20.389628+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.389628+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:33.344999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4011,"num_read_kb":3557,"num_write":1168,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'322","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:12.107988+0000","last_change":"2024-09-12T18:01:12.107915+0000","last_active":"2024-09-12T18:01:12.107988+0000","last_peered":"2024-09-12T18:01:12.107988+0000","last_clean":"2024-09-12T18:01:12.107988+0000","last_became_active":"2024-09-12T17:21:50.755454+0000","last_became_peered":"2024-09-12T17:21:50.755454+0000","last_unstale":"2024-09-12T18:01:12.107988+0000","last_undegraded":"2024-09-12T18:01:12.107988+0000","last_fullsized":"2024-09-12T18:01:12.107988+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T18:01:12.107785+0000","last_clean_scrub_stamp":"2024-09-12T18:01:12.107785+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:13.904898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287371,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":72608,"num_write":1086,"num_write_kb":41613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.042756+0000","last_change":"2024-09-12T18:01:27.042699+0000","last_active":"2024-09-12T18:01:27.042756+0000","last_peered":"2024-09-12T18:01:27.042756+0000","last_clean":"2024-09-12T18:01:27.042756+0000","last_became_active":"2024-09-12T17:21:54.750099+0000","last_became_peered":"2024-09-12T17:21:54.750099+0000","last_unstale":"2024-09-12T18:01:27.042756+0000","last_undegraded":"2024-09-12T18:01:27.042756+0000","last_fullsized":"2024-09-12T18:01:27.042756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.042611+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.042611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:44.161430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'242","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.417943+0000","last_change":"2024-09-12T18:01:35.417943+0000","last_active":"2024-09-12T18:01:35.417943+0000","last_peered":"2024-09-12T18:01:35.417943+0000","last_clean":"2024-09-12T18:01:35.417943+0000","last_became_active":"2024-09-12T17:21:56.768088+0000","last_became_peered":"2024-09-12T17:21:56.768088+0000","last_unstale":"2024-09-12T18:01:35.417943+0000","last_undegraded":"2024-09-12T18:01:35.417943+0000","last_fullsized":"2024-09-12T18:01:35.417943+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T18:01:35.417842+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T18:01:35.417842+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.417842+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.551863+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18914,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":895,"num_write":312,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.297982+0000","last_change":"2024-09-12T18:01:32.297910+0000","last_active":"2024-09-12T18:01:32.297982+0000","last_peered":"2024-09-12T18:01:32.297982+0000","last_clean":"2024-09-12T18:01:32.297982+0000","last_became_active":"2024-09-12T17:21:58.783769+0000","last_became_peered":"2024-09-12T17:21:58.783769+0000","last_unstale":"2024-09-12T18:01:32.297982+0000","last_undegraded":"2024-09-12T18:01:32.297982+0000","last_fullsized":"2024-09-12T18:01:32.297982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:32.297821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:32.297821+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.297821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:48.366526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'115","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:53.765281+0000","last_change":"2024-09-12T18:01:53.765281+0000","last_active":"2024-09-12T18:01:53.765281+0000","last_peered":"2024-09-12T18:01:53.765281+0000","last_clean":"2024-09-12T18:01:53.765281+0000","last_became_active":"2024-09-12T17:22:00.796053+0000","last_became_peered":"2024-09-12T17:22:00.796053+0000","last_unstale":"2024-09-12T18:01:53.765281+0000","last_undegraded":"2024-09-12T18:01:53.765281+0000","last_fullsized":"2024-09-12T18:01:53.765281+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T18:01:53.765207+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T18:01:53.765207+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.765207+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:28.894584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'490","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.896430+0000","last_change":"2024-09-12T18:01:23.896366+0000","last_active":"2024-09-12T18:01:23.896430+0000","last_peered":"2024-09-12T18:01:23.896430+0000","last_clean":"2024-09-12T18:01:23.896430+0000","last_became_active":"2024-09-12T17:21:52.746910+0000","last_became_peered":"2024-09-12T17:21:52.746910+0000","last_unstale":"2024-09-12T18:01:23.896430+0000","last_undegraded":"2024-09-12T18:01:23.896430+0000","last_fullsized":"2024-09-12T18:01:23.896430+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'490","last_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_deep_scrub":"265'490","last_deep_scrub_stamp":"2024-09-12T18:01:23.896262+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.896262+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.890695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2616,"num_read_kb":2462,"num_write":609,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'316","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.847830+0000","last_change":"2024-09-12T18:01:17.847748+0000","last_active":"2024-09-12T18:01:17.847830+0000","last_peered":"2024-09-12T18:01:17.847830+0000","last_clean":"2024-09-12T18:01:17.847830+0000","last_became_active":"2024-09-12T17:21:50.760411+0000","last_became_peered":"2024-09-12T17:21:50.760411+0000","last_unstale":"2024-09-12T18:01:17.847830+0000","last_undegraded":"2024-09-12T18:01:17.847830+0000","last_fullsized":"2024-09-12T18:01:17.847830+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:17.847650+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.847650+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:25.676928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170477,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":22007,"num_write":949,"num_write_kb":24177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.964300+0000","last_change":"2024-09-12T18:01:33.964235+0000","last_active":"2024-09-12T18:01:33.964300+0000","last_peered":"2024-09-12T18:01:33.964300+0000","last_clean":"2024-09-12T18:01:33.964300+0000","last_became_active":"2024-09-12T17:21:54.755398+0000","last_became_peered":"2024-09-12T17:21:54.755398+0000","last_unstale":"2024-09-12T18:01:33.964300+0000","last_undegraded":"2024-09-12T18:01:33.964300+0000","last_fullsized":"2024-09-12T18:01:33.964300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:33.964138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:33.964138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.964138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:57.373932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'85","reported_seq":607,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:46.746655+0000","last_change":"2024-09-12T18:01:46.746573+0000","last_active":"2024-09-12T18:01:46.746655+0000","last_peered":"2024-09-12T18:01:46.746655+0000","last_clean":"2024-09-12T18:01:46.746655+0000","last_became_active":"2024-09-12T17:21:56.760084+0000","last_became_peered":"2024-09-12T17:21:56.760084+0000","last_unstale":"2024-09-12T18:01:46.746655+0000","last_undegraded":"2024-09-12T18:01:46.746655+0000","last_fullsized":"2024-09-12T18:01:46.746655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-12T18:01:46.746473+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-12T18:01:46.746473+0000","last_clean_scrub_stamp":"2024-09-12T18:01:46.746473+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:20.211628+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":58,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'757","reported_seq":2443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:33.846889+0000","last_change":"2024-09-12T18:01:33.846792+0000","last_active":"2024-09-12T18:01:33.846889+0000","last_peered":"2024-09-12T18:01:33.846889+0000","last_clean":"2024-09-12T18:01:33.846889+0000","last_became_active":"2024-09-12T17:21:58.782935+0000","last_became_peered":"2024-09-12T17:21:58.782935+0000","last_unstale":"2024-09-12T18:01:33.846889+0000","last_undegraded":"2024-09-12T18:01:33.846889+0000","last_fullsized":"2024-09-12T18:01:33.846889+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'757","last_scrub_stamp":"2024-09-12T18:01:33.846694+0000","last_deep_scrub":"265'757","last_deep_scrub_stamp":"2024-09-12T18:01:33.846694+0000","last_clean_scrub_stamp":"2024-09-12T18:01:33.846694+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.845076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'112","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:52.803734+0000","last_change":"2024-09-12T18:01:52.803734+0000","last_active":"2024-09-12T18:01:52.803734+0000","last_peered":"2024-09-12T18:01:52.803734+0000","last_clean":"2024-09-12T18:01:52.803734+0000","last_became_active":"2024-09-12T17:22:00.792113+0000","last_became_peered":"2024-09-12T17:22:00.792113+0000","last_unstale":"2024-09-12T18:01:52.803734+0000","last_undegraded":"2024-09-12T18:01:52.803734+0000","last_fullsized":"2024-09-12T18:01:52.803734+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T18:01:52.803666+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T18:01:52.803666+0000","last_clean_scrub_stamp":"2024-09-12T18:01:52.803666+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:10.791317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":256,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'473","reported_seq":2107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.009089+0000","last_change":"2024-09-12T18:01:24.009007+0000","last_active":"2024-09-12T18:01:24.009089+0000","last_peered":"2024-09-12T18:01:24.009089+0000","last_clean":"2024-09-12T18:01:24.009089+0000","last_became_active":"2024-09-12T17:21:52.751079+0000","last_became_peered":"2024-09-12T17:21:52.751079+0000","last_unstale":"2024-09-12T18:01:24.009089+0000","last_undegraded":"2024-09-12T18:01:24.009089+0000","last_fullsized":"2024-09-12T18:01:24.009089+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:24.008914+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.008914+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:34.013264+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2576,"num_read_kb":2428,"num_write":571,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'343","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.091118+0000","last_change":"2024-09-12T18:01:10.091066+0000","last_active":"2024-09-12T18:01:10.091118+0000","last_peered":"2024-09-12T18:01:10.091118+0000","last_clean":"2024-09-12T18:01:10.091118+0000","last_became_active":"2024-09-12T17:21:50.768288+0000","last_became_peered":"2024-09-12T17:21:50.768288+0000","last_unstale":"2024-09-12T18:01:10.091118+0000","last_undegraded":"2024-09-12T18:01:10.091118+0000","last_fullsized":"2024-09-12T18:01:10.091118+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T18:01:10.090952+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.090952+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:28.293870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2782938,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":20563,"num_write":1073,"num_write_kb":31639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:27.245452+0000","last_change":"2024-09-12T18:01:27.245348+0000","last_active":"2024-09-12T18:01:27.245452+0000","last_peered":"2024-09-12T18:01:27.245452+0000","last_clean":"2024-09-12T18:01:27.245452+0000","last_became_active":"2024-09-12T17:21:54.752112+0000","last_became_peered":"2024-09-12T17:21:54.752112+0000","last_unstale":"2024-09-12T18:01:27.245452+0000","last_undegraded":"2024-09-12T18:01:27.245452+0000","last_fullsized":"2024-09-12T18:01:27.245452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:27.245239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:27.245239+0000","last_clean_scrub_stamp":"2024-09-12T18:01:27.245239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:24.543748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'302","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.781142+0000","last_change":"2024-09-12T18:01:30.781142+0000","last_active":"2024-09-12T18:01:30.781142+0000","last_peered":"2024-09-12T18:01:30.781142+0000","last_clean":"2024-09-12T18:01:30.781142+0000","last_became_active":"2024-09-12T17:21:56.771524+0000","last_became_peered":"2024-09-12T17:21:56.771524+0000","last_unstale":"2024-09-12T18:01:30.781142+0000","last_undegraded":"2024-09-12T18:01:30.781142+0000","last_fullsized":"2024-09-12T18:01:30.781142+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T18:01:30.781042+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T18:01:30.781042+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.781042+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:06.795378+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50539,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":1069,"num_write":390,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:43.973609+0000","last_change":"2024-09-12T18:01:43.973609+0000","last_active":"2024-09-12T18:01:43.973609+0000","last_peered":"2024-09-12T18:01:43.973609+0000","last_clean":"2024-09-12T18:01:43.973609+0000","last_became_active":"2024-09-12T17:21:58.789581+0000","last_became_peered":"2024-09-12T17:21:58.789581+0000","last_unstale":"2024-09-12T18:01:43.973609+0000","last_undegraded":"2024-09-12T18:01:43.973609+0000","last_fullsized":"2024-09-12T18:01:43.973609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.973531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.973531+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.973531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:16.451484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'141","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.324434+0000","last_change":"2024-09-12T18:01:38.324434+0000","last_active":"2024-09-12T18:01:38.324434+0000","last_peered":"2024-09-12T18:01:38.324434+0000","last_clean":"2024-09-12T18:01:38.324434+0000","last_became_active":"2024-09-12T17:22:00.793972+0000","last_became_peered":"2024-09-12T17:22:00.793972+0000","last_unstale":"2024-09-12T18:01:38.324434+0000","last_undegraded":"2024-09-12T18:01:38.324434+0000","last_fullsized":"2024-09-12T18:01:38.324434+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'141","last_scrub_stamp":"2024-09-12T18:01:38.324354+0000","last_deep_scrub":"265'141","last_deep_scrub_stamp":"2024-09-12T18:01:38.324354+0000","last_clean_scrub_stamp":"2024-09-12T18:01:38.324354+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:23.213982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":213,"num_write":330,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'473","reported_seq":2090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.961585+0000","last_change":"2024-09-12T18:01:21.961531+0000","last_active":"2024-09-12T18:01:21.961585+0000","last_peered":"2024-09-12T18:01:21.961585+0000","last_clean":"2024-09-12T18:01:21.961585+0000","last_became_active":"2024-09-12T17:21:52.746251+0000","last_became_peered":"2024-09-12T17:21:52.746251+0000","last_unstale":"2024-09-12T18:01:21.961585+0000","last_undegraded":"2024-09-12T18:01:21.961585+0000","last_fullsized":"2024-09-12T18:01:21.961585+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T18:01:21.961440+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.961440+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:47.473255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2568,"num_read_kb":2413,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1157,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'336","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.486384+0000","last_change":"2024-09-12T18:01:22.486325+0000","last_active":"2024-09-12T18:01:22.486384+0000","last_peered":"2024-09-12T18:01:22.486384+0000","last_clean":"2024-09-12T18:01:22.486384+0000","last_became_active":"2024-09-12T17:21:50.769254+0000","last_became_peered":"2024-09-12T17:21:50.769254+0000","last_unstale":"2024-09-12T18:01:22.486384+0000","last_undegraded":"2024-09-12T18:01:22.486384+0000","last_fullsized":"2024-09-12T18:01:22.486384+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T18:01:22.486194+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.486194+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:40.467598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524502,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":60843,"num_write":1102,"num_write_kb":32503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.003042+0000","last_change":"2024-09-12T18:01:25.002984+0000","last_active":"2024-09-12T18:01:25.003042+0000","last_peered":"2024-09-12T18:01:25.003042+0000","last_clean":"2024-09-12T18:01:25.003042+0000","last_became_active":"2024-09-12T17:21:54.754386+0000","last_became_peered":"2024-09-12T17:21:54.754386+0000","last_unstale":"2024-09-12T18:01:25.003042+0000","last_undegraded":"2024-09-12T18:01:25.003042+0000","last_fullsized":"2024-09-12T18:01:25.003042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:25.002885+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.002885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:05.311567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'257","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:39.869369+0000","last_change":"2024-09-12T18:01:39.869369+0000","last_active":"2024-09-12T18:01:39.869369+0000","last_peered":"2024-09-12T18:01:39.869369+0000","last_clean":"2024-09-12T18:01:39.869369+0000","last_became_active":"2024-09-12T17:21:56.763756+0000","last_became_peered":"2024-09-12T17:21:56.763756+0000","last_unstale":"2024-09-12T18:01:39.869369+0000","last_undegraded":"2024-09-12T18:01:39.869369+0000","last_fullsized":"2024-09-12T18:01:39.869369+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'257","last_scrub_stamp":"2024-09-12T18:01:39.869274+0000","last_deep_scrub":"265'257","last_deep_scrub_stamp":"2024-09-12T18:01:39.869274+0000","last_clean_scrub_stamp":"2024-09-12T18:01:39.869274+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.853239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":1004,"num_write":346,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.757217+0000","last_change":"2024-09-12T18:01:49.757217+0000","last_active":"2024-09-12T18:01:49.757217+0000","last_peered":"2024-09-12T18:01:49.757217+0000","last_clean":"2024-09-12T18:01:49.757217+0000","last_became_active":"2024-09-12T17:21:58.783402+0000","last_became_peered":"2024-09-12T17:21:58.783402+0000","last_unstale":"2024-09-12T18:01:49.757217+0000","last_undegraded":"2024-09-12T18:01:49.757217+0000","last_fullsized":"2024-09-12T18:01:49.757217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.757114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.757114+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.757114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:54.659133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'104","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.144979+0000","last_change":"2024-09-12T18:01:49.144979+0000","last_active":"2024-09-12T18:01:49.144979+0000","last_peered":"2024-09-12T18:01:49.144979+0000","last_clean":"2024-09-12T18:01:49.144979+0000","last_became_active":"2024-09-12T17:22:00.798396+0000","last_became_peered":"2024-09-12T17:22:00.798396+0000","last_unstale":"2024-09-12T18:01:49.144979+0000","last_undegraded":"2024-09-12T18:01:49.144979+0000","last_fullsized":"2024-09-12T18:01:49.144979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T18:01:49.144861+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T18:01:49.144861+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.144861+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:04.908407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":245,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'915","reported_seq":2526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.460129+0000","last_change":"2024-09-12T18:01:17.460129+0000","last_active":"2024-09-12T18:01:17.460129+0000","last_peered":"2024-09-12T18:01:17.460129+0000","last_clean":"2024-09-12T18:01:17.460129+0000","last_became_active":"2024-09-12T17:21:52.749944+0000","last_became_peered":"2024-09-12T17:21:52.749944+0000","last_unstale":"2024-09-12T18:01:17.460129+0000","last_undegraded":"2024-09-12T18:01:17.460129+0000","last_fullsized":"2024-09-12T18:01:17.460129+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'915","last_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_deep_scrub":"265'915","last_deep_scrub_stamp":"2024-09-12T18:01:17.460034+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.460034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:51.385437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4440,"num_read_kb":3970,"num_write":1236,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'398","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.993380+0000","last_change":"2024-09-12T18:01:15.993319+0000","last_active":"2024-09-12T18:01:15.993380+0000","last_peered":"2024-09-12T18:01:15.993380+0000","last_clean":"2024-09-12T18:01:15.993380+0000","last_became_active":"2024-09-12T17:21:50.746664+0000","last_became_peered":"2024-09-12T17:21:50.746664+0000","last_unstale":"2024-09-12T18:01:15.993380+0000","last_undegraded":"2024-09-12T18:01:15.993380+0000","last_fullsized":"2024-09-12T18:01:15.993380+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T18:01:15.993142+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.993142+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:46.642090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645063,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":663,"num_read_kb":67994,"num_write":1237,"num_write_kb":29290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.260638+0000","last_change":"2024-09-12T18:01:26.260638+0000","last_active":"2024-09-12T18:01:26.260638+0000","last_peered":"2024-09-12T18:01:26.260638+0000","last_clean":"2024-09-12T18:01:26.260638+0000","last_became_active":"2024-09-12T17:21:54.750462+0000","last_became_peered":"2024-09-12T17:21:54.750462+0000","last_unstale":"2024-09-12T18:01:26.260638+0000","last_undegraded":"2024-09-12T18:01:26.260638+0000","last_fullsized":"2024-09-12T18:01:26.260638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:26.260550+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.260550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:54.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'232","reported_seq":793,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.335908+0000","last_change":"2024-09-12T18:01:32.335831+0000","last_active":"2024-09-12T18:01:32.335908+0000","last_peered":"2024-09-12T18:01:32.335908+0000","last_clean":"2024-09-12T18:01:32.335908+0000","last_became_active":"2024-09-12T17:21:56.763649+0000","last_became_peered":"2024-09-12T17:21:56.763649+0000","last_unstale":"2024-09-12T18:01:32.335908+0000","last_undegraded":"2024-09-12T18:01:32.335908+0000","last_fullsized":"2024-09-12T18:01:32.335908+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'232","last_scrub_stamp":"2024-09-12T18:01:32.335737+0000","last_deep_scrub":"265'232","last_deep_scrub_stamp":"2024-09-12T18:01:32.335737+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.335737+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":330,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.765562+0000","last_change":"2024-09-12T18:01:50.765502+0000","last_active":"2024-09-12T18:01:50.765562+0000","last_peered":"2024-09-12T18:01:50.765562+0000","last_clean":"2024-09-12T18:01:50.765562+0000","last_became_active":"2024-09-12T17:21:58.789506+0000","last_became_peered":"2024-09-12T17:21:58.789506+0000","last_unstale":"2024-09-12T18:01:50.765562+0000","last_undegraded":"2024-09-12T18:01:50.765562+0000","last_fullsized":"2024-09-12T18:01:50.765562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:50.765322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:50.765322+0000","last_clean_scrub_stamp":"2024-09-12T18:01:50.765322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:21.226314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'222","reported_seq":1329,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.820494+0000","last_change":"2024-09-12T18:01:55.820494+0000","last_active":"2024-09-12T18:01:55.820494+0000","last_peered":"2024-09-12T18:01:55.820494+0000","last_clean":"2024-09-12T18:01:55.820494+0000","last_became_active":"2024-09-12T17:22:00.798089+0000","last_became_peered":"2024-09-12T17:22:00.798089+0000","last_unstale":"2024-09-12T18:01:55.820494+0000","last_undegraded":"2024-09-12T18:01:55.820494+0000","last_fullsized":"2024-09-12T18:01:55.820494+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-12T18:01:55.820399+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-12T18:01:55.820399+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.820399+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:18.753999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":834,"num_read_kb":827,"num_write":507,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'869","reported_seq":2394,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:20.999269+0000","last_change":"2024-09-12T18:01:20.999269+0000","last_active":"2024-09-12T18:01:20.999269+0000","last_peered":"2024-09-12T18:01:20.999269+0000","last_clean":"2024-09-12T18:01:20.999269+0000","last_became_active":"2024-09-12T17:21:52.737482+0000","last_became_peered":"2024-09-12T17:21:52.737482+0000","last_unstale":"2024-09-12T18:01:20.999269+0000","last_undegraded":"2024-09-12T18:01:20.999269+0000","last_fullsized":"2024-09-12T18:01:20.999269+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'869","last_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_deep_scrub":"265'869","last_deep_scrub_stamp":"2024-09-12T18:01:20.999172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:20.999172+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:58.536428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4082,"num_read_kb":3636,"num_write":1196,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'354","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.014469+0000","last_change":"2024-09-12T18:01:17.014403+0000","last_active":"2024-09-12T18:01:17.014469+0000","last_peered":"2024-09-12T18:01:17.014469+0000","last_clean":"2024-09-12T18:01:17.014469+0000","last_became_active":"2024-09-12T17:21:50.754572+0000","last_became_peered":"2024-09-12T17:21:50.754572+0000","last_unstale":"2024-09-12T18:01:17.014469+0000","last_undegraded":"2024-09-12T18:01:17.014469+0000","last_fullsized":"2024-09-12T18:01:17.014469+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:17.014256+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.014256+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:50.373551+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3457436,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":16565,"num_write":1099,"num_write_kb":22396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.964824+0000","last_change":"2024-09-12T18:01:32.964824+0000","last_active":"2024-09-12T18:01:32.964824+0000","last_peered":"2024-09-12T18:01:32.964824+0000","last_clean":"2024-09-12T18:01:32.964824+0000","last_became_active":"2024-09-12T17:21:54.758596+0000","last_became_peered":"2024-09-12T17:21:54.758596+0000","last_unstale":"2024-09-12T18:01:32.964824+0000","last_undegraded":"2024-09-12T18:01:32.964824+0000","last_fullsized":"2024-09-12T18:01:32.964824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:01:32.964708+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:01:32.964708+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.964708+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:36.523562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'297","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.713066+0000","last_change":"2024-09-12T18:01:45.712978+0000","last_active":"2024-09-12T18:01:45.713066+0000","last_peered":"2024-09-12T18:01:45.713066+0000","last_clean":"2024-09-12T18:01:45.713066+0000","last_became_active":"2024-09-12T17:21:56.769495+0000","last_became_peered":"2024-09-12T17:21:56.769495+0000","last_unstale":"2024-09-12T18:01:45.713066+0000","last_undegraded":"2024-09-12T18:01:45.713066+0000","last_fullsized":"2024-09-12T18:01:45.713066+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T18:01:45.712884+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T18:01:45.712884+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.712884+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:30.618856+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1131,"num_write":404,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:45.023260+0000","last_change":"2024-09-12T18:01:45.023206+0000","last_active":"2024-09-12T18:01:45.023260+0000","last_peered":"2024-09-12T18:01:45.023260+0000","last_clean":"2024-09-12T18:01:45.023260+0000","last_became_active":"2024-09-12T17:21:58.782340+0000","last_became_peered":"2024-09-12T17:21:58.782340+0000","last_unstale":"2024-09-12T18:01:45.023260+0000","last_undegraded":"2024-09-12T18:01:45.023260+0000","last_fullsized":"2024-09-12T18:01:45.023260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:45.023118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:45.023118+0000","last_clean_scrub_stamp":"2024-09-12T18:01:45.023118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:15.850247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'138","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.804948+0000","last_change":"2024-09-12T18:01:32.804887+0000","last_active":"2024-09-12T18:01:32.804948+0000","last_peered":"2024-09-12T18:01:32.804948+0000","last_clean":"2024-09-12T18:01:32.804948+0000","last_became_active":"2024-09-12T17:22:00.796207+0000","last_became_peered":"2024-09-12T17:22:00.796207+0000","last_unstale":"2024-09-12T18:01:32.804948+0000","last_undegraded":"2024-09-12T18:01:32.804948+0000","last_fullsized":"2024-09-12T18:01:32.804948+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T18:01:32.804809+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T18:01:32.804809+0000","last_clean_scrub_stamp":"2024-09-12T18:01:32.804809+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.756403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'780","reported_seq":2434,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.908292+0000","last_change":"2024-09-12T18:01:22.908292+0000","last_active":"2024-09-12T18:01:22.908292+0000","last_peered":"2024-09-12T18:01:22.908292+0000","last_clean":"2024-09-12T18:01:22.908292+0000","last_became_active":"2024-09-12T17:21:52.741996+0000","last_became_peered":"2024-09-12T17:21:52.741996+0000","last_unstale":"2024-09-12T18:01:22.908292+0000","last_undegraded":"2024-09-12T18:01:22.908292+0000","last_fullsized":"2024-09-12T18:01:22.908292+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'780","last_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_deep_scrub":"265'780","last_deep_scrub_stamp":"2024-09-12T18:01:22.908162+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.908162+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.242029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3934,"num_read_kb":3572,"num_write":1006,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'369","reported_seq":1077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:11.916743+0000","last_change":"2024-09-12T18:01:11.916679+0000","last_active":"2024-09-12T18:01:11.916743+0000","last_peered":"2024-09-12T18:01:11.916743+0000","last_clean":"2024-09-12T18:01:11.916743+0000","last_became_active":"2024-09-12T17:21:50.764475+0000","last_became_peered":"2024-09-12T17:21:50.764475+0000","last_unstale":"2024-09-12T18:01:11.916743+0000","last_undegraded":"2024-09-12T18:01:11.916743+0000","last_fullsized":"2024-09-12T18:01:11.916743+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T18:01:11.916584+0000","last_clean_scrub_stamp":"2024-09-12T18:01:11.916584+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:14.976183+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6259488,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":161127,"num_write":1137,"num_write_kb":69496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'471","reported_seq":1788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.450694+0000","last_change":"2024-09-12T18:01:18.450694+0000","last_active":"2024-09-12T18:01:18.450694+0000","last_peered":"2024-09-12T18:01:18.450694+0000","last_clean":"2024-09-12T18:01:18.450694+0000","last_became_active":"2024-09-12T17:21:52.752749+0000","last_became_peered":"2024-09-12T17:21:52.752749+0000","last_unstale":"2024-09-12T18:01:18.450694+0000","last_undegraded":"2024-09-12T18:01:18.450694+0000","last_fullsized":"2024-09-12T18:01:18.450694+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'471","last_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_deep_scrub":"265'471","last_deep_scrub_stamp":"2024-09-12T18:01:18.450603+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.450603+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.728665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2442,"num_read_kb":2221,"num_write":602,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'445","reported_seq":1133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.453039+0000","last_change":"2024-09-12T18:01:14.452969+0000","last_active":"2024-09-12T18:01:14.453039+0000","last_peered":"2024-09-12T18:01:14.453039+0000","last_clean":"2024-09-12T18:01:14.453039+0000","last_became_active":"2024-09-12T17:21:50.763075+0000","last_became_peered":"2024-09-12T17:21:50.763075+0000","last_unstale":"2024-09-12T18:01:14.453039+0000","last_undegraded":"2024-09-12T18:01:14.453039+0000","last_fullsized":"2024-09-12T18:01:14.453039+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-12T18:01:14.452866+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.452866+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:29.422563+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190265,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":23221,"num_write":1306,"num_write_kb":34125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'806","reported_seq":2443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:35.622061+0000","last_change":"2024-09-12T18:01:35.622061+0000","last_active":"2024-09-12T18:01:35.622061+0000","last_peered":"2024-09-12T18:01:35.622061+0000","last_clean":"2024-09-12T18:01:35.622061+0000","last_became_active":"2024-09-12T17:21:52.749821+0000","last_became_peered":"2024-09-12T17:21:52.749821+0000","last_unstale":"2024-09-12T18:01:35.622061+0000","last_undegraded":"2024-09-12T18:01:35.622061+0000","last_fullsized":"2024-09-12T18:01:35.622061+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T18:01:35.621952+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T18:01:35.621952+0000","last_clean_scrub_stamp":"2024-09-12T18:01:35.621952+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:27.209847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3927,"num_read_kb":3557,"num_write":1064,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'376","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.484407+0000","last_change":"2024-09-12T18:01:19.484338+0000","last_active":"2024-09-12T18:01:19.484407+0000","last_peered":"2024-09-12T18:01:19.484407+0000","last_clean":"2024-09-12T18:01:19.484407+0000","last_became_active":"2024-09-12T17:21:50.763643+0000","last_became_peered":"2024-09-12T17:21:50.763643+0000","last_unstale":"2024-09-12T18:01:19.484407+0000","last_undegraded":"2024-09-12T18:01:19.484407+0000","last_fullsized":"2024-09-12T18:01:19.484407+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T18:01:19.484172+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.484172+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:45.726748+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":33088,"num_write":1180,"num_write_kb":48246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'922","reported_seq":2569,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:31.164426+0000","last_change":"2024-09-12T18:01:31.164426+0000","last_active":"2024-09-12T18:01:31.164426+0000","last_peered":"2024-09-12T18:01:31.164426+0000","last_clean":"2024-09-12T18:01:31.164426+0000","last_became_active":"2024-09-12T17:21:52.751419+0000","last_became_peered":"2024-09-12T17:21:52.751419+0000","last_unstale":"2024-09-12T18:01:31.164426+0000","last_undegraded":"2024-09-12T18:01:31.164426+0000","last_fullsized":"2024-09-12T18:01:31.164426+0000","mapping_epoch":27,"log_start":"265'900","ondisk_log_start":"265'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'922","last_scrub_stamp":"2024-09-12T18:01:31.164340+0000","last_deep_scrub":"265'922","last_deep_scrub_stamp":"2024-09-12T18:01:31.164340+0000","last_clean_scrub_stamp":"2024-09-12T18:01:31.164340+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:02.147024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3962,"num_write":1229,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1530,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'403","reported_seq":1103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.983825+0000","last_change":"2024-09-12T18:01:18.983754+0000","last_active":"2024-09-12T18:01:18.983825+0000","last_peered":"2024-09-12T18:01:18.983825+0000","last_clean":"2024-09-12T18:01:18.983825+0000","last_became_active":"2024-09-12T17:21:50.769338+0000","last_became_peered":"2024-09-12T17:21:50.769338+0000","last_unstale":"2024-09-12T18:01:18.983825+0000","last_undegraded":"2024-09-12T18:01:18.983825+0000","last_fullsized":"2024-09-12T18:01:18.983825+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T18:01:18.983615+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.983615+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:27.019267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254923,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":28930,"num_write":1343,"num_write_kb":31701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'505","reported_seq":2112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.149749+0000","last_change":"2024-09-12T18:01:29.149657+0000","last_active":"2024-09-12T18:01:29.149749+0000","last_peered":"2024-09-12T18:01:29.149749+0000","last_clean":"2024-09-12T18:01:29.149749+0000","last_became_active":"2024-09-12T17:21:52.749768+0000","last_became_peered":"2024-09-12T17:21:52.749768+0000","last_unstale":"2024-09-12T18:01:29.149749+0000","last_undegraded":"2024-09-12T18:01:29.149749+0000","last_fullsized":"2024-09-12T18:01:29.149749+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T18:01:29.149537+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T18:01:29.149537+0000","last_clean_scrub_stamp":"2024-09-12T18:01:29.149537+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:59.837592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2442,"num_write":595,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'354","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.211578+0000","last_change":"2024-09-12T18:01:15.211578+0000","last_active":"2024-09-12T18:01:15.211578+0000","last_peered":"2024-09-12T18:01:15.211578+0000","last_clean":"2024-09-12T18:01:15.211578+0000","last_became_active":"2024-09-12T17:21:50.777085+0000","last_became_peered":"2024-09-12T17:21:50.777085+0000","last_unstale":"2024-09-12T18:01:15.211578+0000","last_undegraded":"2024-09-12T18:01:15.211578+0000","last_fullsized":"2024-09-12T18:01:15.211578+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T18:01:15.211486+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.211486+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:31.451040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":85437,"num_write":1070,"num_write_kb":41477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'465","reported_seq":1967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.678003+0000","last_change":"2024-09-12T18:01:19.677935+0000","last_active":"2024-09-12T18:01:19.678003+0000","last_peered":"2024-09-12T18:01:19.678003+0000","last_clean":"2024-09-12T18:01:19.678003+0000","last_became_active":"2024-09-12T17:21:52.747288+0000","last_became_peered":"2024-09-12T17:21:52.747288+0000","last_unstale":"2024-09-12T18:01:19.678003+0000","last_undegraded":"2024-09-12T18:01:19.678003+0000","last_fullsized":"2024-09-12T18:01:19.678003+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'465","last_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_deep_scrub":"265'465","last_deep_scrub_stamp":"2024-09-12T18:01:19.677819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.677819+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:45.594108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2340,"num_read_kb":2183,"num_write":556,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'299","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.273285+0000","last_change":"2024-09-12T18:01:17.273285+0000","last_active":"2024-09-12T18:01:17.273285+0000","last_peered":"2024-09-12T18:01:17.273285+0000","last_clean":"2024-09-12T18:01:17.273285+0000","last_became_active":"2024-09-12T17:21:50.777064+0000","last_became_peered":"2024-09-12T17:21:50.777064+0000","last_unstale":"2024-09-12T18:01:17.273285+0000","last_undegraded":"2024-09-12T18:01:17.273285+0000","last_fullsized":"2024-09-12T18:01:17.273285+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T18:01:17.273168+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.273168+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.449887+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830346,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":83513,"num_write":1029,"num_write_kb":35141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'602","reported_seq":2282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.265910+0000","last_change":"2024-09-12T18:01:21.265850+0000","last_active":"2024-09-12T18:01:21.265910+0000","last_peered":"2024-09-12T18:01:21.265910+0000","last_clean":"2024-09-12T18:01:21.265910+0000","last_became_active":"2024-09-12T17:21:52.753800+0000","last_became_peered":"2024-09-12T17:21:52.753800+0000","last_unstale":"2024-09-12T18:01:21.265910+0000","last_undegraded":"2024-09-12T18:01:21.265910+0000","last_fullsized":"2024-09-12T18:01:21.265910+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'602","last_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_deep_scrub":"265'602","last_deep_scrub_stamp":"2024-09-12T18:01:21.265759+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.265759+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:25.389513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3193,"num_read_kb":2940,"num_write":789,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:13.921972+0000","last_change":"2024-09-12T18:01:13.921972+0000","last_active":"2024-09-12T18:01:13.921972+0000","last_peered":"2024-09-12T18:01:13.921972+0000","last_clean":"2024-09-12T18:01:13.921972+0000","last_became_active":"2024-09-12T17:21:50.768712+0000","last_became_peered":"2024-09-12T17:21:50.768712+0000","last_unstale":"2024-09-12T18:01:13.921972+0000","last_undegraded":"2024-09-12T18:01:13.921972+0000","last_fullsized":"2024-09-12T18:01:13.921972+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T18:01:13.921810+0000","last_clean_scrub_stamp":"2024-09-12T18:01:13.921810+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:44.545643+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190292,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":100979,"num_write":1090,"num_write_kb":26798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'368","reported_seq":1828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:16.198574+0000","last_change":"2024-09-12T18:01:16.198505+0000","last_active":"2024-09-12T18:01:16.198574+0000","last_peered":"2024-09-12T18:01:16.198574+0000","last_clean":"2024-09-12T18:01:16.198574+0000","last_became_active":"2024-09-12T17:21:52.752246+0000","last_became_peered":"2024-09-12T17:21:52.752246+0000","last_unstale":"2024-09-12T18:01:16.198574+0000","last_undegraded":"2024-09-12T18:01:16.198574+0000","last_fullsized":"2024-09-12T18:01:16.198574+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T18:01:16.198407+0000","last_clean_scrub_stamp":"2024-09-12T18:01:16.198407+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:23.007746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1950,"num_read_kb":1877,"num_write":406,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'356","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.018330+0000","last_change":"2024-09-12T18:01:18.018330+0000","last_active":"2024-09-12T18:01:18.018330+0000","last_peered":"2024-09-12T18:01:18.018330+0000","last_clean":"2024-09-12T18:01:18.018330+0000","last_became_active":"2024-09-12T17:21:50.770828+0000","last_became_peered":"2024-09-12T17:21:50.770828+0000","last_unstale":"2024-09-12T18:01:18.018330+0000","last_undegraded":"2024-09-12T18:01:18.018330+0000","last_fullsized":"2024-09-12T18:01:18.018330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:18.018155+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.018155+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:21.152485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262264,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":460,"num_read_kb":5744,"num_write":1173,"num_write_kb":35079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'856","reported_seq":2406,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.408676+0000","last_change":"2024-09-12T18:01:19.408597+0000","last_active":"2024-09-12T18:01:19.408676+0000","last_peered":"2024-09-12T18:01:19.408676+0000","last_clean":"2024-09-12T18:01:19.408676+0000","last_became_active":"2024-09-12T17:21:52.754700+0000","last_became_peered":"2024-09-12T17:21:52.754700+0000","last_unstale":"2024-09-12T18:01:19.408676+0000","last_undegraded":"2024-09-12T18:01:19.408676+0000","last_fullsized":"2024-09-12T18:01:19.408676+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'856","last_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_deep_scrub":"265'856","last_deep_scrub_stamp":"2024-09-12T18:01:19.408502+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.408502+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:03.521178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4203,"num_read_kb":3771,"num_write":1219,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'380","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.531186+0000","last_change":"2024-09-12T18:01:23.531186+0000","last_active":"2024-09-12T18:01:23.531186+0000","last_peered":"2024-09-12T18:01:23.531186+0000","last_clean":"2024-09-12T18:01:23.531186+0000","last_became_active":"2024-09-12T17:21:50.765802+0000","last_became_peered":"2024-09-12T17:21:50.765802+0000","last_unstale":"2024-09-12T18:01:23.531186+0000","last_undegraded":"2024-09-12T18:01:23.531186+0000","last_fullsized":"2024-09-12T18:01:23.531186+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T18:01:23.531029+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.531029+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:11.136174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49301,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":612,"num_read_kb":751,"num_write":1265,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'639","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.670363+0000","last_change":"2024-09-12T18:01:17.670293+0000","last_active":"2024-09-12T18:01:17.670363+0000","last_peered":"2024-09-12T18:01:17.670363+0000","last_clean":"2024-09-12T18:01:17.670363+0000","last_became_active":"2024-09-12T17:21:52.752034+0000","last_became_peered":"2024-09-12T17:21:52.752034+0000","last_unstale":"2024-09-12T18:01:17.670363+0000","last_undegraded":"2024-09-12T18:01:17.670363+0000","last_fullsized":"2024-09-12T18:01:17.670363+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'639","last_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_deep_scrub":"265'639","last_deep_scrub_stamp":"2024-09-12T18:01:17.670204+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.670204+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:59.417673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2994,"num_read_kb":2757,"num_write":874,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'374","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.973528+0000","last_change":"2024-09-12T18:01:19.973451+0000","last_active":"2024-09-12T18:01:19.973528+0000","last_peered":"2024-09-12T18:01:19.973528+0000","last_clean":"2024-09-12T18:01:19.973528+0000","last_became_active":"2024-09-12T17:21:50.768833+0000","last_became_peered":"2024-09-12T17:21:50.768833+0000","last_unstale":"2024-09-12T18:01:19.973528+0000","last_undegraded":"2024-09-12T18:01:19.973528+0000","last_fullsized":"2024-09-12T18:01:19.973528+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T18:01:19.973298+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.973298+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:20.876852+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190224,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":620,"num_read_kb":17255,"num_write":1152,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'560","reported_seq":2040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:30.170840+0000","last_change":"2024-09-12T18:01:30.170760+0000","last_active":"2024-09-12T18:01:30.170840+0000","last_peered":"2024-09-12T18:01:30.170840+0000","last_clean":"2024-09-12T18:01:30.170840+0000","last_became_active":"2024-09-12T17:21:52.753550+0000","last_became_peered":"2024-09-12T17:21:52.753550+0000","last_unstale":"2024-09-12T18:01:30.170840+0000","last_undegraded":"2024-09-12T18:01:30.170840+0000","last_fullsized":"2024-09-12T18:01:30.170840+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T18:01:30.170670+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T18:01:30.170670+0000","last_clean_scrub_stamp":"2024-09-12T18:01:30.170670+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:25.830397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2494,"num_write":730,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'365","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:14.180506+0000","last_change":"2024-09-12T18:01:14.180439+0000","last_active":"2024-09-12T18:01:14.180506+0000","last_peered":"2024-09-12T18:01:14.180506+0000","last_clean":"2024-09-12T18:01:14.180506+0000","last_became_active":"2024-09-12T17:22:26.298867+0000","last_became_peered":"2024-09-12T17:22:26.298867+0000","last_unstale":"2024-09-12T18:01:14.180506+0000","last_undegraded":"2024-09-12T18:01:14.180506+0000","last_fullsized":"2024-09-12T18:01:14.180506+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:14.180323+0000","last_clean_scrub_stamp":"2024-09-12T18:01:14.180323+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:09.461777+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":563,"num_read_kb":8561,"num_write":1187,"num_write_kb":29245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'555","reported_seq":2168,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.185073+0000","last_change":"2024-09-12T18:01:19.185003+0000","last_active":"2024-09-12T18:01:19.185073+0000","last_peered":"2024-09-12T18:01:19.185073+0000","last_clean":"2024-09-12T18:01:19.185073+0000","last_became_active":"2024-09-12T17:21:52.749647+0000","last_became_peered":"2024-09-12T17:21:52.749647+0000","last_unstale":"2024-09-12T18:01:19.185073+0000","last_undegraded":"2024-09-12T18:01:19.185073+0000","last_fullsized":"2024-09-12T18:01:19.185073+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'555","last_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_deep_scrub":"265'555","last_deep_scrub_stamp":"2024-09-12T18:01:19.184900+0000","last_clean_scrub_stamp":"2024-09-12T18:01:19.184900+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:52.759777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2815,"num_read_kb":2599,"num_write":709,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'316","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.863597+0000","last_change":"2024-09-12T18:01:21.863501+0000","last_active":"2024-09-12T18:01:21.863597+0000","last_peered":"2024-09-12T18:01:21.863597+0000","last_clean":"2024-09-12T18:01:21.863597+0000","last_became_active":"2024-09-12T17:21:50.757354+0000","last_became_peered":"2024-09-12T17:21:50.757354+0000","last_unstale":"2024-09-12T18:01:21.863597+0000","last_undegraded":"2024-09-12T18:01:21.863597+0000","last_fullsized":"2024-09-12T18:01:21.863597+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T18:01:21.863390+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.863390+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:47.927583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":7270,"num_write":974,"num_write_kb":46404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'497","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.169966+0000","last_change":"2024-09-12T18:01:18.169868+0000","last_active":"2024-09-12T18:01:18.169966+0000","last_peered":"2024-09-12T18:01:18.169966+0000","last_clean":"2024-09-12T18:01:18.169966+0000","last_became_active":"2024-09-12T17:21:52.754697+0000","last_became_peered":"2024-09-12T17:21:52.754697+0000","last_unstale":"2024-09-12T18:01:18.169966+0000","last_undegraded":"2024-09-12T18:01:18.169966+0000","last_fullsized":"2024-09-12T18:01:18.169966+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'497","last_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_deep_scrub":"265'497","last_deep_scrub_stamp":"2024-09-12T18:01:18.169758+0000","last_clean_scrub_stamp":"2024-09-12T18:01:18.169758+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:34.271652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2719,"num_read_kb":2545,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'365","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:10.863500+0000","last_change":"2024-09-12T18:01:10.863401+0000","last_active":"2024-09-12T18:01:10.863500+0000","last_peered":"2024-09-12T18:01:10.863500+0000","last_clean":"2024-09-12T18:01:10.863500+0000","last_became_active":"2024-09-12T17:21:50.784585+0000","last_became_peered":"2024-09-12T17:21:50.784585+0000","last_unstale":"2024-09-12T18:01:10.863500+0000","last_undegraded":"2024-09-12T18:01:10.863500+0000","last_fullsized":"2024-09-12T18:01:10.863500+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T18:01:10.863281+0000","last_clean_scrub_stamp":"2024-09-12T18:01:10.863281+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:12.634167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":1811,"num_write":1218,"num_write_kb":22873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'760","reported_seq":2536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:23.499812+0000","last_change":"2024-09-12T18:01:23.499737+0000","last_active":"2024-09-12T18:01:23.499812+0000","last_peered":"2024-09-12T18:01:23.499812+0000","last_clean":"2024-09-12T18:01:23.499812+0000","last_became_active":"2024-09-12T17:21:52.750911+0000","last_became_peered":"2024-09-12T17:21:52.750911+0000","last_unstale":"2024-09-12T18:01:23.499812+0000","last_undegraded":"2024-09-12T18:01:23.499812+0000","last_fullsized":"2024-09-12T18:01:23.499812+0000","mapping_epoch":27,"log_start":"265'700","ondisk_log_start":"265'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'760","last_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_deep_scrub":"265'760","last_deep_scrub_stamp":"2024-09-12T18:01:23.499647+0000","last_clean_scrub_stamp":"2024-09-12T18:01:23.499647+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:40.989755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4011,"num_read_kb":3681,"num_write":980,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'339","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.596609+0000","last_change":"2024-09-12T18:01:26.596545+0000","last_active":"2024-09-12T18:01:26.596609+0000","last_peered":"2024-09-12T18:01:26.596609+0000","last_clean":"2024-09-12T18:01:26.596609+0000","last_became_active":"2024-09-12T17:21:50.764429+0000","last_became_peered":"2024-09-12T17:21:50.764429+0000","last_unstale":"2024-09-12T18:01:26.596609+0000","last_undegraded":"2024-09-12T18:01:26.596609+0000","last_fullsized":"2024-09-12T18:01:26.596609+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-12T18:01:26.596412+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.596412+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:20.074252+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2223469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":11534,"num_write":1063,"num_write_kb":33519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'1319","reported_seq":3066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.924176+0000","last_change":"2024-09-12T18:01:24.924077+0000","last_active":"2024-09-12T18:01:24.924176+0000","last_peered":"2024-09-12T18:01:24.924176+0000","last_clean":"2024-09-12T18:01:24.924176+0000","last_became_active":"2024-09-12T17:21:52.749885+0000","last_became_peered":"2024-09-12T17:21:52.749885+0000","last_unstale":"2024-09-12T18:01:24.924176+0000","last_undegraded":"2024-09-12T18:01:24.924176+0000","last_fullsized":"2024-09-12T18:01:24.924176+0000","mapping_epoch":27,"log_start":"265'1300","ondisk_log_start":"265'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1319","last_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_deep_scrub":"265'1319","last_deep_scrub_stamp":"2024-09-12T18:01:24.923970+0000","last_clean_scrub_stamp":"2024-09-12T18:01:24.923970+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":1300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:13.855563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6065,"num_read_kb":5351,"num_write":1827,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3376,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'431","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:15.487468+0000","last_change":"2024-09-12T18:01:15.487345+0000","last_active":"2024-09-12T18:01:15.487468+0000","last_peered":"2024-09-12T18:01:15.487468+0000","last_clean":"2024-09-12T18:01:15.487468+0000","last_became_active":"2024-09-12T17:21:50.770404+0000","last_became_peered":"2024-09-12T17:21:50.770404+0000","last_unstale":"2024-09-12T18:01:15.487468+0000","last_undegraded":"2024-09-12T18:01:15.487468+0000","last_fullsized":"2024-09-12T18:01:15.487468+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'431","last_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_deep_scrub":"265'431","last_deep_scrub_stamp":"2024-09-12T18:01:15.487068+0000","last_clean_scrub_stamp":"2024-09-12T18:01:15.487068+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.782666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":12654,"num_write":1335,"num_write_kb":18221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'853","reported_seq":2474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:17.216187+0000","last_change":"2024-09-12T18:01:17.216187+0000","last_active":"2024-09-12T18:01:17.216187+0000","last_peered":"2024-09-12T18:01:17.216187+0000","last_clean":"2024-09-12T18:01:17.216187+0000","last_became_active":"2024-09-12T17:21:52.755149+0000","last_became_peered":"2024-09-12T17:21:52.755149+0000","last_unstale":"2024-09-12T18:01:17.216187+0000","last_undegraded":"2024-09-12T18:01:17.216187+0000","last_fullsized":"2024-09-12T18:01:17.216187+0000","mapping_epoch":27,"log_start":"265'800","ondisk_log_start":"265'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'853","last_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_deep_scrub":"265'853","last_deep_scrub_stamp":"2024-09-12T18:01:17.216096+0000","last_clean_scrub_stamp":"2024-09-12T18:01:17.216096+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:08.132663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4167,"num_read_kb":3744,"num_write":1131,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'405","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.507694+0000","last_change":"2024-09-12T18:01:21.507619+0000","last_active":"2024-09-12T18:01:21.507694+0000","last_peered":"2024-09-12T18:01:21.507694+0000","last_clean":"2024-09-12T18:01:21.507694+0000","last_became_active":"2024-09-12T17:21:50.769220+0000","last_became_peered":"2024-09-12T17:21:50.769220+0000","last_unstale":"2024-09-12T18:01:21.507694+0000","last_undegraded":"2024-09-12T18:01:21.507694+0000","last_fullsized":"2024-09-12T18:01:21.507694+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T18:01:21.507507+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.507507+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:37.979878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111016,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":21305,"num_write":1293,"num_write_kb":33169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:25.612545+0000","last_change":"2024-09-12T18:01:25.612472+0000","last_active":"2024-09-12T18:01:25.612545+0000","last_peered":"2024-09-12T18:01:25.612545+0000","last_clean":"2024-09-12T18:01:25.612545+0000","last_became_active":"2024-09-12T17:21:50.764512+0000","last_became_peered":"2024-09-12T17:21:50.764512+0000","last_unstale":"2024-09-12T18:01:25.612545+0000","last_undegraded":"2024-09-12T18:01:25.612545+0000","last_fullsized":"2024-09-12T18:01:25.612545+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T18:01:25.612341+0000","last_clean_scrub_stamp":"2024-09-12T18:01:25.612341+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:10.180395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":645,"num_read_kb":38619,"num_write":1146,"num_write_kb":49754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'588","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:26.909762+0000","last_change":"2024-09-12T18:01:26.909762+0000","last_active":"2024-09-12T18:01:26.909762+0000","last_peered":"2024-09-12T18:01:26.909762+0000","last_clean":"2024-09-12T18:01:26.909762+0000","last_became_active":"2024-09-12T17:21:52.754827+0000","last_became_peered":"2024-09-12T17:21:52.754827+0000","last_unstale":"2024-09-12T18:01:26.909762+0000","last_undegraded":"2024-09-12T18:01:26.909762+0000","last_fullsized":"2024-09-12T18:01:26.909762+0000","mapping_epoch":27,"log_start":"265'500","ondisk_log_start":"265'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'588","last_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_deep_scrub":"265'588","last_deep_scrub_stamp":"2024-09-12T18:01:26.909677+0000","last_clean_scrub_stamp":"2024-09-12T18:01:26.909677+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:37.357766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3003,"num_read_kb":2740,"num_write":772,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:21.007007+0000","last_change":"2024-09-12T18:01:21.006935+0000","last_active":"2024-09-12T18:01:21.007007+0000","last_peered":"2024-09-12T18:01:21.007007+0000","last_clean":"2024-09-12T18:01:21.007007+0000","last_became_active":"2024-09-12T17:21:50.770697+0000","last_became_peered":"2024-09-12T17:21:50.770697+0000","last_unstale":"2024-09-12T18:01:21.007007+0000","last_undegraded":"2024-09-12T18:01:21.007007+0000","last_fullsized":"2024-09-12T18:01:21.007007+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T18:01:21.006814+0000","last_clean_scrub_stamp":"2024-09-12T18:01:21.006814+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:43.121834+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364838,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":51644,"num_write":1154,"num_write_kb":34921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'404","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T18:01:22.241009+0000","last_change":"2024-09-12T18:01:22.241009+0000","last_active":"2024-09-12T18:01:22.241009+0000","last_peered":"2024-09-12T18:01:22.241009+0000","last_clean":"2024-09-12T18:01:22.241009+0000","last_became_active":"2024-09-12T17:21:52.745653+0000","last_became_peered":"2024-09-12T17:21:52.745653+0000","last_unstale":"2024-09-12T18:01:22.241009+0000","last_undegraded":"2024-09-12T18:01:22.241009+0000","last_fullsized":"2024-09-12T18:01:22.241009+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T18:01:22.240903+0000","last_clean_scrub_stamp":"2024-09-12T18:01:22.240903+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:52.955110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2194,"num_write":455,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6105,"num_read_kb":4424,"num_write":1992,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4008,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16198,"num_read_kb":15887,"num_write":16772,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1633,"ondisk_log_size":1633,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":760,"ondisk_log_size":760,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553896,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16885,"num_read_kb":36225,"num_write":14143,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673122,"num_omap_keys":1554,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2231,"ondisk_log_size":2231,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2878,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212084,"num_read_kb":193695,"num_write":55146,"num_write_kb":18719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44063,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4149,"ondisk_log_size":4149,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83193324,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":36148,"num_read_kb":1816228,"num_write":72592,"num_write_kb":2095353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113262592,"data_stored":113262592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3606,"ondisk_log_size":3606,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":163167,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":167173,"num_write":182,"num_write_kb":116987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477233,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286084,"kb_used_data":20276,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94085756,"statfs":{"total":96636764160,"available":96343814144,"internally_reserved":0,"allocated":20762624,"data_stored":18763428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509938,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117088,"kb_used_data":17872,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94254752,"statfs":{"total":96636764160,"available":96516866048,"internally_reserved":0,"allocated":18300928,"data_stored":16277974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509937,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249488,"kb_used_data":15680,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94122352,"statfs":{"total":96636764160,"available":96381288448,"internally_reserved":0,"allocated":16056320,"data_stored":14054405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509937,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268336,"kb_used_data":20576,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94103504,"statfs":{"total":96636764160,"available":96361988096,"internally_reserved":0,"allocated":21069824,"data_stored":19072665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509939,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160940,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94210900,"statfs":{"total":96636764160,"available":96471961600,"internally_reserved":0,"allocated":21983232,"data_stored":19991308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509938,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342488,"kb_used_data":14216,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94029352,"statfs":{"total":96636764160,"available":96286056448,"internally_reserved":0,"allocated":14557184,"data_stored":12561929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509937,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146528,"kb_used_data":20944,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94225312,"statfs":{"total":96636764160,"available":96486719488,"internally_reserved":0,"allocated":21446656,"data_stored":19447593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575345,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265632,"kb_used_data":13776,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94106208,"statfs":{"total":96636764160,"available":96364756992,"internally_reserved":0,"allocated":14106624,"data_stored":12126360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17215488,"data_stored":17215488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9740288,"data_stored":9740288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17760256,"data_stored":17760256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16842752,"data_stored":16842752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11821056,"data_stored":11821056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15941632,"data_stored":15941632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":9895936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":6117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:33.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:02:34.169 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:02:34.169 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:02:34.169 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:02:34.170 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.212 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:02:34.213 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:02:34.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.275 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:02:34.275 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:02:34.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.327 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:02:34.327 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T18:02:34.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.380 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T18:02:34.380 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T18:02:34.381 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.439 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T18:02:34.439 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T18:02:34.439 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.487 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T18:02:34.487 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T18:02:34.487 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.538 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T18:02:34.538 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T18:02:34.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.587 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T18:02:34.587 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:02:34.587 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:02:34.587 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.612 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:02:34.612 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:02:34.612 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.641 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:02:34.641 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:02:34.641 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:02:34.642 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.666 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:02:34.667 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:02:34.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.719 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:02:34.719 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:02:34.719 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:02:34.731 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:02:34.731 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:02:34.731 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T18:02:34.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T18:02:34.802 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:02:35.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T18:02:35.082 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:02:35.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T18:02:35.203 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:02:35.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T18:02:35.285 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T18:02:35.399 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T18:02:35.400 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T18:02:35.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T18:02:35.618 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T18:02:35.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T18:02:35.715 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T18:02:35.787 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T18:02:35.788 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T18:02:35.843 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:02:35.845 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/data/mon.a.tgz 2024-09-12T18:02:35.845 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-12T18:02:35.875 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.cHMNDLCawF 2024-09-12T18:02:35.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cHMNDLCawF 2024-09-12T18:02:36.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.cHMNDLCawF 2024-09-12T18:02:36.208 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.cHMNDLCawF is 538KB 2024-09-12T18:02:36.305 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.cHMNDLCawF 2024-09-12T18:02:36.334 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/data/mon.c.tgz 2024-09-12T18:02:36.334 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-12T18:02:36.403 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.iYSe3ctSki 2024-09-12T18:02:36.404 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iYSe3ctSki 2024-09-12T18:02:36.616 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.iYSe3ctSki 2024-09-12T18:02:36.731 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.iYSe3ctSki is 564KB 2024-09-12T18:02:36.831 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.iYSe3ctSki 2024-09-12T18:02:36.861 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/data/mon.b.tgz 2024-09-12T18:02:36.861 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-09-12T18:02:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.wGduxV69cC 2024-09-12T18:02:36.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wGduxV69cC 2024-09-12T18:02:37.118 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.wGduxV69cC 2024-09-12T18:02:37.229 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.wGduxV69cC is 564KB 2024-09-12T18:02:37.311 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.wGduxV69cC 2024-09-12T18:02:37.340 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:02:37.340 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:02:37.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:02:37.453 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:02:37.485 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:02:37.486 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:02:37.491 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/remote/smithi063/crash 2024-09-12T18:02:37.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:02:37.533 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/remote/smithi082/crash 2024-09-12T18:02:37.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:02:37.572 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:02:37.572 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:02:37.578 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:02:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32901.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32901.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32901.log.gz 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32857.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32714.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32769.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32714.log.gz 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32813.log 2024-09-12T18:02:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32769.log.gz 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32813.log.gz 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.6.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32582.log 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32670.log 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32582.log.gz 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.32670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32670.log.gz 2024-09-12T18:02:37.666 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:02:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:02:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192536.log 2024-09-12T18:02:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96967.log 2024-09-12T18:02:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.192536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93433.log 2024-09-12T18:02:37.725 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192536.log.gz 2024-09-12T18:02:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.96967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38614.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.93433.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96967.log.gz 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45192.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.93433.log.gz 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128186.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38614.log.gz 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.45192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192766.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.45192.log.gz 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.128186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102268.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.128186.log.gz 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65245.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192766.log.gz 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.102268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100501.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.65245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192628.log 2024-09-12T18:02:37.726 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102268.log.gz 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.65245.log.gz 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.100501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91666.log 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106391.log 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192628.log.gz 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.91666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124652.log 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.91666.log.gz 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.106391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61448.log 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106391.log.gz 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.100501.log.gz 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160584.log 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.124652.log: /var/log/ceph/ceph-client.admin.61448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127008.log 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124652.log.gz 2024-09-12T18:02:37.727 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61448.log.gz 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.160584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99323.log 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.160584.log.gz 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.127008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91077.log 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.127008.log.gz 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.99323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147626.log 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99323.log.gz 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.91077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40053.log 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.91077.log.gz 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.147626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69558.log 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.147626.log.gz 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53154.log 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.69558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192260.log 2024-09-12T18:02:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.53154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137613.log 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.53154.log.gz 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192260.log.gzgzip 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.152338.log 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.137613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83420.log 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.152338.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69558.log.gz 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137613.log.gz 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123474.log 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.83420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193043.log 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.83420.log.gz 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.123474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192306.log 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118762.log 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.193043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193043.log.gz 2024-09-12T18:02:37.729 INFO:teuthology.orchestra.run.smithi063.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.152338.log.gz 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192306.log.gz 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90488.log 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.118762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76788.log 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118762.log.gz 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123474.log.gz 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.90488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135844.log 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.76788.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90488.log.gz 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192858.log 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.135844.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.76788.log.gz 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115815.log 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170472.log 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192858.log.gz 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.115815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192122.log 2024-09-12T18:02:37.730 INFO:teuthology.orchestra.run.smithi063.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.115815.log.gz 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.170472.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.135844.log.gz 92.2% 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.170472.log.gz 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161784.log 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192122.log.gz 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125241.log 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.161784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166592.log 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.125241.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.161784.log.gz 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125241.log.gz 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.166592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39392.log 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71417.log 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.166592.log.gz 2024-09-12T18:02:37.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149393.log 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39392.log.gz 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189948.log 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.71417.log: /var/log/ceph/ceph-client.admin.149393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111692.log 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.149393.log.gz 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.189948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53743.log 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.189948.log.gz 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.111692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167770.log 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111692.log.gz 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.53743.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71417.log.gz 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.163551.log 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.167770.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.53743.log.gz 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177296.log 2024-09-12T18:02:37.732 INFO:teuthology.orchestra.run.smithi063.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.167770.log.gz 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.163551.log: /var/log/ceph/ceph-client.admin.192582.log 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.163551.log.gz 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.177296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192490.log 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152927.log 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.177296.log.gz 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192582.log.gz 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120529.log 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192490.log.gz 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.152927.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.152927.log.gz 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.192076.log 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.120529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117584.log 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.120529.log.gz 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88132.log 2024-09-12T18:02:37.733 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192076.log.gz 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.117584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67076.log 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.117584.log.gz 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.88132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77548.log 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.67076.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88132.log.gz 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162962.log 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.77548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176688.log 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.77548.log.gz 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.162962.log: gzip -5 --verbose 80.5% -- replaced with /var/log/ceph/ceph-client.admin.162962.log.gz 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.104035.log 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.176688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86365.log 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114637.log 82.8% -- replaced with /var/log/ceph/ceph-client.admin.104035.log.gz 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.86365.log: gzip -5 81.8% -- replaced with /var/log/ceph/ceph-client.admin.86365.log.gz 2024-09-12T18:02:37.734 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.118173.log 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.114637.log: gzip 81.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.172625.log 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114637.log.gz 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.176688.log.gz 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.118173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179155.log 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.118173.log.gz 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.172625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144092.log 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.179155.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172625.log.gz 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119940.log 84.0% -- replaced with /var/log/ceph/ceph-client.0.179155.log.gz 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.144092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97556.log 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.119940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174596.log 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.97556.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119940.log.gz 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- 81.6% /var/log/ceph/ceph-client.admin.108158.log -- replaced with /var/log/ceph/ceph-client.admin.97556.log.gz 2024-09-12T18:02:37.735 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112870.log 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.144092.log.gz 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.174596.log: /var/log/ceph/ceph-client.admin.108158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64341.log 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr: 93.2% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174596.log.gz 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67076.log.gz 81.5% -- replaced with /var/log/ceph/ceph-client.admin.108158.log.gz 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59044.log 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.112870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59092.log 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.64341.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.112870.log.gz 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.59044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59044.log.gz 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72656.log 2024-09-12T18:02:37.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.59092.log: /var/log/ceph/ceph-client.admin.54332.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.59092.log.gz 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150571.log 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.72656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106980.log 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.150571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105213.log 85.2% -- replaced with /var/log/ceph/ceph-client.admin.150571.log.gz 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.106980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106980.log.gz 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107569.log 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105213.log.gz 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145859.log 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40007.log: /var/log/ceph/ceph-client.admin.107569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.107569.log.gz 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167181.log 2024-09-12T18:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.145859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151160.log 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.167181.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145859.log.gz 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110514.log 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.151160.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.167181.log.gz 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.72656.log.gz 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51339.log 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.151160.log.gz 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189899.log 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.110514.log: /var/log/ceph/ceph-client.admin.51339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65065.log 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.110514.log.gz 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51339.log.gz/var/log/ceph/ceph-client.admin.189899.log: 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189899.log.gz 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41520.log 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165366.log 2024-09-12T18:02:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.65065.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.65065.log.gz 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.41520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95789.log 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.41520.log.gz 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.165366.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.165366.log.gz 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189213.log 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.95789.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.78867.log 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr: 81.2%/var/log/ceph/ceph-client.admin.189213.log: -- replaced with /var/log/ceph/ceph-client.admin.95789.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116995.log 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189213.log.gz 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.78867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39696.log 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr: 51.2% -- replaced with /var/log/ceph/ceph-client.admin.78867.log.gz 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.116995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39780.log 2024-09-12T18:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39696.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116995.log.gz 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39696.log.gz -5 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56099.log 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39780.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.39780.log.gz --verbose 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.122885.log 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.56099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173988.log 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.56099.log.gz 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.122885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128775.log 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.122885.log.gz 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.173988.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.145270.log 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.128775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39022.log 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.173988.log.gz 2024-09-12T18:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.128775.log.gz 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.145270.log: gzip -5 --verbose 81.5% -- replaced with /var/log/ceph/ceph-client.admin.145270.log.gz 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.159995.log 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39022.log.gz 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135255.log 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192812.log 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.159995.log: /var/log/ceph/ceph-client.admin.135255.log: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57277.log 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159995.log.gz 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135255.log.gz 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158817.log 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192812.log.gz 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.57277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159406.log 2024-09-12T18:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57277.log.gz 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.158817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.191351.log 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.158817.log.gz 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.159406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81652.log 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.191351.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126419.log 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159406.log.gz 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.81652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49524.log 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.81652.log.gz 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192444.log 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.126419.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64341.log.gz 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49524.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.126419.log.gz 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.49524.log.gz 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64407.log 2024-09-12T18:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192444.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192444.log.gz 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.192951.log 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.64407.log: 59.3% -- replaced with /var/log/ceph/ceph-client.admin.64407.log.gz 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44589.log 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192951.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77379.log 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192951.log.gz 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.44589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87543.log 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44589.log.gz 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.77379.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.77379.log.gz 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.87543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134077.log 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.87543.log.gz 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95200.log 2024-09-12T18:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.134077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64277.log 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134077.log.gz 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.95200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175204.log 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.95200.log.gz 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192168.log 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.64277.log: /var/log/ceph/ceph-client.admin.175204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81063.log 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64277.log.gz 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121118.log 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175204.log.gz 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192168.log.gz 2024-09-12T18:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.81063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157050.log 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.81063.log.gz 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192030.log 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.121118.log: /var/log/ceph/ceph-client.admin.157050.log: gzip 81.6% -- replaced with /var/log/ceph/ceph-client.admin.121118.log.gz 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.189873.log 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.157050.log.gz 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192030.log.gz 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50702.log 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.189873.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189873.log.gz 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.82241.log 2024-09-12T18:02:37.745 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50702.log.gz 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103446.log 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.82241.log: gzip -5 --verbose 80.4% -- replaced with /var/log/ceph/ceph-client.admin.82241.log.gz 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.172017.log 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.103446.log: gzip -5 --verbose 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103446.log.gz 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.61496.log 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.172017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184636.log 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.172017.log.gz 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.61496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50113.log 83.3% -- replaced with /var/log/ceph/ceph-client.admin.61496.log.gz 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.184636.log: gzip -5 --verbose -- 80.4% /var/log/ceph/ceph-client.admin.143503.log 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.0.184636.log.gz 2024-09-12T18:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136433.log 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.50113.log.gz 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.143503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139380.log 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.143503.log.gz 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.136433.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.132310.log 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.136433.log.gz 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140558.log 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.139380.log: /var/log/ceph/ceph-client.admin.132310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39743.log 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr: 81.4%/var/log/ceph/ceph-client.admin.140558.log: -- replaced with /var/log/ceph/ceph-client.admin.132310.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127597.log 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139380.log.gz 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39743.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140558.log.gz 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39743.log.gz 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T18:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39379.log 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.127597.log: /var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38432.log 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86954.log 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39379.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127597.log.gz 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38432.log.gz 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39014.log 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178544.log 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.86954.log: /var/log/ceph/ceph-client.admin.39014.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39014.log.gz 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.67699.log 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.178544.log: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53130.log 80.1% -- replaced with /var/log/ceph/ceph-client.0.178544.log.gz 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86954.log.gz/var/log/ceph/ceph-client.admin.67699.log: 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39691.log 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.53130.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186463.log 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53130.log.gz 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39691.log.gz 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40300.log 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99912.log 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.40300.log: 94.2%/var/log/ceph/ceph-client.0.186463.log: -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.186463.log.gz 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82830.log 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48935.log 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40300.log.gz 2024-09-12T18:02:37.749 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.99912.log: /var/log/ceph/ceph-client.admin.82830.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.99912.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48346.log 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82830.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89310.log 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48935.log: /var/log/ceph/ceph-client.admin.48346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141147.log 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.67699.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.89310.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.48935.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.48346.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89310.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.193089.log 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.141147.log: gzip -5 81.9% -- replaced with /var/log/ceph/ceph-client.admin.141147.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.189849.log 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.193089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193089.log.gz 2024-09-12T18:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57866.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.189849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189849.log.gz 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85776.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.57866.log: gzip -5 --verbose 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57866.log.gz 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.189827.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.85776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39391.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.85776.log.gz 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.189827.log: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.189827.log.gz 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109925.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39391.log.gz 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40141.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.109925.log: gzip -5 --verbose -- 81.2% -- replaced with /var/log/ceph/ceph-client.admin.109925.log.gz 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.122296.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40141.log.gz 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157639.log 2024-09-12T18:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.122296.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122296.log.gz 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.157639.log: gzip 86.9% -- replaced with /var/log/ceph/ceph-client.0.191351.log.gz 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr: -5 81.3% -- replaced with /var/log/ceph/ceph-client.admin.157639.log.gz 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.155872.log 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102857.log 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.155872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75015.log 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.102857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187988.log 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102857.log.gz 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.75015.log: gzip -5 --verbose -- 84.1% -- replaced with /var/log/ceph/ceph-client.admin.75015.log.gz 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.94022.log 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr: 85.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53106.log 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155872.log.gz 2024-09-12T18:02:37.752 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.187988.log: /var/log/ceph/ceph-client.admin.94022.log: gzip -5 --verbose -- 82.7% -- replaced with /var/log/ceph/ceph-client.admin.187988.log.gz 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.148804.log 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94022.log.gz 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.53106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53106.log.gz 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.148804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109336.log 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.148804.log.gz 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39781.log 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.109336.log: /var/log/ceph/ceph-client.admin.138202.log 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.109336.log.gz 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39781.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39781.log.gz 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.164777.log 2024-09-12T18:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.138202.log: gzip -5 81.5% -- replaced with /var/log/ceph/ceph-client.admin.138202.log.gz 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70797.log 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.164777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173233.log 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.164777.log.gz 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.70797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148215.log 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.173233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96378.log 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr: 92.1%/var/log/ceph/ceph-client.admin.148215.log: -- replaced with /var/log/ceph/ceph-client.admin.173233.log.gz 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161763.log 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85187.log 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.96378.log: /var/log/ceph/ceph-client.admin.161763.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.96378.log.gz 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161763.log.gz 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.70797.log.gz 2024-09-12T18:02:37.754 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50750.log 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.148215.log.gz 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.85187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84009.log 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.85187.log.gz 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147037.log 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr: 85.1%/var/log/ceph/ceph-client.admin.84009.log: -- replaced with /var/log/ceph/ceph-client.admin.50750.log.gz 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142914.log 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.84009.log.gz 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.147037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131721.log 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.142914.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.147037.log.gz 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:gzip 81.7% -- replaced with /var/log/ceph/ceph-client.admin.142914.log.gz 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.192352.log 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.131721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169214.log 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.131721.log.gz 2024-09-12T18:02:37.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192352.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192352.log.gz 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62674.log 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.169214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139969.log 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.62674.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.169214.log.gz 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192720.log 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.62674.log.gz 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.139969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112281.log 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.139969.log.gz 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179764.log 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192720.log.gz 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.112281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166544.log 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.179764.log: gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112281.log.gz 2024-09-12T18:02:37.756 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.189167.log 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.179764.log.gz 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.166544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166544.log.gz 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39019.log 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.189167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39020.log 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.189167.log.gz 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185854.log 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39019.log.gz 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46824.log 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39020.log.gz 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.185854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59681.log 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.185854.log.gz 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50726.log 2024-09-12T18:02:37.757 INFO:teuthology.orchestra.run.smithi063.stderr: 82.7%gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.59681.log: -- replaced with /var/log/ceph/ceph-client.admin.46824.log.gz 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50726.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.59681.log.gz 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151749.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50726.log.gz 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144681.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.151749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39017.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8%/var/log/ceph/ceph-client.admin.144681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65834.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151749.log.gz 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.144681.log.gz 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39017.log.gz 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192214.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.65834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192997.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192214.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38765.log 2024-09-12T18:02:37.758 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192214.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192997.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.65834.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64193.log 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166568.log 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38765.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.64193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180373.log 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64193.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146448.log 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.166568.log: /var/log/ceph/ceph-client.0.180373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38525.log 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166568.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.146448.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.180373.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.146448.log.gz 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125830.log 2024-09-12T18:02:37.759 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38525.log.gz 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66457.log 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.125830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130542.log 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125830.log.gz 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.66457.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75607.log 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr: 85.8%/var/log/ceph/ceph-client.admin.130542.log: -- replaced with /var/log/ceph/ceph-client.admin.66457.log.gz 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.2.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.130542.log.gz 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108747.log 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.75607.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75607.log.gz 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40187.log 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.108747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129364.log 2024-09-12T18:02:37.760 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40187.log.gz 2024-09-12T18:02:37.821 INFO:teuthology.orchestra.run.smithi063.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.108747.log.gz 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63572.log 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.129364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161173.log 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.63572.log: 62.2% -- replaced with /var/log/ceph/ceph-client.admin.63572.log.gz 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.129364.log.gz 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62085.log 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.161173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39381.log 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.161173.log.gz 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.62085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134666.log 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39381.log.gz 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.62085.log.gz 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153516.log 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.134666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73320.log 2024-09-12T18:02:37.822 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.134666.log.gz 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.153516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40277.log 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.73320.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.153516.log.gz 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.73320.log.gz 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192904.log 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40277.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182809.log 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40277.log.gz 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38719.log 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192904.log: /var/log/ceph/ceph-client.0.182809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192904.log.gz 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.182809.log.gz 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38719.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38719.log.gz 2024-09-12T18:02:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154105.log 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.38589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115226.log 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.154105.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.154105.log.gz 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39025.log 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.115226.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.115226.log.gz 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56688.log 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39025.log.gz 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92844.log 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.56688.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.56688.log.gz 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119351.log 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.92844.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92844.log.gz 2024-09-12T18:02:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164729.log 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.119351.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119351.log.gz 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114048.log 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.164729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164729.log.gz 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.114048.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.114048.log.gz 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.log: 94.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39389.log 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59068.log 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39389.log.gz 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105802.log 2024-09-12T18:02:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.59068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59068.log.gz 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88721.log 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105802.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105802.log.gz 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175812.log 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.88721.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88721.log.gz 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54921.log 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.175812.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175812.log.gz 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39618.log 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.54921.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.54921.log.gz 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155283.log 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39618.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39618.log.gz 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61472.log 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.155283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39225.log 2024-09-12T18:02:37.826 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.155283.log.gz 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.61472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61472.log.gz 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43383.log 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.39225.log: /var/log/ceph/ceph-client.admin.51928.log 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.43383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40917.log 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51928.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.43383.log.gz 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.51928.log.gz 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32764.log 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58455.log 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.40917.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40917.log.gz 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32764.log.gz 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-09-12T18:02:37.827 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116404.log 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.58455.log: /var/log/ceph/ceph-client.admin.33199.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.58455.log.gz 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180982.log 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177935.log 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.116404.log: /var/log/ceph/ceph-client.0.180982.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.116404.log.gz 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.180982.log.gz 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184027.log 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.177935.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.177935.log.gz 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113459.log 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.184027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137022.log 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.184027.log.gz 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.113459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158228.log 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.137022.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113459.log.gz 2024-09-12T18:02:37.828 INFO:teuthology.orchestra.run.smithi063.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.137022.log.gz 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142325.log 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169864.log 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.158228.log: /var/log/ceph/ceph-client.admin.142325.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.158228.log.gz 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:gzip 89.0% -5 --verbose -- /var/log/ceph/ceph-client.0.78157.log 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.142325.log.gz 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101090.log 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.169864.log: /var/log/ceph/ceph-client.0.78157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141736.log 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.78157.log.gz 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.101090.log: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47428.log 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101090.log.gz/var/log/ceph/ceph-client.admin.141736.log: 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141736.log.gz 2024-09-12T18:02:37.829 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26683.log 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98734.log 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.47428.log.gz 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.26683.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192398.log 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.26683.log.gz 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.98734.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98734.log.gz 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169864.log.gz 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138791.log 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192398.log.gz 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183418.log 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.138791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162373.log 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.138791.log.gz/var/log/ceph/ceph-client.0.183418.log: 2024-09-12T18:02:37.830 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98145.log 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.183418.log.gz 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.162373.log: -- /var/log/ceph/ceph-client.0.79609.log 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.98145.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80474.log 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.162373.log.gz 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.98145.log.gz 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.0.79609.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.154694.log 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr: 79.9%/var/log/ceph/ceph-client.admin.80474.log: -- replaced with /var/log/ceph/ceph-client.0.79609.log.gz 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189924.log 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.80474.log.gz 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.154694.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.154694.log.gz 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68319.log 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156461.log 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.189924.log: /var/log/ceph/ceph-client.admin.68319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63849.log 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189924.log.gz 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.156461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39598.log 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.156461.log.gz 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.63849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192674.log 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39598.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.63849.log.gz 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39598.log.gz 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39393.log 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131132.log 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.192674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192674.log.gz 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39393.log.gz 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129953.log 2024-09-12T18:02:37.832 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94611.log 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.131132.log: /var/log/ceph/ceph-client.admin.129953.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131132.log.gz 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.129953.log.gz 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149982.log 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5/var/log/ceph/ceph-client.admin.94611.log: --verbose -- /var/log/ceph/ceph-client.admin.70178.log 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.94611.log.gz 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.149982.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.68319.log.gz 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.70178.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.149982.log.gz 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190643.log 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60859.log 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.190643.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.190643.log.gz 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64471.log 2024-09-12T18:02:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.60859.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.60859.log.gz 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43986.log 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.64471.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.64471.log.gz 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165955.log 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.43986.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43986.log.gz 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111103.log 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.165955.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.165955.log.gz 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39023.log 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.111103.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.111103.log.gz 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39023.log.gz 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188577.log 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.52517.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2024-09-12T18:02:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133488.log 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.188577.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.188577.log.gz 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55510.log 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.133488.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.133488.log.gz 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193133.log 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.55510.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.55510.log.gz 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92255.log 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.193133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193133.log.gz 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171409.log 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.92255.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.92255.log.gz 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68938.log 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.171409.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.171409.log.gz 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65131.log 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.68938.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.68938.log.gz 2024-09-12T18:02:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74426.log 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.65131.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.65131.log.gz 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164140.log 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.74426.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.74426.log.gz 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121707.log 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.164140.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164140.log.gz 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181591.log 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.121707.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121707.log.gz 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104624.log 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.181591.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.181591.log.gz 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42129.log 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104624.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104624.log.gz 2024-09-12T18:02:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132899.log 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.42129.log: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.70178.log.gz 43.9% -- replaced with /var/log/ceph/ceph-client.0.42129.log.gz 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189237.log 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39961.log 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.132899.log: /var/log/ceph/ceph-client.admin.189237.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.132899.log.gz 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.189237.log.gz 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38673.log 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182200.log 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39961.log.gz 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38673.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.185245.log 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42774.log 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.182200.log: /var/log/ceph/ceph-client.0.185245.log: 83.7% 80.2% -- replaced with /var/log/ceph/ceph-client.0.182200.log.gz 2024-09-12T18:02:37.837 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.0.185245.log.gz 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76197.log 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189189.log 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.42774.log: /var/log/ceph/ceph-client.admin.76197.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.42774.log.gz 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.76197.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72037.log 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.189189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189189.log.gz 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39782.log 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.72037.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72037.log.gz 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101679.log 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39782.log.gz 2024-09-12T18:02:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89899.log 2024-09-12T18:02:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.101679.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.101679.log.gz 2024-09-12T18:02:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63967.log 2024-09-12T18:02:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.89899.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.89899.log.gz 2024-09-12T18:02:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60270.log 2024-09-12T18:02:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.63967.log: 50.9% -- replaced with /var/log/ceph/ceph-client.admin.63967.log.gz 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40231.log 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.60270.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.60270.log.gz 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40097.log 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40231.log.gz 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84598.log 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40097.log.gz 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79000.log 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.84598.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.84598.log.gz 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124063.log 2024-09-12T18:02:37.843 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.79000.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.79000.log.gz 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164753.log 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.124063.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124063.log.gz 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191984.log 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.164753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164753.log.gz 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38811.log 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.191984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191984.log.gz 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39024.log 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38811.log.gz 2024-09-12T18:02:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39024.log.gz 2024-09-12T18:02:37.933 INFO:teuthology.orchestra.run.smithi082.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:02:38.313 INFO:teuthology.orchestra.run.smithi063.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi082.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi063.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:02:41.278 INFO:teuthology.orchestra.run.smithi063.stderr: 93.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T18:02:47.427 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T18:02:48.230 INFO:teuthology.orchestra.run.smithi082.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T18:02:48.813 INFO:teuthology.orchestra.run.smithi063.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:02:49.049 INFO:teuthology.orchestra.run.smithi063.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:02:51.452 INFO:teuthology.orchestra.run.smithi063.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:02:52.266 INFO:teuthology.orchestra.run.smithi082.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T18:02:59.905 INFO:teuthology.orchestra.run.smithi082.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T18:02:59.907 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-09-12T18:02:59.907 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m22.266s 2024-09-12T18:02:59.907 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m56.409s 2024-09-12T18:02:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m2.024s 2024-09-12T18:02:59.958 INFO:teuthology.orchestra.run.smithi063.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T18:02:59.960 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T18:02:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m22.355s 2024-09-12T18:02:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:user 1m2.610s 2024-09-12T18:02:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m2.249s 2024-09-12T18:02:59.961 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:02:59.961 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/remote/smithi063/log 2024-09-12T18:02:59.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:03:08.646 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/remote/smithi082/log 2024-09-12T18:03:08.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:03:16.736 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:03:16.749 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:03:16.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:03:16.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:03:16.852 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:03:16.864 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:03:16.865 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:03:16.867 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:03:16.897 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:03:16.898 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:03:16.902 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:03:16.902 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-12T18:03:16.902 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +806us[ +787us] +/- 44ms 2024-09-12T18:03:16.902 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -161us[ -161us] +/- 56ms 2024-09-12T18:03:16.902 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -1460us[-1460us] +/- 88ms 2024-09-12T18:03:16.902 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:03:16.903 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:03:16.904 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-09-12T18:03:16.904 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +900us[ +895us] +/- 44ms 2024-09-12T18:03:16.904 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -92us[ -92us] +/- 57ms 2024-09-12T18:03:16.904 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 67 -1343us[-1350us] +/- 87ms 2024-09-12T18:03:16.904 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:03:16.904 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:03:16.915 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:03:16.916 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:03:16.928 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:03:17.025 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:03:17.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:03:17.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:03:17.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:03:17.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:03:17.193 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:03:17.205 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:03:17.216 INFO:teuthology.task.internal:Duration was 2959.485347 seconds 2024-09-12T18:03:17.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:03:17.232 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:03:17.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:03:17.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:03:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:03:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:03:17.478 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:03:17.478 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T18:03:17.479 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:03:17.513 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-09-12T18:03:17.513 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:03:17.548 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:03:17.548 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:03:17.555 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:03:17.629 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:03:17.629 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:03:17.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:03:17.782 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:03:17.795 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:03:17.795 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:03:17.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:03:17.872 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:03:17.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:03:17.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:03:17.924 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-12T18:03:17.949 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-09-12T18:03:17.972 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:03:18.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:03:18.007 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:03:18.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:03:18.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:03:18.056 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:03:18.057 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/remote/smithi063 2024-09-12T18:03:18.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:03:18.109 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902722/remote/smithi082 2024-09-12T18:03:18.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:03:18.157 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:03:18.157 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:03:18.160 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:03:18.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:03:18.233 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:03:18.233 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:03:18.247 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:03:18.247 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:03:18.250 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:03:18.276 INFO:teuthology.orchestra.run.smithi063.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:03 /home/ubuntu/cephtest 2024-09-12T18:03:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:03 /home/ubuntu/cephtest 2024-09-12T18:03:18.291 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:03:18.302 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:03:18.358 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2959.4853467941284 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T18:03:18.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:03:18.484 INFO:teuthology.run:pass